2021-07-26T15:35:26.404 INFO:root:teuthology version: 1.1.0-b6f3efab 2021-07-26T15:35:26.406 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293851 --owner scheduled_sage@teuthology --name sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi --description upgrade/pacific-x/parallel/{0-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} --verbose -- /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293851/orig.config.yaml 2021-07-26T15:35:26.458 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-07-26T15:35:26.514 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293851 branch: wip-kefu-testing-2021-07-24-1158 description: upgrade/pacific-x/parallel/{0-distro$/{ubuntu_20.04} 0-start 1-tasks mon_election/connectivity upgrade-sequence workload/{ec-rados-default rados_api rados_loadgenbig rbd_import_export test_rbd_api test_rbd_python}} email: null first_in_suite: false job_id: '6293851' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'run run randomized correctness test for rados operations on an erasure-coded pool ' - desc: 'object class functional tests ' - desc: 'generate read/write load with rados objects ranging from 1MB to 25MB ' - desc: 'run basic import/export cli tests for rbd ' - desc: 'librbd C and C++ api tests ' - desc: 'librbd python api tests ' name: sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-kefu-testing-2021-07-24-1158 ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true create_rbd_pool: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e workunit: branch: wip-kefu-testing-2021-07-24-1158 sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e owner: scheduled_sage@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e sleep_before_teardown: 0 suite: upgrade suite_branch: wip-kefu-testing-2021-07-24-1158 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e targets: smithi033.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDmFtf2dg+WjuIBniivsQS7FfBWDZV3TS5t6GCYCUX6YuEJArIEvkF7/Ff+gWMhiONtfkyp2s2FExH+TAmxI7v0a6X1/nH7jwfE33YX9XPclZG9AhzA0OMbNgRKOnMTKNl3MhAzcWxY2Sq35iq2bU9LE8jorgPZxCjWSzYkNUqey0qxy04X+x7oJl8MKuvGh2c1D7iQo7b97MPO4vedlViuze3MNELkFkNBNzRHCbndrUtHsiBX/WKH32Hifpi+bnyD2wDqSaiF/7AUOMx4uGaxmTccvkJgwXoS8T/0JxQ8Row8iMZqNhKjlwfISWFgFrN4CoOQREka8C4kaepTGO284DauydDKuXYkqNS7wP2iRqmc47DOzEOciHtYr5It+sEKAg0KdauF1W6Xemt2BXHev/8kBsymDg6PKSX+lL84Lzb7/7HvhYkPIrxY51kTCT9YFr0KZ35ou44l2eRv/hnPGbpFJokQ3IRHbkqff1XNSpxOQ09IcPf5s3aR51byI6k= smithi096.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDqdIKPB8uwUF9v4Fz56irrSaW7GQANgkXX4nHBEj3lEDanxjRmepxrsYvXbjdk4jK5JJ3MeSuNGVbbwEVy9FZiMFp/Fv8zdZ8TC+gnutqaT0kbrMjSjMPQ292XVY9BXnooph0lnoyg/j49gjiE+6xS0xBLPHCPJn/vw/RqiTbs6Xym+9JfPDtkA0CCCUDIANtrhe/nbAP2zDj4LsNZ+iYgRhRCAEzbwPgg78S1EYgLjvukpXuk13y4Fbk+cpEqRUBHoUpUsyKDu2a+O7HAYw4YMoXj6DXrlupb4P2eICyVv84t/9j5HZzswR6NSoIaTssVF6031lTFR1bq5bPC/rNXYL02phmCCOuLS7PMiFTa3h5oUnrq3HUy5wikkPqjm9kHgCGa2eIc9SdBEoYveyH55ZP1CtKn69Fjm8F8xSuuskv29Cc3u0QH9HhXBfpVqYJrj7aRHkCkaX6B832uI5WzWiwvh3b7nCb1WAuEVEOg5Bu+zleXD804z4SB1l/niFs= tasks: - install: branch: pacific - print: '**** done install task...' - print: '**** done start installing pacific cephadm ...' - cephadm: cephadm_branch: pacific cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: docker.io/ceph/daemon-base:latest-pacific - print: '**** done end installing pacific cephadm ...' - print: '**** done start cephadm.shell ceph config set mgr...' - cephadm.shell: mon.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - print: '**** done start parallel' - parallel: - workload - upgrade-sequence - print: '**** done end parallel' teuthology_branch: master teuthology_sha1: b6f3efab84b70e18e86ec271a07564aeb4ed3bac timestamp: 2021-07-26_15:05:01 tube: smithi upgrade-sequence: sequential: - print: '**** done start upgrade, wait' - cephadm.shell: env: - sha1 mon.a: - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - print: '**** done end upgrade, wait...' user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.30581 workload: full_sequential: - print: '**** done start ec-rados-default.yaml' - rados: clients: - client.0 ec_pool: true objects: 50 op_weights: append: 100 copy_from: 50 delete: 50 read: 100 rmattr: 25 rollback: 50 setattr: 25 snap_create: 50 snap_remove: 50 write: 0 ops: 4000 write_append_excl: false - print: '**** done end ec-rados-default.yaml' - print: '**** done start rados_api.yaml' - workunit: branch: pacific clients: client.0: - cls - print: '**** done end rados_api.yaml' - print: '**** done start rados_loadgenbig.yaml' - workunit: branch: pacific clients: client.0: - rados/load-gen-big.sh - print: '**** done end rados_loadgenbig.yaml' - print: '**** done start rbd_import_export.yaml' - workunit: branch: pacific clients: client.1: - rbd/import_export.sh env: RBD_CREATE_ARGS: --new-format - print: '**** done end rbd_import_export.yaml' - print: '**** done start test_rbd_api.yaml' - workunit: branch: pacific clients: client.0: - rbd/test_librbd.sh - print: '**** done end test_rbd_api.yaml' - print: '**** done start test_rbd_python.yaml' - workunit: branch: pacific clients: client.0: - rbd/test_librbd_python.sh - print: '**** done end test_rbd_python.yaml' 2021-07-26T15:35:26.515 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa; will attempt to use it 2021-07-26T15:35:26.515 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa/tasks 2021-07-26T15:35:26.516 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-07-26T15:35:26.518 INFO:teuthology.task.internal:Checking packages... 2021-07-26T15:35:26.539 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e' 2021-07-26T15:35:26.539 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:35:26.540 INFO:teuthology.packaging:ref: None 2021-07-26T15:35:26.540 INFO:teuthology.packaging:tag: None 2021-07-26T15:35:26.541 INFO:teuthology.packaging:branch: wip-kefu-testing-2021-07-24-1158 2021-07-26T15:35:26.541 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:35:26.541 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-kefu-testing-2021-07-24-1158 2021-07-26T15:35:26.742 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-6381-gbccf07c2-1focal 2021-07-26T15:35:26.744 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-07-26T15:35:26.755 INFO:teuthology.task.internal:no buildpackages task found 2021-07-26T15:35:26.756 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-07-26T15:35:26.835 INFO:teuthology.task.internal:Saving configuration 2021-07-26T15:35:26.856 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-07-26T15:35:26.889 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-26T15:35:26.908 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-07-26 15:30:04.541796', 'description': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293851', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHPT0ame/tsGjOLqXpQ4GElmqTM68uAJ2emzkO81P4X7', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi033.front.sepia.ceph.com'} 2021-07-26T15:35:26.924 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-07-26 15:30:04.541774', 'description': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293851', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBnYev/8uukbvPAd0f0D0k5DxAb32D93F9v+/IyiaOpD', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi096.front.sepia.ceph.com'} 2021-07-26T15:35:26.925 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-07-26T15:35:26.938 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2021-07-26T15:35:26.938 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2021-07-26T15:35:26.938 INFO:teuthology.run_tasks:Running task console_log... 2021-07-26T15:35:27.040 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6365606b70>, signals=[15]) 2021-07-26T15:35:27.041 INFO:teuthology.run_tasks:Running task internal.connect... 2021-07-26T15:35:27.055 INFO:teuthology.task.internal:Opening connections... 2021-07-26T15:35:27.056 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2021-07-26T15:35:27.058 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:35:27.111 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2021-07-26T15:35:27.112 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:35:27.161 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-07-26T15:35:27.173 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2021-07-26T15:35:27.190 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2021-07-26T15:35:27.190 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2021-07-26T15:35:27.240 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Ubuntu" 2021-07-26T15:35:27.241 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-07-26T15:35:27.241 INFO:teuthology.orchestra.run.smithi033.stdout:ID=ubuntu 2021-07-26T15:35:27.241 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE=debian 2021-07-26T15:35:27.241 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-07-26T15:35:27.242 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="20.04" 2021-07-26T15:35:27.242 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.ubuntu.com/" 2021-07-26T15:35:27.242 INFO:teuthology.orchestra.run.smithi033.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-07-26T15:35:27.242 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-07-26T15:35:27.243 INFO:teuthology.orchestra.run.smithi033.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-07-26T15:35:27.243 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_CODENAME=focal 2021-07-26T15:35:27.243 INFO:teuthology.orchestra.run.smithi033.stdout:UBUNTU_CODENAME=focal 2021-07-26T15:35:27.244 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2021-07-26T15:35:27.258 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2021-07-26T15:35:27.265 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2021-07-26T15:35:27.265 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2021-07-26T15:35:27.312 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2021-07-26T15:35:27.313 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-07-26T15:35:27.313 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2021-07-26T15:35:27.313 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2021-07-26T15:35:27.314 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-07-26T15:35:27.314 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="20.04" 2021-07-26T15:35:27.314 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2021-07-26T15:35:27.314 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-07-26T15:35:27.315 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-07-26T15:35:27.315 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-07-26T15:35:27.315 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=focal 2021-07-26T15:35:27.315 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=focal 2021-07-26T15:35:27.316 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2021-07-26T15:35:27.336 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-07-26T15:35:27.352 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-07-26T15:35:27.437 INFO:teuthology.task.internal:Checking for old test directory... 2021-07-26T15:35:27.438 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2021-07-26T15:35:27.440 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2021-07-26T15:35:27.446 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-07-26T15:35:27.506 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-07-26T15:35:27.507 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2021-07-26T15:35:27.510 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2021-07-26T15:35:27.526 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-07-26T15:35:27.624 INFO:teuthology.run_tasks:Running task kernel... 2021-07-26T15:35:27.656 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}} 2021-07-26T15:35:27.657 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-07-26T15:35:27.658 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2021-07-26T15:35:27.665 INFO:teuthology.orchestra.run.smithi033.stdout:5.4.0-66-generic 2021-07-26T15:35:27.665 INFO:teuthology.task.kernel:Running kernel on smithi033: 5.4.0-66-generic 2021-07-26T15:35:27.666 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get clean 2021-07-26T15:35:27.767 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get update 2021-07-26T15:35:27.941 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:35:28.041 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:35:28.127 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-07-26T15:35:28.193 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:35:28.252 INFO:teuthology.orchestra.run.smithi033.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:35:28.283 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [155 kB] 2021-07-26T15:35:28.287 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,304 B] 2021-07-26T15:35:28.288 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [16.5 kB] 2021-07-26T15:35:28.288 INFO:teuthology.orchestra.run.smithi033.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [327 kB] 2021-07-26T15:35:28.292 INFO:teuthology.orchestra.run.smithi033.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.4 kB] 2021-07-26T15:35:28.293 INFO:teuthology.orchestra.run.smithi033.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:35:28.294 INFO:teuthology.orchestra.run.smithi033.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:35:28.303 INFO:teuthology.orchestra.run.smithi033.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:35:28.310 INFO:teuthology.orchestra.run.smithi033.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [97.5 kB] 2021-07-26T15:35:28.311 INFO:teuthology.orchestra.run.smithi033.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.9 kB] 2021-07-26T15:35:28.317 INFO:teuthology.orchestra.run.smithi033.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [25.4 kB] 2021-07-26T15:35:28.318 INFO:teuthology.orchestra.run.smithi033.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,912 B] 2021-07-26T15:35:28.326 INFO:teuthology.orchestra.run.smithi033.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,952 B] 2021-07-26T15:35:28.327 INFO:teuthology.orchestra.run.smithi033.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [600 B] 2021-07-26T15:35:28.471 INFO:teuthology.orchestra.run.smithi033.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:35:28.601 INFO:teuthology.orchestra.run.smithi033.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,126 kB] 2021-07-26T15:35:28.921 INFO:teuthology.orchestra.run.smithi033.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [511 kB] 2021-07-26T15:35:28.940 INFO:teuthology.orchestra.run.smithi033.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [245 kB] 2021-07-26T15:35:28.948 INFO:teuthology.orchestra.run.smithi033.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.8 kB] 2021-07-26T15:35:28.949 INFO:teuthology.orchestra.run.smithi033.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [367 kB] 2021-07-26T15:35:28.961 INFO:teuthology.orchestra.run.smithi033.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.2 kB] 2021-07-26T15:35:28.962 INFO:teuthology.orchestra.run.smithi033.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [52.9 kB] 2021-07-26T15:35:28.963 INFO:teuthology.orchestra.run.smithi033.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:35:28.964 INFO:teuthology.orchestra.run.smithi033.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [843 kB] 2021-07-26T15:35:29.031 INFO:teuthology.orchestra.run.smithi033.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [626 kB] 2021-07-26T15:35:29.051 INFO:teuthology.orchestra.run.smithi033.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [176 kB] 2021-07-26T15:35:29.053 INFO:teuthology.orchestra.run.smithi033.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [18.4 kB] 2021-07-26T15:35:29.055 INFO:teuthology.orchestra.run.smithi033.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [7,472 B] 2021-07-26T15:35:29.055 INFO:teuthology.orchestra.run.smithi033.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [23.6 kB] 2021-07-26T15:35:29.055 INFO:teuthology.orchestra.run.smithi033.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,472 B] 2021-07-26T15:35:29.106 INFO:teuthology.orchestra.run.smithi033.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [676 B] 2021-07-26T15:35:29.106 INFO:teuthology.orchestra.run.smithi033.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [2,568 B] 2021-07-26T15:35:29.107 INFO:teuthology.orchestra.run.smithi033.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [2,568 B] 2021-07-26T15:35:29.138 INFO:teuthology.orchestra.run.smithi033.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [1,120 B] 2021-07-26T15:35:29.138 INFO:teuthology.orchestra.run.smithi033.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [400 B] 2021-07-26T15:35:29.140 INFO:teuthology.orchestra.run.smithi033.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [5,792 B] 2021-07-26T15:35:29.140 INFO:teuthology.orchestra.run.smithi033.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [4,724 B] 2021-07-26T15:35:29.188 INFO:teuthology.orchestra.run.smithi033.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [2,060 B] 2021-07-26T15:35:29.188 INFO:teuthology.orchestra.run.smithi033.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [288 B] 2021-07-26T15:35:32.303 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 7,282 kB in 1s (5,007 kB/s) 2021-07-26T15:35:33.445 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2021-07-26T15:35:33.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:35:33.534 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2021-07-26T15:35:33.695 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2021-07-26T15:35:33.696 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2021-07-26T15:35:33.777 INFO:teuthology.orchestra.run.smithi033.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:35:33.779 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:35:33.780 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:35:33.851 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2021-07-26T15:35:34.011 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2021-07-26T15:35:34.012 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2021-07-26T15:35:34.154 INFO:teuthology.orchestra.run.smithi033.stdout:The following additional packages will be installed: 2021-07-26T15:35:34.154 INFO:teuthology.orchestra.run.smithi033.stdout: linux-generic linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:35:34.154 INFO:teuthology.orchestra.run.smithi033.stdout: linux-headers-generic linux-image-5.4.0-80-generic 2021-07-26T15:35:34.155 INFO:teuthology.orchestra.run.smithi033.stdout: linux-modules-5.4.0-80-generic linux-modules-extra-5.4.0-80-generic 2021-07-26T15:35:34.155 INFO:teuthology.orchestra.run.smithi033.stdout:Suggested packages: 2021-07-26T15:35:34.155 INFO:teuthology.orchestra.run.smithi033.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-07-26T15:35:34.156 INFO:teuthology.orchestra.run.smithi033.stdout:Recommended packages: 2021-07-26T15:35:34.156 INFO:teuthology.orchestra.run.smithi033.stdout: thermald 2021-07-26T15:35:34.185 INFO:teuthology.orchestra.run.smithi033.stdout:The following NEW packages will be installed: 2021-07-26T15:35:34.186 INFO:teuthology.orchestra.run.smithi033.stdout: linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:35:34.186 INFO:teuthology.orchestra.run.smithi033.stdout: linux-image-5.4.0-80-generic linux-modules-5.4.0-80-generic 2021-07-26T15:35:34.186 INFO:teuthology.orchestra.run.smithi033.stdout: linux-modules-extra-5.4.0-80-generic 2021-07-26T15:35:34.187 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages will be upgraded: 2021-07-26T15:35:34.187 INFO:teuthology.orchestra.run.smithi033.stdout: linux-generic linux-headers-generic linux-image-generic 2021-07-26T15:35:34.367 INFO:teuthology.orchestra.run.smithi033.stdout:3 upgraded, 5 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:35:34.367 INFO:teuthology.orchestra.run.smithi033.stdout:Need to get 75.6 MB of archives. 2021-07-26T15:35:34.367 INFO:teuthology.orchestra.run.smithi033.stdout:After this operation, 377 MB of additional disk space will be used. 2021-07-26T15:35:34.368 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-80-generic amd64 5.4.0-80.90 [14.8 MB] 2021-07-26T15:35:35.494 INFO:teuthology.orchestra.run.smithi033.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-80-generic amd64 5.4.0-80.90 [8,976 kB] 2021-07-26T15:35:35.693 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-80-generic amd64 5.4.0-80.90 [39.4 MB] 2021-07-26T15:35:37.041 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.80.84 [1,900 B] 2021-07-26T15:35:37.042 INFO:teuthology.orchestra.run.smithi033.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.80.84 [2,568 B] 2021-07-26T15:35:37.043 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80 all 5.4.0-80.90 [11.0 MB] 2021-07-26T15:35:37.617 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80-generic amd64 5.4.0-80.90 [1,410 kB] 2021-07-26T15:35:37.694 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.80.84 [2,436 B] 2021-07-26T15:35:38.103 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 75.6 MB in 4s (21.6 MB/s) 2021-07-26T15:35:38.256 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-modules-5.4.0-80-generic. 2021-07-26T15:35:39.696 INFO:teuthology.orchestra.run.smithi033.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-07-26T15:35:39.701 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../0-linux-modules-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:35:39.854 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:35:41.956 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-image-5.4.0-80-generic. 2021-07-26T15:35:41.969 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../1-linux-image-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:35:42.074 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:35:43.131 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-80-generic. 2021-07-26T15:35:43.146 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:35:43.189 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:35:48.378 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../3-linux-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:35:48.521 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:35:48.886 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:35:49.036 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-image-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:35:49.384 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-headers-5.4.0-80. 2021-07-26T15:35:49.397 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../5-linux-headers-5.4.0-80_5.4.0-80.90_all.deb ... 2021-07-26T15:35:49.433 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:35:56.053 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package linux-headers-5.4.0-80-generic. 2021-07-26T15:35:56.073 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../6-linux-headers-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:35:56.110 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:35:58.878 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:35:59.008 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking linux-headers-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:35:59.390 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:01.530 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:36:01.948 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:03.119 INFO:teuthology.orchestra.run.smithi033.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:36:03.119 INFO:teuthology.orchestra.run.smithi033.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-80-generic 2021-07-26T15:36:03.292 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:03.418 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:04.794 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-image-generic (5.4.0.80.84) ... 2021-07-26T15:36:05.070 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-headers-generic (5.4.0.80.84) ... 2021-07-26T15:36:05.196 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up linux-generic (5.4.0.80.84) ... 2021-07-26T15:36:05.348 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:05.546 INFO:teuthology.orchestra.run.smithi033.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-07-26T15:36:05.546 INFO:teuthology.orchestra.run.smithi033.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:36:27.767 INFO:teuthology.orchestra.run.smithi033.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-07-26T15:36:27.768 INFO:teuthology.orchestra.run.smithi033.stdout:Sourcing file `/etc/default/grub' 2021-07-26T15:36:27.775 INFO:teuthology.orchestra.run.smithi033.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:36:27.800 INFO:teuthology.orchestra.run.smithi033.stdout:Generating grub configuration file ... 2021-07-26T15:36:28.156 INFO:teuthology.orchestra.run.smithi033.stdout:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:36:28.183 INFO:teuthology.orchestra.run.smithi033.stdout:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:36:28.600 INFO:teuthology.orchestra.run.smithi033.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:36:28.612 INFO:teuthology.orchestra.run.smithi033.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:36:30.790 INFO:teuthology.orchestra.run.smithi033.stdout:done 2021-07-26T15:36:31.176 DEBUG:teuthology.orchestra.run.smithi033:> dpkg -s linux-image-generic 2021-07-26T15:36:31.206 INFO:teuthology.orchestra.run.smithi033.stdout:Package: linux-image-generic 2021-07-26T15:36:31.207 INFO:teuthology.orchestra.run.smithi033.stdout:Status: install ok installed 2021-07-26T15:36:31.207 INFO:teuthology.orchestra.run.smithi033.stdout:Priority: optional 2021-07-26T15:36:31.207 INFO:teuthology.orchestra.run.smithi033.stdout:Section: kernel 2021-07-26T15:36:31.207 INFO:teuthology.orchestra.run.smithi033.stdout:Installed-Size: 18 2021-07-26T15:36:31.208 INFO:teuthology.orchestra.run.smithi033.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:36:31.208 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: amd64 2021-07-26T15:36:31.208 INFO:teuthology.orchestra.run.smithi033.stdout:Source: linux-meta 2021-07-26T15:36:31.208 INFO:teuthology.orchestra.run.smithi033.stdout:Version: 5.4.0.80.84 2021-07-26T15:36:31.208 INFO:teuthology.orchestra.run.smithi033.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:36:31.209 INFO:teuthology.orchestra.run.smithi033.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:36:31.209 INFO:teuthology.orchestra.run.smithi033.stdout:Recommends: thermald 2021-07-26T15:36:31.209 INFO:teuthology.orchestra.run.smithi033.stdout:Description: Generic Linux kernel image 2021-07-26T15:36:31.209 INFO:teuthology.orchestra.run.smithi033.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:36:31.210 INFO:teuthology.orchestra.run.smithi033.stdout: available. 2021-07-26T15:36:31.210 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-80-generic 2021-07-26T15:36:31.211 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2021-07-26T15:36:31.218 INFO:teuthology.orchestra.run.smithi096.stdout:5.4.0-66-generic 2021-07-26T15:36:31.218 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.4.0-66-generic 2021-07-26T15:36:31.219 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2021-07-26T15:36:31.301 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2021-07-26T15:36:31.449 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:36:31.566 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:36:31.649 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-07-26T15:36:31.696 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:36:31.780 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:36:31.784 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [155 kB] 2021-07-26T15:36:31.787 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,304 B] 2021-07-26T15:36:31.787 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [17.9 kB] 2021-07-26T15:36:31.787 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [331 kB] 2021-07-26T15:36:31.791 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.6 kB] 2021-07-26T15:36:31.793 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:36:31.793 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:36:31.801 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:36:31.810 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [97.5 kB] 2021-07-26T15:36:31.811 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.9 kB] 2021-07-26T15:36:31.822 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [6,464 B] 2021-07-26T15:36:31.822 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.6 kB] 2021-07-26T15:36:31.824 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,648 B] 2021-07-26T15:36:31.824 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [600 B] 2021-07-26T15:36:31.986 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:36:32.111 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,126 kB] 2021-07-26T15:36:32.431 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [511 kB] 2021-07-26T15:36:32.459 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [245 kB] 2021-07-26T15:36:32.473 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.8 kB] 2021-07-26T15:36:32.474 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [367 kB] 2021-07-26T15:36:32.495 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.2 kB] 2021-07-26T15:36:32.496 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [52.9 kB] 2021-07-26T15:36:32.499 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:36:32.499 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [626 kB] 2021-07-26T15:36:32.547 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [843 kB] 2021-07-26T15:36:32.586 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [176 kB] 2021-07-26T15:36:32.592 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [18.4 kB] 2021-07-26T15:36:32.593 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [23.6 kB] 2021-07-26T15:36:32.594 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [7,472 B] 2021-07-26T15:36:32.595 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,472 B] 2021-07-26T15:36:32.627 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [676 B] 2021-07-26T15:36:32.627 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [2,568 B] 2021-07-26T15:36:32.627 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [2,568 B] 2021-07-26T15:36:32.678 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [1,120 B] 2021-07-26T15:36:32.679 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [400 B] 2021-07-26T15:36:32.679 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [5,792 B] 2021-07-26T15:36:32.680 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [4,724 B] 2021-07-26T15:36:32.709 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [2,060 B] 2021-07-26T15:36:32.709 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [288 B] 2021-07-26T15:36:35.561 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 7,281 kB in 1s (5,099 kB/s) 2021-07-26T15:36:36.685 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2021-07-26T15:36:36.707 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:36:36.778 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2021-07-26T15:36:36.934 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2021-07-26T15:36:36.935 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2021-07-26T15:36:37.012 INFO:teuthology.orchestra.run.smithi096.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:36:37.015 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:36:37.016 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:36:37.086 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2021-07-26T15:36:37.245 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2021-07-26T15:36:37.246 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2021-07-26T15:36:37.387 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2021-07-26T15:36:37.387 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:36:37.388 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-generic linux-image-5.4.0-80-generic 2021-07-26T15:36:37.388 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-5.4.0-80-generic linux-modules-extra-5.4.0-80-generic 2021-07-26T15:36:37.388 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2021-07-26T15:36:37.389 INFO:teuthology.orchestra.run.smithi096.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-07-26T15:36:37.389 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2021-07-26T15:36:37.389 INFO:teuthology.orchestra.run.smithi096.stdout: thermald 2021-07-26T15:36:37.423 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2021-07-26T15:36:37.423 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:36:37.423 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-80-generic linux-modules-5.4.0-80-generic 2021-07-26T15:36:37.423 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-extra-5.4.0-80-generic 2021-07-26T15:36:37.424 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2021-07-26T15:36:37.424 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-generic linux-image-generic 2021-07-26T15:36:37.658 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 5 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:36:37.658 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 75.6 MB of archives. 2021-07-26T15:36:37.658 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 377 MB of additional disk space will be used. 2021-07-26T15:36:37.658 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-80-generic amd64 5.4.0-80.90 [14.8 MB] 2021-07-26T15:36:39.484 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-80-generic amd64 5.4.0-80.90 [8,976 kB] 2021-07-26T15:36:39.717 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-80-generic amd64 5.4.0-80.90 [39.4 MB] 2021-07-26T15:36:41.018 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.80.84 [1,900 B] 2021-07-26T15:36:41.019 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.80.84 [2,568 B] 2021-07-26T15:36:41.019 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80 all 5.4.0-80.90 [11.0 MB] 2021-07-26T15:36:41.294 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80-generic amd64 5.4.0-80.90 [1,410 kB] 2021-07-26T15:36:41.360 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.80.84 [2,436 B] 2021-07-26T15:36:41.766 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 75.6 MB in 4s (19.2 MB/s) 2021-07-26T15:36:41.898 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-5.4.0-80-generic. 2021-07-26T15:36:43.309 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-07-26T15:36:43.314 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-linux-modules-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:36:43.394 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:45.300 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-image-5.4.0-80-generic. 2021-07-26T15:36:45.315 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-linux-image-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:36:45.415 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:46.428 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-80-generic. 2021-07-26T15:36:46.442 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:36:46.489 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:51.438 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-linux-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:36:51.567 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:36:51.868 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:36:52.012 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:36:52.345 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.4.0-80. 2021-07-26T15:36:52.361 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-linux-headers-5.4.0-80_5.4.0-80.90_all.deb ... 2021-07-26T15:36:52.404 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:36:58.319 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.4.0-80-generic. 2021-07-26T15:36:58.342 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-linux-headers-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:36:58.385 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:01.670 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:37:01.816 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:37:02.147 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:03.346 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:37:03.472 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:04.618 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:37:04.618 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-80-generic 2021-07-26T15:37:04.732 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:04.867 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:06.037 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-generic (5.4.0.80.84) ... 2021-07-26T15:37:06.161 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-generic (5.4.0.80.84) ... 2021-07-26T15:37:06.296 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-generic (5.4.0.80.84) ... 2021-07-26T15:37:06.464 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:06.637 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-07-26T15:37:06.638 INFO:teuthology.orchestra.run.smithi096.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:37:28.466 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-07-26T15:37:28.466 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub' 2021-07-26T15:37:28.477 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:37:28.497 INFO:teuthology.orchestra.run.smithi096.stdout:Generating grub configuration file ... 2021-07-26T15:37:28.821 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:37:28.844 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:37:29.288 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:37:29.299 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:37:31.241 INFO:teuthology.orchestra.run.smithi096.stdout:done 2021-07-26T15:37:31.605 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2021-07-26T15:37:31.635 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2021-07-26T15:37:31.635 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2021-07-26T15:37:31.636 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2021-07-26T15:37:31.636 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2021-07-26T15:37:31.636 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 18 2021-07-26T15:37:31.636 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:37:31.638 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2021-07-26T15:37:31.638 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2021-07-26T15:37:31.638 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.4.0.80.84 2021-07-26T15:37:31.638 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:37:31.639 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:37:31.639 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2021-07-26T15:37:31.639 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2021-07-26T15:37:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:37:31.639 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2021-07-26T15:37:31.640 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-80-generic 2021-07-26T15:37:31.640 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-07-26T15:37:31.640 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-07-26T15:37:31.641 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-07-26T15:37:31.641 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-07-26T15:37:31.641 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=None, version=distro) 2021-07-26T15:37:31.642 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get clean 2021-07-26T15:37:31.750 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get update 2021-07-26T15:37:31.870 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:37:32.000 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:37:32.084 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:37:32.100 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:37:32.172 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-07-26T15:37:32.177 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:37:32.182 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [331 kB] 2021-07-26T15:37:32.188 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [17.9 kB] 2021-07-26T15:37:32.189 INFO:teuthology.orchestra.run.smithi033.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.6 kB] 2021-07-26T15:37:32.189 INFO:teuthology.orchestra.run.smithi033.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:37:32.198 INFO:teuthology.orchestra.run.smithi033.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:37:32.208 INFO:teuthology.orchestra.run.smithi033.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [6,464 B] 2021-07-26T15:37:32.208 INFO:teuthology.orchestra.run.smithi033.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.6 kB] 2021-07-26T15:37:32.208 INFO:teuthology.orchestra.run.smithi033.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,648 B] 2021-07-26T15:37:32.630 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 2,737 kB in 1s (4,099 kB/s) 2021-07-26T15:37:33.428 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2021-07-26T15:37:33.452 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:37:33.519 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2021-07-26T15:37:33.681 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2021-07-26T15:37:33.682 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2021-07-26T15:37:33.765 INFO:teuthology.orchestra.run.smithi033.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:37:33.767 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:37:33.768 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:37:33.833 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2021-07-26T15:37:33.996 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2021-07-26T15:37:33.997 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2021-07-26T15:37:34.163 INFO:teuthology.orchestra.run.smithi033.stdout:linux-image-generic is already the newest version (5.4.0.80.84). 2021-07-26T15:37:34.164 INFO:teuthology.orchestra.run.smithi033.stdout:0 upgraded, 0 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:37:34.165 DEBUG:teuthology.orchestra.run.smithi033:> dpkg -s linux-image-generic 2021-07-26T15:37:34.182 INFO:teuthology.orchestra.run.smithi033.stdout:Package: linux-image-generic 2021-07-26T15:37:34.182 INFO:teuthology.orchestra.run.smithi033.stdout:Status: install ok installed 2021-07-26T15:37:34.182 INFO:teuthology.orchestra.run.smithi033.stdout:Priority: optional 2021-07-26T15:37:34.182 INFO:teuthology.orchestra.run.smithi033.stdout:Section: kernel 2021-07-26T15:37:34.183 INFO:teuthology.orchestra.run.smithi033.stdout:Installed-Size: 18 2021-07-26T15:37:34.183 INFO:teuthology.orchestra.run.smithi033.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:37:34.183 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: amd64 2021-07-26T15:37:34.183 INFO:teuthology.orchestra.run.smithi033.stdout:Source: linux-meta 2021-07-26T15:37:34.183 INFO:teuthology.orchestra.run.smithi033.stdout:Version: 5.4.0.80.84 2021-07-26T15:37:34.184 INFO:teuthology.orchestra.run.smithi033.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:37:34.184 INFO:teuthology.orchestra.run.smithi033.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:37:34.184 INFO:teuthology.orchestra.run.smithi033.stdout:Recommends: thermald 2021-07-26T15:37:34.184 INFO:teuthology.orchestra.run.smithi033.stdout:Description: Generic Linux kernel image 2021-07-26T15:37:34.185 INFO:teuthology.orchestra.run.smithi033.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:37:34.185 INFO:teuthology.orchestra.run.smithi033.stdout: available. 2021-07-26T15:37:34.185 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2021-07-26T15:37:34.190 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.GoppqHM6pJ 2021-07-26T15:37:34.191 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub/grub.cfg /tmp/tmp.GoppqHM6pJ 2021-07-26T15:37:34.260 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.GoppqHM6pJ 2021-07-26T15:37:34.358 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.GoppqHM6pJ is 8KB 2021-07-26T15:37:34.373 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.GoppqHM6pJ 2021-07-26T15:37:34.379 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-07-26T15:37:34.391 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:37:34.392 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-07-26T15:37:34.392 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-07-26T15:37:34.476 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-80-generic 2021-07-26T15:37:34.476 DEBUG:teuthology.orchestra.run.smithi033:> sudo update-grub 2021-07-26T15:37:35.801 INFO:teuthology.orchestra.run.smithi033.stderr:Sourcing file `/etc/default/grub' 2021-07-26T15:37:35.802 INFO:teuthology.orchestra.run.smithi033.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:37:35.822 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2021-07-26T15:37:36.105 INFO:teuthology.orchestra.run.smithi033.stderr:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:37:36.117 INFO:teuthology.orchestra.run.smithi033.stderr:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:37:36.499 INFO:teuthology.orchestra.run.smithi033.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:37:36.509 INFO:teuthology.orchestra.run.smithi033.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:37:37.659 INFO:teuthology.orchestra.run.smithi033.stderr:done 2021-07-26T15:37:37.662 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2021-07-26T15:37:37.665 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-07-26T15:37:37.665 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2021-07-26T15:37:37.665 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2021-07-26T15:37:37.722 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2021-07-26T15:37:37.868 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:37:37.976 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:37:38.058 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:37:38.140 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-07-26T15:37:39.320 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2021-07-26T15:37:39.343 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:37:39.414 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2021-07-26T15:37:39.574 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2021-07-26T15:37:39.574 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2021-07-26T15:37:39.655 INFO:teuthology.orchestra.run.smithi096.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:37:39.656 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:37:39.657 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:37:39.729 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2021-07-26T15:37:39.883 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2021-07-26T15:37:39.884 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2021-07-26T15:37:40.037 INFO:teuthology.orchestra.run.smithi096.stdout:linux-image-generic is already the newest version (5.4.0.80.84). 2021-07-26T15:37:40.038 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 0 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:37:40.039 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2021-07-26T15:37:40.061 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2021-07-26T15:37:40.063 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2021-07-26T15:37:40.063 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2021-07-26T15:37:40.063 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2021-07-26T15:37:40.063 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 18 2021-07-26T15:37:40.063 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:37:40.064 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2021-07-26T15:37:40.064 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2021-07-26T15:37:40.064 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.4.0.80.84 2021-07-26T15:37:40.064 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:37:40.065 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:37:40.065 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2021-07-26T15:37:40.065 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2021-07-26T15:37:40.065 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:37:40.065 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2021-07-26T15:37:40.066 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2021-07-26T15:37:40.073 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.hHCEKEkmIS 2021-07-26T15:37:40.073 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub/grub.cfg /tmp/tmp.hHCEKEkmIS 2021-07-26T15:37:40.129 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.hHCEKEkmIS 2021-07-26T15:37:40.174 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.hHCEKEkmIS is 8KB 2021-07-26T15:37:40.189 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.hHCEKEkmIS 2021-07-26T15:37:40.195 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-07-26T15:37:40.248 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:37:40.249 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-07-26T15:37:40.249 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-07-26T15:37:40.287 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-80-generic 2021-07-26T15:37:40.288 DEBUG:teuthology.orchestra.run.smithi096:> sudo update-grub 2021-07-26T15:37:41.474 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub' 2021-07-26T15:37:41.476 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:37:41.487 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2021-07-26T15:37:41.792 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:37:41.804 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:37:42.201 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:37:42.213 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:37:43.283 INFO:teuthology.orchestra.run.smithi096.stderr:done 2021-07-26T15:37:43.284 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2021-07-26T15:38:13.314 INFO:teuthology.misc:Re-opening connections... 2021-07-26T15:38:13.315 INFO:teuthology.misc:trying to connect to ubuntu@smithi033.front.sepia.ceph.com 2021-07-26T15:38:13.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:38:13.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:39:13.375 DEBUG:teuthology.orchestra.remote:timed out 2021-07-26T15:39:13.377 INFO:teuthology.misc:trying to connect to ubuntu@smithi096.front.sepia.ceph.com 2021-07-26T15:39:13.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:39:13.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:39:16.459 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2021-07-26T15:39:16.459 DEBUG:teuthology.misc:waited 63.143998861312866 2021-07-26T15:39:17.461 INFO:teuthology.misc:trying to connect to ubuntu@smithi033.front.sepia.ceph.com 2021-07-26T15:39:17.461 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:39:17.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:39:17.694 DEBUG:teuthology.orchestra.run.smithi033:> true 2021-07-26T15:39:18.328 DEBUG:teuthology.misc:waited 65.01272749900818 2021-07-26T15:39:19.329 INFO:teuthology.misc:trying to connect to ubuntu@smithi096.front.sepia.ceph.com 2021-07-26T15:39:19.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:39:19.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:39:19.487 DEBUG:teuthology.orchestra.run.smithi096:> true 2021-07-26T15:39:20.009 DEBUG:teuthology.misc:waited 66.69379329681396 2021-07-26T15:39:21.010 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-07-26T15:39:21.011 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-80-generic"... 2021-07-26T15:39:21.012 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2021-07-26T15:39:21.019 INFO:teuthology.orchestra.run.smithi033.stdout:5.4.0-80-generic 2021-07-26T15:39:21.019 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-80-generic vs 5.4.0-80-generic 2021-07-26T15:39:21.020 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-07-26T15:39:21.020 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-07-26T15:39:21.020 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-07-26T15:39:21.021 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-80-generic"... 2021-07-26T15:39:21.022 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2021-07-26T15:39:21.029 INFO:teuthology.orchestra.run.smithi096.stdout:5.4.0-80-generic 2021-07-26T15:39:21.030 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-80-generic vs 5.4.0-80-generic 2021-07-26T15:39:21.030 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-07-26T15:39:21.030 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-07-26T15:39:22.032 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-07-26T15:39:22.032 DEBUG:teuthology.orchestra.run.smithi033:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-07-26T15:39:22.095 INFO:teuthology.orchestra.run.smithi033.stdout:ttyS1 2021-07-26T15:39:22.120 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-07-26T15:39:22.121 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-07-26T15:39:22.202 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2021-07-26T15:39:22.221 INFO:teuthology.run_tasks:Running task internal.base... 2021-07-26T15:39:22.233 INFO:teuthology.task.internal:Creating test directory... 2021-07-26T15:39:22.234 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-07-26T15:39:22.238 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-07-26T15:39:22.245 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-07-26T15:39:22.328 INFO:teuthology.run_tasks:Running task internal.archive... 2021-07-26T15:39:22.384 INFO:teuthology.task.internal:Creating archive directory... 2021-07-26T15:39:22.385 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-07-26T15:39:22.388 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-07-26T15:39:22.419 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-07-26T15:39:22.475 INFO:teuthology.task.internal:Enabling coredump saving... 2021-07-26T15:39:22.476 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-07-26T15:39:22.478 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-07-26T15:39:22.501 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:39:22.512 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:39:22.513 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:39:22.522 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:39:22.524 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-07-26T15:39:22.585 INFO:teuthology.task.internal:Configuring sudo... 2021-07-26T15:39:22.586 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-07-26T15:39:22.589 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-07-26T15:39:22.607 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-07-26T15:39:22.694 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-07-26T15:39:22.695 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-07-26T15:39:22.699 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-07-26T15:39:22.708 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-07-26T15:39:22.752 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-07-26T15:39:22.763 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:39:22.764 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-07-26T15:39:22.830 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-07-26T15:39:22.838 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-07-26T15:39:22.889 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:39:22.890 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-07-26T15:39:22.904 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2021-07-26T15:39:22.906 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2021-07-26T15:39:22.961 INFO:teuthology.run_tasks:Running task internal.timer... 2021-07-26T15:39:22.973 INFO:teuthology.task.internal:Starting timer... 2021-07-26T15:39:22.974 INFO:teuthology.run_tasks:Running task pcp... 2021-07-26T15:39:23.058 INFO:teuthology.run_tasks:Running task selinux... 2021-07-26T15:39:23.110 DEBUG:teuthology.task.selinux:Excluding smithi033: OS 'ubuntu' does not support SELinux 2021-07-26T15:39:23.110 DEBUG:teuthology.task.selinux:Excluding smithi096: OS 'ubuntu' does not support SELinux 2021-07-26T15:39:23.111 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-07-26T15:39:23.111 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-07-26T15:39:23.111 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-07-26T15:39:23.112 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-07-26T15:39:23.177 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-07-26T15:39:23.178 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-07-26T15:39:23.206 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-07-26T15:39:23.208 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi096.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-07-26T15:39:23.618 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-07-26T15:39:24.424 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-07-26T15:39:27.253 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-07-26T15:39:27.276 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:27 +0000 (0:00:00.039) 0:00:00.039 *********** 2021-07-26T15:39:27.291 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:27 +0000 (0:00:00.013) 0:00:00.053 *********** 2021-07-26T15:39:29.470 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* [DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi033.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi033.front.sepia.ceph.com] 2021-07-26T15:39:29.521 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:29 +0000 (0:00:02.231) 0:00:02.284 *********** 2021-07-26T15:39:29.572 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi096.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi096.front.sepia.ceph.com] 2021-07-26T15:39:29.720 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:29 +0000 (0:00:00.198) 0:00:02.483 *********** 2021-07-26T15:39:29.913 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:39:29.936 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:29 +0000 (0:00:00.215) 0:00:02.699 *********** 2021-07-26T15:39:29.943 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:39:29.968 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:29 +0000 (0:00:00.032) 0:00:02.731 *********** 2021-07-26T15:39:30.509 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-07-26T15:39:30.511 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-07-26T15:39:30.533 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:30 +0000 (0:00:00.565) 0:00:03.296 *********** 2021-07-26T15:39:30.540 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-07-26T15:39:30.566 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:30 +0000 (0:00:00.032) 0:00:03.328 *********** 2021-07-26T15:39:30.917 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-07-26T15:39:30.919 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.043031", "end": "2021-07-26 15:39:31.075573", "rc": 0, "start": "2021-07-26 15:39:31.032542", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-07-26T15:39:30.940 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:30 +0000 (0:00:00.374) 0:00:03.703 *********** 2021-07-26T15:39:30.957 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.078973", "end": "2021-07-26 15:39:31.583601", "rc": 0, "start": "2021-07-26 15:39:31.504628", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-07-26T15:39:30.981 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:30 +0000 (0:00:00.041) 0:00:03.744 *********** 2021-07-26T15:39:31.205 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:39:31.231 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:31 +0000 (0:00:00.249) 0:00:03.994 *********** 2021-07-26T15:39:31.238 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:39:31.263 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:31 +0000 (0:00:00.032) 0:00:04.026 *********** 2021-07-26T15:39:32.022 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-07-26T15:39:32.024 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313971.2730083-1152-163408723512197/source", "state": "file", "uid": 0} 2021-07-26T15:39:32.046 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:32 +0000 (0:00:00.782) 0:00:04.809 *********** 2021-07-26T15:39:32.054 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313971.2991369-1159-54862358988068/source", "state": "file", "uid": 0} 2021-07-26T15:39:32.082 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:32 +0000 (0:00:00.035) 0:00:04.845 *********** 2021-07-26T15:39:32.495 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-07-26T15:39:32.496 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-07-26T15:39:32.498 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-07-26T15:39:32.500 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-07-26T15:39:32.501 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-07-26T15:39:32.582 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-07-26T15:39:32.584 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-07-26T15:39:32.597 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Monday 26 July 2021 15:39:32 +0000 (0:00:00.514) 0:00:05.360 *********** 2021-07-26T15:39:33.281 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] 2021-07-26T15:39:33.302 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] 2021-07-26T15:39:33.322 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** 2021-07-26T15:39:33.324 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:33 +0000 (0:00:00.725) 0:00:06.085 *********** 2021-07-26T15:39:33.349 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-07-26T15:39:33.360 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-07-26T15:39:33.365 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-07-26T15:39:33.516 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:33 +0000 (0:00:00.193) 0:00:06.279 *********** 2021-07-26T15:39:33.539 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:33 +0000 (0:00:00.022) 0:00:06.301 *********** 2021-07-26T15:39:34.363 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi033.front.sepia.ceph.com] 2021-07-26T15:39:34.396 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] 2021-07-26T15:39:34.428 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-07-26T15:39:34.430 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:34 +0000 (0:00:00.889) 0:00:07.191 *********** 2021-07-26T15:39:34.483 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:34 +0000 (0:00:00.054) 0:00:07.246 *********** 2021-07-26T15:39:34.893 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-07-26T15:39:34.894 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.205633", "end": "2021-07-26 15:39:34.865516", "rc": 0, "start": "2021-07-26 15:39:34.659883", "stderr": "", "stderr_lines": [], "stdout": "fa3530b6c8007ac148c609947f616c9ce81a7370", "stdout_lines": ["fa3530b6c8007ac148c609947f616c9ce81a7370"]} 2021-07-26T15:39:34.916 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:34 +0000 (0:00:00.433) 0:00:07.679 *********** 2021-07-26T15:39:34.955 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.194400", "end": "2021-07-26 15:39:34.933027", "rc": 0, "start": "2021-07-26 15:39:34.738627", "stderr": "", "stderr_lines": [], "stdout": "fa3530b6c8007ac148c609947f616c9ce81a7370", "stdout_lines": ["fa3530b6c8007ac148c609947f616c9ce81a7370"]} 2021-07-26T15:39:34.981 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:34 +0000 (0:00:00.064) 0:00:07.744 *********** 2021-07-26T15:39:35.061 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-07-26T15:39:35.063 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008864", "end": "2021-07-26 15:39:35.698700", "failed_when_result": false, "rc": 0, "start": "2021-07-26 15:39:35.689836", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-07-26T15:39:35.086 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.105) 0:00:07.849 *********** 2021-07-26T15:39:35.124 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011519", "end": "2021-07-26 15:39:35.289049", "failed_when_result": false, "rc": 0, "start": "2021-07-26 15:39:35.277530", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-07-26T15:39:35.150 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.063) 0:00:07.913 *********** 2021-07-26T15:39:35.157 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-07-26T15:39:35.159 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:35.183 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.032) 0:00:07.946 *********** 2021-07-26T15:39:35.211 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:35.239 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.056) 0:00:08.002 *********** 2021-07-26T15:39:35.256 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:35.281 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.041) 0:00:08.044 *********** 2021-07-26T15:39:35.308 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:35.334 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.052) 0:00:08.097 *********** 2021-07-26T15:39:35.350 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-07-26T15:39:35.351 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:35.377 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.043) 0:00:08.140 *********** 2021-07-26T15:39:35.395 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:35.420 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.043) 0:00:08.183 *********** 2021-07-26T15:39:35.459 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-07-26T15:39:35.461 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:35.484 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.063) 0:00:08.247 *********** 2021-07-26T15:39:35.501 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:35.527 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.042) 0:00:08.290 *********** 2021-07-26T15:39:35.554 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-07-26T15:39:35.556 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:35.579 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.051) 0:00:08.342 *********** 2021-07-26T15:39:35.596 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:35.622 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.043) 0:00:08.385 *********** 2021-07-26T15:39:35.763 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-07-26T15:39:35.765 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:39:35.788 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.165) 0:00:08.551 *********** 2021-07-26T15:39:35.806 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:39:35.834 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:35 +0000 (0:00:00.046) 0:00:08.597 *********** 2021-07-26T15:39:36.028 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-07-26T15:39:36.030 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-07-26T15:39:36.071 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-07-26T15:39:36.167 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-07-26T15:39:36.220 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-07-26T15:39:36.314 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-07-26T15:39:36.357 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-07-26T15:39:36.451 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-07-26T15:39:36.505 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-07-26T15:39:36.601 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-07-26T15:39:36.642 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-07-26T15:39:36.741 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-07-26T15:39:36.795 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-07-26T15:39:36.879 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-07-26T15:39:36.943 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-07-26T15:39:37.026 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-07-26T15:39:37.089 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-07-26T15:39:37.173 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-07-26T15:39:37.238 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-07-26T15:39:37.312 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-07-26T15:39:37.387 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-07-26T15:39:37.460 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-07-26T15:39:37.533 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-07-26T15:39:37.596 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-07-26T15:39:37.690 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-07-26T15:39:37.743 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-07-26T15:39:37.827 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-07-26T15:39:37.890 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-07-26T15:39:37.984 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-07-26T15:39:38.038 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-07-26T15:39:38.127 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-07-26T15:39:38.180 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-07-26T15:39:38.264 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-07-26T15:39:38.328 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-07-26T15:39:38.413 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-07-26T15:39:38.468 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-07-26T15:39:38.553 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-07-26T15:39:38.606 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-07-26T15:39:38.703 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-07-26T15:39:38.756 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-07-26T15:39:38.863 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-07-26T15:39:38.905 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-07-26T15:39:39.000 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-07-26T15:39:39.053 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-07-26T15:39:39.148 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-07-26T15:39:39.201 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-07-26T15:39:39.295 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-07-26T15:39:39.338 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-07-26T15:39:39.432 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-07-26T15:39:39.485 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-07-26T15:39:39.580 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-07-26T15:39:39.633 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-07-26T15:39:39.717 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-07-26T15:39:39.780 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-07-26T15:39:39.864 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-07-26T15:39:39.927 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-07-26T15:39:40.012 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-07-26T15:39:40.075 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-07-26T15:39:40.150 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-07-26T15:39:40.223 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-07-26T15:39:40.298 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-07-26T15:39:40.371 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-07-26T15:39:40.465 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-07-26T15:39:40.519 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-07-26T15:39:40.604 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-07-26T15:39:40.667 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-07-26T15:39:40.757 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-07-26T15:39:40.810 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-07-26T15:39:40.894 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-07-26T15:39:40.947 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-07-26T15:39:41.041 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-07-26T15:39:41.094 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-07-26T15:39:41.178 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-07-26T15:39:41.242 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-07-26T15:39:41.328 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-07-26T15:39:41.380 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:39:41.465 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:39:41.528 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-07-26T15:39:41.612 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-07-26T15:39:41.675 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-07-26T15:39:41.759 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-07-26T15:39:41.822 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-07-26T15:39:41.896 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-07-26T15:39:41.970 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-07-26T15:39:42.044 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-07-26T15:39:42.120 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-07-26T15:39:42.196 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-07-26T15:39:42.260 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-07-26T15:39:42.335 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-07-26T15:39:42.418 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-07-26T15:39:42.481 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-07-26T15:39:42.565 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:39:42.618 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:39:42.709 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-07-26T15:39:42.763 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-07-26T15:39:42.857 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-07-26T15:39:42.900 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-07-26T15:39:43.007 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-07-26T15:39:43.049 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-07-26T15:39:43.144 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-07-26T15:39:43.196 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-07-26T15:39:43.291 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-07-26T15:39:43.334 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-07-26T15:39:43.438 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-07-26T15:39:43.481 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-07-26T15:39:43.586 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-07-26T15:39:43.619 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-07-26T15:39:43.746 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-07-26T15:39:43.768 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-07-26T15:39:43.894 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-07-26T15:39:43.905 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-07-26T15:39:44.032 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-07-26T15:39:44.235 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-07-26T15:39:44.326 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-07-26T15:39:44.338 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-07-26T15:39:44.476 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-07-26T15:39:44.488 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-07-26T15:39:44.614 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-07-26T15:39:44.626 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-07-26T15:39:44.767 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-07-26T15:39:44.790 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-07-26T15:39:44.915 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-07-26T15:39:44.937 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-07-26T15:39:45.062 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:39:45.084 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:39:45.210 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-07-26T15:39:45.232 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-07-26T15:39:45.358 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-07-26T15:39:45.380 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-07-26T15:39:45.505 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-07-26T15:39:45.527 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-07-26T15:39:45.644 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-07-26T15:39:45.667 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-07-26T15:39:45.794 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-07-26T15:39:45.816 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-07-26T15:39:45.944 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-07-26T15:39:45.966 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-07-26T15:39:46.092 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-07-26T15:39:46.114 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-07-26T15:39:46.229 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-07-26T15:39:46.251 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-07-26T15:39:46.387 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-07-26T15:39:46.399 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-07-26T15:39:46.526 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-07-26T15:39:46.538 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-07-26T15:39:46.676 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-07-26T15:39:46.679 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-07-26T15:39:46.815 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-07-26T15:39:46.826 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-07-26T15:39:46.962 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-07-26T15:39:46.974 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-07-26T15:39:47.111 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-07-26T15:39:47.122 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-07-26T15:39:47.249 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-07-26T15:39:47.260 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-07-26T15:39:47.397 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-07-26T15:39:47.408 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-07-26T15:39:47.545 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-07-26T15:39:47.557 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-07-26T15:39:47.692 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-07-26T15:39:47.693 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-07-26T15:39:47.832 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-07-26T15:39:47.843 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-07-26T15:39:47.980 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-07-26T15:39:47.981 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-07-26T15:39:48.121 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-07-26T15:39:48.134 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-07-26T15:39:48.273 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-07-26T15:39:48.274 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-07-26T15:39:48.410 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-07-26T15:39:48.421 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-07-26T15:39:48.556 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-07-26T15:39:48.567 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-07-26T15:39:48.704 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-07-26T15:39:48.716 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-07-26T15:39:48.854 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-07-26T15:39:48.857 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-07-26T15:39:48.993 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-07-26T15:39:49.004 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-07-26T15:39:49.140 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-07-26T15:39:49.142 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-07-26T15:39:49.276 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-07-26T15:39:49.288 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-07-26T15:39:49.424 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-07-26T15:39:49.435 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-07-26T15:39:49.572 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-07-26T15:39:49.574 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-07-26T15:39:49.710 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-07-26T15:39:49.720 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-07-26T15:39:49.856 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-07-26T15:39:49.867 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-07-26T15:39:49.994 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-07-26T15:39:50.017 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-07-26T15:39:50.143 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-07-26T15:39:50.166 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-07-26T15:39:50.291 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-07-26T15:39:50.313 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-07-26T15:39:50.429 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-07-26T15:39:50.464 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-07-26T15:39:50.581 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:39:50.615 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:39:50.722 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-07-26T15:39:50.768 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-07-26T15:39:50.862 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-07-26T15:39:50.905 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-07-26T15:39:51.011 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-07-26T15:39:51.054 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-07-26T15:39:51.149 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-07-26T15:39:51.202 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-07-26T15:39:51.288 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-07-26T15:39:51.342 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-07-26T15:39:51.451 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-07-26T15:39:51.490 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-07-26T15:39:51.596 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-07-26T15:39:51.638 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-07-26T15:39:51.734 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-07-26T15:39:51.777 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-07-26T15:39:51.882 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-07-26T15:39:51.925 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-07-26T15:39:52.033 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-07-26T15:39:52.074 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-07-26T15:39:52.181 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-07-26T15:39:52.223 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-07-26T15:39:52.320 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-07-26T15:39:52.363 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-07-26T15:39:52.467 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-07-26T15:39:52.510 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-07-26T15:39:52.614 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-07-26T15:39:52.648 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-07-26T15:39:52.753 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-07-26T15:39:52.796 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-07-26T15:39:52.900 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-07-26T15:39:52.954 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-07-26T15:39:53.049 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-07-26T15:39:53.092 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-07-26T15:39:53.186 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-07-26T15:39:53.239 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-07-26T15:39:53.334 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-07-26T15:39:53.378 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-07-26T15:39:53.474 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-07-26T15:39:53.527 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-07-26T15:39:53.612 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-07-26T15:39:53.664 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-07-26T15:39:53.749 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-07-26T15:39:53.813 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-07-26T15:39:53.897 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-07-26T15:39:53.960 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-07-26T15:39:54.044 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-07-26T15:39:54.108 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-07-26T15:39:54.181 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-07-26T15:39:54.246 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-07-26T15:39:54.331 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-07-26T15:39:54.415 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-07-26T15:39:54.552 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-07-26T15:39:54.605 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-07-26T15:39:54.772 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-07-26T15:39:54.799 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-07-26T15:39:54.920 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-07-26T15:39:55.004 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-07-26T15:39:55.068 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-07-26T15:39:55.152 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-07-26T15:39:55.215 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-07-26T15:39:55.300 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-07-26T15:39:55.363 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-07-26T15:39:55.439 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-07-26T15:39:55.503 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-07-26T15:39:55.587 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-07-26T15:39:55.660 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-07-26T15:39:55.734 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-07-26T15:39:55.798 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-07-26T15:39:55.873 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-07-26T15:39:55.948 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-07-26T15:39:56.024 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-07-26T15:39:56.096 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-07-26T15:39:56.171 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-07-26T15:39:56.693 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-07-26T15:39:56.816 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-07-26T15:39:57.190 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-07-26T15:39:57.350 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-07-26T15:39:57.707 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-07-26T15:39:57.868 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-07-26T15:39:58.171 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-07-26T15:39:58.411 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-07-26T15:39:58.745 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-07-26T15:39:58.901 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-07-26T15:39:59.214 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-07-26T15:39:59.412 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-07-26T15:39:59.816 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-07-26T15:39:59.886 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-07-26T15:40:00.322 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-07-26T15:40:00.388 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-07-26T15:40:00.848 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-07-26T15:40:00.996 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-07-26T15:40:01.350 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-07-26T15:40:01.580 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-07-26T15:40:01.861 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-07-26T15:40:02.132 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-07-26T15:40:02.425 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-07-26T15:40:02.696 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-07-26T15:40:02.902 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-07-26T15:40:03.257 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-07-26T15:40:03.438 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-07-26T15:40:03.785 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-07-26T15:40:03.901 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-07-26T15:40:04.044 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:04 +0000 (0:00:28.209) 0:00:36.807 *********** 2021-07-26T15:40:04.124 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-07-26T15:40:04.147 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:04 +0000 (0:00:00.103) 0:00:36.910 *********** 2021-07-26T15:40:04.252 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-07-26T15:40:04.252 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-07-26T15:40:04.254 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-07-26T15:40:04.256 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-07-26T15:40:04.257 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-07-26T15:40:04.259 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-07-26T15:40:04.261 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-07-26T15:40:04.262 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn" 2021-07-26T15:40:04.263 INFO:teuthology.task.ansible.out:: "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-07-26T15:40:04.265 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-07-26T15:40:04.266 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-07-26T15:40:04.268 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-07-26T15:40:04.269 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-07-26T15:40:04.271 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-07-26T15:40:04.273 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 2021-07-26T15:40:04.273 INFO:teuthology.task.ansible.out: JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-07-26T15:40:04.275 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}]}, "changed": false} 2021-07-26T15:40:04.303 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:04 +0000 (0:00:00.155) 0:00:37.066 *********** 2021-07-26T15:40:04.381 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-07-26T15:40:04.523 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:04 +0000 (0:00:00.219) 0:00:37.286 *********** 2021-07-26T15:40:04.597 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:04.598 INFO:teuthology.task.ansible.out:TASK [Create all users without sudo access.] *********************************** 2021-07-26T15:40:04.623 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:04 +0000 (0:00:00.100) 0:00:37.386 *********** 2021-07-26T15:40:04.721 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-07-26T15:40:04.723 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-07-26T15:40:04.725 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-07-26T15:40:04.726 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-07-26T15:40:04.728 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-07-26T15:40:04.729 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-07-26T15:40:04.731 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-07-26T15:40:04.733 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn" 2021-07-26T15:40:04.733 INFO:teuthology.task.ansible.out:: "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-07-26T15:40:04.735 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-07-26T15:40:04.736 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-07-26T15:40:04.738 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-07-26T15:40:04.739 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-07-26T15:40:04.741 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-07-26T15:40:04.743 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev 2021-07-26T15:40:04.746 INFO:teuthology.task.ansible.out: JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-07-26T15:40:04.747 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}]}, "changed": false} 2021-07-26T15:40:04.772 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:04 +0000 (0:00:00.148) 0:00:37.535 *********** 2021-07-26T15:40:06.210 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-07-26T15:40:06.212 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"after": "fa3530b6c8007ac148c609947f616c9ce81a7370", "attempts": 1, "before": "fa3530b6c8007ac148c609947f616c9ce81a7370", "changed": false, "remote_url_changed": false} 2021-07-26T15:40:06.235 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:06 +0000 (0:00:01.462) 0:00:38.998 *********** 2021-07-26T15:40:06.359 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"after": "fa3530b6c8007ac148c609947f616c9ce81a7370", "attempts": 1, "before": "fa3530b6c8007ac148c609947f616c9ce81a7370", "changed": false, "remote_url_changed": false} 2021-07-26T15:40:06.385 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:06 +0000 (0:00:00.148) 0:00:39.146 *********** 2021-07-26T15:40:06.568 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-07-26T15:40:06.570 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-07-26T15:40:06.623 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-07-26T15:40:06.697 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-07-26T15:40:06.761 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-07-26T15:40:06.835 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-07-26T15:40:06.888 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-07-26T15:40:06.962 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-07-26T15:40:06.964 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-07-26T15:40:07.036 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-07-26T15:40:07.038 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-07-26T15:40:07.100 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-07-26T15:40:07.174 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-07-26T15:40:07.227 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-07-26T15:40:07.229 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-07-26T15:40:07.302 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-07-26T15:40:07.304 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-07-26T15:40:07.355 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-07-26T15:40:07.449 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-07-26T15:40:07.481 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-07-26T15:40:07.588 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-07-26T15:40:07.610 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-07-26T15:40:07.622 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:07.730 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-07-26T15:40:07.742 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:07.753 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-07-26T15:40:07.755 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-07-26T15:40:07.895 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-07-26T15:40:07.897 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-07-26T15:40:07.907 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-07-26T15:40:07.908 INFO:teuthology.task.ansible.out:son", "validate_certs": true} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:07.918 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:08.054 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-07-26T15:40:08.056 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-07-26T15:40:08.066 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:08.068 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7 2021-07-26T15:40:08.070 INFO:teuthology.task.ansible.out:EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-07-26T15:40:08.195 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-07-26T15:40:08.197 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-07-26T15:40:08.199 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-07-26T15:40:08.324 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-07-26T15:40:08.333 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-07-26T15:40:08.334 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-07-26T15:40:08.459 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-07-26T15:40:08.461 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-07-26T15:40:08.470 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-07-26T15:40:08.586 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-07-26T15:40:08.608 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-07-26T15:40:08.610 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-07-26T15:40:08.714 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-07-26T15:40:08.736 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-07-26T15:40:08.852 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-07-26T15:40:08.874 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-07-26T15:40:08.979 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-07-26T15:40:08.981 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-07-26T15:40:09.011 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-07-26T15:40:09.112 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-07-26T15:40:09.116 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-07-26T15:40:09.155 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-07-26T15:40:09.157 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-07-26T15:40:09.249 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-07-26T15:40:09.292 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-07-26T15:40:09.294 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-07-26T15:40:09.375 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-07-26T15:40:09.418 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-07-26T15:40:09.513 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-07-26T15:40:09.515 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-07-26T15:40:09.643 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-07-26T15:40:09.743 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-07-26T15:40:09.882 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-07-26T15:40:09.884 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-07-26T15:40:09.936 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-07-26T15:40:10.020 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-07-26T15:40:10.063 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-07-26T15:40:10.148 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-07-26T15:40:10.202 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-07-26T15:40:10.318 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-07-26T15:40:10.330 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-07-26T15:40:10.457 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-07-26T15:40:10.467 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-07-26T15:40:10.469 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-07-26T15:40:10.596 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-07-26T15:40:10.603 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-07-26T15:40:10.728 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-07-26T15:40:10.729 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-07-26T15:40:10.865 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-07-26T15:40:10.867 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-07-26T15:40:10.994 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-07-26T15:40:11.003 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-07-26T15:40:11.131 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-07-26T15:40:11.132 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-07-26T15:40:11.259 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:40:11.260 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-07-26T15:40:11.397 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-07-26T15:40:11.400 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-07-26T15:40:11.530 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDm 2021-07-26T15:40:11.531 INFO:teuthology.task.ansible.out:SylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-07-26T15:40:11.667 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-07-26T15:40:11.669 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-07-26T15:40:11.805 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-07-26T15:40:11.806 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-07-26T15:40:11.931 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-07-26T15:40:11.943 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-07-26T15:40:11.945 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-07-26T15:40:12.063 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-07-26T15:40:12.085 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-07-26T15:40:12.087 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-07-26T15:40:12.198 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-07-26T15:40:12.217 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-07-26T15:40:12.339 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-07-26T15:40:12.341 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:40:12.354 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-07-26T15:40:12.482 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-07-26T15:40:12.485 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-07-26T15:40:12.486 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-07-26T15:40:12.503 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-07-26T15:40:12.608 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-07-26T15:40:12.640 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-07-26T15:40:12.642 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:40:12.735 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-07-26T15:40:12.788 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-07-26T15:40:12.790 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-07-26T15:40:12.791 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-07-26T15:40:12.872 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-07-26T15:40:12.910 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-07-26T15:40:13.005 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-07-26T15:40:13.058 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-07-26T15:40:13.132 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-07-26T15:40:13.196 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-07-26T15:40:13.270 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-07-26T15:40:13.271 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-07-26T15:40:13.323 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-07-26T15:40:13.398 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-07-26T15:40:13.462 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-07-26T15:40:13.535 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-07-26T15:40:13.599 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-07-26T15:40:13.601 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-07-26T15:40:13.673 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-07-26T15:40:13.675 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-07-26T15:40:13.739 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-07-26T15:40:13.806 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-07-26T15:40:13.868 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-07-26T15:40:13.965 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-07-26T15:40:14.004 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-07-26T15:40:14.006 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-07-26T15:40:14.106 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-07-26T15:40:14.108 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-07-26T15:40:14.132 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-07-26T15:40:14.237 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-07-26T15:40:14.270 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-07-26T15:40:14.366 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-07-26T15:40:14.402 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-07-26T15:40:14.404 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-07-26T15:40:14.509 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-07-26T15:40:14.541 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-07-26T15:40:14.542 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:14.652 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:40:14.688 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-07-26T15:40:14.800 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-07-26T15:40:14.832 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-07-26T15:40:14.948 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-07-26T15:40:15.099 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:40:15.101 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-07-26T15:40:15.134 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-07-26T15:40:15.232 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-07-26T15:40:15.275 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-07-26T15:40:15.369 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-07-26T15:40:15.405 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-07-26T15:40:15.501 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-07-26T15:40:15.555 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-07-26T15:40:15.628 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-07-26T15:40:15.693 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-07-26T15:40:15.757 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-07-26T15:40:15.820 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-07-26T15:40:15.884 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-07-26T15:40:15.958 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-07-26T15:40:16.022 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-07-26T15:40:16.086 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-07-26T15:40:16.165 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-07-26T15:40:16.219 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-07-26T15:40:16.294 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-07-26T15:40:16.355 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-07-26T15:40:16.430 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-07-26T15:40:16.504 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-07-26T15:40:16.558 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-07-26T15:40:16.642 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-07-26T15:40:16.697 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-07-26T15:40:16.783 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-07-26T15:40:16.826 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-07-26T15:40:16.923 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-07-26T15:40:16.966 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-07-26T15:40:16.967 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-07-26T15:40:17.044 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-07-26T15:40:17.109 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-07-26T15:40:17.185 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-07-26T15:40:17.238 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-07-26T15:40:17.322 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-07-26T15:40:17.324 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-07-26T15:40:17.377 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-07-26T15:40:17.452 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-07-26T15:40:17.507 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-07-26T15:40:17.603 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-07-26T15:40:17.635 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-07-26T15:40:17.636 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-07-26T15:40:17.739 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-07-26T15:40:17.781 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-07-26T15:40:17.783 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-07-26T15:40:17.876 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-07-26T15:40:17.920 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-07-26T15:40:17.922 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:18.008 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-07-26T15:40:18.010 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-07-26T15:40:18.051 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-07-26T15:40:18.157 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-07-26T15:40:18.160 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-07-26T15:40:18.179 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-07-26T15:40:18.291 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-07-26T15:40:18.314 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-07-26T15:40:18.443 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-07-26T15:40:18.454 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-07-26T15:40:18.586 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-07-26T15:40:18.588 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-07-26T15:40:18.720 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-07-26T15:40:18.732 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-07-26T15:40:18.848 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-07-26T15:40:18.871 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-07-26T15:40:18.873 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-07-26T15:40:18.987 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-07-26T15:40:19.008 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-07-26T15:40:19.135 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-07-26T15:40:19.146 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-07-26T15:40:19.274 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-07-26T15:40:19.277 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-07-26T15:40:19.287 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-07-26T15:40:19.401 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-07-26T15:40:19.414 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-07-26T15:40:19.546 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-07-26T15:40:19.555 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-07-26T15:40:19.681 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-07-26T15:40:19.683 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-07-26T15:40:19.809 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-07-26T15:40:19.821 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-07-26T15:40:19.824 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:40:19.948 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-07-26T15:40:19.959 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-07-26T15:40:20.078 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-07-26T15:40:20.100 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-07-26T15:40:20.216 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-07-26T15:40:20.218 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:40:20.228 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-07-26T15:40:20.343 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-07-26T15:40:20.366 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-07-26T15:40:20.482 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-07-26T15:40:20.493 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-07-26T15:40:20.609 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-07-26T15:40:20.631 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-07-26T15:40:20.746 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-07-26T15:40:20.768 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-07-26T15:40:20.885 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-07-26T15:40:20.897 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-07-26T15:40:21.030 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-07-26T15:40:21.033 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-07-26T15:40:21.159 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-07-26T15:40:21.170 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-07-26T15:40:21.285 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-07-26T15:40:21.299 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-07-26T15:40:21.425 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-07-26T15:40:21.427 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-07-26T15:40:21.553 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-07-26T15:40:21.564 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-07-26T15:40:21.678 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-07-26T15:40:21.690 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-07-26T15:40:21.815 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-07-26T15:40:21.826 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-07-26T15:40:21.943 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-07-26T15:40:21.954 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-07-26T15:40:22.080 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-07-26T15:40:22.091 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-07-26T15:40:22.208 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-07-26T15:40:22.231 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-07-26T15:40:22.336 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-07-26T15:40:22.339 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-07-26T15:40:22.357 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-07-26T15:40:22.474 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-07-26T15:40:22.494 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-07-26T15:40:22.599 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-07-26T15:40:22.621 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-07-26T15:40:22.727 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-07-26T15:40:22.760 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-07-26T15:40:22.761 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-07-26T15:40:22.875 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-07-26T15:40:22.908 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-07-26T15:40:23.025 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-07-26T15:40:23.036 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-07-26T15:40:23.165 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-07-26T15:40:23.176 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-07-26T15:40:23.291 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-07-26T15:40:23.312 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-07-26T15:40:23.430 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-07-26T15:40:23.440 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-07-26T15:40:23.556 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-07-26T15:40:23.588 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-07-26T15:40:23.694 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-07-26T15:40:23.726 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-07-26T15:40:23.823 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-07-26T15:40:23.866 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-07-26T15:40:24.004 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-07-26T15:40:24.005 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-07-26T15:40:24.130 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-07-26T15:40:24.152 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-07-26T15:40:24.270 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-07-26T15:40:24.301 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-07-26T15:40:24.398 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-07-26T15:40:24.434 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-07-26T15:40:24.529 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-07-26T15:40:24.572 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-07-26T15:40:24.668 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-07-26T15:40:24.671 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-07-26T15:40:24.711 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-07-26T15:40:24.797 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-07-26T15:40:24.862 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-07-26T15:40:24.937 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-07-26T15:40:24.992 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-07-26T15:40:25.075 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-07-26T15:40:25.130 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-07-26T15:40:25.131 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-07-26T15:40:25.205 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-07-26T15:40:25.260 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-07-26T15:40:25.362 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-07-26T15:40:25.429 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-07-26T15:40:25.550 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-07-26T15:40:25.585 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-07-26T15:40:25.684 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-07-26T15:40:25.740 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-07-26T15:40:25.836 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-07-26T15:40:25.879 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-07-26T15:40:25.988 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-07-26T15:40:26.021 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-07-26T15:40:26.115 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-07-26T15:40:26.159 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-07-26T15:40:26.244 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-07-26T15:40:26.286 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-07-26T15:40:26.404 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-07-26T15:40:26.426 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-07-26T15:40:26.543 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-07-26T15:40:26.554 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-07-26T15:40:26.672 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-07-26T15:40:26.693 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-07-26T15:40:26.800 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-07-26T15:40:26.845 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-07-26T15:40:26.938 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-07-26T15:40:27.017 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-07-26T15:40:27.039 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:27 +0000 (0:00:20.655) 0:00:59.802 *********** 2021-07-26T15:40:27.125 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-07-26T15:40:27.254 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-07-26T15:40:27.306 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.308 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.321 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2021-07-26T15:40:27.323 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.331 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.342 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.344 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.354 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.386 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-07-26T15:40:27.513 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-07-26T15:40:27.572 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-07-26T15:40:27.573 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2021-07-26T15:40:27.575 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.596 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:27 +0000 (0:00:00.557) 0:01:00.359 *********** 2021-07-26T15:40:27.640 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-07-26T15:40:27.684 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.695 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.697 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.708 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd 2021-07-26T15:40:27.710 INFO:teuthology.task.ansible.out:0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.719 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.720 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.731 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.744 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.788 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-07-26T15:40:27.791 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.801 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.817 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.827 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.835 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.847 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.852 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.869 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.879 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.892 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f 2021-07-26T15:40:27.894 INFO:teuthology.task.ansible.out:6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.903 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.914 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.926 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.937 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.948 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.959 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.970 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.973 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.985 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.994 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.005 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.017 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.028 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.035 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.046 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM 2021-07-26T15:40:28.048 INFO:teuthology.task.ansible.out:13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.058 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.060 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.070 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.071 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.093 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.094 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.106 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.116 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.127 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.129 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.138 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.150 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.152 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.161 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.172 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.174 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} ok: [smithi033.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnK 2021-07-26T15:40:28.176 INFO:teuthology.task.ansible.out:WPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.185 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.188 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.197 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.199 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.209 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.210 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.221 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.226 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.227 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.230 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.239 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.240 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d 2021-07-26T15:40:28.242 INFO:teuthology.task.ansible.out:7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.257 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.270 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffz 2021-07-26T15:40:28.272 INFO:teuthology.task.ansible.out:Ew 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.280 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.292 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.310 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} sk 2021-07-26T15:40:28.311 INFO:teuthology.task.ansible.out:ipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.321 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.323 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.333 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.336 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.346 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.348 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.359 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.361 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.372 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.373 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.374 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "v 2021-07-26T15:40:28.375 INFO:teuthology.task.ansible.out:asu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.387 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.405 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.417 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.417 INFO:teuthology.task.ansible.out:skipping: [smi 2021-07-26T15:40:28.420 INFO:teuthology.task.ansible.out:thi096.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.431 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.432 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.451 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": 2021-07-26T15:40:28.452 INFO:teuthology.task.ansible.out: "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.463 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.465 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.475 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.477 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.487 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.489 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.489 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.501 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.503 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.517 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.534 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.537 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.552 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.554 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.559 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.574 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857de 2021-07-26T15:40:28.576 INFO:teuthology.task.ansible.out:c48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.584 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.586 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.596 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.598 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.614 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.615 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.615 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.616 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.616 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.617 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_l 2021-07-26T15:40:28.618 INFO:teuthology.task.ansible.out:oop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.628 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.629 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.641 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.643 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.655 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.657 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.678 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.680 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.681 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7 2021-07-26T15:40:28.682 INFO:teuthology.task.ansible.out:ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.687 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.690 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.694 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.706 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.721 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.734 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.745 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.754 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.764 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.773 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozene 2021-07-26T15:40:28.775 INFO:teuthology.task.ansible.out:va@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.786 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.799 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.826 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.828 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.829 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.830 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thi 2021-07-26T15:40:28.831 INFO:teuthology.task.ansible.out:nkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.863 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:28 +0000 (0:00:01.267) 0:01:01.626 *********** 2021-07-26T15:40:28.885 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.890 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.891 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.891 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.903 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.906 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.915 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.931 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.932 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.943 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.944 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.980 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:28 +0000 (0:00:00.115) 0:01:01.741 *********** 2021-07-26T15:40:28.988 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) 2021-07-26T15:40:28.990 INFO:teuthology.task.ansible.out: => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.001 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.018 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": " 2021-07-26T15:40:29.020 INFO:teuthology.task.ansible.out:dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.031 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.033 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.043 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.045 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.058 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.072 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.080 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.094 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.104 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.115 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.126 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.141 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.196 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:29 +0000 (0:00:00.217) 0:01:01.959 *********** 2021-07-26T15:40:29.214 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-07-26T15:40:29.216 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-07-26T15:40:29.269 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-07-26T15:40:29.271 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:29.293 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:29 +0000 (0:00:00.097) 0:01:02.056 *********** 2021-07-26T15:40:29.356 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-07-26T15:40:29.357 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-07-26T15:40:29.488 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-07-26T15:40:29.523 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-07-26T15:40:29.608 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-07-26T15:40:29.662 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-07-26T15:40:29.758 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-07-26T15:40:29.801 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-07-26T15:40:29.907 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-07-26T15:40:29.968 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-07-26T15:40:30.033 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-07-26T15:40:30.067 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-07-26T15:40:30.163 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-07-26T15:40:30.206 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-07-26T15:40:30.302 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-07-26T15:40:30.348 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-07-26T15:40:30.439 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-07-26T15:40:30.494 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-07-26T15:40:30.591 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-07-26T15:40:30.639 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-07-26T15:40:30.744 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-07-26T15:40:30.789 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-07-26T15:40:30.884 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-07-26T15:40:30.928 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-07-26T15:40:31.038 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-07-26T15:40:31.073 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-07-26T15:40:31.176 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-07-26T15:40:31.218 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-07-26T15:40:31.325 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-07-26T15:40:31.378 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-07-26T15:40:31.451 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-07-26T15:40:31.520 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-07-26T15:40:31.596 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-07-26T15:40:31.671 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-07-26T15:40:31.738 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-07-26T15:40:31.821 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-07-26T15:40:31.859 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-07-26T15:40:31.956 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-07-26T15:40:31.999 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-07-26T15:40:32.097 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-07-26T15:40:32.139 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-07-26T15:40:32.235 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-07-26T15:40:32.268 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-07-26T15:40:32.374 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-07-26T15:40:32.408 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-07-26T15:40:32.516 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-07-26T15:40:32.550 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-07-26T15:40:32.685 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} ok: [smithi096.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-07-26T15:40:32.813 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-07-26T15:40:32.825 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-07-26T15:40:32.953 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-07-26T15:40:32.964 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-07-26T15:40:33.091 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-07-26T15:40:33.092 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-07-26T15:40:33.232 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-07-26T15:40:33.243 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-07-26T15:40:33.368 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-07-26T15:40:33.381 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-07-26T15:40:33.507 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} ok: [smithi096.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-07-26T15:40:33.646 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-07-26T15:40:33.648 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-07-26T15:40:33.773 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-07-26T15:40:33.785 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-07-26T15:40:33.912 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-07-26T15:40:33.924 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-07-26T15:40:34.053 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} ok: [smithi033.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-07-26T15:40:34.180 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-07-26T15:40:34.181 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-07-26T15:40:34.320 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-07-26T15:40:34.321 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-07-26T15:40:34.462 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-07-26T15:40:34.599 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-07-26T15:40:34.711 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-07-26T15:40:34.730 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-07-26T15:40:34.858 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-07-26T15:40:34.994 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-07-26T15:40:35.133 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-07-26T15:40:35.176 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-07-26T15:40:35.275 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-07-26T15:40:35.319 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-07-26T15:40:35.418 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-07-26T15:40:35.450 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-07-26T15:40:35.543 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-07-26T15:40:35.586 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-07-26T15:40:35.686 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-07-26T15:40:35.736 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-07-26T15:40:35.836 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-07-26T15:40:35.880 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-07-26T15:40:35.968 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-07-26T15:40:36.020 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-07-26T15:40:36.107 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-07-26T15:40:36.163 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:36 +0000 (0:00:06.869) 0:01:08.926 *********** 2021-07-26T15:40:36.173 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-07-26T15:40:36.306 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-07-26T15:40:36.456 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-07-26T15:40:36.601 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-07-26T15:40:36.608 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "checksum": "6b66beacdb1c95b0ac86e1041f3914cfa0c50311", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e34309bf71492baa6798d79247cca3d0", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314036.2545247-6613-265927639304571/source", "state": "file", "uid": 0} TASK [Remove revoked users] **************************************************** ok: [smithi033.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-07-26T15:40:36.633 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:36 +0000 (0:00:00.469) 0:01:09.396 *********** 2021-07-26T15:40:36.723 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:36 +0000 (0:00:00.088) 0:01:09.484 *********** 2021-07-26T15:40:36.751 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-07-26T15:40:36.757 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => { "msg": "Host smithi096.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-07-26T15:40:36.777 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:36 +0000 (0:00:00.055) 0:01:09.539 *********** 2021-07-26T15:40:36.900 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi096.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-07-26T15:40:36.924 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:36 +0000 (0:00:00.147) 0:01:09.687 *********** 2021-07-26T15:40:37.001 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.021 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.097) 0:01:09.784 *********** 2021-07-26T15:40:37.104 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.129 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.107) 0:01:09.891 *********** 2021-07-26T15:40:37.178 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-07-26T15:40:37.179 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "checksum": "6b66beacdb1c95b0ac86e1041f3914cfa0c50311", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e34309bf71492baa6798d79247cca3d0", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314036.8237238-6738-127079806242914/source", "state": "file", "uid": 0} 2021-07-26T15:40:37.205 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.076) 0:01:09.968 *********** 2021-07-26T15:40:37.216 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.242 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.037) 0:01:10.005 *********** 2021-07-26T15:40:37.299 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi033.front.sepia.ceph.com] => { "msg": "Host smithi033.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-07-26T15:40:37.325 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.082) 0:01:10.088 *********** 2021-07-26T15:40:37.331 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-07-26T15:40:37.335 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.365 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.033) 0:01:10.121 *********** 2021-07-26T15:40:37.411 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi033.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-07-26T15:40:37.433 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.074) 0:01:10.195 *********** 2021-07-26T15:40:37.439 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.465 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.032) 0:01:10.228 *********** 2021-07-26T15:40:37.507 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.533 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.068) 0:01:10.296 *********** 2021-07-26T15:40:37.542 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.579 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.044) 0:01:10.341 *********** 2021-07-26T15:40:37.633 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.658 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.079) 0:01:10.421 *********** 2021-07-26T15:40:37.666 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.694 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.034) 0:01:10.455 *********** 2021-07-26T15:40:37.748 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-07-26T15:40:37.750 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.781 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.088) 0:01:10.544 *********** 2021-07-26T15:40:37.791 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.814 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.033) 0:01:10.577 *********** 2021-07-26T15:40:37.853 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:37.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.063) 0:01:10.641 *********** 2021-07-26T15:40:37.923 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi096.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:37.962 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:37 +0000 (0:00:00.080) 0:01:10.722 *********** 2021-07-26T15:40:37.991 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.015 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.056) 0:01:10.778 *********** 2021-07-26T15:40:38.033 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-07-26T15:40:38.035 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.070 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.045) 0:01:10.824 *********** 2021-07-26T15:40:38.092 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.118 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.054) 0:01:10.879 *********** 2021-07-26T15:40:38.136 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-07-26T15:40:38.137 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.165 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.048) 0:01:10.927 *********** 2021-07-26T15:40:38.190 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.213 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.048) 0:01:10.975 *********** 2021-07-26T15:40:38.241 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-07-26T15:40:38.243 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.266 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.054) 0:01:11.029 *********** 2021-07-26T15:40:38.285 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.312 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.045) 0:01:11.075 *********** 2021-07-26T15:40:38.342 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-07-26T15:40:38.346 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:38.368 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.055) 0:01:11.131 *********** 2021-07-26T15:40:38.396 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-07-26T15:40:38.398 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi033.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:38.421 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.052) 0:01:11.183 *********** 2021-07-26T15:40:38.439 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.471 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.050) 0:01:11.234 *********** 2021-07-26T15:40:38.498 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-07-26T15:40:38.500 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.522 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.051) 0:01:11.285 *********** 2021-07-26T15:40:38.539 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-07-26T15:40:38.540 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:38.571 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.048) 0:01:11.334 *********** 2021-07-26T15:40:38.599 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:38.601 INFO:teuthology.task.ansible.out:TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.624 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.053) 0:01:11.387 *********** 2021-07-26T15:40:38.641 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-07-26T15:40:38.643 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.667 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.043) 0:01:11.430 *********** 2021-07-26T15:40:38.694 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-07-26T15:40:38.696 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.721 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.054) 0:01:11.484 *********** 2021-07-26T15:40:38.740 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-07-26T15:40:38.742 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.767 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.045) 0:01:11.530 *********** 2021-07-26T15:40:38.795 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-07-26T15:40:38.797 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:38.821 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.053) 0:01:11.583 *********** 2021-07-26T15:40:38.839 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-07-26T15:40:38.841 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.866 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.044) 0:01:11.628 *********** 2021-07-26T15:40:38.894 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-07-26T15:40:38.896 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.919 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.053) 0:01:11.682 *********** 2021-07-26T15:40:38.937 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:38.962 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:38 +0000 (0:00:00.043) 0:01:11.725 *********** 2021-07-26T15:40:38.991 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi033.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:39.016 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.053) 0:01:11.779 *********** 2021-07-26T15:40:39.043 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-07-26T15:40:39.046 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:39.068 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.051) 0:01:11.831 *********** 2021-07-26T15:40:39.085 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-07-26T15:40:39.088 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.110 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.042) 0:01:11.873 *********** 2021-07-26T15:40:39.149 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.178 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.067) 0:01:11.941 *********** 2021-07-26T15:40:39.195 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-07-26T15:40:39.197 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.220 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.042) 0:01:11.983 *********** 2021-07-26T15:40:39.250 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.274 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.052) 0:01:12.036 *********** 2021-07-26T15:40:39.289 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-07-26T15:40:39.291 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.315 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.041) 0:01:12.078 *********** 2021-07-26T15:40:39.343 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.370 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.055) 0:01:12.133 *********** 2021-07-26T15:40:39.391 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-07-26T15:40:39.393 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.418 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.047) 0:01:12.180 *********** 2021-07-26T15:40:39.455 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-07-26T15:40:39.457 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.482 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.064) 0:01:12.245 *********** 2021-07-26T15:40:39.489 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-07-26T15:40:39.491 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:39.518 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.035) 0:01:12.280 *********** 2021-07-26T15:40:39.557 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-07-26T15:40:39.560 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.594 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.077) 0:01:12.357 *********** 2021-07-26T15:40:39.614 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.641 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.047) 0:01:12.404 *********** 2021-07-26T15:40:39.691 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-07-26T15:40:39.693 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.719 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.077) 0:01:12.482 *********** 2021-07-26T15:40:39.736 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-07-26T15:40:39.738 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.763 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.043) 0:01:12.526 *********** 2021-07-26T15:40:39.793 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:39.823 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.060) 0:01:12.586 *********** 2021-07-26T15:40:39.842 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-07-26T15:40:39.845 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.868 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.045) 0:01:12.631 *********** 2021-07-26T15:40:39.887 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-07-26T15:40:39.889 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.915 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.045) 0:01:12.677 *********** 2021-07-26T15:40:39.934 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:39.960 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:39 +0000 (0:00:00.046) 0:01:12.723 *********** 2021-07-26T15:40:39.982 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-07-26T15:40:39.984 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.010 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.049) 0:01:12.773 *********** 2021-07-26T15:40:40.042 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.079 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.063) 0:01:12.837 *********** 2021-07-26T15:40:40.092 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-07-26T15:40:40.094 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.123 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.049) 0:01:12.886 *********** 2021-07-26T15:40:40.153 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.179 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.055) 0:01:12.942 *********** 2021-07-26T15:40:40.209 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-07-26T15:40:40.211 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.243 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.058) 0:01:13.000 *********** 2021-07-26T15:40:40.259 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-07-26T15:40:40.261 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:40.294 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.053) 0:01:13.054 *********** 2021-07-26T15:40:40.333 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-07-26T15:40:40.335 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.362 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.071) 0:01:13.125 *********** 2021-07-26T15:40:40.379 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-07-26T15:40:40.381 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.405 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.042) 0:01:13.168 *********** 2021-07-26T15:40:40.435 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-07-26T15:40:40.436 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.465 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.059) 0:01:13.228 *********** 2021-07-26T15:40:40.484 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.510 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.045) 0:01:13.273 *********** 2021-07-26T15:40:40.593 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-07-26T15:40:40.594 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.618 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.107) 0:01:13.381 *********** 2021-07-26T15:40:40.681 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-07-26T15:40:40.683 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.021147", "end": "2021-07-26 15:40:40.833905", "rc": 0, "start": "2021-07-26 15:40:40.812758", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-07-26T15:40:40.709 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.090) 0:01:13.472 *********** 2021-07-26T15:40:40.721 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.750 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.040) 0:01:13.512 *********** 2021-07-26T15:40:40.794 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.834 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.082) 0:01:13.595 *********** 2021-07-26T15:40:40.872 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi033.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.903 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.069) 0:01:13.664 *********** 2021-07-26T15:40:40.932 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:40.978 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:40 +0000 (0:00:00.075) 0:01:13.739 *********** 2021-07-26T15:40:41.016 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:41.078 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:41 +0000 (0:00:00.095) 0:01:13.835 *********** 2021-07-26T15:40:41.336 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-07-26T15:40:41.339 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.014366", "end": "2021-07-26 15:40:41.972144", "rc": 0, "start": "2021-07-26 15:40:41.957778", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-07-26T15:40:41.376 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:41 +0000 (0:00:00.303) 0:01:14.139 *********** 2021-07-26T15:40:41.378 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:41.497 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:41.540 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:41 +0000 (0:00:00.162) 0:01:14.301 *********** 2021-07-26T15:40:41.633 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:41.664 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:41 +0000 (0:00:00.125) 0:01:14.427 *********** 2021-07-26T15:40:41.684 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [smithi096.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:40:41.921 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:40:41.958 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:40:42.119 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:40:42.183 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:40:42.184 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:42.319 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:40:42.344 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:42 +0000 (0:00:00.679) 0:01:15.106 *********** 2021-07-26T15:40:42.376 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:40:42.422 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:42.449 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:42 +0000 (0:00:00.105) 0:01:15.211 *********** 2021-07-26T15:40:42.530 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:42.559 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:42 +0000 (0:00:00.106) 0:01:15.318 *********** 2021-07-26T15:40:42.582 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-07-26T15:40:42.586 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:40:42.631 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:42 +0000 (0:00:00.060) 0:01:15.378 *********** 2021-07-26T15:40:42.652 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:42.669 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:42 +0000 (0:00:00.050) 0:01:15.429 *********** 2021-07-26T15:40:42.695 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-07-26T15:40:42.697 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:42.730 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:42 +0000 (0:00:00.057) 0:01:15.486 *********** 2021-07-26T15:40:42.759 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:42.781 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:42 +0000 (0:00:00.057) 0:01:15.544 *********** 2021-07-26T15:40:42.811 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:42.843 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:42 +0000 (0:00:00.055) 0:01:15.600 *********** 2021-07-26T15:40:42.867 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:42.891 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:42 +0000 (0:00:00.054) 0:01:15.654 *********** 2021-07-26T15:40:42.925 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:42.958 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:42 +0000 (0:00:00.066) 0:01:15.721 *********** 2021-07-26T15:40:43.029 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:43.058 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:43 +0000 (0:00:00.095) 0:01:15.816 *********** 2021-07-26T15:40:43.129 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:43.153 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:43 +0000 (0:00:00.099) 0:01:15.916 *********** 2021-07-26T15:40:43.357 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.318013", "end": "2021-07-26 15:40:43.514760", "rc": 0, "start": "2021-07-26 15:40:43.196747", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:40:43.384 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:43 +0000 (0:00:00.230) 0:01:16.146 *********** 2021-07-26T15:40:43.453 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:43.477 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:43 +0000 (0:00:00.093) 0:01:16.240 *********** 2021-07-26T15:40:43.750 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ [WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.084984", "end": "2021-07-26 15:40:43.911352", "rc": 0, "start": "2021-07-26 15:40:43.826368", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:40:43.774 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:43 +0000 (0:00:00.297) 0:01:16.537 *********** 2021-07-26T15:40:43.877 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-07-26T15:40:43.879 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.570825", "end": "2021-07-26 15:40:44.513499", "rc": 0, "start": "2021-07-26 15:40:43.942674", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:40:43.912 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:43 +0000 (0:00:00.137) 0:01:16.675 *********** 2021-07-26T15:40:43.987 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:44.011 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:44 +0000 (0:00:00.099) 0:01:16.774 *********** 2021-07-26T15:40:44.323 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-07-26T15:40:44.325 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.120665", "end": "2021-07-26 15:40:44.954745", "rc": 0, "start": "2021-07-26 15:40:44.834080", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:40:44.348 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:44 +0000 (0:00:00.335) 0:01:17.109 *********** 2021-07-26T15:40:47.441 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** ok: [smithi096.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:40:47.466 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:47 +0000 (0:00:03.116) 0:01:20.226 *********** 2021-07-26T15:40:48.084 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:40:48.111 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:48 +0000 (0:00:00.647) 0:01:20.874 *********** 2021-07-26T15:40:48.191 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-07-26T15:40:48.192 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:40:48.217 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:48 +0000 (0:00:00.106) 0:01:20.980 *********** 2021-07-26T15:40:48.288 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-07-26T15:40:48.290 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.312 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:48 +0000 (0:00:00.094) 0:01:21.075 *********** 2021-07-26T15:40:48.856 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:40:48.883 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:48 +0000 (0:00:00.571) 0:01:21.646 *********** 2021-07-26T15:40:48.967 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.994 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:48 +0000 (0:00:00.110) 0:01:21.757 *********** 2021-07-26T15:40:49.012 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-07-26T15:40:49.015 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-07-26T15:40:49.059 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:49 +0000 (0:00:00.051) 0:01:21.809 *********** 2021-07-26T15:40:49.454 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-07-26T15:40:49.480 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:49 +0000 (0:00:00.433) 0:01:22.242 *********** 2021-07-26T15:40:49.790 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:40:49.816 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:49 +0000 (0:00:00.333) 0:01:22.576 *********** 2021-07-26T15:40:50.234 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:40:50.255 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:50 +0000 (0:00:00.441) 0:01:23.018 *********** 2021-07-26T15:40:50.262 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-07-26T15:40:50.264 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-07-26T15:40:50.577 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-07-26T15:40:50.682 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-07-26T15:40:50.896 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-07-26T15:40:50.922 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:50 +0000 (0:00:00.667) 0:01:23.685 *********** 2021-07-26T15:40:51.031 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-07-26T15:40:51.061 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-07-26T15:40:51.063 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:40:51.088 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:51 +0000 (0:00:00.163) 0:01:23.849 *********** 2021-07-26T15:40:51.336 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi033.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-07-26T15:40:51.380 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:51 +0000 (0:00:00.294) 0:01:24.143 *********** 2021-07-26T15:40:51.464 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi096.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-07-26T15:40:51.520 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:40:51.548 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:51 +0000 (0:00:00.167) 0:01:24.311 *********** 2021-07-26T15:40:51.766 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi096.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-07-26T15:40:51.948 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-07-26T15:40:52.116 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314051.7804408-9428-211617096771036/source", "state": "file", "uid": 0} 2021-07-26T15:40:52.143 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:52 +0000 (0:00:00.595) 0:01:24.906 *********** 2021-07-26T15:40:52.231 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-07-26T15:40:52.233 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:40:52.255 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:52 +0000 (0:00:00.111) 0:01:25.018 *********** 2021-07-26T15:40:52.263 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-07-26T15:40:52.264 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-07-26T15:40:52.330 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-07-26T15:40:52.332 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:52.356 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:52 +0000 (0:00:00.100) 0:01:25.118 *********** 2021-07-26T15:40:52.438 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:52.471 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:52 +0000 (0:00:00.115) 0:01:25.234 *********** 2021-07-26T15:40:52.562 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-07-26T15:40:52.564 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:40:52.574 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:40:52.595 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:40:52.606 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:40:52.637 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:52 +0000 (0:00:00.165) 0:01:25.399 *********** 2021-07-26T15:40:52.646 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** changed: [smithi033.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314052.273884-9507-227360154700203/source", "state": "file", "uid": 0} 2021-07-26T15:40:52.675 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:52 +0000 (0:00:00.038) 0:01:25.438 *********** 2021-07-26T15:40:52.715 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-07-26T15:40:52.717 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:52.741 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:52 +0000 (0:00:00.065) 0:01:25.504 *********** 2021-07-26T15:40:52.759 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-07-26T15:40:52.761 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:40:52.786 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:52 +0000 (0:00:00.044) 0:01:25.549 *********** 2021-07-26T15:40:52.860 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-07-26T15:40:52.862 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:52.889 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:52 +0000 (0:00:00.103) 0:01:25.652 *********** 2021-07-26T15:40:52.960 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-07-26T15:40:52.962 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:52.984 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:52 +0000 (0:00:00.094) 0:01:25.747 *********** 2021-07-26T15:40:53.076 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi033.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:40:53.087 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:40:53.109 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:40:53.134 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:53 +0000 (0:00:00.149) 0:01:25.897 *********** 2021-07-26T15:40:53.218 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-07-26T15:40:53.220 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:53.248 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:53 +0000 (0:00:00.108) 0:01:26.005 *********** 2021-07-26T15:40:53.667 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-07-26T15:40:53.669 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:40:53.693 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:53 +0000 (0:00:00.450) 0:01:26.456 *********** 2021-07-26T15:40:54.008 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:40:54.032 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:54 +0000 (0:00:00.339) 0:01:26.795 *********** 2021-07-26T15:40:54.034 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:54.104 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-07-26T15:40:54.135 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:54 +0000 (0:00:00.102) 0:01:26.898 *********** 2021-07-26T15:40:54.456 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-07-26T15:40:54.487 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:54 +0000 (0:00:00.351) 0:01:27.250 *********** 2021-07-26T15:40:54.551 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-07-26T15:40:54.575 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:54 +0000 (0:00:00.088) 0:01:27.338 *********** 2021-07-26T15:40:54.788 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi096.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-07-26T15:40:54.898 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-07-26T15:40:54.924 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:54 +0000 (0:00:00.346) 0:01:27.684 *********** 2021-07-26T15:40:54.930 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-07-26T15:40:54.942 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-07-26T15:40:54.973 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:54 +0000 (0:00:00.050) 0:01:27.735 *********** 2021-07-26T15:40:55.070 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:55.097 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:55 +0000 (0:00:00.123) 0:01:27.859 *********** 2021-07-26T15:40:55.127 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi033.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-07-26T15:40:55.183 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi096.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:55.205 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:55 +0000 (0:00:00.108) 0:01:27.968 *********** 2021-07-26T15:40:55.260 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-07-26T15:40:55.262 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-07-26T15:40:55.289 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:55 +0000 (0:00:00.083) 0:01:28.051 *********** 2021-07-26T15:40:55.302 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-07-26T15:40:55.304 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:55.338 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:55 +0000 (0:00:00.044) 0:01:28.095 *********** 2021-07-26T15:40:55.373 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:55.392 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:55 +0000 (0:00:00.059) 0:01:28.155 *********** 2021-07-26T15:40:55.466 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-07-26T15:40:55.468 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:55.494 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:55 +0000 (0:00:00.101) 0:01:28.257 *********** 2021-07-26T15:40:55.567 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:55.573 INFO:teuthology.task.ansible.out:TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:55.595 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:55 +0000 (0:00:00.101) 0:01:28.358 *********** 2021-07-26T15:40:55.789 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-07-26T15:40:55.791 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-07-26T15:40:55.831 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:55 +0000 (0:00:00.221) 0:01:28.580 *********** 2021-07-26T15:40:56.001 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-07-26T15:40:56.026 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.208) 0:01:28.789 *********** 2021-07-26T15:40:56.087 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-07-26T15:40:56.093 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:39:19 UTC", "ActiveEnterTimestampMonotonic": "15038316", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service systemd-journald.socket system.slice network.target sysinit.target remote-fs.target nss-lookup.target -.mount var-run.mount local-fs.target time-sync.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:39:19 UTC", "AssertTimestampMonotonic": "15016024", "Before": "xdm.service shutdown.target multi-user.target plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:39:19 UTC", "Co 2021-07-26T15:40:56.095 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15016023", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "898", "ExecMainStartTimestamp": "Mon 2021-07-26 15:39:19 UTC", "ExecMainStartTimestampMonotonic": "15038131", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:39:19 UTC] ; stop_time=[n/a] ; pid=898 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-07-26 15:39:19 UTC] ; stop_time=[n/a] ; pid=898 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-07-26T15:40:56.099 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:39:19 UTC", "InactiveExitTimestampMonotonic": "15038316", "InvocationID": "f0e942a4624549fd8c0115daa3f9fa1e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "898", "MemoryAccounting": "yes", "MemoryCurrent": "1265664", "MemoryD 2021-07-26T15:40:56.100 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:39:19 UTC", "StateChangeTimestampMonotonic": "15038316", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-07-26T15:40:56.102 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38333", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:40:56.127 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.101) 0:01:28.890 *********** 2021-07-26T15:40:56.215 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.253 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.126) 0:01:29.016 *********** 2021-07-26T15:40:56.333 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:39:05 UTC", "ActiveEnterTimestampMonotonic": "17355550", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target basic.target -.mount var-run.mount local-fs.target nss-lookup.target system.slice systemd-journald.socket remote-fs.target systemd-tmpfiles-setup.service time-sync.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:39:05 UTC", "AssertTimestampMonotonic": "17336440", "Before": "getty@tty1.service multi-user.target xdm.service shutdown.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive" 2021-07-26T15:40:56.339 INFO:teuthology.task.ansible.out:, "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:39:05 UTC", "ConditionTimestampMonotonic": "17336439", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "857", "ExecMainStartTimestamp": "Mon 2021-07-26 15:39:05 UTC", "ExecMainStartTimestampMonotonic": "17355261", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:39:05 UTC] ; stop_time=[n/a] ; pid=857 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-07-26 15:39:05 UTC] ; stop_time=[n/a] ; pid=857 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKil 2021-07-26T15:40:56.341 INFO:teuthology.task.ansible.out:lSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:39:05 UTC", "InactiveExitTimestampMonotonic": "17355550", "InvocationID": "62a183088fad4dbeb317bd8bdba14039", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127801", "LimitNPROCSoft": "127801", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127801", "LimitSIGPENDINGSoft": "127801", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755 2021-07-26T15:40:56.343 INFO:teuthology.task.ansible.out:", "MainPID": "857", "MemoryAccounting": "yes", "MemoryCurrent": "1310720", "MemoryDenyWriteExe 2021-07-26T15:40:56.352 INFO:teuthology.task.ansible.out:cute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:39:05 UTC", "StateChangeTimestampMonotonic": "1 2021-07-26T15:40:56.361 INFO:teuthology.task.ansible.out:7355550", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38340", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:40:56.380 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.120) 0:01:29.137 *********** 2021-07-26T15:40:56.384 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.407 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.032) 0:01:29.170 *********** 2021-07-26T15:40:56.461 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.488 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.080) 0:01:29.250 *********** 2021-07-26T15:40:56.498 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.530 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.043) 0:01:29.293 *********** 2021-07-26T15:40:56.563 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-07-26T15:40:56.565 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.591 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.060) 0:01:29.354 *********** 2021-07-26T15:40:56.623 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.659 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.060) 0:01:29.414 *********** 2021-07-26T15:40:56.674 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-07-26T15:40:56.684 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.720 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.059) 0:01:29.473 *********** 2021-07-26T15:40:56.727 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-07-26T15:40:56.730 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.753 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.043) 0:01:29.516 *********** 2021-07-26T15:40:56.790 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.811 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.056) 0:01:29.573 *********** 2021-07-26T15:40:56.828 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-07-26T15:40:56.831 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.860 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.047) 0:01:29.621 *********** 2021-07-26T15:40:56.892 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.922 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.062) 0:01:29.683 *********** 2021-07-26T15:40:56.939 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-07-26T15:40:56.941 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:56.974 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:56 +0000 (0:00:00.043) 0:01:29.727 *********** 2021-07-26T15:40:57.005 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-07-26T15:40:57.007 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:57.035 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.071) 0:01:29.798 *********** 2021-07-26T15:40:57.058 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-07-26T15:40:57.060 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:57.092 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.056) 0:01:29.855 *********** 2021-07-26T15:40:57.131 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:57.162 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.070) 0:01:29.925 *********** 2021-07-26T15:40:57.181 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-07-26T15:40:57.184 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:57.215 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.046) 0:01:29.972 *********** 2021-07-26T15:40:57.268 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:57.303 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.086) 0:01:30.058 *********** 2021-07-26T15:40:57.304 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:57.332 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.037) 0:01:30.095 *********** 2021-07-26T15:40:57.374 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-07-26T15:40:57.376 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:57.406 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.071) 0:01:30.167 *********** 2021-07-26T15:40:57.447 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-07-26T15:40:57.453 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:40:57.476 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.069) 0:01:30.237 *********** 2021-07-26T15:40:57.482 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-07-26T15:40:57.484 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:57.517 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.043) 0:01:30.280 *********** 2021-07-26T15:40:57.552 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-07-26T15:40:57.554 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-07-26T15:40:57.586 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.063) 0:01:30.344 *********** 2021-07-26T15:40:57.601 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:40:57.629 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.046) 0:01:30.391 *********** 2021-07-26T15:40:57.713 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi096.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-07-26T15:40:57.714 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-07-26T15:40:57.716 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-07-26T15:40:57.752 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.124) 0:01:30.515 *********** 2021-07-26T15:40:57.781 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.028) 0:01:30.544 *********** 2021-07-26T15:40:57.835 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi033.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-07-26T15:40:57.864 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.082) 0:01:30.626 *********** 2021-07-26T15:40:57.870 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-07-26T15:40:57.873 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-07-26T15:40:57.904 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.034) 0:01:30.661 *********** 2021-07-26T15:40:57.956 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-07-26T15:40:57.981 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.082) 0:01:30.744 *********** 2021-07-26T15:40:58.044 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-07-26T15:40:58.048 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:40:58.082 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.098) 0:01:30.842 *********** 2021-07-26T15:40:58.120 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:40:58.150 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.067) 0:01:30.910 *********** 2021-07-26T15:40:58.267 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-07-26T15:40:58.292 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.144) 0:01:31.055 *********** 2021-07-26T15:40:58.331 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-07-26T15:40:58.364 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.070) 0:01:31.125 *********** 2021-07-26T15:40:58.405 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-07-26T15:40:58.409 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.440 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.072) 0:01:31.198 *********** 2021-07-26T15:40:58.477 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.506 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.070) 0:01:31.269 *********** 2021-07-26T15:40:58.517 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-07-26T15:40:58.519 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.554 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.043) 0:01:31.313 *********** 2021-07-26T15:40:58.610 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.637 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.085) 0:01:31.399 *********** 2021-07-26T15:40:58.791 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi096.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-07-26T15:40:58.814 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.178) 0:01:31.577 *********** 2021-07-26T15:40:58.866 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-07-26T15:40:58.867 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:58.893 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.078) 0:01:31.656 *********** 2021-07-26T15:40:59.297 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-07-26T15:40:59.298 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-07-26T15:40:59.323 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.430) 0:01:32.086 *********** 2021-07-26T15:40:59.418 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-07-26T15:40:59.451 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.124) 0:01:32.211 *********** 2021-07-26T15:40:59.467 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi096"}, "changed": false} 2021-07-26T15:40:59.493 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.039) 0:01:32.250 *********** 2021-07-26T15:40:59.528 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi033"}, "changed": false} 2021-07-26T15:40:59.563 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.067) 0:01:32.317 *********** 2021-07-26T15:41:00.396 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-07-26T15:41:00.400 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi096.front.sepia.ceph.com", "ansible_hostname": "smithi096", "ansible_nodename": "smithi096"}, "changed": true, "name": "smithi096"} 2021-07-26T15:41:00.432 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.873) 0:01:33.191 *********** 2021-07-26T15:41:00.439 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi033.front.sepia.ceph.com", "ansible_hostname": "smithi033", "ansible_nodename": "smithi033"}, "changed": true, "name": "smithi033"} 2021-07-26T15:41:00.466 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.037) 0:01:33.229 *********** 2021-07-26T15:41:00.468 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:00.841 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-07-26T15:41:00.875 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.408) 0:01:33.638 *********** 2021-07-26T15:41:00.883 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-07-26T15:41:00.926 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.047) 0:01:33.685 *********** 2021-07-26T15:41:01.305 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-07-26T15:41:01.307 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-07-26T15:41:01.330 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.407) 0:01:34.093 *********** 2021-07-26T15:41:01.387 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-07-26T15:41:01.421 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.090) 0:01:34.184 *********** 2021-07-26T15:41:01.836 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi096.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-07-26T15:41:01.872 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.449) 0:01:34.634 *********** 2021-07-26T15:41:01.906 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-07-26T15:41:01.936 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.062) 0:01:34.696 *********** 2021-07-26T15:41:01.963 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.990 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.055) 0:01:34.752 *********** 2021-07-26T15:41:02.034 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.072 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.082) 0:01:34.835 *********** 2021-07-26T15:41:02.079 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-07-26T15:41:02.085 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.110 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.033) 0:01:34.868 *********** 2021-07-26T15:41:02.147 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.182 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.076) 0:01:34.945 *********** 2021-07-26T15:41:02.211 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-07-26T15:41:02.215 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.244 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.059) 0:01:35.005 *********** 2021-07-26T15:41:02.288 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.319 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.077) 0:01:35.082 *********** 2021-07-26T15:41:02.322 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:02.363 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-07-26T15:41:02.365 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.410 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.090) 0:01:35.172 *********** 2021-07-26T15:41:02.434 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.478 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.061) 0:01:35.234 *********** 2021-07-26T15:41:02.531 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-07-26T15:41:02.533 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.575 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.103) 0:01:35.338 *********** 2021-07-26T15:41:02.586 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.622 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.047) 0:01:35.385 *********** 2021-07-26T15:41:02.673 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:41:02.674 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.712 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.083) 0:01:35.469 *********** 2021-07-26T15:41:02.726 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.757 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.051) 0:01:35.520 *********** 2021-07-26T15:41:02.798 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.832 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.066) 0:01:35.587 *********** 2021-07-26T15:41:02.856 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.895 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.070) 0:01:35.657 *********** 2021-07-26T15:41:02.919 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.946 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.048) 0:01:35.706 *********** 2021-07-26T15:41:03.010 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.051 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.100) 0:01:35.806 *********** 2021-07-26T15:41:03.053 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:41:03.054 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.083 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.037) 0:01:35.844 *********** 2021-07-26T15:41:03.135 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.170 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.088) 0:01:35.933 *********** 2021-07-26T15:41:03.189 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-07-26T15:41:03.191 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.220 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.049) 0:01:35.983 *********** 2021-07-26T15:41:03.281 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.321 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.100) 0:01:36.084 *********** 2021-07-26T15:41:03.333 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-07-26T15:41:03.335 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.384 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.062) 0:01:36.146 *********** 2021-07-26T15:41:03.437 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.470 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.084) 0:01:36.230 *********** 2021-07-26T15:41:03.488 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-07-26T15:41:03.518 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.047) 0:01:36.278 *********** 2021-07-26T15:41:03.591 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.073) 0:01:36.351 *********** 2021-07-26T15:41:03.596 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-07-26T15:41:03.634 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.045) 0:01:36.397 *********** 2021-07-26T15:41:03.715 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.075) 0:01:36.473 *********** 2021-07-26T15:41:03.731 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-07-26T15:41:03.763 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.049) 0:01:36.522 *********** 2021-07-26T15:41:03.838 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.076) 0:01:36.598 *********** 2021-07-26T15:41:03.853 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-07-26T15:41:03.855 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.882 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.044) 0:01:36.642 *********** 2021-07-26T15:41:03.923 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.965 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.084) 0:01:36.727 *********** 2021-07-26T15:41:03.985 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-07-26T15:41:03.987 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.017 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.049) 0:01:36.776 *********** 2021-07-26T15:41:04.063 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.078 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.121 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.107) 0:01:36.884 *********** 2021-07-26T15:41:04.129 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.159 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.037) 0:01:36.921 *********** 2021-07-26T15:41:04.202 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.227 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.068) 0:01:36.990 *********** 2021-07-26T15:41:04.247 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:41:04.249 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.274 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.046) 0:01:37.036 *********** 2021-07-26T15:41:04.294 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.322 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.047) 0:01:37.084 *********** 2021-07-26T15:41:04.349 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-07-26T15:41:04.350 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.375 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.053) 0:01:37.137 *********** 2021-07-26T15:41:04.391 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.418 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.044) 0:01:37.181 *********** 2021-07-26T15:41:04.452 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-07-26T15:41:04.465 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.485 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.066) 0:01:37.248 *********** 2021-07-26T15:41:04.503 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.534 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.048) 0:01:37.297 *********** 2021-07-26T15:41:04.552 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-07-26T15:41:04.554 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.580 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.046) 0:01:37.343 *********** 2021-07-26T15:41:04.611 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.644 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.064) 0:01:37.407 *********** 2021-07-26T15:41:04.664 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-07-26T15:41:04.666 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.693 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.048) 0:01:37.456 *********** 2021-07-26T15:41:04.723 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.750 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.057) 0:01:37.513 *********** 2021-07-26T15:41:04.752 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:04.772 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-07-26T15:41:04.774 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.802 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.051) 0:01:37.564 *********** 2021-07-26T15:41:04.833 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.858 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.056) 0:01:37.621 *********** 2021-07-26T15:41:04.881 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:41:04.883 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.907 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.048) 0:01:37.669 *********** 2021-07-26T15:41:04.924 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.952 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.045) 0:01:37.715 *********** 2021-07-26T15:41:04.982 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.007 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.055) 0:01:37.770 *********** 2021-07-26T15:41:05.024 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.054 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.044) 0:01:37.815 *********** 2021-07-26T15:41:05.070 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-07-26T15:41:05.072 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.097 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.044) 0:01:37.860 *********** 2021-07-26T15:41:05.125 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.150 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.053) 0:01:37.913 *********** 2021-07-26T15:41:05.167 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-07-26T15:41:05.169 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.194 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.042) 0:01:37.955 *********** 2021-07-26T15:41:05.222 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.246 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.053) 0:01:38.009 *********** 2021-07-26T15:41:05.273 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:41:05.275 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.303 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.052) 0:01:38.061 *********** 2021-07-26T15:41:05.332 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.361 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.059) 0:01:38.121 *********** 2021-07-26T15:41:05.391 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-07-26T15:41:05.393 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.422 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.062) 0:01:38.184 *********** 2021-07-26T15:41:05.450 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.478 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.057) 0:01:38.241 *********** 2021-07-26T15:41:05.503 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.529 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.050) 0:01:38.292 *********** 2021-07-26T15:41:05.559 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.584 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.055) 0:01:38.347 *********** 2021-07-26T15:41:05.602 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-07-26T15:41:05.604 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.632 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.048) 0:01:38.395 *********** 2021-07-26T15:41:05.655 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.678 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.043) 0:01:38.439 *********** 2021-07-26T15:41:05.705 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.730 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.054) 0:01:38.493 *********** 2021-07-26T15:41:05.748 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.775 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.044) 0:01:38.538 *********** 2021-07-26T15:41:05.803 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-07-26T15:41:05.805 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.830 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.055) 0:01:38.593 *********** 2021-07-26T15:41:05.848 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.047) 0:01:38.641 *********** 2021-07-26T15:41:05.906 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-07-26T15:41:05.908 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.931 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.052) 0:01:38.694 *********** 2021-07-26T15:41:05.948 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:05.973 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.041) 0:01:38.735 *********** 2021-07-26T15:41:06.001 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-07-26T15:41:06.003 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:06.031 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:06 +0000 (0:00:00.059) 0:01:38.795 *********** 2021-07-26T15:41:06.049 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:06.077 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:06 +0000 (0:00:00.045) 0:01:38.841 *********** 2021-07-26T15:41:06.096 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-07-26T15:41:06.098 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:06.123 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:06 +0000 (0:00:00.045) 0:01:38.886 *********** 2021-07-26T15:41:06.153 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:06.179 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:06 +0000 (0:00:00.055) 0:01:38.942 *********** 2021-07-26T15:41:06.337 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-07-26T15:41:06.338 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005276", "end": "2021-07-26 15:41:06.506031", "rc": 0, "start": "2021-07-26 15:41:06.500755", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:06.363 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:06 +0000 (0:00:00.182) 0:01:39.124 *********** 2021-07-26T15:41:06.380 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005466", "end": "2021-07-26 15:41:07.023214", "rc": 0, "start": "2021-07-26 15:41:07.017748", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:06.405 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:06 +0000 (0:00:00.043) 0:01:39.168 *********** 2021-07-26T15:41:06.422 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-07-26T15:41:06.447 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:06 +0000 (0:00:00.042) 0:01:39.210 *********** 2021-07-26T15:41:06.500 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:06 +0000 (0:00:00.052) 0:01:39.262 *********** 2021-07-26T15:41:06.826 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-07-26T15:41:06.852 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:06 +0000 (0:00:00.351) 0:01:39.614 *********** 2021-07-26T15:41:06.892 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-07-26T15:41:06.918 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:06 +0000 (0:00:00.066) 0:01:39.681 *********** 2021-07-26T15:41:06.936 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:06.962 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:06 +0000 (0:00:00.042) 0:01:39.724 *********** 2021-07-26T15:41:06.990 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:07.018 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:07 +0000 (0:00:00.057) 0:01:39.781 *********** 2021-07-26T15:41:08.332 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-07-26T15:41:08.334 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-07-26T15:41:08.398 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-07-26T15:41:09.322 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-07-26T15:41:09.350 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:09 +0000 (0:00:02.329) 0:01:42.111 *********** 2021-07-26T15:41:09.397 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-07-26T15:41:09.423 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:09 +0000 (0:00:00.074) 0:01:42.186 *********** 2021-07-26T15:41:10.102 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-07-26T15:41:10.105 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:41:10.128 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:10 +0000 (0:00:00.705) 0:01:42.891 *********** 2021-07-26T15:41:10.193 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:41:10.228 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:10 +0000 (0:00:00.099) 0:01:42.991 *********** 2021-07-26T15:41:10.239 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-07-26T15:41:10.270 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:10 +0000 (0:00:00.041) 0:01:43.033 *********** 2021-07-26T15:41:10.352 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:10 +0000 (0:00:00.082) 0:01:43.115 *********** 2021-07-26T15:41:10.486 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-07-26T15:41:10.488 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.031169", "end": "2021-07-26 15:41:10.649540", "rc": 0, "start": "2021-07-26 15:41:10.618371", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:10.513 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:10 +0000 (0:00:00.160) 0:01:43.276 *********** 2021-07-26T15:41:10.573 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.035189", "end": "2021-07-26 15:41:11.206491", "rc": 0, "start": "2021-07-26 15:41:11.171302", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:10.599 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:10 +0000 (0:00:00.085) 0:01:43.362 *********** 2021-07-26T15:41:12.690 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:41:12.715 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:12 +0000 (0:00:02.116) 0:01:45.478 *********** 2021-07-26T15:41:12.818 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:41:12.846 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:12 +0000 (0:00:00.130) 0:01:45.609 *********** 2021-07-26T15:41:23.654 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-07-26T15:41:23.656 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r 2021-07-26T15:41:23.658 INFO:teuthology.task.ansible.out:\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-07-26T15:41:23.661 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:41:23.680 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:10.833) 0:01:56.443 *********** 2021-07-26T15:41:24.202 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r 2021-07-26T15:41:24.204 INFO:teuthology.task.ansible.out:\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-07-26T15:41:24.205 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:41:24.229 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.549) 0:01:56.992 *********** 2021-07-26T15:41:48.577 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* changed: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.\nNeed to get 3866 kB of archives.\nAfter this operation, 42.0 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]\nGet:3 http:/ 2021-07-26T15:41:48.582 INFO:teuthology.task.ansible.out:/archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB]\nFetched 3866 kB in 1s (4090 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.) 2021-07-26T15:41:48.585 INFO:teuthology.task.ansible.out:\r\nPreparing to unpack .../archives/apt_2.0.6_amd64.deb ...\r\nUnpacking apt (2.0.6) over (2.0.4) ...\r\nSetting up apt (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.6_amd64.deb ...\r\nUnpacking apt-utils (2.0.6) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.4) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state inform 2021-07-26T15:41:48.590 INFO:teuthology.task.ansible.out:ation...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.", "Need to get 3866 kB of archives.", "After this operation, 42.0 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]", "Get:7 http://archive.ubuntu 2021-07-26T15:41:48.591 INFO:teuthology.task.ansible.out:.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB]", "Fetched 3866 kB in 1s (4090 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading d 2021-07-26T15:41:48.593 INFO:teuthology.task.ansible.out:atabase ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.6_amd64.deb ...", "Unpacking apt (2.0.6) over (2.0.4) ...", "Setting up apt (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading databa 2021-07-26T15:41:48.594 INFO:teuthology.task.ansible.out:se ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.6_amd64.deb ...", "Unpacking apt-utils (2.0.6) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.4) ...", "Setting up apache2-data (2.4.41-4ubuntu3.4) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.4) ...", "Setting up apache2 (2.4.41-4ubuntu3.4) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:41:48.617 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:48 +0000 (0:00:24.388) 0:02:21.380 *********** 2021-07-26T15:41:48.698 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:48.722 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:48 +0000 (0:00:00.104) 0:02:21.484 *********** 2021-07-26T15:41:48.998 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:41:49.000 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.\nNeed to get 3866 kB of archives.\nAfter this operation, 42.0 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]\n 2021-07-26T15:41:49.005 INFO:teuthology.task.ansible.out:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB]\nFetched 3866 kB in 1s (4105 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_2.0.6_amd64.deb ...\r\nUnpacking apt (2.0.6 2021-07-26T15:41:49.006 INFO:teuthology.task.ansible.out:) over (2.0.4) ...\r\nSetting up apt (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.6_amd64.deb ...\r\nUnpacking apt-utils (2.0.6) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.4) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer re 2021-07-26T15:41:49.008 INFO:teuthology.task.ansible.out:quired:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.", "Need to get 3866 kB of archives.", "After this operation, 42.0 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB] 2021-07-26T15:41:49.012 INFO:teuthology.task.ansible.out:", "Fetched 3866 kB in 1s (4105 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.6_amd64.deb ...", "Unpacking apt (2.0.6) over (2.0.4) ...", "Setting up apt (2.0.6) ...", "(Reading database ... ", "( 2021-07-26T15:41:49.013 INFO:teuthology.task.ansible.out:Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading dat 2021-07-26T15:41:49.015 INFO:teuthology.task.ansible.out:abase ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.6_amd64.deb ...", "Unpacking apt-utils (2.0.6) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.4) ...", "Setting up apache2-data (2.4.41-4ubuntu3.4) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.4) ...", "Setting up apache2 (2.4.41-4ubuntu3.4) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:41:49.038 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:49 +0000 (0:00:00.314) 0:02:21.799 *********** 2021-07-26T15:41:49.119 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-07-26T15:41:49.130 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:49.147 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:49 +0000 (0:00:00.106) 0:02:21.905 *********** 2021-07-26T15:42:02.526 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:42:02.528 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-07-26T15:42:02.530 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.17 [6738 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]\nFetched 18.8 MB in 1s (14.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-07-26T15:42:02.531 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.17) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-07-26T15:42:02.533 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]", "Fetched 18.8 MB in 1s (14.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb . 2021-07-26T15:42:02.535 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.17) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.17) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing 2021-07-26T15:42:02.536 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-07-26T15:42:02.554 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:02 +0000 (0:00:13.412) 0:02:35.317 *********** 2021-07-26T15:42:03.185 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-07-26T15:42:03.187 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.17 [6738 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]\nFetched 18.8 MB in 1s (14.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-07-26T15:42:03.189 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.17) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-07-26T15:42:03.191 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]", "Fetched 18.8 MB in 1s (14.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb . 2021-07-26T15:42:03.192 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...", "Unpa 2021-07-26T15:42:03.193 INFO:teuthology.task.ansible.out:cking librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.17) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.17) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing 2021-07-26T15:42:03.194 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-07-26T15:42:03.218 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:03 +0000 (0:00:00.664) 0:02:35.981 *********** 2021-07-26T15:42:03.323 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:42:03.357 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:03 +0000 (0:00:00.138) 0:02:36.120 *********** 2021-07-26T15:42:03.949 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:42:03.976 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:03 +0000 (0:00:00.613) 0:02:36.733 *********** 2021-07-26T15:42:04.117 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-07-26T15:42:04.119 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:42:04.143 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:04 +0000 (0:00:00.173) 0:02:36.906 *********** 2021-07-26T15:42:04.321 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-07-26T15:42:04.346 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:04 +0000 (0:00:00.201) 0:02:37.108 *********** 2021-07-26T15:42:04.428 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-07-26T15:42:04.429 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:04.452 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:04 +0000 (0:00:00.106) 0:02:37.214 *********** 2021-07-26T15:42:04.642 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-07-26T15:42:04.669 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:04 +0000 (0:00:00.212) 0:02:37.427 *********** 2021-07-26T15:42:04.704 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:42:04.725 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:04 +0000 (0:00:00.059) 0:02:37.487 *********** 2021-07-26T15:42:04.906 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-07-26T15:42:04.928 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:04 +0000 (0:00:00.204) 0:02:37.691 *********** 2021-07-26T15:42:05.000 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:05.031 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:05 +0000 (0:00:00.102) 0:02:37.793 *********** 2021-07-26T15:42:05.072 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-07-26T15:42:05.072 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-07-26T15:42:05.101 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:05 +0000 (0:00:00.069) 0:02:37.863 *********** 2021-07-26T15:42:05.238 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-07-26T15:42:05.263 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:05 +0000 (0:00:00.162) 0:02:38.026 *********** 2021-07-26T15:42:05.326 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi096.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-07-26T15:42:05.359 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:05 +0000 (0:00:00.096) 0:02:38.122 *********** 2021-07-26T15:42:05.552 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:05.573 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:05 +0000 (0:00:00.214) 0:02:38.336 *********** 2021-07-26T15:42:05.686 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-07-26T15:42:05.688 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-07-26T15:42:05.712 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:05 +0000 (0:00:00.138) 0:02:38.475 *********** 2021-07-26T15:42:05.714 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:05.897 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-07-26T15:42:05.899 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:41:40 UTC", "ActiveEnterTimestampMonotonic": "156586275", "ActiveExitTimestamp": "Mon 2021-07-26 15:41:40 UTC", "ActiveExitTimestampMonotonic": "156501982", "ActiveState": "active", "After": "systemd-journald.socket sysinit.target systemd-tmpfiles-setup.service basic.target system.slice network.target -.mount nss-lookup.target remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:41:40 UTC", "AssertTimestampMonotonic": "156551499", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:41:40 UTC", "ConditionTimestampMonotonic": "156551498", "ConfigurationDirec 2021-07-26T15:42:05.900 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6523", "ExecMainStartTimestamp": "Mon 2021-07-26 15:41:40 UTC", "ExecMainStartTimestampMonotonic": "156586248", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-07-26T15:42:05.902 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-07-26 15:41:40 UTC", "InactiveEnterTimestampMonotonic": "156550522", "InactiveExitTimestamp": "Mon 2021-07-26 15:41:40 UTC", "InactiveExitTimestampMonotonic": "156553110", "InvocationID": "8901dcb26f6c4dd3a59048f4f1162232", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6523", "MemoryAccounting": "yes", "MemoryCurrent": "6832128", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-07-26T15:42:05.904 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:41:40 UTC", "StateChangeTimestampMonotonic": "156586275", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-07-26T15:42:05.905 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:42:05.927 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:05 +0000 (0:00:00.214) 0:02:38.690 *********** 2021-07-26T15:42:05.939 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-07-26T15:42:05.939 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-07-26T15:42:05.967 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:05 +0000 (0:00:00.040) 0:02:38.730 *********** 2021-07-26T15:42:05.969 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:06.011 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.038 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.071) 0:02:38.801 *********** 2021-07-26T15:42:06.127 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.167 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.115) 0:02:38.916 *********** TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi033.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:06.197 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.038) 0:02:38.955 *********** 2021-07-26T15:42:06.242 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.266 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.074) 0:02:39.029 *********** 2021-07-26T15:42:06.351 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.377 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.111) 0:02:39.140 *********** 2021-07-26T15:42:06.475 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.508 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.130) 0:02:39.271 *********** 2021-07-26T15:42:06.545 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:41:42 UTC", "ActiveEnterTimestampMonotonic": "174574325", "ActiveExitTimestamp": "Mon 2021-07-26 15:41:42 UTC", "ActiveExitTimestampMonotonic": "174489766", "ActiveState": "active", "After": "network.target systemd-journald.socket basic.target system.slice sysinit.target nss-lookup.target remote-fs.target -.mount systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:41:42 UTC", "AssertTimestampMonotonic": "174539101", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021- 2021-07-26T15:42:06.548 INFO:teuthology.task.ansible.out:07-26 15:41:42 UTC", "ConditionTimestampMonotonic": "174539100", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6431", "ExecMainStartTimestamp": "Mon 2021-07-26 15:41:42 UTC", "ExecMainStartTimestampMonotonic": "174574296", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOR 2021-07-26T15:42:06.554 INFO:teuthology.task.ansible.out:eadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-07-26 15:41:42 UTC", "InactiveEnterTimestampMonotonic": "174538236", "InactiveExitTimestamp": "Mon 2021-07-26 15:41:42 UTC", "InactiveExitTimestampMonotonic": "174540843", "InvocationID": "1e1bb26c39bc4b3bb7f65f30266c4354", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127801", "LimitNPROCSoft": "127801", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127801", "LimitSIGPENDINGSoft": "127801", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6431", "MemoryAccounting": "yes", "MemoryCurrent": "6692864", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit 2021-07-26T15:42:06.559 INFO:teuthology.task.ansible.out:": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:41:42 UTC", "StateChangeTimestampMonotonic": "174574325", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefi 2021-07-26T15:42:06.562 INFO:teuthology.task.ansible.out:x": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38340", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:42:06.575 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.066) 0:02:39.337 *********** 2021-07-26T15:42:06.593 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-07-26T15:42:06.595 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.620 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.046) 0:02:39.383 *********** 2021-07-26T15:42:06.664 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-07-26T15:42:06.666 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.692 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.069) 0:02:39.452 *********** 2021-07-26T15:42:06.709 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.735 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.045) 0:02:39.498 *********** 2021-07-26T15:42:06.767 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-07-26T15:42:06.769 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.804 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.061) 0:02:39.560 *********** 2021-07-26T15:42:06.827 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:42:06.829 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.855 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.057) 0:02:39.618 *********** 2021-07-26T15:42:06.884 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.918 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.062) 0:02:39.680 *********** 2021-07-26T15:42:06.935 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:06.937 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:06.961 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:06 +0000 (0:00:00.043) 0:02:39.724 *********** 2021-07-26T15:42:07.002 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-07-26T15:42:07.004 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.031 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.067) 0:02:39.791 *********** 2021-07-26T15:42:07.047 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-07-26T15:42:07.049 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.074 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.045) 0:02:39.837 *********** 2021-07-26T15:42:07.102 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:42:07.107 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.132 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.054) 0:02:39.892 *********** 2021-07-26T15:42:07.148 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.176 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.047) 0:02:39.939 *********** 2021-07-26T15:42:07.205 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-07-26T15:42:07.207 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.231 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.054) 0:02:39.994 *********** 2021-07-26T15:42:07.250 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:42:07.252 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.287 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.046) 0:02:40.041 *********** 2021-07-26T15:42:07.307 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.332 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.053) 0:02:40.095 *********** 2021-07-26T15:42:07.333 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:07.350 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.374 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.042) 0:02:40.137 *********** 2021-07-26T15:42:07.403 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:42:07.405 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.428 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.053) 0:02:40.190 *********** 2021-07-26T15:42:07.447 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:42:07.449 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.478 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.046) 0:02:40.237 *********** 2021-07-26T15:42:07.514 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:07.516 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.544 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.070) 0:02:40.307 *********** 2021-07-26T15:42:07.566 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:42:07.568 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.606 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.062) 0:02:40.369 *********** 2021-07-26T15:42:07.616 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-07-26T15:42:07.618 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.644 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.037) 0:02:40.407 *********** 2021-07-26T15:42:07.704 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.730 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.086) 0:02:40.493 *********** 2021-07-26T15:42:07.739 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:42:07.740 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.769 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.039) 0:02:40.532 *********** 2021-07-26T15:42:07.810 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-07-26T15:42:07.812 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.838 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.068) 0:02:40.601 *********** 2021-07-26T15:42:07.856 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:42:07.858 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.904 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.052) 0:02:40.653 *********** 2021-07-26T15:42:07.924 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-07-26T15:42:07.926 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:07.955 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:07 +0000 (0:00:00.063) 0:02:40.716 *********** 2021-07-26T15:42:07.985 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.010 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.056) 0:02:40.773 *********** 2021-07-26T15:42:08.016 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:08.044 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.068 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.057) 0:02:40.831 *********** 2021-07-26T15:42:08.086 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:42:08.088 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.114 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.044) 0:02:40.875 *********** 2021-07-26T15:42:08.154 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.178 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.065) 0:02:40.941 *********** 2021-07-26T15:42:08.185 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:08.186 INFO:teuthology.task.ansible.out:TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:42:08.187 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.218 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.040) 0:02:40.981 *********** 2021-07-26T15:42:08.258 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:42:08.261 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.284 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.065) 0:02:41.047 *********** 2021-07-26T15:42:08.299 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.326 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.042) 0:02:41.089 *********** 2021-07-26T15:42:08.358 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:42:08.359 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.383 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.056) 0:02:41.146 *********** 2021-07-26T15:42:08.401 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.428 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.044) 0:02:41.191 *********** 2021-07-26T15:42:08.466 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.486 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.056) 0:02:41.247 *********** 2021-07-26T15:42:08.514 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.560 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.072) 0:02:41.319 *********** 2021-07-26T15:42:08.581 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.605 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.048) 0:02:41.368 *********** 2021-07-26T15:42:08.611 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:08.646 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.675 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.069) 0:02:41.438 *********** 2021-07-26T15:42:08.676 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:08.710 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.739 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.059) 0:02:41.497 *********** 2021-07-26T15:42:08.756 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.785 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.044) 0:02:41.542 *********** 2021-07-26T15:42:08.809 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.850 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.064) 0:02:41.607 *********** 2021-07-26T15:42:08.862 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:08.894 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.050) 0:02:41.657 *********** 2021-07-26T15:42:08.977 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:42:08.979 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:09.001 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:08 +0000 (0:00:00.106) 0:02:41.764 *********** 2021-07-26T15:42:09.050 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-07-26T15:42:09.058 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-07-26T15:42:09.077 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:09 +0000 (0:00:00.074) 0:02:41.838 *********** 2021-07-26T15:42:09.083 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:09.115 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:09 +0000 (0:00:00.036) 0:02:41.875 *********** 2021-07-26T15:42:09.195 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:42:09.197 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:09.219 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:09 +0000 (0:00:00.106) 0:02:41.982 *********** 2021-07-26T15:42:09.300 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:09.324 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:09 +0000 (0:00:00.105) 0:02:42.087 *********** 2021-07-26T15:42:09.405 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:09.431 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:09 +0000 (0:00:00.104) 0:02:42.192 *********** 2021-07-26T15:42:09.525 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-07-26T15:42:09.551 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:09 +0000 (0:00:00.121) 0:02:42.314 *********** 2021-07-26T15:42:09.632 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-07-26T15:42:09.653 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:09 +0000 (0:00:00.102) 0:02:42.416 *********** 2021-07-26T15:42:09.661 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-07-26T15:42:09.662 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:09.693 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:09 +0000 (0:00:00.039) 0:02:42.456 *********** 2021-07-26T15:42:10.076 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-07-26T15:42:10.078 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-07-26T15:42:10.102 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:10 +0000 (0:00:00.408) 0:02:42.865 *********** 2021-07-26T15:42:10.186 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-07-26T15:42:10.188 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-07-26T15:42:10.239 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:10 +0000 (0:00:00.129) 0:02:42.994 *********** 2021-07-26T15:42:10.264 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:10 +0000 (0:00:00.029) 0:02:43.024 *********** 2021-07-26T15:42:10.648 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-07-26T15:42:10.690 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:10 +0000 (0:00:00.428) 0:02:43.453 *********** 2021-07-26T15:42:10.699 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-07-26T15:42:10.701 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-07-26T15:42:10.730 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:10 +0000 (0:00:00.040) 0:02:43.493 *********** 2021-07-26T15:42:11.122 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-07-26T15:42:11.154 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:00.423) 0:02:43.917 *********** 2021-07-26T15:42:11.175 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-07-26T15:42:11.212 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:00.054) 0:02:43.972 *********** 2021-07-26T15:42:11.409 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:11.438 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:00.229) 0:02:44.201 *********** 2021-07-26T15:42:11.442 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:11.530 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:11.554 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:00.115) 0:02:44.317 *********** 2021-07-26T15:42:11.584 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-07-26T15:42:11.586 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-07-26T15:42:11.612 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:00.058) 0:02:44.375 *********** 2021-07-26T15:42:11.632 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:11.659 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:00.045) 0:02:44.422 *********** 2021-07-26T15:42:11.762 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-07-26T15:42:11.764 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:11.791 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:00.132) 0:02:44.554 *********** 2021-07-26T15:42:11.853 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi033.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:11.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:00.085) 0:02:44.640 *********** 2021-07-26T15:42:11.887 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:11.918 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:00.036) 0:02:44.676 *********** 2021-07-26T15:42:11.958 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:11.981 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:00.067) 0:02:44.744 *********** 2021-07-26T15:42:11.992 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.022 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.037) 0:02:44.782 *********** 2021-07-26T15:42:12.065 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.090 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.068) 0:02:44.851 *********** 2021-07-26T15:42:12.125 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-07-26T15:42:12.152 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.060) 0:02:44.912 *********** 2021-07-26T15:42:12.197 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.227 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.078) 0:02:44.990 *********** 2021-07-26T15:42:12.260 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-07-26T15:42:12.261 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.271 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.273 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.283 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.285 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.295 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-07-26T15:42:12.297 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.307 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.319 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.323 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-07-26T15:42:12.325 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi096.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.348 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.120) 0:02:45.111 *********** 2021-07-26T15:42:12.357 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.359 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.392 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.043) 0:02:45.155 *********** 2021-07-26T15:42:12.421 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.447 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.054) 0:02:45.210 *********** 2021-07-26T15:42:12.566 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-07-26T15:42:12.609 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.154) 0:02:45.364 *********** 2021-07-26T15:42:12.670 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.015072", "end": "2021-07-26 15:42:12.634962", "rc": 0, "start": "2021-07-26 15:42:12.619890", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock"]} 2021-07-26T15:42:12.713 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.111) 0:02:45.476 *********** 2021-07-26T15:42:12.723 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi033.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.745 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.747 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.785 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi033.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.798 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.828 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.114) 0:02:45.591 *********** 2021-07-26T15:42:12.835 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-07-26T15:42:12.836 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.837 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.837 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.837 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.050) 0:02:45.641 *********** 2021-07-26T15:42:12.919 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:12.945 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:12 +0000 (0:00:00.066) 0:02:45.708 *********** 2021-07-26T15:42:13.026 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:13.053 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:13 +0000 (0:00:00.107) 0:02:45.816 *********** 2021-07-26T15:42:13.138 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.011796", "end": "2021-07-26 15:42:13.110142", "rc": 0, "start": "2021-07-26 15:42:13.098346", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock"]} 2021-07-26T15:42:13.172 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:13 +0000 (0:00:00.117) 0:02:45.933 *********** 2021-07-26T15:42:13.256 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:13.288 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:13 +0000 (0:00:00.117) 0:02:46.051 *********** 2021-07-26T15:42:13.370 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:13.394 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:13 +0000 (0:00:00.106) 0:02:46.157 *********** 2021-07-26T15:42:13.470 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:13.496 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:13 +0000 (0:00:00.101) 0:02:46.258 *********** 2021-07-26T15:42:13.765 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-07-26T15:42:13.767 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:42:13.791 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:13 +0000 (0:00:00.295) 0:02:46.554 *********** 2021-07-26T15:42:13.866 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:13.890 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:13 +0000 (0:00:00.099) 0:02:46.653 *********** 2021-07-26T15:42:13.994 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi096.front.sepia.ceph.com] => (item={'block_used': 13859362, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235746, 'size_available': 926661615616, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235746, "block_size": 4096, "block_total": 240095108, "block_used": 13859362, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661615616, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-07-26T15:42:14.026 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:14 +0000 (0:00:00.131) 0:02:46.785 *********** 2021-07-26T15:42:14.234 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009421", "end": "2021-07-26 15:42:14.394332", "rc": 0, "start": "2021-07-26 15:42:14.384911", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:42:14.262 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:14 +0000 (0:00:00.235) 0:02:47.021 *********** 2021-07-26T15:42:14.289 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:14 +0000 (0:00:00.029) 0:02:47.050 *********** 2021-07-26T15:42:14.344 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:14.375 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:14 +0000 (0:00:00.086) 0:02:47.137 *********** 2021-07-26T15:42:14.392 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-07-26T15:42:14.393 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'block_used': 13859362, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235746, 'size_available': 926661615616, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235746, "block_size": 4096, "block_total": 240095108, "block_used": 13859362, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661615616, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:14.434 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:14 +0000 (0:00:00.057) 0:02:47.194 *********** 2021-07-26T15:42:14.474 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:42:14.477 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item={'block_used': 13859366, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235742, 'size_available': 926661599232, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150121, 'block_size': 4096, 'inode_available': 60904855}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235742, "block_size": 4096, "block_total": 240095108, "block_used": 13859366, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904855, "inode_total": 61054976, "inode_used": 150121, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661599232, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-07-26T15:42:14.515 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:14 +0000 (0:00:00.082) 0:02:47.277 *********** 2021-07-26T15:42:14.516 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:14.527 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-07-26T15:42:14.558 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:14 +0000 (0:00:00.037) 0:02:47.314 *********** 2021-07-26T15:42:14.694 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:14.730 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-07-26T15:42:14.732 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009360", "end": "2021-07-26 15:42:15.369318", "rc": 0, "start": "2021-07-26 15:42:15.359958", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:14.759 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:14 +0000 (0:00:00.207) 0:02:47.522 *********** 2021-07-26T15:42:14.852 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-07-26T15:42:14.854 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'block_used': 13859366, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235742, 'size_available': 926661599232, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150121, 'block_size': 4096, 'inode_available': 60904855}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235742, "block_size": 4096, "block_total": 240095108, "block_used": 13859366, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904855, "inode_total": 61054976, "inode_used": 150121, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661599232, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:14.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:14 +0000 (0:00:00.118) 0:02:47.641 *********** 2021-07-26T15:42:14.882 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:14.978 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-07-26T15:42:15.032 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:15 +0000 (0:00:00.140) 0:02:47.781 *********** 2021-07-26T15:42:15.115 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:16.485 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcoaQOk6R6pXfdGMTQIgLv4YosWkf3TvjZ'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.686226", "end": "2021-07-26 15:42:16.643668", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcoaQOk6R6pXfdGMTQIgLv4YosWkf3TvjZ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:14.957442", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:16.497 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:16.509 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:16.698 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juJVk0UXNIVyzLv4PvK2PzTAu6v38LTCyF'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.420476", "end": "2021-07-26 15:42:17.317914", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juJVk0UXNIVyzLv4PvK2PzTAu6v38LTCyF"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:15.897438", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-d 2021-07-26T15:42:16.702 INFO:teuthology.task.ansible.out:eadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:16.722 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:17.783 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcf1V8PHPPqdUgtwqD1u5NHpq8DGhvEpuV'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.144815", "end": "2021-07-26 15:42:17.942266", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcf1V8PHPPqdUgtwqD1u5NHpq8DGhvEpuV"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:16.797451", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:17.798 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QGMP', 'wwn-0x5000c50091dfbebc'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QGMP-part1', 'wwn-0x5000c50091dfbebc-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091dfbebc', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QGMP', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGMP", "wwn-0x5000c50091dfbebc"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGMP-part1", "wwn-0x5000c50091dfbebc-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QGMP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091dfbebc"}}, 2021-07-26T15:42:17.801 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-07-26T15:42:17.986 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2ju2SOevJr53RiPZey9zpfJGhC4ISiR1dHh'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.129052", "end": "2021-07-26 15:42:18.604058", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2ju2SOevJr53RiPZey9zpfJGhC4ISiR1dHh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:17.475006", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:17.987 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2L', 'wwn-0x5000c500871a8992'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2L-part1', 'wwn-0x5000c500871a8992-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a8992', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQ2L', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ2L", "wwn-0x5000c500871a8992"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ2L-part1", "wwn-0x5000c500871a8992-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQ2L", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a8992"}}, 2021-07-26T15:42:17.989 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-07-26T15:42:19.084 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-OuTvon-3qJx-lHma-Q7uA-x1BY-8FYC-h7V1NN', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NH400BGN', 'nvme-nvme.8086-504846543632303430304e4834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.161135", "end": "2021-07-26 15:42:19.239766", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-OuTvon-3qJx-lHma-Q7uA-x1BY-8FYC-h7V1NN", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NH400BGN", "nvme-nvme.8086-504846543632303430304e4834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:18.078631", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-07-26T15:42:19.086 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:19.105 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:19.257 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-DOgm6L-bdy5-02Y4-oYBq-jhAK-jVIz-cMJ2TJ', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330008Q400BGN', 'nvme-nvme.8086-43564654353333303030385134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.125696", "end": "2021-07-26 15:42:19.880473", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-DOgm6L-bdy5-02Y4-oYBq-jhAK-jVIz-cMJ2TJ", "nvme-INTEL_SSDPEDMD400G4_CVFT5330008Q400BGN", "nvme-nvme.8086-43564654353333303030385134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:18.754777", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-07-26T15:42:19.263 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:19.268 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:19.303 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:20.359 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvc2mWLI2jowBaNLLhBhaaWsbDUq2pRQoT2'], 'uuids': ['29a5ae23-4f48-4673-a34d-1b8e345ab35e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.123984", "end": "2021-07-26 15:42:20.509356", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvc2mWLI2jowBaNLLhBhaaWsbDUq2pRQoT2"], "labels": [], "masters": [], "uuids": ["29a5ae23-4f48-4673-a34d-1b8e345ab35e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:19.385372", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:20.373 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:20.383 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:20.555 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juRPUP8lGy9zGv0HgEIZU24yntlDywYGfv'], 'uuids': ['5cc2f665-fd31-4ad3-8ba1-a074fab7abd8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.123880", "end": "2021-07-26 15:42:21.183609", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juRPUP8lGy9zGv0HgEIZU24yntlDywYGfv"], "labels": [], "masters": [], "uuids": ["5cc2f665-fd31-4ad3-8ba1-a074fab7abd8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:20.059729", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:20.566 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:20.567 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:21.656 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcyK1UnjGerxCQNzAmA3Mq507GvU32ewx2'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.129757", "end": "2021-07-26 15:42:21.809363", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcyK1UnjGerxCQNzAmA3Mq507GvU32ewx2"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:20.679606", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:21.668 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:21.850 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juQWEc7YX5vTar5N8S61W86veVs6TjizOK'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.141679", "end": "2021-07-26 15:42:22.483683", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juQWEc7YX5vTar5N8S61W86veVs6TjizOK"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:21.342004", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:21.866 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:23.118 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcvzbvvHAwa7FlfTeJU1GogSlFicTbbnFw'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.312957", "end": "2021-07-26 15:42:23.275244", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcvzbvvHAwa7FlfTeJU1GogSlFicTbbnFw"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:21.962287", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:23.130 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juu6oKn4t1lMyFLkbwOhQ1l5bxSbH0Fbd7'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.111201", "end": "2021-07-26 15:42:23.750067", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juu6oKn4t1lMyFLkbwOhQ1l5bxSbH0Fbd7"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:22.638866", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:23.181 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:23 +0000 (0:00:08.162) 0:02:55.944 *********** 2021-07-26T15:42:23.207 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:23 +0000 (0:00:00.025) 0:02:55.969 *********** 2021-07-26T15:42:23.284 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:23.314 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:23.595 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juJVk0UXNIVyzLv4PvK2PzTAu6v38LTCyF'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.164957", "end": "2021-07-26 15:42:24.219482", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juJVk0UXNIVyzLv4PvK2PzTAu6v38LTCyF"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:24.054525", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159957 s, 721 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159957 s, 721 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:23.603 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcoaQOk6R6pXfdGMTQIgLv4YosWkf3TvjZ'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.158747", "end": "2021-07-26 15:42:23.744743", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcoaQOk6R6pXfdGMTQIgLv4YosWkf3TvjZ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sect 2021-07-26T15:42:23.604 INFO:teuthology.task.ansible.out:ors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:23.585996", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153875 s, 750 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153875 s, 750 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "parti 2021-07-26T15:42:23.606 INFO:teuthology.task.ansible.out:tions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:23.895 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2ju2SOevJr53RiPZey9zpfJGhC4ISiR1dHh'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "-1 day, 23:59:59.498201", "end": "2021-07-26 15:42:23.867725", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2ju2SOevJr53RiPZey9zpfJGhC4ISiR1dHh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:24.369524", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15681 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15681 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:23.916 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2L', 'wwn-0x5000c500871a8992'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4HQ2L-part1', 'wwn-0x5000c500871a8992-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871a8992', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4HQ2L', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ2L", "wwn-0x5000c500871a8992"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4HQ2L-part1", "wwn-0x5000c500871a8992-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4HQ2L", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871a8992"}}, 2021-07-26T15:42:23.918 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcf1V8PHPPqdUgtwqD1u5NHpq8DGhvEpuV'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.176732", "end": "2021-07-26 15:42:24.065094", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcf1V8PHPPqdUgtwqD1u5NHpq8DGhvEpuV"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:23.888362", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.17189 s, 671 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.17189 s, 671 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QGMP', 'wwn-0x5000c50091dfbebc'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1 2021-07-26T15:42:23.919 INFO:teuthology.task.ansible.out:000NM0033-9ZM173_Z1W5QGMP-part1', 'wwn-0x5000c50091dfbebc-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091dfbebc', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QGMP', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGMP", "wwn-0x5000c50091dfbebc"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QGMP-part1", "wwn-0x5000c50091dfbebc-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QGMP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091dfbebc"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:24.087 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-DOgm6L-bdy5-02Y4-oYBq-jhAK-jVIz-cMJ2TJ', 'nvme-INTEL_SSDPEDMD400G4_CVFT5330008Q400BGN', 'nvme-nvme.8086-43564654353333303030385134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.052952", "end": "2021-07-26 15:42:24.055328", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-DOgm6L-bdy5-02Y4-oYBq-jhAK-jVIz-cMJ2TJ", "nvme-INTEL_SSDPEDMD400G4_CVFT5330008Q400BGN", "nvme-nvme.8086-43564654353333303030385134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:24.002376", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0481085 s, 2.4 GB/s", "std 2021-07-26T15:42:24.089 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0481085 s, 2.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:24.105 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:24.112 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-OuTvon-3qJx-lHma-Q7uA-x1BY-8FYC-h7V1NN', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NH400BGN', 'nvme-nvme.8086-504846543632303430304e4834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.058198", "end": "2021-07-26 15:42:24.266440", "item": {"key": "nvme0n1", "value": {"holders": [ 2021-07-26T15:42:24.114 INFO:teuthology.task.ansible.out:"vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-OuTvon-3qJx-lHma-Q7uA-x1BY-8FYC-h7V1NN", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NH400BGN", "nvme-nvme.8086-504846543632303430304e4834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:24.208242", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0534085 s, 2.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0534085 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result wa 2021-07-26T15:42:24.116 INFO:teuthology.task.ansible.out:s False"} 2021-07-26T15:42:24.122 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:24.407 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juRPUP8lGy9zGv0HgEIZU24yntlDywYGfv'], 'uuids': ['5cc2f665-fd31-4ad3-8ba1-a074fab7abd8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.160999", "end": "2021-07-26 15:42:24.369041", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juRPUP8lGy9zGv0HgEIZU24yntlDywYGfv"], "labels": [], "masters": [], "uuids": ["5cc2f665-fd31-4ad3-8ba1-a074fab7abd8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:24.208042", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156287 s, 738 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156287 s, 738 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:24.418 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvc2mWLI2jowBaNLLhBhaaWsbDUq2pRQoT2'], 'uuids': ['29a5ae23-4f48-4673-a34d-1b8e345ab35e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.155719", "end": "2021-07-26 15:42:24.565487", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvc2mWLI2jowBaNLLhBhaaWsbDUq2pRQoT2"], "labels": [], "masters": [], "uuids": ["29a5ae23-4f48-4673-a34d-1b8e345ab35e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:24.409768", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151532 s, 761 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151532 s, 761 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:24.420 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:24.421 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:24.423 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:24.434 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:24.716 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcyK1UnjGerxCQNzAmA3Mq507GvU32ewx2'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.161799", "end": "2021-07-26 15:42:24.877818", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcyK1UnjGerxCQNzAmA3Mq507GvU32ewx2"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:24.716019", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156815 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156815 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:24.716 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juQWEc7YX5vTar5N8S61W86veVs6TjizOK'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.158776", "end": "2021-07-26 15:42:24.686334", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juQWEc7YX5vTar5N8S61W86veVs6TjizOK"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:24.527558", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153953 s, 749 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153953 s, 749 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:24.728 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:24.733 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:25.016 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juu6oKn4t1lMyFLkbwOhQ1l5bxSbH0Fbd7'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.158032", "end": "2021-07-26 15:42:24.985438", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-P2pMR3AgKcpMPnOdrxEfImPT0f4wx2juu6oKn4t1lMyFLkbwOhQ1l5bxSbH0Fbd7"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:24.827406", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153048 s, 754 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153048 s, 754 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:25.028 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcvzbvvHAwa7FlfTeJU1GogSlFicTbbnFw'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.162205", "end": "2021-07-26 15:42:25.186119", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-rfzNxfivebW7xB3jIZ0jlEVnAvCiXLvcvzbvvHAwa7FlfTeJU1GogSlFicTbbnFw"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:25.023914", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157251 s, 733 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157251 s, 733 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:25.066 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:01.859) 0:02:57.828 *********** 2021-07-26T15:42:25.112 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.045) 0:02:57.874 *********** 2021-07-26T15:42:25.432 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-07-26T15:42:25.434 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.146117", "end": "2021-07-26 15:42:25.332732", "rc": 0, "start": "2021-07-26 15:42:25.186615", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:25.456 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.345) 0:02:58.219 *********** 2021-07-26T15:42:25.465 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.128813", "end": "2021-07-26 15:42:25.547993", "rc": 0, "start": "2021-07-26 15:42:25.419180", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:25.490 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.034) 0:02:58.253 *********** 2021-07-26T15:42:25.686 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.083679", "end": "2021-07-26 15:42:25.661409", "rc": 0, "start": "2021-07-26 15:42:25.577730", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:25.712 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.221) 0:02:58.475 *********** 2021-07-26T15:42:25.742 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.096110", "end": "2021-07-26 15:42:25.896551", "rc": 0, "start": "2021-07-26 15:42:25.800441", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:25.769 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.056) 0:02:58.531 *********** 2021-07-26T15:42:25.788 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-07-26T15:42:25.855 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.086) 0:02:58.618 *********** 2021-07-26T15:42:25.890 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.035) 0:02:58.653 *********** 2021-07-26T15:42:25.897 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-07-26T15:42:25.899 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:25.925 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.034) 0:02:58.688 *********** 2021-07-26T15:42:25.933 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:25.959 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.034) 0:02:58.722 *********** 2021-07-26T15:42:25.966 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:25.992 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.032) 0:02:58.755 *********** 2021-07-26T15:42:25.999 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.025 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.032) 0:02:58.788 *********** 2021-07-26T15:42:26.034 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-07-26T15:42:26.034 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.064 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.037) 0:02:58.825 *********** 2021-07-26T15:42:26.069 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.099 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.035) 0:02:58.860 *********** 2021-07-26T15:42:26.104 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-07-26T15:42:26.106 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.130 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.032) 0:02:58.892 *********** 2021-07-26T15:42:26.139 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.166 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.036) 0:02:58.929 *********** 2021-07-26T15:42:26.272 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi033.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:26.306 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.138) 0:02:59.068 *********** 2021-07-26T15:42:26.313 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:26.340 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.034) 0:02:59.103 *********** 2021-07-26T15:42:26.358 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi033.front.sepia.ceph.com] => (item={'block_used': 13859366, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235742, 'size_available': 926661599232, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150121, 'block_size': 4096, 'inode_available': 60904855}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235742, "block_size": 4096, "block_total": 240095108, "block_used": 13859366, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904855, "inode_total": 61054976, "inode_used": 150121, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661599232, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.386 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.046) 0:02:59.149 *********** 2021-07-26T15:42:26.398 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'block_used': 13859362, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235746, 'size_available': 926661615616, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235746, "block_size": 4096, "block_total": 240095108, "block_used": 13859362, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661615616, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.424 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.037) 0:02:59.187 *********** 2021-07-26T15:42:26.430 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-07-26T15:42:26.432 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.457 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.033) 0:02:59.220 *********** 2021-07-26T15:42:26.464 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.489 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.032) 0:02:59.252 *********** 2021-07-26T15:42:26.495 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:26.497 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.521 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.031) 0:02:59.284 *********** 2021-07-26T15:42:26.528 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.554 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.033) 0:02:59.317 *********** 2021-07-26T15:42:26.560 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:26.562 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.586 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.032) 0:02:59.349 *********** 2021-07-26T15:42:26.594 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.620 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.033) 0:02:59.383 *********** 2021-07-26T15:42:26.627 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-07-26T15:42:26.629 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.654 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.034) 0:02:59.417 *********** 2021-07-26T15:42:26.663 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.691 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.036) 0:02:59.454 *********** 2021-07-26T15:42:26.700 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-07-26T15:42:26.702 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.733 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.041) 0:02:59.495 *********** 2021-07-26T15:42:26.742 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.769 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.036) 0:02:59.532 *********** 2021-07-26T15:42:26.777 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-07-26T15:42:26.778 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.819 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.049) 0:02:59.582 *********** 2021-07-26T15:42:26.833 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.866 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.046) 0:02:59.629 *********** 2021-07-26T15:42:27.652 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-07-26T15:42:27.654 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-07-26T15:42:27.680 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.814) 0:03:00.443 *********** 2021-07-26T15:42:27.700 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-07-26T15:42:27.728 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.046) 0:03:00.490 *********** 2021-07-26T15:42:28.519 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-07-26T15:42:28.520 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:28.578 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:28.920 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:28.953 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:29.310 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:29.342 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:29.683 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:29.714 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:30.090 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:30.120 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:02.393) 0:03:02.883 *********** 2021-07-26T15:42:30.129 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:30.160 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.038) 0:03:02.921 *********** 2021-07-26T15:42:30.271 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-07-26T15:42:30.273 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-07-26T15:42:30.298 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.139) 0:03:03.061 *********** 2021-07-26T15:42:30.316 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-07-26T15:42:30.342 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.043) 0:03:03.105 *********** 2021-07-26T15:42:30.457 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-07-26T15:42:30.459 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:30.501 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:30.599 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:30.643 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:30.720 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:30.763 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:30.838 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:30.849 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.877 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.535) 0:03:03.640 *********** 2021-07-26T15:42:30.897 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:30.898 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.927 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.048) 0:03:03.688 *********** 2021-07-26T15:42:30.935 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-07-26T15:42:30.936 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.962 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.035) 0:03:03.724 *********** 2021-07-26T15:42:30.972 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.002 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.038) 0:03:03.763 *********** 2021-07-26T15:42:31.007 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-07-26T15:42:31.008 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.035 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.035) 0:03:03.798 *********** 2021-07-26T15:42:31.047 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.079 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.043) 0:03:03.842 *********** 2021-07-26T15:42:31.189 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:42:31.217 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.137) 0:03:03.980 *********** 2021-07-26T15:42:31.237 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:42:31.262 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.045) 0:03:04.025 *********** 2021-07-26T15:42:31.269 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-07-26T15:42:31.271 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-07-26T15:42:31.300 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.037) 0:03:04.062 *********** 2021-07-26T15:42:31.307 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-07-26T15:42:31.335 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.034) 0:03:04.097 *********** 2021-07-26T15:42:31.878 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-07-26T15:42:31.881 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true} 2021-07-26T15:42:31.904 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.570) 0:03:04.667 *********** 2021-07-26T15:42:32.434 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-07-26T15:42:32.438 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-07-26T15:42:32.458 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.553) 0:03:05.221 *********** 2021-07-26T15:42:32.460 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:32.489 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.534 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.074) 0:03:05.296 *********** 2021-07-26T15:42:32.567 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-07-26T15:42:32.569 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.598 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.058) 0:03:05.354 *********** 2021-07-26T15:42:32.619 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.643 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.051) 0:03:05.406 *********** 2021-07-26T15:42:32.674 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-07-26T15:42:32.676 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.698 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.055) 0:03:05.461 *********** 2021-07-26T15:42:32.868 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-07-26T15:42:32.870 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:42:32.892 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.193) 0:03:05.655 *********** 2021-07-26T15:42:32.900 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-07-26T15:42:32.901 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true} 2021-07-26T15:42:32.933 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.040) 0:03:05.696 *********** 2021-07-26T15:42:33.060 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:42:33.085 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.151) 0:03:05.847 *********** 2021-07-26T15:42:33.174 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-07-26T15:42:33.176 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-07-26T15:42:33.200 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.115) 0:03:05.963 *********** 2021-07-26T15:42:33.227 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-07-26T15:42:33.228 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:33.250 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.050) 0:03:06.013 *********** 2021-07-26T15:42:33.277 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:33.302 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.050) 0:03:06.063 *********** 2021-07-26T15:42:33.329 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:33.358 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.056) 0:03:06.120 *********** 2021-07-26T15:42:33.387 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:33.410 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.053) 0:03:06.173 *********** 2021-07-26T15:42:33.450 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-07-26T15:42:33.486 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.073) 0:03:06.246 *********** 2021-07-26T15:42:33.587 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-07-26T15:42:33.589 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:42:33.617 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.132) 0:03:06.379 *********** 2021-07-26T15:42:33.773 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-07-26T15:42:33.775 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:42:33.798 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.181) 0:03:06.561 *********** 2021-07-26T15:42:33.853 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-07-26T15:42:33.855 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-07-26T15:42:33.883 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.081) 0:03:06.642 *********** 2021-07-26T15:42:34.174 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-07-26T15:42:34.176 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-07-26T15:42:34.207 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.321) 0:03:06.964 *********** 2021-07-26T15:42:34.565 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:42:34.588 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.387) 0:03:07.351 *********** 2021-07-26T15:42:34.593 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:34.631 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-07-26T15:42:34.635 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-07-26T15:42:34.672 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.077) 0:03:07.429 *********** 2021-07-26T15:42:34.857 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.118018", "end": "2021-07-26 15:42:34.831203", "rc": 0, "start": "2021-07-26 15:42:34.713185", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-07-26T15:42:34.888 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.221) 0:03:07.651 *********** 2021-07-26T15:42:34.918 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.946 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.057) 0:03:07.709 *********** 2021-07-26T15:42:34.974 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.999 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.053) 0:03:07.762 *********** 2021-07-26T15:42:35.368 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:42:35.390 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:35 +0000 (0:00:00.391) 0:03:08.153 *********** 2021-07-26T15:42:35.660 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.119165", "end": "2021-07-26 15:42:35.627670", "rc": 0, "start": "2021-07-26 15:42:35.508505", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-07-26T15:42:35.662 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:42:35.684 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:35 +0000 (0:00:00.294) 0:03:08.448 *********** 2021-07-26T15:42:35.708 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:35 +0000 (0:00:00.022) 0:03:08.471 *********** 2021-07-26T15:42:35.725 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-07-26T15:42:35.728 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:35.749 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:35 +0000 (0:00:00.041) 0:03:08.512 *********** 2021-07-26T15:42:35.757 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-07-26T15:42:35.758 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:35.783 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:35 +0000 (0:00:00.033) 0:03:08.546 *********** 2021-07-26T15:42:35.790 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-07-26T15:42:35.792 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:35.821 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:35 +0000 (0:00:00.036) 0:03:08.583 *********** 2021-07-26T15:42:36.136 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-07-26T15:42:36.138 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-07-26T15:42:36.162 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.341) 0:03:08.925 *********** 2021-07-26T15:42:36.190 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:36.213 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.051) 0:03:08.976 *********** 2021-07-26T15:42:36.421 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-07-26T15:42:36.422 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:39:17 UTC", "ActiveEnterTimestampMonotonic": "13336223", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount basic.target systemd-tmpfiles-setup.service network.target system.slice sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:39:17 UTC", "AssertTimestampMonotonic": "13199797", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:39:17 UTC", "ConditionTimestampMonotonic": "13199796", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-07-26T15:42:36.424 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "826", "ExecMainStartTimestamp": "Mon 2021-07-26 15:39:17 UTC", "ExecMainStartTimestampMonotonic": "13336202", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:39:17 UTC", "InactiveExitTimestampMonotonic": "13200851", "InvocationID": "d84675e47fc9495b9e8d1d489396c32b", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-07-26T15:42:36.426 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "826", "MemoryAccounting": "yes", "MemoryCurrent": "3469312", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "Requi 2021-07-26T15:42:36.427 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:39:17 UTC", "StateChangeTimestampMonotonic": "13336223", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:42:36.455 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.242) 0:03:09.218 *********** 2021-07-26T15:42:36.496 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:36.497 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-07-26T15:42:36.524 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.069) 0:03:09.287 *********** 2021-07-26T15:42:36.533 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-07-26T15:42:36.536 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:42:36.565 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.040) 0:03:09.328 *********** 2021-07-26T15:42:36.575 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:36.575 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-07-26T15:42:36.601 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.035) 0:03:09.364 *********** 2021-07-26T15:42:36.607 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-07-26T15:42:36.609 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:36.632 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.031) 0:03:09.395 *********** 2021-07-26T15:42:36.639 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-07-26T15:42:36.641 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:36.667 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.034) 0:03:09.430 *********** 2021-07-26T15:42:37.000 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-07-26T15:42:37.002 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-07-26T15:42:37.026 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:37 +0000 (0:00:00.359) 0:03:09.789 *********** 2021-07-26T15:42:37.055 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-07-26T15:42:37.057 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:37.079 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:37 +0000 (0:00:00.052) 0:03:09.842 *********** 2021-07-26T15:42:37.298 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-07-26T15:42:37.299 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:39:05 UTC", "ActiveEnterTimestampMonotonic": "17420824", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service -.mount basic.target systemd-journald.socket system.slice network.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:39:05 UTC", "AssertTimestampMonotonic": "17168295", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:39:05 UTC", "ConditionTimestampMonotonic": "17168294", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-07-26T15:42:37.301 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "852", "ExecMainStartTimestamp": "Mon 2021-07-26 15:39:05 UTC", "ExecMainStartTimestampMonotonic": "17420811", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:39:05 UTC", "InactiveExitTimestampMonotonic": "17169268", "InvocationID": "b6b2af05aee84f098ca59e399dd5f195", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-07-26T15:42:37.303 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127801", "LimitNPROCSoft": "127801", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127801", "LimitSIGPENDINGSoft": "127801", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "852", "MemoryAccounting": "yes", "MemoryCurrent": "3473408", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requi 2021-07-26T15:42:37.305 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:39:05 UTC", "StateChangeTimestampMonotonic": "17420824", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38340", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:42:37.324 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:37 +0000 (0:00:00.244) 0:03:10.087 *********** 2021-07-26T15:42:37.352 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:37.354 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-07-26T15:42:37.376 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:37 +0000 (0:00:00.051) 0:03:10.139 *********** 2021-07-26T15:42:37.405 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-07-26T15:42:37.435 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:37 +0000 (0:00:00.059) 0:03:10.198 *********** 2021-07-26T15:42:37.464 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-07-26T15:42:37.466 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:37.488 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:37 +0000 (0:00:00.052) 0:03:10.251 *********** 2021-07-26T15:42:37.766 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:42:37.794 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:37 +0000 (0:00:00.303) 0:03:10.554 *********** 2021-07-26T15:42:37.830 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-07-26T15:42:37.832 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:37.856 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:37 +0000 (0:00:00.065) 0:03:10.619 *********** 2021-07-26T15:42:38.042 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-07-26T15:42:38.044 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:42:38.067 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:38 +0000 (0:00:00.210) 0:03:10.830 *********** 2021-07-26T15:42:38.515 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-07-26T15:42:38.517 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-07-26T15:42:38.539 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:38 +0000 (0:00:00.471) 0:03:11.302 *********** 2021-07-26T15:42:38.640 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-07-26T15:42:38.641 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:42:38.665 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:38 +0000 (0:00:00.126) 0:03:11.428 *********** 2021-07-26T15:42:38.695 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-07-26T15:42:38.697 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:38.718 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:38 +0000 (0:00:00.053) 0:03:11.481 *********** 2021-07-26T15:42:38.904 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-07-26T15:42:38.906 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:42:38.929 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:38 +0000 (0:00:00.210) 0:03:11.692 *********** 2021-07-26T15:42:39.406 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-07-26T15:42:39.408 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-07-26T15:42:39.433 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:39 +0000 (0:00:00.503) 0:03:12.196 *********** 2021-07-26T15:42:40.875 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-07-26T15:42:40.877 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-07-26T15:42:40.900 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:40 +0000 (0:00:01.467) 0:03:13.663 *********** 2021-07-26T15:42:41.418 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi096.front.sepia.ceph.com] => {"changed": false} 2021-07-26T15:42:41.442 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:41 +0000 (0:00:00.541) 0:03:14.205 *********** 2021-07-26T15:42:41.471 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-07-26T15:42:41.473 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-07-26T15:42:41.496 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:41 +0000 (0:00:00.053) 0:03:14.259 *********** 2021-07-26T15:42:41.502 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-07-26T15:42:41.504 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-07-26T15:42:41.528 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:41 +0000 (0:00:00.032) 0:03:14.291 *********** 2021-07-26T15:42:41.672 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-07-26T15:42:41.674 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1627313711.6947272, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1627313711.6907272, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1627313711.6907272, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-07-26T15:42:41.700 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:41 +0000 (0:00:00.171) 0:03:14.463 *********** 2021-07-26T15:42:42.068 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-07-26T15:42:42.071 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false} 2021-07-26T15:42:42.111 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.411) 0:03:14.874 *********** 2021-07-26T15:42:42.148 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-07-26T15:42:42.149 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2021-07-26T15:42:42.173 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.061) 0:03:14.936 *********** 2021-07-26T15:42:42.181 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-07-26T15:42:42.184 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-07-26T15:42:42.208 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.035) 0:03:14.971 *********** 2021-07-26T15:42:42.210 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:42.237 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-07-26T15:42:42.239 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-07-26T15:42:42.262 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.054) 0:03:15.025 *********** 2021-07-26T15:42:42.291 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.315 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.053) 0:03:15.078 *********** 2021-07-26T15:42:42.365 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-07-26T15:42:42.367 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1627313676.6098611, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1627313676.6058612, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1627313676.6058612, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-07-26T15:42:42.392 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.076) 0:03:15.155 *********** 2021-07-26T15:42:42.485 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-07-26T15:42:42.487 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-07-26T15:42:42.512 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.118) 0:03:15.273 *********** 2021-07-26T15:42:42.569 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-07-26T15:42:42.571 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-07-26T15:42:42.596 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.085) 0:03:15.359 *********** 2021-07-26T15:42:42.628 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-07-26T15:42:42.630 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-07-26T15:42:42.651 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.054) 0:03:15.414 *********** 2021-07-26T15:42:42.678 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-07-26T15:42:42.680 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.704 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.053) 0:03:15.467 *********** 2021-07-26T15:42:42.728 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.023) 0:03:15.491 *********** 2021-07-26T15:42:42.759 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:42.763 INFO:teuthology.task.ansible.out:TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.782 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.053) 0:03:15.545 *********** 2021-07-26T15:42:42.821 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-07-26T15:42:42.823 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.833 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.835 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.846 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.848 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.095) 0:03:15.641 *********** 2021-07-26T15:42:42.884 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-07-26T15:42:42.886 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-07-26T15:42:42.912 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.033) 0:03:15.675 *********** 2021-07-26T15:42:42.922 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi096.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.934 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.935 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi096.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.966 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:00.054) 0:03:15.729 *********** 2021-07-26T15:42:42.997 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.025 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.058) 0:03:15.788 *********** 2021-07-26T15:42:43.054 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.080 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.054) 0:03:15.842 *********** 2021-07-26T15:42:43.089 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-07-26T15:42:43.091 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-07-26T15:42:43.117 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.037) 0:03:15.880 *********** 2021-07-26T15:42:43.125 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-07-26T15:42:43.127 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.155 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.038) 0:03:15.918 *********** 2021-07-26T15:42:43.164 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-07-26T15:42:43.166 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.193 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.037) 0:03:15.956 *********** 2021-07-26T15:42:43.201 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-07-26T15:42:43.203 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.238 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.044) 0:03:16.001 *********** 2021-07-26T15:42:43.249 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-07-26T15:42:43.250 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.252 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.252 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.253 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.254 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.293 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.055) 0:03:16.056 *********** 2021-07-26T15:42:43.303 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-07-26T15:42:43.305 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.333 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.039) 0:03:16.096 *********** 2021-07-26T15:42:43.343 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi033.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.354 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.355 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.366 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.368 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi033.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.391 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.058) 0:03:16.154 *********** 2021-07-26T15:42:43.428 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.036) 0:03:16.191 *********** 2021-07-26T15:42:43.436 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:43.438 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.469 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.040) 0:03:16.231 *********** 2021-07-26T15:42:43.477 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-07-26T15:42:43.478 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.506 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.037) 0:03:16.269 *********** 2021-07-26T15:42:43.514 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-07-26T15:42:43.515 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.540 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.034) 0:03:16.303 *********** 2021-07-26T15:42:43.549 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-07-26T15:42:43.551 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.575 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.034) 0:03:16.338 *********** 2021-07-26T15:42:43.582 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-07-26T15:42:43.584 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.612 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.036) 0:03:16.375 *********** 2021-07-26T15:42:43.654 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.679 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.066) 0:03:16.442 *********** 2021-07-26T15:42:43.708 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-07-26T15:42:43.711 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.736 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.057) 0:03:16.499 *********** 2021-07-26T15:42:43.765 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-07-26T15:42:43.766 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.790 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.054) 0:03:16.553 *********** 2021-07-26T15:42:43.797 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-07-26T15:42:43.800 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010465", "end": "2021-07-26 15:42:43.740262", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-07-26 15:42:43.729797", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:43.820 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-07-26T15:42:43.822 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.845 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.054) 0:03:16.608 *********** 2021-07-26T15:42:43.873 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-07-26T15:42:43.875 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.898 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:43 +0000 (0:00:00.051) 0:03:16.660 *********** 2021-07-26T15:42:43.926 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-07-26T15:42:43.928 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006055", "end": "2021-07-26 15:42:43.899467", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-07-26 15:42:43.893412", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:44.074 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005503", "end": "2021-07-26 15:42:44.050784", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-07-26 15:42:44.045281", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:44.106 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010686", "end": "2021-07-26 15:42:44.066822", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-07-26 15:42:44.056136", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:44.255 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.026786", "end": "2021-07-26 15:42:44.224981", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-07-26 15:42:44.198195", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:44.258 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.005787", "end": "2021-07-26 15:42:44.226947", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-07-26 15:42:44.221160", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:44.289 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:44 +0000 (0:00:00.391) 0:03:17.052 *********** 2021-07-26T15:42:44.318 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-07-26T15:42:44.342 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:44 +0000 (0:00:00.052) 0:03:17.105 *********** 2021-07-26T15:42:44.370 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-07-26T15:42:44.372 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:44.415 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-07-26T15:42:44.417 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005483", "end": "2021-07-26 15:42:44.379296", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-07-26 15:42:44.373813", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:44.593 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.022565", "end": "2021-07-26 15:42:44.559408", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-07-26 15:42:44.536843", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:44.618 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:44 +0000 (0:00:00.276) 0:03:17.381 *********** 2021-07-26T15:42:44.645 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-07-26T15:42:44.669 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:44 +0000 (0:00:00.050) 0:03:17.432 *********** 2021-07-26T15:42:44.695 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-07-26T15:42:44.697 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:44.766 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-07-26T15:42:44.784 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:44 +0000 (0:00:00.115) 0:03:17.547 *********** 2021-07-26T15:42:44.804 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:44 +0000 (0:00:00.020) 0:03:17.567 *********** 2021-07-26T15:42:46.024 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi096.front.sepia.ceph.com] 2021-07-26T15:42:46.075 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:01.270) 0:03:18.838 *********** 2021-07-26T15:42:46.102 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:42:46.104 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-07-26T15:42:46.126 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:00.051) 0:03:18.889 *********** 2021-07-26T15:42:46.153 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:42:46.155 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.177 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:00.050) 0:03:18.940 *********** 2021-07-26T15:42:46.225 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-07-26T15:42:46.227 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-07-26T15:42:46.249 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:00.072) 0:03:19.012 *********** 2021-07-26T15:42:46.901 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi033.front.sepia.ceph.com] 2021-07-26T15:42:46.955 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:00.705) 0:03:19.718 *********** 2021-07-26T15:42:46.995 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:42:46.998 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-07-26T15:42:47.020 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.065) 0:03:19.783 *********** 2021-07-26T15:42:47.048 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:42:47.050 INFO:teuthology.task.ansible.out:skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:47.073 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.053) 0:03:19.836 *********** 2021-07-26T15:42:47.112 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-07-26T15:42:47.114 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-07-26T15:42:47.138 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.064) 0:03:19.901 *********** 2021-07-26T15:43:02.064 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-07-26T15:43:02.066 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (18.2 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.3) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The followin 2021-07-26T15:43:02.068 INFO:teuthology.task.ansible.out:g packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (18.2 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.3) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-07-26T15:43:02.096 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:14.958) 0:03:34.859 *********** 2021-07-26T15:43:02.126 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:43:02.128 INFO:teuthology.task.ansible.out:skipping: [smithi096.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.153 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.054) 0:03:34.914 *********** 2021-07-26T15:43:02.188 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:43:02.190 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-07-26T15:43:02.212 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.061) 0:03:34.975 *********** 2021-07-26T15:43:02.411 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi096.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:43:02.572 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:43:02.604 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.391) 0:03:35.367 *********** 2021-07-26T15:43:03.084 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-07-26T15:43:03.086 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314182.662972-29577-110941583169107/source", "state": "file", "uid": 0} 2021-07-26T15:43:03.420 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-07-26T15:43:03.422 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (17.6 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.3) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The followin 2021-07-26T15:43:03.424 INFO:teuthology.task.ansible.out:g packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (17.6 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.3) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-07-26T15:43:03.447 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.841) 0:03:36.208 *********** 2021-07-26T15:43:03.473 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi033.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:03.496 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.051) 0:03:36.259 *********** 2021-07-26T15:43:03.514 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-07-26T15:43:03.516 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314183.110413-29577-177150085458646/source", "state": "file", "uid": 0} 2021-07-26T15:43:03.539 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.043) 0:03:36.302 *********** 2021-07-26T15:43:03.546 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi033.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-07-26T15:43:03.579 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.039) 0:03:36.341 *********** 2021-07-26T15:43:03.781 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-07-26T15:43:03.783 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:43:03.952 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:43:03.977 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.398) 0:03:36.740 *********** 2021-07-26T15:43:04.297 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** ok: [smithi096.front.sepia.ceph.com] => {"cache_update_time": 1627313793, "cache_updated": false, "changed": false} 2021-07-26T15:43:04.330 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:04 +0000 (0:00:00.350) 0:03:37.090 *********** 2021-07-26T15:43:04.481 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-07-26T15:43:04.483 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314184.0518055-29785-233312856855677/source", "state": "file", "uid": 0} 2021-07-26T15:43:05.049 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314184.5145657-29785-221676046061501/source", "state": "file", "uid": 0} 2021-07-26T15:43:05.076 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:05 +0000 (0:00:00.748) 0:03:37.839 *********** 2021-07-26T15:43:05.867 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-07-26T15:43:05.869 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"cache_update_time": 1627313852, "cache_updated": false, "changed": false} 2021-07-26T15:43:05.892 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:05 +0000 (0:00:00.815) 0:03:38.655 *********** 2021-07-26T15:43:09.054 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-leb4huhf\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-leb4huhf"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-leb4huhf\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=ca98b9c98fe09fa18ca6cf771f0d2fa248a53946ed82fc7f099102ac2df55c0f\n Stored in directory: /tmp/pip-ephem-wheel-cache-_dqw1o4k/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=aace7cb3cb6625dfe13f38a75663cb655b5ecb86e3d5cfd61c4922c68d4b64bb\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 regi 2021-07-26T15:43:09.056 INFO:teuthology.task.ansible.out:stries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-leb4huhf", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=ca98b9c98fe09fa18ca6cf771f0d2fa248a53946ed82fc7f099102ac2df55c0f", " Stored in directory: /tmp/pip-ephem-wheel-cache-_dqw1o4k/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=aace7cb3cb6625dfe13f38a75663cb655b5ecb86e3d5cfd61c4922c68d4b64bb", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-07-26T15:43:09.081 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:09 +0000 (0:00:03.187) 0:03:41.842 *********** 2021-07-26T15:43:09.255 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-07-26T15:43:09.257 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-07-26T15:43:09.283 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:09 +0000 (0:00:00.204) 0:03:42.046 *********** 2021-07-26T15:43:09.729 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314189.338885-30229-147387866986752/source", "state": "file", "uid": 0} 2021-07-26T15:43:09.754 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:09 +0000 (0:00:00.470) 0:03:42.517 *********** 2021-07-26T15:43:09.981 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-07-26T15:43:09.983 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.039156", "end": "2021-07-26 15:43:09.951148", "rc": 0, "start": "2021-07-26 15:43:09.911992", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:43:10.007 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:10 +0000 (0:00:00.252) 0:03:42.770 *********** 2021-07-26T15:43:10.780 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-07-26T15:43:10.782 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-7k0pw26t\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-7k0pw26t"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-7k0pw26t\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=b20f5f9b7c5f92accdcf8ce1e6087f4c3deab6ff2576175b5c06970d2ac650ff\n Stored in directory: /tmp/pip-ephem-wheel-cache-1somgjkw/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=aace7cb3cb6625dfe13f38a75663cb655b5ecb86e3d5cfd61c4922c68d4b64bb\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-07-26T15:43:10.783 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-7k0pw26t", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=b20f5f9b7c5f92accdcf8ce1e6087f4c3deab6ff2576175b5c06970d2ac650ff", " Stored in directory: /tmp/pip-ephem-wheel-cache-1somgjkw/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=aace7cb3cb6625dfe13f38a75663cb655b5ecb86e3d5cfd61c4922c68d4b64bb", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-07-26T15:43:10.805 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:10 +0000 (0:00:00.797) 0:03:43.568 *********** 2021-07-26T15:43:11.001 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-07-26T15:43:11.003 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-07-26T15:43:11.026 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:11 +0000 (0:00:00.221) 0:03:43.789 *********** 2021-07-26T15:43:11.461 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-07-26T15:43:11.463 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314191.0777235-30357-220796425296999/source", "state": "file", "uid": 0} 2021-07-26T15:43:11.486 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:11 +0000 (0:00:00.460) 0:03:44.249 *********** 2021-07-26T15:43:11.713 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-07-26T15:43:11.714 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.039317", "end": "2021-07-26 15:43:11.679678", "rc": 0, "start": "2021-07-26 15:43:11.640361", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:43:11.737 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:11 +0000 (0:00:00.250) 0:03:44.500 *********** 2021-07-26T15:43:11.932 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-07-26T15:43:11.934 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:42:57 UTC", "ActiveEnterTimestampMonotonic": "233695209", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target basic.target system.slice docker.socket network-online.target firewalld.service systemd-journald.socket containerd.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:42:55 UTC", "AssertTimestampMonotonic": "231730529", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:42:55 UTC", "ConditionTimestampMonotonic": "231730529", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.sli 2021-07-26T15:43:11.935 INFO:teuthology.task.ansible.out:ce/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8833", "ExecMainStartTimestamp": "Mon 2021-07-26 15:42:55 UTC", "ExecMainStartTimestampMonotonic": "231731661", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:42:55 UTC] ; stop_time=[n/a] ; pid=8833 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Mon 2021-07-26 15:42:55 UTC] ; stop_time=[n/a] ; pid=8833 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngress 2021-07-26T15:43:11.937 INFO:teuthology.task.ansible.out:Packets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:42:55 UTC", "InactiveExitTimestampMonotonic": "231732065", "InvocationID": "26d7491b211e4e1ca9cc6f799fa60b08", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8833", "MemoryAccounting": "yes", "MemoryCurrent": "54161408", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "contin 2021-07-26T15:43:11.939 INFO:teuthology.task.ansible.out:ue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target docker.socket system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:42:57 UTC", "StateChangeTimestampMonotonic": "233695209", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": " 2021-07-26T15:43:11.941 INFO:teuthology.task.ansible.out:notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:43:13.662 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:42:58 UTC", "ActiveEnterTimestampMonotonic": "251293595", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network-online.target sysinit.target firewalld.service basic.target systemd-journald.socket docker.socket system.slice containerd.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:42:56 UTC", "AssertTimestampMonotonic": "249279980", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:42:56 UTC", "ConditionTimestampMonotonic": "249279979", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.sli 2021-07-26T15:43:13.664 INFO:teuthology.task.ansible.out:ce/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8816", "ExecMainStartTimestamp": "Mon 2021-07-26 15:42:56 UTC", "ExecMainStartTimestampMonotonic": "249280855", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:42:56 UTC] ; stop_time=[n/a] ; pid=8816 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Mon 2021-07-26 15:42:56 UTC] ; stop_time=[n/a] ; pid=8816 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngress 2021-07-26T15:43:13.665 INFO:teuthology.task.ansible.out:Packets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:42:56 UTC", "InactiveExitTimestampMonotonic": "249281122", "InvocationID": "476e172df48740e0b59e9ed059c63222", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127801", "LimitSIGPENDINGSoft": "127801", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8816", "MemoryAccounting": "yes", "MemoryCurrent": "53903360", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "contin 2021-07-26T15:43:13.667 INFO:teuthology.task.ansible.out:ue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice docker.socket", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:42:58 UTC", "StateChangeTimestampMonotonic": "251293595", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": " 2021-07-26T15:43:13.669 INFO:teuthology.task.ansible.out:notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "network-online.target containerd.service", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:43:13.732 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-07-26T15:43:13.733 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-07-26T15:43:13.735 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-07-26T15:43:13.737 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-07-26T15:43:13.751 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-07-26T15:43:13.753 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:13 +0000 (0:00:02.014) 0:03:46.514 *********** 2021-07-26T15:43:14.748 INFO:teuthology.task.ansible.out:ok: [smithi033.front.sepia.ceph.com] 2021-07-26T15:43:15.788 INFO:teuthology.task.ansible.out:ok: [smithi096.front.sepia.ceph.com] 2021-07-26T15:43:15.809 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** 2021-07-26T15:43:15.809 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:15 +0000 (0:00:02.057) 0:03:48.572 *********** 2021-07-26T15:43:15.995 INFO:teuthology.task.ansible.out:changed: [smithi033.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-07-26T15:43:16.028 INFO:teuthology.task.ansible.out:changed: [smithi096.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-07-26T15:43:16.030 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi033.front.sepia.ceph.com : ok=133 changed=41 unreachable=0 failed=0 skipped=187 rescued=0 ignored=0 2021-07-26T15:43:16.032 INFO:teuthology.task.ansible.out:smithi096.front.sepia.ceph.com : ok=133 changed=41 unreachable=0 failed=0 skipped=187 rescued=0 ignored=0 Monday 26 July 2021 15:43:16 +0000 (0:00:00.221) 0:03:48.793 *********** =============================================================================== Create all admin users with sudo access. ------------------------------- 28.21s testnode : Upgrade packages -------------------------------------------- 24.39s users : Update authorized_keys using the keys repo --------------------- 20.66s container-host : Install container packages ---------------------------- 14.96s testnode : Install packages -------------------------------------------- 13.41s testnode : Ensure packages are not present. ---------------------------- 10.83s testnode : Zap all non-root disks --------------------------------------- 8.16s Remove revoked users ---------------------------------------------------- 6.87s container-host : Install registries-conf-ctl ---------------------------- 3.19s common : Update apt cache ----------------------------------------------- 3.12s testnode : Create logical volume(s) ------------------------------------- 2.39s testnode : Install apt keys --------------------------------------------- 2.33s Gathering Facts --------------------------------------------------------- 2.23s testnode : Update apt cache. -------------------------------------------- 2.12s Gathering Facts --------------------------------------------------------- 2.06s container-host : Restart docker service --------------------------------- 2.01s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.86s testnode : Install packages via pip ------------------------------------- 1.47s users : Clone the keys repo --------------------------------------------- 1.46s Gathering Facts --------------------------------------------------------- 1.27s 2021-07-26T15:43:16.449 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi096.front.sepia.ceph.com')] 2021-07-26T15:43:16.451 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:43:16.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:43:16.503 DEBUG:teuthology.orchestra.run.smithi033:> true 2021-07-26T15:43:16.621 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:43:16.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:43:16.676 DEBUG:teuthology.orchestra.run.smithi096:> true 2021-07-26T15:43:16.792 INFO:teuthology.run_tasks:Running task clock... 2021-07-26T15:43:16.812 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-07-26T15:43:16.813 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-07-26T15:43:16.816 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-07-26T15:43:16.852 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-07-26T15:43:16.852 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: Command line: ntpd -gq 2021-07-26T15:43:16.853 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: proto: precision = 0.123 usec (-23) 2021-07-26T15:43:16.853 INFO:teuthology.orchestra.run.smithi033.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:43:16.854 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:43:16.855 INFO:teuthology.orchestra.run.smithi033.stderr:restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:43:16.856 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:43:16.856 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: Listen and drop on 0 v6wildcard [::]:123 2021-07-26T15:43:16.856 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-07-26T15:43:16.856 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: Listen normally on 2 lo 127.0.0.1:123 2021-07-26T15:43:16.857 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: Listen normally on 3 ens1f0 172.21.15.33:123 2021-07-26T15:43:16.857 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: Listen normally on 4 lo [::1]:123 2021-07-26T15:43:16.857 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:d294%4]:123 2021-07-26T15:43:16.857 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:16 ntpd[10189]: Listening on routing socket on fd #22 for interface updates 2021-07-26T15:43:18.855 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:18.855 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:18.856 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:18.856 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:18.856 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:18.856 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:18.857 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:18.857 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:18.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:18.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:18.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:18.859 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:18.861 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:18.862 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:18 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:20.855 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:20.859 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:20.860 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:20.860 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:20.860 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:20.860 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:20.860 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:20 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:22.857 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:22.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:22.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:22.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:22.863 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:22.863 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:22.863 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:22.863 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:22.876 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:22.883 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:22.884 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:22 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:24.857 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:24.857 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:24.857 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:24.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:24.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:24.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:24.858 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:24.859 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:24.859 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:24.859 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:24.859 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:24.859 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:24.860 INFO:teuthology.orchestra.run.smithi033.stdout:26 Jul 15:43:24 ntpd[10189]: ntpd: time slew +0.003089 s 2021-07-26T15:43:24.860 INFO:teuthology.orchestra.run.smithi033.stdout:ntpd: time slew +0.003089s 2021-07-26T15:43:24.861 INFO:teuthology.orchestra.run.smithi033.stderr:26 Jul 15:43:24 ntpd[10189]: can't open /var/log/ntpstats/loopstats.20210726: Permission denied 2021-07-26T15:43:24.915 INFO:teuthology.orchestra.run.smithi033.stdout: remote refid st t when poll reach delay offset jitter 2021-07-26T15:43:24.916 INFO:teuthology.orchestra.run.smithi033.stdout:============================================================================== 2021-07-26T15:43:24.916 INFO:teuthology.orchestra.run.smithi033.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:24.916 INFO:teuthology.orchestra.run.smithi033.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:24.916 INFO:teuthology.orchestra.run.smithi033.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:24.917 INFO:teuthology.orchestra.run.smithi033.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:24.917 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-07-26T15:43:24.918 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-07-26T15:43:24.955 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-07-26T15:43:24.956 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: Command line: ntpd -gq 2021-07-26T15:43:24.956 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: proto: precision = 0.090 usec (-23) 2021-07-26T15:43:24.957 INFO:teuthology.orchestra.run.smithi096.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:43:24.957 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:43:24.958 INFO:teuthology.orchestra.run.smithi096.stderr:restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:43:24.959 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:43:24.959 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: Listen and drop on 0 v6wildcard [::]:123 2021-07-26T15:43:24.959 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-07-26T15:43:24.962 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: Listen normally on 2 lo 127.0.0.1:123 2021-07-26T15:43:24.962 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: Listen normally on 3 enp3s0f1 172.21.15.96:123 2021-07-26T15:43:24.962 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: Listen normally on 4 lo [::1]:123 2021-07-26T15:43:24.963 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0d%5]:123 2021-07-26T15:43:24.963 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:24 ntpd[10210]: Listening on routing socket on fd #22 for interface updates 2021-07-26T15:43:25.955 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:25 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:25.955 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:25 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:25.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:25 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:25.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:25 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:25.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:25 ntpd[10210]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:25.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:25 ntpd[10210]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:27.955 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:27 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:27.955 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:27 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:27.955 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:27 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:27.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:27 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:27.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:27 ntpd[10210]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:27.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:27 ntpd[10210]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:28.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:28.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:28.958 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:28 ntpd[10210]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:29.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:29.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:29.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:29.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:29.958 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:29.958 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:29.958 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:29.958 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:29.958 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:29 ntpd[10210]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:30.959 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:30.959 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:30.960 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:30.960 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:30.960 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:30.960 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:30.961 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:30.961 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:30.961 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:30.961 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:30.961 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:30.962 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:30 ntpd[10210]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:31.955 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:31 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:31.955 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:31 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:31 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:31 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:31 ntpd[10210]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:31 ntpd[10210]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:31.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:31 ntpd[10210]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:31.957 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:31 ntpd[10210]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:31.957 INFO:teuthology.orchestra.run.smithi096.stdout:26 Jul 15:43:31 ntpd[10210]: ntpd: time slew -0.001361 s 2021-07-26T15:43:31.958 INFO:teuthology.orchestra.run.smithi096.stdout:ntpd: time slew -0.001361s 2021-07-26T15:43:31.958 INFO:teuthology.orchestra.run.smithi096.stderr:26 Jul 15:43:31 ntpd[10210]: can't open /var/log/ntpstats/loopstats.20210726: Permission denied 2021-07-26T15:43:32.097 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2021-07-26T15:43:32.097 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2021-07-26T15:43:32.098 INFO:teuthology.orchestra.run.smithi096.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:32.098 INFO:teuthology.orchestra.run.smithi096.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:32.098 INFO:teuthology.orchestra.run.smithi096.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:32.098 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:32.099 INFO:teuthology.run_tasks:Running task install... 2021-07-26T15:43:32.112 DEBUG:teuthology.task.install:project ceph 2021-07-26T15:43:32.113 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}} 2021-07-26T15:43:32.113 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'} 2021-07-26T15:43:32.113 INFO:teuthology.task.install:Using flavor: basic 2021-07-26T15:43:32.124 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-07-26T15:43:32.124 INFO:teuthology.task.install:extra packages: [] 2021-07-26T15:43:32.126 DEBUG:teuthology.orchestra.run.smithi033:> sudo lsb_release -is 2021-07-26T15:43:32.179 INFO:teuthology.orchestra.run.smithi033.stdout:Ubuntu 2021-07-26T15:43:32.184 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:43:32.185 DEBUG:teuthology.orchestra.run.smithi096:> sudo lsb_release -is 2021-07-26T15:43:32.187 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-key list | grep Ceph 2021-07-26T15:43:32.240 INFO:teuthology.orchestra.run.smithi096.stdout:Ubuntu 2021-07-26T15:43:32.246 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:43:32.247 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-key list | grep Ceph 2021-07-26T15:43:32.292 INFO:teuthology.orchestra.run.smithi033.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-07-26T15:43:32.343 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-07-26T15:43:32.354 INFO:teuthology.orchestra.run.smithi033.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-07-26T15:43:32.355 INFO:teuthology.orchestra.run.smithi033.stdout:uid [ unknown] Ceph.com (release key) 2021-07-26T15:43:32.355 DEBUG:teuthology.orchestra.run.smithi033:> sudo lsb_release -is 2021-07-26T15:43:32.408 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-07-26T15:43:32.409 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph.com (release key) 2021-07-26T15:43:32.410 DEBUG:teuthology.orchestra.run.smithi096:> sudo lsb_release -is 2021-07-26T15:43:32.422 INFO:teuthology.orchestra.run.smithi033.stdout:Ubuntu 2021-07-26T15:43:32.423 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:43:32.423 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-07-26T15:43:32.423 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:43:32.424 INFO:teuthology.packaging:ref: None 2021-07-26T15:43:32.424 INFO:teuthology.packaging:tag: None 2021-07-26T15:43:32.424 INFO:teuthology.packaging:branch: pacific 2021-07-26T15:43:32.424 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:43:32.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=pacific 2021-07-26T15:43:32.487 INFO:teuthology.orchestra.run.smithi096.stdout:Ubuntu 2021-07-26T15:43:32.496 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:43:32.496 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-07-26T15:43:32.497 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:43:32.497 INFO:teuthology.packaging:ref: None 2021-07-26T15:43:32.498 INFO:teuthology.packaging:tag: None 2021-07-26T15:43:32.498 INFO:teuthology.packaging:branch: pacific 2021-07-26T15:43:32.498 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:43:32.500 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=pacific 2021-07-26T15:43:32.678 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default/ 2021-07-26T15:43:32.678 INFO:teuthology.task.install.deb:Package version is 16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:43:32.767 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default/ 2021-07-26T15:43:32.768 INFO:teuthology.task.install.deb:Package version is 16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:43:32.815 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:43:32.816 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-07-26T15:43:32.836 DEBUG:teuthology.orchestra.run.smithi033:> sudo apt-get update 2021-07-26T15:43:32.902 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:43:32.912 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-07-26T15:43:32.932 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2021-07-26T15:43:32.987 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:43:33.044 INFO:teuthology.orchestra.run.smithi033.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal InRelease 2021-07-26T15:43:33.071 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-07-26T15:43:33.107 INFO:teuthology.orchestra.run.smithi033.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal Release.gpg 2021-07-26T15:43:33.110 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:43:33.117 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 Packages [17.1 kB] 2021-07-26T15:43:33.119 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:43:33.160 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-07-26T15:43:33.200 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal InRelease 2021-07-26T15:43:33.200 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:43:33.209 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-07-26T15:43:33.235 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal Release.gpg 2021-07-26T15:43:33.237 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:43:33.263 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-07-26T15:43:33.263 INFO:teuthology.orchestra.run.smithi033.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-07-26T15:43:33.296 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 Packages [17.1 kB] 2021-07-26T15:43:33.320 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:43:33.402 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-07-26T15:43:33.663 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 27.9 kB in 1s (42.4 kB/s) 2021-07-26T15:43:33.759 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 27.9 kB in 1s (44.9 kB/s) 2021-07-26T15:43:34.445 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2021-07-26T15:43:34.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.5-102-gc6a1fa5a-1focal cephadm=16.2.5-102-gc6a1fa5a-1focal ceph-mds=16.2.5-102-gc6a1fa5a-1focal ceph-mgr=16.2.5-102-gc6a1fa5a-1focal ceph-common=16.2.5-102-gc6a1fa5a-1focal ceph-fuse=16.2.5-102-gc6a1fa5a-1focal ceph-test=16.2.5-102-gc6a1fa5a-1focal radosgw=16.2.5-102-gc6a1fa5a-1focal python3-rados=16.2.5-102-gc6a1fa5a-1focal python3-rgw=16.2.5-102-gc6a1fa5a-1focal python3-cephfs=16.2.5-102-gc6a1fa5a-1focal python3-rbd=16.2.5-102-gc6a1fa5a-1focal libcephfs2=16.2.5-102-gc6a1fa5a-1focal libcephfs-dev=16.2.5-102-gc6a1fa5a-1focal librados2=16.2.5-102-gc6a1fa5a-1focal librbd1=16.2.5-102-gc6a1fa5a-1focal rbd-fuse=16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:43:34.520 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2021-07-26T15:43:34.542 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.5-102-gc6a1fa5a-1focal cephadm=16.2.5-102-gc6a1fa5a-1focal ceph-mds=16.2.5-102-gc6a1fa5a-1focal ceph-mgr=16.2.5-102-gc6a1fa5a-1focal ceph-common=16.2.5-102-gc6a1fa5a-1focal ceph-fuse=16.2.5-102-gc6a1fa5a-1focal ceph-test=16.2.5-102-gc6a1fa5a-1focal radosgw=16.2.5-102-gc6a1fa5a-1focal python3-rados=16.2.5-102-gc6a1fa5a-1focal python3-rgw=16.2.5-102-gc6a1fa5a-1focal python3-cephfs=16.2.5-102-gc6a1fa5a-1focal python3-rbd=16.2.5-102-gc6a1fa5a-1focal libcephfs2=16.2.5-102-gc6a1fa5a-1focal libcephfs-dev=16.2.5-102-gc6a1fa5a-1focal librados2=16.2.5-102-gc6a1fa5a-1focal librbd1=16.2.5-102-gc6a1fa5a-1focal rbd-fuse=16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:43:34.544 INFO:teuthology.orchestra.run.smithi033.stdout:Reading package lists... 2021-07-26T15:43:34.611 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2021-07-26T15:43:34.713 INFO:teuthology.orchestra.run.smithi033.stdout:Building dependency tree... 2021-07-26T15:43:34.714 INFO:teuthology.orchestra.run.smithi033.stdout:Reading state information... 2021-07-26T15:43:34.754 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2021-07-26T15:43:34.755 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2021-07-26T15:43:34.853 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages were automatically installed and are no longer required: 2021-07-26T15:43:34.854 INFO:teuthology.orchestra.run.smithi033.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-07-26T15:43:34.854 INFO:teuthology.orchestra.run.smithi033.stdout:Use 'sudo apt autoremove' to remove them. 2021-07-26T15:43:34.855 INFO:teuthology.orchestra.run.smithi033.stdout:The following additional packages will be installed: 2021-07-26T15:43:34.855 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-07-26T15:43:34.855 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2021-07-26T15:43:34.855 INFO:teuthology.orchestra.run.smithi033.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-07-26T15:43:34.856 INFO:teuthology.orchestra.run.smithi033.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-07-26T15:43:34.856 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libxslt1.1 nvme-cli 2021-07-26T15:43:34.856 INFO:teuthology.orchestra.run.smithi033.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-07-26T15:43:34.856 INFO:teuthology.orchestra.run.smithi033.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-07-26T15:43:34.856 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2021-07-26T15:43:34.857 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-07-26T15:43:34.857 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-07-26T15:43:34.857 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-07-26T15:43:34.857 INFO:teuthology.orchestra.run.smithi033.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-07-26T15:43:34.857 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:43:34.858 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-07-26T15:43:34.858 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-07-26T15:43:34.858 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-07-26T15:43:34.858 INFO:teuthology.orchestra.run.smithi033.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2021-07-26T15:43:34.859 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2021-07-26T15:43:34.859 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2021-07-26T15:43:34.860 INFO:teuthology.orchestra.run.smithi033.stdout:Suggested packages: 2021-07-26T15:43:34.860 INFO:teuthology.orchestra.run.smithi033.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-07-26T15:43:34.860 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-07-26T15:43:34.861 INFO:teuthology.orchestra.run.smithi033.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-07-26T15:43:34.861 INFO:teuthology.orchestra.run.smithi033.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-07-26T15:43:34.861 INFO:teuthology.orchestra.run.smithi033.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-07-26T15:43:34.861 INFO:teuthology.orchestra.run.smithi033.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-07-26T15:43:34.862 INFO:teuthology.orchestra.run.smithi033.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-07-26T15:43:34.862 INFO:teuthology.orchestra.run.smithi033.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-07-26T15:43:34.862 INFO:teuthology.orchestra.run.smithi033.stdout:Recommended packages: 2021-07-26T15:43:34.862 INFO:teuthology.orchestra.run.smithi033.stdout: btrfs-tools 2021-07-26T15:43:34.876 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2021-07-26T15:43:34.878 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-07-26T15:43:34.878 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2021-07-26T15:43:34.878 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2021-07-26T15:43:34.878 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-07-26T15:43:34.879 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2021-07-26T15:43:34.879 INFO:teuthology.orchestra.run.smithi096.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-07-26T15:43:34.879 INFO:teuthology.orchestra.run.smithi096.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-07-26T15:43:34.879 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libxslt1.1 nvme-cli 2021-07-26T15:43:34.880 INFO:teuthology.orchestra.run.smithi096.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-07-26T15:43:34.880 INFO:teuthology.orchestra.run.smithi096.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-07-26T15:43:34.880 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2021-07-26T15:43:34.880 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2021-07-26T15:43:34.881 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2021-07-26T15:43:34.881 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-07-26T15:43:34.881 INFO:teuthology.orchestra.run.smithi096.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-07-26T15:43:34.881 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:43:34.881 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-07-26T15:43:34.882 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-07-26T15:43:34.882 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-07-26T15:43:34.882 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2021-07-26T15:43:34.882 INFO:teuthology.orchestra.run.smithi096.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2021-07-26T15:43:34.883 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2021-07-26T15:43:34.883 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2021-07-26T15:43:34.883 INFO:teuthology.orchestra.run.smithi096.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-07-26T15:43:34.884 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-07-26T15:43:34.886 INFO:teuthology.orchestra.run.smithi096.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-07-26T15:43:34.886 INFO:teuthology.orchestra.run.smithi096.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-07-26T15:43:34.887 INFO:teuthology.orchestra.run.smithi096.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-07-26T15:43:34.887 INFO:teuthology.orchestra.run.smithi096.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-07-26T15:43:34.887 INFO:teuthology.orchestra.run.smithi096.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-07-26T15:43:34.887 INFO:teuthology.orchestra.run.smithi096.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-07-26T15:43:34.888 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2021-07-26T15:43:34.888 INFO:teuthology.orchestra.run.smithi096.stdout: btrfs-tools 2021-07-26T15:43:34.946 INFO:teuthology.orchestra.run.smithi033.stdout:The following NEW packages will be installed: 2021-07-26T15:43:34.946 INFO:teuthology.orchestra.run.smithi033.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-07-26T15:43:34.947 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-07-26T15:43:34.947 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2021-07-26T15:43:34.947 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-07-26T15:43:34.947 INFO:teuthology.orchestra.run.smithi033.stdout: libleveldb1d liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 2021-07-26T15:43:34.950 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libxslt1.1 nvme-cli 2021-07-26T15:43:34.950 INFO:teuthology.orchestra.run.smithi033.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-07-26T15:43:34.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-07-26T15:43:34.950 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2021-07-26T15:43:34.951 INFO:teuthology.orchestra.run.smithi033.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-07-26T15:43:34.951 INFO:teuthology.orchestra.run.smithi033.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-07-26T15:43:34.951 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-07-26T15:43:34.951 INFO:teuthology.orchestra.run.smithi033.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-07-26T15:43:34.952 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-07-26T15:43:34.953 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2021-07-26T15:43:34.953 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-07-26T15:43:34.954 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-07-26T15:43:34.954 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-07-26T15:43:34.954 INFO:teuthology.orchestra.run.smithi033.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-07-26T15:43:34.954 INFO:teuthology.orchestra.run.smithi033.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-07-26T15:43:34.955 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-07-26T15:43:34.955 INFO:teuthology.orchestra.run.smithi033.stdout:The following packages will be upgraded: 2021-07-26T15:43:34.955 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 librbd1 2021-07-26T15:43:34.966 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2021-07-26T15:43:34.967 INFO:teuthology.orchestra.run.smithi096.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-07-26T15:43:34.967 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-07-26T15:43:34.967 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2021-07-26T15:43:34.967 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-07-26T15:43:34.968 INFO:teuthology.orchestra.run.smithi096.stdout: libleveldb1d liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 2021-07-26T15:43:34.969 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libxslt1.1 nvme-cli 2021-07-26T15:43:34.969 INFO:teuthology.orchestra.run.smithi096.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2021-07-26T15:43:34.969 INFO:teuthology.orchestra.run.smithi096.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2021-07-26T15:43:34.970 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2021-07-26T15:43:34.970 INFO:teuthology.orchestra.run.smithi096.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2021-07-26T15:43:34.970 INFO:teuthology.orchestra.run.smithi096.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2021-07-26T15:43:34.970 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2021-07-26T15:43:34.970 INFO:teuthology.orchestra.run.smithi096.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2021-07-26T15:43:34.971 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2021-07-26T15:43:34.971 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2021-07-26T15:43:34.971 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2021-07-26T15:43:34.971 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-07-26T15:43:34.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-07-26T15:43:34.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-07-26T15:43:34.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-07-26T15:43:34.972 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-07-26T15:43:34.972 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2021-07-26T15:43:34.973 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 librbd1 2021-07-26T15:43:35.085 INFO:teuthology.orchestra.run.smithi033.stdout:2 upgraded, 99 newly installed, 0 to remove and 143 not upgraded. 2021-07-26T15:43:35.086 INFO:teuthology.orchestra.run.smithi033.stdout:Need to get 172 MB of archives. 2021-07-26T15:43:35.086 INFO:teuthology.orchestra.run.smithi033.stdout:After this operation, 796 MB of additional disk space will be used. 2021-07-26T15:43:35.086 INFO:teuthology.orchestra.run.smithi033.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.5-102-gc6a1fa5a-1focal [3,816 B] 2021-07-26T15:43:35.103 INFO:teuthology.orchestra.run.smithi096.stdout:2 upgraded, 99 newly installed, 0 to remove and 143 not upgraded. 2021-07-26T15:43:35.103 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 172 MB of archives. 2021-07-26T15:43:35.103 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 796 MB of additional disk space will be used. 2021-07-26T15:43:35.104 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.5-102-gc6a1fa5a-1focal [3,816 B] 2021-07-26T15:43:35.132 INFO:teuthology.orchestra.run.smithi033.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.5-102-gc6a1fa5a-1focal [3,285 kB] 2021-07-26T15:43:35.139 INFO:teuthology.orchestra.run.smithi033.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-07-26T15:43:35.150 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.5-102-gc6a1fa5a-1focal [3,285 kB] 2021-07-26T15:43:35.158 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-07-26T15:43:35.391 INFO:teuthology.orchestra.run.smithi033.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.5-102-gc6a1fa5a-1focal [3,362 kB] 2021-07-26T15:43:35.419 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.5-102-gc6a1fa5a-1focal [3,362 kB] 2021-07-26T15:43:35.532 INFO:teuthology.orchestra.run.smithi033.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-07-26T15:43:35.543 INFO:teuthology.orchestra.run.smithi033.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2021-07-26T15:43:35.553 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-07-26T15:43:35.556 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2021-07-26T15:43:35.592 INFO:teuthology.orchestra.run.smithi033.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-07-26T15:43:35.599 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-07-26T15:43:35.612 INFO:teuthology.orchestra.run.smithi033.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.5-102-gc6a1fa5a-1focal [715 kB] 2021-07-26T15:43:35.620 INFO:teuthology.orchestra.run.smithi033.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-07-26T15:43:35.639 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-07-26T15:43:35.724 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.5-102-gc6a1fa5a-1focal [715 kB] 2021-07-26T15:43:35.725 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.5-102-gc6a1fa5a-1focal [409 kB] 2021-07-26T15:43:35.725 INFO:teuthology.orchestra.run.smithi033.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.5-102-gc6a1fa5a-1focal [409 kB] 2021-07-26T15:43:35.726 INFO:teuthology.orchestra.run.smithi033.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.5-102-gc6a1fa5a-1focal [22.0 kB] 2021-07-26T15:43:35.726 INFO:teuthology.orchestra.run.smithi033.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.5-102-gc6a1fa5a-1focal [212 kB] 2021-07-26T15:43:35.726 INFO:teuthology.orchestra.run.smithi033.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.5-102-gc6a1fa5a-1focal [31.2 kB] 2021-07-26T15:43:35.727 INFO:teuthology.orchestra.run.smithi033.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.5-102-gc6a1fa5a-1focal [385 kB] 2021-07-26T15:43:35.728 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.5-102-gc6a1fa5a-1focal [22.0 kB] 2021-07-26T15:43:35.729 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.5-102-gc6a1fa5a-1focal [212 kB] 2021-07-26T15:43:35.752 INFO:teuthology.orchestra.run.smithi033.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.5-102-gc6a1fa5a-1focal [3,686 kB] 2021-07-26T15:43:35.757 INFO:teuthology.orchestra.run.smithi033.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-07-26T15:43:35.779 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.5-102-gc6a1fa5a-1focal [31.2 kB] 2021-07-26T15:43:35.780 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.5-102-gc6a1fa5a-1focal [385 kB] 2021-07-26T15:43:35.785 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-07-26T15:43:35.794 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.5-102-gc6a1fa5a-1focal [3,686 kB] 2021-07-26T15:43:35.795 INFO:teuthology.orchestra.run.smithi033.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-07-26T15:43:35.802 INFO:teuthology.orchestra.run.smithi033.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-07-26T15:43:35.809 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-07-26T15:43:35.819 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-07-26T15:43:35.840 INFO:teuthology.orchestra.run.smithi033.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-07-26T15:43:35.846 INFO:teuthology.orchestra.run.smithi033.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-07-26T15:43:35.851 INFO:teuthology.orchestra.run.smithi033.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-07-26T15:43:35.866 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-07-26T15:43:35.871 INFO:teuthology.orchestra.run.smithi033.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-07-26T15:43:35.873 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-07-26T15:43:35.874 INFO:teuthology.orchestra.run.smithi033.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-07-26T15:43:35.875 INFO:teuthology.orchestra.run.smithi033.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-07-26T15:43:35.878 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-07-26T15:43:35.901 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-07-26T15:43:35.904 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-07-26T15:43:35.905 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-07-26T15:43:35.946 INFO:teuthology.orchestra.run.smithi033.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-07-26T15:43:35.950 INFO:teuthology.orchestra.run.smithi033.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-07-26T15:43:35.951 INFO:teuthology.orchestra.run.smithi033.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-07-26T15:43:35.972 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-07-26T15:43:35.978 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-07-26T15:43:35.979 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-07-26T15:43:35.982 INFO:teuthology.orchestra.run.smithi033.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.5-102-gc6a1fa5a-1focal [116 kB] 2021-07-26T15:43:35.989 INFO:teuthology.orchestra.run.smithi033.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.5-102-gc6a1fa5a-1focal [447 kB] 2021-07-26T15:43:36.027 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.5-102-gc6a1fa5a-1focal [116 kB] 2021-07-26T15:43:36.031 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.5-102-gc6a1fa5a-1focal [447 kB] 2021-07-26T15:43:36.039 INFO:teuthology.orchestra.run.smithi033.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.5-102-gc6a1fa5a-1focal [22.4 MB] 2021-07-26T15:43:36.054 INFO:teuthology.orchestra.run.smithi033.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-07-26T15:43:36.058 INFO:teuthology.orchestra.run.smithi033.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-07-26T15:43:36.058 INFO:teuthology.orchestra.run.smithi033.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-07-26T15:43:36.060 INFO:teuthology.orchestra.run.smithi033.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-07-26T15:43:36.063 INFO:teuthology.orchestra.run.smithi033.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-07-26T15:43:36.065 INFO:teuthology.orchestra.run.smithi033.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-07-26T15:43:36.078 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-07-26T15:43:36.079 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.5-102-gc6a1fa5a-1focal [22.4 MB] 2021-07-26T15:43:36.082 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-07-26T15:43:36.084 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-07-26T15:43:36.085 INFO:teuthology.orchestra.run.smithi033.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-07-26T15:43:36.086 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-07-26T15:43:36.090 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-07-26T15:43:36.091 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-07-26T15:43:36.104 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-07-26T15:43:36.138 INFO:teuthology.orchestra.run.smithi033.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-07-26T15:43:36.138 INFO:teuthology.orchestra.run.smithi033.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-07-26T15:43:36.141 INFO:teuthology.orchestra.run.smithi033.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-07-26T15:43:36.158 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-07-26T15:43:36.159 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-07-26T15:43:36.161 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-07-26T15:43:36.222 INFO:teuthology.orchestra.run.smithi033.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-07-26T15:43:36.225 INFO:teuthology.orchestra.run.smithi033.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-07-26T15:43:36.228 INFO:teuthology.orchestra.run.smithi033.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-07-26T15:43:36.230 INFO:teuthology.orchestra.run.smithi033.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-07-26T15:43:36.231 INFO:teuthology.orchestra.run.smithi033.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-07-26T15:43:36.232 INFO:teuthology.orchestra.run.smithi033.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-07-26T15:43:36.237 INFO:teuthology.orchestra.run.smithi033.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-07-26T15:43:36.242 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-07-26T15:43:36.254 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-07-26T15:43:36.254 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-07-26T15:43:36.254 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-07-26T15:43:36.258 INFO:teuthology.orchestra.run.smithi096.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-07-26T15:43:36.263 INFO:teuthology.orchestra.run.smithi096.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-07-26T15:43:36.267 INFO:teuthology.orchestra.run.smithi096.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-07-26T15:43:36.300 INFO:teuthology.orchestra.run.smithi033.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-07-26T15:43:36.301 INFO:teuthology.orchestra.run.smithi033.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-07-26T15:43:36.323 INFO:teuthology.orchestra.run.smithi096.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-07-26T15:43:36.324 INFO:teuthology.orchestra.run.smithi096.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-07-26T15:43:36.806 INFO:teuthology.orchestra.run.smithi033.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-07-26T15:43:36.890 INFO:teuthology.orchestra.run.smithi033.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-07-26T15:43:36.897 INFO:teuthology.orchestra.run.smithi033.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-07-26T15:43:36.931 INFO:teuthology.orchestra.run.smithi096.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-07-26T15:43:36.953 INFO:teuthology.orchestra.run.smithi096.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-07-26T15:43:37.021 INFO:teuthology.orchestra.run.smithi096.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-07-26T15:43:37.036 INFO:teuthology.orchestra.run.smithi033.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-07-26T15:43:37.037 INFO:teuthology.orchestra.run.smithi033.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-07-26T15:43:37.038 INFO:teuthology.orchestra.run.smithi033.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-07-26T15:43:37.038 INFO:teuthology.orchestra.run.smithi033.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-07-26T15:43:37.038 INFO:teuthology.orchestra.run.smithi033.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-07-26T15:43:37.039 INFO:teuthology.orchestra.run.smithi033.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-07-26T15:43:37.039 INFO:teuthology.orchestra.run.smithi033.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-07-26T15:43:37.040 INFO:teuthology.orchestra.run.smithi033.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-07-26T15:43:37.040 INFO:teuthology.orchestra.run.smithi033.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-07-26T15:43:37.075 INFO:teuthology.orchestra.run.smithi096.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-07-26T15:43:37.075 INFO:teuthology.orchestra.run.smithi096.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-07-26T15:43:37.076 INFO:teuthology.orchestra.run.smithi096.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-07-26T15:43:37.077 INFO:teuthology.orchestra.run.smithi096.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-07-26T15:43:37.078 INFO:teuthology.orchestra.run.smithi096.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-07-26T15:43:37.078 INFO:teuthology.orchestra.run.smithi096.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-07-26T15:43:37.079 INFO:teuthology.orchestra.run.smithi096.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-07-26T15:43:37.099 INFO:teuthology.orchestra.run.smithi096.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-07-26T15:43:37.124 INFO:teuthology.orchestra.run.smithi033.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-07-26T15:43:37.127 INFO:teuthology.orchestra.run.smithi033.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-07-26T15:43:37.131 INFO:teuthology.orchestra.run.smithi033.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-07-26T15:43:37.133 INFO:teuthology.orchestra.run.smithi033.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-07-26T15:43:37.134 INFO:teuthology.orchestra.run.smithi033.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-07-26T15:43:37.137 INFO:teuthology.orchestra.run.smithi033.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-07-26T15:43:37.138 INFO:teuthology.orchestra.run.smithi033.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-07-26T15:43:37.141 INFO:teuthology.orchestra.run.smithi033.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-07-26T15:43:37.161 INFO:teuthology.orchestra.run.smithi096.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-07-26T15:43:37.161 INFO:teuthology.orchestra.run.smithi096.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-07-26T15:43:37.167 INFO:teuthology.orchestra.run.smithi096.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-07-26T15:43:37.170 INFO:teuthology.orchestra.run.smithi096.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-07-26T15:43:37.174 INFO:teuthology.orchestra.run.smithi096.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-07-26T15:43:37.175 INFO:teuthology.orchestra.run.smithi096.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-07-26T15:43:37.177 INFO:teuthology.orchestra.run.smithi096.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-07-26T15:43:37.178 INFO:teuthology.orchestra.run.smithi096.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-07-26T15:43:37.181 INFO:teuthology.orchestra.run.smithi096.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-07-26T15:43:37.204 INFO:teuthology.orchestra.run.smithi033.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-07-26T15:43:37.205 INFO:teuthology.orchestra.run.smithi033.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-07-26T15:43:37.262 INFO:teuthology.orchestra.run.smithi096.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-07-26T15:43:37.263 INFO:teuthology.orchestra.run.smithi096.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-07-26T15:43:37.264 INFO:teuthology.orchestra.run.smithi096.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-07-26T15:43:37.264 INFO:teuthology.orchestra.run.smithi096.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-07-26T15:43:37.267 INFO:teuthology.orchestra.run.smithi096.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-07-26T15:43:37.285 INFO:teuthology.orchestra.run.smithi096.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-07-26T15:43:37.285 INFO:teuthology.orchestra.run.smithi096.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-07-26T15:43:37.286 INFO:teuthology.orchestra.run.smithi096.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-07-26T15:43:37.286 INFO:teuthology.orchestra.run.smithi033.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-07-26T15:43:37.288 INFO:teuthology.orchestra.run.smithi033.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-07-26T15:43:37.288 INFO:teuthology.orchestra.run.smithi033.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-07-26T15:43:37.309 INFO:teuthology.orchestra.run.smithi033.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-07-26T15:43:37.309 INFO:teuthology.orchestra.run.smithi033.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-07-26T15:43:37.309 INFO:teuthology.orchestra.run.smithi033.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-07-26T15:43:37.310 INFO:teuthology.orchestra.run.smithi033.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-07-26T15:43:37.310 INFO:teuthology.orchestra.run.smithi033.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-07-26T15:43:37.344 INFO:teuthology.orchestra.run.smithi096.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-07-26T15:43:37.347 INFO:teuthology.orchestra.run.smithi096.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-07-26T15:43:37.367 INFO:teuthology.orchestra.run.smithi033.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-07-26T15:43:37.368 INFO:teuthology.orchestra.run.smithi033.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-07-26T15:43:37.427 INFO:teuthology.orchestra.run.smithi096.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-07-26T15:43:37.427 INFO:teuthology.orchestra.run.smithi096.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-07-26T15:43:37.428 INFO:teuthology.orchestra.run.smithi096.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-07-26T15:43:37.432 INFO:teuthology.orchestra.run.smithi096.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-07-26T15:43:37.449 INFO:teuthology.orchestra.run.smithi033.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-07-26T15:43:37.501 INFO:teuthology.orchestra.run.smithi033.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-07-26T15:43:37.502 INFO:teuthology.orchestra.run.smithi033.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.5-102-gc6a1fa5a-1focal [5,872 kB] 2021-07-26T15:43:37.726 INFO:teuthology.orchestra.run.smithi033.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.5-102-gc6a1fa5a-1focal [186 kB] 2021-07-26T15:43:37.731 INFO:teuthology.orchestra.run.smithi033.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.5-102-gc6a1fa5a-1focal [1,501 kB] 2021-07-26T15:43:37.763 INFO:teuthology.orchestra.run.smithi096.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.5-102-gc6a1fa5a-1focal [5,872 kB] 2021-07-26T15:43:37.812 INFO:teuthology.orchestra.run.smithi033.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.5-102-gc6a1fa5a-1focal [6,929 kB] 2021-07-26T15:43:38.177 INFO:teuthology.orchestra.run.smithi096.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.5-102-gc6a1fa5a-1focal [186 kB] 2021-07-26T15:43:38.182 INFO:teuthology.orchestra.run.smithi096.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.5-102-gc6a1fa5a-1focal [1,501 kB] 2021-07-26T15:43:38.199 INFO:teuthology.orchestra.run.smithi033.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.5-102-gc6a1fa5a-1focal [26.0 MB] 2021-07-26T15:43:38.309 INFO:teuthology.orchestra.run.smithi096.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.5-102-gc6a1fa5a-1focal [6,929 kB] 2021-07-26T15:43:38.874 INFO:teuthology.orchestra.run.smithi096.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.5-102-gc6a1fa5a-1focal [26.0 MB] 2021-07-26T15:43:39.716 INFO:teuthology.orchestra.run.smithi033.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.5-102-gc6a1fa5a-1focal [3,908 B] 2021-07-26T15:43:39.717 INFO:teuthology.orchestra.run.smithi033.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.5-102-gc6a1fa5a-1focal [817 kB] 2021-07-26T15:43:39.729 INFO:teuthology.orchestra.run.smithi033.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.5-102-gc6a1fa5a-1focal [2,306 kB] 2021-07-26T15:43:39.829 INFO:teuthology.orchestra.run.smithi033.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.5-102-gc6a1fa5a-1focal [65.7 kB] 2021-07-26T15:43:39.831 INFO:teuthology.orchestra.run.smithi033.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.5-102-gc6a1fa5a-1focal [84.0 kB] 2021-07-26T15:43:39.833 INFO:teuthology.orchestra.run.smithi033.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.5-102-gc6a1fa5a-1focal [2,360 kB] 2021-07-26T15:43:39.970 INFO:teuthology.orchestra.run.smithi033.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.5-102-gc6a1fa5a-1focal [7,886 kB] 2021-07-26T15:43:40.407 INFO:teuthology.orchestra.run.smithi033.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.5-102-gc6a1fa5a-1focal [4,020 B] 2021-07-26T15:43:40.407 INFO:teuthology.orchestra.run.smithi033.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.5-102-gc6a1fa5a-1focal [126 kB] 2021-07-26T15:43:40.420 INFO:teuthology.orchestra.run.smithi033.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.5-102-gc6a1fa5a-1focal [49.3 MB] 2021-07-26T15:43:41.015 INFO:teuthology.orchestra.run.smithi096.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.5-102-gc6a1fa5a-1focal [3,908 B] 2021-07-26T15:43:41.015 INFO:teuthology.orchestra.run.smithi096.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.5-102-gc6a1fa5a-1focal [817 kB] 2021-07-26T15:43:41.029 INFO:teuthology.orchestra.run.smithi096.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.5-102-gc6a1fa5a-1focal [2,306 kB] 2021-07-26T15:43:41.311 INFO:teuthology.orchestra.run.smithi096.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.5-102-gc6a1fa5a-1focal [65.7 kB] 2021-07-26T15:43:41.313 INFO:teuthology.orchestra.run.smithi096.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.5-102-gc6a1fa5a-1focal [84.0 kB] 2021-07-26T15:43:41.363 INFO:teuthology.orchestra.run.smithi096.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.5-102-gc6a1fa5a-1focal [2,360 kB] 2021-07-26T15:43:41.605 INFO:teuthology.orchestra.run.smithi096.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.5-102-gc6a1fa5a-1focal [7,886 kB] 2021-07-26T15:43:42.405 INFO:teuthology.orchestra.run.smithi096.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.5-102-gc6a1fa5a-1focal [4,020 B] 2021-07-26T15:43:42.405 INFO:teuthology.orchestra.run.smithi096.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.5-102-gc6a1fa5a-1focal [126 kB] 2021-07-26T15:43:42.460 INFO:teuthology.orchestra.run.smithi096.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.5-102-gc6a1fa5a-1focal [49.3 MB] 2021-07-26T15:43:43.775 INFO:teuthology.orchestra.run.smithi033.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.5-102-gc6a1fa5a-1focal [20.8 kB] 2021-07-26T15:43:43.775 INFO:teuthology.orchestra.run.smithi033.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.5-102-gc6a1fa5a-1focal [11.3 MB] 2021-07-26T15:43:44.228 INFO:teuthology.orchestra.run.smithi033.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.5-102-gc6a1fa5a-1focal [77.6 kB] 2021-07-26T15:43:44.825 INFO:teuthology.orchestra.run.smithi033.stdout:Fetched 172 MB in 9s (18.6 MB/s) 2021-07-26T15:43:44.933 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libjaeger. 2021-07-26T15:43:44.990 INFO:teuthology.orchestra.run.smithi033.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138107 files and directories currently installed.) 2021-07-26T15:43:44.995 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../000-libjaeger_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:45.032 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libjaeger (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:45.352 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-07-26T15:43:45.371 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../001-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-07-26T15:43:45.451 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:43:45.466 INFO:teuthology.orchestra.run.smithi096.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.5-102-gc6a1fa5a-1focal [20.8 kB] 2021-07-26T15:43:45.467 INFO:teuthology.orchestra.run.smithi096.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.5-102-gc6a1fa5a-1focal [11.3 MB] 2021-07-26T15:43:45.786 INFO:teuthology.orchestra.run.smithi096.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/pacific/c6a1fa5a5e06fd971d97a2404f2b028c091eb255/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.5-102-gc6a1fa5a-1focal [77.6 kB] 2021-07-26T15:43:45.816 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../002-librbd1_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:45.963 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librbd1 (16.2.5-102-gc6a1fa5a-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:43:46.371 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 172 MB in 11s (15.9 MB/s) 2021-07-26T15:43:46.463 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjaeger. 2021-07-26T15:43:46.519 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138107 files and directories currently installed.) 2021-07-26T15:43:46.524 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../000-libjaeger_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:46.554 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjaeger (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:46.708 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../003-librados2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:46.835 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librados2 (16.2.5-102-gc6a1fa5a-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:43:46.874 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-07-26T15:43:46.889 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../001-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-07-26T15:43:46.973 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:43:47.318 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../002-librbd1_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:47.447 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libcephfs2. 2021-07-26T15:43:47.465 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../004-libcephfs2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:47.472 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librbd1 (16.2.5-102-gc6a1fa5a-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:43:47.505 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libcephfs2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:47.859 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rados. 2021-07-26T15:43:47.874 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../005-python3-rados_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:47.916 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rados (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:48.059 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../003-librados2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:48.182 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librados2 (16.2.5-102-gc6a1fa5a-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:43:48.302 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-07-26T15:43:48.321 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../006-python3-ceph-argparse_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:43:48.361 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-ceph-argparse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:48.645 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cephfs. 2021-07-26T15:43:48.662 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../007-python3-cephfs_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:48.698 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cephfs (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:48.852 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs2. 2021-07-26T15:43:48.870 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../004-libcephfs2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:48.911 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:49.023 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-ceph-common. 2021-07-26T15:43:49.039 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../008-python3-ceph-common_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:43:49.081 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:49.221 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rados. 2021-07-26T15:43:49.240 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../005-python3-rados_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:49.271 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rados (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:49.494 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-prettytable. 2021-07-26T15:43:49.510 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-5_all.deb ... 2021-07-26T15:43:49.551 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-07-26T15:43:49.616 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-07-26T15:43:49.633 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../006-python3-ceph-argparse_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:43:49.674 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-argparse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:49.837 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rbd. 2021-07-26T15:43:49.853 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../010-python3-rbd_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:49.896 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rbd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:49.960 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cephfs. 2021-07-26T15:43:49.980 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../007-python3-cephfs_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:50.018 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cephfs (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:50.273 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2021-07-26T15:43:50.289 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../011-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2021-07-26T15:43:50.332 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2021-07-26T15:43:50.363 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-common. 2021-07-26T15:43:50.383 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../008-python3-ceph-common_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:43:50.421 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:50.676 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-07-26T15:43:50.693 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../012-librabbitmq4_0.10.0-1_amd64.deb ... 2021-07-26T15:43:50.709 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-prettytable. 2021-07-26T15:43:50.723 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-5_all.deb ... 2021-07-26T15:43:50.734 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:43:50.791 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-07-26T15:43:51.037 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-07-26T15:43:51.044 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rbd. 2021-07-26T15:43:51.054 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../013-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-07-26T15:43:51.059 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../010-python3-rbd_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:51.095 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:43:51.102 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rbd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:51.463 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2021-07-26T15:43:51.480 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../011-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2021-07-26T15:43:51.481 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package librgw2. 2021-07-26T15:43:51.498 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../014-librgw2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:51.521 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2021-07-26T15:43:51.540 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking librgw2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:51.808 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-07-26T15:43:51.823 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../012-librabbitmq4_0.10.0-1_amd64.deb ... 2021-07-26T15:43:51.858 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:43:52.167 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rgw. 2021-07-26T15:43:52.171 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-07-26T15:43:52.187 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../015-python3-rgw_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:52.187 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../013-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-07-26T15:43:52.226 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:52.227 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:43:52.505 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-07-26T15:43:52.519 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../016-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-07-26T15:43:52.553 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:43:52.604 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librgw2. 2021-07-26T15:43:52.616 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../014-librgw2_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:52.658 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librgw2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:52.899 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liboath0. 2021-07-26T15:43:52.917 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../017-liboath0_2.6.1-1.3_amd64.deb ... 2021-07-26T15:43:52.981 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-07-26T15:43:53.241 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rgw. 2021-07-26T15:43:53.258 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../015-python3-rgw_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:53.292 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:53.301 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libradosstriper1. 2021-07-26T15:43:53.317 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../018-libradosstriper1_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:53.375 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libradosstriper1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:53.586 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-07-26T15:43:53.603 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../016-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-07-26T15:43:53.644 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:43:53.803 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-common. 2021-07-26T15:43:53.822 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../019-ceph-common_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:53.853 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:53.997 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liboath0. 2021-07-26T15:43:54.014 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../017-liboath0_2.6.1-1.3_amd64.deb ... 2021-07-26T15:43:54.055 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-07-26T15:43:54.367 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libradosstriper1. 2021-07-26T15:43:54.382 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../018-libradosstriper1_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:54.417 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libradosstriper1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:54.836 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-common. 2021-07-26T15:43:54.853 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../019-ceph-common_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:54.894 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:56.208 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-base. 2021-07-26T15:43:56.226 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../020-ceph-base_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:56.311 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-base (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:57.108 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-base. 2021-07-26T15:43:57.124 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../020-ceph-base_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:43:57.178 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-base (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:57.304 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cryptography. 2021-07-26T15:43:57.324 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../021-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-07-26T15:43:57.396 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:43:57.818 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-openssl. 2021-07-26T15:43:57.834 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../022-python3-openssl_19.0.0-1build1_all.deb ... 2021-07-26T15:43:57.876 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-07-26T15:43:58.063 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cryptography. 2021-07-26T15:43:58.081 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../021-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-07-26T15:43:58.113 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:43:58.170 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-07-26T15:43:58.189 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../023-ceph-mgr-modules-core_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:43:58.229 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-modules-core (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:58.450 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-openssl. 2021-07-26T15:43:58.466 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../022-python3-openssl_19.0.0-1build1_all.deb ... 2021-07-26T15:43:58.501 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-07-26T15:43:58.610 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-bcrypt. 2021-07-26T15:43:58.626 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../024-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-07-26T15:43:58.675 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:43:58.736 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-07-26T15:43:58.752 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../023-ceph-mgr-modules-core_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:43:58.794 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-modules-core (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:43:59.011 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cherrypy3. 2021-07-26T15:43:59.031 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2021-07-26T15:43:59.070 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:43:59.150 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bcrypt. 2021-07-26T15:43:59.167 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../024-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-07-26T15:43:59.216 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:43:59.448 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-jwt. 2021-07-26T15:43:59.463 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../026-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-07-26T15:43:59.533 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:43:59.544 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cherrypy3. 2021-07-26T15:43:59.561 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2021-07-26T15:43:59.610 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:43:59.948 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jwt. 2021-07-26T15:43:59.963 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../026-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-07-26T15:44:00.005 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:44:00.109 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-logutils. 2021-07-26T15:44:00.125 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2021-07-26T15:44:00.159 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-07-26T15:44:00.327 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-logutils. 2021-07-26T15:44:00.344 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2021-07-26T15:44:00.385 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-07-26T15:44:00.492 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-markupsafe. 2021-07-26T15:44:00.505 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-07-26T15:44:00.566 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:44:00.672 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-markupsafe. 2021-07-26T15:44:00.696 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-07-26T15:44:00.730 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:44:00.940 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-mako. 2021-07-26T15:44:00.955 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-07-26T15:44:01.006 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:44:01.066 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-mako. 2021-07-26T15:44:01.082 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-07-26T15:44:01.132 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:44:01.384 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-simplegeneric. 2021-07-26T15:44:01.401 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2021-07-26T15:44:01.452 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:44:01.477 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplegeneric. 2021-07-26T15:44:01.493 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2021-07-26T15:44:01.536 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:44:01.787 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-singledispatch. 2021-07-26T15:44:01.803 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-07-26T15:44:01.840 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-singledispatch. 2021-07-26T15:44:01.845 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:44:01.856 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-07-26T15:44:01.896 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:44:02.164 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-webob. 2021-07-26T15:44:02.182 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2021-07-26T15:44:02.199 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webob. 2021-07-26T15:44:02.218 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2021-07-26T15:44:02.223 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-07-26T15:44:02.274 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-07-26T15:44:02.588 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-soupsieve. 2021-07-26T15:44:02.601 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-07-26T15:44:02.627 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-soupsieve. 2021-07-26T15:44:02.642 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:44:02.643 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-07-26T15:44:02.685 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:44:03.038 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bs4. 2021-07-26T15:44:03.046 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-bs4. 2021-07-26T15:44:03.055 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2021-07-26T15:44:03.067 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2021-07-26T15:44:03.107 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-07-26T15:44:03.107 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-07-26T15:44:03.494 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-waitress. 2021-07-26T15:44:03.507 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1_all.deb ... 2021-07-26T15:44:03.507 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-waitress. 2021-07-26T15:44:03.523 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1_all.deb ... 2021-07-26T15:44:03.552 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-07-26T15:44:03.568 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-07-26T15:44:03.903 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempita. 2021-07-26T15:44:03.921 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2021-07-26T15:44:03.934 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-tempita. 2021-07-26T15:44:03.951 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2021-07-26T15:44:03.962 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-07-26T15:44:03.993 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-07-26T15:44:04.288 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-paste. 2021-07-26T15:44:04.305 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-07-26T15:44:04.320 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-paste. 2021-07-26T15:44:04.340 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-07-26T15:44:04.346 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:44:04.379 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:44:04.659 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-07-26T15:44:04.674 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-07-26T15:44:04.716 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:44:05.019 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastedeploy. 2021-07-26T15:44:05.034 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2021-07-26T15:44:05.077 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:44:05.340 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-07-26T15:44:05.352 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-07-26T15:44:05.380 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webtest. 2021-07-26T15:44:05.390 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:44:05.397 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2021-07-26T15:44:05.439 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-07-26T15:44:05.719 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pastedeploy. 2021-07-26T15:44:05.737 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2021-07-26T15:44:05.749 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pecan. 2021-07-26T15:44:05.767 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-07-26T15:44:05.776 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:44:05.808 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:44:06.104 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-webtest. 2021-07-26T15:44:06.123 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2021-07-26T15:44:06.162 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-07-26T15:44:06.187 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-werkzeug. 2021-07-26T15:44:06.204 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-07-26T15:44:06.246 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:44:06.516 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pecan. 2021-07-26T15:44:06.536 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-07-26T15:44:06.573 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:44:06.599 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr. 2021-07-26T15:44:06.614 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../043-ceph-mgr_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:06.675 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:06.987 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-werkzeug. 2021-07-26T15:44:07.003 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-07-26T15:44:07.061 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:44:07.185 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mon. 2021-07-26T15:44:07.201 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../044-ceph-mon_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:07.252 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mon (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:07.448 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr. 2021-07-26T15:44:07.465 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../043-ceph-mgr_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:07.506 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:08.127 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mon. 2021-07-26T15:44:08.145 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../044-ceph-mon_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:08.184 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mon (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:08.839 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-osd. 2021-07-26T15:44:08.856 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../045-ceph-osd_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:08.890 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-osd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:09.571 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-osd. 2021-07-26T15:44:09.591 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../045-ceph-osd_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:09.629 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-osd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:11.494 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph. 2021-07-26T15:44:11.511 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../046-ceph_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:11.551 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:11.885 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-fuse. 2021-07-26T15:44:11.888 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../047-ceph-fuse_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:11.931 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:12.344 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mds. 2021-07-26T15:44:12.358 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../048-ceph-mds_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:12.399 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mds (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:12.494 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph. 2021-07-26T15:44:12.509 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../046-ceph_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:12.551 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:12.944 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephadm. 2021-07-26T15:44:12.953 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-fuse. 2021-07-26T15:44:12.963 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../049-cephadm_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:12.972 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../047-ceph-fuse_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:13.002 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:13.011 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:13.288 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jinja2. 2021-07-26T15:44:13.307 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../050-python3-jinja2_2.10.1-2_all.deb ... 2021-07-26T15:44:13.346 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-07-26T15:44:13.574 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mds. 2021-07-26T15:44:13.591 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../048-ceph-mds_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:13.631 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mds (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:13.808 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-07-26T15:44:13.827 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../051-ceph-mgr-cephadm_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:44:14.007 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:14.199 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package cephadm. 2021-07-26T15:44:14.216 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../049-cephadm_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:14.259 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:14.335 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-repoze.lru. 2021-07-26T15:44:14.352 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../052-python3-repoze.lru_0.7-2_all.deb ... 2021-07-26T15:44:14.385 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-07-26T15:44:14.588 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjs-underscore. 2021-07-26T15:44:14.604 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../053-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-07-26T15:44:14.621 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-jinja2. 2021-07-26T15:44:14.637 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../050-python3-jinja2_2.10.1-2_all.deb ... 2021-07-26T15:44:14.638 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:44:14.679 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-07-26T15:44:14.907 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-07-26T15:44:14.926 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-07-26T15:44:14.973 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:44:15.040 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-07-26T15:44:15.057 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../051-ceph-mgr-cephadm_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:44:15.098 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:15.326 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-routes. 2021-07-26T15:44:15.346 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../055-python3-routes_2.4.1-2_all.deb ... 2021-07-26T15:44:15.385 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-07-26T15:44:15.527 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-repoze.lru. 2021-07-26T15:44:15.545 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../052-python3-repoze.lru_0.7-2_all.deb ... 2021-07-26T15:44:15.585 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-07-26T15:44:15.738 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-07-26T15:44:15.754 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:44:15.797 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-dashboard (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:15.854 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libjs-underscore. 2021-07-26T15:44:15.872 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../053-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-07-26T15:44:15.912 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:44:16.265 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-07-26T15:44:16.282 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-07-26T15:44:16.348 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:44:16.696 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-decorator. 2021-07-26T15:44:16.713 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../057-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-07-26T15:44:16.735 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-routes. 2021-07-26T15:44:16.746 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:44:16.751 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../055-python3-routes_2.4.1-2_all.deb ... 2021-07-26T15:44:16.793 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-07-26T15:44:17.024 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-07-26T15:44:17.041 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../058-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-07-26T15:44:17.082 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:44:17.163 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-07-26T15:44:17.179 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:44:17.223 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-dashboard (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:17.377 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-scipy. 2021-07-26T15:44:17.396 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../059-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-07-26T15:44:17.435 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-07-26T15:44:18.271 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-decorator. 2021-07-26T15:44:18.289 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../057-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-07-26T15:44:18.329 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:44:18.640 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-07-26T15:44:18.659 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../058-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-07-26T15:44:18.698 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:44:18.753 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-07-26T15:44:18.770 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../060-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-07-26T15:44:18.811 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:44:19.059 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-scipy. 2021-07-26T15:44:19.078 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../059-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-07-26T15:44:19.117 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-07-26T15:44:19.431 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-joblib. 2021-07-26T15:44:19.448 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../061-python3-joblib_0.14.0-3_all.deb ... 2021-07-26T15:44:19.498 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-07-26T15:44:19.868 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn. 2021-07-26T15:44:19.885 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../062-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-07-26T15:44:19.926 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:44:20.452 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-07-26T15:44:20.470 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../060-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-07-26T15:44:20.515 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:44:20.651 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-07-26T15:44:20.669 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:44:20.711 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:21.081 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-joblib. 2021-07-26T15:44:21.098 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../061-python3-joblib_0.14.0-3_all.deb ... 2021-07-26T15:44:21.139 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-07-26T15:44:21.534 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-sklearn. 2021-07-26T15:44:21.552 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../062-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-07-26T15:44:21.592 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:44:21.837 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cachetools. 2021-07-26T15:44:21.856 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../064-python3-cachetools_4.0.0-1_all.deb ... 2021-07-26T15:44:21.895 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-07-26T15:44:22.198 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1. 2021-07-26T15:44:22.220 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../065-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-07-26T15:44:22.256 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:44:22.317 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-07-26T15:44:22.334 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:44:22.400 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:22.610 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-07-26T15:44:22.628 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../066-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-07-26T15:44:22.685 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:44:22.987 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rsa. 2021-07-26T15:44:23.007 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../067-python3-rsa_4.0-3_all.deb ... 2021-07-26T15:44:23.045 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rsa (4.0-3) ... 2021-07-26T15:44:23.391 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-google-auth. 2021-07-26T15:44:23.410 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../068-python3-google-auth_1.5.1-2_all.deb ... 2021-07-26T15:44:23.448 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-07-26T15:44:23.578 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-cachetools. 2021-07-26T15:44:23.597 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../064-python3-cachetools_4.0.0-1_all.deb ... 2021-07-26T15:44:23.636 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-07-26T15:44:23.777 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-blinker. 2021-07-26T15:44:23.793 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../069-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-07-26T15:44:23.835 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:44:23.973 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pyasn1. 2021-07-26T15:44:23.992 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../065-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-07-26T15:44:24.033 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:44:24.138 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-oauthlib. 2021-07-26T15:44:24.157 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../070-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-07-26T15:44:24.196 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:44:24.393 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-07-26T15:44:24.412 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../066-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-07-26T15:44:24.450 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:44:24.548 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-07-26T15:44:24.567 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../071-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-07-26T15:44:24.606 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:44:24.795 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-rsa. 2021-07-26T15:44:24.815 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../067-python3-rsa_4.0-3_all.deb ... 2021-07-26T15:44:24.887 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-rsa (4.0-3) ... 2021-07-26T15:44:24.926 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-websocket. 2021-07-26T15:44:24.942 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../072-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-07-26T15:44:24.985 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:44:25.223 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-google-auth. 2021-07-26T15:44:25.244 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../068-python3-google-auth_1.5.1-2_all.deb ... 2021-07-26T15:44:25.282 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-07-26T15:44:25.287 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-kubernetes. 2021-07-26T15:44:25.304 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../073-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-07-26T15:44:25.346 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:44:25.635 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-blinker. 2021-07-26T15:44:25.653 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../069-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-07-26T15:44:25.693 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:44:25.892 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-07-26T15:44:25.909 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../074-ceph-mgr-k8sevents_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:44:25.967 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-k8sevents (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:26.031 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-oauthlib. 2021-07-26T15:44:26.048 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../070-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-07-26T15:44:26.091 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:44:26.203 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libonig5:amd64. 2021-07-26T15:44:26.219 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../075-libonig5_6.9.4-1_amd64.deb ... 2021-07-26T15:44:26.253 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:44:26.440 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-07-26T15:44:26.458 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../071-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-07-26T15:44:26.506 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:44:26.555 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjq1:amd64. 2021-07-26T15:44:26.573 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../076-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:44:26.614 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:44:26.851 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-websocket. 2021-07-26T15:44:26.869 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../072-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-07-26T15:44:26.883 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package jq. 2021-07-26T15:44:26.901 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../077-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:44:26.917 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:44:26.941 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:44:27.187 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package socat. 2021-07-26T15:44:27.202 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../078-socat_1.7.3.3-2_amd64.deb ... 2021-07-26T15:44:27.243 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking socat (1.7.3.3-2) ... 2021-07-26T15:44:27.262 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-kubernetes. 2021-07-26T15:44:27.279 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../073-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-07-26T15:44:27.354 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:44:27.697 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-07-26T15:44:27.713 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../079-libxslt1.1_1.1.34-4_amd64.deb ... 2021-07-26T15:44:27.755 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:44:27.900 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-07-26T15:44:27.920 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../074-ceph-mgr-k8sevents_16.2.5-102-gc6a1fa5a-1focal_all.deb ... 2021-07-26T15:44:27.958 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-mgr-k8sevents (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:28.033 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package xmlstarlet. 2021-07-26T15:44:28.052 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../080-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-07-26T15:44:28.092 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:44:28.311 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libonig5:amd64. 2021-07-26T15:44:28.327 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../075-libonig5_6.9.4-1_amd64.deb ... 2021-07-26T15:44:28.403 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:44:28.581 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2021-07-26T15:44:28.599 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../081-libsqlite3-mod-ceph_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:28.639 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libsqlite3-mod-ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:28.789 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libjq1:amd64. 2021-07-26T15:44:28.806 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../076-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:44:28.847 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:44:28.909 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-test. 2021-07-26T15:44:28.925 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../082-ceph-test_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:28.967 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-test (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:29.150 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package jq. 2021-07-26T15:44:29.166 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../077-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:44:29.208 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:44:29.494 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package socat. 2021-07-26T15:44:29.512 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../078-socat_1.7.3.3-2_amd64.deb ... 2021-07-26T15:44:29.552 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking socat (1.7.3.3-2) ... 2021-07-26T15:44:30.014 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-07-26T15:44:30.031 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../079-libxslt1.1_1.1.34-4_amd64.deb ... 2021-07-26T15:44:30.073 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:44:30.400 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package xmlstarlet. 2021-07-26T15:44:30.417 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../080-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-07-26T15:44:30.458 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:44:31.507 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2021-07-26T15:44:31.522 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../081-libsqlite3-mod-ceph_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:31.564 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libsqlite3-mod-ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:31.892 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package ceph-test. 2021-07-26T15:44:31.909 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../082-ceph-test_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:31.958 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking ceph-test (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:33.228 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs-dev. 2021-07-26T15:44:33.245 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../083-libcephfs-dev_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:33.294 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs-dev (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:33.681 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package nvme-cli. 2021-07-26T15:44:33.697 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../084-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-07-26T15:44:33.757 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:44:34.153 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-atomicwrites. 2021-07-26T15:44:34.170 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../085-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-07-26T15:44:34.211 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:44:34.530 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-attr. 2021-07-26T15:44:34.548 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../086-python3-attr_19.3.0-2_all.deb ... 2021-07-26T15:44:34.588 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-07-26T15:44:34.874 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webencodings. 2021-07-26T15:44:34.892 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../087-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-07-26T15:44:34.941 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:44:35.202 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-html5lib. 2021-07-26T15:44:35.220 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../088-python3-html5lib_1.0.1-2_all.deb ... 2021-07-26T15:44:35.261 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-07-26T15:44:35.589 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-07-26T15:44:35.605 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../089-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-07-26T15:44:35.647 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:44:36.117 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-packaging. 2021-07-26T15:44:36.136 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../090-python3-packaging_20.3-1_all.deb ... 2021-07-26T15:44:36.175 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-packaging (20.3-1) ... 2021-07-26T15:44:36.329 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package libcephfs-dev. 2021-07-26T15:44:36.346 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../083-libcephfs-dev_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:36.395 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking libcephfs-dev (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:36.477 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastescript. 2021-07-26T15:44:36.496 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../091-python3-pastescript_2.0.2-4_all.deb ... 2021-07-26T15:44:36.536 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-07-26T15:44:36.808 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pluggy. 2021-07-26T15:44:36.823 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package nvme-cli. 2021-07-26T15:44:36.824 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../092-python3-pluggy_0.13.0-2_all.deb ... 2021-07-26T15:44:36.841 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../084-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-07-26T15:44:36.858 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-07-26T15:44:36.898 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:44:37.163 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-psutil. 2021-07-26T15:44:37.177 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../093-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-07-26T15:44:37.219 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:44:37.245 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-atomicwrites. 2021-07-26T15:44:37.264 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../085-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-07-26T15:44:37.295 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:44:37.522 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-py. 2021-07-26T15:44:37.538 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../094-python3-py_1.8.1-1_all.deb ... 2021-07-26T15:44:37.580 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-py (1.8.1-1) ... 2021-07-26T15:44:37.589 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-attr. 2021-07-26T15:44:37.608 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../086-python3-attr_19.3.0-2_all.deb ... 2021-07-26T15:44:37.647 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-07-26T15:44:37.929 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyinotify. 2021-07-26T15:44:37.945 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../095-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-07-26T15:44:37.980 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:44:37.983 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-webencodings. 2021-07-26T15:44:38.003 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../087-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-07-26T15:44:38.042 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:44:38.264 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-wcwidth. 2021-07-26T15:44:38.281 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../096-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-07-26T15:44:38.308 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:44:38.353 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-html5lib. 2021-07-26T15:44:38.371 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../088-python3-html5lib_1.0.1-2_all.deb ... 2021-07-26T15:44:38.403 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-07-26T15:44:38.590 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pytest. 2021-07-26T15:44:38.608 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../097-python3-pytest_4.6.9-1_all.deb ... 2021-07-26T15:44:38.651 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-07-26T15:44:38.748 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-07-26T15:44:38.765 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../089-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-07-26T15:44:38.806 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:44:39.039 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplejson. 2021-07-26T15:44:39.057 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../098-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-07-26T15:44:39.106 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:44:39.317 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-packaging. 2021-07-26T15:44:39.336 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../090-python3-packaging_20.3-1_all.deb ... 2021-07-26T15:44:39.375 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-packaging (20.3-1) ... 2021-07-26T15:44:39.559 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package radosgw. 2021-07-26T15:44:39.576 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../099-radosgw_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:39.617 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking radosgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:39.714 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pastescript. 2021-07-26T15:44:39.731 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../091-python3-pastescript_2.0.2-4_all.deb ... 2021-07-26T15:44:39.772 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-07-26T15:44:40.126 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pluggy. 2021-07-26T15:44:40.142 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../092-python3-pluggy_0.13.0-2_all.deb ... 2021-07-26T15:44:40.184 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-07-26T15:44:40.531 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-psutil. 2021-07-26T15:44:40.551 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../093-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-07-26T15:44:40.589 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:44:40.763 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package rbd-fuse. 2021-07-26T15:44:40.779 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../100-rbd-fuse_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:40.828 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking rbd-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:40.964 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-py. 2021-07-26T15:44:40.981 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../094-python3-py_1.8.1-1_all.deb ... 2021-07-26T15:44:41.038 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-py (1.8.1-1) ... 2021-07-26T15:44:41.159 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-attr (19.3.0-2) ... 2021-07-26T15:44:41.411 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pyinotify. 2021-07-26T15:44:41.432 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../095-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-07-26T15:44:41.469 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:44:41.479 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:44:41.604 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:44:41.730 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:44:41.829 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-wcwidth. 2021-07-26T15:44:41.848 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../096-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-07-26T15:44:41.888 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:44:41.935 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:42.216 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-pytest. 2021-07-26T15:44:42.236 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../097-python3-pytest_4.6.9-1_all.deb ... 2021-07-26T15:44:42.275 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-07-26T15:44:42.485 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user cephadm....done 2021-07-26T15:44:42.636 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package python3-simplejson. 2021-07-26T15:44:42.656 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../098-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-07-26T15:44:42.694 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:44:42.697 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-07-26T15:44:43.057 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-07-26T15:44:43.181 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package radosgw. 2021-07-26T15:44:43.198 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../099-radosgw_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:43.241 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking radosgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:43.375 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-07-26T15:44:43.501 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-py (1.8.1-1) ... 2021-07-26T15:44:43.827 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-07-26T15:44:44.229 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:44:44.480 INFO:teuthology.orchestra.run.smithi033.stdout:Selecting previously unselected package rbd-fuse. 2021-07-26T15:44:44.499 INFO:teuthology.orchestra.run.smithi033.stdout:Preparing to unpack .../100-rbd-fuse_16.2.5-102-gc6a1fa5a-1focal_amd64.deb ... 2021-07-26T15:44:44.538 INFO:teuthology.orchestra.run.smithi033.stdout:Unpacking rbd-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:44.539 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-07-26T15:44:44.860 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-attr (19.3.0-2) ... 2021-07-26T15:44:45.210 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:44:45.240 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:44:45.378 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:44:45.504 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:44:45.524 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:44:45.732 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:45.817 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-argparse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:46.111 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:44:46.237 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:44:46.303 INFO:teuthology.orchestra.run.smithi033.stdout:Adding system user cephadm....done 2021-07-26T15:44:46.498 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-07-26T15:44:46.530 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:44:46.823 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:44:46.858 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-07-26T15:44:47.155 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-07-26T15:44:47.234 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:44:47.285 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-py (1.8.1-1) ... 2021-07-26T15:44:47.517 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:44:47.645 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-07-26T15:44:47.868 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:44:48.114 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:44:48.163 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjaeger (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:48.290 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-07-26T15:44:48.456 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-07-26T15:44:48.608 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-07-26T15:44:48.759 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:44:48.892 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-packaging (20.3-1) ... 2021-07-26T15:44:49.077 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:44:49.178 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:44:49.324 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:44:49.403 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-ceph-argparse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:49.621 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:44:49.729 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:44:49.880 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:44:50.044 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:44:50.148 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:44:50.432 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:44:50.475 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:44:50.801 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up socat (1.7.3.3-2) ... 2021-07-26T15:44:50.870 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:44:50.927 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:51.189 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:44:51.270 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-07-26T15:44:51.557 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:44:51.605 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:44:51.730 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-07-26T15:44:51.892 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libjaeger (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:52.023 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2021-07-26T15:44:52.043 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-07-26T15:44:52.149 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:44:52.276 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:44:52.394 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-07-26T15:44:52.594 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:44:52.703 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-packaging (20.3-1) ... 2021-07-26T15:44:52.887 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-07-26T15:44:53.046 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:44:53.180 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:44:53.181 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:44:53.305 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:44:53.474 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:44:53.607 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-07-26T15:44:53.867 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:44:53.891 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:44:54.201 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:44:54.236 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:44:54.604 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-07-26T15:44:54.605 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up socat (1.7.3.3-2) ... 2021-07-26T15:44:54.730 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:54.870 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:44:54.997 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:44:55.074 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-07-26T15:44:55.315 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:44:55.492 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:44:55.618 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-07-26T15:44:55.674 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:44:55.800 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:44:55.912 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2021-07-26T15:44:55.927 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-07-26T15:44:56.046 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:44:56.230 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:44:56.294 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:44:56.565 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:44:56.579 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librados2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:56.706 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-07-26T15:44:56.850 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-07-26T15:44:57.168 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:44:57.319 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:44:57.628 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-07-26T15:44:57.944 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:44:58.157 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librgw2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:58.257 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:44:58.283 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libsqlite3-mod-ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:58.410 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:44:58.560 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-07-26T15:44:58.659 INFO:teuthology.orchestra.run.smithi033.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-07-26T15:44:58.926 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:44:58.945 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-07-26T15:44:59.077 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:44:59.239 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:44:59.404 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:44:59.539 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-07-26T15:44:59.788 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:44:59.874 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:44:59.924 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:45:00.000 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:45:00.086 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-07-26T15:45:00.310 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libradosstriper1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:00.450 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:45:00.461 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:45:00.778 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librados2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:00.796 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:45:00.903 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-07-26T15:45:01.834 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librbd1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:01.977 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:45:02.112 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:45:02.238 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:45:02.443 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librgw2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:02.547 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:45:02.603 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libsqlite3-mod-ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:02.690 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rsa (4.0-3) ... 2021-07-26T15:45:02.728 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:45:02.865 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-07-26T15:45:02.991 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-07-26T15:45:03.248 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-07-26T15:45:03.301 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-modules-core (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:03.427 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:03.540 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:45:03.658 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:45:03.659 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:45:03.875 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-07-26T15:45:04.086 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs-dev (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:04.212 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:45:04.235 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libcephfs2 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:04.386 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:45:04.539 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-07-26T15:45:04.738 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libradosstriper1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:04.840 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:45:04.865 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:45:05.195 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rados (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:05.199 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:45:05.325 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rbd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:05.448 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up rbd-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:05.582 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-routes (2.4.1-2) ... 2021-07-26T15:45:05.985 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-07-26T15:45:06.289 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:06.296 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up librbd1 (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:06.415 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cephfs (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:06.455 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:45:06.581 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:45:06.699 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:45:06.740 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:45:07.051 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:45:07.177 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rsa (4.0-3) ... 2021-07-26T15:45:07.478 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-07-26T15:45:07.629 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:07.794 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-modules-core (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:07.922 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:08.151 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:45:08.151 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:45:08.206 INFO:teuthology.orchestra.run.smithi096.stdout:Adding group ceph....done 2021-07-26T15:45:08.592 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user ceph....done 2021-07-26T15:45:08.624 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up libcephfs-dev (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:08.741 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:45:08.783 INFO:teuthology.orchestra.run.smithi096.stdout:Setting system user ceph properties....done 2021-07-26T15:45:08.809 INFO:teuthology.orchestra.run.smithi096.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-07-26T15:45:08.950 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-07-26T15:45:09.030 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-07-26T15:45:09.263 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-07-26T15:45:09.349 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:45:09.721 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-test (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:09.725 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rados (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:09.826 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rbd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:09.846 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up radosgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:09.969 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up rbd-fuse (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:10.097 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-routes (2.4.1-2) ... 2021-07-26T15:45:10.118 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:45:10.118 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:45:10.517 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-07-26T15:45:10.740 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-base (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:10.802 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-rgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:10.903 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-cephfs (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:11.074 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-07-26T15:45:11.221 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:45:11.525 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mds (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:11.748 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:45:11.749 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:45:12.212 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:12.215 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-common (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:12.444 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:45:12.445 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:45:12.818 INFO:teuthology.orchestra.run.smithi033.stdout:Adding group ceph....done 2021-07-26T15:45:12.891 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-osd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:13.220 INFO:teuthology.orchestra.run.smithi033.stdout:Adding system user ceph....done 2021-07-26T15:45:13.396 INFO:teuthology.orchestra.run.smithi033.stdout:Setting system user ceph properties....done 2021-07-26T15:45:13.419 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:45:13.419 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:45:13.421 INFO:teuthology.orchestra.run.smithi033.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-07-26T15:45:13.579 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-07-26T15:45:13.834 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-k8sevents (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:13.908 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-07-26T15:45:13.960 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-local (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:14.103 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mon (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:14.322 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:45:14.322 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:45:14.383 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-test (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:14.510 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up radosgw (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:14.764 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:45:14.765 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:45:14.779 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:14.922 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:15.057 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-dashboard (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:15.200 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-07-26T15:45:15.403 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-base (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:15.493 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-07-26T15:45:15.783 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-07-26T15:45:16.277 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mds (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:16.506 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:45:16.507 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:45:16.995 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:17.226 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:45:17.226 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:45:17.696 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-osd (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:18.240 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:45:18.241 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:45:18.545 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-07-26T15:45:18.732 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-k8sevents (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:18.857 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-diskprediction-local (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:18.947 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-07-26T15:45:18.950 DEBUG:teuthology.parallel:result is None 2021-07-26T15:45:18.992 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mon (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:19.237 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:45:19.237 INFO:teuthology.orchestra.run.smithi033.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:45:19.685 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-cephadm (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:19.852 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:19.978 INFO:teuthology.orchestra.run.smithi033.stdout:Setting up ceph-mgr-dashboard (16.2.5-102-gc6a1fa5a-1focal) ... 2021-07-26T15:45:20.147 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-07-26T15:45:20.439 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-07-26T15:45:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-07-26T15:45:24.010 INFO:teuthology.orchestra.run.smithi033.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-07-26T15:45:24.013 DEBUG:teuthology.parallel:result is None 2021-07-26T15:45:24.014 DEBUG:teuthology.orchestra.run.smithi033:> sudo lsb_release -is 2021-07-26T15:45:24.062 INFO:teuthology.orchestra.run.smithi033.stdout:Ubuntu 2021-07-26T15:45:24.067 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:45:24.068 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:45:24.069 INFO:teuthology.packaging:ref: None 2021-07-26T15:45:24.069 INFO:teuthology.packaging:tag: None 2021-07-26T15:45:24.070 INFO:teuthology.packaging:branch: pacific 2021-07-26T15:45:24.070 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:45:24.071 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=pacific 2021-07-26T15:45:24.326 DEBUG:teuthology.orchestra.run.smithi033:> dpkg-query -W -f '${Version}' ceph 2021-07-26T15:45:24.349 INFO:teuthology.orchestra.run.smithi033.stdout:16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:45:24.350 INFO:teuthology.packaging:The installed version of ceph is 16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:45:24.350 INFO:teuthology.task.install:The correct ceph version 16.2.5-102-gc6a1fa5a-1focal is installed. 2021-07-26T15:45:24.351 DEBUG:teuthology.orchestra.run.smithi096:> sudo lsb_release -is 2021-07-26T15:45:24.402 INFO:teuthology.orchestra.run.smithi096.stdout:Ubuntu 2021-07-26T15:45:24.408 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:45:24.409 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:45:24.410 INFO:teuthology.packaging:ref: None 2021-07-26T15:45:24.411 INFO:teuthology.packaging:tag: None 2021-07-26T15:45:24.411 INFO:teuthology.packaging:branch: pacific 2021-07-26T15:45:24.412 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:45:24.413 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=pacific 2021-07-26T15:45:24.666 DEBUG:teuthology.orchestra.run.smithi096:> dpkg-query -W -f '${Version}' ceph 2021-07-26T15:45:24.691 INFO:teuthology.orchestra.run.smithi096.stdout:16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:45:24.692 INFO:teuthology.packaging:The installed version of ceph is 16.2.5-102-gc6a1fa5a-1focal 2021-07-26T15:45:24.692 INFO:teuthology.task.install:The correct ceph version 16.2.5-102-gc6a1fa5a-1focal is installed. 2021-07-26T15:45:24.693 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-07-26T15:45:24.693 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:45:24.694 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-07-26T15:45:24.712 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:45:24.712 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-07-26T15:45:24.729 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-07-26T15:45:24.730 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:45:24.730 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2021-07-26T15:45:24.770 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-07-26T15:45:24.781 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:45:24.781 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2021-07-26T15:45:24.798 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-07-26T15:45:24.814 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-07-26T15:45:24.814 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:45:24.815 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2021-07-26T15:45:24.832 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-07-26T15:45:24.842 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:45:24.842 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2021-07-26T15:45:24.859 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-07-26T15:45:24.917 INFO:teuthology.run_tasks:Running task print... 2021-07-26T15:45:24.930 INFO:teuthology.task.print:**** done install task... 2021-07-26T15:45:24.930 INFO:teuthology.run_tasks:Running task print... 2021-07-26T15:45:24.988 INFO:teuthology.task.print:**** done start installing pacific cephadm ... 2021-07-26T15:45:24.988 INFO:teuthology.run_tasks:Running task cephadm... 2021-07-26T15:45:25.138 INFO:tasks.cephadm:Config: {'cephadm_branch': 'pacific', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}, 'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'image': 'docker.io/ceph/daemon-base:latest-pacific', 'create_rbd_pool': True, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'} 2021-07-26T15:45:25.139 INFO:tasks.cephadm:Cluster image is docker.io/ceph/daemon-base:latest-pacific 2021-07-26T15:45:25.141 INFO:tasks.cephadm:Cluster fsid is 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:45:25.142 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-07-26T15:45:25.142 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.33', 'mon.c': '[v2:172.21.15.33:3301,v1:172.21.15.33:6790]', 'mon.b': '172.21.15.96'} 2021-07-26T15:45:25.143 INFO:tasks.cephadm:First mon is mon.a on smithi033 2021-07-26T15:45:25.143 INFO:tasks.cephadm:First mgr is y 2021-07-26T15:45:25.143 INFO:tasks.cephadm:Normalizing hostnames... 2021-07-26T15:45:25.144 DEBUG:teuthology.orchestra.run.smithi033:> sudo hostname $(hostname -s) 2021-07-26T15:45:25.160 DEBUG:teuthology.orchestra.run.smithi096:> sudo hostname $(hostname -s) 2021-07-26T15:45:25.179 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref pacific)... 2021-07-26T15:45:25.181 DEBUG:teuthology.orchestra.run.smithi033:> curl --silent https://raw.githubusercontent.com/ceph/ceph/pacific/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-07-26T15:45:25.478 INFO:teuthology.orchestra.run.smithi033.stdout:-rw-rw-r-- 1 ubuntu ubuntu 298325 Jul 26 15:45 /home/ubuntu/cephtest/cephadm 2021-07-26T15:45:25.478 DEBUG:teuthology.orchestra.run.smithi096:> curl --silent https://raw.githubusercontent.com/ceph/ceph/pacific/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-07-26T15:45:25.621 INFO:teuthology.orchestra.run.smithi096.stdout:-rw-rw-r-- 1 ubuntu ubuntu 298325 Jul 26 15:45 /home/ubuntu/cephtest/cephadm 2021-07-26T15:45:25.622 DEBUG:teuthology.orchestra.run.smithi033:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-07-26T15:45:25.633 DEBUG:teuthology.orchestra.run.smithi096:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-07-26T15:45:25.660 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph 2021-07-26T15:45:25.692 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph 2021-07-26T15:45:25.708 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /etc/ceph 2021-07-26T15:45:25.725 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /etc/ceph 2021-07-26T15:45:25.740 INFO:tasks.cephadm:Writing seed config... 2021-07-26T15:45:25.742 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2021-07-26T15:45:25.743 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2021-07-26T15:45:25.744 INFO:tasks.cephadm: override: [osd] debug ms = 1 2021-07-26T15:45:25.744 INFO:tasks.cephadm: override: [osd] debug osd = 20 2021-07-26T15:45:25.745 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-07-26T15:45:25.745 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2021-07-26T15:45:25.746 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-07-26T15:45:25.746 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-07-26T15:45:25.747 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-07-26T15:45:25.747 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-07-26T15:45:25.748 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-07-26T15:45:25.750 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:45:25.750 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-07-26T15:45:25.768 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7e62724e-ee28-11eb-8c23-001a4aab830c mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2021-07-26T15:45:25.768 DEBUG:teuthology.orchestra.run.smithi033:mon.a> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.a.service 2021-07-26T15:45:25.810 DEBUG:teuthology.orchestra.run.smithi033:mgr.y> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.y.service 2021-07-26T15:45:25.813 INFO:tasks.cephadm:Bootstrapping... 2021-07-26T15:45:25.813 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific -v bootstrap --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.33 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-07-26T15:45:25.885 INFO:journalctl@ceph.mgr.y.smithi033.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:45:25.899 INFO:journalctl@ceph.mon.a.smithi033.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:45:26.105 INFO:teuthology.orchestra.run.smithi033.stderr:Could not locate podman: podman not found 2021-07-26T15:45:26.105 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying podman|docker is present... 2021-07-26T15:45:26.106 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying lvm2 is present... 2021-07-26T15:45:26.106 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying time synchronization is in place... 2021-07-26T15:45:26.107 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chrony.service 2021-07-26T15:45:26.111 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-07-26T15:45:26.111 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chrony.service 2021-07-26T15:45:26.117 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2021-07-26T15:45:26.119 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chronyd.service 2021-07-26T15:45:26.125 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2021-07-26T15:45:26.126 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chronyd.service 2021-07-26T15:45:26.133 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2021-07-26T15:45:26.133 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-07-26T15:45:26.142 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: masked 2021-07-26T15:45:26.143 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-07-26T15:45:26.148 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2021-07-26T15:45:26.150 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled ntpd.service 2021-07-26T15:45:26.155 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2021-07-26T15:45:26.156 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active ntpd.service 2021-07-26T15:45:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2021-07-26T15:45:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled ntp.service 2021-07-26T15:45:26.170 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: enabled 2021-07-26T15:45:26.171 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active ntp.service 2021-07-26T15:45:26.176 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: active 2021-07-26T15:45:26.178 INFO:teuthology.orchestra.run.smithi033.stderr:Unit ntp.service is enabled and running 2021-07-26T15:45:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:Repeating the final host check... 2021-07-26T15:45:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:podman|docker (/usr/bin/docker) is present 2021-07-26T15:45:26.180 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl is present 2021-07-26T15:45:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:lvcreate is present 2021-07-26T15:45:26.181 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chrony.service 2021-07-26T15:45:26.184 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-07-26T15:45:26.186 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chrony.service 2021-07-26T15:45:26.192 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2021-07-26T15:45:26.193 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled chronyd.service 2021-07-26T15:45:26.199 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2021-07-26T15:45:26.200 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active chronyd.service 2021-07-26T15:45:26.206 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2021-07-26T15:45:26.206 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-07-26T15:45:26.213 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: masked 2021-07-26T15:45:26.215 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-07-26T15:45:26.221 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2021-07-26T15:45:26.222 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled ntpd.service 2021-07-26T15:45:26.228 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2021-07-26T15:45:26.229 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active ntpd.service 2021-07-26T15:45:26.235 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: inactive 2021-07-26T15:45:26.236 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-enabled ntp.service 2021-07-26T15:45:26.245 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: enabled 2021-07-26T15:45:26.246 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl is-active ntp.service 2021-07-26T15:45:26.251 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: active 2021-07-26T15:45:26.252 INFO:teuthology.orchestra.run.smithi033.stderr:Unit ntp.service is enabled and running 2021-07-26T15:45:26.253 INFO:teuthology.orchestra.run.smithi033.stderr:Host looks OK 2021-07-26T15:45:26.253 INFO:teuthology.orchestra.run.smithi033.stderr:Cluster fsid: 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:45:26.255 INFO:teuthology.orchestra.run.smithi033.stderr:Acquiring lock 140274089773280 on /run/cephadm/7e62724e-ee28-11eb-8c23-001a4aab830c.lock 2021-07-26T15:45:26.255 INFO:teuthology.orchestra.run.smithi033.stderr:Lock 140274089773280 acquired on /run/cephadm/7e62724e-ee28-11eb-8c23-001a4aab830c.lock 2021-07-26T15:45:26.255 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying IP 172.21.15.33 port 3300 ... 2021-07-26T15:45:26.255 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying IP 172.21.15.33 port 6789 ... 2021-07-26T15:45:26.256 INFO:teuthology.orchestra.run.smithi033.stderr:Base mon IP is 172.21.15.33, final addrv is [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2021-07-26T15:45:26.256 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/sbin/ip route ls 2021-07-26T15:45:26.258 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: default via 172.21.15.254 dev ens1f0 2021-07-26T15:45:26.258 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2021-07-26T15:45:26.258 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.33 2021-07-26T15:45:26.259 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/sbin/ip -6 route ls 2021-07-26T15:45:26.262 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2021-07-26T15:45:26.262 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2021-07-26T15:45:26.262 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2021-07-26T15:45:26.263 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/sbin/ip -6 addr ls 2021-07-26T15:45:26.266 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2021-07-26T15:45:26.266 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: inet6 ::1/128 scope host 2021-07-26T15:45:26.266 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2021-07-26T15:45:26.266 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: 4: ens1f0: mtu 1500 state UP qlen 1000 2021-07-26T15:45:26.267 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2021-07-26T15:45:26.267 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2021-07-26T15:45:26.268 INFO:teuthology.orchestra.run.smithi033.stderr:Mon IP `172.21.15.33` is in CIDR network `172.21.0.0/20` 2021-07-26T15:45:26.268 INFO:teuthology.orchestra.run.smithi033.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2021-07-26T15:45:26.269 INFO:teuthology.orchestra.run.smithi033.stderr:Pulling container image docker.io/ceph/daemon-base:latest-pacific... 2021-07-26T15:45:26.269 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker pull docker.io/ceph/daemon-base:latest-pacific 2021-07-26T15:45:27.021 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: latest-pacific: Pulling from ceph/daemon-base 2021-07-26T15:45:27.022 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: 7a0437f04f83: Pulling fs layer 2021-07-26T15:45:27.022 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: abe80a0369f6: Pulling fs layer 2021-07-26T15:45:27.525 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: 7a0437f04f83: Verifying Checksum 2021-07-26T15:45:27.526 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: 7a0437f04f83: Download complete 2021-07-26T15:45:29.430 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: abe80a0369f6: Verifying Checksum 2021-07-26T15:45:29.430 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: abe80a0369f6: Download complete 2021-07-26T15:45:30.395 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: 7a0437f04f83: Pull complete 2021-07-26T15:45:42.523 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: abe80a0369f6: Pull complete 2021-07-26T15:45:42.681 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: Digest: sha256:f444ee30cf9341da1538df4151fd6e686f159bfec03dbfd6c4e0e84c41185146 2021-07-26T15:45:42.739 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: Status: Downloaded newer image for ceph/daemon-base:latest-pacific 2021-07-26T15:45:42.767 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/docker: docker.io/ceph/daemon-base:latest-pacific 2021-07-26T15:45:42.772 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/daemon-base:latest-pacific --version 2021-07-26T15:45:55.629 INFO:teuthology.orchestra.run.smithi033.stderr:ceph: ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable) 2021-07-26T15:45:56.220 INFO:teuthology.orchestra.run.smithi033.stderr:Ceph version: ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable) 2021-07-26T15:45:56.220 INFO:teuthology.orchestra.run.smithi033.stderr:Extracting ceph user uid/gid from container image... 2021-07-26T15:45:56.220 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint stat --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/daemon-base:latest-pacific -c %u %g /var/lib/ceph 2021-07-26T15:45:57.377 INFO:teuthology.orchestra.run.smithi033.stderr:stat: 167 167 2021-07-26T15:45:57.989 INFO:teuthology.orchestra.run.smithi033.stderr:Creating initial keys... 2021-07-26T15:45:57.989 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/daemon-base:latest-pacific --gen-print-key 2021-07-26T15:45:59.024 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-authtool: AQC32P5glwWXARAAgysWB9QQ+dA0m2Jjs0EeTw== 2021-07-26T15:45:59.620 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/daemon-base:latest-pacific --gen-print-key 2021-07-26T15:46:00.659 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-authtool: AQC42P5gurRlJxAA31E1Lo97ZWfy7sYPSTN01g== 2021-07-26T15:46:01.266 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/daemon-base:latest-pacific --gen-print-key 2021-07-26T15:46:02.306 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-authtool: AQC62P5gV+hgEhAAm+iwjWl5Q2jj/AxpGp2zhA== 2021-07-26T15:46:02.832 INFO:teuthology.orchestra.run.smithi033.stderr:Creating initial monmap... 2021-07-26T15:46:02.833 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmp6yfbk789:/tmp/monmap:z docker.io/ceph/daemon-base:latest-pacific --create --clobber --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c --addv a [v2:172.21.15.33:3300,v1:172.21.15.33:6789] /tmp/monmap 2021-07-26T15:46:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2021-07-26T15:46:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-07-26T15:46:04.553 INFO:teuthology.orchestra.run.smithi033.stderr:monmaptool for a [v2:172.21.15.33:3300,v1:172.21.15.33:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2021-07-26T15:46:04.553 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: set fsid to 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:04.554 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-07-26T15:46:04.554 INFO:teuthology.orchestra.run.smithi033.stderr: 2021-07-26T15:46:04.555 INFO:teuthology.orchestra.run.smithi033.stderr:Creating mon... 2021-07-26T15:46:04.555 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp11x5n28s:/tmp/keyring:z -v /tmp/ceph-tmp6yfbk789:/tmp/monmap:z docker.io/ceph/daemon-base:latest-pacific --mkfs -i a --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-07-26T15:46:05.589 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 0 set uid:gid to 167:167 (ceph:ceph) 2021-07-26T15:46:05.589 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 1 imported monmap: 2021-07-26T15:46:05.590 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: epoch 0 2021-07-26T15:46:05.590 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:05.590 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: last_changed 2021-07-26T15:46:03.938435+0000 2021-07-26T15:46:05.590 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: created 2021-07-26T15:46:03.938435+0000 2021-07-26T15:46:05.590 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2021-07-26T15:46:05.591 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: election_strategy: 1 2021-07-26T15:46:05.591 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2021-07-26T15:46:05.591 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.591 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 0 /usr/bin/ceph-mon: set fsid to 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: RocksDB version: 6.8.1 2021-07-26T15:46:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-07-26T15:46:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Compile date Jul 8 2021 2021-07-26T15:46:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: DB SUMMARY 2021-07-26T15:46:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-07-26T15:46:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.641 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-07-26T15:46:05.641 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.641 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.error_if_exists: 0 2021-07-26T15:46:05.641 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.create_if_missing: 1 2021-07-26T15:46:05.642 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.paranoid_checks: 1 2021-07-26T15:46:05.643 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.env: 0x556b664661c0 2021-07-26T15:46:05.643 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.fs: Posix File System 2021-07-26T15:46:05.643 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.info_log: 0x556b671eef00 2021-07-26T15:46:05.643 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.max_file_opening_threads: 16 2021-07-26T15:46:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.statistics: (nil) 2021-07-26T15:46:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.use_fsync: 0 2021-07-26T15:46:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.max_log_file_size: 0 2021-07-26T15:46:05.646 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-07-26T15:46:05.646 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-07-26T15:46:05.646 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.keep_log_file_num: 1000 2021-07-26T15:46:05.646 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.recycle_log_file_num: 0 2021-07-26T15:46:05.647 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.allow_fallocate: 1 2021-07-26T15:46:05.647 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.allow_mmap_reads: 0 2021-07-26T15:46:05.647 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.allow_mmap_writes: 0 2021-07-26T15:46:05.647 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.use_direct_reads: 0 2021-07-26T15:46:05.647 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-07-26T15:46:05.648 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.create_missing_column_families: 0 2021-07-26T15:46:05.649 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.db_log_dir: 2021-07-26T15:46:05.649 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-07-26T15:46:05.649 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-07-26T15:46:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.max_subcompactions: 1 2021-07-26T15:46:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.max_background_flushes: -1 2021-07-26T15:46:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-07-26T15:46:05.650 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-07-26T15:46:05.651 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-07-26T15:46:05.651 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-07-26T15:46:05.651 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-07-26T15:46:05.651 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.advise_random_on_open: 1 2021-07-26T15:46:05.651 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.db_write_buffer_size: 0 2021-07-26T15:46:05.652 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.write_buffer_manager: 0x556b671f7500 2021-07-26T15:46:05.652 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-07-26T15:46:05.652 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-07-26T15:46:05.653 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-07-26T15:46:05.653 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-07-26T15:46:05.654 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.rate_limiter: (nil) 2021-07-26T15:46:05.654 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-07-26T15:46:05.654 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.wal_recovery_mode: 2 2021-07-26T15:46:05.655 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.enable_thread_tracking: 0 2021-07-26T15:46:05.655 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.enable_pipelined_write: 0 2021-07-26T15:46:05.655 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.unordered_write: 0 2021-07-26T15:46:05.655 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-07-26T15:46:05.656 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-07-26T15:46:05.656 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-07-26T15:46:05.656 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-07-26T15:46:05.656 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.row_cache: None 2021-07-26T15:46:05.656 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.wal_filter: None 2021-07-26T15:46:05.657 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-07-26T15:46:05.657 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.allow_ingest_behind: 0 2021-07-26T15:46:05.657 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.preserve_deletes: 0 2021-07-26T15:46:05.657 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.two_write_queues: 0 2021-07-26T15:46:05.658 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.manual_wal_flush: 0 2021-07-26T15:46:05.658 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.atomic_flush: 0 2021-07-26T15:46:05.658 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-07-26T15:46:05.658 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-07-26T15:46:05.659 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-07-26T15:46:05.659 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.log_readahead_size: 0 2021-07-26T15:46:05.659 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-07-26T15:46:05.659 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.max_background_jobs: 2 2021-07-26T15:46:05.659 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.max_background_compactions: -1 2021-07-26T15:46:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-07-26T15:46:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-07-26T15:46:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-07-26T15:46:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.max_total_wal_size: 0 2021-07-26T15:46:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-07-26T15:46:05.661 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-07-26T15:46:05.661 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-07-26T15:46:05.661 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-07-26T15:46:05.661 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.max_open_files: -1 2021-07-26T15:46:05.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.bytes_per_sync: 0 2021-07-26T15:46:05.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-07-26T15:46:05.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-07-26T15:46:05.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Options.compaction_readahead_size: 0 2021-07-26T15:46:05.662 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Compression algorithms supported: 2021-07-26T15:46:05.663 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-07-26T15:46:05.663 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: kZSTD supported: 0 2021-07-26T15:46:05.663 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: kXpressCompression supported: 0 2021-07-26T15:46:05.663 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: kLZ4HCCompression supported: 1 2021-07-26T15:46:05.664 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: kLZ4Compression supported: 1 2021-07-26T15:46:05.664 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: kBZip2Compression supported: 0 2021-07-26T15:46:05.664 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: kZlibCompression supported: 1 2021-07-26T15:46:05.665 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: kSnappyCompression supported: 1 2021-07-26T15:46:05.665 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.587+0000 7fd84ee74700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-07-26T15:46:05.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2021-07-26T15:46:05.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-07-26T15:46:05.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.666 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-07-26T15:46:05.667 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.667 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-07-26T15:46:05.667 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.merge_operator: 2021-07-26T15:46:05.667 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_filter: None 2021-07-26T15:46:05.668 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_filter_factory: None 2021-07-26T15:46:05.668 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-07-26T15:46:05.668 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-07-26T15:46:05.668 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556b67106160) 2021-07-26T15:46:05.668 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2021-07-26T15:46:05.669 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2021-07-26T15:46:05.669 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2021-07-26T15:46:05.669 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2021-07-26T15:46:05.669 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: index_type: 0 2021-07-26T15:46:05.670 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2021-07-26T15:46:05.670 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: index_shortening: 1 2021-07-26T15:46:05.670 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2021-07-26T15:46:05.670 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2021-07-26T15:46:05.670 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: checksum: 1 2021-07-26T15:46:05.671 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2021-07-26T15:46:05.671 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache: 0x556b6713ed10 2021-07-26T15:46:05.671 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2021-07-26T15:46:05.671 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache_options: 2021-07-26T15:46:05.672 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: capacity : 536870912 2021-07-26T15:46:05.672 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2021-07-26T15:46:05.672 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2021-07-26T15:46:05.672 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2021-07-26T15:46:05.672 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2021-07-26T15:46:05.673 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2021-07-26T15:46:05.673 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_size: 4096 2021-07-26T15:46:05.673 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2021-07-26T15:46:05.673 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2021-07-26T15:46:05.673 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2021-07-26T15:46:05.674 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2021-07-26T15:46:05.674 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: partition_filters: 0 2021-07-26T15:46:05.674 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2021-07-26T15:46:05.674 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2021-07-26T15:46:05.675 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2021-07-26T15:46:05.675 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: verify_compression: 0 2021-07-26T15:46:05.675 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2021-07-26T15:46:05.675 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: format_version: 2 2021-07-26T15:46:05.675 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2021-07-26T15:46:05.676 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: block_align: 0 2021-07-26T15:46:05.676 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.676 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.write_buffer_size: 33554432 2021-07-26T15:46:05.676 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_write_buffer_number: 2 2021-07-26T15:46:05.677 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compression: NoCompression 2021-07-26T15:46:05.677 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.bottommost_compression: Disabled 2021-07-26T15:46:05.677 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.prefix_extractor: nullptr 2021-07-26T15:46:05.677 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-07-26T15:46:05.677 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.num_levels: 7 2021-07-26T15:46:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-07-26T15:46:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-07-26T15:46:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-07-26T15:46:05.678 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-07-26T15:46:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-07-26T15:46:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-07-26T15:46:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-07-26T15:46:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:46:05.679 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-07-26T15:46:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-07-26T15:46:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compression_opts.level: 32767 2021-07-26T15:46:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compression_opts.strategy: 0 2021-07-26T15:46:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-07-26T15:46:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:46:05.681 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compression_opts.enabled: false 2021-07-26T15:46:05.681 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-07-26T15:46:05.681 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-07-26T15:46:05.681 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-07-26T15:46:05.682 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.target_file_size_base: 67108864 2021-07-26T15:46:05.682 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-07-26T15:46:05.682 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-07-26T15:46:05.682 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-07-26T15:46:05.682 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-07-26T15:46:05.683 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-07-26T15:46:05.683 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-07-26T15:46:05.683 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-07-26T15:46:05.683 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-07-26T15:46:05.684 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-07-26T15:46:05.684 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-07-26T15:46:05.684 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-07-26T15:46:05.684 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-07-26T15:46:05.684 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-07-26T15:46:05.685 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.arena_block_size: 4194304 2021-07-26T15:46:05.685 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-07-26T15:46:05.685 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-07-26T15:46:05.685 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-07-26T15:46:05.686 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.disable_auto_compactions: 0 2021-07-26T15:46:05.686 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-07-26T15:46:05.686 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-07-26T15:46:05.686 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-07-26T15:46:05.686 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-07-26T15:46:05.687 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-07-26T15:46:05.687 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-07-26T15:46:05.687 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-07-26T15:46:05.687 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-07-26T15:46:05.688 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-07-26T15:46:05.688 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-07-26T15:46:05.688 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.table_properties_collectors: 2021-07-26T15:46:05.688 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.inplace_update_support: 0 2021-07-26T15:46:05.688 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-07-26T15:46:05.689 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-07-26T15:46:05.689 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-07-26T15:46:05.689 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-07-26T15:46:05.690 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.bloom_locality: 0 2021-07-26T15:46:05.690 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.max_successive_merges: 0 2021-07-26T15:46:05.690 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-07-26T15:46:05.690 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.paranoid_file_checks: 0 2021-07-26T15:46:05.691 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.force_consistency_checks: 0 2021-07-26T15:46:05.691 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.report_bg_io_stats: 0 2021-07-26T15:46:05.691 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.ttl: 2592000 2021-07-26T15:46:05.691 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.591+0000 7fd84ee74700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-07-26T15:46:05.691 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.599+0000 7fd84ee74700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-07-26T15:46:05.692 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.692 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.599+0000 7fd84ee74700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-07-26T15:46:05.692 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.692 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.599+0000 7fd84ee74700 4 rocksdb: DB pointer 0x556b67203800 2021-07-26T15:46:05.693 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.599+0000 7fd837cfd700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-07-26T15:46:05.693 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.599+0000 7fd837cfd700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-07-26T15:46:05.693 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2021-07-26T15:46:05.693 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:46:05.693 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-07-26T15:46:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-07-26T15:46:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:46:05.694 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-07-26T15:46:05.695 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-07-26T15:46:05.695 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:46:05.695 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.696 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-07-26T15:46:05.696 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:46:05.696 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:46:05.696 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:46:05.696 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:46:05.697 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.697 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-07-26T15:46:05.697 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:46:05.697 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:46:05.698 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:46:05.699 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-07-26T15:46:05.699 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:46:05.699 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:46:05.700 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:46:05.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:46:05.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:46:05.701 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:46:05.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:46:05.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:46:05.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.702 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-07-26T15:46:05.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:46:05.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:46:05.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:46:05.703 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:46:05.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-07-26T15:46:05.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:46:05.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:46:05.704 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:46:05.705 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-07-26T15:46:05.705 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:46:05.705 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:46:05.706 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:46:05.706 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:46:05.706 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:46:05.706 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:46:05.706 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:46:05.707 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.707 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:46:05.707 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: 2021-07-26T15:46:05.707 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.603+0000 7fd84ee74700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2021-07-26T15:46:05.707 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.603+0000 7fd84ee74700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2021-07-26T15:46:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph-mon: debug 2021-07-26T15:46:05.603+0000 7fd84ee74700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-07-26T15:46:06.135 INFO:teuthology.orchestra.run.smithi033.stderr:create mon.a on 2021-07-26T15:46:06.136 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:06.143 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl disable ceph.target 2021-07-26T15:46:06.156 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2021-07-26T15:46:06.366 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph.target 2021-07-26T15:46:06.375 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2021-07-26T15:46:06.561 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph.target 2021-07-26T15:46:06.569 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph-7e62724e-ee28-11eb-8c23-001a4aab830c.target 2021-07-26T15:46:06.575 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7e62724e-ee28-11eb-8c23-001a4aab830c.target -> /etc/systemd/system/ceph-7e62724e-ee28-11eb-8c23-001a4aab830c.target. 2021-07-26T15:46:06.576 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-7e62724e-ee28-11eb-8c23-001a4aab830c.target -> /etc/systemd/system/ceph-7e62724e-ee28-11eb-8c23-001a4aab830c.target. 2021-07-26T15:46:06.775 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph-7e62724e-ee28-11eb-8c23-001a4aab830c.target 2021-07-26T15:46:06.783 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl daemon-reload 2021-07-26T15:46:06.969 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl stop ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.a 2021-07-26T15:46:06.982 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl reset-failed ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.a 2021-07-26T15:46:06.987 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to reset failed state of unit ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.a.service: Unit ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.a.service not loaded. 2021-07-26T15:46:06.988 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.a 2021-07-26T15:46:06.996 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/ceph-7e62724e-ee28-11eb-8c23-001a4aab830c.target.wants/ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@.service. 2021-07-26T15:46:07.186 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.a 2021-07-26T15:46:07.198 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld does not appear to be present 2021-07-26T15:46:07.199 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to enable service . firewalld.service is not available 2021-07-26T15:46:07.199 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mon to start... 2021-07-26T15:46:07.200 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mon... 2021-07-26T15:46:07.200 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific status 2021-07-26T15:46:07.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:07 smithi033 bash[14358]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:46:09.364 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: cluster: 2021-07-26T15:46:09.364 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: id: 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:09.364 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: health: HEALTH_OK 2021-07-26T15:46:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: services: 2021-07-26T15:46:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.283226s) 2021-07-26T15:46:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mgr: no daemons active 2021-07-26T15:46:09.365 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2021-07-26T15:46:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: data: 2021-07-26T15:46:09.366 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2021-07-26T15:46:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2021-07-26T15:46:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2021-07-26T15:46:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: pgs: 2021-07-26T15:46:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:09.391 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:09 smithi033 bash[14358]: cluster 2021-07-26T15:46:09.081256+0000 mon.a (mon.0) 0 : [INF] mkfs 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:09.391 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:09 smithi033 bash[14358]: cluster 2021-07-26T15:46:09.075308+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-07-26T15:46:10.005 INFO:teuthology.orchestra.run.smithi033.stderr:mon is available 2021-07-26T15:46:10.007 INFO:teuthology.orchestra.run.smithi033.stderr:Assimilating anything we can from ceph.conf... 2021-07-26T15:46:10.007 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z -v /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z docker.io/ceph/daemon-base:latest-pacific config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-07-26T15:46:10.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:10 smithi033 bash[14358]: cluster 2021-07-26T15:46:09.079782+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-07-26T15:46:10.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:10 smithi033 bash[14358]: cluster 2021-07-26T15:46:09.080049+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0]} 2021-07-26T15:46:10.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:10 smithi033 bash[14358]: cluster 2021-07-26T15:46:09.083318+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-07-26T15:46:10.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:10 smithi033 bash[14358]: cluster 2021-07-26T15:46:09.088379+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-07-26T15:46:10.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:10 smithi033 bash[14358]: cluster 2021-07-26T15:46:09.089477+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-07-26T15:46:10.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:10 smithi033 bash[14358]: audit 2021-07-26T15:46:09.362943+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.33:0/2508156311' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-07-26T15:46:11.382 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:11.383 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [global] 2021-07-26T15:46:11.383 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: fsid = 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:11.384 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: log_to_journald = false 2021-07-26T15:46:11.384 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.33:3300,v1:172.21.15.33:6789] 2021-07-26T15:46:11.384 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-07-26T15:46:11.385 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-07-26T15:46:11.386 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-07-26T15:46:11.386 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-07-26T15:46:11.386 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:11.386 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [mgr] 2021-07-26T15:46:11.387 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-07-26T15:46:11.387 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:11.387 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [osd] 2021-07-26T15:46:11.387 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-07-26T15:46:11.388 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-07-26T15:46:11.703 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:11 smithi033 bash[14358]: audit 2021-07-26T15:46:11.377272+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.33:0/3687519025' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-07-26T15:46:11.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:11 smithi033 bash[14358]: audit 2021-07-26T15:46:11.383468+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.33:0/3687519025' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-07-26T15:46:11.986 INFO:teuthology.orchestra.run.smithi033.stderr:Generating new minimal ceph.conf... 2021-07-26T15:46:11.986 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z -v /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z docker.io/ceph/daemon-base:latest-pacific config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-07-26T15:46:13.604 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:13 smithi033 bash[14358]: audit 2021-07-26T15:46:13.319301+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.33:0/3680181979' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:46:14.025 INFO:teuthology.orchestra.run.smithi033.stderr:Restarting the monitor... 2021-07-26T15:46:14.025 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl restart ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.a 2021-07-26T15:46:14.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:14 smithi033 systemd[1]: Stopping Ceph mon.a for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T15:46:14.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:14 smithi033 docker[14727]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:46:14.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:14 smithi033 bash[14358]: debug 2021-07-26T15:46:14.279+0000 7f1dbf100700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2021-07-26T15:46:14.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:14 smithi033 bash[14358]: debug 2021-07-26T15:46:14.279+0000 7f1dbf100700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-07-26T15:46:15.150 INFO:teuthology.orchestra.run.smithi033.stderr:Setting mon public_network to 172.21.0.0/20 2021-07-26T15:46:15.150 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific config set mon public_network 172.21.0.0/20 2021-07-26T15:46:15.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:15 smithi033 docker[14727]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-mon.a 2021-07-26T15:46:15.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:15 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.a.service: Succeeded. 2021-07-26T15:46:15.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:15 smithi033 systemd[1]: Stopped Ceph mon.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:46:15.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:15 smithi033 systemd[1]: Started Ceph mon.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:46:15.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:15 smithi033 bash[14790]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:46:16.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.963+0000 7fbcdf142700 0 set uid:gid to 167:167 (ceph:ceph) 2021-07-26T15:46:16.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.963+0000 7fbcdf142700 0 ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable), process ceph-mon, pid 7 2021-07-26T15:46:16.985 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.963+0000 7fbcdf142700 0 pidfile_write: ignore empty --pid-file 2021-07-26T15:46:16.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 0 load: jerasure load: lrc load: isa 2021-07-26T15:46:16.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: RocksDB version: 6.8.1 2021-07-26T15:46:16.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-07-26T15:46:16.986 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Compile date Jul 8 2021 2021-07-26T15:46:16.987 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: DB SUMMARY 2021-07-26T15:46:16.987 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: CURRENT file: CURRENT 2021-07-26T15:46:16.987 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: IDENTITY file: IDENTITY 2021-07-26T15:46:16.987 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2021-07-26T15:46:16.988 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-07-26T15:46:16.988 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 86536 ; 2021-07-26T15:46:16.988 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.error_if_exists: 0 2021-07-26T15:46:16.988 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.create_if_missing: 0 2021-07-26T15:46:16.988 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.paranoid_checks: 1 2021-07-26T15:46:16.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.env: 0x55ec7db4c1c0 2021-07-26T15:46:16.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.fs: Posix File System 2021-07-26T15:46:16.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.info_log: 0x55ec7ea83e20 2021-07-26T15:46:16.989 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_file_opening_threads: 16 2021-07-26T15:46:16.990 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.statistics: (nil) 2021-07-26T15:46:16.990 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.use_fsync: 0 2021-07-26T15:46:16.990 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_log_file_size: 0 2021-07-26T15:46:16.990 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-07-26T15:46:16.990 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-07-26T15:46:16.991 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.keep_log_file_num: 1000 2021-07-26T15:46:16.991 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.recycle_log_file_num: 0 2021-07-26T15:46:16.991 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.allow_fallocate: 1 2021-07-26T15:46:16.991 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.allow_mmap_reads: 0 2021-07-26T15:46:16.992 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.allow_mmap_writes: 0 2021-07-26T15:46:16.992 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.use_direct_reads: 0 2021-07-26T15:46:16.992 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-07-26T15:46:16.992 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.create_missing_column_families: 0 2021-07-26T15:46:16.992 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.db_log_dir: 2021-07-26T15:46:16.993 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-07-26T15:46:16.993 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-07-26T15:46:16.994 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_subcompactions: 1 2021-07-26T15:46:16.995 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_background_flushes: -1 2021-07-26T15:46:16.995 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-07-26T15:46:16.995 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-07-26T15:46:16.995 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-07-26T15:46:16.996 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-07-26T15:46:16.996 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-07-26T15:46:16.996 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.advise_random_on_open: 1 2021-07-26T15:46:16.996 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.db_write_buffer_size: 0 2021-07-26T15:46:16.997 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.write_buffer_manager: 0x55ec7eb1bf80 2021-07-26T15:46:16.997 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-07-26T15:46:16.997 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-07-26T15:46:16.997 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-07-26T15:46:16.998 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-07-26T15:46:16.998 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.rate_limiter: (nil) 2021-07-26T15:46:16.998 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-07-26T15:46:16.999 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.wal_recovery_mode: 2 2021-07-26T15:46:16.999 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.enable_thread_tracking: 0 2021-07-26T15:46:16.999 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.enable_pipelined_write: 0 2021-07-26T15:46:17.000 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.unordered_write: 0 2021-07-26T15:46:17.000 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-07-26T15:46:17.000 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-07-26T15:46:17.000 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-07-26T15:46:17.001 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-07-26T15:46:17.001 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.row_cache: None 2021-07-26T15:46:17.001 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.wal_filter: None 2021-07-26T15:46:17.001 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-07-26T15:46:17.002 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.allow_ingest_behind: 0 2021-07-26T15:46:17.002 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.preserve_deletes: 0 2021-07-26T15:46:17.002 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.two_write_queues: 0 2021-07-26T15:46:17.002 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.manual_wal_flush: 0 2021-07-26T15:46:17.003 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.atomic_flush: 0 2021-07-26T15:46:17.003 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-07-26T15:46:17.003 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-07-26T15:46:17.003 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-07-26T15:46:17.003 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.log_readahead_size: 0 2021-07-26T15:46:17.004 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-07-26T15:46:17.004 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_background_jobs: 2 2021-07-26T15:46:17.004 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_background_compactions: -1 2021-07-26T15:46:17.004 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-07-26T15:46:17.004 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-07-26T15:46:17.005 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-07-26T15:46:17.006 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_total_wal_size: 0 2021-07-26T15:46:17.007 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-07-26T15:46:17.007 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-07-26T15:46:17.007 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-07-26T15:46:17.007 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-07-26T15:46:17.008 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_open_files: -1 2021-07-26T15:46:17.009 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.bytes_per_sync: 0 2021-07-26T15:46:17.009 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-07-26T15:46:17.009 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-07-26T15:46:17.009 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_readahead_size: 0 2021-07-26T15:46:17.010 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Compression algorithms supported: 2021-07-26T15:46:17.010 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-07-26T15:46:17.010 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: kZSTD supported: 0 2021-07-26T15:46:17.010 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: kXpressCompression supported: 0 2021-07-26T15:46:17.011 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: kLZ4HCCompression supported: 1 2021-07-26T15:46:17.011 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: kLZ4Compression supported: 1 2021-07-26T15:46:17.011 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: kBZip2Compression supported: 0 2021-07-26T15:46:17.011 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: kZlibCompression supported: 1 2021-07-26T15:46:17.011 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: kSnappyCompression supported: 1 2021-07-26T15:46:17.012 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-07-26T15:46:17.012 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-07-26T15:46:17.012 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-07-26T15:46:17.012 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-07-26T15:46:17.013 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.merge_operator: 2021-07-26T15:46:17.013 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_filter: None 2021-07-26T15:46:17.013 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_filter_factory: None 2021-07-26T15:46:17.013 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-07-26T15:46:17.013 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-07-26T15:46:17.014 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ec7ea2a170) 2021-07-26T15:46:17.014 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: cache_index_and_filter_blocks: 1 2021-07-26T15:46:17.014 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: cache_index_and_filter_blocks_with_high_priority: 0 2021-07-26T15:46:17.014 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-07-26T15:46:17.015 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: pin_top_level_index_and_filter: 1 2021-07-26T15:46:17.015 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: index_type: 0 2021-07-26T15:46:17.015 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: data_block_index_type: 0 2021-07-26T15:46:17.015 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: index_shortening: 1 2021-07-26T15:46:17.015 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: data_block_hash_table_util_ratio: 0.750000 2021-07-26T15:46:17.016 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: hash_index_allow_collision: 1 2021-07-26T15:46:17.016 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: checksum: 1 2021-07-26T15:46:17.016 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: no_block_cache: 0 2021-07-26T15:46:17.016 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: block_cache: 0x55ec7ea62f10 2021-07-26T15:46:17.016 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: block_cache_name: BinnedLRUCache 2021-07-26T15:46:17.017 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: block_cache_options: 2021-07-26T15:46:17.017 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: capacity : 536870912 2021-07-26T15:46:17.017 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: num_shard_bits : 4 2021-07-26T15:46:17.017 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: strict_capacity_limit : 0 2021-07-26T15:46:17.018 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: high_pri_pool_ratio: 0.000 2021-07-26T15:46:17.018 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: block_cache_compressed: (nil) 2021-07-26T15:46:17.018 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: persistent_cache: (nil) 2021-07-26T15:46:17.019 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: block_size: 4096 2021-07-26T15:46:17.019 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: block_size_deviation: 10 2021-07-26T15:46:17.019 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: block_restart_interval: 16 2021-07-26T15:46:17.019 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: index_block_restart_interval: 1 2021-07-26T15:46:17.019 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: metadata_block_size: 4096 2021-07-26T15:46:17.020 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: partition_filters: 0 2021-07-26T15:46:17.020 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: use_delta_encoding: 1 2021-07-26T15:46:17.020 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: filter_policy: rocksdb.BuiltinBloomFilter 2021-07-26T15:46:17.020 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: whole_key_filtering: 1 2021-07-26T15:46:17.020 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: verify_compression: 0 2021-07-26T15:46:17.021 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: read_amp_bytes_per_bit: 0 2021-07-26T15:46:17.021 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: format_version: 2 2021-07-26T15:46:17.021 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: enable_index_compression: 1 2021-07-26T15:46:17.021 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: block_align: 0 2021-07-26T15:46:17.022 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.write_buffer_size: 33554432 2021-07-26T15:46:17.022 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_write_buffer_number: 2 2021-07-26T15:46:17.022 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compression: NoCompression 2021-07-26T15:46:17.022 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.bottommost_compression: Disabled 2021-07-26T15:46:17.022 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.prefix_extractor: nullptr 2021-07-26T15:46:17.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-07-26T15:46:17.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.num_levels: 7 2021-07-26T15:46:17.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-07-26T15:46:17.023 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-07-26T15:46:17.024 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-07-26T15:46:17.024 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-07-26T15:46:17.024 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-07-26T15:46:17.024 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-07-26T15:46:17.024 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-07-26T15:46:17.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:46:17.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-07-26T15:46:17.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-07-26T15:46:17.025 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compression_opts.level: 32767 2021-07-26T15:46:17.027 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compression_opts.strategy: 0 2021-07-26T15:46:17.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-07-26T15:46:17.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:46:17.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compression_opts.enabled: false 2021-07-26T15:46:17.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-07-26T15:46:17.028 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-07-26T15:46:17.029 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-07-26T15:46:17.029 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.target_file_size_base: 67108864 2021-07-26T15:46:17.029 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-07-26T15:46:17.029 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-07-26T15:46:17.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-07-26T15:46:17.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-07-26T15:46:17.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-07-26T15:46:17.030 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-07-26T15:46:17.031 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-07-26T15:46:17.031 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-07-26T15:46:17.035 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-07-26T15:46:17.035 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-07-26T15:46:17.035 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-07-26T15:46:17.036 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-07-26T15:46:17.036 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-07-26T15:46:17.036 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.arena_block_size: 4194304 2021-07-26T15:46:17.037 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-07-26T15:46:17.037 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-07-26T15:46:17.038 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-07-26T15:46:17.038 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.disable_auto_compactions: 0 2021-07-26T15:46:17.038 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-07-26T15:46:17.038 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-07-26T15:46:17.039 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-07-26T15:46:17.039 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-07-26T15:46:17.040 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-07-26T15:46:17.040 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-07-26T15:46:17.040 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-07-26T15:46:17.040 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-07-26T15:46:17.041 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-07-26T15:46:17.041 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-07-26T15:46:17.041 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.table_properties_collectors: 2021-07-26T15:46:17.042 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.inplace_update_support: 0 2021-07-26T15:46:17.042 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-07-26T15:46:17.042 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-07-26T15:46:17.042 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-07-26T15:46:17.043 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-07-26T15:46:17.043 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.bloom_locality: 0 2021-07-26T15:46:17.043 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.max_successive_merges: 0 2021-07-26T15:46:17.043 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-07-26T15:46:17.043 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.paranoid_file_checks: 0 2021-07-26T15:46:17.044 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.force_consistency_checks: 0 2021-07-26T15:46:17.044 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.report_bg_io_stats: 0 2021-07-26T15:46:17.044 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.ttl: 2592000 2021-07-26T15:46:17.044 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-07-26T15:46:17.045 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-07-26T15:46:17.045 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2021-07-26T15:46:17.045 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627314376973586, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-07-26T15:46:17.045 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2021-07-26T15:46:17.046 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.971+0000 7fbcdf142700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-07-26T15:46:17.046 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.975+0000 7fbcdf142700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627314376979297, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 82896, "table_properties": {"data_size": 81165, "index_size": 336, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 9730, "raw_average_key_size": 47, "raw_value_size": 75578, "raw_average_value_size": 368, "num_data_blocks": 11, "num_entries": 205, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1627314376, "oldest_key_time": 3, "file_creation_time": 0}} 2021-07-26T15:46:17.046 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.975+0000 7fbcdf142700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2021-07-26T15:46:17.046 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.979+0000 7fbcdf142700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627314376979926, "job": 1, "event": "recovery_finished"} 2021-07-26T15:46:17.047 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.979+0000 7fbcdf142700 4 rocksdb: DB pointer 0x55ec7eb27800 2021-07-26T15:46:17.047 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.979+0000 7fbcc5f4a700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-07-26T15:46:17.047 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.979+0000 7fbcc5f4a700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-07-26T15:46:17.047 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: ** DB Stats ** 2021-07-26T15:46:17.048 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:46:17.048 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-07-26T15:46:17.049 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-07-26T15:46:17.049 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:46:17.049 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-07-26T15:46:17.049 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-07-26T15:46:17.050 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:46:17.050 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: ** Compaction Stats [default] ** 2021-07-26T15:46:17.051 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:46:17.051 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:46:17.051 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: L0 2/0 82.61 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 15.0 0.01 0.00 1 0.005 0 0 2021-07-26T15:46:17.051 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Sum 2/0 82.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 15.0 0.01 0.00 1 0.005 0 0 2021-07-26T15:46:17.052 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 15.0 0.01 0.00 1 0.005 0 0 2021-07-26T15:46:17.052 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: ** Compaction Stats [default] ** 2021-07-26T15:46:17.052 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:46:17.052 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:46:17.053 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 15.0 0.01 0.00 1 0.005 0 0 2021-07-26T15:46:17.053 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:46:17.053 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Flush(GB): cumulative 0.000, interval 0.000 2021-07-26T15:46:17.053 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:46:17.054 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:46:17.054 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:46:17.054 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:46:17.054 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Cumulative compaction: 0.00 GB write, 8.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:46:17.055 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Interval compaction: 0.00 GB write, 8.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:46:17.055 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:46:17.055 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:46:17.055 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: ** Compaction Stats [default] ** 2021-07-26T15:46:17.055 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:46:17.056 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:46:17.056 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: L0 2/0 82.61 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 15.0 0.01 0.00 1 0.005 0 0 2021-07-26T15:46:17.056 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Sum 2/0 82.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 15.0 0.01 0.00 1 0.005 0 0 2021-07-26T15:46:17.056 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:46:17.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: ** Compaction Stats [default] ** 2021-07-26T15:46:17.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:46:17.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:46:17.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 15.0 0.01 0.00 1 0.005 0 0 2021-07-26T15:46:17.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:46:17.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Flush(GB): cumulative 0.000, interval 0.000 2021-07-26T15:46:17.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:46:17.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:46:17.059 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:46:17.059 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:46:17.059 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Cumulative compaction: 0.00 GB write, 8.59 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:46:17.059 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:46:17.060 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:46:17.061 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:46:17.061 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.983+0000 7fbcdf142700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:17.062 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.983+0000 7fbcdf142700 1 mon.a@-1(???) e1 preinit fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:17.062 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.983+0000 7fbcdf142700 0 mon.a@-1(???).mds e1 new map 2021-07-26T15:46:17.063 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.983+0000 7fbcdf142700 0 mon.a@-1(???).mds e1 print_map 2021-07-26T15:46:17.063 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: e1 2021-07-26T15:46:17.063 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: enable_multiple, ever_enabled_multiple: 1,1 2021-07-26T15:46:17.064 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-07-26T15:46:17.064 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: legacy client fscid: -1 2021-07-26T15:46:17.064 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: 2021-07-26T15:46:17.065 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: No filesystems configured 2021-07-26T15:46:17.065 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.983+0000 7fbcdf142700 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-07-26T15:46:17.065 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.983+0000 7fbcdf142700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-07-26T15:46:17.065 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.983+0000 7fbcdf142700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-07-26T15:46:17.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.983+0000 7fbcdf142700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-07-26T15:46:17.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: audit 2021-07-26T15:46:13.319301+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.33:0/3680181979' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:46:17.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:16 smithi033 bash[14790]: debug 2021-07-26T15:46:16.983+0000 7fbcdf142700 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-07-26T15:46:17.353 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:17 smithi033 bash[14790]: cluster 2021-07-26T15:46:16.990255+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-07-26T15:46:17.353 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:17 smithi033 bash[14790]: cluster 2021-07-26T15:46:16.990328+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0]} 2021-07-26T15:46:17.354 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:17 smithi033 bash[14790]: cluster 2021-07-26T15:46:16.990394+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-07-26T15:46:17.354 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:17 smithi033 bash[14790]: cluster 2021-07-26T15:46:16.990437+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-07-26T15:46:17.354 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:17 smithi033 bash[14790]: cluster 2021-07-26T15:46:16.990867+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-07-26T15:46:17.826 INFO:teuthology.orchestra.run.smithi033.stderr:Wrote config to /etc/ceph/ceph.conf 2021-07-26T15:46:17.827 INFO:teuthology.orchestra.run.smithi033.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-07-26T15:46:17.827 INFO:teuthology.orchestra.run.smithi033.stderr:Creating mgr... 2021-07-26T15:46:17.827 INFO:teuthology.orchestra.run.smithi033.stderr:Verifying port 9283 ... 2021-07-26T15:46:17.830 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl daemon-reload 2021-07-26T15:46:18.049 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl stop ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.y 2021-07-26T15:46:18.061 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl reset-failed ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.y 2021-07-26T15:46:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Failed to reset failed state of unit ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.y.service: Unit ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.y.service not loaded. 2021-07-26T15:46:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl enable ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.y 2021-07-26T15:46:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:systemctl: Created symlink /etc/systemd/system/ceph-7e62724e-ee28-11eb-8c23-001a4aab830c.target.wants/ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@.service. 2021-07-26T15:46:18.281 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: systemctl start ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.y 2021-07-26T15:46:18.295 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld does not appear to be present 2021-07-26T15:46:18.295 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to enable service . firewalld.service is not available 2021-07-26T15:46:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld does not appear to be present 2021-07-26T15:46:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2021-07-26T15:46:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr to start... 2021-07-26T15:46:18.296 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr... 2021-07-26T15:46:18.297 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific status -f json-pretty 2021-07-26T15:46:18.377 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:18 smithi033 bash[14790]: audit 2021-07-26T15:46:17.131687+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.33:0/499270942' entity='client.admin' 2021-07-26T15:46:18.703 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:18 smithi033 bash[15053]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:46:20.231 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:20.231 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2021-07-26T15:46:20.232 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsid": "7e62724e-ee28-11eb-8c23-001a4aab830c", 2021-07-26T15:46:20.232 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "health": { 2021-07-26T15:46:20.232 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-07-26T15:46:20.233 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "checks": {}, 2021-07-26T15:46:20.233 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mutes": [] 2021-07-26T15:46:20.233 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:20.233 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-07-26T15:46:20.234 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum": [ 2021-07-26T15:46:20.234 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 0 2021-07-26T15:46:20.234 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2021-07-26T15:46:20.235 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_names": [ 2021-07-26T15:46:20.235 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "a" 2021-07-26T15:46:20.235 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2021-07-26T15:46:20.235 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_age": 3, 2021-07-26T15:46:20.236 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "monmap": { 2021-07-26T15:46:20.236 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:20.236 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2021-07-26T15:46:20.237 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_mons": 1 2021-07-26T15:46:20.237 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:20.237 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osdmap": { 2021-07-26T15:46:20.237 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:20.238 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_osds": 0, 2021-07-26T15:46:20.238 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-07-26T15:46:20.238 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-07-26T15:46:20.239 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-07-26T15:46:20.243 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-07-26T15:46:20.243 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-07-26T15:46:20.243 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:20.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgmap": { 2021-07-26T15:46:20.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-07-26T15:46:20.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-07-26T15:46:20.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pools": 0, 2021-07-26T15:46:20.244 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_objects": 0, 2021-07-26T15:46:20.245 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-07-26T15:46:20.245 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-07-26T15:46:20.245 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-07-26T15:46:20.245 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_total": 0 2021-07-26T15:46:20.246 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:20.246 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsmap": { 2021-07-26T15:46:20.246 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:20.246 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "by_rank": [], 2021-07-26T15:46:20.247 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "up:standby": 0 2021-07-26T15:46:20.247 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:20.247 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap": { 2021-07-26T15:46:20.247 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": false, 2021-07-26T15:46:20.248 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-07-26T15:46:20.248 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modules": [ 2021-07-26T15:46:20.248 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "iostat", 2021-07-26T15:46:20.248 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "nfs", 2021-07-26T15:46:20.249 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "restful" 2021-07-26T15:46:20.249 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2021-07-26T15:46:20.249 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2021-07-26T15:46:20.249 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:20.249 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "servicemap": { 2021-07-26T15:46:20.250 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:20.250 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modified": "2021-07-26T15:46:09.081695+0000", 2021-07-26T15:46:20.250 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2021-07-26T15:46:20.251 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:20.251 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "progress_events": {} 2021-07-26T15:46:20.251 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2021-07-26T15:46:20.703 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:20 smithi033 bash[14790]: audit 2021-07-26T15:46:20.227856+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.33:0/2160289763' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-07-26T15:46:20.815 INFO:teuthology.orchestra.run.smithi033.stderr:mgr not available, waiting (1/15)... 2021-07-26T15:46:22.817 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific status -f json-pretty 2021-07-26T15:46:24.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:24.109 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2021-07-26T15:46:24.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsid": "7e62724e-ee28-11eb-8c23-001a4aab830c", 2021-07-26T15:46:24.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "health": { 2021-07-26T15:46:24.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-07-26T15:46:24.110 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "checks": {}, 2021-07-26T15:46:24.111 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mutes": [] 2021-07-26T15:46:24.111 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:24.111 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-07-26T15:46:24.111 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum": [ 2021-07-26T15:46:24.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 0 2021-07-26T15:46:24.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2021-07-26T15:46:24.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_names": [ 2021-07-26T15:46:24.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "a" 2021-07-26T15:46:24.112 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2021-07-26T15:46:24.113 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_age": 7, 2021-07-26T15:46:24.113 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "monmap": { 2021-07-26T15:46:24.113 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:24.114 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2021-07-26T15:46:24.114 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_mons": 1 2021-07-26T15:46:24.114 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:24.114 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osdmap": { 2021-07-26T15:46:24.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:24.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_osds": 0, 2021-07-26T15:46:24.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-07-26T15:46:24.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-07-26T15:46:24.115 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-07-26T15:46:24.121 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-07-26T15:46:24.121 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-07-26T15:46:24.121 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:24.121 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgmap": { 2021-07-26T15:46:24.122 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-07-26T15:46:24.122 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-07-26T15:46:24.122 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pools": 0, 2021-07-26T15:46:24.122 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_objects": 0, 2021-07-26T15:46:24.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-07-26T15:46:24.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-07-26T15:46:24.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-07-26T15:46:24.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_total": 0 2021-07-26T15:46:24.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsmap": { 2021-07-26T15:46:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "by_rank": [], 2021-07-26T15:46:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "up:standby": 0 2021-07-26T15:46:24.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:24.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap": { 2021-07-26T15:46:24.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": false, 2021-07-26T15:46:24.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-07-26T15:46:24.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modules": [ 2021-07-26T15:46:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "iostat", 2021-07-26T15:46:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "nfs", 2021-07-26T15:46:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "restful" 2021-07-26T15:46:24.126 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2021-07-26T15:46:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2021-07-26T15:46:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "servicemap": { 2021-07-26T15:46:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modified": "2021-07-26T15:46:09.081695+0000", 2021-07-26T15:46:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2021-07-26T15:46:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:24.129 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "progress_events": {} 2021-07-26T15:46:24.129 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2021-07-26T15:46:24.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:24 smithi033 bash[14790]: audit 2021-07-26T15:46:24.107384+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.33:0/1229267489' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-07-26T15:46:24.698 INFO:teuthology.orchestra.run.smithi033.stderr:mgr not available, waiting (2/15)... 2021-07-26T15:46:26.701 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific status -f json-pretty 2021-07-26T15:46:26.704 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:26 smithi033 bash[14790]: cluster 2021-07-26T15:46:26.393954+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2021-07-26T15:46:26.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:26 smithi033 bash[14790]: cluster 2021-07-26T15:46:26.401069+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00731643s) 2021-07-26T15:46:26.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:26 smithi033 bash[14790]: audit 2021-07-26T15:46:26.403618+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.33:0/1097931513' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:46:26.706 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:26 smithi033 bash[14790]: audit 2021-07-26T15:46:26.404000+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.33:0/1097931513' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:46:26.707 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:26 smithi033 bash[14790]: audit 2021-07-26T15:46:26.404525+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.33:0/1097931513' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:46:26.707 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:26 smithi033 bash[14790]: audit 2021-07-26T15:46:26.405221+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.33:0/1097931513' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:46:26.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:26 smithi033 bash[14790]: audit 2021-07-26T15:46:26.405841+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.33:0/1097931513' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-07-26T15:46:26.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:26 smithi033 bash[14790]: cluster 2021-07-26T15:46:26.410120+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2021-07-26T15:46:26.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:26 smithi033 bash[14790]: audit 2021-07-26T15:46:26.424183+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.33:0/1097931513' entity='mgr.y' 2021-07-26T15:46:26.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:26 smithi033 bash[14790]: audit 2021-07-26T15:46:26.433559+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.33:0/1097931513' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:46:26.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:26 smithi033 bash[14790]: audit 2021-07-26T15:46:26.436409+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.33:0/1097931513' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:46:27.699 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:27 smithi033 bash[14790]: audit 2021-07-26T15:46:26.447066+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.33:0/1097931513' entity='mgr.y' 2021-07-26T15:46:27.699 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:27 smithi033 bash[14790]: audit 2021-07-26T15:46:26.453834+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.33:0/1097931513' entity='mgr.y' 2021-07-26T15:46:27.699 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:27 smithi033 bash[14790]: cluster 2021-07-26T15:46:27.405941+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.01219s) 2021-07-26T15:46:28.393 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:28.394 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2021-07-26T15:46:28.394 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsid": "7e62724e-ee28-11eb-8c23-001a4aab830c", 2021-07-26T15:46:28.396 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "health": { 2021-07-26T15:46:28.396 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-07-26T15:46:28.396 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "checks": {}, 2021-07-26T15:46:28.396 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mutes": [] 2021-07-26T15:46:28.397 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:28.397 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-07-26T15:46:28.397 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum": [ 2021-07-26T15:46:28.397 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 0 2021-07-26T15:46:28.398 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2021-07-26T15:46:28.398 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_names": [ 2021-07-26T15:46:28.398 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "a" 2021-07-26T15:46:28.398 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2021-07-26T15:46:28.398 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "quorum_age": 11, 2021-07-26T15:46:28.399 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "monmap": { 2021-07-26T15:46:28.399 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:28.399 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2021-07-26T15:46:28.399 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_mons": 1 2021-07-26T15:46:28.400 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:28.400 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osdmap": { 2021-07-26T15:46:28.400 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:28.400 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_osds": 0, 2021-07-26T15:46:28.402 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-07-26T15:46:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-07-26T15:46:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-07-26T15:46:28.410 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-07-26T15:46:28.411 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-07-26T15:46:28.411 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgmap": { 2021-07-26T15:46:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-07-26T15:46:28.413 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-07-26T15:46:28.413 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_pools": 0, 2021-07-26T15:46:28.413 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_objects": 0, 2021-07-26T15:46:28.414 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-07-26T15:46:28.414 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-07-26T15:46:28.415 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-07-26T15:46:28.415 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "bytes_total": 0 2021-07-26T15:46:28.416 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:28.416 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "fsmap": { 2021-07-26T15:46:28.417 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:28.417 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "by_rank": [], 2021-07-26T15:46:28.418 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "up:standby": 0 2021-07-26T15:46:28.418 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:28.418 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap": { 2021-07-26T15:46:28.419 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": true, 2021-07-26T15:46:28.419 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-07-26T15:46:28.420 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modules": [ 2021-07-26T15:46:28.421 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "iostat", 2021-07-26T15:46:28.421 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "nfs", 2021-07-26T15:46:28.421 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "restful" 2021-07-26T15:46:28.421 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ], 2021-07-26T15:46:28.422 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2021-07-26T15:46:28.422 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:28.422 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "servicemap": { 2021-07-26T15:46:28.422 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 1, 2021-07-26T15:46:28.422 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "modified": "2021-07-26T15:46:09.081695+0000", 2021-07-26T15:46:28.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "services": {} 2021-07-26T15:46:28.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: }, 2021-07-26T15:46:28.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "progress_events": {} 2021-07-26T15:46:28.423 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2021-07-26T15:46:28.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:28 smithi033 bash[14790]: audit 2021-07-26T15:46:28.385204+0000 mon.a (mon.0) 23 : audit [DBG] from='client.? 172.21.15.33:0/70420576' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-07-26T15:46:29.033 INFO:teuthology.orchestra.run.smithi033.stderr:mgr is available 2021-07-26T15:46:29.034 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z -v /tmp/tmpyc341ism:/var/lib/ceph/user.conf:z docker.io/ceph/daemon-base:latest-pacific config assimilate-conf -i /var/lib/ceph/user.conf 2021-07-26T15:46:29.954 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:29 smithi033 bash[14790]: cluster 2021-07-26T15:46:28.455167+0000 mon.a (mon.0) 24 : cluster [DBG] mgrmap e4: y(active, since 2s) 2021-07-26T15:46:30.534 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:30.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [global] 2021-07-26T15:46:30.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: fsid = 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:30.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: log_to_journald = false 2021-07-26T15:46:30.535 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-07-26T15:46:30.536 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-07-26T15:46:30.536 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-07-26T15:46:30.536 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-07-26T15:46:30.536 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:30.536 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [mgr] 2021-07-26T15:46:30.537 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-07-26T15:46:30.538 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 2021-07-26T15:46:30.538 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: [osd] 2021-07-26T15:46:30.538 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-07-26T15:46:30.538 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-07-26T15:46:30.953 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:30 smithi033 bash[14790]: audit 2021-07-26T15:46:30.534234+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.33:0/240958397' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-07-26T15:46:31.140 INFO:teuthology.orchestra.run.smithi033.stderr:Enabling cephadm module... 2021-07-26T15:46:31.140 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific mgr module enable cephadm 2021-07-26T15:46:33.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:32 smithi033 bash[14790]: audit 2021-07-26T15:46:32.771609+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.33:0/2975335521' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-07-26T15:46:33.454 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:33 smithi033 bash[15053]: ignoring --setuser ceph since I am not root 2021-07-26T15:46:33.454 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:33 smithi033 bash[15053]: ignoring --setgroup ceph since I am not root 2021-07-26T15:46:33.613 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific mgr stat 2021-07-26T15:46:34.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:33 smithi033 bash[14790]: audit 2021-07-26T15:46:33.002488+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.33:0/2975335521' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-07-26T15:46:34.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:33 smithi033 bash[14790]: cluster 2021-07-26T15:46:33.002576+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 6s) 2021-07-26T15:46:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2021-07-26T15:46:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 5, 2021-07-26T15:46:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": true, 2021-07-26T15:46:35.332 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "active_name": "y", 2021-07-26T15:46:35.332 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standby": 0 2021-07-26T15:46:35.332 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2021-07-26T15:46:35.703 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:35 smithi033 bash[14790]: audit 2021-07-26T15:46:35.332370+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.33:0/3292390259' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-07-26T15:46:35.945 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for the mgr to restart... 2021-07-26T15:46:35.945 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr epoch 5... 2021-07-26T15:46:35.945 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific tell mgr mgr_status 2021-07-26T15:46:39.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:39 smithi033 bash[14790]: cluster 2021-07-26T15:46:39.321414+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon y restarted 2021-07-26T15:46:39.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:39 smithi033 bash[14790]: cluster 2021-07-26T15:46:39.322106+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon y 2021-07-26T15:46:39.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:39 smithi033 bash[14790]: cluster 2021-07-26T15:46:39.326412+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-07-26T15:46:40.407 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2021-07-26T15:46:40.408 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2021-07-26T15:46:40.409 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "initialized": true 2021-07-26T15:46:40.409 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2021-07-26T15:46:40.703 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: cluster 2021-07-26T15:46:39.379433+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0574049s) 2021-07-26T15:46:40.704 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.385759+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:46:40.704 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.387963+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-07-26T15:46:40.704 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.389432+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:46:40.704 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.389770+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:46:40.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.390069+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:46:40.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: cluster 2021-07-26T15:46:39.393999+0000 mon.a (mon.0) 39 : cluster [INF] Manager daemon y is now available 2021-07-26T15:46:40.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.418243+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:46:40.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.424106+0000 mon.a (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:46:40.706 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.428849+0000 mon.a (mon.0) 42 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:46:40.706 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.561763+0000 mon.a (mon.0) 43 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:46:40.706 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.563077+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:46:40.706 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.566577+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:46:40.707 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.570486+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:46:40.707 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.594402+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:46:40.707 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:40 smithi033 bash[14790]: audit 2021-07-26T15:46:39.596559+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:46:41.044 INFO:teuthology.orchestra.run.smithi033.stderr:mgr epoch 5 is available 2021-07-26T15:46:41.044 INFO:teuthology.orchestra.run.smithi033.stderr:Setting orchestrator backend to cephadm... 2021-07-26T15:46:41.045 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific orch set backend cephadm 2021-07-26T15:46:41.703 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:41 smithi033 bash[14790]: audit 2021-07-26T15:46:40.389461+0000 mgr.y (mgr.14116) 1 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-07-26T15:46:41.704 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:41 smithi033 bash[14790]: cluster 2021-07-26T15:46:40.391312+0000 mon.a (mon.0) 49 : cluster [DBG] mgrmap e7: y(active, since 1.06929s) 2021-07-26T15:46:41.704 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:41 smithi033 bash[14790]: audit 2021-07-26T15:46:40.408409+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-07-26T15:46:42.677 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:42 smithi033 bash[14790]: cluster 2021-07-26T15:46:41.402310+0000 mon.a (mon.0) 50 : cluster [DBG] mgrmap e8: y(active, since 2s) 2021-07-26T15:46:43.217 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific cephadm set-user root 2021-07-26T15:46:43.954 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:43 smithi033 bash[14790]: audit 2021-07-26T15:46:42.640293+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:46:43.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:43 smithi033 bash[14790]: audit 2021-07-26T15:46:42.649984+0000 mon.a (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:46:43.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:43 smithi033 bash[14790]: audit 2021-07-26T15:46:42.657434+0000 mon.a (mon.0) 52 : audit [DBG] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:46:44.726 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: value unchanged 2021-07-26T15:46:45.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:45 smithi033 bash[14790]: audit 2021-07-26T15:46:44.726794+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:46:45.349 INFO:teuthology.orchestra.run.smithi033.stderr:Generating ssh key... 2021-07-26T15:46:45.349 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific cephadm generate-key 2021-07-26T15:46:47.457 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: Generating public/private rsa key pair. 2021-07-26T15:46:47.457 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: Your identification has been saved in /tmp/tmpt079upcg/key. 2021-07-26T15:46:47.457 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: Your public key has been saved in /tmp/tmpt079upcg/key.pub. 2021-07-26T15:46:47.457 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: The key fingerprint is: 2021-07-26T15:46:47.458 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: SHA256:TU0hml9ZswRj0W/XILsDFUO4jdKsLtyqi9mV/yPCKMw ceph-7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:47.458 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: The key's randomart image is: 2021-07-26T15:46:47.458 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: +---[RSA 3072]----+ 2021-07-26T15:46:47.458 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: | .o@*+ | 2021-07-26T15:46:47.459 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: | o.=o*oo | 2021-07-26T15:46:47.459 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: | oo.=+o.o.| 2021-07-26T15:46:47.459 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: | .+*.o =| 2021-07-26T15:46:47.459 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: | Soo. . ..| 2021-07-26T15:46:47.460 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: | .. o | 2021-07-26T15:46:47.460 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: | o +oo . | 2021-07-26T15:46:47.460 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: | E+..=.+ . | 2021-07-26T15:46:47.460 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: | o.+o.+.o.. | 2021-07-26T15:46:47.460 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:46 smithi033 bash[15053]: +----[SHA256]-----+ 2021-07-26T15:46:47.623 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific cephadm get-pub-key 2021-07-26T15:46:48.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:47 smithi033 bash[14790]: cephadm 2021-07-26T15:46:46.823030+0000 mgr.y (mgr.14116) 6 : cephadm [INF] Generating ssh key... 2021-07-26T15:46:48.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:47 smithi033 bash[14790]: audit 2021-07-26T15:46:46.965267+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:46:48.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:47 smithi033 bash[14790]: audit 2021-07-26T15:46:46.969236+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:46:49.151 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYfbYM8gsXrgQ7LMY7v2e+b1mKPXjRkO1ymtHFCk5jhYIZGRiDF5sgbe2hQg1pyVgUUTzOrfTCJO6RXX2Vx8IS6PeSaU2WWB1q/PaXSDESGygRNYSYbDgSiC0CJhUCPtUKsHDdPayCbo0m3SeKoQFQWtY4tdwpe7pqsx7T+0WuVLwJB21U6dOadr+FamycM0jXohXTDTcOL1PJVyRkAdLr6GrDJ7Zp9/FhQJslYMc49CaF7RhIVnJGjmCmyXzfl+G2dZpx3ngD7X8aNbfo2Tqe1W6a1UrzFA5yE3rZyFwL5wFrC5J9/Ikm4UgUMCJRpkG+bDJ4laaqtOtFz2e67c1PJKd+Pfg7LA0OPVX/+X/90UwjNeyvSG5hPettWTsbNqNDCb4NHzAQNcjUTlGRSntjzvk+d1MW+WwOkx3Ckk+O4YeZWnLrj+CVO4SE13c48HHxntbQGgxxT1H0BRAWXUcRAJzxUJhQWyhii/XnT1ktw+8AEtDRWVkU5AFZOE7P4BE= ceph-7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:46:49.737 INFO:teuthology.orchestra.run.smithi033.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2021-07-26T15:46:49.737 INFO:teuthology.orchestra.run.smithi033.stderr:Adding key to root@localhost authorized_keys... 2021-07-26T15:46:49.737 INFO:teuthology.orchestra.run.smithi033.stderr:Adding host smithi033... 2021-07-26T15:46:49.738 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific orch host add smithi033 172.21.15.33 2021-07-26T15:46:50.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:50 smithi033 bash[14790]: audit 2021-07-26T15:46:49.150682+0000 mgr.y (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:46:51.706 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:46:51 smithi033 bash[15053]: Warning: Permanently added '172.21.15.33' (ECDSA) to the list of known hosts. 2021-07-26T15:46:52.164 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Added host 'smithi033' with addr '172.21.15.33' 2021-07-26T15:46:52.852 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying unmanaged mon service... 2021-07-26T15:46:52.852 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific orch apply mon --unmanaged 2021-07-26T15:46:53.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:52 smithi033 bash[14790]: audit 2021-07-26T15:46:51.376339+0000 mgr.y (mgr.14116) 8 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi033", "addr": "172.21.15.33", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:46:53.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:52 smithi033 bash[14790]: audit 2021-07-26T15:46:52.162944+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:46:53.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:52 smithi033 bash[14790]: audit 2021-07-26T15:46:52.164276+0000 mon.a (mon.0) 56 : audit [DBG] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:46:54.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:54 smithi033 bash[14790]: cephadm 2021-07-26T15:46:52.163736+0000 mgr.y (mgr.14116) 9 : cephadm [INF] Added host smithi033 2021-07-26T15:46:55.120 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled mon update... 2021-07-26T15:46:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:Deploying unmanaged mgr service... 2021-07-26T15:46:56.018 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific orch apply mgr --unmanaged 2021-07-26T15:46:56.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:56 smithi033 bash[14790]: audit 2021-07-26T15:46:55.114757+0000 mgr.y (mgr.14116) 10 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:46:56.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:56 smithi033 bash[14790]: cephadm 2021-07-26T15:46:55.115675+0000 mgr.y (mgr.14116) 11 : cephadm [INF] Saving service mon spec with placement count:5 2021-07-26T15:46:56.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:56 smithi033 bash[14790]: audit 2021-07-26T15:46:55.119588+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:46:56.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:56 smithi033 bash[14790]: audit 2021-07-26T15:46:55.866752+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:46:57.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:57 smithi033 bash[14790]: audit 2021-07-26T15:46:56.124990+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:46:57.624 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Scheduled mgr update... 2021-07-26T15:46:58.201 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific config set mgr mgr/cephadm/container_init True --force 2021-07-26T15:46:58.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:58 smithi033 bash[14790]: audit 2021-07-26T15:46:57.616547+0000 mgr.y (mgr.14116) 12 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:46:58.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:58 smithi033 bash[14790]: cephadm 2021-07-26T15:46:57.617769+0000 mgr.y (mgr.14116) 13 : cephadm [INF] Saving service mgr spec with placement count:2 2021-07-26T15:46:58.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:46:58 smithi033 bash[14790]: audit 2021-07-26T15:46:57.622463+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:47:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific config set mgr mgr/dashboard/ssl_server_port 8443 2021-07-26T15:47:00.660 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:00 smithi033 bash[14790]: audit 2021-07-26T15:46:59.309142+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14116 172.21.15.33:0/3292075522' entity='mgr.y' 2021-07-26T15:47:00.661 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:00 smithi033 bash[14790]: cluster 2021-07-26T15:46:59.391275+0000 mgr.y (mgr.14116) 14 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:00.661 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:00 smithi033 bash[14790]: audit 2021-07-26T15:46:59.739030+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.33:0/1771331469' entity='client.admin' 2021-07-26T15:47:03.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:03 smithi033 bash[14790]: cluster 2021-07-26T15:47:01.391885+0000 mgr.y (mgr.14116) 15 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:03.207 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:03 smithi033 bash[14790]: audit 2021-07-26T15:47:02.703219+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.33:0/423580705' entity='client.admin' 2021-07-26T15:47:03.286 INFO:teuthology.orchestra.run.smithi033.stderr:Enabling the dashboard module... 2021-07-26T15:47:03.287 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific mgr module enable dashboard 2021-07-26T15:47:05.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:05 smithi033 bash[14790]: cluster 2021-07-26T15:47:03.392361+0000 mgr.y (mgr.14116) 16 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:05.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:05 smithi033 bash[14790]: audit 2021-07-26T15:47:04.849470+0000 mon.a (mon.0) 64 : audit [INF] from='client.? 172.21.15.33:0/2455724069' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-07-26T15:47:05.457 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:47:05 smithi033 bash[15053]: ignoring --setuser ceph since I am not root 2021-07-26T15:47:05.457 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:47:05 smithi033 bash[15053]: ignoring --setgroup ceph since I am not root 2021-07-26T15:47:05.576 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific mgr stat 2021-07-26T15:47:06.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:06 smithi033 bash[14790]: audit 2021-07-26T15:47:05.010935+0000 mon.a (mon.0) 65 : audit [INF] from='client.? 172.21.15.33:0/2455724069' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-07-26T15:47:06.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:06 smithi033 bash[14790]: cluster 2021-07-26T15:47:05.011159+0000 mon.a (mon.0) 66 : cluster [DBG] mgrmap e9: y(active, since 25s) 2021-07-26T15:47:07.123 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2021-07-26T15:47:07.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "epoch": 9, 2021-07-26T15:47:07.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "available": true, 2021-07-26T15:47:07.124 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "active_name": "y", 2021-07-26T15:47:07.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "num_standby": 0 2021-07-26T15:47:07.125 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2021-07-26T15:47:07.733 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for the mgr to restart... 2021-07-26T15:47:07.733 INFO:teuthology.orchestra.run.smithi033.stderr:Waiting for mgr epoch 9... 2021-07-26T15:47:07.734 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific tell mgr mgr_status 2021-07-26T15:47:08.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:08 smithi033 bash[14790]: audit 2021-07-26T15:47:07.122257+0000 mon.a (mon.0) 67 : audit [DBG] from='client.? 172.21.15.33:0/1882384910' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-07-26T15:47:11.715 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:47:11 smithi033 bash[15053]: Warning: Permanently added '172.21.15.33' (ECDSA) to the list of known hosts. 2021-07-26T15:47:11.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:11 smithi033 bash[14790]: cluster 2021-07-26T15:47:11.401112+0000 mon.a (mon.0) 68 : cluster [INF] Active manager daemon y restarted 2021-07-26T15:47:11.716 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:11 smithi033 bash[14790]: cluster 2021-07-26T15:47:11.401866+0000 mon.a (mon.0) 69 : cluster [INF] Activating manager daemon y 2021-07-26T15:47:11.716 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:11 smithi033 bash[14790]: cluster 2021-07-26T15:47:11.404817+0000 mon.a (mon.0) 70 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-07-26T15:47:12.485 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: { 2021-07-26T15:47:12.486 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2021-07-26T15:47:12.486 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: "initialized": true 2021-07-26T15:47:12.486 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: } 2021-07-26T15:47:12.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:12 smithi033 bash[14790]: cluster 2021-07-26T15:47:11.458500+0000 mon.a (mon.0) 71 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0567328s) 2021-07-26T15:47:12.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:12 smithi033 bash[14790]: audit 2021-07-26T15:47:11.461067+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:47:12.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:12 smithi033 bash[14790]: audit 2021-07-26T15:47:11.465414+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-07-26T15:47:12.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:12 smithi033 bash[14790]: audit 2021-07-26T15:47:11.465924+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:47:12.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:12 smithi033 bash[14790]: audit 2021-07-26T15:47:11.466286+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:47:12.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:12 smithi033 bash[14790]: audit 2021-07-26T15:47:11.466622+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:47:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:12 smithi033 bash[14790]: cluster 2021-07-26T15:47:11.471468+0000 mon.a (mon.0) 77 : cluster [INF] Manager daemon y is now available 2021-07-26T15:47:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:12 smithi033 bash[14790]: audit 2021-07-26T15:47:11.615865+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:47:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:12 smithi033 bash[14790]: audit 2021-07-26T15:47:11.621458+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:47:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:12 smithi033 bash[14790]: audit 2021-07-26T15:47:11.659114+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:47:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:12 smithi033 bash[14790]: audit 2021-07-26T15:47:11.662665+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:47:13.151 INFO:teuthology.orchestra.run.smithi033.stderr:mgr epoch 9 is available 2021-07-26T15:47:13.151 INFO:teuthology.orchestra.run.smithi033.stderr:Generating a dashboard self-signed certificate... 2021-07-26T15:47:13.152 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific dashboard create-self-signed-cert 2021-07-26T15:47:13.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:13 smithi033 bash[14790]: audit 2021-07-26T15:47:12.471427+0000 mgr.y (mgr.14146) 1 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-07-26T15:47:13.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:13 smithi033 bash[14790]: cluster 2021-07-26T15:47:12.473595+0000 mon.a (mon.0) 82 : cluster [DBG] mgrmap e11: y(active, since 1.07182s) 2021-07-26T15:47:13.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:13 smithi033 bash[14790]: audit 2021-07-26T15:47:12.484888+0000 mgr.y (mgr.14146) 2 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-07-26T15:47:14.845 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: Self-signed certificate created 2021-07-26T15:47:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:14 smithi033 bash[14790]: cluster 2021-07-26T15:47:13.487235+0000 mon.a (mon.0) 83 : cluster [DBG] mgrmap e12: y(active, since 2s) 2021-07-26T15:47:15.633 INFO:teuthology.orchestra.run.smithi033.stderr:Creating initial admin user... 2021-07-26T15:47:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp9fpgap8l:/tmp/dashboard.pw:z docker.io/ceph/daemon-base:latest-pacific dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2021-07-26T15:47:15.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:15 smithi033 bash[14790]: audit 2021-07-26T15:47:14.719121+0000 mgr.y (mgr.14146) 3 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:47:15.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:15 smithi033 bash[14790]: audit 2021-07-26T15:47:14.841753+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:47:15.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:15 smithi033 bash[14790]: audit 2021-07-26T15:47:14.845293+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:47:15.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:15 smithi033 bash[14790]: audit 2021-07-26T15:47:15.048309+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:47:17.903 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$m7AC0UbA4M.ZZJw8L2kvpu04lM5.8q1HWtx.5KeEtptqh4O.kCPGG", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1627314437, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-07-26T15:47:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:Fetching dashboard port number... 2021-07-26T15:47:18.502 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/docker run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/daemon-base:latest-pacific -e NODE_NAME=smithi033 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpbpbeuu6y:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpecdx6muq:/etc/ceph/ceph.conf:z docker.io/ceph/daemon-base:latest-pacific config get mgr mgr/dashboard/ssl_server_port 2021-07-26T15:47:19.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:18 smithi033 bash[14790]: audit 2021-07-26T15:47:17.642007+0000 mgr.y (mgr.14146) 4 : audit [DBG] from='client.14158 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:47:19.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:18 smithi033 bash[14790]: audit 2021-07-26T15:47:17.902442+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:47:19.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:18 smithi033 bash[14790]: cluster 2021-07-26T15:47:18.009932+0000 mon.a (mon.0) 88 : cluster [DBG] mgrmap e13: y(active, since 6s) 2021-07-26T15:47:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:/usr/bin/ceph: 8443 2021-07-26T15:47:20.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:20 smithi033 bash[14790]: audit 2021-07-26T15:47:20.010206+0000 mon.a (mon.0) 89 : audit [DBG] from='client.? 172.21.15.33:0/4074446236' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-07-26T15:47:20.571 INFO:teuthology.orchestra.run.smithi033.stderr:firewalld does not appear to be present 2021-07-26T15:47:20.571 INFO:teuthology.orchestra.run.smithi033.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2021-07-26T15:47:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:Ceph Dashboard is now available at: 2021-07-26T15:47:20.572 INFO:teuthology.orchestra.run.smithi033.stderr: 2021-07-26T15:47:20.572 INFO:teuthology.orchestra.run.smithi033.stderr: URL: https://smithi033.front.sepia.ceph.com:8443/ 2021-07-26T15:47:20.572 INFO:teuthology.orchestra.run.smithi033.stderr: User: admin 2021-07-26T15:47:20.573 INFO:teuthology.orchestra.run.smithi033.stderr: Password: uy0v9e347d 2021-07-26T15:47:20.573 INFO:teuthology.orchestra.run.smithi033.stderr: 2021-07-26T15:47:20.574 INFO:teuthology.orchestra.run.smithi033.stderr:You can access the Ceph CLI with: 2021-07-26T15:47:20.574 INFO:teuthology.orchestra.run.smithi033.stderr: 2021-07-26T15:47:20.575 INFO:teuthology.orchestra.run.smithi033.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-07-26T15:47:20.575 INFO:teuthology.orchestra.run.smithi033.stderr: 2021-07-26T15:47:20.575 INFO:teuthology.orchestra.run.smithi033.stderr:Please consider enabling telemetry to help improve Ceph: 2021-07-26T15:47:20.575 INFO:teuthology.orchestra.run.smithi033.stderr: 2021-07-26T15:47:20.575 INFO:teuthology.orchestra.run.smithi033.stderr: ceph telemetry on 2021-07-26T15:47:20.576 INFO:teuthology.orchestra.run.smithi033.stderr: 2021-07-26T15:47:20.576 INFO:teuthology.orchestra.run.smithi033.stderr:For more information see: 2021-07-26T15:47:20.576 INFO:teuthology.orchestra.run.smithi033.stderr: 2021-07-26T15:47:20.576 INFO:teuthology.orchestra.run.smithi033.stderr: https://docs.ceph.com/docs/pacific/mgr/telemetry/ 2021-07-26T15:47:20.577 INFO:teuthology.orchestra.run.smithi033.stderr: 2021-07-26T15:47:20.577 INFO:teuthology.orchestra.run.smithi033.stderr:Bootstrap complete. 2021-07-26T15:47:20.577 INFO:teuthology.orchestra.run.smithi033.stderr:Releasing lock 140274089773280 on /run/cephadm/7e62724e-ee28-11eb-8c23-001a4aab830c.lock 2021-07-26T15:47:20.577 INFO:teuthology.orchestra.run.smithi033.stderr:Lock 140274089773280 released on /run/cephadm/7e62724e-ee28-11eb-8c23-001a4aab830c.lock 2021-07-26T15:47:20.601 INFO:tasks.cephadm:Fetching config... 2021-07-26T15:47:20.601 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:47:20.602 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-07-26T15:47:20.609 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-07-26T15:47:20.610 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:47:20.610 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-07-26T15:47:20.667 INFO:tasks.cephadm:Fetching mon keyring... 2021-07-26T15:47:20.668 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:47:20.668 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-07-26T15:47:20.685 INFO:tasks.cephadm:Fetching pub ssh key... 2021-07-26T15:47:20.685 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:47:20.686 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-07-26T15:47:20.693 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-07-26T15:47:20.693 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYfbYM8gsXrgQ7LMY7v2e+b1mKPXjRkO1ymtHFCk5jhYIZGRiDF5sgbe2hQg1pyVgUUTzOrfTCJO6RXX2Vx8IS6PeSaU2WWB1q/PaXSDESGygRNYSYbDgSiC0CJhUCPtUKsHDdPayCbo0m3SeKoQFQWtY4tdwpe7pqsx7T+0WuVLwJB21U6dOadr+FamycM0jXohXTDTcOL1PJVyRkAdLr6GrDJ7Zp9/FhQJslYMc49CaF7RhIVnJGjmCmyXzfl+G2dZpx3ngD7X8aNbfo2Tqe1W6a1UrzFA5yE3rZyFwL5wFrC5J9/Ikm4UgUMCJRpkG+bDJ4laaqtOtFz2e67c1PJKd+Pfg7LA0OPVX/+X/90UwjNeyvSG5hPettWTsbNqNDCb4NHzAQNcjUTlGRSntjzvk+d1MW+WwOkx3Ckk+O4YeZWnLrj+CVO4SE13c48HHxntbQGgxxT1H0BRAWXUcRAJzxUJhQWyhii/XnT1ktw+8AEtDRWVkU5AFZOE7P4BE= ceph-7e62724e-ee28-11eb-8c23-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-07-26T15:47:20.762 INFO:teuthology.orchestra.run.smithi033.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYfbYM8gsXrgQ7LMY7v2e+b1mKPXjRkO1ymtHFCk5jhYIZGRiDF5sgbe2hQg1pyVgUUTzOrfTCJO6RXX2Vx8IS6PeSaU2WWB1q/PaXSDESGygRNYSYbDgSiC0CJhUCPtUKsHDdPayCbo0m3SeKoQFQWtY4tdwpe7pqsx7T+0WuVLwJB21U6dOadr+FamycM0jXohXTDTcOL1PJVyRkAdLr6GrDJ7Zp9/FhQJslYMc49CaF7RhIVnJGjmCmyXzfl+G2dZpx3ngD7X8aNbfo2Tqe1W6a1UrzFA5yE3rZyFwL5wFrC5J9/Ikm4UgUMCJRpkG+bDJ4laaqtOtFz2e67c1PJKd+Pfg7LA0OPVX/+X/90UwjNeyvSG5hPettWTsbNqNDCb4NHzAQNcjUTlGRSntjzvk+d1MW+WwOkx3Ckk+O4YeZWnLrj+CVO4SE13c48HHxntbQGgxxT1H0BRAWXUcRAJzxUJhQWyhii/XnT1ktw+8AEtDRWVkU5AFZOE7P4BE= ceph-7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:47:20.774 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYfbYM8gsXrgQ7LMY7v2e+b1mKPXjRkO1ymtHFCk5jhYIZGRiDF5sgbe2hQg1pyVgUUTzOrfTCJO6RXX2Vx8IS6PeSaU2WWB1q/PaXSDESGygRNYSYbDgSiC0CJhUCPtUKsHDdPayCbo0m3SeKoQFQWtY4tdwpe7pqsx7T+0WuVLwJB21U6dOadr+FamycM0jXohXTDTcOL1PJVyRkAdLr6GrDJ7Zp9/FhQJslYMc49CaF7RhIVnJGjmCmyXzfl+G2dZpx3ngD7X8aNbfo2Tqe1W6a1UrzFA5yE3rZyFwL5wFrC5J9/Ikm4UgUMCJRpkG+bDJ4laaqtOtFz2e67c1PJKd+Pfg7LA0OPVX/+X/90UwjNeyvSG5hPettWTsbNqNDCb4NHzAQNcjUTlGRSntjzvk+d1MW+WwOkx3Ckk+O4YeZWnLrj+CVO4SE13c48HHxntbQGgxxT1H0BRAWXUcRAJzxUJhQWyhii/XnT1ktw+8AEtDRWVkU5AFZOE7P4BE= ceph-7e62724e-ee28-11eb-8c23-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2021-07-26T15:47:20.802 INFO:teuthology.orchestra.run.smithi096.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDYfbYM8gsXrgQ7LMY7v2e+b1mKPXjRkO1ymtHFCk5jhYIZGRiDF5sgbe2hQg1pyVgUUTzOrfTCJO6RXX2Vx8IS6PeSaU2WWB1q/PaXSDESGygRNYSYbDgSiC0CJhUCPtUKsHDdPayCbo0m3SeKoQFQWtY4tdwpe7pqsx7T+0WuVLwJB21U6dOadr+FamycM0jXohXTDTcOL1PJVyRkAdLr6GrDJ7Zp9/FhQJslYMc49CaF7RhIVnJGjmCmyXzfl+G2dZpx3ngD7X8aNbfo2Tqe1W6a1UrzFA5yE3rZyFwL5wFrC5J9/Ikm4UgUMCJRpkG+bDJ4laaqtOtFz2e67c1PJKd+Pfg7LA0OPVX/+X/90UwjNeyvSG5hPettWTsbNqNDCb4NHzAQNcjUTlGRSntjzvk+d1MW+WwOkx3Ckk+O4YeZWnLrj+CVO4SE13c48HHxntbQGgxxT1H0BRAWXUcRAJzxUJhQWyhii/XnT1ktw+8AEtDRWVkU5AFZOE7P4BE= ceph-7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:47:20.809 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2021-07-26T15:47:25.921 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2021-07-26T15:47:25.922 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2021-07-26T15:47:26.139 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:25 smithi033 bash[14790]: audit 2021-07-26T15:47:24.867020+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:47:26.140 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:25 smithi033 bash[14790]: audit 2021-07-26T15:47:24.964049+0000 mon.a (mon.0) 91 : audit [INF] from='client.? 172.21.15.33:0/2917378718' entity='client.admin' 2021-07-26T15:47:26.140 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:25 smithi033 bash[14790]: audit 2021-07-26T15:47:25.200739+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi033", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:47:26.140 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:25 smithi033 bash[14790]: audit 2021-07-26T15:47:25.207404+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:47:26.140 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:25 smithi033 bash[14790]: audit 2021-07-26T15:47:25.210335+0000 mon.a (mon.0) 94 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:47:26.140 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:25 smithi033 bash[14790]: audit 2021-07-26T15:47:25.217679+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:47:30.389 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi096 2021-07-26T15:47:30.390 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:47:30.391 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/etc/ceph/ceph.conf 2021-07-26T15:47:30.399 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:47:30.400 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:47:30.407 INFO:tasks.cephadm:Adding host smithi096 to orchestrator... 2021-07-26T15:47:30.407 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch host add smithi096 2021-07-26T15:47:30.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:30 smithi033 bash[14790]: audit 2021-07-26T15:47:29.706444+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:47:30.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:30 smithi033 bash[14790]: audit 2021-07-26T15:47:29.707731+0000 mon.a (mon.0) 97 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:47:30.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:30 smithi033 bash[14790]: audit 2021-07-26T15:47:29.710272+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:47:30.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:30 smithi033 bash[14790]: audit 2021-07-26T15:47:29.711430+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:47:30.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:30 smithi033 bash[14790]: cephadm 2021-07-26T15:47:29.713979+0000 mgr.y (mgr.14146) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:47:30.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:30 smithi033 bash[14790]: cephadm 2021-07-26T15:47:29.736411+0000 mgr.y (mgr.14146) 7 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:47:30.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:30 smithi033 bash[14790]: audit 2021-07-26T15:47:29.778995+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:47:30.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:30 smithi033 bash[14790]: audit 2021-07-26T15:47:29.785439+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:47:33.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:33 smithi033 bash[14790]: cluster 2021-07-26T15:47:31.467019+0000 mgr.y (mgr.14146) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:35.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:35 smithi033 bash[14790]: cluster 2021-07-26T15:47:33.467482+0000 mgr.y (mgr.14146) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:37.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:37 smithi033 bash[14790]: cluster 2021-07-26T15:47:35.467934+0000 mgr.y (mgr.14146) 10 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:39.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:39 smithi033 bash[14790]: cluster 2021-07-26T15:47:37.468350+0000 mgr.y (mgr.14146) 11 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:41.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:41 smithi033 bash[14790]: cluster 2021-07-26T15:47:39.468761+0000 mgr.y (mgr.14146) 12 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:43.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:43 smithi033 bash[14790]: cluster 2021-07-26T15:47:41.469209+0000 mgr.y (mgr.14146) 13 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:45.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:45 smithi033 bash[14790]: cluster 2021-07-26T15:47:43.469681+0000 mgr.y (mgr.14146) 14 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:47.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:47 smithi033 bash[14790]: cluster 2021-07-26T15:47:45.470084+0000 mgr.y (mgr.14146) 15 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:49.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:49 smithi033 bash[14790]: cluster 2021-07-26T15:47:47.470484+0000 mgr.y (mgr.14146) 16 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:51.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:51 smithi033 bash[14790]: cluster 2021-07-26T15:47:49.470877+0000 mgr.y (mgr.14146) 17 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:53.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:53 smithi033 bash[14790]: cluster 2021-07-26T15:47:51.471311+0000 mgr.y (mgr.14146) 18 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:55.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:55 smithi033 bash[14790]: cluster 2021-07-26T15:47:53.471716+0000 mgr.y (mgr.14146) 19 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:57.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:57 smithi033 bash[14790]: cluster 2021-07-26T15:47:55.472066+0000 mgr.y (mgr.14146) 20 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:47:59.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:47:59 smithi033 bash[14790]: cluster 2021-07-26T15:47:57.472424+0000 mgr.y (mgr.14146) 21 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:00.455 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:47:59 smithi033 bash[15053]: Warning: Permanently added 'smithi096,172.21.15.96' (ECDSA) to the list of known hosts. 2021-07-26T15:48:00.721 INFO:teuthology.orchestra.run.smithi096.stdout:Added host 'smithi096' with addr '172.21.15.96' 2021-07-26T15:48:01.041 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:48:00 smithi033 bash[15053]: Warning: Permanently added '172.21.15.96' (ECDSA) to the list of known hosts. 2021-07-26T15:48:01.340 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch host ls --format=json 2021-07-26T15:48:01.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:01 smithi033 bash[14790]: cluster 2021-07-26T15:47:59.472836+0000 mgr.y (mgr.14146) 22 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:01.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:01 smithi033 bash[14790]: audit 2021-07-26T15:47:59.923752+0000 mgr.y (mgr.14146) 23 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi096", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:48:01.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:01 smithi033 bash[14790]: audit 2021-07-26T15:48:00.718023+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:01.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:01 smithi033 bash[14790]: audit 2021-07-26T15:48:00.719751+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:01.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:01 smithi033 bash[14790]: audit 2021-07-26T15:48:00.722672+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:01.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:01 smithi033 bash[14790]: audit 2021-07-26T15:48:00.724908+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:02.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:02 smithi033 bash[14790]: cephadm 2021-07-26T15:48:00.718950+0000 mgr.y (mgr.14146) 24 : cephadm [INF] Added host smithi096 2021-07-26T15:48:02.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:02 smithi033 bash[14790]: audit 2021-07-26T15:48:01.259360+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:02.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:02 smithi033 bash[14790]: audit 2021-07-26T15:48:02.002236+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:03.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:03 smithi033 bash[14790]: cluster 2021-07-26T15:48:01.473308+0000 mgr.y (mgr.14146) 25 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:05.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:05 smithi033 bash[14790]: cluster 2021-07-26T15:48:03.473830+0000 mgr.y (mgr.14146) 26 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:05.756 INFO:teuthology.orchestra.run.smithi096.stdout: 2021-07-26T15:48:05.756 INFO:teuthology.orchestra.run.smithi096.stdout:[{"addr": "172.21.15.33", "hostname": "smithi033", "labels": [], "status": ""}, {"addr": "172.21.15.96", "hostname": "smithi096", "labels": [], "status": ""}] 2021-07-26T15:48:06.372 INFO:tasks.cephadm:Setting crush tunables to default 2021-07-26T15:48:06.373 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd crush tunables default 2021-07-26T15:48:07.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:07 smithi033 bash[14790]: cluster 2021-07-26T15:48:05.474355+0000 mgr.y (mgr.14146) 27 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:07.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:07 smithi033 bash[14790]: audit 2021-07-26T15:48:05.755748+0000 mgr.y (mgr.14146) 28 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-07-26T15:48:09.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:08 smithi033 bash[14790]: cluster 2021-07-26T15:48:07.474832+0000 mgr.y (mgr.14146) 29 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:09.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:08 smithi033 bash[14790]: audit 2021-07-26T15:48:07.865370+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:09.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:08 smithi033 bash[14790]: audit 2021-07-26T15:48:08.135944+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:09.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:08 smithi033 bash[14790]: audit 2021-07-26T15:48:08.137451+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi096", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:48:09.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:08 smithi033 bash[14790]: audit 2021-07-26T15:48:08.144559+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:09.877 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2021-07-26T15:48:10.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:09 smithi033 bash[14790]: audit 2021-07-26T15:48:09.753614+0000 mon.a (mon.0) 112 : audit [INF] from='client.? 172.21.15.33:0/1620361484' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-07-26T15:48:10.579 INFO:tasks.cephadm:Adding mon.a on smithi033 2021-07-26T15:48:10.579 INFO:tasks.cephadm:Adding mon.c on smithi033 2021-07-26T15:48:10.579 INFO:tasks.cephadm:Adding mon.b on smithi096 2021-07-26T15:48:10.580 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch apply mon '3;smithi033:172.21.15.33=a;smithi033:[v2:172.21.15.33:3301,v1:172.21.15.33:6790]=c;smithi096:172.21.15.96=b' 2021-07-26T15:48:11.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:10 smithi033 bash[14790]: cluster 2021-07-26T15:48:09.475330+0000 mgr.y (mgr.14146) 30 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:11.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:10 smithi033 bash[14790]: audit 2021-07-26T15:48:09.873391+0000 mon.a (mon.0) 113 : audit [INF] from='client.? 172.21.15.33:0/1620361484' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-07-26T15:48:11.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:10 smithi033 bash[14790]: cluster 2021-07-26T15:48:09.873560+0000 mon.a (mon.0) 114 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-07-26T15:48:12.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:11 smithi033 bash[14790]: audit 2021-07-26T15:48:11.661688+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:48:12.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:11 smithi033 bash[14790]: audit 2021-07-26T15:48:11.665360+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:48:13.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:13 smithi033 bash[14790]: cluster 2021-07-26T15:48:11.475760+0000 mgr.y (mgr.14146) 31 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:13.601 INFO:teuthology.orchestra.run.smithi096.stdout:Scheduled mon update... 2021-07-26T15:48:14.129 DEBUG:teuthology.orchestra.run.smithi033:mon.c> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.c.service 2021-07-26T15:48:14.132 DEBUG:teuthology.orchestra.run.smithi096:mon.b> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.b.service 2021-07-26T15:48:14.135 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-07-26T15:48:14.135 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph mon dump -f json 2021-07-26T15:48:14.213 INFO:journalctl@ceph.mon.b.smithi096.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:48:14.406 INFO:journalctl@ceph.mon.c.smithi033.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:48:14.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: cluster 2021-07-26T15:48:13.476218+0000 mgr.y (mgr.14146) 32 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:14.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: audit 2021-07-26T15:48:13.592562+0000 mgr.y (mgr.14146) 33 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi033:172.21.15.33=a;smithi033:[v2:172.21.15.33:3301,v1:172.21.15.33:6790]=c;smithi096:172.21.15.96=b", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:48:14.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: cephadm 2021-07-26T15:48:13.596064+0000 mgr.y (mgr.14146) 34 : cephadm [INF] Saving service mon spec with placement smithi033:172.21.15.33=a;smithi033:[v2:172.21.15.33:3301,v1:172.21.15.33:6790]=c;smithi096:172.21.15.96=b;count:3 2021-07-26T15:48:14.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: audit 2021-07-26T15:48:13.601505+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:14.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: audit 2021-07-26T15:48:13.603043+0000 mon.a (mon.0) 118 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:14.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: audit 2021-07-26T15:48:13.605765+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:14.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: audit 2021-07-26T15:48:13.608147+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:14.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: cephadm 2021-07-26T15:48:13.611312+0000 mgr.y (mgr.14146) 35 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:48:14.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: cephadm 2021-07-26T15:48:13.627319+0000 mgr.y (mgr.14146) 36 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:48:14.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: audit 2021-07-26T15:48:13.674577+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:14.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: audit 2021-07-26T15:48:13.680707+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:14.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: audit 2021-07-26T15:48:13.683881+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:14.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: audit 2021-07-26T15:48:13.685410+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:14.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:14 smithi033 bash[14790]: cephadm 2021-07-26T15:48:13.687425+0000 mgr.y (mgr.14146) 37 : cephadm [INF] Deploying daemon mon.c on smithi033 2021-07-26T15:48:16.954 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:16 smithi033 bash[14790]: cluster 2021-07-26T15:48:15.476677+0000 mgr.y (mgr.14146) 38 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:17.034 INFO:teuthology.orchestra.run.smithi096.stdout: 2021-07-26T15:48:17.034 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":1,"fsid":"7e62724e-ee28-11eb-8c23-001a4aab830c","modified":"2021-07-26T15:46:03.938435Z","created":"2021-07-26T15:46:03.938435Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2021-07-26T15:48:17.037 INFO:teuthology.orchestra.run.smithi096.stderr:dumped monmap epoch 1 2021-07-26T15:48:18.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:18 smithi033 bash[14790]: audit 2021-07-26T15:48:17.035214+0000 mon.a (mon.0) 125 : audit [DBG] from='client.? 172.21.15.96:0/1048383509' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-07-26T15:48:18.591 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-07-26T15:48:18.591 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph mon dump -f json 2021-07-26T15:48:18.705 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:18 smithi033 bash[19094]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:48:19.448 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[14790]: cluster 2021-07-26T15:48:17.477148+0000 mgr.y (mgr.14146) 39 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:19.449 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[14790]: audit 2021-07-26T15:48:18.380286+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:19.449 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[14790]: audit 2021-07-26T15:48:18.381724+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:19.450 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[14790]: audit 2021-07-26T15:48:18.382760+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:19.705 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.564+0000 7ffbd0fbe700 0 set uid:gid to 167:167 (ceph:ceph) 2021-07-26T15:48:19.706 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.564+0000 7ffbd0fbe700 0 ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable), process ceph-mon, pid 7 2021-07-26T15:48:19.706 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.564+0000 7ffbd0fbe700 0 pidfile_write: ignore empty --pid-file 2021-07-26T15:48:19.706 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.568+0000 7ffbd0fbe700 0 load: jerasure load: lrc load: isa 2021-07-26T15:48:19.707 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: RocksDB version: 6.8.1 2021-07-26T15:48:19.707 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-07-26T15:48:19.707 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Compile date Jul 8 2021 2021-07-26T15:48:19.707 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: DB SUMMARY 2021-07-26T15:48:19.707 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: CURRENT file: CURRENT 2021-07-26T15:48:19.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: IDENTITY file: IDENTITY 2021-07-26T15:48:19.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-07-26T15:48:19.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2021-07-26T15:48:19.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 511 ; 2021-07-26T15:48:19.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.error_if_exists: 0 2021-07-26T15:48:19.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.create_if_missing: 0 2021-07-26T15:48:19.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.paranoid_checks: 1 2021-07-26T15:48:19.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.env: 0x55cb56c801c0 2021-07-26T15:48:19.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.fs: Posix File System 2021-07-26T15:48:19.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.info_log: 0x55cb5784be20 2021-07-26T15:48:19.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_file_opening_threads: 16 2021-07-26T15:48:19.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.statistics: (nil) 2021-07-26T15:48:19.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.use_fsync: 0 2021-07-26T15:48:19.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_log_file_size: 0 2021-07-26T15:48:19.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-07-26T15:48:19.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-07-26T15:48:19.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.keep_log_file_num: 1000 2021-07-26T15:48:19.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.recycle_log_file_num: 0 2021-07-26T15:48:19.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.allow_fallocate: 1 2021-07-26T15:48:19.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.allow_mmap_reads: 0 2021-07-26T15:48:19.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.allow_mmap_writes: 0 2021-07-26T15:48:19.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.use_direct_reads: 0 2021-07-26T15:48:19.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-07-26T15:48:19.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.create_missing_column_families: 0 2021-07-26T15:48:19.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.db_log_dir: 2021-07-26T15:48:19.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-07-26T15:48:19.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-07-26T15:48:19.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_subcompactions: 1 2021-07-26T15:48:19.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_background_flushes: -1 2021-07-26T15:48:19.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-07-26T15:48:19.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-07-26T15:48:19.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-07-26T15:48:19.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-07-26T15:48:19.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-07-26T15:48:19.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.advise_random_on_open: 1 2021-07-26T15:48:19.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.db_write_buffer_size: 0 2021-07-26T15:48:19.719 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.write_buffer_manager: 0x55cb578e3fb0 2021-07-26T15:48:19.719 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-07-26T15:48:19.719 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-07-26T15:48:19.719 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-07-26T15:48:19.720 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-07-26T15:48:19.720 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.rate_limiter: (nil) 2021-07-26T15:48:19.720 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-07-26T15:48:19.720 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.wal_recovery_mode: 2 2021-07-26T15:48:19.720 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.enable_thread_tracking: 0 2021-07-26T15:48:19.721 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.enable_pipelined_write: 0 2021-07-26T15:48:19.721 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.unordered_write: 0 2021-07-26T15:48:19.721 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-07-26T15:48:19.721 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-07-26T15:48:19.721 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-07-26T15:48:19.722 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-07-26T15:48:19.722 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.row_cache: None 2021-07-26T15:48:19.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.wal_filter: None 2021-07-26T15:48:19.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-07-26T15:48:19.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.allow_ingest_behind: 0 2021-07-26T15:48:19.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.preserve_deletes: 0 2021-07-26T15:48:19.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.two_write_queues: 0 2021-07-26T15:48:19.724 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.manual_wal_flush: 0 2021-07-26T15:48:19.724 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.atomic_flush: 0 2021-07-26T15:48:19.724 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-07-26T15:48:19.725 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-07-26T15:48:19.725 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-07-26T15:48:19.725 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.log_readahead_size: 0 2021-07-26T15:48:19.726 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-07-26T15:48:19.726 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_background_jobs: 2 2021-07-26T15:48:19.726 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_background_compactions: -1 2021-07-26T15:48:19.727 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-07-26T15:48:19.727 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-07-26T15:48:19.727 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-07-26T15:48:19.728 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_total_wal_size: 0 2021-07-26T15:48:19.728 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-07-26T15:48:19.729 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-07-26T15:48:19.729 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-07-26T15:48:19.729 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-07-26T15:48:19.729 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_open_files: -1 2021-07-26T15:48:19.730 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.bytes_per_sync: 0 2021-07-26T15:48:19.730 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-07-26T15:48:19.730 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-07-26T15:48:19.730 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_readahead_size: 0 2021-07-26T15:48:19.730 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Compression algorithms supported: 2021-07-26T15:48:19.731 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-07-26T15:48:19.731 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: kZSTD supported: 0 2021-07-26T15:48:19.731 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: kXpressCompression supported: 0 2021-07-26T15:48:19.731 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: kLZ4HCCompression supported: 1 2021-07-26T15:48:19.732 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: kLZ4Compression supported: 1 2021-07-26T15:48:19.732 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: kBZip2Compression supported: 0 2021-07-26T15:48:19.732 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: kZlibCompression supported: 1 2021-07-26T15:48:19.732 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: kSnappyCompression supported: 1 2021-07-26T15:48:19.733 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-07-26T15:48:19.733 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2021-07-26T15:48:19.733 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-07-26T15:48:19.733 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-07-26T15:48:19.734 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.merge_operator: 2021-07-26T15:48:19.734 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_filter: None 2021-07-26T15:48:19.734 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_filter_factory: None 2021-07-26T15:48:19.735 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-07-26T15:48:19.735 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-07-26T15:48:19.735 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55cb577f2170) 2021-07-26T15:48:19.736 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: cache_index_and_filter_blocks: 1 2021-07-26T15:48:19.736 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: cache_index_and_filter_blocks_with_high_priority: 0 2021-07-26T15:48:19.736 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-07-26T15:48:19.737 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: pin_top_level_index_and_filter: 1 2021-07-26T15:48:19.737 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: index_type: 0 2021-07-26T15:48:19.738 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: data_block_index_type: 0 2021-07-26T15:48:19.738 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: index_shortening: 1 2021-07-26T15:48:19.738 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: data_block_hash_table_util_ratio: 0.750000 2021-07-26T15:48:19.739 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: hash_index_allow_collision: 1 2021-07-26T15:48:19.739 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: checksum: 1 2021-07-26T15:48:19.739 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: no_block_cache: 0 2021-07-26T15:48:19.739 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: block_cache: 0x55cb5782af10 2021-07-26T15:48:19.740 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: block_cache_name: BinnedLRUCache 2021-07-26T15:48:19.740 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: block_cache_options: 2021-07-26T15:48:19.740 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: capacity : 536870912 2021-07-26T15:48:19.740 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: num_shard_bits : 4 2021-07-26T15:48:19.741 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: strict_capacity_limit : 0 2021-07-26T15:48:19.741 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: high_pri_pool_ratio: 0.000 2021-07-26T15:48:19.741 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: block_cache_compressed: (nil) 2021-07-26T15:48:19.741 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: persistent_cache: (nil) 2021-07-26T15:48:19.741 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: block_size: 4096 2021-07-26T15:48:19.742 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: block_size_deviation: 10 2021-07-26T15:48:19.742 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: block_restart_interval: 16 2021-07-26T15:48:19.742 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: index_block_restart_interval: 1 2021-07-26T15:48:19.742 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: metadata_block_size: 4096 2021-07-26T15:48:19.742 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: partition_filters: 0 2021-07-26T15:48:19.743 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: use_delta_encoding: 1 2021-07-26T15:48:19.743 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: filter_policy: rocksdb.BuiltinBloomFilter 2021-07-26T15:48:19.743 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: whole_key_filtering: 1 2021-07-26T15:48:19.743 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: verify_compression: 0 2021-07-26T15:48:19.743 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: read_amp_bytes_per_bit: 0 2021-07-26T15:48:19.744 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: format_version: 2 2021-07-26T15:48:19.744 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: enable_index_compression: 1 2021-07-26T15:48:19.744 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: block_align: 0 2021-07-26T15:48:19.744 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.write_buffer_size: 33554432 2021-07-26T15:48:19.744 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_write_buffer_number: 2 2021-07-26T15:48:19.745 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compression: NoCompression 2021-07-26T15:48:19.745 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.bottommost_compression: Disabled 2021-07-26T15:48:19.745 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.prefix_extractor: nullptr 2021-07-26T15:48:19.746 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-07-26T15:48:19.746 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.num_levels: 7 2021-07-26T15:48:19.746 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-07-26T15:48:19.747 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-07-26T15:48:19.747 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-07-26T15:48:19.747 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-07-26T15:48:19.748 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-07-26T15:48:19.748 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-07-26T15:48:19.749 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-07-26T15:48:19.749 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:48:19.750 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-07-26T15:48:19.750 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-07-26T15:48:19.750 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compression_opts.level: 32767 2021-07-26T15:48:19.751 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compression_opts.strategy: 0 2021-07-26T15:48:19.751 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-07-26T15:48:19.752 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:48:19.752 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compression_opts.enabled: false 2021-07-26T15:48:19.752 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-07-26T15:48:19.753 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-07-26T15:48:19.753 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-07-26T15:48:19.753 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.target_file_size_base: 67108864 2021-07-26T15:48:19.754 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-07-26T15:48:19.754 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-07-26T15:48:19.755 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-07-26T15:48:19.755 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-07-26T15:48:19.755 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-07-26T15:48:19.756 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-07-26T15:48:19.756 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-07-26T15:48:19.757 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-07-26T15:48:19.757 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-07-26T15:48:19.757 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-07-26T15:48:19.758 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-07-26T15:48:19.758 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-07-26T15:48:19.759 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-07-26T15:48:19.759 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.arena_block_size: 4194304 2021-07-26T15:48:19.760 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-07-26T15:48:19.760 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-07-26T15:48:19.760 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-07-26T15:48:19.761 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.disable_auto_compactions: 0 2021-07-26T15:48:19.761 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-07-26T15:48:19.762 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-07-26T15:48:19.762 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-07-26T15:48:19.762 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-07-26T15:48:19.763 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-07-26T15:48:19.763 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-07-26T15:48:19.764 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-07-26T15:48:19.764 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-07-26T15:48:19.765 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-07-26T15:48:19.765 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-07-26T15:48:19.766 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.table_properties_collectors: 2021-07-26T15:48:19.766 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.inplace_update_support: 0 2021-07-26T15:48:19.766 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-07-26T15:48:19.767 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-07-26T15:48:19.767 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-07-26T15:48:19.768 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-07-26T15:48:19.768 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.bloom_locality: 0 2021-07-26T15:48:19.768 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.max_successive_merges: 0 2021-07-26T15:48:19.769 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-07-26T15:48:19.769 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.paranoid_file_checks: 0 2021-07-26T15:48:19.770 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.force_consistency_checks: 0 2021-07-26T15:48:19.770 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.report_bg_io_stats: 0 2021-07-26T15:48:19.770 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.ttl: 2592000 2021-07-26T15:48:19.771 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-07-26T15:48:19.771 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-07-26T15:48:19.772 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-07-26T15:48:19.772 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627314499577617, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-07-26T15:48:19.773 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-07-26T15:48:19.773 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-07-26T15:48:19.773 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627314499578478, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1627314499, "oldest_key_time": 3, "file_creation_time": 0}} 2021-07-26T15:48:19.774 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.572+0000 7ffbd0fbe700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-07-26T15:48:19.774 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.576+0000 7ffbd0fbe700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627314499579550, "job": 1, "event": "recovery_finished"} 2021-07-26T15:48:19.774 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.576+0000 7ffbd0fbe700 4 rocksdb: DB pointer 0x55cb578ef800 2021-07-26T15:48:19.774 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.576+0000 7ffbb7dc6700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-07-26T15:48:19.775 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.576+0000 7ffbb7dc6700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-07-26T15:48:19.775 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: ** DB Stats ** 2021-07-26T15:48:19.775 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:48:19.776 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-07-26T15:48:19.776 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-07-26T15:48:19.776 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:48:19.776 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-07-26T15:48:19.777 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-07-26T15:48:19.777 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:48:19.777 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: ** Compaction Stats [default] ** 2021-07-26T15:48:19.777 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:48:19.778 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:48:19.778 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:19.778 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:19.779 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:19.779 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: ** Compaction Stats [default] ** 2021-07-26T15:48:19.779 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:48:19.780 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:48:19.780 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:19.780 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:48:19.781 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Flush(GB): cumulative 0.000, interval 0.000 2021-07-26T15:48:19.781 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:48:19.781 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:48:19.782 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:48:19.782 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:48:19.782 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:48:19.782 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Interval compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:48:19.783 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:48:19.783 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:48:19.783 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: ** Compaction Stats [default] ** 2021-07-26T15:48:19.783 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:48:19.784 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:48:19.784 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:19.784 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:19.784 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:48:19.784 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: ** Compaction Stats [default] ** 2021-07-26T15:48:19.785 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:48:19.785 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:48:19.785 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:19.785 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:48:19.786 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Flush(GB): cumulative 0.000, interval 0.000 2021-07-26T15:48:19.786 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:48:19.786 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:48:19.787 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:48:19.787 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:48:19.787 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:48:19.787 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:48:19.788 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:48:19.788 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:48:19.788 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.576+0000 7ffbd0fbe700 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2021-07-26T15:48:19.789 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.576+0000 7ffbd0fbe700 0 using public_addrv [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2021-07-26T15:48:19.789 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.580+0000 7ffbd0fbe700 0 starting mon.c rank -1 at public addrs [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] at bind addrs [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:48:19.789 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.580+0000 7ffbd0fbe700 1 mon.c@-1(???) e0 preinit fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:48:19.790 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 0 mon.c@-1(synchronizing).mds e1 new map 2021-07-26T15:48:19.790 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 0 mon.c@-1(synchronizing).mds e1 print_map 2021-07-26T15:48:19.790 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: e1 2021-07-26T15:48:19.791 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: enable_multiple, ever_enabled_multiple: 1,1 2021-07-26T15:48:19.791 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-07-26T15:48:19.791 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: legacy client fscid: -1 2021-07-26T15:48:19.791 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: 2021-07-26T15:48:19.792 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: No filesystems configured 2021-07-26T15:48:19.792 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-07-26T15:48:19.792 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-07-26T15:48:19.792 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-07-26T15:48:19.792 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-07-26T15:48:19.793 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-07-26T15:48:19.793 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-07-26T15:48:19.793 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 0 mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2021-07-26T15:48:19.793 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-07-26T15:48:19.794 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-07-26T15:48:19.794 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 0 mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-07-26T15:48:19.794 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: cluster 2021-07-26T15:48:17.477148+0000 mgr.y (mgr.14146) 39 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:19.795 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: audit 2021-07-26T15:48:18.380286+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:19.795 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: audit 2021-07-26T15:48:18.381724+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:19.795 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: audit 2021-07-26T15:48:18.382760+0000 mon.a (mon.0) 128 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:19.795 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.608+0000 7ffbba5cb700 1 mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2021-07-26T15:48:19.795 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta expand map: {default=false} 2021-07-26T15:48:19.796 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta from 'false' to 'false' 2021-07-26T15:48:19.796 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta expanded map: {default=false} 2021-07-26T15:48:19.796 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta expand map: {default=info} 2021-07-26T15:48:19.796 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta from 'info' to 'info' 2021-07-26T15:48:19.797 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta expanded map: {default=info} 2021-07-26T15:48:19.797 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta expand map: {default=daemon} 2021-07-26T15:48:19.797 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-07-26T15:48:19.797 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta expanded map: {default=daemon} 2021-07-26T15:48:19.798 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta expand map: {default=debug} 2021-07-26T15:48:19.798 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta from 'debug' to 'debug' 2021-07-26T15:48:19.798 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:19 smithi033 bash[19094]: debug 2021-07-26T15:48:19.612+0000 7ffbba5cb700 20 expand_channel_meta expanded map: {default=debug} 2021-07-26T15:48:23.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:23 smithi096 bash[15117]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:48:24.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: cluster 2021-07-26T15:48:19.477595+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:24.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: audit 2021-07-26T15:48:19.626356+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:48:24.956 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: cluster 2021-07-26T15:48:19.626724+0000 mon.a (mon.0) 131 : cluster [INF] mon.a calling monitor election 2021-07-26T15:48:24.956 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: audit 2021-07-26T15:48:19.629253+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.956 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: audit 2021-07-26T15:48:20.621278+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.956 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: cluster 2021-07-26T15:48:21.478080+0000 mgr.y (mgr.14146) 42 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:24.957 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: audit 2021-07-26T15:48:21.621200+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.957 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: cluster 2021-07-26T15:48:21.624357+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-07-26T15:48:24.957 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: audit 2021-07-26T15:48:22.621315+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.957 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: cluster 2021-07-26T15:48:23.478569+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:24.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: audit 2021-07-26T15:48:23.621600+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: audit 2021-07-26T15:48:24.621621+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: cluster 2021-07-26T15:48:24.632443+0000 mon.a (mon.0) 138 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-07-26T15:48:24.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: cluster 2021-07-26T15:48:24.639481+0000 mon.a (mon.0) 139 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:48:24.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: cluster 2021-07-26T15:48:24.639630+0000 mon.a (mon.0) 140 : cluster [DBG] fsmap 2021-07-26T15:48:24.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: cluster 2021-07-26T15:48:24.639743+0000 mon.a (mon.0) 141 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-07-26T15:48:24.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: cluster 2021-07-26T15:48:24.640064+0000 mon.a (mon.0) 142 : cluster [DBG] mgrmap e13: y(active, since 73s) 2021-07-26T15:48:24.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: cluster 2021-07-26T15:48:24.646044+0000 mon.a (mon.0) 143 : cluster [INF] overall HEALTH_OK 2021-07-26T15:48:24.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: audit 2021-07-26T15:48:24.650223+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:24.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: audit 2021-07-26T15:48:24.652404+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:24.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: audit 2021-07-26T15:48:24.655107+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:24.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[19094]: audit 2021-07-26T15:48:24.656869+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:24.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: cluster 2021-07-26T15:48:19.477595+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:24.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: audit 2021-07-26T15:48:19.626356+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:48:24.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: cluster 2021-07-26T15:48:19.626724+0000 mon.a (mon.0) 131 : cluster [INF] mon.a calling monitor election 2021-07-26T15:48:24.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: audit 2021-07-26T15:48:19.629253+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: audit 2021-07-26T15:48:20.621278+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: cluster 2021-07-26T15:48:21.478080+0000 mgr.y (mgr.14146) 42 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:24.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: audit 2021-07-26T15:48:21.621200+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: cluster 2021-07-26T15:48:21.624357+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-07-26T15:48:24.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: audit 2021-07-26T15:48:22.621315+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: cluster 2021-07-26T15:48:23.478569+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:24.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: audit 2021-07-26T15:48:23.621600+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: audit 2021-07-26T15:48:24.621621+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:24.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: cluster 2021-07-26T15:48:24.632443+0000 mon.a (mon.0) 138 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-07-26T15:48:24.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: cluster 2021-07-26T15:48:24.639481+0000 mon.a (mon.0) 139 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:48:24.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: cluster 2021-07-26T15:48:24.639630+0000 mon.a (mon.0) 140 : cluster [DBG] fsmap 2021-07-26T15:48:24.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: cluster 2021-07-26T15:48:24.639743+0000 mon.a (mon.0) 141 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-07-26T15:48:24.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: cluster 2021-07-26T15:48:24.640064+0000 mon.a (mon.0) 142 : cluster [DBG] mgrmap e13: y(active, since 73s) 2021-07-26T15:48:24.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: cluster 2021-07-26T15:48:24.646044+0000 mon.a (mon.0) 143 : cluster [INF] overall HEALTH_OK 2021-07-26T15:48:24.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: audit 2021-07-26T15:48:24.650223+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:24.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: audit 2021-07-26T15:48:24.652404+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:24.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: audit 2021-07-26T15:48:24.655107+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:24.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:24 smithi033 bash[14790]: audit 2021-07-26T15:48:24.656869+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:25.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.926+0000 7f292cc8e700 0 set uid:gid to 167:167 (ceph:ceph) 2021-07-26T15:48:25.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.926+0000 7f292cc8e700 0 ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable), process ceph-mon, pid 8 2021-07-26T15:48:25.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.926+0000 7f292cc8e700 0 pidfile_write: ignore empty --pid-file 2021-07-26T15:48:25.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 0 load: jerasure load: lrc load: isa 2021-07-26T15:48:25.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: RocksDB version: 6.8.1 2021-07-26T15:48:25.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-07-26T15:48:25.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Compile date Jul 8 2021 2021-07-26T15:48:25.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: DB SUMMARY 2021-07-26T15:48:25.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: CURRENT file: CURRENT 2021-07-26T15:48:25.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: IDENTITY file: IDENTITY 2021-07-26T15:48:25.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-07-26T15:48:25.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2021-07-26T15:48:25.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 511 ; 2021-07-26T15:48:25.243 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.error_if_exists: 0 2021-07-26T15:48:25.243 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.create_if_missing: 0 2021-07-26T15:48:25.243 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.paranoid_checks: 1 2021-07-26T15:48:25.243 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.env: 0x562c7ff391c0 2021-07-26T15:48:25.243 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.fs: Posix File System 2021-07-26T15:48:25.244 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.info_log: 0x562c81da5e20 2021-07-26T15:48:25.244 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_file_opening_threads: 16 2021-07-26T15:48:25.244 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.statistics: (nil) 2021-07-26T15:48:25.244 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.use_fsync: 0 2021-07-26T15:48:25.245 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_log_file_size: 0 2021-07-26T15:48:25.245 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-07-26T15:48:25.245 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-07-26T15:48:25.245 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.keep_log_file_num: 1000 2021-07-26T15:48:25.245 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.recycle_log_file_num: 0 2021-07-26T15:48:25.247 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.allow_fallocate: 1 2021-07-26T15:48:25.248 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.allow_mmap_reads: 0 2021-07-26T15:48:25.248 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.allow_mmap_writes: 0 2021-07-26T15:48:25.249 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.use_direct_reads: 0 2021-07-26T15:48:25.249 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-07-26T15:48:25.249 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.create_missing_column_families: 0 2021-07-26T15:48:25.249 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.db_log_dir: 2021-07-26T15:48:25.249 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-07-26T15:48:25.250 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-07-26T15:48:25.250 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_subcompactions: 1 2021-07-26T15:48:25.250 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_background_flushes: -1 2021-07-26T15:48:25.250 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-07-26T15:48:25.251 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-07-26T15:48:25.251 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-07-26T15:48:25.251 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-07-26T15:48:25.251 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-07-26T15:48:25.252 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.advise_random_on_open: 1 2021-07-26T15:48:25.252 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.db_write_buffer_size: 0 2021-07-26T15:48:25.252 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.write_buffer_manager: 0x562c81e3df80 2021-07-26T15:48:25.252 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-07-26T15:48:25.252 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-07-26T15:48:25.253 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-07-26T15:48:25.253 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-07-26T15:48:25.253 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.rate_limiter: (nil) 2021-07-26T15:48:25.254 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-07-26T15:48:25.254 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.wal_recovery_mode: 2 2021-07-26T15:48:25.254 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.enable_thread_tracking: 0 2021-07-26T15:48:25.254 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.enable_pipelined_write: 0 2021-07-26T15:48:25.254 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.unordered_write: 0 2021-07-26T15:48:25.255 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-07-26T15:48:25.255 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-07-26T15:48:25.255 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-07-26T15:48:25.255 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-07-26T15:48:25.255 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.row_cache: None 2021-07-26T15:48:25.256 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.wal_filter: None 2021-07-26T15:48:25.256 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-07-26T15:48:25.256 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.allow_ingest_behind: 0 2021-07-26T15:48:25.256 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.preserve_deletes: 0 2021-07-26T15:48:25.257 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.two_write_queues: 0 2021-07-26T15:48:25.257 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.manual_wal_flush: 0 2021-07-26T15:48:25.257 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.atomic_flush: 0 2021-07-26T15:48:25.257 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-07-26T15:48:25.257 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-07-26T15:48:25.258 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-07-26T15:48:25.258 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.log_readahead_size: 0 2021-07-26T15:48:25.258 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-07-26T15:48:25.258 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_background_jobs: 2 2021-07-26T15:48:25.259 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_background_compactions: -1 2021-07-26T15:48:25.259 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-07-26T15:48:25.259 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-07-26T15:48:25.260 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-07-26T15:48:25.260 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_total_wal_size: 0 2021-07-26T15:48:25.260 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-07-26T15:48:25.260 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-07-26T15:48:25.261 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-07-26T15:48:25.261 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-07-26T15:48:25.261 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_open_files: -1 2021-07-26T15:48:25.261 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.bytes_per_sync: 0 2021-07-26T15:48:25.261 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-07-26T15:48:25.262 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-07-26T15:48:25.262 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_readahead_size: 0 2021-07-26T15:48:25.262 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Compression algorithms supported: 2021-07-26T15:48:25.262 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-07-26T15:48:25.263 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: kZSTD supported: 0 2021-07-26T15:48:25.263 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: kXpressCompression supported: 0 2021-07-26T15:48:25.263 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: kLZ4HCCompression supported: 1 2021-07-26T15:48:25.263 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: kLZ4Compression supported: 1 2021-07-26T15:48:25.263 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: kBZip2Compression supported: 0 2021-07-26T15:48:25.264 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: kZlibCompression supported: 1 2021-07-26T15:48:25.264 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: kSnappyCompression supported: 1 2021-07-26T15:48:25.264 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-07-26T15:48:25.265 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2021-07-26T15:48:25.265 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-07-26T15:48:25.265 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-07-26T15:48:25.265 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.merge_operator: 2021-07-26T15:48:25.266 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_filter: None 2021-07-26T15:48:25.266 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_filter_factory: None 2021-07-26T15:48:25.266 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-07-26T15:48:25.266 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-07-26T15:48:25.267 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562c81d4c170) 2021-07-26T15:48:25.267 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cache_index_and_filter_blocks: 1 2021-07-26T15:48:25.267 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cache_index_and_filter_blocks_with_high_priority: 0 2021-07-26T15:48:25.267 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-07-26T15:48:25.267 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: pin_top_level_index_and_filter: 1 2021-07-26T15:48:25.268 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: index_type: 0 2021-07-26T15:48:25.268 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: data_block_index_type: 0 2021-07-26T15:48:25.268 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: index_shortening: 1 2021-07-26T15:48:25.268 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: data_block_hash_table_util_ratio: 0.750000 2021-07-26T15:48:25.268 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: hash_index_allow_collision: 1 2021-07-26T15:48:25.269 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: checksum: 1 2021-07-26T15:48:25.269 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: no_block_cache: 0 2021-07-26T15:48:25.270 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: block_cache: 0x562c81d84f10 2021-07-26T15:48:25.270 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: block_cache_name: BinnedLRUCache 2021-07-26T15:48:25.270 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: block_cache_options: 2021-07-26T15:48:25.270 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: capacity : 536870912 2021-07-26T15:48:25.270 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: num_shard_bits : 4 2021-07-26T15:48:25.271 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: strict_capacity_limit : 0 2021-07-26T15:48:25.271 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: high_pri_pool_ratio: 0.000 2021-07-26T15:48:25.271 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: block_cache_compressed: (nil) 2021-07-26T15:48:25.271 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: persistent_cache: (nil) 2021-07-26T15:48:25.272 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: block_size: 4096 2021-07-26T15:48:25.272 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: block_size_deviation: 10 2021-07-26T15:48:25.272 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: block_restart_interval: 16 2021-07-26T15:48:25.272 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: index_block_restart_interval: 1 2021-07-26T15:48:25.272 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: metadata_block_size: 4096 2021-07-26T15:48:25.273 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: partition_filters: 0 2021-07-26T15:48:25.273 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: use_delta_encoding: 1 2021-07-26T15:48:25.273 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: filter_policy: rocksdb.BuiltinBloomFilter 2021-07-26T15:48:25.273 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: whole_key_filtering: 1 2021-07-26T15:48:25.273 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: verify_compression: 0 2021-07-26T15:48:25.274 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: read_amp_bytes_per_bit: 0 2021-07-26T15:48:25.274 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: format_version: 2 2021-07-26T15:48:25.274 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: enable_index_compression: 1 2021-07-26T15:48:25.274 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: block_align: 0 2021-07-26T15:48:25.274 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.write_buffer_size: 33554432 2021-07-26T15:48:25.275 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_write_buffer_number: 2 2021-07-26T15:48:25.275 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compression: NoCompression 2021-07-26T15:48:25.275 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.bottommost_compression: Disabled 2021-07-26T15:48:25.275 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.prefix_extractor: nullptr 2021-07-26T15:48:25.276 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-07-26T15:48:25.276 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.num_levels: 7 2021-07-26T15:48:25.276 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-07-26T15:48:25.276 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-07-26T15:48:25.276 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-07-26T15:48:25.277 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-07-26T15:48:25.277 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-07-26T15:48:25.277 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-07-26T15:48:25.277 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-07-26T15:48:25.278 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:48:25.278 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-07-26T15:48:25.278 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-07-26T15:48:25.278 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compression_opts.level: 32767 2021-07-26T15:48:25.279 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compression_opts.strategy: 0 2021-07-26T15:48:25.279 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-07-26T15:48:25.279 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:48:25.279 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compression_opts.enabled: false 2021-07-26T15:48:25.280 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-07-26T15:48:25.280 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-07-26T15:48:25.281 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-07-26T15:48:25.281 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.target_file_size_base: 67108864 2021-07-26T15:48:25.281 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-07-26T15:48:25.281 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-07-26T15:48:25.281 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-07-26T15:48:25.282 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-07-26T15:48:25.282 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-07-26T15:48:25.282 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-07-26T15:48:25.282 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-07-26T15:48:25.283 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-07-26T15:48:25.283 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-07-26T15:48:25.283 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-07-26T15:48:25.283 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-07-26T15:48:25.283 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-07-26T15:48:25.284 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-07-26T15:48:25.284 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.arena_block_size: 4194304 2021-07-26T15:48:25.284 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-07-26T15:48:25.284 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-07-26T15:48:25.285 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-07-26T15:48:25.285 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.disable_auto_compactions: 0 2021-07-26T15:48:25.285 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-07-26T15:48:25.285 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-07-26T15:48:25.286 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-07-26T15:48:25.286 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-07-26T15:48:25.286 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-07-26T15:48:25.287 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-07-26T15:48:25.287 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-07-26T15:48:25.287 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-07-26T15:48:25.287 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-07-26T15:48:25.288 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-07-26T15:48:25.288 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.table_properties_collectors: 2021-07-26T15:48:25.288 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.inplace_update_support: 0 2021-07-26T15:48:25.289 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-07-26T15:48:25.289 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-07-26T15:48:25.289 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-07-26T15:48:25.289 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-07-26T15:48:25.289 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.bloom_locality: 0 2021-07-26T15:48:25.290 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.max_successive_merges: 0 2021-07-26T15:48:25.291 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-07-26T15:48:25.291 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.paranoid_file_checks: 0 2021-07-26T15:48:25.291 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.force_consistency_checks: 0 2021-07-26T15:48:25.291 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.report_bg_io_stats: 0 2021-07-26T15:48:25.292 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.ttl: 2592000 2021-07-26T15:48:25.292 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-07-26T15:48:25.292 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-07-26T15:48:25.292 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-07-26T15:48:25.293 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627314504934780, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-07-26T15:48:25.293 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-07-26T15:48:25.293 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.930+0000 7f292cc8e700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-07-26T15:48:25.293 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.934+0000 7f292cc8e700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627314504935525, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1627314504, "oldest_key_time": 3, "file_creation_time": 0}} 2021-07-26T15:48:25.294 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.934+0000 7f292cc8e700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-07-26T15:48:25.295 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.934+0000 7f292cc8e700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627314504936011, "job": 1, "event": "recovery_finished"} 2021-07-26T15:48:25.295 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.934+0000 7f292cc8e700 4 rocksdb: DB pointer 0x562c81e49800 2021-07-26T15:48:25.295 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.934+0000 7f2913a96700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-07-26T15:48:25.295 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.934+0000 7f2913a96700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-07-26T15:48:25.296 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: ** DB Stats ** 2021-07-26T15:48:25.296 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:48:25.296 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-07-26T15:48:25.296 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-07-26T15:48:25.297 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:48:25.297 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-07-26T15:48:25.297 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-07-26T15:48:25.297 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:48:25.298 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: ** Compaction Stats [default] ** 2021-07-26T15:48:25.298 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:48:25.298 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:48:25.299 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:25.299 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:25.299 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:25.299 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: ** Compaction Stats [default] ** 2021-07-26T15:48:25.299 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:48:25.300 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:48:25.300 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:25.300 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:48:25.301 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Flush(GB): cumulative 0.000, interval 0.000 2021-07-26T15:48:25.301 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:48:25.301 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:48:25.302 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:48:25.302 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:48:25.302 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Cumulative compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:48:25.302 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Interval compaction: 0.00 GB write, 0.42 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:48:25.302 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:48:25.303 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:48:25.303 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: ** Compaction Stats [default] ** 2021-07-26T15:48:25.303 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:48:25.303 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:48:25.304 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:25.304 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:25.304 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:48:25.304 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: ** Compaction Stats [default] ** 2021-07-26T15:48:25.305 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:48:25.305 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:48:25.305 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 0.00 0.00 1 0.001 0 0 2021-07-26T15:48:25.305 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:48:25.306 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Flush(GB): cumulative 0.000, interval 0.000 2021-07-26T15:48:25.306 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:48:25.306 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:48:25.306 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:48:25.307 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:48:25.307 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Cumulative compaction: 0.00 GB write, 0.41 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:48:25.307 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:48:25.307 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:48:25.307 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:48:25.308 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.934+0000 7f292cc8e700 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2021-07-26T15:48:25.308 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.934+0000 7f292cc8e700 0 using public_addr v2:172.21.15.96:0/0 -> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] 2021-07-26T15:48:25.308 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.934+0000 7f292cc8e700 0 starting mon.b rank -1 at public addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] at bind addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:48:25.308 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.938+0000 7f292cc8e700 1 mon.b@-1(???) e0 preinit fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:48:25.309 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.962+0000 7f291629b700 0 mon.b@-1(synchronizing).mds e1 new map 2021-07-26T15:48:25.309 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.962+0000 7f291629b700 0 mon.b@-1(synchronizing).mds e1 print_map 2021-07-26T15:48:25.309 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: e1 2021-07-26T15:48:25.309 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: enable_multiple, ever_enabled_multiple: 1,1 2021-07-26T15:48:25.309 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-07-26T15:48:25.310 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: legacy client fscid: -1 2021-07-26T15:48:25.310 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: 2021-07-26T15:48:25.310 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: No filesystems configured 2021-07-26T15:48:25.310 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.962+0000 7f291629b700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-07-26T15:48:25.311 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.962+0000 7f291629b700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-07-26T15:48:25.311 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.962+0000 7f291629b700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-07-26T15:48:25.311 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.966+0000 7f291629b700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-07-26T15:48:25.312 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.966+0000 7f291629b700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-07-26T15:48:25.312 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.966+0000 7f291629b700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-07-26T15:48:25.312 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.966+0000 7f291629b700 0 mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2021-07-26T15:48:25.312 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.966+0000 7f291629b700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-07-26T15:48:25.313 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.966+0000 7f291629b700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-07-26T15:48:25.313 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.966+0000 7f291629b700 0 mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2021-07-26T15:48:25.313 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cluster 2021-07-26T15:48:19.477595+0000 mgr.y (mgr.14146) 41 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:25.313 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: audit 2021-07-26T15:48:19.626356+0000 mon.a (mon.0) 130 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:48:25.313 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cluster 2021-07-26T15:48:19.626724+0000 mon.a (mon.0) 131 : cluster [INF] mon.a calling monitor election 2021-07-26T15:48:25.314 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: audit 2021-07-26T15:48:19.629253+0000 mon.a (mon.0) 132 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:25.314 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: audit 2021-07-26T15:48:20.621278+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:25.314 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cluster 2021-07-26T15:48:21.478080+0000 mgr.y (mgr.14146) 42 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:25.314 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: audit 2021-07-26T15:48:21.621200+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:25.315 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cluster 2021-07-26T15:48:21.624357+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-07-26T15:48:25.315 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: audit 2021-07-26T15:48:22.621315+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:25.315 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cluster 2021-07-26T15:48:23.478569+0000 mgr.y (mgr.14146) 43 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:25.315 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: audit 2021-07-26T15:48:23.621600+0000 mon.a (mon.0) 136 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:25.316 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: audit 2021-07-26T15:48:24.621621+0000 mon.a (mon.0) 137 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:25.316 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cluster 2021-07-26T15:48:24.632443+0000 mon.a (mon.0) 138 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-07-26T15:48:25.316 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cluster 2021-07-26T15:48:24.639481+0000 mon.a (mon.0) 139 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:48:25.316 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cluster 2021-07-26T15:48:24.639630+0000 mon.a (mon.0) 140 : cluster [DBG] fsmap 2021-07-26T15:48:25.316 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cluster 2021-07-26T15:48:24.639743+0000 mon.a (mon.0) 141 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-07-26T15:48:25.317 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cluster 2021-07-26T15:48:24.640064+0000 mon.a (mon.0) 142 : cluster [DBG] mgrmap e13: y(active, since 73s) 2021-07-26T15:48:25.317 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: cluster 2021-07-26T15:48:24.646044+0000 mon.a (mon.0) 143 : cluster [INF] overall HEALTH_OK 2021-07-26T15:48:25.317 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: audit 2021-07-26T15:48:24.650223+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:25.317 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: audit 2021-07-26T15:48:24.652404+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:25.317 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: audit 2021-07-26T15:48:24.655107+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:25.318 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: audit 2021-07-26T15:48:24.656869+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:25.318 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:24 smithi096 bash[15117]: debug 2021-07-26T15:48:24.966+0000 7f291629b700 1 mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2021-07-26T15:48:30.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:24.985420+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:48:30.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:24.985889+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2021-07-26T15:48:30.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:24.986286+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-07-26T15:48:30.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:24.988001+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:24.988266+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:30.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:25.479046+0000 mgr.y (mgr.14146) 44 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:30.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:25.978205+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:26.978249+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:27.479470+0000 mgr.y (mgr.14146) 45 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:30.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:27.978315+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:28.978437+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:29.978436+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:29.988006+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-07-26T15:48:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:29.993287+0000 mon.a (mon.0) 159 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:48:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:29.993392+0000 mon.a (mon.0) 160 : cluster [DBG] fsmap 2021-07-26T15:48:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:29.993450+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-07-26T15:48:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:29.993783+0000 mon.a (mon.0) 162 : cluster [DBG] mgrmap e13: y(active, since 78s) 2021-07-26T15:48:30.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:29.994129+0000 mon.a (mon.0) 163 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-07-26T15:48:30.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:30.003074+0000 mon.a (mon.0) 164 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2021-07-26T15:48:30.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:30.003133+0000 mon.a (mon.0) 165 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-07-26T15:48:30.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: cluster 2021-07-26T15:48:30.003202+0000 mon.a (mon.0) 166 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] is down (out of quorum) 2021-07-26T15:48:30.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:30.009734+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:30.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:30.016223+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:30.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:30.020056+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:30.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[14790]: audit 2021-07-26T15:48:30.042688+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:30.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:24.985420+0000 mon.a (mon.0) 149 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:48:30.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:24.985889+0000 mon.a (mon.0) 150 : cluster [INF] mon.a calling monitor election 2021-07-26T15:48:30.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:24.986286+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-07-26T15:48:30.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:24.988001+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:24.988266+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:48:30.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:25.479046+0000 mgr.y (mgr.14146) 44 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:30.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:25.978205+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:26.978249+0000 mon.a (mon.0) 154 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:27.479470+0000 mgr.y (mgr.14146) 45 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:30.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:27.978315+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:28.978437+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:29.978436+0000 mon.a (mon.0) 157 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:30.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:29.988006+0000 mon.a (mon.0) 158 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-07-26T15:48:30.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:29.993287+0000 mon.a (mon.0) 159 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:48:30.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:29.993392+0000 mon.a (mon.0) 160 : cluster [DBG] fsmap 2021-07-26T15:48:30.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:29.993450+0000 mon.a (mon.0) 161 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-07-26T15:48:30.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:29.993783+0000 mon.a (mon.0) 162 : cluster [DBG] mgrmap e13: y(active, since 78s) 2021-07-26T15:48:30.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:29.994129+0000 mon.a (mon.0) 163 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2021-07-26T15:48:30.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:30.003074+0000 mon.a (mon.0) 164 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2021-07-26T15:48:30.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:30.003133+0000 mon.a (mon.0) 165 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2021-07-26T15:48:30.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: cluster 2021-07-26T15:48:30.003202+0000 mon.a (mon.0) 166 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] is down (out of quorum) 2021-07-26T15:48:30.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:30.009734+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:30.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:30.016223+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:30.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:30.020056+0000 mon.a (mon.0) 169 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:30.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:30 smithi033 bash[19094]: audit 2021-07-26T15:48:30.042688+0000 mon.a (mon.0) 170 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:31.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[14790]: cluster 2021-07-26T15:48:29.479917+0000 mgr.y (mgr.14146) 46 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:31.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[14790]: cephadm 2021-07-26T15:48:30.016990+0000 mgr.y (mgr.14146) 47 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:48:31.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[14790]: audit 2021-07-26T15:48:30.316035+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:31.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[14790]: audit 2021-07-26T15:48:30.323065+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:31.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[14790]: audit 2021-07-26T15:48:30.325711+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:31.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[14790]: audit 2021-07-26T15:48:30.327266+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:48:31.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[14790]: audit 2021-07-26T15:48:30.328787+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:31.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[14790]: audit 2021-07-26T15:48:30.978759+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:31.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[19094]: cluster 2021-07-26T15:48:29.479917+0000 mgr.y (mgr.14146) 46 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:31.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[19094]: cephadm 2021-07-26T15:48:30.016990+0000 mgr.y (mgr.14146) 47 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:48:31.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[19094]: audit 2021-07-26T15:48:30.316035+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:31.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[19094]: audit 2021-07-26T15:48:30.323065+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:31.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[19094]: audit 2021-07-26T15:48:30.325711+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:31.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[19094]: audit 2021-07-26T15:48:30.327266+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:48:31.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[19094]: audit 2021-07-26T15:48:30.328787+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:31.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:31 smithi033 bash[19094]: audit 2021-07-26T15:48:30.978759+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:31.498 INFO:teuthology.orchestra.run.smithi096.stdout: 2021-07-26T15:48:31.498 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":3,"fsid":"7e62724e-ee28-11eb-8c23-001a4aab830c","modified":"2021-07-26T15:48:24.978154Z","created":"2021-07-26T15:46:03.938435Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3300","nonce":0},{"type":"v1","addr":"172.21.15.33:6789","nonce":0}]},"addr":"172.21.15.33:6789/0","public_addr":"172.21.15.33:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:3301","nonce":0},{"type":"v1","addr":"172.21.15.33:6790","nonce":0}]},"addr":"172.21.15.33:6790/0","public_addr":"172.21.15.33:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:3300","nonce":0},{"type":"v1","addr":"172.21.15.96:6789","nonce":0}]},"addr":"172.21.15.96:6789/0","public_addr":"172.21.15.96:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-07-26T15:48:31.505 INFO:teuthology.orchestra.run.smithi096.stderr:dumped monmap epoch 3 2021-07-26T15:48:32.178 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-07-26T15:48:32.178 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph config generate-minimal-conf 2021-07-26T15:48:32.389 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:26.977004+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-07-26T15:48:32.390 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:32.006650+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-07-26T15:48:32.390 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:32.011033+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-07-26T15:48:32.390 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:32.011092+0000 mon.a (mon.0) 179 : cluster [INF] mon.a calling monitor election 2021-07-26T15:48:32.390 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:32.015342+0000 mon.a (mon.0) 180 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:48:32.391 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:32.023125+0000 mon.a (mon.0) 181 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:48:32.391 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:32.023219+0000 mon.a (mon.0) 182 : cluster [DBG] fsmap 2021-07-26T15:48:32.391 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:32.023269+0000 mon.a (mon.0) 183 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-07-26T15:48:32.391 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:32.023597+0000 mon.a (mon.0) 184 : cluster [DBG] mgrmap e13: y(active, since 80s) 2021-07-26T15:48:32.392 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:32.023883+0000 mon.a (mon.0) 185 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-07-26T15:48:32.392 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:32.023928+0000 mon.a (mon.0) 186 : cluster [INF] Cluster is now healthy 2021-07-26T15:48:32.392 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[14790]: cluster 2021-07-26T15:48:32.028993+0000 mon.a (mon.0) 187 : cluster [INF] overall HEALTH_OK 2021-07-26T15:48:32.392 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:26.977004+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-07-26T15:48:32.393 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:32.006650+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-07-26T15:48:32.393 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:32.011033+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-07-26T15:48:32.393 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:32.011092+0000 mon.a (mon.0) 179 : cluster [INF] mon.a calling monitor election 2021-07-26T15:48:32.393 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:32.015342+0000 mon.a (mon.0) 180 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:48:32.394 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:32.023125+0000 mon.a (mon.0) 181 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:48:32.394 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:32.023219+0000 mon.a (mon.0) 182 : cluster [DBG] fsmap 2021-07-26T15:48:32.394 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:32.023269+0000 mon.a (mon.0) 183 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-07-26T15:48:32.394 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:32.023597+0000 mon.a (mon.0) 184 : cluster [DBG] mgrmap e13: y(active, since 80s) 2021-07-26T15:48:32.394 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:32.023883+0000 mon.a (mon.0) 185 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-07-26T15:48:32.395 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:32.023928+0000 mon.a (mon.0) 186 : cluster [INF] Cluster is now healthy 2021-07-26T15:48:32.395 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:32 smithi033 bash[19094]: cluster 2021-07-26T15:48:32.028993+0000 mon.a (mon.0) 187 : cluster [INF] overall HEALTH_OK 2021-07-26T15:48:32.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:29.479917+0000 mgr.y (mgr.14146) 46 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:32.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cephadm 2021-07-26T15:48:30.016990+0000 mgr.y (mgr.14146) 47 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:48:32.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: audit 2021-07-26T15:48:30.316035+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:32.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: audit 2021-07-26T15:48:30.323065+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:32.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: audit 2021-07-26T15:48:30.325711+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:32.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: audit 2021-07-26T15:48:30.327266+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:48:32.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: audit 2021-07-26T15:48:30.328787+0000 mon.a (mon.0) 175 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:32.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: audit 2021-07-26T15:48:30.978759+0000 mon.a (mon.0) 176 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:32.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:26.977004+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-07-26T15:48:32.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:32.006650+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-07-26T15:48:32.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:32.011033+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2021-07-26T15:48:32.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:32.011092+0000 mon.a (mon.0) 179 : cluster [INF] mon.a calling monitor election 2021-07-26T15:48:32.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:32.015342+0000 mon.a (mon.0) 180 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:48:32.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:32.023125+0000 mon.a (mon.0) 181 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:48:32.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:32.023219+0000 mon.a (mon.0) 182 : cluster [DBG] fsmap 2021-07-26T15:48:32.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:32.023269+0000 mon.a (mon.0) 183 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-07-26T15:48:32.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:32.023597+0000 mon.a (mon.0) 184 : cluster [DBG] mgrmap e13: y(active, since 80s) 2021-07-26T15:48:32.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:32.023883+0000 mon.a (mon.0) 185 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2021-07-26T15:48:32.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:32.023928+0000 mon.a (mon.0) 186 : cluster [INF] Cluster is now healthy 2021-07-26T15:48:32.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:32 smithi096 bash[15117]: cluster 2021-07-26T15:48:32.028993+0000 mon.a (mon.0) 187 : cluster [INF] overall HEALTH_OK 2021-07-26T15:48:33.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[14790]: cluster 2021-07-26T15:48:31.480400+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:33.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[14790]: audit 2021-07-26T15:48:32.431004+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:33.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[14790]: audit 2021-07-26T15:48:32.432283+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:33.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[14790]: audit 2021-07-26T15:48:32.433525+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:48:33.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[14790]: audit 2021-07-26T15:48:32.434941+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:33.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[14790]: audit 2021-07-26T15:48:32.979262+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:33.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[19094]: cluster 2021-07-26T15:48:31.480400+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:33.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[19094]: audit 2021-07-26T15:48:32.431004+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:33.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[19094]: audit 2021-07-26T15:48:32.432283+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:33.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[19094]: audit 2021-07-26T15:48:32.433525+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:48:33.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[19094]: audit 2021-07-26T15:48:32.434941+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:33.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:33 smithi033 bash[19094]: audit 2021-07-26T15:48:32.979262+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:33.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:33 smithi096 bash[15117]: cluster 2021-07-26T15:48:31.480400+0000 mgr.y (mgr.14146) 51 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:33.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:33 smithi096 bash[15117]: audit 2021-07-26T15:48:32.431004+0000 mon.a (mon.0) 188 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:33.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:33 smithi096 bash[15117]: audit 2021-07-26T15:48:32.432283+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:33.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:33 smithi096 bash[15117]: audit 2021-07-26T15:48:32.433525+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:48:33.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:33 smithi096 bash[15117]: audit 2021-07-26T15:48:32.434941+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:33.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:33 smithi096 bash[15117]: audit 2021-07-26T15:48:32.979262+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:48:34.357 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:34 smithi033 bash[19094]: cephadm 2021-07-26T15:48:32.431875+0000 mgr.y (mgr.14146) 52 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-07-26T15:48:34.358 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:34 smithi033 bash[19094]: cephadm 2021-07-26T15:48:32.436511+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring daemon mon.c on smithi033 2021-07-26T15:48:34.359 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:34 smithi033 bash[14790]: cephadm 2021-07-26T15:48:32.431875+0000 mgr.y (mgr.14146) 52 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-07-26T15:48:34.359 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:34 smithi033 bash[14790]: cephadm 2021-07-26T15:48:32.436511+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring daemon mon.c on smithi033 2021-07-26T15:48:34.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:34 smithi096 bash[15117]: cephadm 2021-07-26T15:48:32.431875+0000 mgr.y (mgr.14146) 52 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-07-26T15:48:34.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:34 smithi096 bash[15117]: cephadm 2021-07-26T15:48:32.436511+0000 mgr.y (mgr.14146) 53 : cephadm [INF] Reconfiguring daemon mon.c on smithi033 2021-07-26T15:48:35.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:35 smithi033 bash[14790]: cluster 2021-07-26T15:48:33.480811+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:35.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:35 smithi033 bash[19094]: cluster 2021-07-26T15:48:33.480811+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:35.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:35 smithi096 bash[15117]: cluster 2021-07-26T15:48:33.480811+0000 mgr.y (mgr.14146) 54 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:36.862 INFO:teuthology.orchestra.run.smithi033.stdout:# minimal ceph.conf for 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:48:36.863 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2021-07-26T15:48:36.863 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:48:36.863 INFO:teuthology.orchestra.run.smithi033.stdout: mon_host = [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] 2021-07-26T15:48:37.170 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:36 smithi096 bash[15117]: cluster 2021-07-26T15:48:35.481230+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:37.170 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:36 smithi096 bash[15117]: audit 2021-07-26T15:48:35.874014+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:37.171 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:36 smithi096 bash[15117]: cephadm 2021-07-26T15:48:35.875021+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-07-26T15:48:37.171 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:36 smithi096 bash[15117]: audit 2021-07-26T15:48:35.875578+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:37.171 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:36 smithi096 bash[15117]: audit 2021-07-26T15:48:35.877152+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:48:37.171 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:36 smithi096 bash[15117]: audit 2021-07-26T15:48:35.878893+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:37.172 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:36 smithi096 bash[15117]: cephadm 2021-07-26T15:48:35.880392+0000 mgr.y (mgr.14146) 57 : cephadm [INF] Reconfiguring daemon mon.b on smithi096 2021-07-26T15:48:37.172 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:36 smithi096 bash[15117]: audit 2021-07-26T15:48:36.863854+0000 mon.a (mon.0) 197 : audit [DBG] from='client.? 172.21.15.33:0/931685786' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:37.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[14790]: cluster 2021-07-26T15:48:35.481230+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:37.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[14790]: audit 2021-07-26T15:48:35.874014+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:37.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[14790]: cephadm 2021-07-26T15:48:35.875021+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-07-26T15:48:37.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[14790]: audit 2021-07-26T15:48:35.875578+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:37.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[14790]: audit 2021-07-26T15:48:35.877152+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:48:37.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[14790]: audit 2021-07-26T15:48:35.878893+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:37.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[14790]: cephadm 2021-07-26T15:48:35.880392+0000 mgr.y (mgr.14146) 57 : cephadm [INF] Reconfiguring daemon mon.b on smithi096 2021-07-26T15:48:37.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[14790]: audit 2021-07-26T15:48:36.863854+0000 mon.a (mon.0) 197 : audit [DBG] from='client.? 172.21.15.33:0/931685786' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:37.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[19094]: cluster 2021-07-26T15:48:35.481230+0000 mgr.y (mgr.14146) 55 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:37.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[19094]: audit 2021-07-26T15:48:35.874014+0000 mon.a (mon.0) 193 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:37.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[19094]: cephadm 2021-07-26T15:48:35.875021+0000 mgr.y (mgr.14146) 56 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-07-26T15:48:37.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[19094]: audit 2021-07-26T15:48:35.875578+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:48:37.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[19094]: audit 2021-07-26T15:48:35.877152+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:48:37.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[19094]: audit 2021-07-26T15:48:35.878893+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:37.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[19094]: cephadm 2021-07-26T15:48:35.880392+0000 mgr.y (mgr.14146) 57 : cephadm [INF] Reconfiguring daemon mon.b on smithi096 2021-07-26T15:48:37.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:36 smithi033 bash[19094]: audit 2021-07-26T15:48:36.863854+0000 mon.a (mon.0) 197 : audit [DBG] from='client.? 172.21.15.33:0/931685786' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:37.541 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-07-26T15:48:37.541 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:48:37.542 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.conf 2021-07-26T15:48:37.554 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:48:37.555 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:48:37.572 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:48:37.572 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.conf 2021-07-26T15:48:37.589 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:48:37.589 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:48:37.649 INFO:tasks.cephadm:Adding mgr.y on smithi033 2021-07-26T15:48:37.649 INFO:tasks.cephadm:Adding mgr.x on smithi096 2021-07-26T15:48:37.649 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch apply mgr '2;smithi033=y;smithi096=x' 2021-07-26T15:48:38.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[14790]: cluster 2021-07-26T15:48:37.481657+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:38.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[14790]: audit 2021-07-26T15:48:37.684037+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:38.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[14790]: audit 2021-07-26T15:48:37.685678+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:38.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[14790]: audit 2021-07-26T15:48:37.688255+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:38.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[14790]: audit 2021-07-26T15:48:37.690007+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:38.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[14790]: cephadm 2021-07-26T15:48:37.693081+0000 mgr.y (mgr.14146) 59 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:48:38.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[14790]: cephadm 2021-07-26T15:48:37.693613+0000 mgr.y (mgr.14146) 60 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:48:38.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[14790]: audit 2021-07-26T15:48:37.718954+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:38.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[14790]: audit 2021-07-26T15:48:37.725300+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:38.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[14790]: audit 2021-07-26T15:48:37.732778+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:38.957 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[19094]: cluster 2021-07-26T15:48:37.481657+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:38.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[19094]: audit 2021-07-26T15:48:37.684037+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:38.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[19094]: audit 2021-07-26T15:48:37.685678+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:38.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[19094]: audit 2021-07-26T15:48:37.688255+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:38.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[19094]: audit 2021-07-26T15:48:37.690007+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:38.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[19094]: cephadm 2021-07-26T15:48:37.693081+0000 mgr.y (mgr.14146) 59 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:48:38.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[19094]: cephadm 2021-07-26T15:48:37.693613+0000 mgr.y (mgr.14146) 60 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:48:38.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[19094]: audit 2021-07-26T15:48:37.718954+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:38.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[19094]: audit 2021-07-26T15:48:37.725300+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:38.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:38 smithi033 bash[19094]: audit 2021-07-26T15:48:37.732778+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:38.961 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:38 smithi096 bash[15117]: cluster 2021-07-26T15:48:37.481657+0000 mgr.y (mgr.14146) 58 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:38.961 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:38 smithi096 bash[15117]: audit 2021-07-26T15:48:37.684037+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:38.962 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:38 smithi096 bash[15117]: audit 2021-07-26T15:48:37.685678+0000 mon.a (mon.0) 199 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:38.962 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:38 smithi096 bash[15117]: audit 2021-07-26T15:48:37.688255+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:38.963 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:38 smithi096 bash[15117]: audit 2021-07-26T15:48:37.690007+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:38.964 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:38 smithi096 bash[15117]: cephadm 2021-07-26T15:48:37.693081+0000 mgr.y (mgr.14146) 59 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:48:38.964 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:38 smithi096 bash[15117]: cephadm 2021-07-26T15:48:37.693613+0000 mgr.y (mgr.14146) 60 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:48:38.964 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:38 smithi096 bash[15117]: audit 2021-07-26T15:48:37.718954+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:38.964 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:38 smithi096 bash[15117]: audit 2021-07-26T15:48:37.725300+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:38.965 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:38 smithi096 bash[15117]: audit 2021-07-26T15:48:37.732778+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:40.644 INFO:teuthology.orchestra.run.smithi096.stdout:Scheduled mgr update... 2021-07-26T15:48:40.935 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:40 smithi096 bash[15117]: cluster 2021-07-26T15:48:39.482103+0000 mgr.y (mgr.14146) 61 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:40.936 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:40 smithi096 bash[15117]: audit 2021-07-26T15:48:40.643894+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:40.936 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:40 smithi096 bash[15117]: audit 2021-07-26T15:48:40.645428+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:40.936 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:40 smithi096 bash[15117]: audit 2021-07-26T15:48:40.648030+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:40.936 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:40 smithi096 bash[15117]: audit 2021-07-26T15:48:40.649618+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:40.937 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:40 smithi096 bash[15117]: audit 2021-07-26T15:48:40.658240+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:40.937 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:40 smithi096 bash[15117]: audit 2021-07-26T15:48:40.660199+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:48:40.937 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:40 smithi096 bash[15117]: audit 2021-07-26T15:48:40.664659+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-07-26T15:48:40.937 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:40 smithi096 bash[15117]: audit 2021-07-26T15:48:40.666113+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:48:40.938 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:40 smithi096 bash[15117]: audit 2021-07-26T15:48:40.667811+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:40.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[14790]: cluster 2021-07-26T15:48:39.482103+0000 mgr.y (mgr.14146) 61 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:40.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[14790]: audit 2021-07-26T15:48:40.643894+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:40.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[14790]: audit 2021-07-26T15:48:40.645428+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:40.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[14790]: audit 2021-07-26T15:48:40.648030+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:40.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[14790]: audit 2021-07-26T15:48:40.649618+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:40.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[14790]: audit 2021-07-26T15:48:40.658240+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:40.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[14790]: audit 2021-07-26T15:48:40.660199+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:48:40.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[14790]: audit 2021-07-26T15:48:40.664659+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-07-26T15:48:40.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[14790]: audit 2021-07-26T15:48:40.666113+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:48:40.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[14790]: audit 2021-07-26T15:48:40.667811+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:40.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[19094]: cluster 2021-07-26T15:48:39.482103+0000 mgr.y (mgr.14146) 61 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:40.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[19094]: audit 2021-07-26T15:48:40.643894+0000 mon.a (mon.0) 205 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:40.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[19094]: audit 2021-07-26T15:48:40.645428+0000 mon.a (mon.0) 206 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:40.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[19094]: audit 2021-07-26T15:48:40.648030+0000 mon.a (mon.0) 207 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:40.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[19094]: audit 2021-07-26T15:48:40.649618+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:40.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[19094]: audit 2021-07-26T15:48:40.658240+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:40.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[19094]: audit 2021-07-26T15:48:40.660199+0000 mon.a (mon.0) 210 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:48:40.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[19094]: audit 2021-07-26T15:48:40.664659+0000 mon.a (mon.0) 211 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-07-26T15:48:40.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[19094]: audit 2021-07-26T15:48:40.666113+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:48:40.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:40 smithi033 bash[19094]: audit 2021-07-26T15:48:40.667811+0000 mon.a (mon.0) 213 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:41.554 DEBUG:teuthology.orchestra.run.smithi096:mgr.x> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.x.service 2021-07-26T15:48:41.557 INFO:tasks.cephadm:Deploying OSDs... 2021-07-26T15:48:41.557 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:48:41.558 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2021-07-26T15:48:41.566 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-07-26T15:48:41.566 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-07-26T15:48:41.573 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-07-26T15:48:41.574 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:48:41.574 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 349 Links: 1 2021-07-26T15:48:41.575 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:48:41.575 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2021-07-26 15:42:28.640308866 +0000 2021-07-26T15:48:41.575 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2021-07-26 15:42:28.456308871 +0000 2021-07-26T15:48:41.576 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2021-07-26 15:42:28.456308871 +0000 2021-07-26T15:48:41.576 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2021-07-26T15:48:41.585 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2021-07-26T15:48:41.585 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2021-07-26T15:48:41.585 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000404058 s, 1.3 MB/s 2021-07-26T15:48:41.589 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-07-26T15:48:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-07-26T15:48:41.596 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:48:41.596 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 354 Links: 1 2021-07-26T15:48:41.596 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:48:41.597 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2021-07-26 15:42:29.036308855 +0000 2021-07-26T15:48:41.597 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2021-07-26 15:42:28.872308860 +0000 2021-07-26T15:48:41.597 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2021-07-26 15:42:28.872308860 +0000 2021-07-26T15:48:41.597 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2021-07-26T15:48:41.605 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2021-07-26T15:48:41.606 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2021-07-26T15:48:41.606 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000398487 s, 1.3 MB/s 2021-07-26T15:48:41.610 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-07-26T15:48:41.665 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-07-26T15:48:41.666 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:48:41.666 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 358 Links: 1 2021-07-26T15:48:41.667 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:48:41.667 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2021-07-26 15:42:29.420308844 +0000 2021-07-26T15:48:41.667 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2021-07-26 15:42:29.248308849 +0000 2021-07-26T15:48:41.667 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2021-07-26 15:42:29.248308849 +0000 2021-07-26T15:48:41.668 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2021-07-26T15:48:41.676 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2021-07-26T15:48:41.676 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2021-07-26T15:48:41.677 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000411184 s, 1.2 MB/s 2021-07-26T15:48:41.682 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-07-26T15:48:41.689 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-07-26T15:48:41.690 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:48:41.690 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 366 Links: 1 2021-07-26T15:48:41.690 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:48:41.690 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2021-07-26 15:42:29.804308834 +0000 2021-07-26T15:48:41.690 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2021-07-26 15:42:29.644308838 +0000 2021-07-26T15:48:41.691 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2021-07-26 15:42:29.644308838 +0000 2021-07-26T15:48:41.691 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2021-07-26T15:48:41.698 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2021-07-26T15:48:41.698 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2021-07-26T15:48:41.699 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.00034668 s, 1.5 MB/s 2021-07-26T15:48:41.703 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:48:41.703 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2021-07-26T15:48:41.711 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-07-26T15:48:41.712 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-07-26T15:48:41.719 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-07-26T15:48:41.719 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:48:41.720 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 350 Links: 1 2021-07-26T15:48:41.720 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:48:41.720 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2021-07-26 15:42:28.667997827 +0000 2021-07-26T15:48:41.720 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2021-07-26 15:42:28.663997827 +0000 2021-07-26T15:48:41.721 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2021-07-26 15:42:28.663997827 +0000 2021-07-26T15:48:41.721 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2021-07-26T15:48:41.730 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2021-07-26T15:48:41.730 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2021-07-26T15:48:41.730 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000389573 s, 1.3 MB/s 2021-07-26T15:48:41.735 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-07-26T15:48:41.742 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-07-26T15:48:41.743 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:48:41.744 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 356 Links: 1 2021-07-26T15:48:41.744 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:48:41.744 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2021-07-26 15:42:29.099997822 +0000 2021-07-26T15:48:41.744 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2021-07-26 15:42:29.095997822 +0000 2021-07-26T15:48:41.745 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2021-07-26 15:42:29.095997822 +0000 2021-07-26T15:48:41.745 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2021-07-26T15:48:41.751 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2021-07-26T15:48:41.751 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2021-07-26T15:48:41.752 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000302595 s, 1.7 MB/s 2021-07-26T15:48:41.756 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-07-26T15:48:41.777 INFO:journalctl@ceph.mgr.x.smithi096.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:48:41.784 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-07-26T15:48:41.784 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:48:41.784 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 363 Links: 1 2021-07-26T15:48:41.784 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:48:41.785 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2021-07-26 15:42:29.643997816 +0000 2021-07-26T15:48:41.785 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2021-07-26 15:42:29.499997818 +0000 2021-07-26T15:48:41.785 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2021-07-26 15:42:29.499997818 +0000 2021-07-26T15:48:41.785 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2021-07-26T15:48:41.793 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2021-07-26T15:48:41.794 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2021-07-26T15:48:41.794 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000370126 s, 1.4 MB/s 2021-07-26T15:48:41.799 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-07-26T15:48:41.851 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-07-26T15:48:41.852 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:48:41.852 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 369 Links: 1 2021-07-26T15:48:41.852 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:48:41.853 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2021-07-26 15:42:30.023997812 +0000 2021-07-26T15:48:41.853 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2021-07-26 15:42:29.851997814 +0000 2021-07-26T15:48:41.853 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2021-07-26 15:42:29.851997814 +0000 2021-07-26T15:48:41.853 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2021-07-26T15:48:41.859 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:41 smithi096 bash[15117]: audit 2021-07-26T15:48:40.635970+0000 mgr.y (mgr.14146) 62 : audit [DBG] from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi033=y;smithi096=x", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:48:41.860 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:41 smithi096 bash[15117]: cephadm 2021-07-26T15:48:40.637558+0000 mgr.y (mgr.14146) 63 : cephadm [INF] Saving service mgr spec with placement smithi033=y;smithi096=x;count:2 2021-07-26T15:48:41.860 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:41 smithi096 bash[15117]: cephadm 2021-07-26T15:48:40.669095+0000 mgr.y (mgr.14146) 64 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:48:41.862 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2021-07-26T15:48:41.862 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2021-07-26T15:48:41.863 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000406941 s, 1.3 MB/s 2021-07-26T15:48:41.866 INFO:tasks.cephadm:Deploying osd.0 on smithi033 with /dev/vg_nvme/lv_4... 2021-07-26T15:48:41.867 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-07-26T15:48:41.879 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:41 smithi033 bash[19094]: audit 2021-07-26T15:48:40.635970+0000 mgr.y (mgr.14146) 62 : audit [DBG] from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi033=y;smithi096=x", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:48:41.879 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:41 smithi033 bash[19094]: cephadm 2021-07-26T15:48:40.637558+0000 mgr.y (mgr.14146) 63 : cephadm [INF] Saving service mgr spec with placement smithi033=y;smithi096=x;count:2 2021-07-26T15:48:41.880 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:41 smithi033 bash[19094]: cephadm 2021-07-26T15:48:40.669095+0000 mgr.y (mgr.14146) 64 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:48:41.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:41 smithi033 bash[14790]: audit 2021-07-26T15:48:40.635970+0000 mgr.y (mgr.14146) 62 : audit [DBG] from='client.24107 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi033=y;smithi096=x", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:48:41.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:41 smithi033 bash[14790]: cephadm 2021-07-26T15:48:40.637558+0000 mgr.y (mgr.14146) 63 : cephadm [INF] Saving service mgr spec with placement smithi033=y;smithi096=x;count:2 2021-07-26T15:48:41.881 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:41 smithi033 bash[14790]: cephadm 2021-07-26T15:48:40.669095+0000 mgr.y (mgr.14146) 64 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:48:43.403 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:43 smithi033 bash[14790]: cluster 2021-07-26T15:48:41.482602+0000 mgr.y (mgr.14146) 65 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:43.404 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:43 smithi033 bash[19094]: cluster 2021-07-26T15:48:41.482602+0000 mgr.y (mgr.14146) 65 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:43.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:43 smithi096 bash[15117]: cluster 2021-07-26T15:48:41.482602+0000 mgr.y (mgr.14146) 65 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:43.489 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:48:43 smithi096 bash[15762]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:48:44.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:44 smithi033 bash[14790]: audit 2021-07-26T15:48:43.183914+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:44.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:44 smithi033 bash[14790]: audit 2021-07-26T15:48:43.186974+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:44.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:44 smithi033 bash[14790]: audit 2021-07-26T15:48:43.189462+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:44.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:44 smithi033 bash[14790]: audit 2021-07-26T15:48:43.191114+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:44.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:44 smithi033 bash[14790]: cluster 2021-07-26T15:48:43.483163+0000 mgr.y (mgr.14146) 66 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:44.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:44 smithi033 bash[19094]: audit 2021-07-26T15:48:43.183914+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:44.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:44 smithi033 bash[19094]: audit 2021-07-26T15:48:43.186974+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:44.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:44 smithi033 bash[19094]: audit 2021-07-26T15:48:43.189462+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:44.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:44 smithi033 bash[19094]: audit 2021-07-26T15:48:43.191114+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:44.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:44 smithi033 bash[19094]: cluster 2021-07-26T15:48:43.483163+0000 mgr.y (mgr.14146) 66 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:44.488 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:48:44 smithi096 bash[15762]: debug 2021-07-26T15:48:44.210+0000 7f5aa5fff700 1 -- 172.21.15.96:0/1864624333 <== mon.1 v2:172.21.15.33:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560bbfe944e0 con 0x560bbff83000 2021-07-26T15:48:44.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:44 smithi096 bash[15117]: audit 2021-07-26T15:48:43.183914+0000 mon.a (mon.0) 214 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:44.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:44 smithi096 bash[15117]: audit 2021-07-26T15:48:43.186974+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:44.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:44 smithi096 bash[15117]: audit 2021-07-26T15:48:43.189462+0000 mon.a (mon.0) 216 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:44.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:44 smithi096 bash[15117]: audit 2021-07-26T15:48:43.191114+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:44.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:44 smithi096 bash[15117]: cluster 2021-07-26T15:48:43.483163+0000 mgr.y (mgr.14146) 66 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-07-26T15:48:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-07-26T15:48:45.462 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2021-07-26T15:48:45.462 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2021-07-26T15:48:45.463 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0190099 s, 552 MB/s 2021-07-26T15:48:45.463 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2021-07-26T15:48:46.147 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch daemon add osd smithi033:vg_nvme/lv_4 2021-07-26T15:48:46.370 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:46 smithi033 bash[19094]: audit 2021-07-26T15:48:45.017277+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:46.371 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:46 smithi033 bash[14790]: audit 2021-07-26T15:48:45.017277+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:46.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:46 smithi096 bash[15117]: audit 2021-07-26T15:48:45.017277+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:47.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[14790]: cluster 2021-07-26T15:48:45.483605+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:47.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[14790]: audit 2021-07-26T15:48:46.338930+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:47.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[14790]: audit 2021-07-26T15:48:46.348147+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:47.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[14790]: audit 2021-07-26T15:48:46.350161+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:48:47.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[14790]: audit 2021-07-26T15:48:46.351195+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:48:47.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[14790]: audit 2021-07-26T15:48:46.352308+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:47.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[19094]: cluster 2021-07-26T15:48:45.483605+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:47.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[19094]: audit 2021-07-26T15:48:46.338930+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:47.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[19094]: audit 2021-07-26T15:48:46.348147+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:47.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[19094]: audit 2021-07-26T15:48:46.350161+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:48:47.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[19094]: audit 2021-07-26T15:48:46.351195+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:48:47.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:47 smithi033 bash[19094]: audit 2021-07-26T15:48:46.352308+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:47.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:47 smithi096 bash[15117]: cluster 2021-07-26T15:48:45.483605+0000 mgr.y (mgr.14146) 67 : cluster [DBG] pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:47.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:47 smithi096 bash[15117]: audit 2021-07-26T15:48:46.338930+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:47.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:47 smithi096 bash[15117]: audit 2021-07-26T15:48:46.348147+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:47.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:47 smithi096 bash[15117]: audit 2021-07-26T15:48:46.350161+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:48:47.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:47 smithi096 bash[15117]: audit 2021-07-26T15:48:46.351195+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:48:47.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:47 smithi096 bash[15117]: audit 2021-07-26T15:48:46.352308+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:48.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:48 smithi033 bash[14790]: cephadm 2021-07-26T15:48:46.349835+0000 mgr.y (mgr.14146) 68 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-07-26T15:48:48.159 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:48 smithi033 bash[14790]: cephadm 2021-07-26T15:48:46.353360+0000 mgr.y (mgr.14146) 69 : cephadm [INF] Reconfiguring daemon mgr.y on smithi033 2021-07-26T15:48:48.160 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:48 smithi033 bash[19094]: cephadm 2021-07-26T15:48:46.349835+0000 mgr.y (mgr.14146) 68 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-07-26T15:48:48.160 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:48 smithi033 bash[19094]: cephadm 2021-07-26T15:48:46.353360+0000 mgr.y (mgr.14146) 69 : cephadm [INF] Reconfiguring daemon mgr.y on smithi033 2021-07-26T15:48:48.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:48 smithi096 bash[15117]: cephadm 2021-07-26T15:48:46.349835+0000 mgr.y (mgr.14146) 68 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-07-26T15:48:48.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:48 smithi096 bash[15117]: cephadm 2021-07-26T15:48:46.353360+0000 mgr.y (mgr.14146) 69 : cephadm [INF] Reconfiguring daemon mgr.y on smithi033 2021-07-26T15:48:49.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:49 smithi033 bash[14790]: cluster 2021-07-26T15:48:47.484017+0000 mgr.y (mgr.14146) 70 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:49.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:49 smithi033 bash[19094]: cluster 2021-07-26T15:48:47.484017+0000 mgr.y (mgr.14146) 70 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:49.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:49 smithi096 bash[15117]: cluster 2021-07-26T15:48:47.484017+0000 mgr.y (mgr.14146) 70 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:50.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[14790]: audit 2021-07-26T15:48:49.142541+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:50.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[14790]: audit 2021-07-26T15:48:49.144713+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:50.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[14790]: audit 2021-07-26T15:48:49.147262+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:50.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[14790]: audit 2021-07-26T15:48:49.149114+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:50.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[14790]: audit 2021-07-26T15:48:49.158289+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:50.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[14790]: cluster 2021-07-26T15:48:49.484535+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:50.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[19094]: audit 2021-07-26T15:48:49.142541+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:50.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[19094]: audit 2021-07-26T15:48:49.144713+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:50.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[19094]: audit 2021-07-26T15:48:49.147262+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:50.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[19094]: audit 2021-07-26T15:48:49.149114+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:50.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[19094]: audit 2021-07-26T15:48:49.158289+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:50.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:50 smithi033 bash[19094]: cluster 2021-07-26T15:48:49.484535+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:50.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:50 smithi096 bash[15117]: audit 2021-07-26T15:48:49.142541+0000 mon.a (mon.0) 224 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:50.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:50 smithi096 bash[15117]: audit 2021-07-26T15:48:49.144713+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:48:50.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:50 smithi096 bash[15117]: audit 2021-07-26T15:48:49.147262+0000 mon.a (mon.0) 226 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:50.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:50 smithi096 bash[15117]: audit 2021-07-26T15:48:49.149114+0000 mon.a (mon.0) 227 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:48:50.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:50 smithi096 bash[15117]: audit 2021-07-26T15:48:49.158289+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:48:50.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:50 smithi096 bash[15117]: cluster 2021-07-26T15:48:49.484535+0000 mgr.y (mgr.14146) 71 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:51.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[14790]: audit 2021-07-26T15:48:50.207595+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:48:51.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[14790]: audit 2021-07-26T15:48:50.208365+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:48:51.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[14790]: cluster 2021-07-26T15:48:50.209840+0000 mon.a (mon.0) 229 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:48:51.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[14790]: audit 2021-07-26T15:48:50.210366+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:48:51.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[14790]: audit 2021-07-26T15:48:50.211122+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:48:51.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[14790]: audit 2021-07-26T15:48:50.521762+0000 mgr.y (mgr.14146) 72 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:48:51.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[14790]: audit 2021-07-26T15:48:50.522864+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:48:51.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[14790]: audit 2021-07-26T15:48:50.526486+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:48:51.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[14790]: audit 2021-07-26T15:48:50.527805+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:51.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[19094]: audit 2021-07-26T15:48:50.207595+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:48:51.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[19094]: audit 2021-07-26T15:48:50.208365+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:48:51.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[19094]: cluster 2021-07-26T15:48:50.209840+0000 mon.a (mon.0) 229 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:48:51.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[19094]: audit 2021-07-26T15:48:50.210366+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:48:51.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[19094]: audit 2021-07-26T15:48:50.211122+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:48:51.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[19094]: audit 2021-07-26T15:48:50.521762+0000 mgr.y (mgr.14146) 72 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:48:51.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[19094]: audit 2021-07-26T15:48:50.522864+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:48:51.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[19094]: audit 2021-07-26T15:48:50.526486+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:48:51.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:51 smithi033 bash[19094]: audit 2021-07-26T15:48:50.527805+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:51.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:51 smithi096 bash[15117]: audit 2021-07-26T15:48:50.207595+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:48:51.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:51 smithi096 bash[15117]: audit 2021-07-26T15:48:50.208365+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:48:51.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:51 smithi096 bash[15117]: cluster 2021-07-26T15:48:50.209840+0000 mon.a (mon.0) 229 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:48:51.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:51 smithi096 bash[15117]: audit 2021-07-26T15:48:50.210366+0000 mon.b (mon.2) 5 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:48:51.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:51 smithi096 bash[15117]: audit 2021-07-26T15:48:50.211122+0000 mon.b (mon.2) 6 : audit [DBG] from='mgr.? 172.21.15.96:0/2857633764' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:48:51.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:51 smithi096 bash[15117]: audit 2021-07-26T15:48:50.521762+0000 mgr.y (mgr.14146) 72 : audit [DBG] from='client.14202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:48:51.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:51 smithi096 bash[15117]: audit 2021-07-26T15:48:50.522864+0000 mon.a (mon.0) 230 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:48:51.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:51 smithi096 bash[15117]: audit 2021-07-26T15:48:50.526486+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:48:51.497 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:51 smithi096 bash[15117]: audit 2021-07-26T15:48:50.527805+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:48:52.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:52 smithi033 bash[14790]: cluster 2021-07-26T15:48:51.174380+0000 mon.a (mon.0) 233 : cluster [DBG] mgrmap e14: y(active, since 99s), standbys: x 2021-07-26T15:48:52.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:52 smithi033 bash[14790]: audit 2021-07-26T15:48:51.175683+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-07-26T15:48:52.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:52 smithi033 bash[14790]: cluster 2021-07-26T15:48:51.485018+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:52.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:52 smithi033 bash[19094]: cluster 2021-07-26T15:48:51.174380+0000 mon.a (mon.0) 233 : cluster [DBG] mgrmap e14: y(active, since 99s), standbys: x 2021-07-26T15:48:52.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:52 smithi033 bash[19094]: audit 2021-07-26T15:48:51.175683+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-07-26T15:48:52.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:52 smithi033 bash[19094]: cluster 2021-07-26T15:48:51.485018+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:52.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:52 smithi096 bash[15117]: cluster 2021-07-26T15:48:51.174380+0000 mon.a (mon.0) 233 : cluster [DBG] mgrmap e14: y(active, since 99s), standbys: x 2021-07-26T15:48:52.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:52 smithi096 bash[15117]: audit 2021-07-26T15:48:51.175683+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-07-26T15:48:52.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:52 smithi096 bash[15117]: cluster 2021-07-26T15:48:51.485018+0000 mgr.y (mgr.14146) 73 : cluster [DBG] pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:54.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:54 smithi033 bash[14790]: cluster 2021-07-26T15:48:53.485525+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:54.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:54 smithi033 bash[14790]: audit 2021-07-26T15:48:54.532221+0000 mon.a (mon.0) 235 : audit [INF] from='client.? 172.21.15.33:0/1233172958' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d02e4ad-97fb-45ac-9912-2d795394c8ca"}]: dispatch 2021-07-26T15:48:54.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:54 smithi033 bash[14790]: audit 2021-07-26T15:48:54.537219+0000 mon.a (mon.0) 236 : audit [INF] from='client.? 172.21.15.33:0/1233172958' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d02e4ad-97fb-45ac-9912-2d795394c8ca"}]': finished 2021-07-26T15:48:54.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:54 smithi033 bash[14790]: cluster 2021-07-26T15:48:54.537282+0000 mon.a (mon.0) 237 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2021-07-26T15:48:54.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:54 smithi033 bash[14790]: audit 2021-07-26T15:48:54.537528+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:48:54.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:54 smithi033 bash[19094]: cluster 2021-07-26T15:48:53.485525+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:54.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:54 smithi033 bash[19094]: audit 2021-07-26T15:48:54.532221+0000 mon.a (mon.0) 235 : audit [INF] from='client.? 172.21.15.33:0/1233172958' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d02e4ad-97fb-45ac-9912-2d795394c8ca"}]: dispatch 2021-07-26T15:48:54.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:54 smithi033 bash[19094]: audit 2021-07-26T15:48:54.537219+0000 mon.a (mon.0) 236 : audit [INF] from='client.? 172.21.15.33:0/1233172958' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d02e4ad-97fb-45ac-9912-2d795394c8ca"}]': finished 2021-07-26T15:48:54.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:54 smithi033 bash[19094]: cluster 2021-07-26T15:48:54.537282+0000 mon.a (mon.0) 237 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2021-07-26T15:48:54.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:54 smithi033 bash[19094]: audit 2021-07-26T15:48:54.537528+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:48:54.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:54 smithi096 bash[15117]: cluster 2021-07-26T15:48:53.485525+0000 mgr.y (mgr.14146) 74 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:54.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:54 smithi096 bash[15117]: audit 2021-07-26T15:48:54.532221+0000 mon.a (mon.0) 235 : audit [INF] from='client.? 172.21.15.33:0/1233172958' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3d02e4ad-97fb-45ac-9912-2d795394c8ca"}]: dispatch 2021-07-26T15:48:54.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:54 smithi096 bash[15117]: audit 2021-07-26T15:48:54.537219+0000 mon.a (mon.0) 236 : audit [INF] from='client.? 172.21.15.33:0/1233172958' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3d02e4ad-97fb-45ac-9912-2d795394c8ca"}]': finished 2021-07-26T15:48:54.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:54 smithi096 bash[15117]: cluster 2021-07-26T15:48:54.537282+0000 mon.a (mon.0) 237 : cluster [DBG] osdmap e5: 1 total, 0 up, 1 in 2021-07-26T15:48:54.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:54 smithi096 bash[15117]: audit 2021-07-26T15:48:54.537528+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:48:55.954 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:55 smithi033 bash[14790]: audit 2021-07-26T15:48:55.178076+0000 mon.a (mon.0) 239 : audit [DBG] from='client.? 172.21.15.33:0/3565115304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:48:55.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:55 smithi033 bash[19094]: audit 2021-07-26T15:48:55.178076+0000 mon.a (mon.0) 239 : audit [DBG] from='client.? 172.21.15.33:0/3565115304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:48:55.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:55 smithi096 bash[15117]: audit 2021-07-26T15:48:55.178076+0000 mon.a (mon.0) 239 : audit [DBG] from='client.? 172.21.15.33:0/3565115304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:48:56.954 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:56 smithi033 bash[14790]: cluster 2021-07-26T15:48:55.486024+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:56.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:56 smithi033 bash[19094]: cluster 2021-07-26T15:48:55.486024+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:56.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:56 smithi096 bash[15117]: cluster 2021-07-26T15:48:55.486024+0000 mgr.y (mgr.14146) 75 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:59.439 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:48:59 smithi033 bash[14790]: cluster 2021-07-26T15:48:57.486484+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:59.440 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:48:59 smithi033 bash[19094]: cluster 2021-07-26T15:48:57.486484+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:48:59.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:48:59 smithi096 bash[15117]: cluster 2021-07-26T15:48:57.486484+0000 mgr.y (mgr.14146) 76 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:01.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:01 smithi033 bash[14790]: cluster 2021-07-26T15:48:59.486973+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:01.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:01 smithi033 bash[19094]: cluster 2021-07-26T15:48:59.486973+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:01.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:01 smithi096 bash[15117]: cluster 2021-07-26T15:48:59.486973+0000 mgr.y (mgr.14146) 77 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:03.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:03 smithi033 bash[14790]: cluster 2021-07-26T15:49:01.487412+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:03.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:03 smithi033 bash[14790]: audit 2021-07-26T15:49:02.311923+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-07-26T15:49:03.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:03 smithi033 bash[14790]: audit 2021-07-26T15:49:02.313595+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:03.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:03 smithi033 bash[19094]: cluster 2021-07-26T15:49:01.487412+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:03.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:03 smithi033 bash[19094]: audit 2021-07-26T15:49:02.311923+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-07-26T15:49:03.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:03 smithi033 bash[19094]: audit 2021-07-26T15:49:02.313595+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:03.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:03 smithi096 bash[15117]: cluster 2021-07-26T15:49:01.487412+0000 mgr.y (mgr.14146) 78 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:03.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:03 smithi096 bash[15117]: audit 2021-07-26T15:49:02.311923+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-07-26T15:49:03.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:03 smithi096 bash[15117]: audit 2021-07-26T15:49:02.313595+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:04.328 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:04 smithi033 bash[14790]: cephadm 2021-07-26T15:49:02.314907+0000 mgr.y (mgr.14146) 79 : cephadm [INF] Deploying daemon osd.0 on smithi033 2021-07-26T15:49:04.328 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:04 smithi033 bash[19094]: cephadm 2021-07-26T15:49:02.314907+0000 mgr.y (mgr.14146) 79 : cephadm [INF] Deploying daemon osd.0 on smithi033 2021-07-26T15:49:04.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:04 smithi096 bash[15117]: cephadm 2021-07-26T15:49:02.314907+0000 mgr.y (mgr.14146) 79 : cephadm [INF] Deploying daemon osd.0 on smithi033 2021-07-26T15:49:04.829 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 0 on host 'smithi033' 2021-07-26T15:49:05.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[14790]: cluster 2021-07-26T15:49:03.487887+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:05.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[14790]: audit 2021-07-26T15:49:04.814266+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:05.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[14790]: audit 2021-07-26T15:49:04.816211+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:05.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[14790]: audit 2021-07-26T15:49:04.820971+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:05.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[14790]: audit 2021-07-26T15:49:04.824147+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:05.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[14790]: audit 2021-07-26T15:49:04.829843+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:05.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[19094]: cluster 2021-07-26T15:49:03.487887+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:05.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[19094]: audit 2021-07-26T15:49:04.814266+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:05.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[19094]: audit 2021-07-26T15:49:04.816211+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:05.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[19094]: audit 2021-07-26T15:49:04.820971+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:05.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[19094]: audit 2021-07-26T15:49:04.824147+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:05.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:05 smithi033 bash[19094]: audit 2021-07-26T15:49:04.829843+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:05.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:05 smithi096 bash[15117]: cluster 2021-07-26T15:49:03.487887+0000 mgr.y (mgr.14146) 80 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:05.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:05 smithi096 bash[15117]: audit 2021-07-26T15:49:04.814266+0000 mon.a (mon.0) 242 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:05.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:05 smithi096 bash[15117]: audit 2021-07-26T15:49:04.816211+0000 mon.a (mon.0) 243 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:05.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:05 smithi096 bash[15117]: audit 2021-07-26T15:49:04.820971+0000 mon.a (mon.0) 244 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:05.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:05 smithi096 bash[15117]: audit 2021-07-26T15:49:04.824147+0000 mon.a (mon.0) 245 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:05.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:05 smithi096 bash[15117]: audit 2021-07-26T15:49:04.829843+0000 mon.a (mon.0) 246 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:06.176 DEBUG:teuthology.orchestra.run.smithi033:osd.0> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.0.service 2021-07-26T15:49:06.181 INFO:tasks.cephadm:Deploying osd.1 on smithi033 with /dev/vg_nvme/lv_3... 2021-07-26T15:49:06.182 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-07-26T15:49:06.259 INFO:journalctl@ceph.osd.0.smithi033.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:49:07.324 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:07 smithi033 bash[14790]: cluster 2021-07-26T15:49:05.488351+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:07.325 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:07 smithi033 bash[19094]: cluster 2021-07-26T15:49:05.488351+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:07.325 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:07 smithi033 bash[21402]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-07-26T15:49:07.325 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:07 smithi033 bash[21402]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-07-26T15:49:07.326 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:07 smithi033 bash[21402]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-07-26T15:49:07.326 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:07 smithi033 bash[21402]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-07-26T15:49:07.326 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:07 smithi033 bash[21402]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-07-26T15:49:07.326 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:07 smithi033 bash[21402]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-07-26T15:49:07.327 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:07 smithi033 bash[21402]: --> ceph-volume lvm activate successful for osd ID: 0 2021-07-26T15:49:07.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:07 smithi096 bash[15117]: cluster 2021-07-26T15:49:05.488351+0000 mgr.y (mgr.14146) 81 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:08.253 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:08 smithi033 bash[21582]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:49:09.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:09 smithi033 bash[14790]: cluster 2021-07-26T15:49:07.488866+0000 mgr.y (mgr.14146) 82 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:09.204 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:09 smithi033 bash[19094]: cluster 2021-07-26T15:49:07.488866+0000 mgr.y (mgr.14146) 82 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:09.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:09 smithi096 bash[15117]: cluster 2021-07-26T15:49:07.488866+0000 mgr.y (mgr.14146) 82 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:10.204 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:09 smithi033 bash[21582]: debug 2021-07-26T15:49:09.920+0000 7f601cf09700 1 -- 172.21.15.33:0/3065979972 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cba1d224e0 con 0x55cba1d98c00 2021-07-26T15:49:10.704 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:10 smithi033 bash[21582]: debug 2021-07-26T15:49:10.480+0000 7f60249a2080 -1 Falling back to public interface 2021-07-26T15:49:11.346 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:11 smithi033 bash[14790]: cluster 2021-07-26T15:49:09.489330+0000 mgr.y (mgr.14146) 83 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:11.346 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:11 smithi033 bash[14790]: audit 2021-07-26T15:49:10.132336+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:11.347 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:11 smithi033 bash[19094]: cluster 2021-07-26T15:49:09.489330+0000 mgr.y (mgr.14146) 83 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:11.347 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:11 smithi033 bash[19094]: audit 2021-07-26T15:49:10.132336+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:11.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:11 smithi096 bash[15117]: cluster 2021-07-26T15:49:09.489330+0000 mgr.y (mgr.14146) 83 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:11.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:11 smithi096 bash[15117]: audit 2021-07-26T15:49:10.132336+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:11.902 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-07-26T15:49:11.903 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-07-26T15:49:11.903 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2021-07-26T15:49:11.903 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2021-07-26T15:49:11.903 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0160518 s, 653 MB/s 2021-07-26T15:49:11.904 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2021-07-26T15:49:12.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:12 smithi033 bash[14790]: audit 2021-07-26T15:49:11.663641+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:49:12.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:12 smithi033 bash[14790]: audit 2021-07-26T15:49:11.667269+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:49:12.205 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:12 smithi033 bash[19094]: audit 2021-07-26T15:49:11.663641+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:49:12.205 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:12 smithi033 bash[19094]: audit 2021-07-26T15:49:11.667269+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:49:12.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:12 smithi096 bash[15117]: audit 2021-07-26T15:49:11.663641+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:49:12.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:12 smithi096 bash[15117]: audit 2021-07-26T15:49:11.667269+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:49:13.150 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch daemon add osd smithi033:vg_nvme/lv_3 2021-07-26T15:49:13.348 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:13 smithi033 bash[19094]: cluster 2021-07-26T15:49:11.489819+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:13.349 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:13 smithi033 bash[14790]: cluster 2021-07-26T15:49:11.489819+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:13.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:13 smithi096 bash[15117]: cluster 2021-07-26T15:49:11.489819+0000 mgr.y (mgr.14146) 84 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:13.704 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:13 smithi033 bash[21582]: debug 2021-07-26T15:49:13.460+0000 7f60249a2080 -1 osd.0 0 log_to_monitors {default=true} 2021-07-26T15:49:14.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:14 smithi033 bash[14790]: audit 2021-07-26T15:49:13.471743+0000 mon.a (mon.0) 250 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-07-26T15:49:14.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:14 smithi033 bash[19094]: audit 2021-07-26T15:49:13.471743+0000 mon.a (mon.0) 250 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-07-26T15:49:14.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:14 smithi096 bash[15117]: audit 2021-07-26T15:49:13.471743+0000 mon.a (mon.0) 250 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-07-26T15:49:15.138 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:15 smithi033 bash[14790]: cluster 2021-07-26T15:49:13.490316+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:15.138 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:15 smithi033 bash[14790]: audit 2021-07-26T15:49:14.092638+0000 mon.a (mon.0) 251 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-07-26T15:49:15.454 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:49:15 smithi033 bash[21582]: debug 2021-07-26T15:49:15.096+0000 7f601af05700 -1 osd.0 0 waiting for initial osdmap 2021-07-26T15:49:15.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:15 smithi033 bash[14790]: cluster 2021-07-26T15:49:14.092832+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2021-07-26T15:49:15.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:15 smithi033 bash[14790]: audit 2021-07-26T15:49:14.093131+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:15.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:15 smithi033 bash[14790]: audit 2021-07-26T15:49:14.094519+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:49:15.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:15 smithi033 bash[19094]: cluster 2021-07-26T15:49:13.490316+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:15.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:15 smithi033 bash[19094]: audit 2021-07-26T15:49:14.092638+0000 mon.a (mon.0) 251 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-07-26T15:49:15.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:15 smithi033 bash[19094]: cluster 2021-07-26T15:49:14.092832+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2021-07-26T15:49:15.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:15 smithi033 bash[19094]: audit 2021-07-26T15:49:14.093131+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:15.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:15 smithi033 bash[19094]: audit 2021-07-26T15:49:14.094519+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:49:15.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:15 smithi096 bash[15117]: cluster 2021-07-26T15:49:13.490316+0000 mgr.y (mgr.14146) 85 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:15.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:15 smithi096 bash[15117]: audit 2021-07-26T15:49:14.092638+0000 mon.a (mon.0) 251 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-07-26T15:49:15.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:15 smithi096 bash[15117]: cluster 2021-07-26T15:49:14.092832+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2021-07-26T15:49:15.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:15 smithi096 bash[15117]: audit 2021-07-26T15:49:14.093131+0000 mon.a (mon.0) 253 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:15.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:15 smithi096 bash[15117]: audit 2021-07-26T15:49:14.094519+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:49:16.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:16 smithi033 bash[14790]: audit 2021-07-26T15:49:15.092817+0000 mon.a (mon.0) 255 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:49:16.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:16 smithi033 bash[14790]: cluster 2021-07-26T15:49:15.092917+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2021-07-26T15:49:16.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:16 smithi033 bash[14790]: audit 2021-07-26T15:49:15.093533+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:16.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:16 smithi033 bash[14790]: audit 2021-07-26T15:49:15.102863+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:16.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:16 smithi033 bash[14790]: cluster 2021-07-26T15:49:15.490892+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:16.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:16 smithi096 bash[15117]: audit 2021-07-26T15:49:15.092817+0000 mon.a (mon.0) 255 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:49:16.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:16 smithi096 bash[15117]: cluster 2021-07-26T15:49:15.092917+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2021-07-26T15:49:16.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:16 smithi096 bash[15117]: audit 2021-07-26T15:49:15.093533+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:16.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:16 smithi096 bash[15117]: audit 2021-07-26T15:49:15.102863+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:16.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:16 smithi096 bash[15117]: cluster 2021-07-26T15:49:15.490892+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:16.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:16 smithi033 bash[19094]: audit 2021-07-26T15:49:15.092817+0000 mon.a (mon.0) 255 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:49:16.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:16 smithi033 bash[19094]: cluster 2021-07-26T15:49:15.092917+0000 mon.a (mon.0) 256 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2021-07-26T15:49:16.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:16 smithi033 bash[19094]: audit 2021-07-26T15:49:15.093533+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:16.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:16 smithi033 bash[19094]: audit 2021-07-26T15:49:15.102863+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:16.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:16 smithi033 bash[19094]: cluster 2021-07-26T15:49:15.490892+0000 mgr.y (mgr.14146) 86 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-07-26T15:49:17.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[14790]: cluster 2021-07-26T15:49:14.437357+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:49:17.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[14790]: cluster 2021-07-26T15:49:14.437535+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:49:17.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[14790]: cluster 2021-07-26T15:49:16.105575+0000 mon.a (mon.0) 259 : cluster [INF] osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081] boot 2021-07-26T15:49:17.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[14790]: cluster 2021-07-26T15:49:16.105666+0000 mon.a (mon.0) 260 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2021-07-26T15:49:17.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[14790]: audit 2021-07-26T15:49:16.106423+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:17.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[14790]: cephadm 2021-07-26T15:49:17.080275+0000 mgr.y (mgr.14146) 87 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:49:17.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[14790]: audit 2021-07-26T15:49:17.087920+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:17.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[14790]: audit 2021-07-26T15:49:17.089491+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:49:17.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[14790]: audit 2021-07-26T15:49:17.102208+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:17.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[14790]: audit 2021-07-26T15:49:17.108380+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:17.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[19094]: cluster 2021-07-26T15:49:14.437357+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:49:17.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[19094]: cluster 2021-07-26T15:49:14.437535+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:49:17.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[19094]: cluster 2021-07-26T15:49:16.105575+0000 mon.a (mon.0) 259 : cluster [INF] osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081] boot 2021-07-26T15:49:17.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[19094]: cluster 2021-07-26T15:49:16.105666+0000 mon.a (mon.0) 260 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2021-07-26T15:49:17.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[19094]: audit 2021-07-26T15:49:16.106423+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:17.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[19094]: cephadm 2021-07-26T15:49:17.080275+0000 mgr.y (mgr.14146) 87 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:49:17.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[19094]: audit 2021-07-26T15:49:17.087920+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:17.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[19094]: audit 2021-07-26T15:49:17.089491+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:49:17.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[19094]: audit 2021-07-26T15:49:17.102208+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:17.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:17 smithi033 bash[19094]: audit 2021-07-26T15:49:17.108380+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:17.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:17 smithi096 bash[15117]: cluster 2021-07-26T15:49:14.437357+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:49:17.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:17 smithi096 bash[15117]: cluster 2021-07-26T15:49:14.437535+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:49:17.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:17 smithi096 bash[15117]: cluster 2021-07-26T15:49:16.105575+0000 mon.a (mon.0) 259 : cluster [INF] osd.0 [v2:172.21.15.33:6802/2786020081,v1:172.21.15.33:6803/2786020081] boot 2021-07-26T15:49:17.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:17 smithi096 bash[15117]: cluster 2021-07-26T15:49:16.105666+0000 mon.a (mon.0) 260 : cluster [DBG] osdmap e8: 1 total, 1 up, 1 in 2021-07-26T15:49:17.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:17 smithi096 bash[15117]: audit 2021-07-26T15:49:16.106423+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:49:17.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:17 smithi096 bash[15117]: cephadm 2021-07-26T15:49:17.080275+0000 mgr.y (mgr.14146) 87 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:49:17.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:17 smithi096 bash[15117]: audit 2021-07-26T15:49:17.087920+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:17.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:17 smithi096 bash[15117]: audit 2021-07-26T15:49:17.089491+0000 mon.a (mon.0) 263 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:49:17.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:17 smithi096 bash[15117]: audit 2021-07-26T15:49:17.102208+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:17.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:17 smithi096 bash[15117]: audit 2021-07-26T15:49:17.108380+0000 mon.a (mon.0) 265 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:18.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[14790]: cephadm 2021-07-26T15:49:17.090519+0000 mgr.y (mgr.14146) 88 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 16262M 2021-07-26T15:49:18.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[14790]: audit 2021-07-26T15:49:17.110869+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:18.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[14790]: audit 2021-07-26T15:49:17.117682+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:18.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[14790]: cluster 2021-07-26T15:49:17.121868+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2021-07-26T15:49:18.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[14790]: audit 2021-07-26T15:49:17.123284+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:18.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[14790]: audit 2021-07-26T15:49:17.366046+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:18.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[14790]: audit 2021-07-26T15:49:17.433545+0000 mgr.y (mgr.14146) 89 : audit [DBG] from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:49:18.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[14790]: audit 2021-07-26T15:49:17.435089+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:49:18.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[14790]: audit 2021-07-26T15:49:17.438331+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:49:18.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[14790]: audit 2021-07-26T15:49:17.439907+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:18.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[14790]: cluster 2021-07-26T15:49:17.491442+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:18.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[19094]: cephadm 2021-07-26T15:49:17.090519+0000 mgr.y (mgr.14146) 88 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 16262M 2021-07-26T15:49:18.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[19094]: audit 2021-07-26T15:49:17.110869+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:18.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[19094]: audit 2021-07-26T15:49:17.117682+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:18.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[19094]: cluster 2021-07-26T15:49:17.121868+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2021-07-26T15:49:18.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[19094]: audit 2021-07-26T15:49:17.123284+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:18.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[19094]: audit 2021-07-26T15:49:17.366046+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:18.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[19094]: audit 2021-07-26T15:49:17.433545+0000 mgr.y (mgr.14146) 89 : audit [DBG] from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:49:18.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[19094]: audit 2021-07-26T15:49:17.435089+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:49:18.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[19094]: audit 2021-07-26T15:49:17.438331+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:49:18.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[19094]: audit 2021-07-26T15:49:17.439907+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:18.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:18 smithi033 bash[19094]: cluster 2021-07-26T15:49:17.491442+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:18.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:18 smithi096 bash[15117]: cephadm 2021-07-26T15:49:17.090519+0000 mgr.y (mgr.14146) 88 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 16262M 2021-07-26T15:49:18.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:18 smithi096 bash[15117]: audit 2021-07-26T15:49:17.110869+0000 mon.a (mon.0) 266 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:18.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:18 smithi096 bash[15117]: audit 2021-07-26T15:49:17.117682+0000 mon.a (mon.0) 267 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:18.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:18 smithi096 bash[15117]: cluster 2021-07-26T15:49:17.121868+0000 mon.a (mon.0) 268 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2021-07-26T15:49:18.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:18 smithi096 bash[15117]: audit 2021-07-26T15:49:17.123284+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:18.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:18 smithi096 bash[15117]: audit 2021-07-26T15:49:17.366046+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:18.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:18 smithi096 bash[15117]: audit 2021-07-26T15:49:17.433545+0000 mgr.y (mgr.14146) 89 : audit [DBG] from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:49:18.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:18 smithi096 bash[15117]: audit 2021-07-26T15:49:17.435089+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:49:18.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:18 smithi096 bash[15117]: audit 2021-07-26T15:49:17.438331+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:49:18.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:18 smithi096 bash[15117]: audit 2021-07-26T15:49:17.439907+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:18.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:18 smithi096 bash[15117]: cluster 2021-07-26T15:49:17.491442+0000 mgr.y (mgr.14146) 90 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:20.954 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:20 smithi033 bash[14790]: cluster 2021-07-26T15:49:19.491941+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:20.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:20 smithi033 bash[19094]: cluster 2021-07-26T15:49:19.491941+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:20.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:20 smithi096 bash[15117]: cluster 2021-07-26T15:49:19.491941+0000 mgr.y (mgr.14146) 91 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:21.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:21 smithi033 bash[19094]: audit 2021-07-26T15:49:21.431828+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.33:0/2312052650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d"}]: dispatch 2021-07-26T15:49:21.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:21 smithi033 bash[19094]: audit 2021-07-26T15:49:21.432457+0000 mon.a (mon.0) 274 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d"}]: dispatch 2021-07-26T15:49:21.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:21 smithi033 bash[19094]: audit 2021-07-26T15:49:21.437623+0000 mon.a (mon.0) 275 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d"}]': finished 2021-07-26T15:49:21.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:21 smithi033 bash[19094]: cluster 2021-07-26T15:49:21.437669+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2021-07-26T15:49:21.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:21 smithi033 bash[19094]: audit 2021-07-26T15:49:21.437895+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:21.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:21 smithi033 bash[14790]: audit 2021-07-26T15:49:21.431828+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.33:0/2312052650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d"}]: dispatch 2021-07-26T15:49:21.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:21 smithi033 bash[14790]: audit 2021-07-26T15:49:21.432457+0000 mon.a (mon.0) 274 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d"}]: dispatch 2021-07-26T15:49:21.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:21 smithi033 bash[14790]: audit 2021-07-26T15:49:21.437623+0000 mon.a (mon.0) 275 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d"}]': finished 2021-07-26T15:49:21.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:21 smithi033 bash[14790]: cluster 2021-07-26T15:49:21.437669+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2021-07-26T15:49:21.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:21 smithi033 bash[14790]: audit 2021-07-26T15:49:21.437895+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:21.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:21 smithi096 bash[15117]: audit 2021-07-26T15:49:21.431828+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.33:0/2312052650' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d"}]: dispatch 2021-07-26T15:49:21.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:21 smithi096 bash[15117]: audit 2021-07-26T15:49:21.432457+0000 mon.a (mon.0) 274 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d"}]: dispatch 2021-07-26T15:49:21.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:21 smithi096 bash[15117]: audit 2021-07-26T15:49:21.437623+0000 mon.a (mon.0) 275 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d"}]': finished 2021-07-26T15:49:21.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:21 smithi096 bash[15117]: cluster 2021-07-26T15:49:21.437669+0000 mon.a (mon.0) 276 : cluster [DBG] osdmap e10: 2 total, 1 up, 2 in 2021-07-26T15:49:21.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:21 smithi096 bash[15117]: audit 2021-07-26T15:49:21.437895+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:23.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:23 smithi033 bash[14790]: cluster 2021-07-26T15:49:21.492442+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:23.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:23 smithi033 bash[14790]: audit 2021-07-26T15:49:22.104558+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.33:0/1607636330' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:49:23.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:23 smithi033 bash[19094]: cluster 2021-07-26T15:49:21.492442+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:23.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:23 smithi033 bash[19094]: audit 2021-07-26T15:49:22.104558+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.33:0/1607636330' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:49:23.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:23 smithi096 bash[15117]: cluster 2021-07-26T15:49:21.492442+0000 mgr.y (mgr.14146) 92 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:23.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:23 smithi096 bash[15117]: audit 2021-07-26T15:49:22.104558+0000 mon.c (mon.1) 5 : audit [DBG] from='client.? 172.21.15.33:0/1607636330' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:49:25.427 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:25 smithi033 bash[19094]: cluster 2021-07-26T15:49:23.492982+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:25.428 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:25 smithi033 bash[14790]: cluster 2021-07-26T15:49:23.492982+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:25.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:25 smithi096 bash[15117]: cluster 2021-07-26T15:49:23.492982+0000 mgr.y (mgr.14146) 93 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:27.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:27 smithi033 bash[14790]: cluster 2021-07-26T15:49:25.493521+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:27.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:27 smithi033 bash[19094]: cluster 2021-07-26T15:49:25.493521+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:27.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:27 smithi096 bash[15117]: cluster 2021-07-26T15:49:25.493521+0000 mgr.y (mgr.14146) 94 : cluster [DBG] pgmap v67: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:29.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:29 smithi033 bash[14790]: cluster 2021-07-26T15:49:27.494081+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:29.204 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:29 smithi033 bash[19094]: cluster 2021-07-26T15:49:27.494081+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:29.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:29 smithi096 bash[15117]: cluster 2021-07-26T15:49:27.494081+0000 mgr.y (mgr.14146) 95 : cluster [DBG] pgmap v68: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:30.062 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:30 smithi033 bash[14790]: audit 2021-07-26T15:49:29.491791+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-07-26T15:49:30.062 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:30 smithi033 bash[14790]: audit 2021-07-26T15:49:29.493573+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:30.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:30 smithi033 bash[19094]: audit 2021-07-26T15:49:29.491791+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-07-26T15:49:30.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:30 smithi033 bash[19094]: audit 2021-07-26T15:49:29.493573+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:30.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:30 smithi096 bash[15117]: audit 2021-07-26T15:49:29.491791+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-07-26T15:49:30.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:30 smithi096 bash[15117]: audit 2021-07-26T15:49:29.493573+0000 mon.a (mon.0) 279 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:31.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:31 smithi033 bash[19094]: cluster 2021-07-26T15:49:29.494522+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:31.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:31 smithi033 bash[19094]: cephadm 2021-07-26T15:49:29.495128+0000 mgr.y (mgr.14146) 97 : cephadm [INF] Deploying daemon osd.1 on smithi033 2021-07-26T15:49:31.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:31 smithi033 bash[14790]: cluster 2021-07-26T15:49:29.494522+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:31.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:31 smithi033 bash[14790]: cephadm 2021-07-26T15:49:29.495128+0000 mgr.y (mgr.14146) 97 : cephadm [INF] Deploying daemon osd.1 on smithi033 2021-07-26T15:49:31.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:31 smithi096 bash[15117]: cluster 2021-07-26T15:49:29.494522+0000 mgr.y (mgr.14146) 96 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:31.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:31 smithi096 bash[15117]: cephadm 2021-07-26T15:49:29.495128+0000 mgr.y (mgr.14146) 97 : cephadm [INF] Deploying daemon osd.1 on smithi033 2021-07-26T15:49:31.999 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 1 on host 'smithi033' 2021-07-26T15:49:32.152 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:32 smithi033 bash[14790]: audit 2021-07-26T15:49:31.987016+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:32.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:32 smithi033 bash[14790]: audit 2021-07-26T15:49:31.989312+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:32.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:32 smithi033 bash[14790]: audit 2021-07-26T15:49:31.993259+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:32.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:32 smithi033 bash[14790]: audit 2021-07-26T15:49:31.995752+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:32.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:32 smithi033 bash[14790]: audit 2021-07-26T15:49:32.000050+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:32.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:32 smithi033 bash[19094]: audit 2021-07-26T15:49:31.987016+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:32.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:32 smithi033 bash[19094]: audit 2021-07-26T15:49:31.989312+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:32.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:32 smithi033 bash[19094]: audit 2021-07-26T15:49:31.993259+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:32.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:32 smithi033 bash[19094]: audit 2021-07-26T15:49:31.995752+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:32.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:32 smithi033 bash[19094]: audit 2021-07-26T15:49:32.000050+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:32.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:32 smithi096 bash[15117]: audit 2021-07-26T15:49:31.987016+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:32.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:32 smithi096 bash[15117]: audit 2021-07-26T15:49:31.989312+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:32.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:32 smithi096 bash[15117]: audit 2021-07-26T15:49:31.993259+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:32.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:32 smithi096 bash[15117]: audit 2021-07-26T15:49:31.995752+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:32.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:32 smithi096 bash[15117]: audit 2021-07-26T15:49:32.000050+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:33.341 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:33 smithi033 bash[19094]: cluster 2021-07-26T15:49:31.495144+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:33.341 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:33 smithi033 bash[14790]: cluster 2021-07-26T15:49:31.495144+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:33.343 DEBUG:teuthology.orchestra.run.smithi033:osd.1> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.1.service 2021-07-26T15:49:33.345 INFO:tasks.cephadm:Deploying osd.2 on smithi033 with /dev/vg_nvme/lv_2... 2021-07-26T15:49:33.346 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-07-26T15:49:33.476 INFO:journalctl@ceph.osd.1.smithi033.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:49:33.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:33 smithi096 bash[15117]: cluster 2021-07-26T15:49:31.495144+0000 mgr.y (mgr.14146) 98 : cluster [DBG] pgmap v70: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:35.076 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:34 smithi033 bash[24028]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-07-26T15:49:35.077 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:34 smithi033 bash[24028]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-07-26T15:49:35.077 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:34 smithi033 bash[24028]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-07-26T15:49:35.077 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:34 smithi033 bash[24028]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-07-26T15:49:35.077 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:34 smithi033 bash[24028]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-07-26T15:49:35.078 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:34 smithi033 bash[24028]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-07-26T15:49:35.078 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:34 smithi033 bash[24028]: --> ceph-volume lvm activate successful for osd ID: 1 2021-07-26T15:49:35.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:35 smithi033 bash[14790]: cluster 2021-07-26T15:49:33.495578+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:35.204 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:35 smithi033 bash[19094]: cluster 2021-07-26T15:49:33.495578+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:35.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:35 smithi096 bash[15117]: cluster 2021-07-26T15:49:33.495578+0000 mgr.y (mgr.14146) 99 : cluster [DBG] pgmap v71: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:35.953 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:35 smithi033 bash[24389]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:49:36.953 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:36 smithi033 bash[14790]: audit 2021-07-26T15:49:35.494661+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:36.954 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:36 smithi033 bash[14790]: cluster 2021-07-26T15:49:35.495990+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:36.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:36 smithi033 bash[19094]: audit 2021-07-26T15:49:35.494661+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:36.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:36 smithi033 bash[19094]: cluster 2021-07-26T15:49:35.495990+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:36.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:36 smithi096 bash[15117]: audit 2021-07-26T15:49:35.494661+0000 mon.a (mon.0) 285 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:36.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:36 smithi096 bash[15117]: cluster 2021-07-26T15:49:35.495990+0000 mgr.y (mgr.14146) 100 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:38.355 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:38 smithi033 bash[24389]: debug 2021-07-26T15:49:38.184+0000 7f9416a83700 1 -- 172.21.15.33:0/3547639082 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5633fc6864e0 con 0x5633fc6fcc00 2021-07-26T15:49:38.953 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:38 smithi033 bash[24389]: debug 2021-07-26T15:49:38.724+0000 7f941e51c080 -1 Falling back to public interface 2021-07-26T15:49:39.222 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-07-26T15:49:39.222 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-07-26T15:49:39.222 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2021-07-26T15:49:39.222 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2021-07-26T15:49:39.223 INFO:teuthology.orchestra.run.smithi033.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0168486 s, 622 MB/s 2021-07-26T15:49:39.223 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 2021-07-26T15:49:39.223 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2021-07-26T15:49:39.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:39 smithi033 bash[14790]: cluster 2021-07-26T15:49:37.496479+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:39.267 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:39 smithi033 bash[19094]: cluster 2021-07-26T15:49:37.496479+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:39.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:39 smithi096 bash[15117]: cluster 2021-07-26T15:49:37.496479+0000 mgr.y (mgr.14146) 101 : cluster [DBG] pgmap v73: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:40.333 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch daemon add osd smithi033:vg_nvme/lv_2 2021-07-26T15:49:41.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:41 smithi033 bash[14790]: cluster 2021-07-26T15:49:39.496990+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:41.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:41 smithi033 bash[19094]: cluster 2021-07-26T15:49:39.496990+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:41.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:41 smithi096 bash[15117]: cluster 2021-07-26T15:49:39.496990+0000 mgr.y (mgr.14146) 102 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:41.984 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:41 smithi033 bash[24389]: debug 2021-07-26T15:49:41.728+0000 7f941e51c080 -1 osd.1 0 log_to_monitors {default=true} 2021-07-26T15:49:42.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:42 smithi033 bash[14790]: audit 2021-07-26T15:49:41.740895+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-07-26T15:49:42.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:42 smithi033 bash[19094]: audit 2021-07-26T15:49:41.740895+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-07-26T15:49:42.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:42 smithi096 bash[15117]: audit 2021-07-26T15:49:41.740895+0000 mon.a (mon.0) 286 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-07-26T15:49:43.453 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:49:43 smithi033 bash[24389]: debug 2021-07-26T15:49:43.076+0000 7f9414a7f700 -1 osd.1 0 waiting for initial osdmap 2021-07-26T15:49:43.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:43 smithi033 bash[14790]: cluster 2021-07-26T15:49:41.497584+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:43.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:43 smithi033 bash[14790]: audit 2021-07-26T15:49:42.068357+0000 mon.a (mon.0) 287 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-07-26T15:49:43.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:43 smithi033 bash[14790]: cluster 2021-07-26T15:49:42.068469+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2021-07-26T15:49:43.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:43 smithi033 bash[14790]: audit 2021-07-26T15:49:42.068815+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:43.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:43 smithi033 bash[14790]: audit 2021-07-26T15:49:42.069630+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:49:43.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:43 smithi033 bash[19094]: cluster 2021-07-26T15:49:41.497584+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:43.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:43 smithi033 bash[19094]: audit 2021-07-26T15:49:42.068357+0000 mon.a (mon.0) 287 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-07-26T15:49:43.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:43 smithi033 bash[19094]: cluster 2021-07-26T15:49:42.068469+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2021-07-26T15:49:43.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:43 smithi033 bash[19094]: audit 2021-07-26T15:49:42.068815+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:43.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:43 smithi033 bash[19094]: audit 2021-07-26T15:49:42.069630+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:49:43.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:43 smithi096 bash[15117]: cluster 2021-07-26T15:49:41.497584+0000 mgr.y (mgr.14146) 103 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:43.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:43 smithi096 bash[15117]: audit 2021-07-26T15:49:42.068357+0000 mon.a (mon.0) 287 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-07-26T15:49:43.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:43 smithi096 bash[15117]: cluster 2021-07-26T15:49:42.068469+0000 mon.a (mon.0) 288 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2021-07-26T15:49:43.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:43 smithi096 bash[15117]: audit 2021-07-26T15:49:42.068815+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:43.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:43 smithi096 bash[15117]: audit 2021-07-26T15:49:42.069630+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:49:44.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.074704+0000 mon.a (mon.0) 291 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:49:44.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: cluster 2021-07-26T15:49:43.074877+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2021-07-26T15:49:44.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.075697+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:44.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.085538+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:44.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.424373+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:44.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.664520+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:49:44.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.666477+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:49:44.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.677259+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:44.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.686196+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:44.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.689034+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:44.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.690911+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:44.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.692430+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:44.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[19094]: audit 2021-07-26T15:49:43.701637+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:44.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.074704+0000 mon.a (mon.0) 291 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:49:44.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: cluster 2021-07-26T15:49:43.074877+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2021-07-26T15:49:44.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.075697+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:44.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.085538+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:44.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.424373+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:44.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.664520+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:49:44.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.666477+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:49:44.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.677259+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:44.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.686196+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:44.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.689034+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:44.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.690911+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:44.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.692430+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:44.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:44 smithi033 bash[14790]: audit 2021-07-26T15:49:43.701637+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:44.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.074704+0000 mon.a (mon.0) 291 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:49:44.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: cluster 2021-07-26T15:49:43.074877+0000 mon.a (mon.0) 292 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2021-07-26T15:49:44.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.075697+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:44.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.085538+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:44.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.424373+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:44.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.664520+0000 mon.a (mon.0) 296 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:49:44.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.666477+0000 mon.a (mon.0) 297 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:49:44.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.677259+0000 mon.a (mon.0) 298 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:44.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.686196+0000 mon.a (mon.0) 299 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:44.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.689034+0000 mon.a (mon.0) 300 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:44.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.690911+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:44.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.692430+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:44.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:44 smithi096 bash[15117]: audit 2021-07-26T15:49:43.701637+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:45.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: cluster 2021-07-26T15:49:42.717892+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:49:45.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: cluster 2021-07-26T15:49:42.718078+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:49:45.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: cephadm 2021-07-26T15:49:43.414738+0000 mgr.y (mgr.14146) 104 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:49:45.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: cluster 2021-07-26T15:49:43.498008+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:45.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: cephadm 2021-07-26T15:49:43.667638+0000 mgr.y (mgr.14146) 106 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 8131M 2021-07-26T15:49:45.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: audit 2021-07-26T15:49:44.089057+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:45.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: cluster 2021-07-26T15:49:44.100107+0000 mon.a (mon.0) 305 : cluster [INF] osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317] boot 2021-07-26T15:49:45.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: cluster 2021-07-26T15:49:44.100157+0000 mon.a (mon.0) 306 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2021-07-26T15:49:45.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: audit 2021-07-26T15:49:44.100501+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:45.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: audit 2021-07-26T15:49:44.436644+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:49:45.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: audit 2021-07-26T15:49:44.439698+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:49:45.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[14790]: audit 2021-07-26T15:49:44.441097+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:45.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: cluster 2021-07-26T15:49:42.717892+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:49:45.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: cluster 2021-07-26T15:49:42.718078+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:49:45.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: cephadm 2021-07-26T15:49:43.414738+0000 mgr.y (mgr.14146) 104 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:49:45.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: cluster 2021-07-26T15:49:43.498008+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:45.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: cephadm 2021-07-26T15:49:43.667638+0000 mgr.y (mgr.14146) 106 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 8131M 2021-07-26T15:49:45.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: audit 2021-07-26T15:49:44.089057+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:45.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: cluster 2021-07-26T15:49:44.100107+0000 mon.a (mon.0) 305 : cluster [INF] osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317] boot 2021-07-26T15:49:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: cluster 2021-07-26T15:49:44.100157+0000 mon.a (mon.0) 306 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2021-07-26T15:49:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: audit 2021-07-26T15:49:44.100501+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: audit 2021-07-26T15:49:44.436644+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:49:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: audit 2021-07-26T15:49:44.439698+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:49:45.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:45 smithi033 bash[19094]: audit 2021-07-26T15:49:44.441097+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: cluster 2021-07-26T15:49:42.717892+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:49:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: cluster 2021-07-26T15:49:42.718078+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:49:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: cephadm 2021-07-26T15:49:43.414738+0000 mgr.y (mgr.14146) 104 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:49:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: cluster 2021-07-26T15:49:43.498008+0000 mgr.y (mgr.14146) 105 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-07-26T15:49:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: cephadm 2021-07-26T15:49:43.667638+0000 mgr.y (mgr.14146) 106 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 8131M 2021-07-26T15:49:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: audit 2021-07-26T15:49:44.089057+0000 mon.a (mon.0) 304 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: cluster 2021-07-26T15:49:44.100107+0000 mon.a (mon.0) 305 : cluster [INF] osd.1 [v2:172.21.15.33:6810/2278642317,v1:172.21.15.33:6811/2278642317] boot 2021-07-26T15:49:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: cluster 2021-07-26T15:49:44.100157+0000 mon.a (mon.0) 306 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2021-07-26T15:49:45.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: audit 2021-07-26T15:49:44.100501+0000 mon.a (mon.0) 307 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:49:45.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: audit 2021-07-26T15:49:44.436644+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:49:45.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: audit 2021-07-26T15:49:44.439698+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:49:45.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:45 smithi096 bash[15117]: audit 2021-07-26T15:49:44.441097+0000 mon.a (mon.0) 310 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:46.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:46 smithi033 bash[14790]: audit 2021-07-26T15:49:44.435042+0000 mgr.y (mgr.14146) 107 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:49:46.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:46 smithi033 bash[14790]: cluster 2021-07-26T15:49:45.429323+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2021-07-26T15:49:46.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:46 smithi033 bash[19094]: audit 2021-07-26T15:49:44.435042+0000 mgr.y (mgr.14146) 107 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:49:46.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:46 smithi033 bash[19094]: cluster 2021-07-26T15:49:45.429323+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2021-07-26T15:49:46.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:46 smithi096 bash[15117]: audit 2021-07-26T15:49:44.435042+0000 mgr.y (mgr.14146) 107 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:49:46.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:46 smithi096 bash[15117]: cluster 2021-07-26T15:49:45.429323+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2021-07-26T15:49:47.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:47 smithi033 bash[19094]: cluster 2021-07-26T15:49:45.498510+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:47.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:47 smithi033 bash[14790]: cluster 2021-07-26T15:49:45.498510+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:47.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:47 smithi096 bash[15117]: cluster 2021-07-26T15:49:45.498510+0000 mgr.y (mgr.14146) 108 : cluster [DBG] pgmap v81: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:48.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:48 smithi033 bash[14790]: cluster 2021-07-26T15:49:47.499107+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:48.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:48 smithi033 bash[19094]: cluster 2021-07-26T15:49:47.499107+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:48.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:48 smithi096 bash[15117]: cluster 2021-07-26T15:49:47.499107+0000 mgr.y (mgr.14146) 109 : cluster [DBG] pgmap v82: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:49.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:49 smithi033 bash[14790]: audit 2021-07-26T15:49:48.489083+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.33:0/3723572967' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9690c749-a40a-44a7-8a07-5290ff8980a5"}]: dispatch 2021-07-26T15:49:49.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:49 smithi033 bash[14790]: audit 2021-07-26T15:49:48.489633+0000 mon.a (mon.0) 312 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9690c749-a40a-44a7-8a07-5290ff8980a5"}]: dispatch 2021-07-26T15:49:49.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:49 smithi033 bash[14790]: audit 2021-07-26T15:49:48.497417+0000 mon.a (mon.0) 313 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9690c749-a40a-44a7-8a07-5290ff8980a5"}]': finished 2021-07-26T15:49:49.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:49 smithi033 bash[14790]: cluster 2021-07-26T15:49:48.497652+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2021-07-26T15:49:49.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:49 smithi033 bash[14790]: audit 2021-07-26T15:49:48.497808+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:49:49.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:49 smithi033 bash[19094]: audit 2021-07-26T15:49:48.489083+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.33:0/3723572967' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9690c749-a40a-44a7-8a07-5290ff8980a5"}]: dispatch 2021-07-26T15:49:49.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:49 smithi033 bash[19094]: audit 2021-07-26T15:49:48.489633+0000 mon.a (mon.0) 312 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9690c749-a40a-44a7-8a07-5290ff8980a5"}]: dispatch 2021-07-26T15:49:49.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:49 smithi033 bash[19094]: audit 2021-07-26T15:49:48.497417+0000 mon.a (mon.0) 313 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9690c749-a40a-44a7-8a07-5290ff8980a5"}]': finished 2021-07-26T15:49:49.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:49 smithi033 bash[19094]: cluster 2021-07-26T15:49:48.497652+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2021-07-26T15:49:49.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:49 smithi033 bash[19094]: audit 2021-07-26T15:49:48.497808+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:49:49.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:49 smithi096 bash[15117]: audit 2021-07-26T15:49:48.489083+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.33:0/3723572967' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9690c749-a40a-44a7-8a07-5290ff8980a5"}]: dispatch 2021-07-26T15:49:49.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:49 smithi096 bash[15117]: audit 2021-07-26T15:49:48.489633+0000 mon.a (mon.0) 312 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9690c749-a40a-44a7-8a07-5290ff8980a5"}]: dispatch 2021-07-26T15:49:49.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:49 smithi096 bash[15117]: audit 2021-07-26T15:49:48.497417+0000 mon.a (mon.0) 313 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9690c749-a40a-44a7-8a07-5290ff8980a5"}]': finished 2021-07-26T15:49:49.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:49 smithi096 bash[15117]: cluster 2021-07-26T15:49:48.497652+0000 mon.a (mon.0) 314 : cluster [DBG] osdmap e15: 3 total, 2 up, 3 in 2021-07-26T15:49:49.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:49 smithi096 bash[15117]: audit 2021-07-26T15:49:48.497808+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:49:50.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:50 smithi033 bash[14790]: audit 2021-07-26T15:49:49.173401+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.15.33:0/4268341969' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:49:50.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:50 smithi033 bash[14790]: cluster 2021-07-26T15:49:49.499805+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:50.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:50 smithi033 bash[19094]: audit 2021-07-26T15:49:49.173401+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.15.33:0/4268341969' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:49:50.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:50 smithi033 bash[19094]: cluster 2021-07-26T15:49:49.499805+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:50 smithi096 bash[15117]: audit 2021-07-26T15:49:49.173401+0000 mon.c (mon.1) 7 : audit [DBG] from='client.? 172.21.15.33:0/4268341969' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:49:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:50 smithi096 bash[15117]: cluster 2021-07-26T15:49:49.499805+0000 mgr.y (mgr.14146) 110 : cluster [DBG] pgmap v84: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:53.432 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:53 smithi033 bash[14790]: cluster 2021-07-26T15:49:51.500400+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:53.432 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:53 smithi033 bash[19094]: cluster 2021-07-26T15:49:51.500400+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:53.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:53 smithi096 bash[15117]: cluster 2021-07-26T15:49:51.500400+0000 mgr.y (mgr.14146) 111 : cluster [DBG] pgmap v85: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:55.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:55 smithi033 bash[19094]: cluster 2021-07-26T15:49:53.500931+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:55.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:55 smithi033 bash[14790]: cluster 2021-07-26T15:49:53.500931+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:55.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:55 smithi096 bash[15117]: cluster 2021-07-26T15:49:53.500931+0000 mgr.y (mgr.14146) 112 : cluster [DBG] pgmap v86: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:57.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:57 smithi033 bash[14790]: cluster 2021-07-26T15:49:55.501443+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:57.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:57 smithi033 bash[14790]: audit 2021-07-26T15:49:56.410093+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-07-26T15:49:57.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:57 smithi033 bash[14790]: audit 2021-07-26T15:49:56.411782+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:57.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:57 smithi033 bash[19094]: cluster 2021-07-26T15:49:55.501443+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:57.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:57 smithi033 bash[19094]: audit 2021-07-26T15:49:56.410093+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-07-26T15:49:57.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:57 smithi033 bash[19094]: audit 2021-07-26T15:49:56.411782+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:57.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:57 smithi096 bash[15117]: cluster 2021-07-26T15:49:55.501443+0000 mgr.y (mgr.14146) 113 : cluster [DBG] pgmap v87: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:57.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:57 smithi096 bash[15117]: audit 2021-07-26T15:49:56.410093+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-07-26T15:49:57.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:57 smithi096 bash[15117]: audit 2021-07-26T15:49:56.411782+0000 mon.a (mon.0) 317 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:58.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:58 smithi033 bash[14790]: cephadm 2021-07-26T15:49:56.413122+0000 mgr.y (mgr.14146) 114 : cephadm [INF] Deploying daemon osd.2 on smithi033 2021-07-26T15:49:58.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:58 smithi033 bash[19094]: cephadm 2021-07-26T15:49:56.413122+0000 mgr.y (mgr.14146) 114 : cephadm [INF] Deploying daemon osd.2 on smithi033 2021-07-26T15:49:58.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:58 smithi096 bash[15117]: cephadm 2021-07-26T15:49:56.413122+0000 mgr.y (mgr.14146) 114 : cephadm [INF] Deploying daemon osd.2 on smithi033 2021-07-26T15:49:59.049 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 2 on host 'smithi033' 2021-07-26T15:49:59.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[14790]: cluster 2021-07-26T15:49:57.501971+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:59.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[14790]: audit 2021-07-26T15:49:59.035974+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:59.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[14790]: audit 2021-07-26T15:49:59.041569+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:59.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[14790]: audit 2021-07-26T15:49:59.041835+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:59.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[14790]: audit 2021-07-26T15:49:59.044509+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:59.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[14790]: audit 2021-07-26T15:49:59.048711+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:59.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[19094]: cluster 2021-07-26T15:49:57.501971+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:59.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[19094]: audit 2021-07-26T15:49:59.035974+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:59.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[19094]: audit 2021-07-26T15:49:59.041569+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:59.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[19094]: audit 2021-07-26T15:49:59.041835+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:59.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[19094]: audit 2021-07-26T15:49:59.044509+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:59.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:49:59 smithi033 bash[19094]: audit 2021-07-26T15:49:59.048711+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:59.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:59 smithi096 bash[15117]: cluster 2021-07-26T15:49:57.501971+0000 mgr.y (mgr.14146) 115 : cluster [DBG] pgmap v88: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:49:59.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:59 smithi096 bash[15117]: audit 2021-07-26T15:49:59.035974+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:49:59.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:59 smithi096 bash[15117]: audit 2021-07-26T15:49:59.041569+0000 mon.a (mon.0) 319 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:49:59.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:59 smithi096 bash[15117]: audit 2021-07-26T15:49:59.041835+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:49:59.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:59 smithi096 bash[15117]: audit 2021-07-26T15:49:59.044509+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:49:59.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:49:59 smithi096 bash[15117]: audit 2021-07-26T15:49:59.048711+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:00.387 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:00 smithi033 bash[19094]: cluster 2021-07-26T15:50:00.000135+0000 mon.a (mon.0) 323 : cluster [INF] overall HEALTH_OK 2021-07-26T15:50:00.388 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:00 smithi033 bash[14790]: cluster 2021-07-26T15:50:00.000135+0000 mon.a (mon.0) 323 : cluster [INF] overall HEALTH_OK 2021-07-26T15:50:00.390 DEBUG:teuthology.orchestra.run.smithi033:osd.2> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.2.service 2021-07-26T15:50:00.394 INFO:tasks.cephadm:Deploying osd.3 on smithi033 with /dev/vg_nvme/lv_1... 2021-07-26T15:50:00.394 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-07-26T15:50:00.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:00 smithi096 bash[15117]: cluster 2021-07-26T15:50:00.000135+0000 mon.a (mon.0) 323 : cluster [INF] overall HEALTH_OK 2021-07-26T15:50:00.543 INFO:journalctl@ceph.osd.2.smithi033.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:50:01.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:01 smithi033 bash[14790]: cluster 2021-07-26T15:49:59.502521+0000 mgr.y (mgr.14146) 116 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:01.203 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:01 smithi033 bash[19094]: cluster 2021-07-26T15:49:59.502521+0000 mgr.y (mgr.14146) 116 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:01.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:01 smithi096 bash[15117]: cluster 2021-07-26T15:49:59.502521+0000 mgr.y (mgr.14146) 116 : cluster [DBG] pgmap v89: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:01.703 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:01 smithi033 bash[26683]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-07-26T15:50:01.703 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:01 smithi033 bash[26683]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-07-26T15:50:01.704 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:01 smithi033 bash[26683]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-07-26T15:50:01.704 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:01 smithi033 bash[26683]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-07-26T15:50:01.704 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:01 smithi033 bash[26683]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-07-26T15:50:01.704 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:01 smithi033 bash[26683]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-07-26T15:50:01.705 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:01 smithi033 bash[26683]: --> ceph-volume lvm activate successful for osd ID: 2 2021-07-26T15:50:02.883 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:02 smithi033 bash[27012]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:50:03.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:03 smithi033 bash[14790]: cluster 2021-07-26T15:50:01.503128+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:03.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:03 smithi033 bash[14790]: audit 2021-07-26T15:50:02.691108+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:03.204 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:03 smithi033 bash[19094]: cluster 2021-07-26T15:50:01.503128+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:03.204 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:03 smithi033 bash[19094]: audit 2021-07-26T15:50:02.691108+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:03.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:03 smithi096 bash[15117]: cluster 2021-07-26T15:50:01.503128+0000 mgr.y (mgr.14146) 117 : cluster [DBG] pgmap v90: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:03.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:03 smithi096 bash[15117]: audit 2021-07-26T15:50:02.691108+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:05.351 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:05 smithi033 bash[19094]: cluster 2021-07-26T15:50:03.503733+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:05.351 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:05 smithi033 bash[14790]: cluster 2021-07-26T15:50:03.503733+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:05.352 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:05 smithi033 bash[27012]: debug 2021-07-26T15:50:05.240+0000 7f1672460700 1 -- 172.21.15.33:0/1598598377 <== mon.1 v2:172.21.15.33:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ab2aa964e0 con 0x55ab2ab0d000 2021-07-26T15:50:05.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:05 smithi096 bash[15117]: cluster 2021-07-26T15:50:03.503733+0000 mgr.y (mgr.14146) 118 : cluster [DBG] pgmap v91: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:06.203 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:05 smithi033 bash[27012]: debug 2021-07-26T15:50:05.792+0000 7f1679ef9080 -1 Falling back to public interface 2021-07-26T15:50:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-07-26T15:50:06.526 INFO:teuthology.orchestra.run.smithi033.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-07-26T15:50:06.527 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10+0 records in 2021-07-26T15:50:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:10+0 records out 2021-07-26T15:50:06.527 INFO:teuthology.orchestra.run.smithi033.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0168568 s, 622 MB/s 2021-07-26T15:50:06.527 INFO:teuthology.orchestra.run.smithi033.stderr:--> Zapping successful for: 2021-07-26T15:50:07.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:07 smithi033 bash[14790]: cluster 2021-07-26T15:50:05.504275+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:07.203 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:07 smithi033 bash[19094]: cluster 2021-07-26T15:50:05.504275+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:07.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:07 smithi096 bash[15117]: cluster 2021-07-26T15:50:05.504275+0000 mgr.y (mgr.14146) 119 : cluster [DBG] pgmap v92: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:07.766 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch daemon add osd smithi033:vg_nvme/lv_1 2021-07-26T15:50:09.100 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:08 smithi033 bash[27012]: debug 2021-07-26T15:50:08.800+0000 7f1679ef9080 -1 osd.2 0 log_to_monitors {default=true} 2021-07-26T15:50:09.100 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:09 smithi033 bash[14790]: cluster 2021-07-26T15:50:07.504747+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:09.101 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:09 smithi033 bash[14790]: audit 2021-07-26T15:50:08.812225+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/290055652,v1:172.21.15.33:6819/290055652]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-07-26T15:50:09.101 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:09 smithi033 bash[14790]: audit 2021-07-26T15:50:08.812615+0000 mon.a (mon.0) 325 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-07-26T15:50:09.389 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:09 smithi033 bash[19094]: cluster 2021-07-26T15:50:07.504747+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:09.390 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:09 smithi033 bash[19094]: audit 2021-07-26T15:50:08.812225+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/290055652,v1:172.21.15.33:6819/290055652]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-07-26T15:50:09.390 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:09 smithi033 bash[19094]: audit 2021-07-26T15:50:08.812615+0000 mon.a (mon.0) 325 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-07-26T15:50:09.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:09 smithi096 bash[15117]: cluster 2021-07-26T15:50:07.504747+0000 mgr.y (mgr.14146) 120 : cluster [DBG] pgmap v93: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:09.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:09 smithi096 bash[15117]: audit 2021-07-26T15:50:08.812225+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/290055652,v1:172.21.15.33:6819/290055652]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-07-26T15:50:09.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:09 smithi096 bash[15117]: audit 2021-07-26T15:50:08.812615+0000 mon.a (mon.0) 325 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-07-26T15:50:10.453 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[27012]: debug 2021-07-26T15:50:10.120+0000 7f167045c700 -1 osd.2 0 waiting for initial osdmap 2021-07-26T15:50:10.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[14790]: audit 2021-07-26T15:50:09.098896+0000 mon.a (mon.0) 326 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-07-26T15:50:10.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[14790]: cluster 2021-07-26T15:50:09.099076+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2021-07-26T15:50:10.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[14790]: audit 2021-07-26T15:50:09.100096+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:10.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[14790]: audit 2021-07-26T15:50:09.100789+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/290055652,v1:172.21.15.33:6819/290055652]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:50:10.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[14790]: audit 2021-07-26T15:50:09.106863+0000 mon.a (mon.0) 329 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:50:10.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[14790]: cluster 2021-07-26T15:50:09.505244+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:10.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[19094]: audit 2021-07-26T15:50:09.098896+0000 mon.a (mon.0) 326 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-07-26T15:50:10.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[19094]: cluster 2021-07-26T15:50:09.099076+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2021-07-26T15:50:10.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[19094]: audit 2021-07-26T15:50:09.100096+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:10.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[19094]: audit 2021-07-26T15:50:09.100789+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/290055652,v1:172.21.15.33:6819/290055652]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:50:10.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[19094]: audit 2021-07-26T15:50:09.106863+0000 mon.a (mon.0) 329 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:50:10.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:10 smithi033 bash[19094]: cluster 2021-07-26T15:50:09.505244+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:10.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:10 smithi096 bash[15117]: audit 2021-07-26T15:50:09.098896+0000 mon.a (mon.0) 326 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-07-26T15:50:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:10 smithi096 bash[15117]: cluster 2021-07-26T15:50:09.099076+0000 mon.a (mon.0) 327 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2021-07-26T15:50:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:10 smithi096 bash[15117]: audit 2021-07-26T15:50:09.100096+0000 mon.a (mon.0) 328 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:10 smithi096 bash[15117]: audit 2021-07-26T15:50:09.100789+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/290055652,v1:172.21.15.33:6819/290055652]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:50:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:10 smithi096 bash[15117]: audit 2021-07-26T15:50:09.106863+0000 mon.a (mon.0) 329 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:50:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:10 smithi096 bash[15117]: cluster 2021-07-26T15:50:09.505244+0000 mgr.y (mgr.14146) 121 : cluster [DBG] pgmap v95: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:11.893 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:10.114332+0000 mon.a (mon.0) 330 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:50:11.894 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: cluster 2021-07-26T15:50:10.114552+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2021-07-26T15:50:11.894 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:10.115424+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:11.894 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:10.123003+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:11.895 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: cephadm 2021-07-26T15:50:10.971580+0000 mgr.y (mgr.14146) 122 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:50:11.895 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:10.978837+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:11.895 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:10.980858+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:11.895 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:10.982795+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:11.896 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:10.984705+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:11.896 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: cephadm 2021-07-26T15:50:10.985875+0000 mgr.y (mgr.14146) 123 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 5420M 2021-07-26T15:50:11.897 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:10.993205+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:11.897 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:11.000692+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:11.898 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:11.003585+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:11.898 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:11.005451+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:11.898 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:11.007215+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:11.898 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[14790]: audit 2021-07-26T15:50:11.014377+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:11.899 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:10.114332+0000 mon.a (mon.0) 330 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:50:11.899 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: cluster 2021-07-26T15:50:10.114552+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2021-07-26T15:50:11.899 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:10.115424+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:11.900 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:10.123003+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:11.900 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: cephadm 2021-07-26T15:50:10.971580+0000 mgr.y (mgr.14146) 122 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:50:11.900 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:10.978837+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:11.900 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:10.980858+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:11.901 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:10.982795+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:11.901 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:10.984705+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:11.901 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: cephadm 2021-07-26T15:50:10.985875+0000 mgr.y (mgr.14146) 123 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 5420M 2021-07-26T15:50:11.902 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:10.993205+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:11.902 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:11.000692+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:11.902 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:11.003585+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:11.902 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:11.005451+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:11.902 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:11.007215+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:11.903 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:11 smithi033 bash[19094]: audit 2021-07-26T15:50:11.014377+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:11.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:10.114332+0000 mon.a (mon.0) 330 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:50:11.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: cluster 2021-07-26T15:50:10.114552+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2021-07-26T15:50:11.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:10.115424+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:11.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:10.123003+0000 mon.a (mon.0) 333 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:11.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: cephadm 2021-07-26T15:50:10.971580+0000 mgr.y (mgr.14146) 122 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:50:11.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:10.978837+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:11.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:10.980858+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:11.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:10.982795+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:11.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:10.984705+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:11.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: cephadm 2021-07-26T15:50:10.985875+0000 mgr.y (mgr.14146) 123 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 5420M 2021-07-26T15:50:11.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:10.993205+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:11.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:11.000692+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:11.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:11.003585+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:11.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:11.005451+0000 mon.a (mon.0) 341 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:11.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:11.007215+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:11.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:11 smithi096 bash[15117]: audit 2021-07-26T15:50:11.014377+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:12.953 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: cluster 2021-07-26T15:50:09.839448+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:50:12.953 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: cluster 2021-07-26T15:50:09.839682+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:50:12.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: cluster 2021-07-26T15:50:11.126794+0000 mon.a (mon.0) 344 : cluster [INF] osd.2 [v2:172.21.15.33:6818/290055652,v1:172.21.15.33:6819/290055652] boot 2021-07-26T15:50:12.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: cluster 2021-07-26T15:50:11.126957+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2021-07-26T15:50:12.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: audit 2021-07-26T15:50:11.127715+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:12.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: audit 2021-07-26T15:50:11.129025+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-07-26T15:50:12.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: cluster 2021-07-26T15:50:11.505690+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:12.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: audit 2021-07-26T15:50:11.665527+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:50:12.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: audit 2021-07-26T15:50:11.669192+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:50:12.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: audit 2021-07-26T15:50:12.126393+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-07-26T15:50:12.956 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: cluster 2021-07-26T15:50:12.126471+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2021-07-26T15:50:12.956 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[19094]: audit 2021-07-26T15:50:12.129308+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-07-26T15:50:12.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: cluster 2021-07-26T15:50:09.839448+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:50:12.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: cluster 2021-07-26T15:50:09.839682+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:50:12.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: cluster 2021-07-26T15:50:11.126794+0000 mon.a (mon.0) 344 : cluster [INF] osd.2 [v2:172.21.15.33:6818/290055652,v1:172.21.15.33:6819/290055652] boot 2021-07-26T15:50:12.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: cluster 2021-07-26T15:50:11.126957+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2021-07-26T15:50:12.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: audit 2021-07-26T15:50:11.127715+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:12.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: audit 2021-07-26T15:50:11.129025+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-07-26T15:50:12.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: cluster 2021-07-26T15:50:11.505690+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:12.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: audit 2021-07-26T15:50:11.665527+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:50:12.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: audit 2021-07-26T15:50:11.669192+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:50:12.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: audit 2021-07-26T15:50:12.126393+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-07-26T15:50:12.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: cluster 2021-07-26T15:50:12.126471+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2021-07-26T15:50:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:12 smithi033 bash[14790]: audit 2021-07-26T15:50:12.129308+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-07-26T15:50:12.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: cluster 2021-07-26T15:50:09.839448+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:50:12.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: cluster 2021-07-26T15:50:09.839682+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:50:12.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: cluster 2021-07-26T15:50:11.126794+0000 mon.a (mon.0) 344 : cluster [INF] osd.2 [v2:172.21.15.33:6818/290055652,v1:172.21.15.33:6819/290055652] boot 2021-07-26T15:50:12.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: cluster 2021-07-26T15:50:11.126957+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e18: 3 total, 3 up, 3 in 2021-07-26T15:50:12.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: audit 2021-07-26T15:50:11.127715+0000 mon.a (mon.0) 346 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:50:12.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: audit 2021-07-26T15:50:11.129025+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-07-26T15:50:12.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: cluster 2021-07-26T15:50:11.505690+0000 mgr.y (mgr.14146) 124 : cluster [DBG] pgmap v98: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-07-26T15:50:12.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: audit 2021-07-26T15:50:11.665527+0000 mon.a (mon.0) 348 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:50:12.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: audit 2021-07-26T15:50:11.669192+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:50:12.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: audit 2021-07-26T15:50:12.126393+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-07-26T15:50:12.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: cluster 2021-07-26T15:50:12.126471+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2021-07-26T15:50:12.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:12 smithi096 bash[15117]: audit 2021-07-26T15:50:12.129308+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-07-26T15:50:13.703 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[14790]: audit 2021-07-26T15:50:12.235391+0000 mgr.y (mgr.14146) 125 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:50:13.703 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[14790]: audit 2021-07-26T15:50:13.131069+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-07-26T15:50:13.704 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[14790]: cluster 2021-07-26T15:50:13.131277+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2021-07-26T15:50:13.704 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[14790]: audit 2021-07-26T15:50:13.145605+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:50:13.704 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[14790]: audit 2021-07-26T15:50:13.147634+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:50:13.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[14790]: audit 2021-07-26T15:50:13.148701+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:13.705 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[19094]: audit 2021-07-26T15:50:12.235391+0000 mgr.y (mgr.14146) 125 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:50:13.705 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[19094]: audit 2021-07-26T15:50:13.131069+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-07-26T15:50:13.705 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[19094]: cluster 2021-07-26T15:50:13.131277+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2021-07-26T15:50:13.706 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[19094]: audit 2021-07-26T15:50:13.145605+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:50:13.706 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[19094]: audit 2021-07-26T15:50:13.147634+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:50:13.706 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:13 smithi033 bash[19094]: audit 2021-07-26T15:50:13.148701+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:13.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:13 smithi096 bash[15117]: audit 2021-07-26T15:50:12.235391+0000 mgr.y (mgr.14146) 125 : audit [DBG] from='client.24202 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi033:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:50:13.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:13 smithi096 bash[15117]: audit 2021-07-26T15:50:13.131069+0000 mon.a (mon.0) 353 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-07-26T15:50:13.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:13 smithi096 bash[15117]: cluster 2021-07-26T15:50:13.131277+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2021-07-26T15:50:13.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:13 smithi096 bash[15117]: audit 2021-07-26T15:50:13.145605+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:50:13.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:13 smithi096 bash[15117]: audit 2021-07-26T15:50:13.147634+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:50:13.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:13 smithi096 bash[15117]: audit 2021-07-26T15:50:13.148701+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:14 smithi033 bash[14790]: cluster 2021-07-26T15:50:13.506283+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v101: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:14.880 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:14 smithi033 bash[14790]: cluster 2021-07-26T15:50:14.138321+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-07-26T15:50:14.881 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:14 smithi033 bash[19094]: cluster 2021-07-26T15:50:13.506283+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v101: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:14.881 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:14 smithi033 bash[19094]: cluster 2021-07-26T15:50:14.138321+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-07-26T15:50:14.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:14 smithi096 bash[15117]: cluster 2021-07-26T15:50:13.506283+0000 mgr.y (mgr.14146) 126 : cluster [DBG] pgmap v101: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:14.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:14 smithi096 bash[15117]: cluster 2021-07-26T15:50:14.138321+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-07-26T15:50:16.953 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:16 smithi033 bash[19094]: cluster 2021-07-26T15:50:15.506922+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:16.953 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:16 smithi033 bash[14790]: cluster 2021-07-26T15:50:15.506922+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:16.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:16 smithi096 bash[15117]: cluster 2021-07-26T15:50:15.506922+0000 mgr.y (mgr.14146) 127 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:18.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:18 smithi033 bash[14790]: audit 2021-07-26T15:50:17.357353+0000 mon.a (mon.0) 359 : audit [INF] from='client.? 172.21.15.33:0/275597202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca4ee0f8-4870-49bb-8dd6-75ab536d7199"}]: dispatch 2021-07-26T15:50:18.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:18 smithi033 bash[14790]: audit 2021-07-26T15:50:17.364642+0000 mon.a (mon.0) 360 : audit [INF] from='client.? 172.21.15.33:0/275597202' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca4ee0f8-4870-49bb-8dd6-75ab536d7199"}]': finished 2021-07-26T15:50:18.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:18 smithi033 bash[14790]: cluster 2021-07-26T15:50:17.364722+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2021-07-26T15:50:18.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:18 smithi033 bash[14790]: audit 2021-07-26T15:50:17.364920+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:18.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:18 smithi033 bash[14790]: audit 2021-07-26T15:50:18.006282+0000 mon.a (mon.0) 363 : audit [DBG] from='client.? 172.21.15.33:0/3125887785' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:50:18.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:18 smithi033 bash[19094]: audit 2021-07-26T15:50:17.357353+0000 mon.a (mon.0) 359 : audit [INF] from='client.? 172.21.15.33:0/275597202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca4ee0f8-4870-49bb-8dd6-75ab536d7199"}]: dispatch 2021-07-26T15:50:18.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:18 smithi033 bash[19094]: audit 2021-07-26T15:50:17.364642+0000 mon.a (mon.0) 360 : audit [INF] from='client.? 172.21.15.33:0/275597202' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca4ee0f8-4870-49bb-8dd6-75ab536d7199"}]': finished 2021-07-26T15:50:18.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:18 smithi033 bash[19094]: cluster 2021-07-26T15:50:17.364722+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2021-07-26T15:50:18.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:18 smithi033 bash[19094]: audit 2021-07-26T15:50:17.364920+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:18.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:18 smithi033 bash[19094]: audit 2021-07-26T15:50:18.006282+0000 mon.a (mon.0) 363 : audit [DBG] from='client.? 172.21.15.33:0/3125887785' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:50:18.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:18 smithi096 bash[15117]: audit 2021-07-26T15:50:17.357353+0000 mon.a (mon.0) 359 : audit [INF] from='client.? 172.21.15.33:0/275597202' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ca4ee0f8-4870-49bb-8dd6-75ab536d7199"}]: dispatch 2021-07-26T15:50:18.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:18 smithi096 bash[15117]: audit 2021-07-26T15:50:17.364642+0000 mon.a (mon.0) 360 : audit [INF] from='client.? 172.21.15.33:0/275597202' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ca4ee0f8-4870-49bb-8dd6-75ab536d7199"}]': finished 2021-07-26T15:50:18.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:18 smithi096 bash[15117]: cluster 2021-07-26T15:50:17.364722+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2021-07-26T15:50:18.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:18 smithi096 bash[15117]: audit 2021-07-26T15:50:17.364920+0000 mon.a (mon.0) 362 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:18.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:18 smithi096 bash[15117]: audit 2021-07-26T15:50:18.006282+0000 mon.a (mon.0) 363 : audit [DBG] from='client.? 172.21.15.33:0/3125887785' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:50:19.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:19 smithi033 bash[14790]: cluster 2021-07-26T15:50:17.507553+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:19.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:19 smithi033 bash[19094]: cluster 2021-07-26T15:50:17.507553+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:19.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:19 smithi096 bash[15117]: cluster 2021-07-26T15:50:17.507553+0000 mgr.y (mgr.14146) 128 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:21.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:21 smithi033 bash[14790]: cluster 2021-07-26T15:50:19.508210+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:21.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:21 smithi033 bash[19094]: cluster 2021-07-26T15:50:19.508210+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:21.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:21 smithi096 bash[15117]: cluster 2021-07-26T15:50:19.508210+0000 mgr.y (mgr.14146) 129 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:23.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:23 smithi033 bash[14790]: cluster 2021-07-26T15:50:21.508950+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:23.203 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:23 smithi033 bash[19094]: cluster 2021-07-26T15:50:21.508950+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:23.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:23 smithi096 bash[15117]: cluster 2021-07-26T15:50:21.508950+0000 mgr.y (mgr.14146) 130 : cluster [DBG] pgmap v107: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:25.388 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:25 smithi033 bash[14790]: cluster 2021-07-26T15:50:23.509653+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:25.388 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:25 smithi033 bash[19094]: cluster 2021-07-26T15:50:23.509653+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:25.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:25 smithi096 bash[15117]: cluster 2021-07-26T15:50:23.509653+0000 mgr.y (mgr.14146) 131 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:26.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:26 smithi033 bash[14790]: audit 2021-07-26T15:50:25.897247+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-07-26T15:50:26.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:26 smithi033 bash[14790]: audit 2021-07-26T15:50:25.899150+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:26.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:26 smithi033 bash[19094]: audit 2021-07-26T15:50:25.897247+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-07-26T15:50:26.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:26 smithi033 bash[19094]: audit 2021-07-26T15:50:25.899150+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:26 smithi096 bash[15117]: audit 2021-07-26T15:50:25.897247+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-07-26T15:50:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:26 smithi096 bash[15117]: audit 2021-07-26T15:50:25.899150+0000 mon.a (mon.0) 365 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:27.326 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:27 smithi033 bash[14790]: cluster 2021-07-26T15:50:25.510424+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:27.326 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:27 smithi033 bash[14790]: cephadm 2021-07-26T15:50:25.900730+0000 mgr.y (mgr.14146) 133 : cephadm [INF] Deploying daemon osd.3 on smithi033 2021-07-26T15:50:27.327 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:27 smithi033 bash[19094]: cluster 2021-07-26T15:50:25.510424+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:27.327 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:27 smithi033 bash[19094]: cephadm 2021-07-26T15:50:25.900730+0000 mgr.y (mgr.14146) 133 : cephadm [INF] Deploying daemon osd.3 on smithi033 2021-07-26T15:50:27.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:27 smithi096 bash[15117]: cluster 2021-07-26T15:50:25.510424+0000 mgr.y (mgr.14146) 132 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:27.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:27 smithi096 bash[15117]: cephadm 2021-07-26T15:50:25.900730+0000 mgr.y (mgr.14146) 133 : cephadm [INF] Deploying daemon osd.3 on smithi033 2021-07-26T15:50:28.563 INFO:teuthology.orchestra.run.smithi033.stdout:Created osd(s) 3 on host 'smithi033' 2021-07-26T15:50:29.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[14790]: cluster 2021-07-26T15:50:27.511028+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:29.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[14790]: audit 2021-07-26T15:50:28.549785+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:29.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[14790]: audit 2021-07-26T15:50:28.553046+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:29.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[14790]: audit 2021-07-26T15:50:28.554257+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:29.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[14790]: audit 2021-07-26T15:50:28.558774+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:29.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[14790]: audit 2021-07-26T15:50:28.565740+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:29.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[19094]: cluster 2021-07-26T15:50:27.511028+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:29.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[19094]: audit 2021-07-26T15:50:28.549785+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:29.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[19094]: audit 2021-07-26T15:50:28.553046+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:29.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[19094]: audit 2021-07-26T15:50:28.554257+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:29.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[19094]: audit 2021-07-26T15:50:28.558774+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:29.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:29 smithi033 bash[19094]: audit 2021-07-26T15:50:28.565740+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:29.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:29 smithi096 bash[15117]: cluster 2021-07-26T15:50:27.511028+0000 mgr.y (mgr.14146) 134 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:29.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:29 smithi096 bash[15117]: audit 2021-07-26T15:50:28.549785+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:29.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:29 smithi096 bash[15117]: audit 2021-07-26T15:50:28.553046+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:29.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:29 smithi096 bash[15117]: audit 2021-07-26T15:50:28.554257+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:29.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:29 smithi096 bash[15117]: audit 2021-07-26T15:50:28.558774+0000 mon.a (mon.0) 369 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:29.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:29 smithi096 bash[15117]: audit 2021-07-26T15:50:28.565740+0000 mon.a (mon.0) 370 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:29.982 DEBUG:teuthology.orchestra.run.smithi033:osd.3> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.3.service 2021-07-26T15:50:29.985 INFO:tasks.cephadm:Deploying osd.4 on smithi096 with /dev/vg_nvme/lv_4... 2021-07-26T15:50:29.985 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-07-26T15:50:30.208 INFO:journalctl@ceph.osd.3.smithi033.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:50:31.084 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:30 smithi033 bash[29338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-07-26T15:50:31.084 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:30 smithi033 bash[29338]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-07-26T15:50:31.085 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:30 smithi033 bash[29338]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-07-26T15:50:31.085 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:30 smithi033 bash[29338]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-07-26T15:50:31.085 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:30 smithi033 bash[29338]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-07-26T15:50:31.085 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:30 smithi033 bash[29338]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-07-26T15:50:31.085 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:30 smithi033 bash[29338]: --> ceph-volume lvm activate successful for osd ID: 3 2021-07-26T15:50:31.385 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:31 smithi096 bash[15117]: cluster 2021-07-26T15:50:29.511650+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:31.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:31 smithi033 bash[14790]: cluster 2021-07-26T15:50:29.511650+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:31.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:31 smithi033 bash[19094]: cluster 2021-07-26T15:50:29.511650+0000 mgr.y (mgr.14146) 135 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:32.203 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:31 smithi033 bash[29474]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:50:33.089 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:33 smithi033 bash[14790]: cluster 2021-07-26T15:50:31.512250+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:33.090 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:33 smithi033 bash[14790]: audit 2021-07-26T15:50:32.955215+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:33.090 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:32 smithi033 bash[29474]: debug 2021-07-26T15:50:32.864+0000 7f0ade4eb700 1 -- 172.21.15.33:0/810856606 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5567f528a4e0 con 0x5567f5300c00 2021-07-26T15:50:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-07-26T15:50:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-07-26T15:50:33.293 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2021-07-26T15:50:33.293 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2021-07-26T15:50:33.294 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0178416 s, 588 MB/s 2021-07-26T15:50:33.294 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2021-07-26T15:50:33.406 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:33 smithi033 bash[19094]: cluster 2021-07-26T15:50:31.512250+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:33.407 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:33 smithi033 bash[19094]: audit 2021-07-26T15:50:32.955215+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:33.444 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:33 smithi096 bash[15117]: cluster 2021-07-26T15:50:31.512250+0000 mgr.y (mgr.14146) 136 : cluster [DBG] pgmap v112: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:33.444 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:33 smithi096 bash[15117]: audit 2021-07-26T15:50:32.955215+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:33.702 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:33 smithi033 bash[29474]: debug 2021-07-26T15:50:33.404+0000 7f0ae5f84080 -1 Falling back to public interface 2021-07-26T15:50:33.898 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch daemon add osd smithi096:vg_nvme/lv_4 2021-07-26T15:50:35.202 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:35 smithi096 bash[15117]: cluster 2021-07-26T15:50:33.512826+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:35.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:35 smithi033 bash[14790]: cluster 2021-07-26T15:50:33.512826+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:35.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:35 smithi033 bash[19094]: cluster 2021-07-26T15:50:33.512826+0000 mgr.y (mgr.14146) 137 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:36.413 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:36 smithi033 bash[14790]: cluster 2021-07-26T15:50:35.513440+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:36.414 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:36 smithi033 bash[19094]: cluster 2021-07-26T15:50:35.513440+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:36.463 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:36 smithi096 bash[15117]: cluster 2021-07-26T15:50:35.513440+0000 mgr.y (mgr.14146) 138 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:36.702 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:36 smithi033 bash[29474]: debug 2021-07-26T15:50:36.412+0000 7f0ae5f84080 -1 osd.3 0 log_to_monitors {default=true} 2021-07-26T15:50:37.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:37 smithi033 bash[14790]: audit 2021-07-26T15:50:36.422111+0000 mon.a (mon.0) 372 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-07-26T15:50:37.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:37 smithi033 bash[14790]: audit 2021-07-26T15:50:36.886154+0000 mgr.y (mgr.14146) 139 : audit [DBG] from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:50:37.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:37 smithi033 bash[14790]: audit 2021-07-26T15:50:36.887831+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:50:37.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:37 smithi033 bash[14790]: audit 2021-07-26T15:50:36.891962+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:50:37.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:37 smithi033 bash[14790]: audit 2021-07-26T15:50:36.893475+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:37.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:37 smithi033 bash[19094]: audit 2021-07-26T15:50:36.422111+0000 mon.a (mon.0) 372 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-07-26T15:50:37.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:37 smithi033 bash[19094]: audit 2021-07-26T15:50:36.886154+0000 mgr.y (mgr.14146) 139 : audit [DBG] from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:50:37.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:37 smithi033 bash[19094]: audit 2021-07-26T15:50:36.887831+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:50:37.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:37 smithi033 bash[19094]: audit 2021-07-26T15:50:36.891962+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:50:37.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:37 smithi033 bash[19094]: audit 2021-07-26T15:50:36.893475+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:37.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:37 smithi096 bash[15117]: audit 2021-07-26T15:50:36.422111+0000 mon.a (mon.0) 372 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-07-26T15:50:37.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:37 smithi096 bash[15117]: audit 2021-07-26T15:50:36.886154+0000 mgr.y (mgr.14146) 139 : audit [DBG] from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:50:37.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:37 smithi096 bash[15117]: audit 2021-07-26T15:50:36.887831+0000 mon.a (mon.0) 373 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:50:37.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:37 smithi096 bash[15117]: audit 2021-07-26T15:50:36.891962+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:50:37.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:37 smithi096 bash[15117]: audit 2021-07-26T15:50:36.893475+0000 mon.a (mon.0) 375 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:38.360 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:38 smithi096 bash[15117]: audit 2021-07-26T15:50:37.167358+0000 mon.a (mon.0) 376 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-07-26T15:50:38.361 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:38 smithi096 bash[15117]: cluster 2021-07-26T15:50:37.167560+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2021-07-26T15:50:38.361 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:38 smithi096 bash[15117]: audit 2021-07-26T15:50:37.167818+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:38.361 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:38 smithi096 bash[15117]: audit 2021-07-26T15:50:37.168589+0000 mon.a (mon.0) 379 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:50:38.361 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:38 smithi096 bash[15117]: cluster 2021-07-26T15:50:37.514084+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:38.452 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:50:38 smithi033 bash[29474]: debug 2021-07-26T15:50:38.172+0000 7f0adc4e7700 -1 osd.3 0 waiting for initial osdmap 2021-07-26T15:50:38.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:38 smithi033 bash[14790]: audit 2021-07-26T15:50:37.167358+0000 mon.a (mon.0) 376 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-07-26T15:50:38.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:38 smithi033 bash[14790]: cluster 2021-07-26T15:50:37.167560+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2021-07-26T15:50:38.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:38 smithi033 bash[14790]: audit 2021-07-26T15:50:37.167818+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:38.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:38 smithi033 bash[14790]: audit 2021-07-26T15:50:37.168589+0000 mon.a (mon.0) 379 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:50:38.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:38 smithi033 bash[14790]: cluster 2021-07-26T15:50:37.514084+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:38.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:38 smithi033 bash[19094]: audit 2021-07-26T15:50:37.167358+0000 mon.a (mon.0) 376 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-07-26T15:50:38.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:38 smithi033 bash[19094]: cluster 2021-07-26T15:50:37.167560+0000 mon.a (mon.0) 377 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2021-07-26T15:50:38.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:38 smithi033 bash[19094]: audit 2021-07-26T15:50:37.167818+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:38.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:38 smithi033 bash[19094]: audit 2021-07-26T15:50:37.168589+0000 mon.a (mon.0) 379 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:50:38.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:38 smithi033 bash[19094]: cluster 2021-07-26T15:50:37.514084+0000 mgr.y (mgr.14146) 140 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:39.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.170535+0000 mon.a (mon.0) 380 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:50:39.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: cluster 2021-07-26T15:50:38.170768+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2021-07-26T15:50:39.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.171782+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:39.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.178907+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:39.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: cephadm 2021-07-26T15:50:38.499282+0000 mgr.y (mgr.14146) 141 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:50:39.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.510167+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:39.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.511954+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.513561+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.515209+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.516561+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: cephadm 2021-07-26T15:50:38.517715+0000 mgr.y (mgr.14146) 142 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 4065M 2021-07-26T15:50:39.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.527452+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:39.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.537370+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:39.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.540229+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:39.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.542390+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:39.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.543700+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:39.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[14790]: audit 2021-07-26T15:50:38.553214+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:39.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.170535+0000 mon.a (mon.0) 380 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:50:39.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: cluster 2021-07-26T15:50:38.170768+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2021-07-26T15:50:39.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.171782+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:39.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.178907+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:39.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: cephadm 2021-07-26T15:50:38.499282+0000 mgr.y (mgr.14146) 141 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:50:39.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.510167+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:39.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.511954+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.513561+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.515209+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.516561+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: cephadm 2021-07-26T15:50:38.517715+0000 mgr.y (mgr.14146) 142 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 4065M 2021-07-26T15:50:39.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.527452+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:39.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.537370+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:39.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.540229+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:39.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.542390+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:39.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.543700+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:39.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:39 smithi033 bash[19094]: audit 2021-07-26T15:50:38.553214+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:39.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.170535+0000 mon.a (mon.0) 380 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]': finished 2021-07-26T15:50:39.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: cluster 2021-07-26T15:50:38.170768+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2021-07-26T15:50:39.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.171782+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:39.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.178907+0000 mon.a (mon.0) 383 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:39.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: cephadm 2021-07-26T15:50:38.499282+0000 mgr.y (mgr.14146) 141 : cephadm [INF] Detected new or changed devices on smithi033 2021-07-26T15:50:39.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.510167+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:39.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.511954+0000 mon.a (mon.0) 385 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.513561+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.515209+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.516561+0000 mon.a (mon.0) 388 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:50:39.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: cephadm 2021-07-26T15:50:38.517715+0000 mgr.y (mgr.14146) 142 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 4065M 2021-07-26T15:50:39.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.527452+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:39.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.537370+0000 mon.a (mon.0) 390 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:39.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.540229+0000 mon.a (mon.0) 391 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:39.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.542390+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:39.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.543700+0000 mon.a (mon.0) 393 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:39.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:39 smithi096 bash[15117]: audit 2021-07-26T15:50:38.553214+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:40.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[14790]: cluster 2021-07-26T15:50:37.396493+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:50:40.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[14790]: cluster 2021-07-26T15:50:37.396688+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:50:40.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[14790]: audit 2021-07-26T15:50:39.185536+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:40.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[14790]: cluster 2021-07-26T15:50:39.191998+0000 mon.a (mon.0) 396 : cluster [INF] osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836] boot 2021-07-26T15:50:40.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[14790]: cluster 2021-07-26T15:50:39.192076+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2021-07-26T15:50:40.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[14790]: audit 2021-07-26T15:50:39.192260+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:40.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[14790]: cluster 2021-07-26T15:50:39.514689+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:40.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[19094]: cluster 2021-07-26T15:50:37.396493+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:50:40.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[19094]: cluster 2021-07-26T15:50:37.396688+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:50:40.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[19094]: audit 2021-07-26T15:50:39.185536+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:40.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[19094]: cluster 2021-07-26T15:50:39.191998+0000 mon.a (mon.0) 396 : cluster [INF] osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836] boot 2021-07-26T15:50:40.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[19094]: cluster 2021-07-26T15:50:39.192076+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2021-07-26T15:50:40.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[19094]: audit 2021-07-26T15:50:39.192260+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:40.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:40 smithi033 bash[19094]: cluster 2021-07-26T15:50:39.514689+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:40.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:40 smithi096 bash[15117]: cluster 2021-07-26T15:50:37.396493+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:50:40.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:40 smithi096 bash[15117]: cluster 2021-07-26T15:50:37.396688+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:50:40.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:40 smithi096 bash[15117]: audit 2021-07-26T15:50:39.185536+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:40.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:40 smithi096 bash[15117]: cluster 2021-07-26T15:50:39.191998+0000 mon.a (mon.0) 396 : cluster [INF] osd.3 [v2:172.21.15.33:6826/3214716836,v1:172.21.15.33:6827/3214716836] boot 2021-07-26T15:50:40.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:40 smithi096 bash[15117]: cluster 2021-07-26T15:50:39.192076+0000 mon.a (mon.0) 397 : cluster [DBG] osdmap e25: 4 total, 4 up, 4 in 2021-07-26T15:50:40.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:40 smithi096 bash[15117]: audit 2021-07-26T15:50:39.192260+0000 mon.a (mon.0) 398 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:50:40.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:40 smithi096 bash[15117]: cluster 2021-07-26T15:50:39.514689+0000 mgr.y (mgr.14146) 143 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-07-26T15:50:41.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[14790]: cluster 2021-07-26T15:50:40.199368+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-07-26T15:50:41.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[14790]: audit 2021-07-26T15:50:40.549448+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.96:0/468852127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d630717e-8f0b-4257-8157-bff1918f9841"}]: dispatch 2021-07-26T15:50:41.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[14790]: audit 2021-07-26T15:50:40.552969+0000 mon.a (mon.0) 400 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d630717e-8f0b-4257-8157-bff1918f9841"}]: dispatch 2021-07-26T15:50:41.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[14790]: audit 2021-07-26T15:50:40.561833+0000 mon.a (mon.0) 401 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d630717e-8f0b-4257-8157-bff1918f9841"}]': finished 2021-07-26T15:50:41.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[14790]: cluster 2021-07-26T15:50:40.562045+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2021-07-26T15:50:41.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[14790]: audit 2021-07-26T15:50:40.562331+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:50:41.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[19094]: cluster 2021-07-26T15:50:40.199368+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-07-26T15:50:41.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[19094]: audit 2021-07-26T15:50:40.549448+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.96:0/468852127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d630717e-8f0b-4257-8157-bff1918f9841"}]: dispatch 2021-07-26T15:50:41.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[19094]: audit 2021-07-26T15:50:40.552969+0000 mon.a (mon.0) 400 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d630717e-8f0b-4257-8157-bff1918f9841"}]: dispatch 2021-07-26T15:50:41.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[19094]: audit 2021-07-26T15:50:40.561833+0000 mon.a (mon.0) 401 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d630717e-8f0b-4257-8157-bff1918f9841"}]': finished 2021-07-26T15:50:41.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[19094]: cluster 2021-07-26T15:50:40.562045+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2021-07-26T15:50:41.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:41 smithi033 bash[19094]: audit 2021-07-26T15:50:40.562331+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:50:41.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:41 smithi096 bash[15117]: cluster 2021-07-26T15:50:40.199368+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-07-26T15:50:41.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:41 smithi096 bash[15117]: audit 2021-07-26T15:50:40.549448+0000 mon.b (mon.2) 7 : audit [INF] from='client.? 172.21.15.96:0/468852127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d630717e-8f0b-4257-8157-bff1918f9841"}]: dispatch 2021-07-26T15:50:41.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:41 smithi096 bash[15117]: audit 2021-07-26T15:50:40.552969+0000 mon.a (mon.0) 400 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d630717e-8f0b-4257-8157-bff1918f9841"}]: dispatch 2021-07-26T15:50:41.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:41 smithi096 bash[15117]: audit 2021-07-26T15:50:40.561833+0000 mon.a (mon.0) 401 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d630717e-8f0b-4257-8157-bff1918f9841"}]': finished 2021-07-26T15:50:41.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:41 smithi096 bash[15117]: cluster 2021-07-26T15:50:40.562045+0000 mon.a (mon.0) 402 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2021-07-26T15:50:41.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:41 smithi096 bash[15117]: audit 2021-07-26T15:50:40.562331+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:50:42.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:42 smithi033 bash[14790]: audit 2021-07-26T15:50:41.195449+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.96:0/1040421520' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:50:42.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:42 smithi033 bash[14790]: cluster 2021-07-26T15:50:41.515267+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 19 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:42.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:42 smithi033 bash[19094]: audit 2021-07-26T15:50:41.195449+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.96:0/1040421520' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:50:42.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:42 smithi033 bash[19094]: cluster 2021-07-26T15:50:41.515267+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 19 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:42.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:42 smithi096 bash[15117]: audit 2021-07-26T15:50:41.195449+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.96:0/1040421520' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:50:42.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:42 smithi096 bash[15117]: cluster 2021-07-26T15:50:41.515267+0000 mgr.y (mgr.14146) 144 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 19 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:44.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:44 smithi096 bash[15117]: cluster 2021-07-26T15:50:43.515833+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:44.952 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:44 smithi033 bash[14790]: cluster 2021-07-26T15:50:43.515833+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:44.953 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:44 smithi033 bash[19094]: cluster 2021-07-26T15:50:43.515833+0000 mgr.y (mgr.14146) 145 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:46.901 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:46 smithi096 bash[15117]: cluster 2021-07-26T15:50:45.516423+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:46.952 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:46 smithi033 bash[14790]: cluster 2021-07-26T15:50:45.516423+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:46.953 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:46 smithi033 bash[19094]: cluster 2021-07-26T15:50:45.516423+0000 mgr.y (mgr.14146) 146 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:48.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:48 smithi033 bash[14790]: audit 2021-07-26T15:50:47.986314+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-07-26T15:50:48.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:48 smithi033 bash[14790]: audit 2021-07-26T15:50:47.988190+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:48.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:48 smithi033 bash[19094]: audit 2021-07-26T15:50:47.986314+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-07-26T15:50:48.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:48 smithi033 bash[19094]: audit 2021-07-26T15:50:47.988190+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:48.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:48 smithi096 bash[15117]: audit 2021-07-26T15:50:47.986314+0000 mon.a (mon.0) 404 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-07-26T15:50:48.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:48 smithi096 bash[15117]: audit 2021-07-26T15:50:47.988190+0000 mon.a (mon.0) 405 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:49.390 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:49 smithi096 bash[15117]: cluster 2021-07-26T15:50:47.517079+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:49.391 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:49 smithi096 bash[15117]: cephadm 2021-07-26T15:50:47.989750+0000 mgr.y (mgr.14146) 148 : cephadm [INF] Deploying daemon osd.4 on smithi096 2021-07-26T15:50:49.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:49 smithi033 bash[14790]: cluster 2021-07-26T15:50:47.517079+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:49.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:49 smithi033 bash[14790]: cephadm 2021-07-26T15:50:47.989750+0000 mgr.y (mgr.14146) 148 : cephadm [INF] Deploying daemon osd.4 on smithi096 2021-07-26T15:50:49.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:49 smithi033 bash[19094]: cluster 2021-07-26T15:50:47.517079+0000 mgr.y (mgr.14146) 147 : cluster [DBG] pgmap v125: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:49.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:49 smithi033 bash[19094]: cephadm 2021-07-26T15:50:47.989750+0000 mgr.y (mgr.14146) 148 : cephadm [INF] Deploying daemon osd.4 on smithi096 2021-07-26T15:50:50.363 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 4 on host 'smithi096' 2021-07-26T15:50:51.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:51 smithi096 bash[15117]: cluster 2021-07-26T15:50:49.517795+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:51.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:51 smithi096 bash[15117]: audit 2021-07-26T15:50:50.343887+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:51.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:51 smithi096 bash[15117]: audit 2021-07-26T15:50:50.347716+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:51.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:51 smithi096 bash[15117]: audit 2021-07-26T15:50:50.353799+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:51.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:51 smithi096 bash[15117]: audit 2021-07-26T15:50:50.354316+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:51.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:51 smithi096 bash[15117]: audit 2021-07-26T15:50:50.364189+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:51.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[14790]: cluster 2021-07-26T15:50:49.517795+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:51.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[14790]: audit 2021-07-26T15:50:50.343887+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:51.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[14790]: audit 2021-07-26T15:50:50.347716+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:51.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[14790]: audit 2021-07-26T15:50:50.353799+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:51.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[14790]: audit 2021-07-26T15:50:50.354316+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:51.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[14790]: audit 2021-07-26T15:50:50.364189+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:51.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[19094]: cluster 2021-07-26T15:50:49.517795+0000 mgr.y (mgr.14146) 149 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:51.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[19094]: audit 2021-07-26T15:50:50.343887+0000 mon.a (mon.0) 406 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:50:51.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[19094]: audit 2021-07-26T15:50:50.347716+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:50:51.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[19094]: audit 2021-07-26T15:50:50.353799+0000 mon.a (mon.0) 408 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:51.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[19094]: audit 2021-07-26T15:50:50.354316+0000 mon.a (mon.0) 409 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:50:51.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:51 smithi033 bash[19094]: audit 2021-07-26T15:50:50.364189+0000 mon.a (mon.0) 410 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:51.592 DEBUG:teuthology.orchestra.run.smithi096:osd.4> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.4.service 2021-07-26T15:50:51.595 INFO:tasks.cephadm:Deploying osd.5 on smithi096 with /dev/vg_nvme/lv_3... 2021-07-26T15:50:51.595 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-07-26T15:50:51.790 INFO:journalctl@ceph.osd.4.smithi096.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:50:52.984 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:50:52 smithi096 bash[17680]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-07-26T15:50:52.985 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:50:52 smithi096 bash[17680]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-07-26T15:50:52.985 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:50:52 smithi096 bash[17680]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-07-26T15:50:52.985 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:50:52 smithi096 bash[17680]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-07-26T15:50:52.985 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:50:52 smithi096 bash[17680]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-07-26T15:50:52.986 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:50:52 smithi096 bash[17680]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-07-26T15:50:52.986 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:50:52 smithi096 bash[17680]: --> ceph-volume lvm activate successful for osd ID: 4 2021-07-26T15:50:53.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:53 smithi096 bash[15117]: cluster 2021-07-26T15:50:51.518439+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:53.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:53 smithi033 bash[14790]: cluster 2021-07-26T15:50:51.518439+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:53.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:53 smithi033 bash[19094]: cluster 2021-07-26T15:50:51.518439+0000 mgr.y (mgr.14146) 150 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:53.677 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:50:53 smithi096 bash[17896]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:50:55.368 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:55 smithi096 bash[15117]: cluster 2021-07-26T15:50:53.519026+0000 mgr.y (mgr.14146) 151 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:55.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:55 smithi033 bash[14790]: cluster 2021-07-26T15:50:53.519026+0000 mgr.y (mgr.14146) 151 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:55.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:55 smithi033 bash[19094]: cluster 2021-07-26T15:50:53.519026+0000 mgr.y (mgr.14146) 151 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:55.696 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:50:55 smithi096 bash[17896]: debug 2021-07-26T15:50:55.366+0000 7f4665219700 1 -- 172.21.15.96:0/1652260170 <== mon.2 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556fb645c4e0 con 0x556fb64d3400 2021-07-26T15:50:55.985 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:50:55 smithi096 bash[17896]: debug 2021-07-26T15:50:55.910+0000 7f466ccb2080 -1 Falling back to public interface 2021-07-26T15:50:56.249 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-07-26T15:50:56.249 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-07-26T15:50:56.249 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2021-07-26T15:50:56.250 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2021-07-26T15:50:56.250 INFO:teuthology.orchestra.run.smithi096.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0164993 s, 636 MB/s 2021-07-26T15:50:56.250 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2021-07-26T15:50:56.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:56 smithi096 bash[15117]: audit 2021-07-26T15:50:55.489013+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:56.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:56 smithi096 bash[15117]: cluster 2021-07-26T15:50:55.519652+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:56.953 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:56 smithi033 bash[14790]: audit 2021-07-26T15:50:55.489013+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:56.953 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:56 smithi033 bash[14790]: cluster 2021-07-26T15:50:55.519652+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:56.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:56 smithi033 bash[19094]: audit 2021-07-26T15:50:55.489013+0000 mon.a (mon.0) 411 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:50:56.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:56 smithi033 bash[19094]: cluster 2021-07-26T15:50:55.519652+0000 mgr.y (mgr.14146) 152 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:57.131 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch daemon add osd smithi096:vg_nvme/lv_3 2021-07-26T15:50:59.206 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:50:58 smithi096 bash[17896]: debug 2021-07-26T15:50:58.902+0000 7f466ccb2080 -1 osd.4 0 log_to_monitors {default=true} 2021-07-26T15:50:59.206 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:59 smithi096 bash[15117]: cluster 2021-07-26T15:50:57.520227+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:59.206 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:59 smithi096 bash[15117]: audit 2021-07-26T15:50:58.911772+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/1174280901,v1:172.21.15.96:6801/1174280901]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T15:50:59.207 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:50:59 smithi096 bash[15117]: audit 2021-07-26T15:50:58.915181+0000 mon.a (mon.0) 412 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T15:50:59.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:59 smithi033 bash[14790]: cluster 2021-07-26T15:50:57.520227+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:59.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:59 smithi033 bash[14790]: audit 2021-07-26T15:50:58.911772+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/1174280901,v1:172.21.15.96:6801/1174280901]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T15:50:59.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:50:59 smithi033 bash[14790]: audit 2021-07-26T15:50:58.915181+0000 mon.a (mon.0) 412 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T15:50:59.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:59 smithi033 bash[19094]: cluster 2021-07-26T15:50:57.520227+0000 mgr.y (mgr.14146) 153 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:50:59.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:59 smithi033 bash[19094]: audit 2021-07-26T15:50:58.911772+0000 mon.b (mon.2) 9 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/1174280901,v1:172.21.15.96:6801/1174280901]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T15:50:59.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:50:59 smithi033 bash[19094]: audit 2021-07-26T15:50:58.915181+0000 mon.a (mon.0) 412 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T15:51:00.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:00 smithi033 bash[14790]: audit 2021-07-26T15:50:59.078746+0000 mon.b (mon.2) 10 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/1174280901,v1:172.21.15.96:6801/1174280901]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:00.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:00 smithi033 bash[14790]: audit 2021-07-26T15:50:59.079065+0000 mon.a (mon.0) 413 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-07-26T15:51:00.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:00 smithi033 bash[14790]: cluster 2021-07-26T15:50:59.079280+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2021-07-26T15:51:00.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:00 smithi033 bash[14790]: audit 2021-07-26T15:50:59.079488+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:00.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:00 smithi033 bash[14790]: audit 2021-07-26T15:50:59.081900+0000 mon.a (mon.0) 416 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:00.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:00 smithi033 bash[19094]: audit 2021-07-26T15:50:59.078746+0000 mon.b (mon.2) 10 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/1174280901,v1:172.21.15.96:6801/1174280901]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:00.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:00 smithi033 bash[19094]: audit 2021-07-26T15:50:59.079065+0000 mon.a (mon.0) 413 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-07-26T15:51:00.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:00 smithi033 bash[19094]: cluster 2021-07-26T15:50:59.079280+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2021-07-26T15:51:00.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:00 smithi033 bash[19094]: audit 2021-07-26T15:50:59.079488+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:00.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:00 smithi033 bash[19094]: audit 2021-07-26T15:50:59.081900+0000 mon.a (mon.0) 416 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:00.486 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:51:00 smithi096 bash[17896]: debug 2021-07-26T15:51:00.086+0000 7f4663215700 -1 osd.4 0 waiting for initial osdmap 2021-07-26T15:51:00.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:00 smithi096 bash[15117]: audit 2021-07-26T15:50:59.078746+0000 mon.b (mon.2) 10 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/1174280901,v1:172.21.15.96:6801/1174280901]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:00.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:00 smithi096 bash[15117]: audit 2021-07-26T15:50:59.079065+0000 mon.a (mon.0) 413 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-07-26T15:51:00.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:00 smithi096 bash[15117]: cluster 2021-07-26T15:50:59.079280+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2021-07-26T15:51:00.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:00 smithi096 bash[15117]: audit 2021-07-26T15:50:59.079488+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:00.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:00 smithi096 bash[15117]: audit 2021-07-26T15:50:59.081900+0000 mon.a (mon.0) 416 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:01.363 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:01 smithi096 bash[15117]: cluster 2021-07-26T15:50:59.520775+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:51:01.364 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:01 smithi096 bash[15117]: audit 2021-07-26T15:51:00.083032+0000 mon.a (mon.0) 417 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:51:01.364 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:01 smithi096 bash[15117]: cluster 2021-07-26T15:51:00.083347+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2021-07-26T15:51:01.364 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:01 smithi096 bash[15117]: audit 2021-07-26T15:51:00.084398+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:01.364 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:01 smithi096 bash[15117]: audit 2021-07-26T15:51:00.090760+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:01.365 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:01 smithi096 bash[15117]: cluster 2021-07-26T15:51:01.086234+0000 mon.a (mon.0) 421 : cluster [INF] osd.4 [v2:172.21.15.96:6800/1174280901,v1:172.21.15.96:6801/1174280901] boot 2021-07-26T15:51:01.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[14790]: cluster 2021-07-26T15:50:59.520775+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:51:01.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[14790]: audit 2021-07-26T15:51:00.083032+0000 mon.a (mon.0) 417 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:51:01.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[14790]: cluster 2021-07-26T15:51:00.083347+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2021-07-26T15:51:01.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[14790]: audit 2021-07-26T15:51:00.084398+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:01.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[14790]: audit 2021-07-26T15:51:00.090760+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:01.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[14790]: cluster 2021-07-26T15:51:01.086234+0000 mon.a (mon.0) 421 : cluster [INF] osd.4 [v2:172.21.15.96:6800/1174280901,v1:172.21.15.96:6801/1174280901] boot 2021-07-26T15:51:01.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[19094]: cluster 2021-07-26T15:50:59.520775+0000 mgr.y (mgr.14146) 154 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-07-26T15:51:01.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[19094]: audit 2021-07-26T15:51:00.083032+0000 mon.a (mon.0) 417 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:51:01.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[19094]: cluster 2021-07-26T15:51:00.083347+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2021-07-26T15:51:01.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[19094]: audit 2021-07-26T15:51:00.084398+0000 mon.a (mon.0) 419 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:01.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[19094]: audit 2021-07-26T15:51:00.090760+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:01.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:01 smithi033 bash[19094]: cluster 2021-07-26T15:51:01.086234+0000 mon.a (mon.0) 421 : cluster [INF] osd.4 [v2:172.21.15.96:6800/1174280901,v1:172.21.15.96:6801/1174280901] boot 2021-07-26T15:51:02.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[14790]: cluster 2021-07-26T15:50:59.865347+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:51:02.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[14790]: cluster 2021-07-26T15:50:59.865561+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:51:02.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[14790]: cluster 2021-07-26T15:51:01.086384+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2021-07-26T15:51:02.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[14790]: audit 2021-07-26T15:51:01.086796+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:02.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[14790]: audit 2021-07-26T15:51:01.698979+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:51:02.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[14790]: audit 2021-07-26T15:51:01.702987+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:51:02.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[14790]: audit 2021-07-26T15:51:01.704732+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:02.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[14790]: cluster 2021-07-26T15:51:02.068367+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-07-26T15:51:02.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[19094]: cluster 2021-07-26T15:50:59.865347+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:51:02.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[19094]: cluster 2021-07-26T15:50:59.865561+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:51:02.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[19094]: cluster 2021-07-26T15:51:01.086384+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2021-07-26T15:51:02.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[19094]: audit 2021-07-26T15:51:01.086796+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:02.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[19094]: audit 2021-07-26T15:51:01.698979+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:51:02.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[19094]: audit 2021-07-26T15:51:01.702987+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:51:02.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[19094]: audit 2021-07-26T15:51:01.704732+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:02.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:02 smithi033 bash[19094]: cluster 2021-07-26T15:51:02.068367+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-07-26T15:51:02.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:02 smithi096 bash[15117]: cluster 2021-07-26T15:50:59.865347+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:51:02.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:02 smithi096 bash[15117]: cluster 2021-07-26T15:50:59.865561+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:51:02.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:02 smithi096 bash[15117]: cluster 2021-07-26T15:51:01.086384+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e30: 5 total, 5 up, 5 in 2021-07-26T15:51:02.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:02 smithi096 bash[15117]: audit 2021-07-26T15:51:01.086796+0000 mon.a (mon.0) 423 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:51:02.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:02 smithi096 bash[15117]: audit 2021-07-26T15:51:01.698979+0000 mon.a (mon.0) 424 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:51:02.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:02 smithi096 bash[15117]: audit 2021-07-26T15:51:01.702987+0000 mon.a (mon.0) 425 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:51:02.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:02 smithi096 bash[15117]: audit 2021-07-26T15:51:01.704732+0000 mon.a (mon.0) 426 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:02.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:02 smithi096 bash[15117]: cluster 2021-07-26T15:51:02.068367+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-07-26T15:51:03.354 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:03 smithi096 bash[15117]: cluster 2021-07-26T15:51:01.521360+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v135: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:03.355 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:03 smithi096 bash[15117]: audit 2021-07-26T15:51:01.697258+0000 mgr.y (mgr.14146) 156 : audit [DBG] from='client.24251 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:51:03.355 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:03 smithi096 bash[15117]: audit 2021-07-26T15:51:02.884182+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.355 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:03 smithi096 bash[15117]: audit 2021-07-26T15:51:02.886048+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:03.356 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:03 smithi096 bash[15117]: audit 2021-07-26T15:51:02.896881+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.356 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:03 smithi096 bash[15117]: audit 2021-07-26T15:51:02.907131+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.356 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:03 smithi096 bash[15117]: audit 2021-07-26T15:51:02.911709+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:03.356 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:03 smithi096 bash[15117]: audit 2021-07-26T15:51:02.914387+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:03.356 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:03 smithi096 bash[15117]: audit 2021-07-26T15:51:02.915691+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:03.357 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:03 smithi096 bash[15117]: audit 2021-07-26T15:51:02.926267+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.357 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:03 smithi096 bash[15117]: cluster 2021-07-26T15:51:03.072228+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-07-26T15:51:03.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[14790]: cluster 2021-07-26T15:51:01.521360+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v135: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:03.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[14790]: audit 2021-07-26T15:51:01.697258+0000 mgr.y (mgr.14146) 156 : audit [DBG] from='client.24251 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:51:03.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[14790]: audit 2021-07-26T15:51:02.884182+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[14790]: audit 2021-07-26T15:51:02.886048+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:03.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[14790]: audit 2021-07-26T15:51:02.896881+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[14790]: audit 2021-07-26T15:51:02.907131+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[14790]: audit 2021-07-26T15:51:02.911709+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:03.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[14790]: audit 2021-07-26T15:51:02.914387+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:03.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[14790]: audit 2021-07-26T15:51:02.915691+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:03.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[14790]: audit 2021-07-26T15:51:02.926267+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[14790]: cluster 2021-07-26T15:51:03.072228+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-07-26T15:51:03.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[19094]: cluster 2021-07-26T15:51:01.521360+0000 mgr.y (mgr.14146) 155 : cluster [DBG] pgmap v135: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:03.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[19094]: audit 2021-07-26T15:51:01.697258+0000 mgr.y (mgr.14146) 156 : audit [DBG] from='client.24251 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:51:03.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[19094]: audit 2021-07-26T15:51:02.884182+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[19094]: audit 2021-07-26T15:51:02.886048+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:03.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[19094]: audit 2021-07-26T15:51:02.896881+0000 mon.a (mon.0) 430 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[19094]: audit 2021-07-26T15:51:02.907131+0000 mon.a (mon.0) 431 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[19094]: audit 2021-07-26T15:51:02.911709+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:03.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[19094]: audit 2021-07-26T15:51:02.914387+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:03.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[19094]: audit 2021-07-26T15:51:02.915691+0000 mon.a (mon.0) 434 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:03.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[19094]: audit 2021-07-26T15:51:02.926267+0000 mon.a (mon.0) 435 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:03.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:03 smithi033 bash[19094]: cluster 2021-07-26T15:51:03.072228+0000 mon.a (mon.0) 436 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-07-26T15:51:04.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:04 smithi096 bash[15117]: cephadm 2021-07-26T15:51:02.874620+0000 mgr.y (mgr.14146) 157 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:51:04.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:04 smithi096 bash[15117]: cephadm 2021-07-26T15:51:02.887568+0000 mgr.y (mgr.14146) 158 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 17282M 2021-07-26T15:51:04.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:04 smithi096 bash[15117]: cluster 2021-07-26T15:51:03.521999+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v138: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:04.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:04 smithi033 bash[14790]: cephadm 2021-07-26T15:51:02.874620+0000 mgr.y (mgr.14146) 157 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:51:04.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:04 smithi033 bash[14790]: cephadm 2021-07-26T15:51:02.887568+0000 mgr.y (mgr.14146) 158 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 17282M 2021-07-26T15:51:04.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:04 smithi033 bash[14790]: cluster 2021-07-26T15:51:03.521999+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v138: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:04.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:04 smithi033 bash[19094]: cephadm 2021-07-26T15:51:02.874620+0000 mgr.y (mgr.14146) 157 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:51:04.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:04 smithi033 bash[19094]: cephadm 2021-07-26T15:51:02.887568+0000 mgr.y (mgr.14146) 158 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 17282M 2021-07-26T15:51:04.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:04 smithi033 bash[19094]: cluster 2021-07-26T15:51:03.521999+0000 mgr.y (mgr.14146) 159 : cluster [DBG] pgmap v138: 1 pgs: 1 peering; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:06.952 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[14790]: cluster 2021-07-26T15:51:05.522624+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:06.952 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[14790]: audit 2021-07-26T15:51:05.624696+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.96:0/3158637950' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e2f20b4-26f0-495a-9361-8cea9b39883d"}]: dispatch 2021-07-26T15:51:06.953 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[14790]: audit 2021-07-26T15:51:05.628002+0000 mon.a (mon.0) 437 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e2f20b4-26f0-495a-9361-8cea9b39883d"}]: dispatch 2021-07-26T15:51:06.953 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[14790]: audit 2021-07-26T15:51:05.637260+0000 mon.a (mon.0) 438 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e2f20b4-26f0-495a-9361-8cea9b39883d"}]': finished 2021-07-26T15:51:06.953 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[14790]: cluster 2021-07-26T15:51:05.637477+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2021-07-26T15:51:06.953 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[14790]: audit 2021-07-26T15:51:05.637773+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:06.954 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[14790]: audit 2021-07-26T15:51:06.282752+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.96:0/1044722645' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:51:06.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[19094]: cluster 2021-07-26T15:51:05.522624+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:06.954 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[19094]: audit 2021-07-26T15:51:05.624696+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.96:0/3158637950' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e2f20b4-26f0-495a-9361-8cea9b39883d"}]: dispatch 2021-07-26T15:51:06.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[19094]: audit 2021-07-26T15:51:05.628002+0000 mon.a (mon.0) 437 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e2f20b4-26f0-495a-9361-8cea9b39883d"}]: dispatch 2021-07-26T15:51:06.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[19094]: audit 2021-07-26T15:51:05.637260+0000 mon.a (mon.0) 438 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e2f20b4-26f0-495a-9361-8cea9b39883d"}]': finished 2021-07-26T15:51:06.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[19094]: cluster 2021-07-26T15:51:05.637477+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2021-07-26T15:51:06.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[19094]: audit 2021-07-26T15:51:05.637773+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:06.956 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:06 smithi033 bash[19094]: audit 2021-07-26T15:51:06.282752+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.96:0/1044722645' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:51:06.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:06 smithi096 bash[15117]: cluster 2021-07-26T15:51:05.522624+0000 mgr.y (mgr.14146) 160 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:06.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:06 smithi096 bash[15117]: audit 2021-07-26T15:51:05.624696+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.96:0/3158637950' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e2f20b4-26f0-495a-9361-8cea9b39883d"}]: dispatch 2021-07-26T15:51:06.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:06 smithi096 bash[15117]: audit 2021-07-26T15:51:05.628002+0000 mon.a (mon.0) 437 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8e2f20b4-26f0-495a-9361-8cea9b39883d"}]: dispatch 2021-07-26T15:51:06.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:06 smithi096 bash[15117]: audit 2021-07-26T15:51:05.637260+0000 mon.a (mon.0) 438 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8e2f20b4-26f0-495a-9361-8cea9b39883d"}]': finished 2021-07-26T15:51:06.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:06 smithi096 bash[15117]: cluster 2021-07-26T15:51:05.637477+0000 mon.a (mon.0) 439 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2021-07-26T15:51:06.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:06 smithi096 bash[15117]: audit 2021-07-26T15:51:05.637773+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:06.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:06 smithi096 bash[15117]: audit 2021-07-26T15:51:06.282752+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.96:0/1044722645' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:51:09.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:09 smithi096 bash[15117]: cluster 2021-07-26T15:51:07.523196+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:09.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:09 smithi033 bash[14790]: cluster 2021-07-26T15:51:07.523196+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:09.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:09 smithi033 bash[19094]: cluster 2021-07-26T15:51:07.523196+0000 mgr.y (mgr.14146) 161 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:11.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:11 smithi033 bash[19094]: cluster 2021-07-26T15:51:09.523880+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:11.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:11 smithi033 bash[14790]: cluster 2021-07-26T15:51:09.523880+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:11.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:11 smithi096 bash[15117]: cluster 2021-07-26T15:51:09.523880+0000 mgr.y (mgr.14146) 162 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:12.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:12 smithi033 bash[14790]: audit 2021-07-26T15:51:11.667834+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:51:12.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:12 smithi033 bash[14790]: audit 2021-07-26T15:51:11.671811+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:51:12.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:12 smithi033 bash[19094]: audit 2021-07-26T15:51:11.667834+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:51:12.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:12 smithi033 bash[19094]: audit 2021-07-26T15:51:11.671811+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:51:12.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:12 smithi096 bash[15117]: audit 2021-07-26T15:51:11.667834+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:51:12.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:12 smithi096 bash[15117]: audit 2021-07-26T15:51:11.671811+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:51:13.399 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:13 smithi096 bash[15117]: cluster 2021-07-26T15:51:11.524592+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:13.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:13 smithi033 bash[14790]: cluster 2021-07-26T15:51:11.524592+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:13.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:13 smithi033 bash[19094]: cluster 2021-07-26T15:51:11.524592+0000 mgr.y (mgr.14146) 163 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:14.427 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:14 smithi096 bash[15117]: audit 2021-07-26T15:51:13.134712+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-07-26T15:51:14.427 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:14 smithi096 bash[15117]: audit 2021-07-26T15:51:13.136732+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:14.451 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:14 smithi033 bash[19094]: audit 2021-07-26T15:51:13.134712+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-07-26T15:51:14.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:14 smithi033 bash[19094]: audit 2021-07-26T15:51:13.136732+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:14.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:14 smithi033 bash[14790]: audit 2021-07-26T15:51:13.134712+0000 mon.a (mon.0) 443 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-07-26T15:51:14.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:14 smithi033 bash[14790]: audit 2021-07-26T15:51:13.136732+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:15.375 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:15 smithi096 bash[15117]: cephadm 2021-07-26T15:51:13.138282+0000 mgr.y (mgr.14146) 164 : cephadm [INF] Deploying daemon osd.5 on smithi096 2021-07-26T15:51:15.376 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:15 smithi096 bash[15117]: cluster 2021-07-26T15:51:13.525235+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:15.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:15 smithi033 bash[14790]: cephadm 2021-07-26T15:51:13.138282+0000 mgr.y (mgr.14146) 164 : cephadm [INF] Deploying daemon osd.5 on smithi096 2021-07-26T15:51:15.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:15 smithi033 bash[14790]: cluster 2021-07-26T15:51:13.525235+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:15.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:15 smithi033 bash[19094]: cephadm 2021-07-26T15:51:13.138282+0000 mgr.y (mgr.14146) 164 : cephadm [INF] Deploying daemon osd.5 on smithi096 2021-07-26T15:51:15.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:15 smithi033 bash[19094]: cluster 2021-07-26T15:51:13.525235+0000 mgr.y (mgr.14146) 165 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:15.533 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 5 on host 'smithi096' 2021-07-26T15:51:16.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:16 smithi033 bash[14790]: audit 2021-07-26T15:51:15.517895+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:16.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:16 smithi033 bash[14790]: audit 2021-07-26T15:51:15.522378+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:16.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:16 smithi033 bash[14790]: audit 2021-07-26T15:51:15.526170+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:16.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:16 smithi033 bash[14790]: audit 2021-07-26T15:51:15.530111+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:16.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:16 smithi033 bash[14790]: audit 2021-07-26T15:51:15.535156+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:16.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:16 smithi033 bash[19094]: audit 2021-07-26T15:51:15.517895+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:16.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:16 smithi033 bash[19094]: audit 2021-07-26T15:51:15.522378+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:16.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:16 smithi033 bash[19094]: audit 2021-07-26T15:51:15.526170+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:16.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:16 smithi033 bash[19094]: audit 2021-07-26T15:51:15.530111+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:16.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:16 smithi033 bash[19094]: audit 2021-07-26T15:51:15.535156+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:16.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:16 smithi096 bash[15117]: audit 2021-07-26T15:51:15.517895+0000 mon.a (mon.0) 445 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:16.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:16 smithi096 bash[15117]: audit 2021-07-26T15:51:15.522378+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:16.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:16 smithi096 bash[15117]: audit 2021-07-26T15:51:15.526170+0000 mon.a (mon.0) 447 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:16.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:16 smithi096 bash[15117]: audit 2021-07-26T15:51:15.530111+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:16.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:16 smithi096 bash[15117]: audit 2021-07-26T15:51:15.535156+0000 mon.a (mon.0) 449 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:16.869 DEBUG:teuthology.orchestra.run.smithi096:osd.5> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.5.service 2021-07-26T15:51:16.872 INFO:tasks.cephadm:Deploying osd.6 on smithi096 with /dev/vg_nvme/lv_2... 2021-07-26T15:51:16.872 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-07-26T15:51:17.027 INFO:journalctl@ceph.osd.5.smithi096.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:51:17.128 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:17 smithi096 bash[15117]: cluster 2021-07-26T15:51:15.525797+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:17.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:17 smithi033 bash[14790]: cluster 2021-07-26T15:51:15.525797+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:17.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:17 smithi033 bash[19094]: cluster 2021-07-26T15:51:15.525797+0000 mgr.y (mgr.14146) 166 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:18.235 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:17 smithi096 bash[20280]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-07-26T15:51:18.235 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:17 smithi096 bash[20280]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-07-26T15:51:18.236 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:17 smithi096 bash[20280]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-07-26T15:51:18.236 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:17 smithi096 bash[20280]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-07-26T15:51:18.236 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:17 smithi096 bash[20280]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-07-26T15:51:18.236 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:17 smithi096 bash[20280]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-07-26T15:51:18.236 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:17 smithi096 bash[20280]: --> ceph-volume lvm activate successful for osd ID: 5 2021-07-26T15:51:19.101 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:18 smithi096 bash[20458]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:51:19.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:19 smithi033 bash[14790]: cluster 2021-07-26T15:51:17.526450+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:19.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:19 smithi033 bash[19094]: cluster 2021-07-26T15:51:17.526450+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:19.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:19 smithi096 bash[15117]: cluster 2021-07-26T15:51:17.526450+0000 mgr.y (mgr.14146) 167 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:20.985 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:20 smithi096 bash[20458]: debug 2021-07-26T15:51:20.682+0000 7f2df61c5700 1 -- 172.21.15.96:0/3715759574 <== mon.2 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f5563b04e0 con 0x55f556427400 2021-07-26T15:51:21.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:21 smithi033 bash[14790]: cluster 2021-07-26T15:51:19.527019+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:21.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:21 smithi033 bash[14790]: audit 2021-07-26T15:51:21.038959+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:21.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:21 smithi033 bash[19094]: cluster 2021-07-26T15:51:19.527019+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:21.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:21 smithi033 bash[19094]: audit 2021-07-26T15:51:21.038959+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:21.479 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:21 smithi096 bash[20458]: debug 2021-07-26T15:51:21.262+0000 7f2dfdc5e080 -1 Falling back to public interface 2021-07-26T15:51:21.480 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:21 smithi096 bash[15117]: cluster 2021-07-26T15:51:19.527019+0000 mgr.y (mgr.14146) 168 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:21.480 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:21 smithi096 bash[15117]: audit 2021-07-26T15:51:21.038959+0000 mon.a (mon.0) 450 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:22.060 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-07-26T15:51:22.060 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-07-26T15:51:22.061 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2021-07-26T15:51:22.061 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2021-07-26T15:51:22.061 INFO:teuthology.orchestra.run.smithi096.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0183968 s, 570 MB/s 2021-07-26T15:51:22.061 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 2021-07-26T15:51:22.061 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2021-07-26T15:51:22.872 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch daemon add osd smithi096:vg_nvme/lv_2 2021-07-26T15:51:23.067 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:23 smithi096 bash[15117]: cluster 2021-07-26T15:51:21.527599+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:23.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:23 smithi033 bash[14790]: cluster 2021-07-26T15:51:21.527599+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:23.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:23 smithi033 bash[19094]: cluster 2021-07-26T15:51:21.527599+0000 mgr.y (mgr.14146) 169 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:24.485 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:24 smithi096 bash[20458]: debug 2021-07-26T15:51:24.234+0000 7f2dfdc5e080 -1 osd.5 0 log_to_monitors {default=true} 2021-07-26T15:51:25.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:25 smithi096 bash[15117]: cluster 2021-07-26T15:51:23.528298+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:25.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:25 smithi096 bash[15117]: audit 2021-07-26T15:51:24.241117+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/143251839,v1:172.21.15.96:6809/143251839]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T15:51:25.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:25 smithi096 bash[15117]: audit 2021-07-26T15:51:24.244264+0000 mon.a (mon.0) 451 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T15:51:25.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:25 smithi033 bash[14790]: cluster 2021-07-26T15:51:23.528298+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:25.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:25 smithi033 bash[14790]: audit 2021-07-26T15:51:24.241117+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/143251839,v1:172.21.15.96:6809/143251839]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T15:51:25.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:25 smithi033 bash[14790]: audit 2021-07-26T15:51:24.244264+0000 mon.a (mon.0) 451 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T15:51:25.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:25 smithi033 bash[19094]: cluster 2021-07-26T15:51:23.528298+0000 mgr.y (mgr.14146) 170 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:25.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:25 smithi033 bash[19094]: audit 2021-07-26T15:51:24.241117+0000 mon.b (mon.2) 13 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/143251839,v1:172.21.15.96:6809/143251839]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T15:51:25.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:25 smithi033 bash[19094]: audit 2021-07-26T15:51:24.244264+0000 mon.a (mon.0) 451 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T15:51:26.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:26 smithi033 bash[14790]: audit 2021-07-26T15:51:25.082516+0000 mon.b (mon.2) 14 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/143251839,v1:172.21.15.96:6809/143251839]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:26.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:26 smithi033 bash[14790]: audit 2021-07-26T15:51:25.082914+0000 mon.a (mon.0) 452 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-07-26T15:51:26.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:26 smithi033 bash[14790]: cluster 2021-07-26T15:51:25.083123+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2021-07-26T15:51:26.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:26 smithi033 bash[14790]: audit 2021-07-26T15:51:25.084037+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:26.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:26 smithi033 bash[14790]: audit 2021-07-26T15:51:25.090828+0000 mon.a (mon.0) 455 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:26.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:26 smithi033 bash[19094]: audit 2021-07-26T15:51:25.082516+0000 mon.b (mon.2) 14 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/143251839,v1:172.21.15.96:6809/143251839]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:26.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:26 smithi033 bash[19094]: audit 2021-07-26T15:51:25.082914+0000 mon.a (mon.0) 452 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-07-26T15:51:26.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:26 smithi033 bash[19094]: cluster 2021-07-26T15:51:25.083123+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2021-07-26T15:51:26.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:26 smithi033 bash[19094]: audit 2021-07-26T15:51:25.084037+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:26.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:26 smithi033 bash[19094]: audit 2021-07-26T15:51:25.090828+0000 mon.a (mon.0) 455 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:26.485 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:51:26 smithi096 bash[20458]: debug 2021-07-26T15:51:26.098+0000 7f2df59c4700 -1 osd.5 0 waiting for initial osdmap 2021-07-26T15:51:26.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:26 smithi096 bash[15117]: audit 2021-07-26T15:51:25.082516+0000 mon.b (mon.2) 14 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/143251839,v1:172.21.15.96:6809/143251839]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:26.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:26 smithi096 bash[15117]: audit 2021-07-26T15:51:25.082914+0000 mon.a (mon.0) 452 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-07-26T15:51:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:26 smithi096 bash[15117]: cluster 2021-07-26T15:51:25.083123+0000 mon.a (mon.0) 453 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2021-07-26T15:51:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:26 smithi096 bash[15117]: audit 2021-07-26T15:51:25.084037+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:26 smithi096 bash[15117]: audit 2021-07-26T15:51:25.090828+0000 mon.a (mon.0) 455 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:27.340 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:27 smithi096 bash[15117]: cluster 2021-07-26T15:51:25.528925+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:27.342 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:27 smithi096 bash[15117]: audit 2021-07-26T15:51:26.095032+0000 mon.a (mon.0) 456 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:51:27.342 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:27 smithi096 bash[15117]: cluster 2021-07-26T15:51:26.095256+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2021-07-26T15:51:27.342 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:27 smithi096 bash[15117]: audit 2021-07-26T15:51:26.096062+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:27.342 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:27 smithi096 bash[15117]: audit 2021-07-26T15:51:26.103348+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:27.343 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:27 smithi096 bash[15117]: cluster 2021-07-26T15:51:27.079951+0000 mon.a (mon.0) 460 : cluster [INF] osd.5 [v2:172.21.15.96:6808/143251839,v1:172.21.15.96:6809/143251839] boot 2021-07-26T15:51:27.343 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:27 smithi096 bash[15117]: cluster 2021-07-26T15:51:27.080054+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-07-26T15:51:27.343 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:27 smithi096 bash[15117]: audit 2021-07-26T15:51:27.081176+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:27.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[14790]: cluster 2021-07-26T15:51:25.528925+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:27.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[14790]: audit 2021-07-26T15:51:26.095032+0000 mon.a (mon.0) 456 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:51:27.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[14790]: cluster 2021-07-26T15:51:26.095256+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2021-07-26T15:51:27.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[14790]: audit 2021-07-26T15:51:26.096062+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:27.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[14790]: audit 2021-07-26T15:51:26.103348+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:27.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[14790]: cluster 2021-07-26T15:51:27.079951+0000 mon.a (mon.0) 460 : cluster [INF] osd.5 [v2:172.21.15.96:6808/143251839,v1:172.21.15.96:6809/143251839] boot 2021-07-26T15:51:27.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[14790]: cluster 2021-07-26T15:51:27.080054+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-07-26T15:51:27.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[14790]: audit 2021-07-26T15:51:27.081176+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:27.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[19094]: cluster 2021-07-26T15:51:25.528925+0000 mgr.y (mgr.14146) 171 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-07-26T15:51:27.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[19094]: audit 2021-07-26T15:51:26.095032+0000 mon.a (mon.0) 456 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:51:27.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[19094]: cluster 2021-07-26T15:51:26.095256+0000 mon.a (mon.0) 457 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2021-07-26T15:51:27.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[19094]: audit 2021-07-26T15:51:26.096062+0000 mon.a (mon.0) 458 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:27.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[19094]: audit 2021-07-26T15:51:26.103348+0000 mon.a (mon.0) 459 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:27.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[19094]: cluster 2021-07-26T15:51:27.079951+0000 mon.a (mon.0) 460 : cluster [INF] osd.5 [v2:172.21.15.96:6808/143251839,v1:172.21.15.96:6809/143251839] boot 2021-07-26T15:51:27.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[19094]: cluster 2021-07-26T15:51:27.080054+0000 mon.a (mon.0) 461 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-07-26T15:51:27.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:27 smithi033 bash[19094]: audit 2021-07-26T15:51:27.081176+0000 mon.a (mon.0) 462 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:51:28.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[14790]: cluster 2021-07-26T15:51:25.243866+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:51:28.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[14790]: cluster 2021-07-26T15:51:25.244068+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:51:28.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[14790]: audit 2021-07-26T15:51:27.489722+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:51:28.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[14790]: audit 2021-07-26T15:51:27.493433+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:51:28.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[14790]: audit 2021-07-26T15:51:27.495083+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:28.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[14790]: cluster 2021-07-26T15:51:28.081646+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-07-26T15:51:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[19094]: cluster 2021-07-26T15:51:25.243866+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:51:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[19094]: cluster 2021-07-26T15:51:25.244068+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:51:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[19094]: audit 2021-07-26T15:51:27.489722+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:51:28.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[19094]: audit 2021-07-26T15:51:27.493433+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:51:28.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[19094]: audit 2021-07-26T15:51:27.495083+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:28.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:28 smithi033 bash[19094]: cluster 2021-07-26T15:51:28.081646+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-07-26T15:51:28.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:28 smithi096 bash[15117]: cluster 2021-07-26T15:51:25.243866+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:51:28.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:28 smithi096 bash[15117]: cluster 2021-07-26T15:51:25.244068+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:51:28.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:28 smithi096 bash[15117]: audit 2021-07-26T15:51:27.489722+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:51:28.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:28 smithi096 bash[15117]: audit 2021-07-26T15:51:27.493433+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:51:28.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:28 smithi096 bash[15117]: audit 2021-07-26T15:51:27.495083+0000 mon.a (mon.0) 465 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:28.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:28 smithi096 bash[15117]: cluster 2021-07-26T15:51:28.081646+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-07-26T15:51:29.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: audit 2021-07-26T15:51:27.488002+0000 mgr.y (mgr.14146) 172 : audit [DBG] from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:51:29.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: cluster 2021-07-26T15:51:27.529519+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v154: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:29.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: audit 2021-07-26T15:51:28.421744+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: audit 2021-07-26T15:51:28.423680+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:29.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: audit 2021-07-26T15:51:28.425506+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:29.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: audit 2021-07-26T15:51:28.434219+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: audit 2021-07-26T15:51:28.441070+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: audit 2021-07-26T15:51:28.444386+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:29.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: audit 2021-07-26T15:51:28.446250+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:29.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: audit 2021-07-26T15:51:28.447653+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:29.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: audit 2021-07-26T15:51:28.455105+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[14790]: cluster 2021-07-26T15:51:29.083361+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-07-26T15:51:29.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: audit 2021-07-26T15:51:27.488002+0000 mgr.y (mgr.14146) 172 : audit [DBG] from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:51:29.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: cluster 2021-07-26T15:51:27.529519+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v154: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:29.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: audit 2021-07-26T15:51:28.421744+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: audit 2021-07-26T15:51:28.423680+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:29.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: audit 2021-07-26T15:51:28.425506+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:29.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: audit 2021-07-26T15:51:28.434219+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: audit 2021-07-26T15:51:28.441070+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: audit 2021-07-26T15:51:28.444386+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:29.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: audit 2021-07-26T15:51:28.446250+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:29.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: audit 2021-07-26T15:51:28.447653+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:29.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: audit 2021-07-26T15:51:28.455105+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:29 smithi033 bash[19094]: cluster 2021-07-26T15:51:29.083361+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-07-26T15:51:29.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: audit 2021-07-26T15:51:27.488002+0000 mgr.y (mgr.14146) 172 : audit [DBG] from='client.24278 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:51:29.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: cluster 2021-07-26T15:51:27.529519+0000 mgr.y (mgr.14146) 173 : cluster [DBG] pgmap v154: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:29.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: audit 2021-07-26T15:51:28.421744+0000 mon.a (mon.0) 467 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: audit 2021-07-26T15:51:28.423680+0000 mon.a (mon.0) 468 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:29.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: audit 2021-07-26T15:51:28.425506+0000 mon.a (mon.0) 469 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:29.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: audit 2021-07-26T15:51:28.434219+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: audit 2021-07-26T15:51:28.441070+0000 mon.a (mon.0) 471 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: audit 2021-07-26T15:51:28.444386+0000 mon.a (mon.0) 472 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:29.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: audit 2021-07-26T15:51:28.446250+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:29.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: audit 2021-07-26T15:51:28.447653+0000 mon.a (mon.0) 474 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:29.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: audit 2021-07-26T15:51:28.455105+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:29.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:29 smithi096 bash[15117]: cluster 2021-07-26T15:51:29.083361+0000 mon.a (mon.0) 476 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2021-07-26T15:51:30.379 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:30 smithi096 bash[15117]: cephadm 2021-07-26T15:51:28.411954+0000 mgr.y (mgr.14146) 174 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:51:30.379 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:30 smithi096 bash[15117]: cephadm 2021-07-26T15:51:28.426725+0000 mgr.y (mgr.14146) 175 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 8641M 2021-07-26T15:51:30.379 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:30 smithi096 bash[15117]: cluster 2021-07-26T15:51:29.530238+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v157: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:30.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:30 smithi033 bash[14790]: cephadm 2021-07-26T15:51:28.411954+0000 mgr.y (mgr.14146) 174 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:51:30.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:30 smithi033 bash[14790]: cephadm 2021-07-26T15:51:28.426725+0000 mgr.y (mgr.14146) 175 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 8641M 2021-07-26T15:51:30.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:30 smithi033 bash[14790]: cluster 2021-07-26T15:51:29.530238+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v157: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:30.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:30 smithi033 bash[19094]: cephadm 2021-07-26T15:51:28.411954+0000 mgr.y (mgr.14146) 174 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:51:30.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:30 smithi033 bash[19094]: cephadm 2021-07-26T15:51:28.426725+0000 mgr.y (mgr.14146) 175 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 8641M 2021-07-26T15:51:30.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:30 smithi033 bash[19094]: cluster 2021-07-26T15:51:29.530238+0000 mgr.y (mgr.14146) 176 : cluster [DBG] pgmap v157: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:31.702 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:31 smithi033 bash[14790]: audit 2021-07-26T15:51:31.255058+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.96:0/458348879' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c08bca3f-043c-406b-9f5a-88890d11ecae"}]: dispatch 2021-07-26T15:51:31.702 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:31 smithi033 bash[14790]: audit 2021-07-26T15:51:31.258340+0000 mon.a (mon.0) 477 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c08bca3f-043c-406b-9f5a-88890d11ecae"}]: dispatch 2021-07-26T15:51:31.702 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:31 smithi033 bash[14790]: audit 2021-07-26T15:51:31.267729+0000 mon.a (mon.0) 478 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c08bca3f-043c-406b-9f5a-88890d11ecae"}]': finished 2021-07-26T15:51:31.702 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:31 smithi033 bash[14790]: cluster 2021-07-26T15:51:31.267885+0000 mon.a (mon.0) 479 : cluster [DBG] osdmap e39: 7 total, 6 up, 7 in 2021-07-26T15:51:31.703 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:31 smithi033 bash[14790]: audit 2021-07-26T15:51:31.268190+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:31.703 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:31 smithi033 bash[19094]: audit 2021-07-26T15:51:31.255058+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.96:0/458348879' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c08bca3f-043c-406b-9f5a-88890d11ecae"}]: dispatch 2021-07-26T15:51:31.703 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:31 smithi033 bash[19094]: audit 2021-07-26T15:51:31.258340+0000 mon.a (mon.0) 477 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c08bca3f-043c-406b-9f5a-88890d11ecae"}]: dispatch 2021-07-26T15:51:31.704 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:31 smithi033 bash[19094]: audit 2021-07-26T15:51:31.267729+0000 mon.a (mon.0) 478 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c08bca3f-043c-406b-9f5a-88890d11ecae"}]': finished 2021-07-26T15:51:31.704 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:31 smithi033 bash[19094]: cluster 2021-07-26T15:51:31.267885+0000 mon.a (mon.0) 479 : cluster [DBG] osdmap e39: 7 total, 6 up, 7 in 2021-07-26T15:51:31.704 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:31 smithi033 bash[19094]: audit 2021-07-26T15:51:31.268190+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:31.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:31 smithi096 bash[15117]: audit 2021-07-26T15:51:31.255058+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.96:0/458348879' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c08bca3f-043c-406b-9f5a-88890d11ecae"}]: dispatch 2021-07-26T15:51:31.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:31 smithi096 bash[15117]: audit 2021-07-26T15:51:31.258340+0000 mon.a (mon.0) 477 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c08bca3f-043c-406b-9f5a-88890d11ecae"}]: dispatch 2021-07-26T15:51:31.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:31 smithi096 bash[15117]: audit 2021-07-26T15:51:31.267729+0000 mon.a (mon.0) 478 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c08bca3f-043c-406b-9f5a-88890d11ecae"}]': finished 2021-07-26T15:51:31.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:31 smithi096 bash[15117]: cluster 2021-07-26T15:51:31.267885+0000 mon.a (mon.0) 479 : cluster [DBG] osdmap e39: 7 total, 6 up, 7 in 2021-07-26T15:51:31.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:31 smithi096 bash[15117]: audit 2021-07-26T15:51:31.268190+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:32.701 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:32 smithi033 bash[14790]: cluster 2021-07-26T15:51:31.530976+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v159: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:32.702 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:32 smithi033 bash[14790]: audit 2021-07-26T15:51:31.942007+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.15.96:0/3294789304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:51:32.702 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:32 smithi033 bash[19094]: cluster 2021-07-26T15:51:31.530976+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v159: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:32.702 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:32 smithi033 bash[19094]: audit 2021-07-26T15:51:31.942007+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.15.96:0/3294789304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:51:32.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:32 smithi096 bash[15117]: cluster 2021-07-26T15:51:31.530976+0000 mgr.y (mgr.14146) 177 : cluster [DBG] pgmap v159: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:32.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:32 smithi096 bash[15117]: audit 2021-07-26T15:51:31.942007+0000 mon.b (mon.2) 16 : audit [DBG] from='client.? 172.21.15.96:0/3294789304' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:51:34.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:34 smithi096 bash[15117]: cluster 2021-07-26T15:51:33.531670+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:34.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:34 smithi033 bash[14790]: cluster 2021-07-26T15:51:33.531670+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:34.952 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:34 smithi033 bash[19094]: cluster 2021-07-26T15:51:33.531670+0000 mgr.y (mgr.14146) 178 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:36 smithi096 bash[15117]: cluster 2021-07-26T15:51:35.532197+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:36.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:36 smithi033 bash[14790]: cluster 2021-07-26T15:51:35.532197+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:36.952 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:36 smithi033 bash[19094]: cluster 2021-07-26T15:51:35.532197+0000 mgr.y (mgr.14146) 179 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:39.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:39 smithi033 bash[14790]: cluster 2021-07-26T15:51:37.532781+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:39.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:39 smithi033 bash[14790]: audit 2021-07-26T15:51:38.965641+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-07-26T15:51:39.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:39 smithi033 bash[14790]: audit 2021-07-26T15:51:38.967675+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:39.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:39 smithi033 bash[19094]: cluster 2021-07-26T15:51:37.532781+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:39.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:39 smithi033 bash[19094]: audit 2021-07-26T15:51:38.965641+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-07-26T15:51:39.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:39 smithi033 bash[19094]: audit 2021-07-26T15:51:38.967675+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:39.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:39 smithi096 bash[15117]: cluster 2021-07-26T15:51:37.532781+0000 mgr.y (mgr.14146) 180 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:39.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:39 smithi096 bash[15117]: audit 2021-07-26T15:51:38.965641+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-07-26T15:51:39.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:39 smithi096 bash[15117]: audit 2021-07-26T15:51:38.967675+0000 mon.a (mon.0) 482 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:40.346 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:40 smithi096 bash[15117]: cephadm 2021-07-26T15:51:38.969413+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Deploying daemon osd.6 on smithi096 2021-07-26T15:51:40.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:40 smithi033 bash[14790]: cephadm 2021-07-26T15:51:38.969413+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Deploying daemon osd.6 on smithi096 2021-07-26T15:51:40.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:40 smithi033 bash[19094]: cephadm 2021-07-26T15:51:38.969413+0000 mgr.y (mgr.14146) 181 : cephadm [INF] Deploying daemon osd.6 on smithi096 2021-07-26T15:51:41.154 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:41 smithi096 bash[15117]: cluster 2021-07-26T15:51:39.533367+0000 mgr.y (mgr.14146) 182 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:41.318 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 6 on host 'smithi096' 2021-07-26T15:51:41.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:41 smithi033 bash[14790]: cluster 2021-07-26T15:51:39.533367+0000 mgr.y (mgr.14146) 182 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:41.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:41 smithi033 bash[19094]: cluster 2021-07-26T15:51:39.533367+0000 mgr.y (mgr.14146) 182 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:42.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:42 smithi096 bash[15117]: audit 2021-07-26T15:51:41.305839+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:42.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:42 smithi096 bash[15117]: audit 2021-07-26T15:51:41.314171+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:42.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:42 smithi096 bash[15117]: audit 2021-07-26T15:51:41.314654+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:42.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:42 smithi096 bash[15117]: audit 2021-07-26T15:51:41.318585+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:42.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:42 smithi096 bash[15117]: audit 2021-07-26T15:51:41.322014+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:42.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:42 smithi033 bash[14790]: audit 2021-07-26T15:51:41.305839+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:42.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:42 smithi033 bash[14790]: audit 2021-07-26T15:51:41.314171+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:42.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:42 smithi033 bash[14790]: audit 2021-07-26T15:51:41.314654+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:42.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:42 smithi033 bash[14790]: audit 2021-07-26T15:51:41.318585+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:42.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:42 smithi033 bash[14790]: audit 2021-07-26T15:51:41.322014+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:42.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:42 smithi033 bash[19094]: audit 2021-07-26T15:51:41.305839+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:42.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:42 smithi033 bash[19094]: audit 2021-07-26T15:51:41.314171+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:42.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:42 smithi033 bash[19094]: audit 2021-07-26T15:51:41.314654+0000 mon.a (mon.0) 485 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:42.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:42 smithi033 bash[19094]: audit 2021-07-26T15:51:41.318585+0000 mon.a (mon.0) 486 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:42.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:42 smithi033 bash[19094]: audit 2021-07-26T15:51:41.322014+0000 mon.a (mon.0) 487 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:42.631 DEBUG:teuthology.orchestra.run.smithi096:osd.6> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.6.service 2021-07-26T15:51:42.634 INFO:tasks.cephadm:Deploying osd.7 on smithi096 with /dev/vg_nvme/lv_1... 2021-07-26T15:51:42.635 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-07-26T15:51:42.747 INFO:journalctl@ceph.osd.6.smithi096.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:51:43.153 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:43 smithi096 bash[15117]: cluster 2021-07-26T15:51:41.533922+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:43.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:43 smithi033 bash[14790]: cluster 2021-07-26T15:51:41.533922+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:43.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:43 smithi033 bash[19094]: cluster 2021-07-26T15:51:41.533922+0000 mgr.y (mgr.14146) 183 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:43.971 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:43 smithi096 bash[22891]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-07-26T15:51:43.971 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:43 smithi096 bash[22891]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-07-26T15:51:43.971 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:43 smithi096 bash[22891]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-07-26T15:51:43.972 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:43 smithi096 bash[22891]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-07-26T15:51:43.972 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:43 smithi096 bash[22891]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-07-26T15:51:43.972 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:43 smithi096 bash[22891]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-07-26T15:51:43.972 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:43 smithi096 bash[22891]: --> ceph-volume lvm activate successful for osd ID: 6 2021-07-26T15:51:44.734 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:44 smithi096 bash[23105]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:51:45.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:45 smithi033 bash[14790]: cluster 2021-07-26T15:51:43.534526+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:45.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:45 smithi033 bash[19094]: cluster 2021-07-26T15:51:43.534526+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:45.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:45 smithi096 bash[15117]: cluster 2021-07-26T15:51:43.534526+0000 mgr.y (mgr.14146) 184 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:46.921 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:46 smithi096 bash[15117]: cluster 2021-07-26T15:51:45.535097+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:46.922 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:46 smithi096 bash[15117]: audit 2021-07-26T15:51:45.557218+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:46.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:46 smithi033 bash[14790]: cluster 2021-07-26T15:51:45.535097+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:46.952 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:46 smithi033 bash[14790]: audit 2021-07-26T15:51:45.557218+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:46.952 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:46 smithi033 bash[19094]: cluster 2021-07-26T15:51:45.535097+0000 mgr.y (mgr.14146) 185 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:46.952 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:46 smithi033 bash[19094]: audit 2021-07-26T15:51:45.557218+0000 mon.a (mon.0) 488 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:47.234 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:46 smithi096 bash[23105]: debug 2021-07-26T15:51:46.974+0000 7f3dfe34b700 1 -- 172.21.15.96:0/2767283841 <== mon.2 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a7c7e244e0 con 0x55a7c7e9ac00 2021-07-26T15:51:47.685 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:47 smithi096 bash[23105]: debug 2021-07-26T15:51:47.526+0000 7f3e05de4080 -1 Falling back to public interface 2021-07-26T15:51:48.103 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-07-26T15:51:48.104 INFO:teuthology.orchestra.run.smithi096.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-07-26T15:51:48.104 INFO:teuthology.orchestra.run.smithi096.stderr: stderr: 10+0 records in 2021-07-26T15:51:48.104 INFO:teuthology.orchestra.run.smithi096.stderr:10+0 records out 2021-07-26T15:51:48.105 INFO:teuthology.orchestra.run.smithi096.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0151442 s, 692 MB/s 2021-07-26T15:51:48.105 INFO:teuthology.orchestra.run.smithi096.stderr:--> Zapping successful for: 2021-07-26T15:51:49.319 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch daemon add osd smithi096:vg_nvme/lv_1 2021-07-26T15:51:49.332 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:49 smithi096 bash[15117]: cluster 2021-07-26T15:51:47.535745+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:49.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:49 smithi033 bash[14790]: cluster 2021-07-26T15:51:47.535745+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:49.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:49 smithi033 bash[19094]: cluster 2021-07-26T15:51:47.535745+0000 mgr.y (mgr.14146) 186 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:50.726 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:50 smithi096 bash[23105]: debug 2021-07-26T15:51:50.558+0000 7f3e05de4080 -1 osd.6 0 log_to_monitors {default=true} 2021-07-26T15:51:51.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:51 smithi033 bash[14790]: cluster 2021-07-26T15:51:49.536339+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:51.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:51 smithi033 bash[14790]: audit 2021-07-26T15:51:50.564236+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/806457173,v1:172.21.15.96:6817/806457173]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T15:51:51.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:51 smithi033 bash[14790]: audit 2021-07-26T15:51:50.567197+0000 mon.a (mon.0) 489 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T15:51:51.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:51 smithi033 bash[19094]: cluster 2021-07-26T15:51:49.536339+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:51.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:51 smithi033 bash[19094]: audit 2021-07-26T15:51:50.564236+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/806457173,v1:172.21.15.96:6817/806457173]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T15:51:51.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:51 smithi033 bash[19094]: audit 2021-07-26T15:51:50.567197+0000 mon.a (mon.0) 489 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T15:51:51.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:51 smithi096 bash[15117]: cluster 2021-07-26T15:51:49.536339+0000 mgr.y (mgr.14146) 187 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:51.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:51 smithi096 bash[15117]: audit 2021-07-26T15:51:50.564236+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/806457173,v1:172.21.15.96:6817/806457173]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T15:51:51.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:51 smithi096 bash[15117]: audit 2021-07-26T15:51:50.567197+0000 mon.a (mon.0) 489 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T15:51:52.302 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:51:52 smithi096 bash[23105]: debug 2021-07-26T15:51:52.114+0000 7f3dfc347700 -1 osd.6 0 waiting for initial osdmap 2021-07-26T15:51:52.302 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:52 smithi096 bash[15117]: audit 2021-07-26T15:51:51.094070+0000 mon.b (mon.2) 18 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/806457173,v1:172.21.15.96:6817/806457173]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:52.302 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:52 smithi096 bash[15117]: audit 2021-07-26T15:51:51.094305+0000 mon.a (mon.0) 490 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-07-26T15:51:52.303 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:52 smithi096 bash[15117]: cluster 2021-07-26T15:51:51.094573+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2021-07-26T15:51:52.303 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:52 smithi096 bash[15117]: audit 2021-07-26T15:51:51.095507+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:52.304 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:52 smithi096 bash[15117]: audit 2021-07-26T15:51:51.102532+0000 mon.a (mon.0) 493 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:52.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:52 smithi033 bash[14790]: audit 2021-07-26T15:51:51.094070+0000 mon.b (mon.2) 18 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/806457173,v1:172.21.15.96:6817/806457173]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:52.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:52 smithi033 bash[14790]: audit 2021-07-26T15:51:51.094305+0000 mon.a (mon.0) 490 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-07-26T15:51:52.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:52 smithi033 bash[14790]: cluster 2021-07-26T15:51:51.094573+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2021-07-26T15:51:52.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:52 smithi033 bash[14790]: audit 2021-07-26T15:51:51.095507+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:52.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:52 smithi033 bash[14790]: audit 2021-07-26T15:51:51.102532+0000 mon.a (mon.0) 493 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:52.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:52 smithi033 bash[19094]: audit 2021-07-26T15:51:51.094070+0000 mon.b (mon.2) 18 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/806457173,v1:172.21.15.96:6817/806457173]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:52.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:52 smithi033 bash[19094]: audit 2021-07-26T15:51:51.094305+0000 mon.a (mon.0) 490 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-07-26T15:51:52.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:52 smithi033 bash[19094]: cluster 2021-07-26T15:51:51.094573+0000 mon.a (mon.0) 491 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2021-07-26T15:51:52.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:52 smithi033 bash[19094]: audit 2021-07-26T15:51:51.095507+0000 mon.a (mon.0) 492 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:52.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:52 smithi033 bash[19094]: audit 2021-07-26T15:51:51.102532+0000 mon.a (mon.0) 493 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:51:53.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:53 smithi096 bash[15117]: cluster 2021-07-26T15:51:51.536907+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:53.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:53 smithi096 bash[15117]: audit 2021-07-26T15:51:52.113444+0000 mon.a (mon.0) 494 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:51:53.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:53 smithi096 bash[15117]: cluster 2021-07-26T15:51:52.113571+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2021-07-26T15:51:53.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:53 smithi096 bash[15117]: audit 2021-07-26T15:51:52.113869+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:53.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:53 smithi096 bash[15117]: audit 2021-07-26T15:51:52.120798+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:53.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:53 smithi033 bash[14790]: cluster 2021-07-26T15:51:51.536907+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:53.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:53 smithi033 bash[14790]: audit 2021-07-26T15:51:52.113444+0000 mon.a (mon.0) 494 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:51:53.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:53 smithi033 bash[14790]: cluster 2021-07-26T15:51:52.113571+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2021-07-26T15:51:53.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:53 smithi033 bash[14790]: audit 2021-07-26T15:51:52.113869+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:53.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:53 smithi033 bash[14790]: audit 2021-07-26T15:51:52.120798+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:53.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:53 smithi033 bash[19094]: cluster 2021-07-26T15:51:51.536907+0000 mgr.y (mgr.14146) 188 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2021-07-26T15:51:53.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:53 smithi033 bash[19094]: audit 2021-07-26T15:51:52.113444+0000 mon.a (mon.0) 494 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:51:53.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:53 smithi033 bash[19094]: cluster 2021-07-26T15:51:52.113571+0000 mon.a (mon.0) 495 : cluster [DBG] osdmap e41: 7 total, 6 up, 7 in 2021-07-26T15:51:53.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:53 smithi033 bash[19094]: audit 2021-07-26T15:51:52.113869+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:53.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:53 smithi033 bash[19094]: audit 2021-07-26T15:51:52.120798+0000 mon.a (mon.0) 497 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:54.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: cluster 2021-07-26T15:51:51.606150+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:51:54.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: cluster 2021-07-26T15:51:51.606319+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:51:54.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: cluster 2021-07-26T15:51:53.114855+0000 mon.a (mon.0) 498 : cluster [INF] osd.6 [v2:172.21.15.96:6816/806457173,v1:172.21.15.96:6817/806457173] boot 2021-07-26T15:51:54.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: cluster 2021-07-26T15:51:53.115119+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-07-26T15:51:54.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.116461+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:54.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: cephadm 2021-07-26T15:51:53.178095+0000 mgr.y (mgr.14146) 189 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:51:54.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.187078+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:54.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.387641+0000 mgr.y (mgr.14146) 190 : audit [DBG] from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:51:54.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.389302+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:51:54.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.393088+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:51:54.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.394946+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:54.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.421614+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:54.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.423633+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:54.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.425649+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:54.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: cephadm 2021-07-26T15:51:53.427140+0000 mgr.y (mgr.14146) 191 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 5760M 2021-07-26T15:51:54.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.435920+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:54.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.443730+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:54.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.446451+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:54.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.448553+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:54.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.450008+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:54.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: cluster 2021-07-26T15:51:51.606150+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:51:54.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: cluster 2021-07-26T15:51:51.606319+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:51:54.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: cluster 2021-07-26T15:51:53.114855+0000 mon.a (mon.0) 498 : cluster [INF] osd.6 [v2:172.21.15.96:6816/806457173,v1:172.21.15.96:6817/806457173] boot 2021-07-26T15:51:54.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: cluster 2021-07-26T15:51:53.115119+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-07-26T15:51:54.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.116461+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:54.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: cephadm 2021-07-26T15:51:53.178095+0000 mgr.y (mgr.14146) 189 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:51:54.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.187078+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:54.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.387641+0000 mgr.y (mgr.14146) 190 : audit [DBG] from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:51:54.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.389302+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:51:54.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.393088+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:51:54.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.394946+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:54.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.421614+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:54.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.423633+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:54.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.425649+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:54.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: cephadm 2021-07-26T15:51:53.427140+0000 mgr.y (mgr.14146) 191 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 5760M 2021-07-26T15:51:54.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.435920+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:54.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.443730+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:54.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.446451+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:54.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.448553+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:54.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.450008+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:54.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: cluster 2021-07-26T15:51:53.537493+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:51:54.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[19094]: audit 2021-07-26T15:51:53.702892+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:54.475 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: cluster 2021-07-26T15:51:53.537493+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:51:54.477 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:54 smithi033 bash[14790]: audit 2021-07-26T15:51:53.702892+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:54.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: cluster 2021-07-26T15:51:51.606150+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:51:54.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: cluster 2021-07-26T15:51:51.606319+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:51:54.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: cluster 2021-07-26T15:51:53.114855+0000 mon.a (mon.0) 498 : cluster [INF] osd.6 [v2:172.21.15.96:6816/806457173,v1:172.21.15.96:6817/806457173] boot 2021-07-26T15:51:54.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: cluster 2021-07-26T15:51:53.115119+0000 mon.a (mon.0) 499 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-07-26T15:51:54.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.116461+0000 mon.a (mon.0) 500 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:51:54.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: cephadm 2021-07-26T15:51:53.178095+0000 mgr.y (mgr.14146) 189 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:51:54.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.187078+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:54.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.387641+0000 mgr.y (mgr.14146) 190 : audit [DBG] from='client.24305 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi096:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:51:54.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.389302+0000 mon.a (mon.0) 502 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-07-26T15:51:54.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.393088+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-07-26T15:51:54.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.394946+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:54.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.421614+0000 mon.a (mon.0) 505 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:54.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.423633+0000 mon.a (mon.0) 506 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:54.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.425649+0000 mon.a (mon.0) 507 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:51:54.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: cephadm 2021-07-26T15:51:53.427140+0000 mgr.y (mgr.14146) 191 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 5760M 2021-07-26T15:51:54.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.435920+0000 mon.a (mon.0) 508 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:54.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.443730+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:54.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.446451+0000 mon.a (mon.0) 510 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:51:54.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.448553+0000 mon.a (mon.0) 511 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:51:54.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.450008+0000 mon.a (mon.0) 512 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:51:54.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: cluster 2021-07-26T15:51:53.537493+0000 mgr.y (mgr.14146) 192 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:51:54.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:54 smithi096 bash[15117]: audit 2021-07-26T15:51:53.702892+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:51:55.432 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:55 smithi096 bash[15117]: cluster 2021-07-26T15:51:54.126242+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-07-26T15:51:55.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:55 smithi033 bash[14790]: cluster 2021-07-26T15:51:54.126242+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-07-26T15:51:55.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:55 smithi033 bash[19094]: cluster 2021-07-26T15:51:54.126242+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e43: 7 total, 7 up, 7 in 2021-07-26T15:51:56.432 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:56 smithi096 bash[15117]: cluster 2021-07-26T15:51:55.145335+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2021-07-26T15:51:56.432 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:56 smithi096 bash[15117]: cluster 2021-07-26T15:51:55.538116+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:51:56.451 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:56 smithi033 bash[19094]: cluster 2021-07-26T15:51:55.145335+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2021-07-26T15:51:56.451 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:56 smithi033 bash[19094]: cluster 2021-07-26T15:51:55.538116+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:51:56.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:56 smithi033 bash[14790]: cluster 2021-07-26T15:51:55.145335+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e44: 7 total, 7 up, 7 in 2021-07-26T15:51:56.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:56 smithi033 bash[14790]: cluster 2021-07-26T15:51:55.538116+0000 mgr.y (mgr.14146) 193 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:51:58.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[19094]: audit 2021-07-26T15:51:57.321594+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.96:0/1208680264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a54a6024-e16e-429a-aa5b-4445c0a29b17"}]: dispatch 2021-07-26T15:51:58.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[19094]: audit 2021-07-26T15:51:57.324674+0000 mon.a (mon.0) 516 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a54a6024-e16e-429a-aa5b-4445c0a29b17"}]: dispatch 2021-07-26T15:51:58.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[19094]: audit 2021-07-26T15:51:57.333912+0000 mon.a (mon.0) 517 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a54a6024-e16e-429a-aa5b-4445c0a29b17"}]': finished 2021-07-26T15:51:58.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[19094]: cluster 2021-07-26T15:51:57.334124+0000 mon.a (mon.0) 518 : cluster [DBG] osdmap e45: 8 total, 7 up, 8 in 2021-07-26T15:51:58.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[19094]: audit 2021-07-26T15:51:57.334421+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:51:58.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[19094]: audit 2021-07-26T15:51:57.995843+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.15.96:0/1104945849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:51:58.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[14790]: audit 2021-07-26T15:51:57.321594+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.96:0/1208680264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a54a6024-e16e-429a-aa5b-4445c0a29b17"}]: dispatch 2021-07-26T15:51:58.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[14790]: audit 2021-07-26T15:51:57.324674+0000 mon.a (mon.0) 516 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a54a6024-e16e-429a-aa5b-4445c0a29b17"}]: dispatch 2021-07-26T15:51:58.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[14790]: audit 2021-07-26T15:51:57.333912+0000 mon.a (mon.0) 517 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a54a6024-e16e-429a-aa5b-4445c0a29b17"}]': finished 2021-07-26T15:51:58.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[14790]: cluster 2021-07-26T15:51:57.334124+0000 mon.a (mon.0) 518 : cluster [DBG] osdmap e45: 8 total, 7 up, 8 in 2021-07-26T15:51:58.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[14790]: audit 2021-07-26T15:51:57.334421+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:51:58.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:58 smithi033 bash[14790]: audit 2021-07-26T15:51:57.995843+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.15.96:0/1104945849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:51:58.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:58 smithi096 bash[15117]: audit 2021-07-26T15:51:57.321594+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.96:0/1208680264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a54a6024-e16e-429a-aa5b-4445c0a29b17"}]: dispatch 2021-07-26T15:51:58.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:58 smithi096 bash[15117]: audit 2021-07-26T15:51:57.324674+0000 mon.a (mon.0) 516 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a54a6024-e16e-429a-aa5b-4445c0a29b17"}]: dispatch 2021-07-26T15:51:58.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:58 smithi096 bash[15117]: audit 2021-07-26T15:51:57.333912+0000 mon.a (mon.0) 517 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a54a6024-e16e-429a-aa5b-4445c0a29b17"}]': finished 2021-07-26T15:51:58.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:58 smithi096 bash[15117]: cluster 2021-07-26T15:51:57.334124+0000 mon.a (mon.0) 518 : cluster [DBG] osdmap e45: 8 total, 7 up, 8 in 2021-07-26T15:51:58.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:58 smithi096 bash[15117]: audit 2021-07-26T15:51:57.334421+0000 mon.a (mon.0) 519 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:51:58.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:58 smithi096 bash[15117]: audit 2021-07-26T15:51:57.995843+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.15.96:0/1104945849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-07-26T15:51:59.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:51:59 smithi033 bash[14790]: cluster 2021-07-26T15:51:57.538713+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:51:59.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:51:59 smithi033 bash[19094]: cluster 2021-07-26T15:51:57.538713+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:51:59.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:51:59 smithi096 bash[15117]: cluster 2021-07-26T15:51:57.538713+0000 mgr.y (mgr.14146) 194 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:01.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:01 smithi033 bash[14790]: cluster 2021-07-26T15:51:59.539456+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:01.451 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:01 smithi033 bash[19094]: cluster 2021-07-26T15:51:59.539456+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:01.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:01 smithi096 bash[15117]: cluster 2021-07-26T15:51:59.539456+0000 mgr.y (mgr.14146) 195 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:03.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:03 smithi033 bash[14790]: cluster 2021-07-26T15:52:01.540198+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:03.451 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:03 smithi033 bash[19094]: cluster 2021-07-26T15:52:01.540198+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:03.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:03 smithi096 bash[15117]: cluster 2021-07-26T15:52:01.540198+0000 mgr.y (mgr.14146) 196 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:05.439 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:05 smithi096 bash[15117]: cluster 2021-07-26T15:52:03.540837+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:05.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:05 smithi033 bash[14790]: cluster 2021-07-26T15:52:03.540837+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:05.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:05 smithi033 bash[19094]: cluster 2021-07-26T15:52:03.540837+0000 mgr.y (mgr.14146) 197 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:06.426 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:06 smithi096 bash[15117]: audit 2021-07-26T15:52:05.164219+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-07-26T15:52:06.426 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:06 smithi096 bash[15117]: audit 2021-07-26T15:52:05.166153+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:52:06.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:06 smithi033 bash[14790]: audit 2021-07-26T15:52:05.164219+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-07-26T15:52:06.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:06 smithi033 bash[14790]: audit 2021-07-26T15:52:05.166153+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:52:06.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:06 smithi033 bash[19094]: audit 2021-07-26T15:52:05.164219+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-07-26T15:52:06.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:06 smithi033 bash[19094]: audit 2021-07-26T15:52:05.166153+0000 mon.a (mon.0) 521 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:52:07.441 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:07 smithi096 bash[15117]: cephadm 2021-07-26T15:52:05.167737+0000 mgr.y (mgr.14146) 198 : cephadm [INF] Deploying daemon osd.7 on smithi096 2021-07-26T15:52:07.442 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:07 smithi096 bash[15117]: cluster 2021-07-26T15:52:05.541418+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:07.451 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:07 smithi033 bash[14790]: cephadm 2021-07-26T15:52:05.167737+0000 mgr.y (mgr.14146) 198 : cephadm [INF] Deploying daemon osd.7 on smithi096 2021-07-26T15:52:07.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:07 smithi033 bash[14790]: cluster 2021-07-26T15:52:05.541418+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:07.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:07 smithi033 bash[19094]: cephadm 2021-07-26T15:52:05.167737+0000 mgr.y (mgr.14146) 198 : cephadm [INF] Deploying daemon osd.7 on smithi096 2021-07-26T15:52:07.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:07 smithi033 bash[19094]: cluster 2021-07-26T15:52:05.541418+0000 mgr.y (mgr.14146) 199 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:07.701 INFO:teuthology.orchestra.run.smithi096.stdout:Created osd(s) 7 on host 'smithi096' 2021-07-26T15:52:08.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:08 smithi033 bash[14790]: audit 2021-07-26T15:52:07.684831+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:52:08.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:08 smithi033 bash[14790]: audit 2021-07-26T15:52:07.693595+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:08.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:08 smithi033 bash[14790]: audit 2021-07-26T15:52:07.694082+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:52:08.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:08 smithi033 bash[14790]: audit 2021-07-26T15:52:07.696612+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:52:08.453 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:08 smithi033 bash[14790]: audit 2021-07-26T15:52:07.701930+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:08.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:08 smithi033 bash[19094]: audit 2021-07-26T15:52:07.684831+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:52:08.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:08 smithi033 bash[19094]: audit 2021-07-26T15:52:07.693595+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:08.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:08 smithi033 bash[19094]: audit 2021-07-26T15:52:07.694082+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:52:08.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:08 smithi033 bash[19094]: audit 2021-07-26T15:52:07.696612+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:52:08.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:08 smithi033 bash[19094]: audit 2021-07-26T15:52:07.701930+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:08.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:08 smithi096 bash[15117]: audit 2021-07-26T15:52:07.684831+0000 mon.a (mon.0) 522 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:52:08.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:08 smithi096 bash[15117]: audit 2021-07-26T15:52:07.693595+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:08.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:08 smithi096 bash[15117]: audit 2021-07-26T15:52:07.694082+0000 mon.a (mon.0) 524 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:52:08.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:08 smithi096 bash[15117]: audit 2021-07-26T15:52:07.696612+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:52:08.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:08 smithi096 bash[15117]: audit 2021-07-26T15:52:07.701930+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:08.957 DEBUG:teuthology.orchestra.run.smithi096:osd.7> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.7.service 2021-07-26T15:52:08.961 INFO:tasks.cephadm:Adding prometheus.a on smithi096 2021-07-26T15:52:08.962 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch apply prometheus '1;smithi096=a' 2021-07-26T15:52:09.038 INFO:journalctl@ceph.osd.7.smithi096.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:52:09.207 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:09 smithi096 bash[15117]: cluster 2021-07-26T15:52:07.541996+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:09.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:09 smithi033 bash[14790]: cluster 2021-07-26T15:52:07.541996+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:09.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:09 smithi033 bash[19094]: cluster 2021-07-26T15:52:07.541996+0000 mgr.y (mgr.14146) 200 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:10.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:10 smithi033 bash[19094]: cluster 2021-07-26T15:52:09.542579+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:10.452 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:10 smithi033 bash[14790]: cluster 2021-07-26T15:52:09.542579+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:10.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:10 smithi096 bash[15117]: cluster 2021-07-26T15:52:09.542579+0000 mgr.y (mgr.14146) 201 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:10.484 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:10 smithi096 bash[25547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-07-26T15:52:10.484 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:10 smithi096 bash[25547]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-07-26T15:52:10.485 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:10 smithi096 bash[25547]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-07-26T15:52:10.485 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:10 smithi096 bash[25547]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-07-26T15:52:10.485 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:10 smithi096 bash[25547]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-07-26T15:52:10.485 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:10 smithi096 bash[25547]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-07-26T15:52:10.485 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:10 smithi096 bash[25547]: --> ceph-volume lvm activate successful for osd ID: 7 2021-07-26T15:52:11.229 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:11 smithi096 bash[25729]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:52:12.919 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:12 smithi096 bash[15117]: cluster 2021-07-26T15:52:11.543149+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:12.920 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:12 smithi096 bash[15117]: audit 2021-07-26T15:52:11.670554+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:52:12.920 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:12 smithi096 bash[15117]: audit 2021-07-26T15:52:11.674997+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:52:12.952 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:12 smithi033 bash[19094]: cluster 2021-07-26T15:52:11.543149+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:12.953 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:12 smithi033 bash[19094]: audit 2021-07-26T15:52:11.670554+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:52:12.953 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:12 smithi033 bash[19094]: audit 2021-07-26T15:52:11.674997+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:52:12.953 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:12 smithi033 bash[14790]: cluster 2021-07-26T15:52:11.543149+0000 mgr.y (mgr.14146) 202 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:12.954 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:12 smithi033 bash[14790]: audit 2021-07-26T15:52:11.670554+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:52:12.954 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:12 smithi033 bash[14790]: audit 2021-07-26T15:52:11.674997+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:52:13.234 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:12 smithi096 bash[25729]: debug 2021-07-26T15:52:12.974+0000 7fd6160f4700 1 -- 172.21.15.96:0/3313859024 <== mon.1 v2:172.21.15.33:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f7a8a164e0 con 0x55f7a8a8cc00 2021-07-26T15:52:13.734 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:13 smithi096 bash[25729]: debug 2021-07-26T15:52:13.514+0000 7fd61db8d080 -1 Falling back to public interface 2021-07-26T15:52:14.476 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:14 smithi096 bash[15117]: audit 2021-07-26T15:52:13.215864+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:14.477 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:14 smithi096 bash[15117]: cluster 2021-07-26T15:52:13.543777+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:14.703 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:14 smithi033 bash[19094]: audit 2021-07-26T15:52:13.215864+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:14.703 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:14 smithi033 bash[19094]: cluster 2021-07-26T15:52:13.543777+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:14.703 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:14 smithi033 bash[14790]: audit 2021-07-26T15:52:13.215864+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:14.704 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:14 smithi033 bash[14790]: cluster 2021-07-26T15:52:13.543777+0000 mgr.y (mgr.14146) 203 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:14.909 INFO:teuthology.orchestra.run.smithi096.stdout:Scheduled prometheus update... 2021-07-26T15:52:16.071 DEBUG:teuthology.orchestra.run.smithi096:prometheus.a> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@prometheus.a.service 2021-07-26T15:52:16.074 INFO:tasks.cephadm:Adding node-exporter.a on smithi033 2021-07-26T15:52:16.075 INFO:tasks.cephadm:Adding node-exporter.b on smithi096 2021-07-26T15:52:16.075 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch apply node-exporter '2;smithi033=a;smithi096=b' 2021-07-26T15:52:16.203 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:15 smithi033 bash[19094]: audit 2021-07-26T15:52:14.903933+0000 mgr.y (mgr.14146) 204 : audit [DBG] from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi096=a", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:16.203 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:15 smithi033 bash[19094]: cephadm 2021-07-26T15:52:14.905490+0000 mgr.y (mgr.14146) 205 : cephadm [INF] Saving service prometheus spec with placement smithi096=a;count:1 2021-07-26T15:52:16.203 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:15 smithi033 bash[19094]: audit 2021-07-26T15:52:14.912207+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:16.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:15 smithi033 bash[14790]: audit 2021-07-26T15:52:14.903933+0000 mgr.y (mgr.14146) 204 : audit [DBG] from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi096=a", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:16.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:15 smithi033 bash[14790]: cephadm 2021-07-26T15:52:14.905490+0000 mgr.y (mgr.14146) 205 : cephadm [INF] Saving service prometheus spec with placement smithi096=a;count:1 2021-07-26T15:52:16.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:15 smithi033 bash[14790]: audit 2021-07-26T15:52:14.912207+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:16.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:15 smithi096 bash[15117]: audit 2021-07-26T15:52:14.903933+0000 mgr.y (mgr.14146) 204 : audit [DBG] from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi096=a", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:16.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:15 smithi096 bash[15117]: cephadm 2021-07-26T15:52:14.905490+0000 mgr.y (mgr.14146) 205 : cephadm [INF] Saving service prometheus spec with placement smithi096=a;count:1 2021-07-26T15:52:16.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:15 smithi096 bash[15117]: audit 2021-07-26T15:52:14.912207+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:16.260 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:52:16.733 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:16 smithi096 bash[25729]: debug 2021-07-26T15:52:16.326+0000 7fd61db8d080 -1 osd.7 0 log_to_monitors {default=true} 2021-07-26T15:52:17.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:16 smithi033 bash[14790]: cluster 2021-07-26T15:52:15.544344+0000 mgr.y (mgr.14146) 206 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:17.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:16 smithi033 bash[14790]: audit 2021-07-26T15:52:16.334777+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/535155277,v1:172.21.15.96:6825/535155277]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T15:52:17.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:16 smithi033 bash[14790]: audit 2021-07-26T15:52:16.335524+0000 mon.a (mon.0) 531 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T15:52:17.205 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:16 smithi033 bash[19094]: cluster 2021-07-26T15:52:15.544344+0000 mgr.y (mgr.14146) 206 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:17.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:16 smithi033 bash[19094]: audit 2021-07-26T15:52:16.334777+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/535155277,v1:172.21.15.96:6825/535155277]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T15:52:17.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:16 smithi033 bash[19094]: audit 2021-07-26T15:52:16.335524+0000 mon.a (mon.0) 531 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T15:52:17.233 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:16 smithi096 bash[15117]: cluster 2021-07-26T15:52:15.544344+0000 mgr.y (mgr.14146) 206 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:17.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:16 smithi096 bash[15117]: audit 2021-07-26T15:52:16.334777+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/535155277,v1:172.21.15.96:6825/535155277]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T15:52:17.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:16 smithi096 bash[15117]: audit 2021-07-26T15:52:16.335524+0000 mon.a (mon.0) 531 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T15:52:18.195 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:17 smithi096 bash[15117]: audit 2021-07-26T15:52:16.926814+0000 mon.a (mon.0) 532 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-07-26T15:52:18.195 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:17 smithi096 bash[15117]: cluster 2021-07-26T15:52:16.927193+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2021-07-26T15:52:18.195 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:17 smithi096 bash[15117]: audit 2021-07-26T15:52:16.928130+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:18.195 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:17 smithi096 bash[15117]: audit 2021-07-26T15:52:16.928547+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/535155277,v1:172.21.15.96:6825/535155277]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:52:18.196 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:17 smithi096 bash[15117]: audit 2021-07-26T15:52:16.929233+0000 mon.a (mon.0) 535 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:52:18.197 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:52:17 smithi096 bash[25729]: debug 2021-07-26T15:52:17.938+0000 7fd6140f0700 -1 osd.7 0 waiting for initial osdmap 2021-07-26T15:52:18.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:17 smithi033 bash[14790]: audit 2021-07-26T15:52:16.926814+0000 mon.a (mon.0) 532 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-07-26T15:52:18.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:17 smithi033 bash[14790]: cluster 2021-07-26T15:52:16.927193+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2021-07-26T15:52:18.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:17 smithi033 bash[14790]: audit 2021-07-26T15:52:16.928130+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:18.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:17 smithi033 bash[14790]: audit 2021-07-26T15:52:16.928547+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/535155277,v1:172.21.15.96:6825/535155277]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:52:18.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:17 smithi033 bash[14790]: audit 2021-07-26T15:52:16.929233+0000 mon.a (mon.0) 535 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:52:18.205 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:17 smithi033 bash[19094]: audit 2021-07-26T15:52:16.926814+0000 mon.a (mon.0) 532 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-07-26T15:52:18.205 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:17 smithi033 bash[19094]: cluster 2021-07-26T15:52:16.927193+0000 mon.a (mon.0) 533 : cluster [DBG] osdmap e46: 8 total, 7 up, 8 in 2021-07-26T15:52:18.205 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:17 smithi033 bash[19094]: audit 2021-07-26T15:52:16.928130+0000 mon.a (mon.0) 534 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:18.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:17 smithi033 bash[19094]: audit 2021-07-26T15:52:16.928547+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/535155277,v1:172.21.15.96:6825/535155277]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:52:18.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:17 smithi033 bash[19094]: audit 2021-07-26T15:52:16.929233+0000 mon.a (mon.0) 535 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T15:52:19.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:18 smithi033 bash[14790]: cluster 2021-07-26T15:52:17.544979+0000 mgr.y (mgr.14146) 207 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:19.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:18 smithi033 bash[14790]: audit 2021-07-26T15:52:17.929599+0000 mon.a (mon.0) 536 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:52:19.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:18 smithi033 bash[14790]: cluster 2021-07-26T15:52:17.929836+0000 mon.a (mon.0) 537 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2021-07-26T15:52:19.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:18 smithi033 bash[14790]: audit 2021-07-26T15:52:17.930171+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:19.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:18 smithi033 bash[14790]: audit 2021-07-26T15:52:17.939553+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:19.205 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:18 smithi033 bash[19094]: cluster 2021-07-26T15:52:17.544979+0000 mgr.y (mgr.14146) 207 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:19.205 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:18 smithi033 bash[19094]: audit 2021-07-26T15:52:17.929599+0000 mon.a (mon.0) 536 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:52:19.205 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:18 smithi033 bash[19094]: cluster 2021-07-26T15:52:17.929836+0000 mon.a (mon.0) 537 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2021-07-26T15:52:19.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:18 smithi033 bash[19094]: audit 2021-07-26T15:52:17.930171+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:19.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:18 smithi033 bash[19094]: audit 2021-07-26T15:52:17.939553+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:19.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:18 smithi096 bash[15117]: cluster 2021-07-26T15:52:17.544979+0000 mgr.y (mgr.14146) 207 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:19.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:18 smithi096 bash[15117]: audit 2021-07-26T15:52:17.929599+0000 mon.a (mon.0) 536 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]': finished 2021-07-26T15:52:19.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:18 smithi096 bash[15117]: cluster 2021-07-26T15:52:17.929836+0000 mon.a (mon.0) 537 : cluster [DBG] osdmap e47: 8 total, 7 up, 8 in 2021-07-26T15:52:19.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:18 smithi096 bash[15117]: audit 2021-07-26T15:52:17.930171+0000 mon.a (mon.0) 538 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:19.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:18 smithi096 bash[15117]: audit 2021-07-26T15:52:17.939553+0000 mon.a (mon.0) 539 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:20.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[14790]: cluster 2021-07-26T15:52:17.355819+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:52:20.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[14790]: cluster 2021-07-26T15:52:17.356016+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:52:20.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[14790]: cluster 2021-07-26T15:52:18.942225+0000 mon.a (mon.0) 540 : cluster [INF] osd.7 [v2:172.21.15.96:6824/535155277,v1:172.21.15.96:6825/535155277] boot 2021-07-26T15:52:20.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[14790]: cluster 2021-07-26T15:52:18.942455+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-07-26T15:52:20.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[14790]: audit 2021-07-26T15:52:18.943712+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:20.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[14790]: cluster 2021-07-26T15:52:19.943768+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-07-26T15:52:20.205 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[19094]: cluster 2021-07-26T15:52:17.355819+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:52:20.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[19094]: cluster 2021-07-26T15:52:17.356016+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:52:20.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[19094]: cluster 2021-07-26T15:52:18.942225+0000 mon.a (mon.0) 540 : cluster [INF] osd.7 [v2:172.21.15.96:6824/535155277,v1:172.21.15.96:6825/535155277] boot 2021-07-26T15:52:20.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[19094]: cluster 2021-07-26T15:52:18.942455+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-07-26T15:52:20.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[19094]: audit 2021-07-26T15:52:18.943712+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:20.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:19 smithi033 bash[19094]: cluster 2021-07-26T15:52:19.943768+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-07-26T15:52:20.233 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:19 smithi096 bash[15117]: cluster 2021-07-26T15:52:17.355819+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-07-26T15:52:20.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:19 smithi096 bash[15117]: cluster 2021-07-26T15:52:17.356016+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-07-26T15:52:20.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:19 smithi096 bash[15117]: cluster 2021-07-26T15:52:18.942225+0000 mon.a (mon.0) 540 : cluster [INF] osd.7 [v2:172.21.15.96:6824/535155277,v1:172.21.15.96:6825/535155277] boot 2021-07-26T15:52:20.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:19 smithi096 bash[15117]: cluster 2021-07-26T15:52:18.942455+0000 mon.a (mon.0) 541 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2021-07-26T15:52:20.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:19 smithi096 bash[15117]: audit 2021-07-26T15:52:18.943712+0000 mon.a (mon.0) 542 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:52:20.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:19 smithi096 bash[15117]: cluster 2021-07-26T15:52:19.943768+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-07-26T15:52:20.968 INFO:teuthology.orchestra.run.smithi096.stdout:Scheduled node-exporter update... 2021-07-26T15:52:21.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:20 smithi096 bash[15117]: cluster 2021-07-26T15:52:19.545572+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:21.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:20 smithi096 bash[15117]: audit 2021-07-26T15:52:20.796051+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:21.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:20 smithi096 bash[15117]: audit 2021-07-26T15:52:20.798661+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:20 smithi096 bash[15117]: audit 2021-07-26T15:52:20.800957+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:20 smithi096 bash[15117]: audit 2021-07-26T15:52:20.803112+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:20 smithi096 bash[15117]: audit 2021-07-26T15:52:20.804956+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:20 smithi096 bash[15117]: audit 2021-07-26T15:52:20.815372+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:21.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:20 smithi096 bash[15117]: audit 2021-07-26T15:52:20.825401+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:21.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:20 smithi096 bash[15117]: cluster 2021-07-26T15:52:20.948795+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-07-26T15:52:21.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[14790]: cluster 2021-07-26T15:52:19.545572+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:21.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[14790]: audit 2021-07-26T15:52:20.796051+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:21.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[14790]: audit 2021-07-26T15:52:20.798661+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[14790]: audit 2021-07-26T15:52:20.800957+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[14790]: audit 2021-07-26T15:52:20.803112+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[14790]: audit 2021-07-26T15:52:20.804956+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[14790]: audit 2021-07-26T15:52:20.815372+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:21.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[14790]: audit 2021-07-26T15:52:20.825401+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:21.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[14790]: cluster 2021-07-26T15:52:20.948795+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-07-26T15:52:21.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[19094]: cluster 2021-07-26T15:52:19.545572+0000 mgr.y (mgr.14146) 208 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-07-26T15:52:21.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[19094]: audit 2021-07-26T15:52:20.796051+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:21.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[19094]: audit 2021-07-26T15:52:20.798661+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[19094]: audit 2021-07-26T15:52:20.800957+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[19094]: audit 2021-07-26T15:52:20.803112+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[19094]: audit 2021-07-26T15:52:20.804956+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:52:21.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[19094]: audit 2021-07-26T15:52:20.815372+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:21.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[19094]: audit 2021-07-26T15:52:20.825401+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:21.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:20 smithi033 bash[19094]: cluster 2021-07-26T15:52:20.948795+0000 mon.a (mon.0) 551 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-07-26T15:52:21.822 DEBUG:teuthology.orchestra.run.smithi033:node-exporter.a> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@node-exporter.a.service 2021-07-26T15:52:21.825 DEBUG:teuthology.orchestra.run.smithi096:node-exporter.b> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@node-exporter.b.service 2021-07-26T15:52:21.827 INFO:tasks.cephadm:Adding alertmanager.a on smithi033 2021-07-26T15:52:21.828 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch apply alertmanager '1;smithi033=a' 2021-07-26T15:52:21.925 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:52:21.949 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:52:22.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[14790]: cephadm 2021-07-26T15:52:20.785523+0000 mgr.y (mgr.14146) 209 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:52:22.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[14790]: cephadm 2021-07-26T15:52:20.805977+0000 mgr.y (mgr.14146) 210 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 4320M 2021-07-26T15:52:22.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[14790]: cephadm 2021-07-26T15:52:20.848202+0000 mgr.y (mgr.14146) 211 : cephadm [INF] Deploying daemon prometheus.a on smithi096 2021-07-26T15:52:22.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[14790]: audit 2021-07-26T15:52:20.965145+0000 mgr.y (mgr.14146) 212 : audit [DBG] from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi033=a;smithi096=b", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:22.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[14790]: cephadm 2021-07-26T15:52:20.966285+0000 mgr.y (mgr.14146) 213 : cephadm [INF] Saving service node-exporter spec with placement smithi033=a;smithi096=b;count:2 2021-07-26T15:52:22.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[14790]: audit 2021-07-26T15:52:20.970479+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:22.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[19094]: cephadm 2021-07-26T15:52:20.785523+0000 mgr.y (mgr.14146) 209 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:52:22.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[19094]: cephadm 2021-07-26T15:52:20.805977+0000 mgr.y (mgr.14146) 210 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 4320M 2021-07-26T15:52:22.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[19094]: cephadm 2021-07-26T15:52:20.848202+0000 mgr.y (mgr.14146) 211 : cephadm [INF] Deploying daemon prometheus.a on smithi096 2021-07-26T15:52:22.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[19094]: audit 2021-07-26T15:52:20.965145+0000 mgr.y (mgr.14146) 212 : audit [DBG] from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi033=a;smithi096=b", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:22.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[19094]: cephadm 2021-07-26T15:52:20.966285+0000 mgr.y (mgr.14146) 213 : cephadm [INF] Saving service node-exporter spec with placement smithi033=a;smithi096=b;count:2 2021-07-26T15:52:22.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:21 smithi033 bash[19094]: audit 2021-07-26T15:52:20.970479+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:22.233 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:21 smithi096 bash[15117]: cephadm 2021-07-26T15:52:20.785523+0000 mgr.y (mgr.14146) 209 : cephadm [INF] Detected new or changed devices on smithi096 2021-07-26T15:52:22.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:21 smithi096 bash[15117]: cephadm 2021-07-26T15:52:20.805977+0000 mgr.y (mgr.14146) 210 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 4320M 2021-07-26T15:52:22.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:21 smithi096 bash[15117]: cephadm 2021-07-26T15:52:20.848202+0000 mgr.y (mgr.14146) 211 : cephadm [INF] Deploying daemon prometheus.a on smithi096 2021-07-26T15:52:22.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:21 smithi096 bash[15117]: audit 2021-07-26T15:52:20.965145+0000 mgr.y (mgr.14146) 212 : audit [DBG] from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi033=a;smithi096=b", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:22.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:21 smithi096 bash[15117]: cephadm 2021-07-26T15:52:20.966285+0000 mgr.y (mgr.14146) 213 : cephadm [INF] Saving service node-exporter spec with placement smithi033=a;smithi096=b;count:2 2021-07-26T15:52:22.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:21 smithi096 bash[15117]: audit 2021-07-26T15:52:20.970479+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:23.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:23 smithi033 bash[19094]: cluster 2021-07-26T15:52:21.546150+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:23.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:23 smithi033 bash[14790]: cluster 2021-07-26T15:52:21.546150+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:23.483 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:23 smithi096 bash[15117]: cluster 2021-07-26T15:52:21.546150+0000 mgr.y (mgr.14146) 214 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:25.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:25 smithi033 bash[19094]: cluster 2021-07-26T15:52:23.546818+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:25.454 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:25 smithi033 bash[14790]: cluster 2021-07-26T15:52:23.546818+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:25.483 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:25 smithi096 bash[15117]: cluster 2021-07-26T15:52:23.546818+0000 mgr.y (mgr.14146) 215 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:27.394 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:27 smithi096 bash[15117]: cluster 2021-07-26T15:52:25.547432+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:27.454 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:27 smithi033 bash[19094]: cluster 2021-07-26T15:52:25.547432+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:27.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:27 smithi033 bash[14790]: cluster 2021-07-26T15:52:25.547432+0000 mgr.y (mgr.14146) 216 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:27.735 INFO:teuthology.orchestra.run.smithi096.stdout:Scheduled alertmanager update... 2021-07-26T15:52:28.801 DEBUG:teuthology.orchestra.run.smithi033:alertmanager.a> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@alertmanager.a.service 2021-07-26T15:52:28.804 INFO:tasks.cephadm:Adding grafana.a on smithi096 2021-07-26T15:52:28.805 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph orch apply grafana '1;smithi096=a' 2021-07-26T15:52:28.824 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:52:29.013 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:28 smithi096 bash[15117]: cluster 2021-07-26T15:52:27.548123+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:29.013 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:28 smithi096 bash[15117]: audit 2021-07-26T15:52:27.727236+0000 mgr.y (mgr.14146) 218 : audit [DBG] from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi033=a", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:29.014 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:28 smithi096 bash[15117]: cephadm 2021-07-26T15:52:27.728820+0000 mgr.y (mgr.14146) 219 : cephadm [INF] Saving service alertmanager spec with placement smithi033=a;count:1 2021-07-26T15:52:29.014 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:28 smithi096 bash[15117]: audit 2021-07-26T15:52:27.736445+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:29.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:28 smithi033 bash[14790]: cluster 2021-07-26T15:52:27.548123+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:29.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:28 smithi033 bash[14790]: audit 2021-07-26T15:52:27.727236+0000 mgr.y (mgr.14146) 218 : audit [DBG] from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi033=a", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:29.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:28 smithi033 bash[14790]: cephadm 2021-07-26T15:52:27.728820+0000 mgr.y (mgr.14146) 219 : cephadm [INF] Saving service alertmanager spec with placement smithi033=a;count:1 2021-07-26T15:52:29.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:28 smithi033 bash[14790]: audit 2021-07-26T15:52:27.736445+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:29.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:28 smithi033 bash[19094]: cluster 2021-07-26T15:52:27.548123+0000 mgr.y (mgr.14146) 217 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:29.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:28 smithi033 bash[19094]: audit 2021-07-26T15:52:27.727236+0000 mgr.y (mgr.14146) 218 : audit [DBG] from='client.24344 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi033=a", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:29.206 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:28 smithi033 bash[19094]: cephadm 2021-07-26T15:52:27.728820+0000 mgr.y (mgr.14146) 219 : cephadm [INF] Saving service alertmanager spec with placement smithi033=a;count:1 2021-07-26T15:52:29.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:28 smithi033 bash[19094]: audit 2021-07-26T15:52:27.736445+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:30.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:30 smithi096 bash[15117]: cluster 2021-07-26T15:52:29.548866+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:31.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:30 smithi033 bash[14790]: cluster 2021-07-26T15:52:29.548866+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:31.205 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:30 smithi033 bash[19094]: cluster 2021-07-26T15:52:29.548866+0000 mgr.y (mgr.14146) 220 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:33.121 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:33 smithi096 bash[15117]: cluster 2021-07-26T15:52:31.549521+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:33.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:33 smithi033 bash[14790]: cluster 2021-07-26T15:52:31.549521+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:33.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:33 smithi033 bash[19094]: cluster 2021-07-26T15:52:31.549521+0000 mgr.y (mgr.14146) 221 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:34.723 INFO:teuthology.orchestra.run.smithi096.stdout:Scheduled grafana update... 2021-07-26T15:52:35.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:35 smithi096 bash[15117]: cluster 2021-07-26T15:52:33.550181+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:35.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:35 smithi096 bash[15117]: audit 2021-07-26T15:52:34.723519+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:35.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:35 smithi033 bash[14790]: cluster 2021-07-26T15:52:33.550181+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:35.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:35 smithi033 bash[14790]: audit 2021-07-26T15:52:34.723519+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:35.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:35 smithi033 bash[19094]: cluster 2021-07-26T15:52:33.550181+0000 mgr.y (mgr.14146) 222 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:35.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:35 smithi033 bash[19094]: audit 2021-07-26T15:52:34.723519+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:35.804 DEBUG:teuthology.orchestra.run.smithi096:grafana.a> sudo journalctl -f -n 0 -u ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@grafana.a.service 2021-07-26T15:52:35.809 INFO:tasks.cephadm:Setting up client nodes... 2021-07-26T15:52:35.810 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-07-26T15:52:35.873 INFO:journalctl@ceph.grafana.a.smithi096.stdout:-- Logs begin at Wed 2021-03-03 23:51:07 UTC. -- 2021-07-26T15:52:36.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:36 smithi033 bash[19094]: audit 2021-07-26T15:52:34.714482+0000 mgr.y (mgr.14146) 223 : audit [DBG] from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi096=a", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:36.455 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:36 smithi033 bash[19094]: cephadm 2021-07-26T15:52:34.716022+0000 mgr.y (mgr.14146) 224 : cephadm [INF] Saving service grafana spec with placement smithi096=a;count:1 2021-07-26T15:52:36.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:36 smithi033 bash[14790]: audit 2021-07-26T15:52:34.714482+0000 mgr.y (mgr.14146) 223 : audit [DBG] from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi096=a", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:36.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:36 smithi033 bash[14790]: cephadm 2021-07-26T15:52:34.716022+0000 mgr.y (mgr.14146) 224 : cephadm [INF] Saving service grafana spec with placement smithi096=a;count:1 2021-07-26T15:52:36.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:36 smithi096 bash[15117]: audit 2021-07-26T15:52:34.714482+0000 mgr.y (mgr.14146) 223 : audit [DBG] from='client.24350 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi096=a", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:52:36.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:36 smithi096 bash[15117]: cephadm 2021-07-26T15:52:34.716022+0000 mgr.y (mgr.14146) 224 : cephadm [INF] Saving service grafana spec with placement smithi096=a;count:1 2021-07-26T15:52:37.380 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:37 smithi033 bash[19094]: cluster 2021-07-26T15:52:35.550906+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:37.380 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:37 smithi033 bash[14790]: cluster 2021-07-26T15:52:35.550906+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:37.386 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:37 smithi096 bash[15117]: cluster 2021-07-26T15:52:35.550906+0000 mgr.y (mgr.14146) 225 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:37.387 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:37 smithi096 systemd[1]: Started Ceph prometheus.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:52:37.735 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:37 smithi096 bash[27660]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:52:38.636 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[15117]: audit 2021-07-26T15:52:37.336302+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:38.636 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[15117]: audit 2021-07-26T15:52:37.338913+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:52:38.637 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[15117]: audit 2021-07-26T15:52:37.341258+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:52:38.637 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[15117]: audit 2021-07-26T15:52:37.343179+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:52:38.637 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[15117]: cluster 2021-07-26T15:52:37.551639+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:38.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:38 smithi033 bash[14790]: audit 2021-07-26T15:52:37.336302+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:38.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:38 smithi033 bash[14790]: audit 2021-07-26T15:52:37.338913+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:52:38.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:38 smithi033 bash[14790]: audit 2021-07-26T15:52:37.341258+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:52:38.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:38 smithi033 bash[14790]: audit 2021-07-26T15:52:37.343179+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:52:38.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:38 smithi033 bash[14790]: cluster 2021-07-26T15:52:37.551639+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:38.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:38 smithi033 bash[19094]: audit 2021-07-26T15:52:37.336302+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:38.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:38 smithi033 bash[19094]: audit 2021-07-26T15:52:37.338913+0000 mon.a (mon.0) 556 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:52:38.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:38 smithi033 bash[19094]: audit 2021-07-26T15:52:37.341258+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:52:38.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:38 smithi033 bash[19094]: audit 2021-07-26T15:52:37.343179+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:52:38.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:38 smithi033 bash[19094]: cluster 2021-07-26T15:52:37.551639+0000 mgr.y (mgr.14146) 226 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:38.985 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.638Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-07-26T15:52:38.986 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.638Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-07-26T15:52:38.986 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.638Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-07-26T15:52:38.987 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.638Z caller=main.go:339 host_details="(Linux 5.4.0-80-generic #90-Ubuntu SMP Fri Jul 9 22:49:44 UTC 2021 x86_64 smithi096 (none))" 2021-07-26T15:52:38.987 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.638Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-07-26T15:52:38.988 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.638Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-07-26T15:52:38.989 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.641Z caller=main.go:678 msg="Starting TSDB ..." 2021-07-26T15:52:38.990 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.641Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-07-26T15:52:38.990 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.647Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-07-26T15:52:38.991 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.648Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-07-26T15:52:38.991 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.648Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=878.599µs 2021-07-26T15:52:38.992 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.651Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-07-26T15:52:38.992 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.651Z caller=main.go:695 msg="TSDB started" 2021-07-26T15:52:38.994 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.651Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-07-26T15:52:38.995 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.660Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-07-26T15:52:38.995 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:52:38 smithi096 bash[27660]: level=info ts=2021-07-26T15:52:38.660Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-07-26T15:52:39.602 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2021-07-26T15:52:39.602 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQBH2v5gDzN8IxAAYcoEiza8EGNOUjw958u03g== 2021-07-26T15:52:39.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:39 smithi033 bash[19094]: audit 2021-07-26T15:52:39.594987+0000 mon.a (mon.0) 559 : audit [INF] from='client.? 172.21.15.33:0/1573886826' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-07-26T15:52:39.955 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:39 smithi033 bash[19094]: audit 2021-07-26T15:52:39.602699+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.33:0/1573886826' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-07-26T15:52:39.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:39 smithi033 bash[14790]: audit 2021-07-26T15:52:39.594987+0000 mon.a (mon.0) 559 : audit [INF] from='client.? 172.21.15.33:0/1573886826' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-07-26T15:52:39.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:39 smithi033 bash[14790]: audit 2021-07-26T15:52:39.602699+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.33:0/1573886826' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-07-26T15:52:39.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:39 smithi096 bash[15117]: audit 2021-07-26T15:52:39.594987+0000 mon.a (mon.0) 559 : audit [INF] from='client.? 172.21.15.33:0/1573886826' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-07-26T15:52:39.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:39 smithi096 bash[15117]: audit 2021-07-26T15:52:39.602699+0000 mon.a (mon.0) 560 : audit [INF] from='client.? 172.21.15.33:0/1573886826' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-07-26T15:52:40.271 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T15:52:40.271 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-07-26T15:52:40.272 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-07-26T15:52:40.298 DEBUG:teuthology.orchestra.run.smithi096:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-07-26T15:52:41.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:41 smithi033 bash[14790]: cluster 2021-07-26T15:52:39.552048+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:41.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:41 smithi033 bash[14790]: audit 2021-07-26T15:52:40.033601+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:41.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:41 smithi033 bash[19094]: cluster 2021-07-26T15:52:39.552048+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:41.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:41 smithi033 bash[19094]: audit 2021-07-26T15:52:40.033601+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:41.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:41 smithi096 bash[15117]: cluster 2021-07-26T15:52:39.552048+0000 mgr.y (mgr.14146) 227 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:41.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:41 smithi096 bash[15117]: audit 2021-07-26T15:52:40.033601+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:42.847 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:42 smithi033 systemd[1]: Started Ceph node-exporter.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:52:43.205 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:42 smithi033 bash[30660]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:52:43.622 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:42 smithi033 bash[30660]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-07-26T15:52:43.622 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[14790]: cluster 2021-07-26T15:52:41.552633+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:43.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[14790]: audit 2021-07-26T15:52:42.039101+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:43.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[14790]: audit 2021-07-26T15:52:42.049461+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:43.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[14790]: cephadm 2021-07-26T15:52:42.054047+0000 mgr.y (mgr.14146) 229 : cephadm [INF] Deploying daemon node-exporter.a on smithi033 2021-07-26T15:52:43.623 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[14790]: audit 2021-07-26T15:52:42.804226+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:43.624 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[19094]: cluster 2021-07-26T15:52:41.552633+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:43.624 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[19094]: audit 2021-07-26T15:52:42.039101+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:43.624 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[19094]: audit 2021-07-26T15:52:42.049461+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:43.624 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[19094]: cephadm 2021-07-26T15:52:42.054047+0000 mgr.y (mgr.14146) 229 : cephadm [INF] Deploying daemon node-exporter.a on smithi033 2021-07-26T15:52:43.625 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[19094]: audit 2021-07-26T15:52:42.804226+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:43.625 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:43 smithi096 bash[15117]: cluster 2021-07-26T15:52:41.552633+0000 mgr.y (mgr.14146) 228 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:43.625 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:43 smithi096 bash[15117]: audit 2021-07-26T15:52:42.039101+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:43.626 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:43 smithi096 bash[15117]: audit 2021-07-26T15:52:42.049461+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:43.626 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:43 smithi096 bash[15117]: cephadm 2021-07-26T15:52:42.054047+0000 mgr.y (mgr.14146) 229 : cephadm [INF] Deploying daemon node-exporter.a on smithi033 2021-07-26T15:52:43.626 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:43 smithi096 bash[15117]: audit 2021-07-26T15:52:42.804226+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:43.627 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:43 smithi096 systemd[1]: Started Ceph node-exporter.b for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:52:43.705 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[30660]: v0.18.1: Pulling from prom/node-exporter 2021-07-26T15:52:43.705 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[30660]: 49a2d53aa1af: Pulling fs layer 2021-07-26T15:52:43.706 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[30660]: 3589a6efd9ce: Pulling fs layer 2021-07-26T15:52:43.706 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[30660]: 190160031744: Pulling fs layer 2021-07-26T15:52:43.706 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[30660]: 3589a6efd9ce: Download complete 2021-07-26T15:52:43.708 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[30660]: 49a2d53aa1af: Download complete 2021-07-26T15:52:43.708 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[30660]: 190160031744: Verifying Checksum 2021-07-26T15:52:43.708 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[30660]: 190160031744: Download complete 2021-07-26T15:52:43.778 INFO:teuthology.orchestra.run.smithi096.stdout:[client.1] 2021-07-26T15:52:43.779 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBL2v5gXxHoLRAAQIRG6Op7rboC7ADxYZ0cPQ== 2021-07-26T15:52:43.985 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:43 smithi096 bash[28218]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:52:43.985 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:43 smithi096 bash[28218]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-07-26T15:52:44.205 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:43 smithi033 bash[30660]: 49a2d53aa1af: Pull complete 2021-07-26T15:52:44.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[14790]: cephadm 2021-07-26T15:52:42.805395+0000 mgr.y (mgr.14146) 230 : cephadm [INF] Deploying daemon node-exporter.b on smithi096 2021-07-26T15:52:44.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[14790]: audit 2021-07-26T15:52:43.542576+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:44.206 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[14790]: audit 2021-07-26T15:52:43.769710+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.96:0/1864657376' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-07-26T15:52:44.207 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[14790]: audit 2021-07-26T15:52:43.769824+0000 mon.a (mon.0) 566 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-07-26T15:52:44.207 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[14790]: audit 2021-07-26T15:52:43.778981+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-07-26T15:52:44.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[19094]: cephadm 2021-07-26T15:52:42.805395+0000 mgr.y (mgr.14146) 230 : cephadm [INF] Deploying daemon node-exporter.b on smithi096 2021-07-26T15:52:44.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[19094]: audit 2021-07-26T15:52:43.542576+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:44.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[19094]: audit 2021-07-26T15:52:43.769710+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.96:0/1864657376' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-07-26T15:52:44.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[19094]: audit 2021-07-26T15:52:43.769824+0000 mon.a (mon.0) 566 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-07-26T15:52:44.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[19094]: audit 2021-07-26T15:52:43.778981+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-07-26T15:52:44.485 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[28218]: v0.18.1: Pulling from prom/node-exporter 2021-07-26T15:52:44.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[15117]: cephadm 2021-07-26T15:52:42.805395+0000 mgr.y (mgr.14146) 230 : cephadm [INF] Deploying daemon node-exporter.b on smithi096 2021-07-26T15:52:44.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[15117]: audit 2021-07-26T15:52:43.542576+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:44.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[15117]: audit 2021-07-26T15:52:43.769710+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.96:0/1864657376' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-07-26T15:52:44.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[15117]: audit 2021-07-26T15:52:43.769824+0000 mon.a (mon.0) 566 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-07-26T15:52:44.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[15117]: audit 2021-07-26T15:52:43.778981+0000 mon.a (mon.0) 567 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-07-26T15:52:44.705 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[30660]: 3589a6efd9ce: Pull complete 2021-07-26T15:52:44.839 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2021-07-26T15:52:44.840 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-07-26T15:52:44.840 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-07-26T15:52:44.862 INFO:tasks.cephadm:Waiting for OSDs to come up 2021-07-26T15:52:44.864 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-07-26T15:52:45.046 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[28218]: 49a2d53aa1af: Pulling fs layer 2021-07-26T15:52:45.046 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[28218]: 3589a6efd9ce: Pulling fs layer 2021-07-26T15:52:45.046 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[28218]: 190160031744: Pulling fs layer 2021-07-26T15:52:45.047 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[28218]: 3589a6efd9ce: Verifying Checksum 2021-07-26T15:52:45.047 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[28218]: 3589a6efd9ce: Download complete 2021-07-26T15:52:45.047 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[28218]: 49a2d53aa1af: Download complete 2021-07-26T15:52:45.048 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[28218]: 190160031744: Verifying Checksum 2021-07-26T15:52:45.048 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:44 smithi096 bash[28218]: 190160031744: Download complete 2021-07-26T15:52:45.048 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[30660]: 190160031744: Pull complete 2021-07-26T15:52:45.049 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:44 smithi033 bash[30660]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-07-26T15:52:45.175 INFO:teuthology.misc.health.smithi033.stdout: 2021-07-26T15:52:45.175 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":50,"fsid":"7e62724e-ee28-11eb-8c23-001a4aab830c","created":"2021-07-26T15:46:09.081088+0000","modified":"2021-07-26T15:52:20.937609+0000","last_up_change":"2021-07-26T15:52:18.932597+0000","last_in_change":"2021-07-26T15:51:57.326019+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:50:11.585304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"3d02e4ad-97fb-45ac-9912-2d795394c8ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6803","nonce":2786020081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6805","nonce":2786020081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6809","nonce":2786020081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6807","nonce":2786020081}]},"public_addr":"172.21.15.33:6803/2786020081","cluster_addr":"172.21.15.33:6805/2786020081","heartbeat_back_addr":"172.21.15.33:6809/2786020081","heartbeat_front_addr":"172.21.15.33:6807/2786020081","state":["exists","up"]},{"osd":1,"uuid":"789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6811","nonce":2278642317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6813","nonce":2278642317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6817","nonce":2278642317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6815","nonce":2278642317}]},"public_addr":"172.21.15.33:6811/2278642317","cluster_addr":"172.21.15.33:6813/2278642317","heartbeat_back_addr":"172.21.15.33:6817/2278642317","heartbeat_front_addr":"172.21.15.33:6815/2278642317","state":["exists","up"]},{"osd":2,"uuid":"9690c749-a40a-44a7-8a07-5290ff8980a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6819","nonce":290055652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6821","nonce":290055652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6825","nonce":290055652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6823","nonce":290055652}]},"public_addr":"172.21.15.33:6819/290055652","cluster_addr":"172.21.15.33:6821/290055652","heartbeat_back_addr":"172.21.15.33:6825/290055652","heartbeat_front_addr":"172.21.15.33:6823/290055652","state":["exists","up"]},{"osd":3,"uuid":"ca4ee0f8-4870-49bb-8dd6-75ab536d7199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6827","nonce":3214716836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6829","nonce":3214716836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6833","nonce":3214716836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6831","nonce":3214716836}]},"public_addr":"172.21.15.33:6827/3214716836","cluster_addr":"172.21.15.33:6829/3214716836","heartbeat_back_addr":"172.21.15.33:6833/3214716836","heartbeat_front_addr":"172.21.15.33:6831/3214716836","state":["exists","up"]},{"osd":4,"uuid":"d630717e-8f0b-4257-8157-bff1918f9841","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6801","nonce":1174280901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6803","nonce":1174280901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6807","nonce":1174280901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6805","nonce":1174280901}]},"public_addr":"172.21.15.96:6801/1174280901","cluster_addr":"172.21.15.96:6803/1174280901","heartbeat_back_addr":"172.21.15.96:6807/1174280901","heartbeat_front_addr":"172.21.15.96:6805/1174280901","state":["exists","up"]},{"osd":5,"uuid":"8e2f20b4-26f0-495a-9361-8cea9b39883d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6809","nonce":143251839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6811","nonce":143251839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6815","nonce":143251839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6813","nonce":143251839}]},"public_addr":"172.21.15.96:6809/143251839","cluster_addr":"172.21.15.96:6811/143251839","heartbeat_back_addr":"172.21.15.96:6815/143251839","heartbeat_front_addr":"172.21.15.96:6813/143251839","state":["exists","up"]},{"osd":6,"uuid":"c08bca3f-043c-406b-9f5a-88890d11ecae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6817","nonce":806457173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6819","nonce":806457173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6823","nonce":806457173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6821","nonce":806457173}]},"public_addr":"172.21.15.96:6817/806457173","cluster_addr":"172.21.15.96:6819/806457173","heartbeat_back_addr":"172.21.15.96:6823/806457173","heartbeat_front_addr":"172.21.15.96:6821/806457173","state":["exists","up"]},{"osd":7,"uuid":"a54a6024-e16e-429a-aa5b-4445c0a29b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6825","nonce":535155277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6827","nonce":535155277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6831","nonce":535155277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6829","nonce":535155277}]},"public_addr":"172.21.15.96:6825/535155277","cluster_addr":"172.21.15.96:6827/535155277","heartbeat_back_addr":"172.21.15.96:6831/535155277","heartbeat_front_addr":"172.21.15.96:6829/535155277","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:49:14.437542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:49:42.718085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:09.839689+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:37.396695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:59.865570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:51:25.244074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:51:51.606323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:52:17.356022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6801/2328850889":"2021-07-27T15:47:11.401176+0000","172.21.15.33:6800/2328850889":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/629989338":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/167530138":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/474711394":"2021-07-27T15:46:39.321454+0000","172.21.15.33:6800/3040782006":"2021-07-27T15:46:39.321454+0000","172.21.15.33:6801/3040782006":"2021-07-27T15:46:39.321454+0000","172.21.15.33:0/2349254883":"2021-07-27T15:46:39.321454+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:52:45.189 DEBUG:teuthology.misc:8 of 8 OSDs are up 2021-07-26T15:52:45.189 INFO:tasks.cephadm:Creating RBD pool 2021-07-26T15:52:45.190 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- sudo ceph --cluster ceph osd pool create rbd 8 2021-07-26T15:52:45.456 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:45 smithi033 bash[30660]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-07-26T15:52:45.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:45 smithi033 bash[19094]: cluster 2021-07-26T15:52:43.553726+0000 mgr.y (mgr.14146) 231 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:45.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:45 smithi033 bash[19094]: cephadm 2021-07-26T15:52:43.558909+0000 mgr.y (mgr.14146) 232 : cephadm [INF] Deploying daemon alertmanager.a on smithi033 2021-07-26T15:52:45.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:45 smithi033 bash[14790]: cluster 2021-07-26T15:52:43.553726+0000 mgr.y (mgr.14146) 231 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:45.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:45 smithi033 bash[14790]: cephadm 2021-07-26T15:52:43.558909+0000 mgr.y (mgr.14146) 232 : cephadm [INF] Deploying daemon alertmanager.a on smithi033 2021-07-26T15:52:45.486 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:45 smithi096 bash[28218]: 49a2d53aa1af: Pull complete 2021-07-26T15:52:45.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:45 smithi096 bash[15117]: cluster 2021-07-26T15:52:43.553726+0000 mgr.y (mgr.14146) 231 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:45.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:45 smithi096 bash[15117]: cephadm 2021-07-26T15:52:43.558909+0000 mgr.y (mgr.14146) 232 : cephadm [INF] Deploying daemon alertmanager.a on smithi033 2021-07-26T15:52:45.878 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:45 smithi096 bash[28218]: 3589a6efd9ce: Pull complete 2021-07-26T15:52:46.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:46 smithi096 bash[15117]: audit 2021-07-26T15:52:45.041070+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:46.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:46 smithi096 bash[15117]: audit 2021-07-26T15:52:45.174325+0000 mon.a (mon.0) 569 : audit [DBG] from='client.? 172.21.15.33:0/2718389639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:52:46.236 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:45 smithi096 bash[28218]: 190160031744: Pull complete 2021-07-26T15:52:46.236 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:46 smithi096 bash[28218]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-07-26T15:52:46.237 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:46 smithi096 bash[28218]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-07-26T15:52:46.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:46 smithi033 bash[19094]: audit 2021-07-26T15:52:45.041070+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:46.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:46 smithi033 bash[19094]: audit 2021-07-26T15:52:45.174325+0000 mon.a (mon.0) 569 : audit [DBG] from='client.? 172.21.15.33:0/2718389639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:52:46.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:46 smithi033 bash[14790]: audit 2021-07-26T15:52:45.041070+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:46.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:46 smithi033 bash[14790]: audit 2021-07-26T15:52:45.174325+0000 mon.a (mon.0) 569 : audit [DBG] from='client.? 172.21.15.33:0/2718389639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:52:47.433 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[15117]: cluster 2021-07-26T15:52:45.554233+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:47.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:47 smithi033 bash[14790]: cluster 2021-07-26T15:52:45.554233+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:47.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:47 smithi033 bash[19094]: cluster 2021-07-26T15:52:45.554233+0000 mgr.y (mgr.14146) 233 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:47.736 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-07-26T15:52:47.737 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-07-26T15:52:47.737 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-07-26T15:52:47.738 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-07-26T15:52:47.738 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-07-26T15:52:47.738 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-07-26T15:52:47.738 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-07-26T15:52:47.738 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-07-26T15:52:47.739 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-07-26T15:52:47.739 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-07-26T15:52:47.739 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-07-26T15:52:47.739 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-07-26T15:52:47.740 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-07-26T15:52:47.740 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-07-26T15:52:47.740 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-07-26T15:52:47.741 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-07-26T15:52:47.741 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-07-26T15:52:47.742 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-07-26T15:52:47.743 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-07-26T15:52:47.744 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-07-26T15:52:47.744 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-07-26T15:52:47.744 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-07-26T15:52:47.744 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-07-26T15:52:47.745 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-07-26T15:52:47.745 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-07-26T15:52:47.745 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-07-26T15:52:47.745 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-07-26T15:52:47.745 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-07-26T15:52:47.746 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-07-26T15:52:47.746 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - time" source="node_exporter.go:104" 2021-07-26T15:52:47.746 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-07-26T15:52:47.746 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-07-26T15:52:47.747 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-07-26T15:52:47.748 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-07-26T15:52:47.748 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 15:52:47 smithi096 bash[28218]: time="2021-07-26T15:52:47Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-07-26T15:52:48.457 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-07-26T15:52:48.457 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-07-26T15:52:48.458 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-07-26T15:52:48.458 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-07-26T15:52:48.458 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-07-26T15:52:48.458 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-07-26T15:52:48.458 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-07-26T15:52:48.459 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-07-26T15:52:48.459 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-07-26T15:52:48.459 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-07-26T15:52:48.459 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-07-26T15:52:48.460 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-07-26T15:52:48.460 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-07-26T15:52:48.460 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-07-26T15:52:48.460 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-07-26T15:52:48.460 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-07-26T15:52:48.461 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-07-26T15:52:48.461 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-07-26T15:52:48.461 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-07-26T15:52:48.461 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-07-26T15:52:48.461 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-07-26T15:52:48.462 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-07-26T15:52:48.462 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-07-26T15:52:48.462 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-07-26T15:52:48.462 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-07-26T15:52:48.463 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-07-26T15:52:48.463 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-07-26T15:52:48.463 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-07-26T15:52:48.463 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-07-26T15:52:48.463 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - time" source="node_exporter.go:104" 2021-07-26T15:52:48.464 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-07-26T15:52:48.464 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-07-26T15:52:48.464 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-07-26T15:52:48.464 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-07-26T15:52:48.464 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 15:52:48 smithi033 bash[30660]: time="2021-07-26T15:52:48Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-07-26T15:52:49.455 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:49 smithi033 bash[14790]: cluster 2021-07-26T15:52:47.554681+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:49.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:49 smithi033 bash[19094]: cluster 2021-07-26T15:52:47.554681+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:49.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:49 smithi096 bash[15117]: cluster 2021-07-26T15:52:47.554681+0000 mgr.y (mgr.14146) 234 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:51.478 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:51 smithi033 bash[14790]: cluster 2021-07-26T15:52:49.555229+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:51.479 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:51 smithi033 bash[19094]: cluster 2021-07-26T15:52:49.555229+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:51.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:51 smithi096 bash[15117]: cluster 2021-07-26T15:52:49.555229+0000 mgr.y (mgr.14146) 235 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:53.128 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'rbd' created 2021-07-26T15:52:53.419 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:53 smithi033 bash[14790]: cluster 2021-07-26T15:52:51.555900+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:53.419 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:53 smithi033 bash[14790]: audit 2021-07-26T15:52:52.376496+0000 mon.a (mon.0) 570 : audit [INF] from='client.? 172.21.15.33:0/812443210' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2021-07-26T15:52:53.420 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:53 smithi033 bash[19094]: cluster 2021-07-26T15:52:51.555900+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:53.420 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:53 smithi033 bash[19094]: audit 2021-07-26T15:52:52.376496+0000 mon.a (mon.0) 570 : audit [INF] from='client.? 172.21.15.33:0/812443210' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2021-07-26T15:52:53.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:53 smithi096 bash[15117]: cluster 2021-07-26T15:52:51.555900+0000 mgr.y (mgr.14146) 236 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:53.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:53 smithi096 bash[15117]: audit 2021-07-26T15:52:52.376496+0000 mon.a (mon.0) 570 : audit [INF] from='client.? 172.21.15.33:0/812443210' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2021-07-26T15:52:54.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-07-26T15:52:54.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:54 smithi033 bash[14790]: audit 2021-07-26T15:52:53.124195+0000 mon.a (mon.0) 571 : audit [INF] from='client.? 172.21.15.33:0/812443210' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2021-07-26T15:52:54.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:54 smithi033 bash[14790]: cluster 2021-07-26T15:52:53.124314+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-07-26T15:52:54.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:54 smithi033 bash[19094]: audit 2021-07-26T15:52:53.124195+0000 mon.a (mon.0) 571 : audit [INF] from='client.? 172.21.15.33:0/812443210' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2021-07-26T15:52:54.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:54 smithi033 bash[19094]: cluster 2021-07-26T15:52:53.124314+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-07-26T15:52:54.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:54 smithi096 bash[15117]: audit 2021-07-26T15:52:53.124195+0000 mon.a (mon.0) 571 : audit [INF] from='client.? 172.21.15.33:0/812443210' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2021-07-26T15:52:54.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:54 smithi096 bash[15117]: cluster 2021-07-26T15:52:53.124314+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-07-26T15:52:55.475 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:55 smithi033 bash[14790]: cluster 2021-07-26T15:52:53.556544+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v212: 9 pgs: 8 unknown, 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:55.476 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:55 smithi033 bash[14790]: cluster 2021-07-26T15:52:54.133346+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-07-26T15:52:55.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:55 smithi033 bash[19094]: cluster 2021-07-26T15:52:53.556544+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v212: 9 pgs: 8 unknown, 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:55.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:55 smithi033 bash[19094]: cluster 2021-07-26T15:52:54.133346+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-07-26T15:52:55.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:55 smithi096 bash[15117]: cluster 2021-07-26T15:52:53.556544+0000 mgr.y (mgr.14146) 237 : cluster [DBG] pgmap v212: 9 pgs: 8 unknown, 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:55.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:55 smithi096 bash[15117]: cluster 2021-07-26T15:52:54.133346+0000 mon.a (mon.0) 573 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-07-26T15:52:56.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:56 smithi033 bash[14790]: cluster 2021-07-26T15:52:55.142312+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-07-26T15:52:56.456 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:56 smithi033 bash[14790]: cluster 2021-07-26T15:52:55.557177+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v215: 9 pgs: 5 active+clean, 4 unknown; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:56.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:56 smithi033 bash[19094]: cluster 2021-07-26T15:52:55.142312+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-07-26T15:52:56.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:56 smithi033 bash[19094]: cluster 2021-07-26T15:52:55.557177+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v215: 9 pgs: 5 active+clean, 4 unknown; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:56.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:56 smithi096 bash[15117]: cluster 2021-07-26T15:52:55.142312+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-07-26T15:52:56.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:56 smithi096 bash[15117]: cluster 2021-07-26T15:52:55.557177+0000 mgr.y (mgr.14146) 238 : cluster [DBG] pgmap v215: 9 pgs: 5 active+clean, 4 unknown; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:57.956 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:52:57 smithi033 bash[31387]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:52:58.956 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[14790]: cluster 2021-07-26T15:52:57.557646+0000 mgr.y (mgr.14146) 239 : cluster [DBG] pgmap v216: 9 pgs: 8 active+clean, 1 unknown; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:58.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[14790]: audit 2021-07-26T15:52:57.739581+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:58.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[14790]: audit 2021-07-26T15:52:57.813765+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:58.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[14790]: audit 2021-07-26T15:52:57.822156+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:58.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[14790]: audit 2021-07-26T15:52:57.823063+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-07-26T15:52:58.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[14790]: audit 2021-07-26T15:52:57.823921+0000 mgr.y (mgr.14146) 240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-07-26T15:52:58.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[14790]: audit 2021-07-26T15:52:57.831271+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:58.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[14790]: cephadm 2021-07-26T15:52:57.837815+0000 mgr.y (mgr.14146) 241 : cephadm [INF] Deploying daemon grafana.a on smithi096 2021-07-26T15:52:58.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[19094]: cluster 2021-07-26T15:52:57.557646+0000 mgr.y (mgr.14146) 239 : cluster [DBG] pgmap v216: 9 pgs: 8 active+clean, 1 unknown; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:58.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[19094]: audit 2021-07-26T15:52:57.739581+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:58.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[19094]: audit 2021-07-26T15:52:57.813765+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:58.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[19094]: audit 2021-07-26T15:52:57.822156+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:58.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[19094]: audit 2021-07-26T15:52:57.823063+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-07-26T15:52:58.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[19094]: audit 2021-07-26T15:52:57.823921+0000 mgr.y (mgr.14146) 240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-07-26T15:52:58.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[19094]: audit 2021-07-26T15:52:57.831271+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:58.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:52:58 smithi033 bash[19094]: cephadm 2021-07-26T15:52:57.837815+0000 mgr.y (mgr.14146) 241 : cephadm [INF] Deploying daemon grafana.a on smithi096 2021-07-26T15:52:59.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:58 smithi096 bash[15117]: cluster 2021-07-26T15:52:57.557646+0000 mgr.y (mgr.14146) 239 : cluster [DBG] pgmap v216: 9 pgs: 8 active+clean, 1 unknown; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:52:59.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:58 smithi096 bash[15117]: audit 2021-07-26T15:52:57.739581+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:59.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:58 smithi096 bash[15117]: audit 2021-07-26T15:52:57.813765+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:59.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:58 smithi096 bash[15117]: audit 2021-07-26T15:52:57.822156+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:59.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:58 smithi096 bash[15117]: audit 2021-07-26T15:52:57.823063+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-07-26T15:52:59.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:58 smithi096 bash[15117]: audit 2021-07-26T15:52:57.823921+0000 mgr.y (mgr.14146) 240 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-07-26T15:52:59.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:58 smithi096 bash[15117]: audit 2021-07-26T15:52:57.831271+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:52:59.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:52:58 smithi096 bash[15117]: cephadm 2021-07-26T15:52:57.837815+0000 mgr.y (mgr.14146) 241 : cephadm [INF] Deploying daemon grafana.a on smithi096 2021-07-26T15:53:00.206 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:52:59 smithi033 bash[31387]: level=info ts=2021-07-26T15:52:59.878Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-07-26T15:53:00.207 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:52:59 smithi033 bash[31387]: level=info ts=2021-07-26T15:52:59.878Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-07-26T15:53:00.207 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:52:59 smithi033 bash[31387]: level=info ts=2021-07-26T15:52:59.880Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.33 port=9094 2021-07-26T15:53:00.207 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:52:59 smithi033 bash[31387]: level=info ts=2021-07-26T15:52:59.881Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-07-26T15:53:00.207 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:52:59 smithi033 bash[31387]: level=info ts=2021-07-26T15:52:59.925Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-07-26T15:53:00.208 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:52:59 smithi033 bash[31387]: level=info ts=2021-07-26T15:52:59.926Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-07-26T15:53:00.208 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:52:59 smithi033 bash[31387]: level=info ts=2021-07-26T15:52:59.931Z caller=main.go:497 msg=Listening address=:9093 2021-07-26T15:53:00.768 INFO:teuthology.orchestra.run.smithi033.stderr:enabled application 'rbd' on pool 'rbd' 2021-07-26T15:53:01.207 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:00 smithi033 bash[14790]: cluster 2021-07-26T15:52:59.558223+0000 mgr.y (mgr.14146) 242 : cluster [DBG] pgmap v217: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:01.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:00 smithi033 bash[14790]: audit 2021-07-26T15:52:59.950119+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.33:0/467992207' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:53:01.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:00 smithi033 bash[14790]: audit 2021-07-26T15:52:59.950781+0000 mon.a (mon.0) 580 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:53:01.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:00 smithi033 bash[14790]: audit 2021-07-26T15:53:00.050199+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:01.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:00 smithi033 bash[19094]: cluster 2021-07-26T15:52:59.558223+0000 mgr.y (mgr.14146) 242 : cluster [DBG] pgmap v217: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:01.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:00 smithi033 bash[19094]: audit 2021-07-26T15:52:59.950119+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.33:0/467992207' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:53:01.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:00 smithi033 bash[19094]: audit 2021-07-26T15:52:59.950781+0000 mon.a (mon.0) 580 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:53:01.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:00 smithi033 bash[19094]: audit 2021-07-26T15:53:00.050199+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:01.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:00 smithi096 bash[15117]: cluster 2021-07-26T15:52:59.558223+0000 mgr.y (mgr.14146) 242 : cluster [DBG] pgmap v217: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:01.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:00 smithi096 bash[15117]: audit 2021-07-26T15:52:59.950119+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.33:0/467992207' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:53:01.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:00 smithi096 bash[15117]: audit 2021-07-26T15:52:59.950781+0000 mon.a (mon.0) 580 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:53:01.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:00 smithi096 bash[15117]: audit 2021-07-26T15:53:00.050199+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:01.595 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd dump --format=json 2021-07-26T15:53:01.887 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:01 smithi033 bash[14790]: audit 2021-07-26T15:53:00.763821+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2021-07-26T15:53:01.892 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:01 smithi033 bash[14790]: cluster 2021-07-26T15:53:00.764045+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-07-26T15:53:01.892 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:01 smithi033 bash[19094]: audit 2021-07-26T15:53:00.763821+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2021-07-26T15:53:01.892 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:01 smithi033 bash[19094]: cluster 2021-07-26T15:53:00.764045+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-07-26T15:53:02.207 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:01 smithi033 bash[31387]: level=info ts=2021-07-26T15:53:01.881Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000176142s 2021-07-26T15:53:02.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:01 smithi096 bash[15117]: audit 2021-07-26T15:53:00.763821+0000 mon.a (mon.0) 582 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2021-07-26T15:53:02.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:01 smithi096 bash[15117]: cluster 2021-07-26T15:53:00.764045+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-07-26T15:53:03.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:03 smithi033 bash[14790]: cluster 2021-07-26T15:53:01.558821+0000 mgr.y (mgr.14146) 243 : cluster [DBG] pgmap v219: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:03.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:03 smithi033 bash[19094]: cluster 2021-07-26T15:53:01.558821+0000 mgr.y (mgr.14146) 243 : cluster [DBG] pgmap v219: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:03.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:03 smithi096 bash[15117]: cluster 2021-07-26T15:53:01.558821+0000 mgr.y (mgr.14146) 243 : cluster [DBG] pgmap v219: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:04.372 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:53:05.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:05 smithi033 bash[19094]: cluster 2021-07-26T15:53:03.559545+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v220: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:05.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:05 smithi033 bash[14790]: cluster 2021-07-26T15:53:03.559545+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v220: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:05.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:05 smithi096 bash[15117]: cluster 2021-07-26T15:53:03.559545+0000 mgr.y (mgr.14146) 244 : cluster [DBG] pgmap v220: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:07.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:07 smithi033 bash[14790]: cluster 2021-07-26T15:53:05.560372+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v221: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:07.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:07 smithi033 bash[19094]: cluster 2021-07-26T15:53:05.560372+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v221: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:07.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:07 smithi096 bash[15117]: cluster 2021-07-26T15:53:05.560372+0000 mgr.y (mgr.14146) 245 : cluster [DBG] pgmap v221: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:08.009 INFO:teuthology.orchestra.run.smithi033.stdout: 2021-07-26T15:53:08.010 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":54,"fsid":"7e62724e-ee28-11eb-8c23-001a4aab830c","created":"2021-07-26T15:46:09.081088+0000","modified":"2021-07-26T15:53:00.744554+0000","last_up_change":"2021-07-26T15:52:18.932597+0000","last_in_change":"2021-07-26T15:51:57.326019+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:50:11.585304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:52:52.822163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3d02e4ad-97fb-45ac-9912-2d795394c8ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6803","nonce":2786020081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6805","nonce":2786020081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6809","nonce":2786020081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6807","nonce":2786020081}]},"public_addr":"172.21.15.33:6803/2786020081","cluster_addr":"172.21.15.33:6805/2786020081","heartbeat_back_addr":"172.21.15.33:6809/2786020081","heartbeat_front_addr":"172.21.15.33:6807/2786020081","state":["exists","up"]},{"osd":1,"uuid":"789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6811","nonce":2278642317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6813","nonce":2278642317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6817","nonce":2278642317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6815","nonce":2278642317}]},"public_addr":"172.21.15.33:6811/2278642317","cluster_addr":"172.21.15.33:6813/2278642317","heartbeat_back_addr":"172.21.15.33:6817/2278642317","heartbeat_front_addr":"172.21.15.33:6815/2278642317","state":["exists","up"]},{"osd":2,"uuid":"9690c749-a40a-44a7-8a07-5290ff8980a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6819","nonce":290055652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6821","nonce":290055652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6825","nonce":290055652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6823","nonce":290055652}]},"public_addr":"172.21.15.33:6819/290055652","cluster_addr":"172.21.15.33:6821/290055652","heartbeat_back_addr":"172.21.15.33:6825/290055652","heartbeat_front_addr":"172.21.15.33:6823/290055652","state":["exists","up"]},{"osd":3,"uuid":"ca4ee0f8-4870-49bb-8dd6-75ab536d7199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6827","nonce":3214716836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6829","nonce":3214716836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6833","nonce":3214716836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6831","nonce":3214716836}]},"public_addr":"172.21.15.33:6827/3214716836","cluster_addr":"172.21.15.33:6829/3214716836","heartbeat_back_addr":"172.21.15.33:6833/3214716836","heartbeat_front_addr":"172.21.15.33:6831/3214716836","state":["exists","up"]},{"osd":4,"uuid":"d630717e-8f0b-4257-8157-bff1918f9841","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6801","nonce":1174280901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6803","nonce":1174280901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6807","nonce":1174280901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6805","nonce":1174280901}]},"public_addr":"172.21.15.96:6801/1174280901","cluster_addr":"172.21.15.96:6803/1174280901","heartbeat_back_addr":"172.21.15.96:6807/1174280901","heartbeat_front_addr":"172.21.15.96:6805/1174280901","state":["exists","up"]},{"osd":5,"uuid":"8e2f20b4-26f0-495a-9361-8cea9b39883d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6809","nonce":143251839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6811","nonce":143251839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6815","nonce":143251839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6813","nonce":143251839}]},"public_addr":"172.21.15.96:6809/143251839","cluster_addr":"172.21.15.96:6811/143251839","heartbeat_back_addr":"172.21.15.96:6815/143251839","heartbeat_front_addr":"172.21.15.96:6813/143251839","state":["exists","up"]},{"osd":6,"uuid":"c08bca3f-043c-406b-9f5a-88890d11ecae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6817","nonce":806457173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6819","nonce":806457173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6823","nonce":806457173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6821","nonce":806457173}]},"public_addr":"172.21.15.96:6817/806457173","cluster_addr":"172.21.15.96:6819/806457173","heartbeat_back_addr":"172.21.15.96:6823/806457173","heartbeat_front_addr":"172.21.15.96:6821/806457173","state":["exists","up"]},{"osd":7,"uuid":"a54a6024-e16e-429a-aa5b-4445c0a29b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6825","nonce":535155277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6827","nonce":535155277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6831","nonce":535155277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6829","nonce":535155277}]},"public_addr":"172.21.15.96:6825/535155277","cluster_addr":"172.21.15.96:6827/535155277","heartbeat_back_addr":"172.21.15.96:6831/535155277","heartbeat_front_addr":"172.21.15.96:6829/535155277","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:49:14.437542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:49:42.718085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:09.839689+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:37.396695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:59.865570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:51:25.244074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:51:51.606323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:52:17.356022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6801/2328850889":"2021-07-27T15:47:11.401176+0000","172.21.15.33:6800/2328850889":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/629989338":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/167530138":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/474711394":"2021-07-27T15:46:39.321454+0000","172.21.15.33:6800/3040782006":"2021-07-27T15:46:39.321454+0000","172.21.15.33:6801/3040782006":"2021-07-27T15:46:39.321454+0000","172.21.15.33:0/2349254883":"2021-07-27T15:46:39.321454+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:53:08.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:08 smithi033 bash[14790]: audit 2021-07-26T15:53:08.007131+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.33:0/924577198' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:53:08.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:08 smithi033 bash[19094]: audit 2021-07-26T15:53:08.007131+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.33:0/924577198' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:53:08.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:08 smithi096 bash[15117]: audit 2021-07-26T15:53:08.007131+0000 mon.c (mon.1) 11 : audit [DBG] from='client.? 172.21.15.33:0/924577198' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:53:08.730 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-07-26T15:50:11.585304+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-07-26T15:52:52.822163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-07-26T15:53:08.730 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-07-26T15:53:09.456 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:09 smithi033 bash[19094]: cluster 2021-07-26T15:53:07.561113+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v222: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:09.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:09 smithi033 bash[14790]: cluster 2021-07-26T15:53:07.561113+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v222: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:09.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:09 smithi096 bash[15117]: cluster 2021-07-26T15:53:07.561113+0000 mgr.y (mgr.14146) 246 : cluster [DBG] pgmap v222: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:10.206 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:09 smithi033 bash[31387]: level=info ts=2021-07-26T15:53:09.882Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001058108s 2021-07-26T15:53:11.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:11 smithi033 bash[14790]: cluster 2021-07-26T15:53:09.561754+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v223: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:11.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:11 smithi033 bash[14790]: audit 2021-07-26T15:53:10.060081+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:11.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:11 smithi033 bash[19094]: cluster 2021-07-26T15:53:09.561754+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v223: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:11.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:11 smithi033 bash[19094]: audit 2021-07-26T15:53:10.060081+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:11.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:11 smithi096 bash[15117]: cluster 2021-07-26T15:53:09.561754+0000 mgr.y (mgr.14146) 247 : cluster [DBG] pgmap v223: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:11.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:11 smithi096 bash[15117]: audit 2021-07-26T15:53:10.060081+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:11.513 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:53:12.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:12 smithi096 bash[15117]: audit 2021-07-26T15:53:11.673629+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:53:12.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:12 smithi096 bash[15117]: audit 2021-07-26T15:53:11.678936+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:53:12.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:12 smithi033 bash[14790]: audit 2021-07-26T15:53:11.673629+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:53:12.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:12 smithi033 bash[14790]: audit 2021-07-26T15:53:11.678936+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:53:12.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:12 smithi033 bash[19094]: audit 2021-07-26T15:53:11.673629+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:53:12.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:12 smithi033 bash[19094]: audit 2021-07-26T15:53:11.678936+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:53:13.386 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:13 smithi096 bash[15117]: cluster 2021-07-26T15:53:11.562226+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v224: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:13.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:13 smithi033 bash[14790]: cluster 2021-07-26T15:53:11.562226+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v224: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:13.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:13 smithi033 bash[19094]: cluster 2021-07-26T15:53:11.562226+0000 mgr.y (mgr.14146) 248 : cluster [DBG] pgmap v224: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:14.986 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:14 smithi096 systemd[1]: Started Ceph grafana.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:53:14.987 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:14 smithi096 bash[28628]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:53:15.207 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2021-07-26T15:53:15.375 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[19094]: cluster 2021-07-26T15:53:13.562898+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v225: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:15.375 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[19094]: audit 2021-07-26T15:53:14.764764+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:15.376 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[19094]: audit 2021-07-26T15:53:14.767655+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:53:15.376 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[19094]: audit 2021-07-26T15:53:14.770197+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:53:15.376 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[19094]: audit 2021-07-26T15:53:14.771707+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:53:15.376 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[19094]: audit 2021-07-26T15:53:15.068123+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:15.377 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[14790]: cluster 2021-07-26T15:53:13.562898+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v225: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:15.377 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[14790]: audit 2021-07-26T15:53:14.764764+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:15.377 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[14790]: audit 2021-07-26T15:53:14.767655+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:53:15.377 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[14790]: audit 2021-07-26T15:53:14.770197+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:53:15.378 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[14790]: audit 2021-07-26T15:53:14.771707+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:53:15.378 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:15 smithi033 bash[14790]: audit 2021-07-26T15:53:15.068123+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:15.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:15 smithi096 bash[15117]: cluster 2021-07-26T15:53:13.562898+0000 mgr.y (mgr.14146) 249 : cluster [DBG] pgmap v225: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:15.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:15 smithi096 bash[15117]: audit 2021-07-26T15:53:14.764764+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:15.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:15 smithi096 bash[15117]: audit 2021-07-26T15:53:14.767655+0000 mon.a (mon.0) 588 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:53:15.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:15 smithi096 bash[15117]: audit 2021-07-26T15:53:14.770197+0000 mon.a (mon.0) 589 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:53:15.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:15 smithi096 bash[15117]: audit 2021-07-26T15:53:14.771707+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:53:15.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:15 smithi096 bash[15117]: audit 2021-07-26T15:53:15.068123+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:15.955 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd pool get rbd pg_num 2021-07-26T15:53:16.149 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[15117]: audit 2021-07-26T15:53:15.205898+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.15.33:0/2223627846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-07-26T15:53:16.149 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Starting Grafana" logger=server version=6.7.4 commit=8e44bbc5f5 branch=HEAD compiled=2020-05-26T17:35:38+0000 2021-07-26T15:53:16.150 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-07-26T15:53:16.150 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-07-26T15:53:16.150 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-07-26T15:53:16.150 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-07-26T15:53:16.151 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-07-26T15:53:16.151 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-07-26T15:53:16.151 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-07-26T15:53:16.151 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-07-26T15:53:16.151 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-07-26T15:53:16.152 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-07-26T15:53:16.152 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-07-26T15:53:16.152 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="App mode production" logger=settings 2021-07-26T15:53:16.152 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-07-26T15:53:16.152 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-07-26T15:53:16.153 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-07-26T15:53:16.153 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-07-26T15:53:16.153 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-07-26T15:53:16.153 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-07-26T15:53:16.207 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:16 smithi033 bash[14790]: audit 2021-07-26T15:53:15.205898+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.15.33:0/2223627846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-07-26T15:53:16.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:16 smithi033 bash[19094]: audit 2021-07-26T15:53:15.205898+0000 mon.c (mon.1) 12 : audit [DBG] from='client.? 172.21.15.33:0/2223627846' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-07-26T15:53:16.408 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-07-26T15:53:16.408 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-07-26T15:53:16.410 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-07-26T15:53:16.410 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-07-26T15:53:16.410 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-07-26T15:53:16.411 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-07-26T15:53:16.411 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-07-26T15:53:16.412 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-07-26T15:53:16.412 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-07-26T15:53:16.677 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-07-26T15:53:16.678 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-07-26T15:53:16.678 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-07-26T15:53:16.678 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-07-26T15:53:16.678 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-07-26T15:53:16.679 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-07-26T15:53:16.679 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-07-26T15:53:16.679 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-07-26T15:53:16.679 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-07-26T15:53:16.939 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-07-26T15:53:16.939 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-07-26T15:53:16.940 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-07-26T15:53:16.940 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-07-26T15:53:16.940 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-07-26T15:53:16.941 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-07-26T15:53:16.941 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-07-26T15:53:16.942 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-07-26T15:53:17.218 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[15117]: cluster 2021-07-26T15:53:15.563577+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v226: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:17.219 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-07-26T15:53:17.219 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:16 smithi096 bash[28628]: t=2021-07-26T15:53:16+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-07-26T15:53:17.220 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-07-26T15:53:17.220 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-07-26T15:53:17.221 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-07-26T15:53:17.221 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-07-26T15:53:17.221 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-07-26T15:53:17.222 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-07-26T15:53:17.223 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-07-26T15:53:17.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:17 smithi033 bash[19094]: cluster 2021-07-26T15:53:15.563577+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v226: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:17.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:17 smithi033 bash[14790]: cluster 2021-07-26T15:53:15.563577+0000 mgr.y (mgr.14146) 250 : cluster [DBG] pgmap v226: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:17.469 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-07-26T15:53:17.470 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-07-26T15:53:17.470 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-07-26T15:53:17.470 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-07-26T15:53:17.471 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-07-26T15:53:17.471 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-07-26T15:53:17.471 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-07-26T15:53:17.737 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-07-26T15:53:17.738 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-07-26T15:53:17.738 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-07-26T15:53:17.739 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-07-26T15:53:17.739 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-07-26T15:53:17.740 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-07-26T15:53:18.010 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-07-26T15:53:18.010 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-07-26T15:53:18.010 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-07-26T15:53:18.011 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-07-26T15:53:18.011 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-07-26T15:53:18.011 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-07-26T15:53:18.011 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-07-26T15:53:18.011 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-07-26T15:53:18.012 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-07-26T15:53:18.012 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:17 smithi096 bash[28628]: t=2021-07-26T15:53:17+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-07-26T15:53:18.012 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-07-26T15:53:18.279 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-07-26T15:53:18.279 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-07-26T15:53:18.280 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-07-26T15:53:18.280 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-07-26T15:53:18.280 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-07-26T15:53:18.281 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-07-26T15:53:18.281 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-07-26T15:53:18.281 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-07-26T15:53:18.550 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-07-26T15:53:18.550 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-07-26T15:53:18.550 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-07-26T15:53:18.550 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-07-26T15:53:18.551 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-07-26T15:53:18.551 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-07-26T15:53:18.551 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-07-26T15:53:18.551 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-07-26T15:53:18.552 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-07-26T15:53:18.553 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-07-26T15:53:18.582 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:53:18.829 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-07-26T15:53:18.829 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-07-26T15:53:18.829 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-07-26T15:53:18.829 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-07-26T15:53:18.830 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-07-26T15:53:18.830 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-07-26T15:53:19.096 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-07-26T15:53:19.097 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-07-26T15:53:19.097 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-07-26T15:53:19.097 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-07-26T15:53:19.097 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:18 smithi096 bash[28628]: t=2021-07-26T15:53:18+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-07-26T15:53:19.098 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-07-26T15:53:19.098 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-07-26T15:53:19.098 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-07-26T15:53:19.207 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:19 smithi033 bash[14790]: cluster 2021-07-26T15:53:17.564181+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v227: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:19.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:19 smithi033 bash[14790]: audit 2021-07-26T15:53:19.038733+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:19.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:19 smithi033 bash[19094]: cluster 2021-07-26T15:53:17.564181+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v227: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:19.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:19 smithi033 bash[19094]: audit 2021-07-26T15:53:19.038733+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:19.360 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-07-26T15:53:19.361 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-07-26T15:53:19.361 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-07-26T15:53:19.361 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-07-26T15:53:19.362 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-07-26T15:53:19.362 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-07-26T15:53:19.362 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-07-26T15:53:19.363 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[15117]: cluster 2021-07-26T15:53:17.564181+0000 mgr.y (mgr.14146) 251 : cluster [DBG] pgmap v227: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:19.363 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[15117]: audit 2021-07-26T15:53:19.038733+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:19.629 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-07-26T15:53:19.630 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-07-26T15:53:19.630 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-07-26T15:53:19.630 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-07-26T15:53:19.630 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-07-26T15:53:19.630 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-07-26T15:53:19.631 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-07-26T15:53:19.631 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-07-26T15:53:19.906 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-07-26T15:53:19.907 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-07-26T15:53:19.907 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-07-26T15:53:19.908 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-07-26T15:53:19.908 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-07-26T15:53:19.908 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-07-26T15:53:19.908 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-07-26T15:53:20.176 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-07-26T15:53:20.176 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:19 smithi096 bash[28628]: t=2021-07-26T15:53:19+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-07-26T15:53:20.176 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-07-26T15:53:20.176 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-07-26T15:53:20.177 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-07-26T15:53:20.177 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-07-26T15:53:20.431 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-07-26T15:53:20.432 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-07-26T15:53:20.432 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-07-26T15:53:20.432 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-07-26T15:53:20.432 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-07-26T15:53:20.433 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-07-26T15:53:20.433 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-07-26T15:53:20.433 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-07-26T15:53:20.706 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-07-26T15:53:20.708 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-07-26T15:53:20.708 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-07-26T15:53:20.708 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-07-26T15:53:20.709 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-07-26T15:53:20.709 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-07-26T15:53:20.709 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-07-26T15:53:20.709 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-07-26T15:53:20.710 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-07-26T15:53:20.953 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-07-26T15:53:20.953 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-07-26T15:53:20.953 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-07-26T15:53:20.954 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-07-26T15:53:20.954 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-07-26T15:53:20.954 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-07-26T15:53:20.954 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-07-26T15:53:20.955 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:20 smithi096 bash[28628]: t=2021-07-26T15:53:20+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-07-26T15:53:21.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:21 smithi033 bash[19094]: cluster 2021-07-26T15:53:19.564915+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v228: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:21.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:21 smithi033 bash[19094]: audit 2021-07-26T15:53:20.023096+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:21.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:21 smithi033 bash[19094]: audit 2021-07-26T15:53:20.285399+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:21.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:21 smithi033 bash[14790]: cluster 2021-07-26T15:53:19.564915+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v228: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:21.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:21 smithi033 bash[14790]: audit 2021-07-26T15:53:20.023096+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:21.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:21 smithi033 bash[14790]: audit 2021-07-26T15:53:20.285399+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:21.220 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-07-26T15:53:21.221 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-07-26T15:53:21.221 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-07-26T15:53:21.221 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-07-26T15:53:21.222 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-07-26T15:53:21.222 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-07-26T15:53:21.222 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-07-26T15:53:21.222 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[15117]: cluster 2021-07-26T15:53:19.564915+0000 mgr.y (mgr.14146) 252 : cluster [DBG] pgmap v228: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:21.223 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[15117]: audit 2021-07-26T15:53:20.023096+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:21.223 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[15117]: audit 2021-07-26T15:53:20.285399+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:21.474 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-07-26T15:53:21.474 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-07-26T15:53:21.475 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-07-26T15:53:21.475 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-07-26T15:53:21.475 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-07-26T15:53:21.475 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-07-26T15:53:21.476 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-07-26T15:53:21.476 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-07-26T15:53:21.476 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-07-26T15:53:21.737 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-07-26T15:53:21.737 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-07-26T15:53:21.738 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-07-26T15:53:21.738 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-07-26T15:53:21.738 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-07-26T15:53:21.738 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-07-26T15:53:21.738 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-07-26T15:53:21.739 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-07-26T15:53:21.739 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-07-26T15:53:22.033 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-07-26T15:53:22.034 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-07-26T15:53:22.034 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-07-26T15:53:22.035 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-07-26T15:53:22.035 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-07-26T15:53:22.035 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-07-26T15:53:22.035 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-07-26T15:53:22.035 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-07-26T15:53:22.036 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:21 smithi096 bash[28628]: t=2021-07-26T15:53:21+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-07-26T15:53:22.036 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-07-26T15:53:22.316 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[15117]: cephadm 2021-07-26T15:53:20.290330+0000 mgr.y (mgr.14146) 253 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-07-26T15:53:22.317 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[15117]: cephadm 2021-07-26T15:53:20.294862+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi033 2021-07-26T15:53:22.317 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-07-26T15:53:22.317 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-07-26T15:53:22.317 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-07-26T15:53:22.318 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-07-26T15:53:22.318 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-07-26T15:53:22.318 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2021-07-26T15:53:22.318 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-07-26T15:53:22.365 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:22 smithi033 bash[14790]: cephadm 2021-07-26T15:53:20.290330+0000 mgr.y (mgr.14146) 253 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-07-26T15:53:22.366 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:22 smithi033 bash[14790]: cephadm 2021-07-26T15:53:20.294862+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi033 2021-07-26T15:53:22.366 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:22 smithi033 bash[19094]: cephadm 2021-07-26T15:53:20.290330+0000 mgr.y (mgr.14146) 253 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-07-26T15:53:22.368 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:22 smithi033 bash[19094]: cephadm 2021-07-26T15:53:20.294862+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi033 2021-07-26T15:53:22.577 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-07-26T15:53:22.578 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-07-26T15:53:22.578 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-07-26T15:53:22.578 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-07-26T15:53:22.578 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-07-26T15:53:22.579 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-07-26T15:53:22.579 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-07-26T15:53:22.579 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-07-26T15:53:22.847 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-07-26T15:53:22.847 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-07-26T15:53:22.848 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-07-26T15:53:22.848 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-07-26T15:53:22.848 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-07-26T15:53:22.848 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-07-26T15:53:22.849 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-07-26T15:53:22.849 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-07-26T15:53:22.850 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-07-26T15:53:23.085 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 8 2021-07-26T15:53:23.111 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-07-26T15:53:23.112 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-07-26T15:53:23.112 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-07-26T15:53:23.112 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:22 smithi096 bash[28628]: t=2021-07-26T15:53:22+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-07-26T15:53:23.113 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-07-26T15:53:23.113 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-07-26T15:53:23.113 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-07-26T15:53:23.379 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[15117]: cluster 2021-07-26T15:53:21.565795+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v229: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:23.379 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[15117]: audit 2021-07-26T15:53:23.084341+0000 mon.a (mon.0) 595 : audit [DBG] from='client.? 172.21.15.33:0/410138940' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2021-07-26T15:53:23.380 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-07-26T15:53:23.380 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-07-26T15:53:23.380 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-07-26T15:53:23.380 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-07-26T15:53:23.380 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-07-26T15:53:23.381 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-07-26T15:53:23.381 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-07-26T15:53:23.381 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-07-26T15:53:23.381 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-07-26T15:53:23.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:23 smithi033 bash[14790]: cluster 2021-07-26T15:53:21.565795+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v229: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:23.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:23 smithi033 bash[14790]: audit 2021-07-26T15:53:23.084341+0000 mon.a (mon.0) 595 : audit [DBG] from='client.? 172.21.15.33:0/410138940' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2021-07-26T15:53:23.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:23 smithi033 bash[19094]: cluster 2021-07-26T15:53:21.565795+0000 mgr.y (mgr.14146) 255 : cluster [DBG] pgmap v229: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:23.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:23 smithi033 bash[19094]: audit 2021-07-26T15:53:23.084341+0000 mon.a (mon.0) 595 : audit [DBG] from='client.? 172.21.15.33:0/410138940' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2021-07-26T15:53:23.656 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-07-26T15:53:23.656 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-07-26T15:53:23.656 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-07-26T15:53:23.657 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-07-26T15:53:23.657 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-07-26T15:53:23.657 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-07-26T15:53:23.657 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-07-26T15:53:23.657 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-07-26T15:53:23.658 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-07-26T15:53:23.987 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-07-26T15:53:23.988 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-07-26T15:53:23.988 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-07-26T15:53:23.988 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-07-26T15:53:23.988 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-07-26T15:53:23.989 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-07-26T15:53:23.989 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-07-26T15:53:23.989 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-07-26T15:53:23.990 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-07-26T15:53:23.990 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-07-26T15:53:23.990 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing HooksService" logger=server 2021-07-26T15:53:23.991 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-07-26T15:53:23.991 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-07-26T15:53:23.991 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-07-26T15:53:23.992 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-07-26T15:53:23.992 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-07-26T15:53:23.992 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-07-26T15:53:23.992 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-07-26T15:53:23.993 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-07-26T15:53:23.993 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-07-26T15:53:23.993 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing LoginService" logger=server 2021-07-26T15:53:23.994 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing SearchService" logger=server 2021-07-26T15:53:23.994 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing TracingService" logger=server 2021-07-26T15:53:23.994 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-07-26T15:53:23.994 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-07-26T15:53:23.995 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-07-26T15:53:23.995 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-07-26T15:53:23.995 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-07-26T15:53:23.997 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2021-07-26T15:53:23.997 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-07-26T15:53:23.997 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin. Read more at https://grafana.com/docs/grafana/latest/administration/image_rendering/" logger=rendering renderer=phantomJS 2021-07-26T15:53:23.998 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="Initializing Stream Manager" 2021-07-26T15:53:23.998 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 15:53:23 smithi096 bash[28628]: t=2021-07-26T15:53:23+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2021-07-26T15:53:24.078 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-07-26T15:53:24.080 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-07-26T15:53:24.080 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph mgr dump --format=json 2021-07-26T15:53:25.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:25 smithi033 bash[14790]: cluster 2021-07-26T15:53:23.566458+0000 mgr.y (mgr.14146) 256 : cluster [DBG] pgmap v230: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:25.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:25 smithi033 bash[19094]: cluster 2021-07-26T15:53:23.566458+0000 mgr.y (mgr.14146) 256 : cluster [DBG] pgmap v230: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:25.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:25 smithi096 bash[15117]: cluster 2021-07-26T15:53:23.566458+0000 mgr.y (mgr.14146) 256 : cluster [DBG] pgmap v230: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:26.039 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:25 smithi033 systemd[1]: Stopping Ceph alertmanager.a for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T15:53:26.040 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:25 smithi033 docker[32641]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:53:26.040 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:25 smithi033 bash[31387]: level=info ts=2021-07-26T15:53:25.860Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2021-07-26T15:53:26.957 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:26 smithi033 docker[32641]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-alertmanager.a 2021-07-26T15:53:26.957 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:26 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@alertmanager.a.service: Succeeded. 2021-07-26T15:53:26.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:26 smithi033 systemd[1]: Stopped Ceph alertmanager.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:53:26.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:26 smithi033 systemd[1]: Started Ceph alertmanager.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:53:26.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:26 smithi033 bash[32681]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:53:27.147 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:53:27.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:27 smithi096 bash[15117]: cluster 2021-07-26T15:53:25.567142+0000 mgr.y (mgr.14146) 257 : cluster [DBG] pgmap v231: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:27.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:27 smithi096 bash[15117]: audit 2021-07-26T15:53:26.686342+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:27.375 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:27 smithi033 bash[14790]: cluster 2021-07-26T15:53:25.567142+0000 mgr.y (mgr.14146) 257 : cluster [DBG] pgmap v231: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:27.375 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:27 smithi033 bash[14790]: audit 2021-07-26T15:53:26.686342+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:27.376 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:27 smithi033 bash[19094]: cluster 2021-07-26T15:53:25.567142+0000 mgr.y (mgr.14146) 257 : cluster [DBG] pgmap v231: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:27.376 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:27 smithi033 bash[19094]: audit 2021-07-26T15:53:26.686342+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:28.403 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:28 smithi096 bash[15117]: cephadm 2021-07-26T15:53:26.688016+0000 mgr.y (mgr.14146) 258 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-07-26T15:53:28.403 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:28 smithi096 bash[15117]: cephadm 2021-07-26T15:53:26.690944+0000 mgr.y (mgr.14146) 259 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi096 2021-07-26T15:53:28.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:28 smithi033 bash[14790]: cephadm 2021-07-26T15:53:26.688016+0000 mgr.y (mgr.14146) 258 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-07-26T15:53:28.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:28 smithi033 bash[14790]: cephadm 2021-07-26T15:53:26.690944+0000 mgr.y (mgr.14146) 259 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi096 2021-07-26T15:53:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:28 smithi033 bash[19094]: cephadm 2021-07-26T15:53:26.688016+0000 mgr.y (mgr.14146) 258 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-07-26T15:53:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:28 smithi033 bash[19094]: cephadm 2021-07-26T15:53:26.690944+0000 mgr.y (mgr.14146) 259 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi096 2021-07-26T15:53:29.026 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:28 smithi033 bash[32681]: level=info ts=2021-07-26T15:53:28.927Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-07-26T15:53:29.026 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:28 smithi033 bash[32681]: level=info ts=2021-07-26T15:53:28.927Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-07-26T15:53:29.026 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:28 smithi033 bash[32681]: level=info ts=2021-07-26T15:53:28.930Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.33 port=9094 2021-07-26T15:53:29.027 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:28 smithi033 bash[32681]: level=info ts=2021-07-26T15:53:28.932Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-07-26T15:53:29.027 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:28 smithi033 bash[32681]: level=info ts=2021-07-26T15:53:28.981Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-07-26T15:53:29.027 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:28 smithi033 bash[32681]: level=info ts=2021-07-26T15:53:28.981Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-07-26T15:53:29.027 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:28 smithi033 bash[32681]: level=info ts=2021-07-26T15:53:28.986Z caller=main.go:497 msg=Listening address=:9093 2021-07-26T15:53:29.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:29 smithi033 bash[14790]: cluster 2021-07-26T15:53:27.567935+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v232: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:29.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:29 smithi033 bash[19094]: cluster 2021-07-26T15:53:27.567935+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v232: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:29.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:29 smithi096 bash[15117]: cluster 2021-07-26T15:53:27.567935+0000 mgr.y (mgr.14146) 260 : cluster [DBG] pgmap v232: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:30 smithi033 bash[14790]: cluster 2021-07-26T15:53:29.568628+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v233: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:30.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:30 smithi033 bash[19094]: cluster 2021-07-26T15:53:29.568628+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v233: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:30.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:30 smithi096 bash[15117]: cluster 2021-07-26T15:53:29.568628+0000 mgr.y (mgr.14146) 261 : cluster [DBG] pgmap v233: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:31.207 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:30 smithi033 bash[32681]: level=info ts=2021-07-26T15:53:30.932Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000145433s 2021-07-26T15:53:31.243 INFO:teuthology.orchestra.run.smithi033.stdout: 2021-07-26T15:53:31.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[15117]: audit 2021-07-26T15:53:31.230248+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.33:0/2486651515' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-07-26T15:53:31.487 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 systemd[1]: Stopping Ceph prometheus.a for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T15:53:31.487 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 docker[29258]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:53:31.488 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=warn ts=2021-07-26T15:53:31.299Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-07-26T15:53:31.488 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=info ts=2021-07-26T15:53:31.300Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2021-07-26T15:53:31.488 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=info ts=2021-07-26T15:53:31.300Z caller=main.go:561 msg="Stopping notify discovery manager..." 2021-07-26T15:53:31.488 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=info ts=2021-07-26T15:53:31.300Z caller=main.go:543 msg="Scrape discovery manager stopped" 2021-07-26T15:53:31.489 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=info ts=2021-07-26T15:53:31.300Z caller=main.go:583 msg="Stopping scrape manager..." 2021-07-26T15:53:31.489 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=info ts=2021-07-26T15:53:31.300Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2021-07-26T15:53:31.489 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=info ts=2021-07-26T15:53:31.300Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2021-07-26T15:53:31.489 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=info ts=2021-07-26T15:53:31.300Z caller=main.go:557 msg="Notify discovery manager stopped" 2021-07-26T15:53:31.489 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=info ts=2021-07-26T15:53:31.300Z caller=main.go:577 msg="Scrape manager stopped" 2021-07-26T15:53:31.490 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=info ts=2021-07-26T15:53:31.300Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-07-26T15:53:31.490 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=info ts=2021-07-26T15:53:31.300Z caller=main.go:749 msg="Notifier manager stopped" 2021-07-26T15:53:31.491 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:31 smithi096 bash[27660]: level=info ts=2021-07-26T15:53:31.301Z caller=main.go:761 msg="See you next time!" 2021-07-26T15:53:31.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:31 smithi033 bash[19094]: audit 2021-07-26T15:53:31.230248+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.33:0/2486651515' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-07-26T15:53:31.716 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:31 smithi033 bash[14790]: audit 2021-07-26T15:53:31.230248+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.33:0/2486651515' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-07-26T15:53:31.935 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":14,"active_gid":14146,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":2899626203},{"type":"v1","addr":"172.21.15.33:6801","nonce":2899626203}]},"active_addr":"172.21.15.33:6801/2899626203","active_change":"2021-07-26T15:47:11.401740+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":24113,"name":"x","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.33:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":3822740668}]},{"addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1984688876}]}]}} 2021-07-26T15:53:31.948 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-07-26T15:53:31.950 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-07-26T15:53:31.951 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd dump --format=json 2021-07-26T15:53:32.487 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:32 smithi096 docker[29258]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-prometheus.a 2021-07-26T15:53:32.487 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:32 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@prometheus.a.service: Succeeded. 2021-07-26T15:53:32.489 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:32 smithi096 systemd[1]: Stopped Ceph prometheus.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:53:32.490 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:32 smithi096 systemd[1]: Started Ceph prometheus.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:53:32.490 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:32 smithi096 bash[29300]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:53:33.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: cluster 2021-07-26T15:53:31.569378+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v234: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:33.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.083298+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.089016+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T15:53:33.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.089731+0000 mgr.y (mgr.14146) 263 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T15:53:33.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.091134+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2021-07-26T15:53:33.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.091637+0000 mgr.y (mgr.14146) 264 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2021-07-26T15:53:33.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.096876+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.102008+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T15:53:33.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.102714+0000 mgr.y (mgr.14146) 265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T15:53:33.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.115877+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.96:9095"}]: dispatch 2021-07-26T15:53:33.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.116561+0000 mgr.y (mgr.14146) 266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.96:9095"}]: dispatch 2021-07-26T15:53:33.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.122357+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.128724+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T15:53:33.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.129321+0000 mgr.y (mgr.14146) 267 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T15:53:33.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.136960+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.96:3000"}]: dispatch 2021-07-26T15:53:33.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.145244+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.149325+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:53:33.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.150908+0000 mon.a (mon.0) 608 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:53:33.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[19094]: audit 2021-07-26T15:53:32.152476+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:53:33.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: cluster 2021-07-26T15:53:31.569378+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v234: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:33.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.083298+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.089016+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T15:53:33.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.089731+0000 mgr.y (mgr.14146) 263 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T15:53:33.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.091134+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2021-07-26T15:53:33.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.091637+0000 mgr.y (mgr.14146) 264 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2021-07-26T15:53:33.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.096876+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.102008+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T15:53:33.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.102714+0000 mgr.y (mgr.14146) 265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T15:53:33.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.115877+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.96:9095"}]: dispatch 2021-07-26T15:53:33.468 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.116561+0000 mgr.y (mgr.14146) 266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.96:9095"}]: dispatch 2021-07-26T15:53:33.468 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.122357+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.468 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.128724+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T15:53:33.468 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.129321+0000 mgr.y (mgr.14146) 267 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T15:53:33.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.136960+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.96:3000"}]: dispatch 2021-07-26T15:53:33.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.145244+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.149325+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:53:33.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.150908+0000 mon.a (mon.0) 608 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:53:33.470 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:33 smithi033 bash[14790]: audit 2021-07-26T15:53:32.152476+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:53:33.488 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.247Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-07-26T15:53:33.489 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.247Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-07-26T15:53:33.489 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.247Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-07-26T15:53:33.489 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.247Z caller=main.go:339 host_details="(Linux 5.4.0-80-generic #90-Ubuntu SMP Fri Jul 9 22:49:44 UTC 2021 x86_64 smithi096 (none))" 2021-07-26T15:53:33.489 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.247Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-07-26T15:53:33.490 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.247Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-07-26T15:53:33.490 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.250Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-07-26T15:53:33.490 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.250Z caller=main.go:678 msg="Starting TSDB ..." 2021-07-26T15:53:33.490 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.254Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-07-26T15:53:33.490 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.255Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-07-26T15:53:33.491 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.256Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-07-26T15:53:33.491 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.256Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=1.693321ms 2021-07-26T15:53:33.491 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.258Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-07-26T15:53:33.491 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.258Z caller=main.go:695 msg="TSDB started" 2021-07-26T15:53:33.492 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.258Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-07-26T15:53:33.492 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.265Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-07-26T15:53:33.492 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[29300]: level=info ts=2021-07-26T15:53:33.265Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-07-26T15:53:33.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: cluster 2021-07-26T15:53:31.569378+0000 mgr.y (mgr.14146) 262 : cluster [DBG] pgmap v234: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:33.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.083298+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.089016+0000 mon.a (mon.0) 598 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T15:53:33.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.089731+0000 mgr.y (mgr.14146) 263 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T15:53:33.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.091134+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2021-07-26T15:53:33.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.091637+0000 mgr.y (mgr.14146) 264 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.33:9093"}]: dispatch 2021-07-26T15:53:33.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.096876+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.102008+0000 mon.a (mon.0) 601 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T15:53:33.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.102714+0000 mgr.y (mgr.14146) 265 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T15:53:33.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.115877+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.96:9095"}]: dispatch 2021-07-26T15:53:33.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.116561+0000 mgr.y (mgr.14146) 266 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.96:9095"}]: dispatch 2021-07-26T15:53:33.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.122357+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.128724+0000 mon.a (mon.0) 604 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T15:53:33.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.129321+0000 mgr.y (mgr.14146) 267 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T15:53:33.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.136960+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.96:3000"}]: dispatch 2021-07-26T15:53:33.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.145244+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:33.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.149325+0000 mon.a (mon.0) 607 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:53:33.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.150908+0000 mon.a (mon.0) 608 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:53:33.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:33 smithi096 bash[15117]: audit 2021-07-26T15:53:32.152476+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:53:34.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:34 smithi033 bash[14790]: audit 2021-07-26T15:53:32.137541+0000 mgr.y (mgr.14146) 268 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.96:3000"}]: dispatch 2021-07-26T15:53:34.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:34 smithi033 bash[19094]: audit 2021-07-26T15:53:32.137541+0000 mgr.y (mgr.14146) 268 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.96:3000"}]: dispatch 2021-07-26T15:53:34.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:34 smithi096 bash[15117]: audit 2021-07-26T15:53:32.137541+0000 mgr.y (mgr.14146) 268 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.96:3000"}]: dispatch 2021-07-26T15:53:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:53:35.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:35 smithi033 bash[19094]: cluster 2021-07-26T15:53:33.570083+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v235: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:35.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:35 smithi033 bash[14790]: cluster 2021-07-26T15:53:33.570083+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v235: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:35.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:35 smithi096 bash[15117]: cluster 2021-07-26T15:53:33.570083+0000 mgr.y (mgr.14146) 269 : cluster [DBG] pgmap v235: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:37.207 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[14790]: cluster 2021-07-26T15:53:35.570751+0000 mgr.y (mgr.14146) 270 : cluster [DBG] pgmap v236: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:37.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[14790]: audit 2021-07-26T15:53:36.157173+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:37.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[14790]: audit 2021-07-26T15:53:36.370262+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:37.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[14790]: audit 2021-07-26T15:53:36.380925+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:37.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[14790]: audit 2021-07-26T15:53:36.386364+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:53:37.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[14790]: audit 2021-07-26T15:53:36.388534+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:53:37.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[14790]: audit 2021-07-26T15:53:36.390232+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:53:37.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[19094]: cluster 2021-07-26T15:53:35.570751+0000 mgr.y (mgr.14146) 270 : cluster [DBG] pgmap v236: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:37.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[19094]: audit 2021-07-26T15:53:36.157173+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:37.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[19094]: audit 2021-07-26T15:53:36.370262+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:37.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[19094]: audit 2021-07-26T15:53:36.380925+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:37.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[19094]: audit 2021-07-26T15:53:36.386364+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:53:37.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[19094]: audit 2021-07-26T15:53:36.388534+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:53:37.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:37 smithi033 bash[19094]: audit 2021-07-26T15:53:36.390232+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:53:37.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:37 smithi096 bash[15117]: cluster 2021-07-26T15:53:35.570751+0000 mgr.y (mgr.14146) 270 : cluster [DBG] pgmap v236: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:37.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:37 smithi096 bash[15117]: audit 2021-07-26T15:53:36.157173+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:37.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:37 smithi096 bash[15117]: audit 2021-07-26T15:53:36.370262+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:37.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:37 smithi096 bash[15117]: audit 2021-07-26T15:53:36.380925+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:37.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:37 smithi096 bash[15117]: audit 2021-07-26T15:53:36.386364+0000 mon.a (mon.0) 613 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:53:37.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:37 smithi096 bash[15117]: audit 2021-07-26T15:53:36.388534+0000 mon.a (mon.0) 614 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:53:37.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:37 smithi096 bash[15117]: audit 2021-07-26T15:53:36.390232+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:53:38.393 INFO:teuthology.orchestra.run.smithi033.stdout: 2021-07-26T15:53:38.393 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":54,"fsid":"7e62724e-ee28-11eb-8c23-001a4aab830c","created":"2021-07-26T15:46:09.081088+0000","modified":"2021-07-26T15:53:00.744554+0000","last_up_change":"2021-07-26T15:52:18.932597+0000","last_in_change":"2021-07-26T15:51:57.326019+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:50:11.585304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:52:52.822163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3d02e4ad-97fb-45ac-9912-2d795394c8ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6803","nonce":2786020081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6805","nonce":2786020081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6809","nonce":2786020081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6807","nonce":2786020081}]},"public_addr":"172.21.15.33:6803/2786020081","cluster_addr":"172.21.15.33:6805/2786020081","heartbeat_back_addr":"172.21.15.33:6809/2786020081","heartbeat_front_addr":"172.21.15.33:6807/2786020081","state":["exists","up"]},{"osd":1,"uuid":"789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6811","nonce":2278642317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6813","nonce":2278642317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6817","nonce":2278642317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6815","nonce":2278642317}]},"public_addr":"172.21.15.33:6811/2278642317","cluster_addr":"172.21.15.33:6813/2278642317","heartbeat_back_addr":"172.21.15.33:6817/2278642317","heartbeat_front_addr":"172.21.15.33:6815/2278642317","state":["exists","up"]},{"osd":2,"uuid":"9690c749-a40a-44a7-8a07-5290ff8980a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6819","nonce":290055652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6821","nonce":290055652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6825","nonce":290055652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6823","nonce":290055652}]},"public_addr":"172.21.15.33:6819/290055652","cluster_addr":"172.21.15.33:6821/290055652","heartbeat_back_addr":"172.21.15.33:6825/290055652","heartbeat_front_addr":"172.21.15.33:6823/290055652","state":["exists","up"]},{"osd":3,"uuid":"ca4ee0f8-4870-49bb-8dd6-75ab536d7199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6827","nonce":3214716836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6829","nonce":3214716836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6833","nonce":3214716836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6831","nonce":3214716836}]},"public_addr":"172.21.15.33:6827/3214716836","cluster_addr":"172.21.15.33:6829/3214716836","heartbeat_back_addr":"172.21.15.33:6833/3214716836","heartbeat_front_addr":"172.21.15.33:6831/3214716836","state":["exists","up"]},{"osd":4,"uuid":"d630717e-8f0b-4257-8157-bff1918f9841","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6801","nonce":1174280901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6803","nonce":1174280901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6807","nonce":1174280901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6805","nonce":1174280901}]},"public_addr":"172.21.15.96:6801/1174280901","cluster_addr":"172.21.15.96:6803/1174280901","heartbeat_back_addr":"172.21.15.96:6807/1174280901","heartbeat_front_addr":"172.21.15.96:6805/1174280901","state":["exists","up"]},{"osd":5,"uuid":"8e2f20b4-26f0-495a-9361-8cea9b39883d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6809","nonce":143251839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6811","nonce":143251839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6815","nonce":143251839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6813","nonce":143251839}]},"public_addr":"172.21.15.96:6809/143251839","cluster_addr":"172.21.15.96:6811/143251839","heartbeat_back_addr":"172.21.15.96:6815/143251839","heartbeat_front_addr":"172.21.15.96:6813/143251839","state":["exists","up"]},{"osd":6,"uuid":"c08bca3f-043c-406b-9f5a-88890d11ecae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6817","nonce":806457173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6819","nonce":806457173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6823","nonce":806457173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6821","nonce":806457173}]},"public_addr":"172.21.15.96:6817/806457173","cluster_addr":"172.21.15.96:6819/806457173","heartbeat_back_addr":"172.21.15.96:6823/806457173","heartbeat_front_addr":"172.21.15.96:6821/806457173","state":["exists","up"]},{"osd":7,"uuid":"a54a6024-e16e-429a-aa5b-4445c0a29b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6825","nonce":535155277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6827","nonce":535155277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6831","nonce":535155277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6829","nonce":535155277}]},"public_addr":"172.21.15.96:6825/535155277","cluster_addr":"172.21.15.96:6827/535155277","heartbeat_back_addr":"172.21.15.96:6831/535155277","heartbeat_front_addr":"172.21.15.96:6829/535155277","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:49:14.437542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:49:42.718085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:09.839689+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:37.396695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:59.865570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:51:25.244074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:51:51.606323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:52:17.356022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6801/2328850889":"2021-07-27T15:47:11.401176+0000","172.21.15.33:6800/2328850889":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/629989338":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/167530138":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/474711394":"2021-07-27T15:46:39.321454+0000","172.21.15.33:6800/3040782006":"2021-07-27T15:46:39.321454+0000","172.21.15.33:6801/3040782006":"2021-07-27T15:46:39.321454+0000","172.21.15.33:0/2349254883":"2021-07-27T15:46:39.321454+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:53:39.109 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-07-26T15:53:39.110 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd dump --format=json 2021-07-26T15:53:39.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:39 smithi033 bash[19094]: cluster 2021-07-26T15:53:37.571373+0000 mgr.y (mgr.14146) 271 : cluster [DBG] pgmap v237: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:39.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:39 smithi033 bash[19094]: audit 2021-07-26T15:53:38.390382+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.33:0/3174654309' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:53:39.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:39 smithi033 bash[14790]: cluster 2021-07-26T15:53:37.571373+0000 mgr.y (mgr.14146) 271 : cluster [DBG] pgmap v237: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:39.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:39 smithi033 bash[14790]: audit 2021-07-26T15:53:38.390382+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.33:0/3174654309' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:53:39.208 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:53:38 smithi033 bash[32681]: level=info ts=2021-07-26T15:53:38.933Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001055042s 2021-07-26T15:53:39.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:39 smithi096 bash[15117]: cluster 2021-07-26T15:53:37.571373+0000 mgr.y (mgr.14146) 271 : cluster [DBG] pgmap v237: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:39.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:39 smithi096 bash[15117]: audit 2021-07-26T15:53:38.390382+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.33:0/3174654309' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:53:41.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:41 smithi033 bash[14790]: cluster 2021-07-26T15:53:39.572120+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v238: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:41.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:41 smithi033 bash[14790]: audit 2021-07-26T15:53:40.607663+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:41.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:41 smithi033 bash[14790]: audit 2021-07-26T15:53:40.883765+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:41.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:41 smithi033 bash[14790]: audit 2021-07-26T15:53:40.892034+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:41.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:41 smithi033 bash[19094]: cluster 2021-07-26T15:53:39.572120+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v238: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:41.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:41 smithi033 bash[19094]: audit 2021-07-26T15:53:40.607663+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:41.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:41 smithi033 bash[19094]: audit 2021-07-26T15:53:40.883765+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:41.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:41 smithi033 bash[19094]: audit 2021-07-26T15:53:40.892034+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:41.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:41 smithi096 bash[15117]: cluster 2021-07-26T15:53:39.572120+0000 mgr.y (mgr.14146) 272 : cluster [DBG] pgmap v238: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:41.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:41 smithi096 bash[15117]: audit 2021-07-26T15:53:40.607663+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:41.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:41 smithi096 bash[15117]: audit 2021-07-26T15:53:40.883765+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:41.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:41 smithi096 bash[15117]: audit 2021-07-26T15:53:40.892034+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:53:41.640 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:53:43.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:43 smithi033 bash[14790]: cluster 2021-07-26T15:53:41.572951+0000 mgr.y (mgr.14146) 273 : cluster [DBG] pgmap v239: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:43.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:43 smithi033 bash[19094]: cluster 2021-07-26T15:53:41.572951+0000 mgr.y (mgr.14146) 273 : cluster [DBG] pgmap v239: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:43.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:43 smithi096 bash[15117]: cluster 2021-07-26T15:53:41.572951+0000 mgr.y (mgr.14146) 273 : cluster [DBG] pgmap v239: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:45.115 INFO:teuthology.orchestra.run.smithi033.stdout: 2021-07-26T15:53:45.116 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":54,"fsid":"7e62724e-ee28-11eb-8c23-001a4aab830c","created":"2021-07-26T15:46:09.081088+0000","modified":"2021-07-26T15:53:00.744554+0000","last_up_change":"2021-07-26T15:52:18.932597+0000","last_in_change":"2021-07-26T15:51:57.326019+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:50:11.585304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:52:52.822163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"3d02e4ad-97fb-45ac-9912-2d795394c8ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6803","nonce":2786020081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6805","nonce":2786020081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6809","nonce":2786020081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":2786020081},{"type":"v1","addr":"172.21.15.33:6807","nonce":2786020081}]},"public_addr":"172.21.15.33:6803/2786020081","cluster_addr":"172.21.15.33:6805/2786020081","heartbeat_back_addr":"172.21.15.33:6809/2786020081","heartbeat_front_addr":"172.21.15.33:6807/2786020081","state":["exists","up"]},{"osd":1,"uuid":"789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6811","nonce":2278642317}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6813","nonce":2278642317}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6817","nonce":2278642317}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":2278642317},{"type":"v1","addr":"172.21.15.33:6815","nonce":2278642317}]},"public_addr":"172.21.15.33:6811/2278642317","cluster_addr":"172.21.15.33:6813/2278642317","heartbeat_back_addr":"172.21.15.33:6817/2278642317","heartbeat_front_addr":"172.21.15.33:6815/2278642317","state":["exists","up"]},{"osd":2,"uuid":"9690c749-a40a-44a7-8a07-5290ff8980a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6819","nonce":290055652}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6821","nonce":290055652}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6825","nonce":290055652}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":290055652},{"type":"v1","addr":"172.21.15.33:6823","nonce":290055652}]},"public_addr":"172.21.15.33:6819/290055652","cluster_addr":"172.21.15.33:6821/290055652","heartbeat_back_addr":"172.21.15.33:6825/290055652","heartbeat_front_addr":"172.21.15.33:6823/290055652","state":["exists","up"]},{"osd":3,"uuid":"ca4ee0f8-4870-49bb-8dd6-75ab536d7199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6827","nonce":3214716836}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6829","nonce":3214716836}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6833","nonce":3214716836}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":3214716836},{"type":"v1","addr":"172.21.15.33:6831","nonce":3214716836}]},"public_addr":"172.21.15.33:6827/3214716836","cluster_addr":"172.21.15.33:6829/3214716836","heartbeat_back_addr":"172.21.15.33:6833/3214716836","heartbeat_front_addr":"172.21.15.33:6831/3214716836","state":["exists","up"]},{"osd":4,"uuid":"d630717e-8f0b-4257-8157-bff1918f9841","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":30,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6801","nonce":1174280901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6803","nonce":1174280901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6807","nonce":1174280901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":1174280901},{"type":"v1","addr":"172.21.15.96:6805","nonce":1174280901}]},"public_addr":"172.21.15.96:6801/1174280901","cluster_addr":"172.21.15.96:6803/1174280901","heartbeat_back_addr":"172.21.15.96:6807/1174280901","heartbeat_front_addr":"172.21.15.96:6805/1174280901","state":["exists","up"]},{"osd":5,"uuid":"8e2f20b4-26f0-495a-9361-8cea9b39883d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6809","nonce":143251839}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6811","nonce":143251839}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6815","nonce":143251839}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":143251839},{"type":"v1","addr":"172.21.15.96:6813","nonce":143251839}]},"public_addr":"172.21.15.96:6809/143251839","cluster_addr":"172.21.15.96:6811/143251839","heartbeat_back_addr":"172.21.15.96:6815/143251839","heartbeat_front_addr":"172.21.15.96:6813/143251839","state":["exists","up"]},{"osd":6,"uuid":"c08bca3f-043c-406b-9f5a-88890d11ecae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":42,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6817","nonce":806457173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6819","nonce":806457173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6823","nonce":806457173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":806457173},{"type":"v1","addr":"172.21.15.96:6821","nonce":806457173}]},"public_addr":"172.21.15.96:6817/806457173","cluster_addr":"172.21.15.96:6819/806457173","heartbeat_back_addr":"172.21.15.96:6823/806457173","heartbeat_front_addr":"172.21.15.96:6821/806457173","state":["exists","up"]},{"osd":7,"uuid":"a54a6024-e16e-429a-aa5b-4445c0a29b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6825","nonce":535155277}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6827","nonce":535155277}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6831","nonce":535155277}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":535155277},{"type":"v1","addr":"172.21.15.96:6829","nonce":535155277}]},"public_addr":"172.21.15.96:6825/535155277","cluster_addr":"172.21.15.96:6827/535155277","heartbeat_back_addr":"172.21.15.96:6831/535155277","heartbeat_front_addr":"172.21.15.96:6829/535155277","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:49:14.437542+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:49:42.718085+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:09.839689+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:37.396695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:59.865570+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:51:25.244074+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:51:51.606323+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:52:17.356022+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6801/2328850889":"2021-07-27T15:47:11.401176+0000","172.21.15.33:6800/2328850889":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/629989338":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/167530138":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/474711394":"2021-07-27T15:46:39.321454+0000","172.21.15.33:6800/3040782006":"2021-07-27T15:46:39.321454+0000","172.21.15.33:6801/3040782006":"2021-07-27T15:46:39.321454+0000","172.21.15.33:0/2349254883":"2021-07-27T15:46:39.321454+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T15:53:45.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:45 smithi033 bash[14790]: cluster 2021-07-26T15:53:43.573674+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v240: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:45.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:45 smithi033 bash[14790]: audit 2021-07-26T15:53:45.112938+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.33:0/3388278727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:53:45.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:45 smithi033 bash[19094]: cluster 2021-07-26T15:53:43.573674+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v240: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:45.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:45 smithi033 bash[19094]: audit 2021-07-26T15:53:45.112938+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.33:0/3388278727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:53:45.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:45 smithi096 bash[15117]: cluster 2021-07-26T15:53:43.573674+0000 mgr.y (mgr.14146) 274 : cluster [DBG] pgmap v240: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:45.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:45 smithi096 bash[15117]: audit 2021-07-26T15:53:45.112938+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.33:0/3388278727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T15:53:45.813 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-07-26T15:53:47.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:47 smithi033 bash[19094]: cluster 2021-07-26T15:53:45.574326+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v241: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:47.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:47 smithi033 bash[14790]: cluster 2021-07-26T15:53:45.574326+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v241: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:47.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:47 smithi096 bash[15117]: cluster 2021-07-26T15:53:45.574326+0000 mgr.y (mgr.14146) 275 : cluster [DBG] pgmap v241: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:48.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:48 smithi033 bash[14790]: cluster 2021-07-26T15:53:47.574976+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v242: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:48.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:48 smithi033 bash[19094]: cluster 2021-07-26T15:53:47.574976+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v242: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:48.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:48 smithi096 bash[15117]: cluster 2021-07-26T15:53:47.574976+0000 mgr.y (mgr.14146) 276 : cluster [DBG] pgmap v242: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:53:50.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:50 smithi033 bash[14790]: cluster 2021-07-26T15:53:49.575678+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v243: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:50.957 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:50 smithi033 bash[19094]: cluster 2021-07-26T15:53:49.575678+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v243: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:50.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:50 smithi096 bash[15117]: cluster 2021-07-26T15:53:49.575678+0000 mgr.y (mgr.14146) 277 : cluster [DBG] pgmap v243: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:52.596 INFO:teuthology.orchestra.run.smithi033.stdout:34359738426 2021-07-26T15:53:52.596 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-07-26T15:53:53.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:53 smithi033 bash[14790]: cluster 2021-07-26T15:53:51.576468+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v244: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:53.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:53 smithi033 bash[19094]: cluster 2021-07-26T15:53:51.576468+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v244: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:53.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:53 smithi096 bash[15117]: cluster 2021-07-26T15:53:51.576468+0000 mgr.y (mgr.14146) 278 : cluster [DBG] pgmap v244: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:55.373 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:53:55.434 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:55 smithi033 bash[19094]: cluster 2021-07-26T15:53:53.577135+0000 mgr.y (mgr.14146) 279 : cluster [DBG] pgmap v245: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:55.435 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:55 smithi033 bash[14790]: cluster 2021-07-26T15:53:53.577135+0000 mgr.y (mgr.14146) 279 : cluster [DBG] pgmap v245: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:55.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:55 smithi096 bash[15117]: cluster 2021-07-26T15:53:53.577135+0000 mgr.y (mgr.14146) 279 : cluster [DBG] pgmap v245: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:57.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:57 smithi033 bash[19094]: cluster 2021-07-26T15:53:55.577888+0000 mgr.y (mgr.14146) 280 : cluster [DBG] pgmap v246: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:57.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:57 smithi033 bash[14790]: cluster 2021-07-26T15:53:55.577888+0000 mgr.y (mgr.14146) 280 : cluster [DBG] pgmap v246: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:57.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:57 smithi096 bash[15117]: cluster 2021-07-26T15:53:55.577888+0000 mgr.y (mgr.14146) 280 : cluster [DBG] pgmap v246: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:59.357 INFO:teuthology.orchestra.run.smithi033.stdout:55834574902 2021-07-26T15:53:59.358 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-07-26T15:53:59.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:53:59 smithi033 bash[19094]: cluster 2021-07-26T15:53:57.578666+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v247: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:59.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:53:59 smithi033 bash[14790]: cluster 2021-07-26T15:53:57.578666+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v247: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:53:59.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:53:59 smithi096 bash[15117]: cluster 2021-07-26T15:53:57.578666+0000 mgr.y (mgr.14146) 281 : cluster [DBG] pgmap v247: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:01.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:01 smithi033 bash[14790]: cluster 2021-07-26T15:53:59.579320+0000 mgr.y (mgr.14146) 282 : cluster [DBG] pgmap v248: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:01.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:01 smithi033 bash[19094]: cluster 2021-07-26T15:53:59.579320+0000 mgr.y (mgr.14146) 282 : cluster [DBG] pgmap v248: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:01.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:01 smithi096 bash[15117]: cluster 2021-07-26T15:53:59.579320+0000 mgr.y (mgr.14146) 282 : cluster [DBG] pgmap v248: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:02.141 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:54:03.426 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:03 smithi033 bash[19094]: cluster 2021-07-26T15:54:01.579994+0000 mgr.y (mgr.14146) 283 : cluster [DBG] pgmap v249: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:03.427 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:03 smithi033 bash[14790]: cluster 2021-07-26T15:54:01.579994+0000 mgr.y (mgr.14146) 283 : cluster [DBG] pgmap v249: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:03.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:03 smithi096 bash[15117]: cluster 2021-07-26T15:54:01.579994+0000 mgr.y (mgr.14146) 283 : cluster [DBG] pgmap v249: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:05.393 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:05 smithi033 bash[19094]: cluster 2021-07-26T15:54:03.580697+0000 mgr.y (mgr.14146) 284 : cluster [DBG] pgmap v250: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:05.393 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:05 smithi033 bash[14790]: cluster 2021-07-26T15:54:03.580697+0000 mgr.y (mgr.14146) 284 : cluster [DBG] pgmap v250: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:05.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:05 smithi096 bash[15117]: cluster 2021-07-26T15:54:03.580697+0000 mgr.y (mgr.14146) 284 : cluster [DBG] pgmap v250: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:06.097 INFO:teuthology.orchestra.run.smithi033.stdout:77309411378 2021-07-26T15:54:06.098 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-07-26T15:54:07.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:07 smithi033 bash[14790]: cluster 2021-07-26T15:54:05.581422+0000 mgr.y (mgr.14146) 285 : cluster [DBG] pgmap v251: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:07.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:07 smithi033 bash[19094]: cluster 2021-07-26T15:54:05.581422+0000 mgr.y (mgr.14146) 285 : cluster [DBG] pgmap v251: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:07.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:07 smithi096 bash[15117]: cluster 2021-07-26T15:54:05.581422+0000 mgr.y (mgr.14146) 285 : cluster [DBG] pgmap v251: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:54:09.207 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:09 smithi033 bash[14790]: cluster 2021-07-26T15:54:07.582142+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v252: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:09.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:09 smithi033 bash[19094]: cluster 2021-07-26T15:54:07.582142+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v252: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:09.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:09 smithi096 bash[15117]: cluster 2021-07-26T15:54:07.582142+0000 mgr.y (mgr.14146) 286 : cluster [DBG] pgmap v252: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:11.207 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:11 smithi033 bash[14790]: cluster 2021-07-26T15:54:09.582873+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v253: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:11.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:11 smithi033 bash[19094]: cluster 2021-07-26T15:54:09.582873+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v253: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:11.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:11 smithi096 bash[15117]: cluster 2021-07-26T15:54:09.582873+0000 mgr.y (mgr.14146) 287 : cluster [DBG] pgmap v253: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:12.323 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:12 smithi033 bash[14790]: audit 2021-07-26T15:54:11.682239+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:54:12.324 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:12 smithi033 bash[14790]: audit 2021-07-26T15:54:11.685349+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:54:12.324 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:12 smithi033 bash[19094]: audit 2021-07-26T15:54:11.682239+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:54:12.324 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:12 smithi033 bash[19094]: audit 2021-07-26T15:54:11.685349+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:54:12.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:12 smithi096 bash[15117]: audit 2021-07-26T15:54:11.682239+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:54:12.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:12 smithi096 bash[15117]: audit 2021-07-26T15:54:11.685349+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:54:12.853 INFO:teuthology.orchestra.run.smithi033.stdout:107374182445 2021-07-26T15:54:12.854 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-07-26T15:54:13.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:13 smithi033 bash[14790]: cluster 2021-07-26T15:54:11.583641+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v254: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:13.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:13 smithi033 bash[19094]: cluster 2021-07-26T15:54:11.583641+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v254: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:13.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:13 smithi096 bash[15117]: cluster 2021-07-26T15:54:11.583641+0000 mgr.y (mgr.14146) 288 : cluster [DBG] pgmap v254: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:14.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:14 smithi033 bash[14790]: cluster 2021-07-26T15:54:13.584291+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v255: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:14.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:14 smithi033 bash[19094]: cluster 2021-07-26T15:54:13.584291+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v255: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:14.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:14 smithi096 bash[15117]: cluster 2021-07-26T15:54:13.584291+0000 mgr.y (mgr.14146) 289 : cluster [DBG] pgmap v255: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:15.632 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:54:16.955 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:16 smithi033 bash[14790]: cluster 2021-07-26T15:54:15.584999+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v256: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:16.956 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:16 smithi033 bash[19094]: cluster 2021-07-26T15:54:15.584999+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v256: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:16.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:16 smithi096 bash[15117]: cluster 2021-07-26T15:54:15.584999+0000 mgr.y (mgr.14146) 290 : cluster [DBG] pgmap v256: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:19.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:19 smithi033 bash[14790]: cluster 2021-07-26T15:54:17.585647+0000 mgr.y (mgr.14146) 291 : cluster [DBG] pgmap v257: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:19.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:19 smithi033 bash[19094]: cluster 2021-07-26T15:54:17.585647+0000 mgr.y (mgr.14146) 291 : cluster [DBG] pgmap v257: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:19.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:19 smithi096 bash[15117]: cluster 2021-07-26T15:54:17.585647+0000 mgr.y (mgr.14146) 291 : cluster [DBG] pgmap v257: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:19.784 INFO:teuthology.orchestra.run.smithi033.stdout:128849018922 2021-07-26T15:54:19.784 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-07-26T15:54:21.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:21 smithi033 bash[19094]: cluster 2021-07-26T15:54:19.586318+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v258: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:21.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:21 smithi033 bash[14790]: cluster 2021-07-26T15:54:19.586318+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v258: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:21.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:21 smithi096 bash[15117]: cluster 2021-07-26T15:54:19.586318+0000 mgr.y (mgr.14146) 292 : cluster [DBG] pgmap v258: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:22.564 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:54:23.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:23 smithi033 bash[14790]: cluster 2021-07-26T15:54:21.587024+0000 mgr.y (mgr.14146) 293 : cluster [DBG] pgmap v259: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:23.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:23 smithi033 bash[19094]: cluster 2021-07-26T15:54:21.587024+0000 mgr.y (mgr.14146) 293 : cluster [DBG] pgmap v259: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:23.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:23 smithi096 bash[15117]: cluster 2021-07-26T15:54:21.587024+0000 mgr.y (mgr.14146) 293 : cluster [DBG] pgmap v259: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:25.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:25 smithi033 bash[14790]: cluster 2021-07-26T15:54:23.587749+0000 mgr.y (mgr.14146) 294 : cluster [DBG] pgmap v260: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:25.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:25 smithi033 bash[19094]: cluster 2021-07-26T15:54:23.587749+0000 mgr.y (mgr.14146) 294 : cluster [DBG] pgmap v260: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:25.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:25 smithi096 bash[15117]: cluster 2021-07-26T15:54:23.587749+0000 mgr.y (mgr.14146) 294 : cluster [DBG] pgmap v260: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:26.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:26 smithi033 bash[14790]: cluster 2021-07-26T15:54:25.588437+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v261: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:26.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:26 smithi033 bash[19094]: cluster 2021-07-26T15:54:25.588437+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v261: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:26.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:26 smithi096 bash[15117]: cluster 2021-07-26T15:54:25.588437+0000 mgr.y (mgr.14146) 295 : cluster [DBG] pgmap v261: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:26.660 INFO:teuthology.orchestra.run.smithi033.stdout:154618822693 2021-07-26T15:54:26.660 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-07-26T15:54:29.434 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:54:29.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:29 smithi033 bash[19094]: cluster 2021-07-26T15:54:27.589125+0000 mgr.y (mgr.14146) 296 : cluster [DBG] pgmap v262: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:29.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:29 smithi033 bash[14790]: cluster 2021-07-26T15:54:27.589125+0000 mgr.y (mgr.14146) 296 : cluster [DBG] pgmap v262: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:29.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:29 smithi096 bash[15117]: cluster 2021-07-26T15:54:27.589125+0000 mgr.y (mgr.14146) 296 : cluster [DBG] pgmap v262: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:31.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:31 smithi033 bash[14790]: cluster 2021-07-26T15:54:29.589714+0000 mgr.y (mgr.14146) 297 : cluster [DBG] pgmap v263: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:31.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:31 smithi033 bash[19094]: cluster 2021-07-26T15:54:29.589714+0000 mgr.y (mgr.14146) 297 : cluster [DBG] pgmap v263: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:31.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:31 smithi096 bash[15117]: cluster 2021-07-26T15:54:29.589714+0000 mgr.y (mgr.14146) 297 : cluster [DBG] pgmap v263: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:33.207 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:33 smithi033 bash[14790]: cluster 2021-07-26T15:54:31.590426+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v264: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:33.207 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:33 smithi033 bash[19094]: cluster 2021-07-26T15:54:31.590426+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v264: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:33.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:33 smithi096 bash[15117]: cluster 2021-07-26T15:54:31.590426+0000 mgr.y (mgr.14146) 298 : cluster [DBG] pgmap v264: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:33.432 INFO:teuthology.orchestra.run.smithi033.stdout:180388626466 2021-07-26T15:54:33.433 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-07-26T15:54:35.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:35 smithi033 bash[14790]: cluster 2021-07-26T15:54:33.590916+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v265: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:35.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:35 smithi033 bash[19094]: cluster 2021-07-26T15:54:33.590916+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v265: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:35.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:35 smithi096 bash[15117]: cluster 2021-07-26T15:54:33.590916+0000 mgr.y (mgr.14146) 299 : cluster [DBG] pgmap v265: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:36.214 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:54:36.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:36 smithi033 bash[14790]: cluster 2021-07-26T15:54:35.591599+0000 mgr.y (mgr.14146) 300 : cluster [DBG] pgmap v266: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:36.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:36 smithi033 bash[19094]: cluster 2021-07-26T15:54:35.591599+0000 mgr.y (mgr.14146) 300 : cluster [DBG] pgmap v266: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:36.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:36 smithi096 bash[15117]: cluster 2021-07-26T15:54:35.591599+0000 mgr.y (mgr.14146) 300 : cluster [DBG] pgmap v266: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:39.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:39 smithi033 bash[14790]: cluster 2021-07-26T15:54:37.592239+0000 mgr.y (mgr.14146) 301 : cluster [DBG] pgmap v267: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:39.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:39 smithi033 bash[19094]: cluster 2021-07-26T15:54:37.592239+0000 mgr.y (mgr.14146) 301 : cluster [DBG] pgmap v267: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:39.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:39 smithi096 bash[15117]: cluster 2021-07-26T15:54:37.592239+0000 mgr.y (mgr.14146) 301 : cluster [DBG] pgmap v267: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:40.088 INFO:teuthology.orchestra.run.smithi033.stdout:206158430238 2021-07-26T15:54:40.089 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-07-26T15:54:41.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:41 smithi033 bash[14790]: cluster 2021-07-26T15:54:39.592947+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v268: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:41.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:41 smithi033 bash[14790]: audit 2021-07-26T15:54:40.900417+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:54:41.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:41 smithi033 bash[14790]: audit 2021-07-26T15:54:40.903513+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:54:41.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:41 smithi033 bash[14790]: audit 2021-07-26T15:54:40.905522+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:54:41.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:41 smithi033 bash[19094]: cluster 2021-07-26T15:54:39.592947+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v268: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:41.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:41 smithi033 bash[19094]: audit 2021-07-26T15:54:40.900417+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:54:41.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:41 smithi033 bash[19094]: audit 2021-07-26T15:54:40.903513+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:54:41.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:41 smithi033 bash[19094]: audit 2021-07-26T15:54:40.905522+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:54:41.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:41 smithi096 bash[15117]: cluster 2021-07-26T15:54:39.592947+0000 mgr.y (mgr.14146) 302 : cluster [DBG] pgmap v268: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:41.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:41 smithi096 bash[15117]: audit 2021-07-26T15:54:40.900417+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:54:41.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:41 smithi096 bash[15117]: audit 2021-07-26T15:54:40.903513+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:54:41.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:41 smithi096 bash[15117]: audit 2021-07-26T15:54:40.905522+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:54:42.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:42 smithi033 bash[19094]: audit 2021-07-26T15:54:41.168133+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:54:42.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:42 smithi033 bash[19094]: cluster 2021-07-26T15:54:41.593625+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v269: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:42.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:42 smithi033 bash[14790]: audit 2021-07-26T15:54:41.168133+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:54:42.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:42 smithi033 bash[14790]: cluster 2021-07-26T15:54:41.593625+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v269: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:42.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:42 smithi096 bash[15117]: audit 2021-07-26T15:54:41.168133+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:54:42.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:42 smithi096 bash[15117]: cluster 2021-07-26T15:54:41.593625+0000 mgr.y (mgr.14146) 303 : cluster [DBG] pgmap v269: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:42.865 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:54:44.925 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:44 smithi033 bash[14790]: cluster 2021-07-26T15:54:43.594272+0000 mgr.y (mgr.14146) 304 : cluster [DBG] pgmap v270: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:44.925 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:44 smithi033 bash[19094]: cluster 2021-07-26T15:54:43.594272+0000 mgr.y (mgr.14146) 304 : cluster [DBG] pgmap v270: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:44.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:44 smithi096 bash[15117]: cluster 2021-07-26T15:54:43.594272+0000 mgr.y (mgr.14146) 304 : cluster [DBG] pgmap v270: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:46.433 INFO:teuthology.orchestra.run.smithi033.stdout:34359738437 2021-07-26T15:54:46.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:46 smithi033 bash[14790]: cluster 2021-07-26T15:54:45.594947+0000 mgr.y (mgr.14146) 305 : cluster [DBG] pgmap v271: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:46.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:46 smithi033 bash[14790]: audit 2021-07-26T15:54:46.432032+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.33:0/96869397' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-07-26T15:54:46.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:46 smithi033 bash[19094]: cluster 2021-07-26T15:54:45.594947+0000 mgr.y (mgr.14146) 305 : cluster [DBG] pgmap v271: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:46.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:46 smithi033 bash[19094]: audit 2021-07-26T15:54:46.432032+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.33:0/96869397' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-07-26T15:54:46.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:46 smithi096 bash[15117]: cluster 2021-07-26T15:54:45.594947+0000 mgr.y (mgr.14146) 305 : cluster [DBG] pgmap v271: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:46.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:46 smithi096 bash[15117]: audit 2021-07-26T15:54:46.432032+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.33:0/96869397' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-07-26T15:54:47.196 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738426 got 34359738437 for osd.0 2021-07-26T15:54:47.196 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-07-26T15:54:49.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:49 smithi033 bash[14790]: cluster 2021-07-26T15:54:47.595639+0000 mgr.y (mgr.14146) 306 : cluster [DBG] pgmap v272: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:49.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:49 smithi033 bash[19094]: cluster 2021-07-26T15:54:47.595639+0000 mgr.y (mgr.14146) 306 : cluster [DBG] pgmap v272: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:49.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:49 smithi096 bash[15117]: cluster 2021-07-26T15:54:47.595639+0000 mgr.y (mgr.14146) 306 : cluster [DBG] pgmap v272: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:49.966 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:54:51.434 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:51 smithi033 bash[14790]: cluster 2021-07-26T15:54:49.596374+0000 mgr.y (mgr.14146) 307 : cluster [DBG] pgmap v273: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:51.434 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:51 smithi033 bash[19094]: cluster 2021-07-26T15:54:49.596374+0000 mgr.y (mgr.14146) 307 : cluster [DBG] pgmap v273: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:51.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:51 smithi096 bash[15117]: cluster 2021-07-26T15:54:49.596374+0000 mgr.y (mgr.14146) 307 : cluster [DBG] pgmap v273: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:53.444 INFO:teuthology.orchestra.run.smithi033.stdout:55834574913 2021-07-26T15:54:53.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:53 smithi033 bash[14790]: cluster 2021-07-26T15:54:51.597138+0000 mgr.y (mgr.14146) 308 : cluster [DBG] pgmap v274: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:53.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:53 smithi033 bash[19094]: cluster 2021-07-26T15:54:51.597138+0000 mgr.y (mgr.14146) 308 : cluster [DBG] pgmap v274: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:53.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:53 smithi096 bash[15117]: cluster 2021-07-26T15:54:51.597138+0000 mgr.y (mgr.14146) 308 : cluster [DBG] pgmap v274: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:54.146 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574902 got 55834574913 for osd.1 2021-07-26T15:54:54.146 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-07-26T15:54:54.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:54 smithi033 bash[14790]: audit 2021-07-26T15:54:53.442931+0000 mon.a (mon.0) 625 : audit [DBG] from='client.? 172.21.15.33:0/3372909180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-07-26T15:54:54.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:54 smithi033 bash[19094]: audit 2021-07-26T15:54:53.442931+0000 mon.a (mon.0) 625 : audit [DBG] from='client.? 172.21.15.33:0/3372909180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-07-26T15:54:54.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:54 smithi096 bash[15117]: audit 2021-07-26T15:54:53.442931+0000 mon.a (mon.0) 625 : audit [DBG] from='client.? 172.21.15.33:0/3372909180' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-07-26T15:54:55.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:55 smithi033 bash[19094]: cluster 2021-07-26T15:54:53.597995+0000 mgr.y (mgr.14146) 309 : cluster [DBG] pgmap v275: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:55.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:55 smithi033 bash[14790]: cluster 2021-07-26T15:54:53.597995+0000 mgr.y (mgr.14146) 309 : cluster [DBG] pgmap v275: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:55.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:55 smithi096 bash[15117]: cluster 2021-07-26T15:54:53.597995+0000 mgr.y (mgr.14146) 309 : cluster [DBG] pgmap v275: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:56.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:56 smithi033 bash[14790]: cluster 2021-07-26T15:54:55.598727+0000 mgr.y (mgr.14146) 310 : cluster [DBG] pgmap v276: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:56.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:56 smithi033 bash[19094]: cluster 2021-07-26T15:54:55.598727+0000 mgr.y (mgr.14146) 310 : cluster [DBG] pgmap v276: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:56.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:56 smithi096 bash[15117]: cluster 2021-07-26T15:54:55.598727+0000 mgr.y (mgr.14146) 310 : cluster [DBG] pgmap v276: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:56.912 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:54:59.207 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:54:59 smithi033 bash[14790]: cluster 2021-07-26T15:54:57.599372+0000 mgr.y (mgr.14146) 311 : cluster [DBG] pgmap v277: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:59.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:54:59 smithi033 bash[19094]: cluster 2021-07-26T15:54:57.599372+0000 mgr.y (mgr.14146) 311 : cluster [DBG] pgmap v277: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:54:59.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:54:59 smithi096 bash[15117]: cluster 2021-07-26T15:54:57.599372+0000 mgr.y (mgr.14146) 311 : cluster [DBG] pgmap v277: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:00.410 INFO:teuthology.orchestra.run.smithi033.stdout:77309411389 2021-07-26T15:55:01.095 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411378 got 77309411389 for osd.2 2021-07-26T15:55:01.096 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-07-26T15:55:01.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:01 smithi033 bash[14790]: cluster 2021-07-26T15:54:59.600034+0000 mgr.y (mgr.14146) 312 : cluster [DBG] pgmap v278: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:01.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:01 smithi033 bash[14790]: audit 2021-07-26T15:55:00.409541+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.15.33:0/3674937561' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-07-26T15:55:01.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:01 smithi033 bash[19094]: cluster 2021-07-26T15:54:59.600034+0000 mgr.y (mgr.14146) 312 : cluster [DBG] pgmap v278: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:01.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:01 smithi033 bash[19094]: audit 2021-07-26T15:55:00.409541+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.15.33:0/3674937561' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-07-26T15:55:01.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:01 smithi096 bash[15117]: cluster 2021-07-26T15:54:59.600034+0000 mgr.y (mgr.14146) 312 : cluster [DBG] pgmap v278: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:01.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:01 smithi096 bash[15117]: audit 2021-07-26T15:55:00.409541+0000 mon.a (mon.0) 626 : audit [DBG] from='client.? 172.21.15.33:0/3674937561' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-07-26T15:55:03.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:03 smithi033 bash[14790]: cluster 2021-07-26T15:55:01.600762+0000 mgr.y (mgr.14146) 313 : cluster [DBG] pgmap v279: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:03.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:03 smithi033 bash[19094]: cluster 2021-07-26T15:55:01.600762+0000 mgr.y (mgr.14146) 313 : cluster [DBG] pgmap v279: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:03.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:03 smithi096 bash[15117]: cluster 2021-07-26T15:55:01.600762+0000 mgr.y (mgr.14146) 313 : cluster [DBG] pgmap v279: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:03.864 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:55:04.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:04 smithi096 bash[15117]: cluster 2021-07-26T15:55:03.601463+0000 mgr.y (mgr.14146) 314 : cluster [DBG] pgmap v280: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:04.707 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:04 smithi033 bash[14790]: cluster 2021-07-26T15:55:03.601463+0000 mgr.y (mgr.14146) 314 : cluster [DBG] pgmap v280: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:04.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:04 smithi033 bash[19094]: cluster 2021-07-26T15:55:03.601463+0000 mgr.y (mgr.14146) 314 : cluster [DBG] pgmap v280: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:06.935 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:06 smithi033 bash[19094]: cluster 2021-07-26T15:55:05.602173+0000 mgr.y (mgr.14146) 315 : cluster [DBG] pgmap v281: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:06.936 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:06 smithi033 bash[14790]: cluster 2021-07-26T15:55:05.602173+0000 mgr.y (mgr.14146) 315 : cluster [DBG] pgmap v281: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:06.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:06 smithi096 bash[15117]: cluster 2021-07-26T15:55:05.602173+0000 mgr.y (mgr.14146) 315 : cluster [DBG] pgmap v281: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:07.261 INFO:teuthology.orchestra.run.smithi033.stdout:107374182456 2021-07-26T15:55:07.875 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182445 got 107374182456 for osd.3 2021-07-26T15:55:07.876 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-07-26T15:55:08.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:08 smithi033 bash[14790]: audit 2021-07-26T15:55:07.260153+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.33:0/3305224638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-07-26T15:55:08.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:08 smithi033 bash[19094]: audit 2021-07-26T15:55:07.260153+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.33:0/3305224638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-07-26T15:55:08.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:08 smithi096 bash[15117]: audit 2021-07-26T15:55:07.260153+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.33:0/3305224638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-07-26T15:55:09.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:09 smithi033 bash[14790]: cluster 2021-07-26T15:55:07.602934+0000 mgr.y (mgr.14146) 316 : cluster [DBG] pgmap v282: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:09.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:09 smithi033 bash[19094]: cluster 2021-07-26T15:55:07.602934+0000 mgr.y (mgr.14146) 316 : cluster [DBG] pgmap v282: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:09.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:09 smithi096 bash[15117]: cluster 2021-07-26T15:55:07.602934+0000 mgr.y (mgr.14146) 316 : cluster [DBG] pgmap v282: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:10.658 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:55:11.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:11 smithi033 bash[19094]: cluster 2021-07-26T15:55:09.603758+0000 mgr.y (mgr.14146) 317 : cluster [DBG] pgmap v283: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:11.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:11 smithi033 bash[14790]: cluster 2021-07-26T15:55:09.603758+0000 mgr.y (mgr.14146) 317 : cluster [DBG] pgmap v283: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:11.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:11 smithi096 bash[15117]: cluster 2021-07-26T15:55:09.603758+0000 mgr.y (mgr.14146) 317 : cluster [DBG] pgmap v283: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:12.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:12 smithi033 bash[14790]: cluster 2021-07-26T15:55:11.604473+0000 mgr.y (mgr.14146) 318 : cluster [DBG] pgmap v284: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:12.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:12 smithi033 bash[14790]: audit 2021-07-26T15:55:11.687135+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:55:12.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:12 smithi033 bash[14790]: audit 2021-07-26T15:55:11.690928+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:55:12.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:12 smithi033 bash[19094]: cluster 2021-07-26T15:55:11.604473+0000 mgr.y (mgr.14146) 318 : cluster [DBG] pgmap v284: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:12.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:12 smithi033 bash[19094]: audit 2021-07-26T15:55:11.687135+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:55:12.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:12 smithi033 bash[19094]: audit 2021-07-26T15:55:11.690928+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:55:12.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:12 smithi096 bash[15117]: cluster 2021-07-26T15:55:11.604473+0000 mgr.y (mgr.14146) 318 : cluster [DBG] pgmap v284: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:12.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:12 smithi096 bash[15117]: audit 2021-07-26T15:55:11.687135+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:55:12.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:12 smithi096 bash[15117]: audit 2021-07-26T15:55:11.690928+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:55:14.189 INFO:teuthology.orchestra.run.smithi033.stdout:128849018933 2021-07-26T15:55:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:14 smithi033 bash[19094]: cluster 2021-07-26T15:55:13.605200+0000 mgr.y (mgr.14146) 319 : cluster [DBG] pgmap v285: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:14 smithi033 bash[19094]: audit 2021-07-26T15:55:14.187486+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.33:0/3612612634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-07-26T15:55:14.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:14 smithi033 bash[14790]: cluster 2021-07-26T15:55:13.605200+0000 mgr.y (mgr.14146) 319 : cluster [DBG] pgmap v285: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:14.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:14 smithi033 bash[14790]: audit 2021-07-26T15:55:14.187486+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.33:0/3612612634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-07-26T15:55:14.889 INFO:tasks.cephadm.ceph_manager.ceph:need seq 128849018922 got 128849018933 for osd.4 2021-07-26T15:55:14.890 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-07-26T15:55:14.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:14 smithi096 bash[15117]: cluster 2021-07-26T15:55:13.605200+0000 mgr.y (mgr.14146) 319 : cluster [DBG] pgmap v285: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:14.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:14 smithi096 bash[15117]: audit 2021-07-26T15:55:14.187486+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.33:0/3612612634' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-07-26T15:55:16.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:16 smithi033 bash[14790]: cluster 2021-07-26T15:55:15.605851+0000 mgr.y (mgr.14146) 320 : cluster [DBG] pgmap v286: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:16.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:16 smithi033 bash[19094]: cluster 2021-07-26T15:55:15.605851+0000 mgr.y (mgr.14146) 320 : cluster [DBG] pgmap v286: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:16.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:16 smithi096 bash[15117]: cluster 2021-07-26T15:55:15.605851+0000 mgr.y (mgr.14146) 320 : cluster [DBG] pgmap v286: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:17.672 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:55:19.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:19 smithi033 bash[14790]: cluster 2021-07-26T15:55:17.606546+0000 mgr.y (mgr.14146) 321 : cluster [DBG] pgmap v287: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:19.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:19 smithi033 bash[19094]: cluster 2021-07-26T15:55:17.606546+0000 mgr.y (mgr.14146) 321 : cluster [DBG] pgmap v287: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:19.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:19 smithi096 bash[15117]: cluster 2021-07-26T15:55:17.606546+0000 mgr.y (mgr.14146) 321 : cluster [DBG] pgmap v287: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:21.054 INFO:teuthology.orchestra.run.smithi033.stdout:154618822704 2021-07-26T15:55:21.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:21 smithi033 bash[14790]: cluster 2021-07-26T15:55:19.607300+0000 mgr.y (mgr.14146) 322 : cluster [DBG] pgmap v288: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:21.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:21 smithi033 bash[14790]: audit 2021-07-26T15:55:21.052523+0000 mon.a (mon.0) 629 : audit [DBG] from='client.? 172.21.15.33:0/137690929' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-07-26T15:55:21.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:21 smithi033 bash[19094]: cluster 2021-07-26T15:55:19.607300+0000 mgr.y (mgr.14146) 322 : cluster [DBG] pgmap v288: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:21.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:21 smithi033 bash[19094]: audit 2021-07-26T15:55:21.052523+0000 mon.a (mon.0) 629 : audit [DBG] from='client.? 172.21.15.33:0/137690929' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-07-26T15:55:21.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:21 smithi096 bash[15117]: cluster 2021-07-26T15:55:19.607300+0000 mgr.y (mgr.14146) 322 : cluster [DBG] pgmap v288: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:21.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:21 smithi096 bash[15117]: audit 2021-07-26T15:55:21.052523+0000 mon.a (mon.0) 629 : audit [DBG] from='client.? 172.21.15.33:0/137690929' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-07-26T15:55:21.763 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822693 got 154618822704 for osd.5 2021-07-26T15:55:21.764 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-07-26T15:55:23.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:23 smithi033 bash[14790]: cluster 2021-07-26T15:55:21.608027+0000 mgr.y (mgr.14146) 323 : cluster [DBG] pgmap v289: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:23.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:23 smithi033 bash[19094]: cluster 2021-07-26T15:55:21.608027+0000 mgr.y (mgr.14146) 323 : cluster [DBG] pgmap v289: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:23.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:23 smithi096 bash[15117]: cluster 2021-07-26T15:55:21.608027+0000 mgr.y (mgr.14146) 323 : cluster [DBG] pgmap v289: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:24.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:24 smithi033 bash[14790]: cluster 2021-07-26T15:55:23.608680+0000 mgr.y (mgr.14146) 324 : cluster [DBG] pgmap v290: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:24.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:24 smithi033 bash[19094]: cluster 2021-07-26T15:55:23.608680+0000 mgr.y (mgr.14146) 324 : cluster [DBG] pgmap v290: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:24.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:24 smithi096 bash[15117]: cluster 2021-07-26T15:55:23.608680+0000 mgr.y (mgr.14146) 324 : cluster [DBG] pgmap v290: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:24.540 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:55:26.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:26 smithi033 bash[14790]: cluster 2021-07-26T15:55:25.609369+0000 mgr.y (mgr.14146) 325 : cluster [DBG] pgmap v291: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:26.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:26 smithi033 bash[19094]: cluster 2021-07-26T15:55:25.609369+0000 mgr.y (mgr.14146) 325 : cluster [DBG] pgmap v291: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:26.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:26 smithi096 bash[15117]: cluster 2021-07-26T15:55:25.609369+0000 mgr.y (mgr.14146) 325 : cluster [DBG] pgmap v291: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:28.023 INFO:teuthology.orchestra.run.smithi033.stdout:180388626477 2021-07-26T15:55:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:28 smithi033 bash[19094]: audit 2021-07-26T15:55:28.022023+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.33:0/4094907753' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-07-26T15:55:28.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:28 smithi033 bash[14790]: audit 2021-07-26T15:55:28.022023+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.33:0/4094907753' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-07-26T15:55:28.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:28 smithi096 bash[15117]: audit 2021-07-26T15:55:28.022023+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.33:0/4094907753' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-07-26T15:55:28.702 INFO:tasks.cephadm.ceph_manager.ceph:need seq 180388626466 got 180388626477 for osd.6 2021-07-26T15:55:28.703 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-07-26T15:55:29.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:29 smithi033 bash[14790]: cluster 2021-07-26T15:55:27.610050+0000 mgr.y (mgr.14146) 326 : cluster [DBG] pgmap v292: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:29.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:29 smithi033 bash[19094]: cluster 2021-07-26T15:55:27.610050+0000 mgr.y (mgr.14146) 326 : cluster [DBG] pgmap v292: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:29.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:29 smithi096 bash[15117]: cluster 2021-07-26T15:55:27.610050+0000 mgr.y (mgr.14146) 326 : cluster [DBG] pgmap v292: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:30.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:30 smithi033 bash[14790]: cluster 2021-07-26T15:55:29.610683+0000 mgr.y (mgr.14146) 327 : cluster [DBG] pgmap v293: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:30.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:30 smithi033 bash[19094]: cluster 2021-07-26T15:55:29.610683+0000 mgr.y (mgr.14146) 327 : cluster [DBG] pgmap v293: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:30.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:30 smithi096 bash[15117]: cluster 2021-07-26T15:55:29.610683+0000 mgr.y (mgr.14146) 327 : cluster [DBG] pgmap v293: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:31.473 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:55:33.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:33 smithi033 bash[19094]: cluster 2021-07-26T15:55:31.611397+0000 mgr.y (mgr.14146) 328 : cluster [DBG] pgmap v294: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:33.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:33 smithi033 bash[14790]: cluster 2021-07-26T15:55:31.611397+0000 mgr.y (mgr.14146) 328 : cluster [DBG] pgmap v294: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:33.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:33 smithi096 bash[15117]: cluster 2021-07-26T15:55:31.611397+0000 mgr.y (mgr.14146) 328 : cluster [DBG] pgmap v294: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:34.938 INFO:teuthology.orchestra.run.smithi033.stdout:206158430249 2021-07-26T15:55:35.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:35 smithi033 bash[19094]: cluster 2021-07-26T15:55:33.612118+0000 mgr.y (mgr.14146) 329 : cluster [DBG] pgmap v295: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:35.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:35 smithi033 bash[19094]: audit 2021-07-26T15:55:34.936223+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.33:0/4140623656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-07-26T15:55:35.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:35 smithi033 bash[14790]: cluster 2021-07-26T15:55:33.612118+0000 mgr.y (mgr.14146) 329 : cluster [DBG] pgmap v295: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:35.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:35 smithi033 bash[14790]: audit 2021-07-26T15:55:34.936223+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.33:0/4140623656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-07-26T15:55:35.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:35 smithi096 bash[15117]: cluster 2021-07-26T15:55:33.612118+0000 mgr.y (mgr.14146) 329 : cluster [DBG] pgmap v295: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:35.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:35 smithi096 bash[15117]: audit 2021-07-26T15:55:34.936223+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.33:0/4140623656' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-07-26T15:55:35.648 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430238 got 206158430249 for osd.7 2021-07-26T15:55:35.649 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-07-26T15:55:35.649 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph pg dump --format=json 2021-07-26T15:55:37.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:37 smithi033 bash[14790]: cluster 2021-07-26T15:55:35.612801+0000 mgr.y (mgr.14146) 330 : cluster [DBG] pgmap v296: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:37.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:37 smithi033 bash[19094]: cluster 2021-07-26T15:55:35.612801+0000 mgr.y (mgr.14146) 330 : cluster [DBG] pgmap v296: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:37.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:37 smithi096 bash[15117]: cluster 2021-07-26T15:55:35.612801+0000 mgr.y (mgr.14146) 330 : cluster [DBG] pgmap v296: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:38.419 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:55:38.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:38 smithi033 bash[19094]: cluster 2021-07-26T15:55:37.613453+0000 mgr.y (mgr.14146) 331 : cluster [DBG] pgmap v297: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:38.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:38 smithi033 bash[14790]: cluster 2021-07-26T15:55:37.613453+0000 mgr.y (mgr.14146) 331 : cluster [DBG] pgmap v297: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:38.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:38 smithi096 bash[15117]: cluster 2021-07-26T15:55:37.613453+0000 mgr.y (mgr.14146) 331 : cluster [DBG] pgmap v297: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:40.707 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:40 smithi033 bash[19094]: cluster 2021-07-26T15:55:39.614137+0000 mgr.y (mgr.14146) 332 : cluster [DBG] pgmap v298: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:40 smithi033 bash[14790]: cluster 2021-07-26T15:55:39.614137+0000 mgr.y (mgr.14146) 332 : cluster [DBG] pgmap v298: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:40.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:40 smithi096 bash[15117]: cluster 2021-07-26T15:55:39.614137+0000 mgr.y (mgr.14146) 332 : cluster [DBG] pgmap v298: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:41.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2021-07-26T15:55:41.914 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2021-07-26T15:55:41.939 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:41 smithi033 bash[19094]: audit 2021-07-26T15:55:41.175572+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:55:41.940 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:41 smithi033 bash[19094]: audit 2021-07-26T15:55:41.178636+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:55:41.941 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:41 smithi033 bash[19094]: audit 2021-07-26T15:55:41.180527+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:55:41.941 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:41 smithi033 bash[19094]: audit 2021-07-26T15:55:41.442303+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:55:41.942 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:41 smithi033 bash[14790]: audit 2021-07-26T15:55:41.175572+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:55:41.942 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:41 smithi033 bash[14790]: audit 2021-07-26T15:55:41.178636+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:55:41.942 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:41 smithi033 bash[14790]: audit 2021-07-26T15:55:41.180527+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:55:41.943 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:41 smithi033 bash[14790]: audit 2021-07-26T15:55:41.442303+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:55:41.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:41 smithi096 bash[15117]: audit 2021-07-26T15:55:41.175572+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:55:41.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:41 smithi096 bash[15117]: audit 2021-07-26T15:55:41.178636+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:55:41.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:41 smithi096 bash[15117]: audit 2021-07-26T15:55:41.180527+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:55:41.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:41 smithi096 bash[15117]: audit 2021-07-26T15:55:41.442303+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:55:42.623 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2021-07-26T15:55:41.614394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":44056,"kb_used_data":4120,"kb_used_omap":0,"kb_used_meta":39872,"kb_avail":749917160,"statfs":{"total":767960285184,"available":767915171840,"internally_reserved":0,"allocated":4218880,"data_stored":1703794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40828928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.133759+0000","last_change":"2021-07-26T15:52:54.140877+0000","last_active":"2021-07-26T15:52:56.133759+0000","last_peered":"2021-07-26T15:52:56.133759+0000","last_clean":"2021-07-26T15:52:56.133759+0000","last_became_active":"2021-07-26T15:52:54.140341+0000","last_became_peered":"2021-07-26T15:52:54.140341+0000","last_unstale":"2021-07-26T15:52:56.133759+0000","last_undegraded":"2021-07-26T15:52:56.133759+0000","last_fullsized":"2021-07-26T15:52:56.133759+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:55.140134+0000","last_change":"2021-07-26T15:52:54.268535+0000","last_active":"2021-07-26T15:52:55.140134+0000","last_peered":"2021-07-26T15:52:55.140134+0000","last_clean":"2021-07-26T15:52:55.140134+0000","last_became_active":"2021-07-26T15:52:54.267667+0000","last_became_peered":"2021-07-26T15:52:54.267667+0000","last_unstale":"2021-07-26T15:52:55.140134+0000","last_undegraded":"2021-07-26T15:52:55.140134+0000","last_fullsized":"2021-07-26T15:52:55.140134+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.134071+0000","last_change":"2021-07-26T15:52:54.268676+0000","last_active":"2021-07-26T15:52:56.134071+0000","last_peered":"2021-07-26T15:52:56.134071+0000","last_clean":"2021-07-26T15:52:56.134071+0000","last_became_active":"2021-07-26T15:52:54.267536+0000","last_became_peered":"2021-07-26T15:52:54.267536+0000","last_unstale":"2021-07-26T15:52:56.134071+0000","last_undegraded":"2021-07-26T15:52:56.134071+0000","last_fullsized":"2021-07-26T15:52:56.134071+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.134000+0000","last_change":"2021-07-26T15:52:54.141381+0000","last_active":"2021-07-26T15:52:56.134000+0000","last_peered":"2021-07-26T15:52:56.134000+0000","last_clean":"2021-07-26T15:52:56.134000+0000","last_became_active":"2021-07-26T15:52:54.140487+0000","last_became_peered":"2021-07-26T15:52:54.140487+0000","last_unstale":"2021-07-26T15:52:56.134000+0000","last_undegraded":"2021-07-26T15:52:56.134000+0000","last_fullsized":"2021-07-26T15:52:56.134000+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.133982+0000","last_change":"2021-07-26T15:52:21.242070+0000","last_active":"2021-07-26T15:52:56.133982+0000","last_peered":"2021-07-26T15:52:56.133982+0000","last_clean":"2021-07-26T15:52:56.133982+0000","last_became_active":"2021-07-26T15:52:21.241133+0000","last_became_peered":"2021-07-26T15:52:21.241133+0000","last_unstale":"2021-07-26T15:52:56.133982+0000","last_undegraded":"2021-07-26T15:52:56.133982+0000","last_fullsized":"2021-07-26T15:52:56.133982+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:50:12.120754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:50:12.120754+0000","last_clean_scrub_stamp":"2021-07-26T15:50:12.120754+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.133358+0000","last_change":"2021-07-26T15:52:54.140398+0000","last_active":"2021-07-26T15:52:56.133358+0000","last_peered":"2021-07-26T15:52:56.133358+0000","last_clean":"2021-07-26T15:52:56.133358+0000","last_became_active":"2021-07-26T15:52:54.139913+0000","last_became_peered":"2021-07-26T15:52:54.139913+0000","last_unstale":"2021-07-26T15:52:56.133358+0000","last_undegraded":"2021-07-26T15:52:56.133358+0000","last_fullsized":"2021-07-26T15:52:56.133358+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:55.140366+0000","last_change":"2021-07-26T15:52:54.553767+0000","last_active":"2021-07-26T15:52:55.140366+0000","last_peered":"2021-07-26T15:52:55.140366+0000","last_clean":"2021-07-26T15:52:55.140366+0000","last_became_active":"2021-07-26T15:52:54.553146+0000","last_became_peered":"2021-07-26T15:52:54.553146+0000","last_unstale":"2021-07-26T15:52:55.140366+0000","last_undegraded":"2021-07-26T15:52:55.140366+0000","last_fullsized":"2021-07-26T15:52:55.140366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.133239+0000","last_change":"2021-07-26T15:52:54.140566+0000","last_active":"2021-07-26T15:52:56.133239+0000","last_peered":"2021-07-26T15:52:56.133239+0000","last_clean":"2021-07-26T15:52:56.133239+0000","last_became_active":"2021-07-26T15:52:54.139777+0000","last_became_peered":"2021-07-26T15:52:54.139777+0000","last_unstale":"2021-07-26T15:52:56.133239+0000","last_undegraded":"2021-07-26T15:52:56.133239+0000","last_fullsized":"2021-07-26T15:52:56.133239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:55.140104+0000","last_change":"2021-07-26T15:52:54.139520+0000","last_active":"2021-07-26T15:52:55.140104+0000","last_peered":"2021-07-26T15:52:55.140104+0000","last_clean":"2021-07-26T15:52:55.140104+0000","last_became_active":"2021-07-26T15:52:54.139051+0000","last_became_peered":"2021-07-26T15:52:54.139051+0000","last_unstale":"2021-07-26T15:52:55.140104+0000","last_undegraded":"2021-07-26T15:52:55.140104+0000","last_fullsized":"2021-07-26T15:52:55.140104+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430251,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5320,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93739832,"statfs":{"total":95995035648,"available":95989587968,"internally_reserved":0,"allocated":524288,"data_stored":212738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.93600000000000005,"15min":0.92300000000000004},"min":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.284,"5min":1.498,"15min":1.498},"last":1},{"interface":"front","average":{"1min":1.03,"5min":0.95499999999999996,"15min":0.93500000000000005},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.92000000000000004}]},{"osd":1,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.96899999999999997,"15min":0.95399999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.417,"5min":1.454,"15min":1.454},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.002,"15min":1.012},"min":{"1min":0.68899999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.82599999999999996}]},{"osd":2,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.96399999999999997,"15min":0.95799999999999996},"min":{"1min":0.71299999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.206},{"interface":"front","average":{"1min":0.997,"5min":1.0569999999999999,"15min":1.0720000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.79100000000000004}]},{"osd":3,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.995,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.171,"5min":1.407,"15min":1.407},"last":1.266},{"interface":"front","average":{"1min":1.105,"5min":1.115,"15min":1.121},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.96299999999999997}]},{"osd":4,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97999999999999998,"15min":0.98299999999999998},"min":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.333,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.024,"5min":1.0409999999999999,"15min":1.04},"min":{"1min":0.73299999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3460000000000001,"5min":1.373,"15min":1.373},"last":1.1279999999999999}]},{"osd":5,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0820000000000001},"min":{"1min":0.71899999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3580000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.048},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.85699999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.522,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.98699999999999999}]},{"osd":6,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.204,"15min":1.1950000000000001},"min":{"1min":0.92700000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.5760000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.077},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1950000000000001,"15min":1.1890000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.542,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.325}]}]},{"osd":6,"up_from":42,"seq":180388626480,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5384,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739768,"statfs":{"total":95995035648,"available":95989522432,"internally_reserved":0,"allocated":524288,"data_stored":212738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.91800000000000004,"15min":0.92000000000000004},"min":{"1min":0.60499999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1970000000000001,"5min":1.456,"15min":1.456},"last":0.871},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.016,"15min":1.038},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.454,"5min":2.8759999999999999,"15min":2.8759999999999999},"last":0.91800000000000004}]},{"osd":1,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.96099999999999997,"15min":0.96999999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.214,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.71399999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3149999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.2110000000000001}]},{"osd":2,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.98299999999999998,"15min":0.98499999999999999},"min":{"1min":0.72899999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.375,"5min":1.659,"15min":1.659},"last":1.008},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0820000000000001,"15min":1.1100000000000001},"min":{"1min":0.76400000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.341,"5min":3.0539999999999998,"15min":3.0539999999999998},"last":0.74199999999999999}]},{"osd":3,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.028,"15min":1.0569999999999999},"min":{"1min":0.78800000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.137,"5min":3.1320000000000001,"15min":3.1320000000000001},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0960000000000001,"15min":1.0880000000000001},"min":{"1min":0.68100000000000005,"5min":0.623,"15min":0.623},"max":{"1min":1.421,"5min":2.794,"15min":2.794},"last":1.107}]},{"osd":4,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0940000000000001,"15min":1.1160000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3680000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1220000000000001,"15min":1.1539999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3500000000000001,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.0349999999999999}]},{"osd":5,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1910000000000001,"15min":1.214},"min":{"1min":0.78400000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.423,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.25,"15min":1.272},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3899999999999999,"5min":3.875,"15min":3.875},"last":1.1399999999999999}]},{"osd":7,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.254,"15min":1.2669999999999999},"min":{"1min":0.89300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.496,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.169},{"interface":"front","average":{"1min":1.218,"5min":1.2949999999999999,"15min":1.3280000000000001},"min":{"1min":0.96299999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.3919999999999999,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.2330000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5644,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739508,"statfs":{"total":95995035648,"available":95989256192,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:54:58 2021","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73999999999999999,"15min":0.629},"min":{"1min":0.59499999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.0780000000000001,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.81699999999999995,"15min":0.69699999999999995},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.85699999999999998}]},{"osd":2,"last update":"Mon Jul 26 15:55:20 2021","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.83499999999999996,"15min":0.76100000000000001},"min":{"1min":0.53100000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.252,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90900000000000003,"15min":0.82199999999999995},"min":{"1min":0.622,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3340000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.99399999999999999}]},{"osd":3,"last update":"Mon Jul 26 15:54:44 2021","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.88,"15min":0.84499999999999997},"min":{"1min":0.70199999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.024},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.95099999999999996,"15min":0.90700000000000003},"min":{"1min":0.78600000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.284,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0489999999999999}]},{"osd":4,"last update":"Mon Jul 26 15:55:10 2021","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1200000000000001,"15min":1.0840000000000001},"min":{"1min":0.95099999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.407,"5min":1.736,"15min":1.736},"last":1.506},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1459999999999999,"15min":1.0980000000000001},"min":{"1min":0.80200000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.458,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.425}]},{"osd":5,"last update":"Mon Jul 26 15:55:35 2021","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2130000000000001,"15min":1.1579999999999999},"min":{"1min":0.94999999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7070000000000001,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.365},{"interface":"front","average":{"1min":1.238,"5min":1.244,"15min":1.224},"min":{"1min":1.0269999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.544,"5min":1.627,"15min":1.627},"last":1.1659999999999999}]},{"osd":6,"last update":"Mon Jul 26 15:54:58 2021","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3089999999999999,"15min":1.27},"min":{"1min":1.022,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.706,"5min":1.865,"15min":1.865},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.325,"5min":1.339,"15min":1.3120000000000001},"min":{"1min":1.1439999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.784,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":1.3}]},{"osd":7,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.3939999999999999,"15min":1.3999999999999999},"min":{"1min":1.0289999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.645,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3879999999999999,"15min":1.3759999999999999},"min":{"1min":1.2030000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.569,"5min":1.857,"15min":1.857},"last":1.6160000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5708,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739444,"statfs":{"total":95995035648,"available":95989190656,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jul 26 15:54:56 2021","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69499999999999995,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0549999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.80000000000000004,"15min":0.70999999999999996},"min":{"1min":0.52300000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.93400000000000005}]},{"osd":2,"last update":"Mon Jul 26 15:55:22 2021","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.74199999999999999},"min":{"1min":0.53500000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0980000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.90200000000000002,"15min":0.85199999999999998},"min":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3819999999999999,"5min":1.496,"15min":1.496},"last":0.75900000000000001}]},{"osd":3,"last update":"Mon Jul 26 15:54:46 2021","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93500000000000005,"15min":0.89000000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.298,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.91900000000000004,"15min":0.89200000000000002},"min":{"1min":0.69799999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6080000000000001,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.86099999999999999}]},{"osd":4,"last update":"Mon Jul 26 15:55:06 2021","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.048,"15min":1.0069999999999999},"min":{"1min":0.79800000000000004,"5min":0.747,"15min":0.747},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1599999999999999,"15min":1.1579999999999999},"min":{"1min":0.91000000000000003,"5min":0.747,"15min":0.747},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.016}]},{"osd":5,"last update":"Mon Jul 26 15:55:30 2021","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1559999999999999,"15min":1.133},"min":{"1min":0.94399999999999995,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.4430000000000001,"5min":2.597,"15min":2.597},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.1910000000000001,"15min":1.1679999999999999},"min":{"1min":0.95299999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.661,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.52}]},{"osd":6,"last update":"Mon Jul 26 15:55:02 2021","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2669999999999999,"15min":1.2549999999999999},"min":{"1min":0.95399999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7130000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.306}]},{"osd":7,"last update":"Mon Jul 26 15:55:22 2021","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2989999999999999,"15min":1.286},"min":{"1min":0.996,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.611,"5min":2.056,"15min":2.056},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3620000000000001,"15min":1.3720000000000001},"min":{"1min":0.91200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.655,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.21}]}]},{"osd":2,"up_from":18,"seq":77309411397,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5580,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739572,"statfs":{"total":95995035648,"available":95989321728,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:55:20 2021","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76500000000000001,"15min":0.69899999999999995},"min":{"1min":0.61199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1299999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80900000000000005,"15min":0.71899999999999997},"min":{"1min":0.66500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.0600000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.85299999999999998}]},{"osd":1,"last update":"Mon Jul 26 15:55:20 2021","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.90700000000000003,"15min":0.78500000000000003},"min":{"1min":0.70599999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.383,"5min":1.647,"15min":1.647},"last":1.052},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.85599999999999998,"15min":0.77400000000000002},"min":{"1min":0.73799999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.2270000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.97799999999999998}]},{"osd":3,"last update":"Mon Jul 26 15:54:47 2021","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.95699999999999996,"15min":0.90300000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.333,"5min":1.546,"15min":1.546},"last":1.294},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.97999999999999998,"15min":0.93999999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.45,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":1.121}]},{"osd":4,"last update":"Mon Jul 26 15:55:16 2021","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.115,"15min":1.087},"min":{"1min":0.89000000000000001,"5min":0.625,"15min":0.625},"max":{"1min":1.3240000000000001,"5min":2.907,"15min":2.907},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.208,"15min":1.153},"min":{"1min":0.94299999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5589999999999999,"5min":1.843,"15min":1.843},"last":1.546}]},{"osd":5,"last update":"Mon Jul 26 15:55:34 2021","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.272,"15min":1.244},"min":{"1min":0.96699999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6799999999999999,"5min":2.121,"15min":2.121},"last":1.643},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1419999999999999,"15min":1.127},"min":{"1min":0.88300000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.089}]},{"osd":6,"last update":"Mon Jul 26 15:55:02 2021","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2789999999999999,"15min":1.286},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6020000000000001,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.516},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2849999999999999,"15min":1.2769999999999999},"min":{"1min":0.97899999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.3240000000000001}]},{"osd":7,"last update":"Mon Jul 26 15:55:28 2021","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3480000000000001,"15min":1.369},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.569,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.373},{"interface":"front","average":{"1min":1.401,"5min":1.423,"15min":1.431},"min":{"1min":1.1319999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.7629999999999999,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.742}]}]},{"osd":3,"up_from":25,"seq":107374182463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5516,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739636,"statfs":{"total":95995035648,"available":95989387264,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:54:49 2021","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.72999999999999998,"15min":0.69099999999999995},"min":{"1min":0.55300000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1879999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.92100000000000004}]},{"osd":1,"last update":"Mon Jul 26 15:54:49 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88800000000000001,"15min":0.84599999999999997},"min":{"1min":0.68000000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.405,"5min":1.647,"15min":1.647},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.089,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.67100000000000004}]},{"osd":2,"last update":"Mon Jul 26 15:54:49 2021","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.86599999999999999,"15min":0.84299999999999997},"min":{"1min":0.67800000000000005,"5min":0.623,"15min":0.623},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90700000000000003,"15min":0.85099999999999998},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.466,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.0129999999999999}]},{"osd":4,"last update":"Mon Jul 26 15:55:10 2021","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.075,"15min":1.038},"min":{"1min":0.73699999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.504,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.119,"5min":1.0669999999999999,"15min":1.0609999999999999},"min":{"1min":0.84799999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.95399999999999996}]},{"osd":5,"last update":"Mon Jul 26 15:54:38 2021","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.1719999999999999,"15min":1.1539999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.573,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.206,"5min":1.1819999999999999,"15min":1.1890000000000001},"min":{"1min":0.92900000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.54,"5min":1.625,"15min":1.625},"last":1.0629999999999999}]},{"osd":6,"last update":"Mon Jul 26 15:54:56 2021","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3,"15min":1.325},"min":{"1min":1.002,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.7509999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.302,"15min":1.2829999999999999},"min":{"1min":1.135,"5min":1,"15min":1},"max":{"1min":1.6739999999999999,"5min":1.712,"15min":1.712},"last":1.246}]},{"osd":7,"last update":"Mon Jul 26 15:55:21 2021","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3740000000000001},"min":{"1min":1.071,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.748,"5min":1.786,"15min":1.786},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.3540000000000001,"15min":1.371},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.304}]}]},{"osd":4,"up_from":30,"seq":128849018939,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5452,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739700,"statfs":{"total":95995035648,"available":95989452800,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88400000000000001,"15min":0.84099999999999997},"min":{"1min":0.68600000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2030000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.996,"5min":0.91400000000000003,"15min":0.89400000000000002},"min":{"1min":0.69699999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.90900000000000003}]},{"osd":1,"last update":"Mon Jul 26 15:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91200000000000003,"15min":0.878},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.234,"5min":1.417,"15min":1.417},"last":1.04},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.95099999999999996,"15min":0.94099999999999995},"min":{"1min":0.70399999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.73499999999999999}]},{"osd":2,"last update":"Mon Jul 26 15:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.95599999999999996,"15min":0.93999999999999995},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3320000000000001,"5min":1.341,"15min":1.341},"last":0.98499999999999999},{"interface":"front","average":{"1min":1.04,"5min":0.99199999999999999,"15min":0.97499999999999998},"min":{"1min":0.751,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.335,"5min":1.383,"15min":1.383},"last":0.81799999999999995}]},{"osd":3,"last update":"Mon Jul 26 15:55:09 2021","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.98399999999999999,"15min":0.95499999999999996},"min":{"1min":0.70599999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":1.018},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1100000000000001,"15min":1.1259999999999999},"min":{"1min":0.92400000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.268,"5min":3.27,"15min":3.27},"last":1.165}]},{"osd":5,"last update":"Mon Jul 26 15:55:32 2021","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.95799999999999996,"15min":0.96399999999999997},"min":{"1min":0.68999999999999995,"5min":0.624,"15min":0.624},"max":{"1min":1.2130000000000001,"5min":1.369,"15min":1.369},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.056,"5min":0.99399999999999999,"15min":0.94299999999999995},"min":{"1min":0.70199999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.345,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.079}]},{"osd":6,"last update":"Mon Jul 26 15:54:58 2021","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.786,"15min":2.0920000000000001},"min":{"1min":0.81200000000000006,"5min":0.624,"15min":0.624},"max":{"1min":1.286,"5min":22.518000000000001,"15min":22.518000000000001},"last":1.244},{"interface":"front","average":{"1min":1.155,"5min":1.895,"15min":2.2050000000000001},"min":{"1min":0.95199999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4910000000000001,"5min":23.016999999999999,"15min":23.016999999999999},"last":1.194}]},{"osd":7,"last update":"Mon Jul 26 15:55:21 2021","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.121,"15min":1.1259999999999999},"min":{"1min":0.90600000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.4490000000000001,"5min":1.573,"15min":1.573},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.94999999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.516,"5min":1.518,"15min":1.518},"last":1.119}]}]},{"osd":5,"up_from":36,"seq":154618822708,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5452,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739700,"statfs":{"total":95995035648,"available":95989452800,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:55:36 2021","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.875,"15min":0.84899999999999998},"min":{"1min":0.73199999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1659999999999999,"5min":1.383,"15min":1.383},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.99199999999999999,"15min":1.006},"min":{"1min":0.755,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3160000000000001,"5min":1.508,"15min":1.508},"last":1.129}]},{"osd":1,"last update":"Mon Jul 26 15:55:36 2021","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.97299999999999998,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94699999999999995,"15min":0.93600000000000005},"min":{"1min":0.68500000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.242,"5min":1.302,"15min":1.302},"last":0.97999999999999998}]},{"osd":2,"last update":"Mon Jul 26 15:55:36 2021","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.95899999999999996,"15min":0.96799999999999997},"min":{"1min":0.80100000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.28,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0509999999999999,"15min":1.0349999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3560000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.22}]},{"osd":3,"last update":"Mon Jul 26 15:55:36 2021","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.002,"15min":1.002},"min":{"1min":0.73099999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1990000000000001,"5min":1.738,"15min":1.738},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.107,"15min":1.0860000000000001},"min":{"1min":0.82099999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.48,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.2849999999999999}]},{"osd":4,"last update":"Mon Jul 26 15:55:36 2021","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92100000000000004,"15min":0.92800000000000005},"min":{"1min":0.60699999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98499999999999999,"15min":0.996},"min":{"1min":0.65700000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.29,"5min":1.571,"15min":1.571},"last":0.92700000000000005}]},{"osd":6,"last update":"Mon Jul 26 15:54:58 2021","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.073,"15min":1.093},"min":{"1min":0.74099999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.216,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.028},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.115,"15min":1.1259999999999999},"min":{"1min":0.91800000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.341,"5min":1.738,"15min":1.738},"last":1.1879999999999999}]},{"osd":7,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1479999999999999,"15min":1.1699999999999999},"min":{"1min":0.71399999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.4319999999999999,"5min":1.621,"15min":1.621},"last":1.343},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.1120000000000001,"15min":1.135},"min":{"1min":0.82599999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4550000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.099}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-07-26T15:55:42.626 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph pg dump --format=json 2021-07-26T15:55:43.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:43 smithi033 bash[14790]: cluster 2021-07-26T15:55:41.614738+0000 mgr.y (mgr.14146) 333 : cluster [DBG] pgmap v299: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:43.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:43 smithi033 bash[14790]: audit 2021-07-26T15:55:41.900036+0000 mgr.y (mgr.14146) 334 : audit [DBG] from='client.24502 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-07-26T15:55:43.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:43 smithi033 bash[19094]: cluster 2021-07-26T15:55:41.614738+0000 mgr.y (mgr.14146) 333 : cluster [DBG] pgmap v299: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:43.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:43 smithi033 bash[19094]: audit 2021-07-26T15:55:41.900036+0000 mgr.y (mgr.14146) 334 : audit [DBG] from='client.24502 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-07-26T15:55:43.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:43 smithi096 bash[15117]: cluster 2021-07-26T15:55:41.614738+0000 mgr.y (mgr.14146) 333 : cluster [DBG] pgmap v299: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:43.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:43 smithi096 bash[15117]: audit 2021-07-26T15:55:41.900036+0000 mgr.y (mgr.14146) 334 : audit [DBG] from='client.24502 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-07-26T15:55:45.416 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:55:45.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:45 smithi033 bash[19094]: cluster 2021-07-26T15:55:43.615388+0000 mgr.y (mgr.14146) 335 : cluster [DBG] pgmap v300: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:45.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:45 smithi033 bash[14790]: cluster 2021-07-26T15:55:43.615388+0000 mgr.y (mgr.14146) 335 : cluster [DBG] pgmap v300: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:45 smithi096 bash[15117]: cluster 2021-07-26T15:55:43.615388+0000 mgr.y (mgr.14146) 335 : cluster [DBG] pgmap v300: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:47.441 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:47 smithi033 bash[14790]: cluster 2021-07-26T15:55:45.616111+0000 mgr.y (mgr.14146) 336 : cluster [DBG] pgmap v301: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:47.442 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:47 smithi033 bash[19094]: cluster 2021-07-26T15:55:45.616111+0000 mgr.y (mgr.14146) 336 : cluster [DBG] pgmap v301: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:47.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:47 smithi096 bash[15117]: cluster 2021-07-26T15:55:45.616111+0000 mgr.y (mgr.14146) 336 : cluster [DBG] pgmap v301: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:48.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:48 smithi033 bash[14790]: cluster 2021-07-26T15:55:47.616710+0000 mgr.y (mgr.14146) 337 : cluster [DBG] pgmap v302: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:48.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:48 smithi033 bash[19094]: cluster 2021-07-26T15:55:47.616710+0000 mgr.y (mgr.14146) 337 : cluster [DBG] pgmap v302: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:48.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:48 smithi096 bash[15117]: cluster 2021-07-26T15:55:47.616710+0000 mgr.y (mgr.14146) 337 : cluster [DBG] pgmap v302: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:48.935 INFO:teuthology.orchestra.run.smithi033.stdout: 2021-07-26T15:55:48.937 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2021-07-26T15:55:49.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:49 smithi033 bash[14790]: audit 2021-07-26T15:55:48.922973+0000 mgr.y (mgr.14146) 338 : audit [DBG] from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-07-26T15:55:49.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:49 smithi033 bash[19094]: audit 2021-07-26T15:55:48.922973+0000 mgr.y (mgr.14146) 338 : audit [DBG] from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-07-26T15:55:49.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:49 smithi096 bash[15117]: audit 2021-07-26T15:55:48.922973+0000 mgr.y (mgr.14146) 338 : audit [DBG] from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-07-26T15:55:49.560 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2021-07-26T15:55:47.616399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":27,"acting":27,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":27,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":44056,"kb_used_data":4120,"kb_used_omap":0,"kb_used_meta":39872,"kb_avail":749917160,"statfs":{"total":767960285184,"available":767915171840,"internally_reserved":0,"allocated":4218880,"data_stored":1703794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40828928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.133759+0000","last_change":"2021-07-26T15:52:54.140877+0000","last_active":"2021-07-26T15:52:56.133759+0000","last_peered":"2021-07-26T15:52:56.133759+0000","last_clean":"2021-07-26T15:52:56.133759+0000","last_became_active":"2021-07-26T15:52:54.140341+0000","last_became_peered":"2021-07-26T15:52:54.140341+0000","last_unstale":"2021-07-26T15:52:56.133759+0000","last_undegraded":"2021-07-26T15:52:56.133759+0000","last_fullsized":"2021-07-26T15:52:56.133759+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:55.140134+0000","last_change":"2021-07-26T15:52:54.268535+0000","last_active":"2021-07-26T15:52:55.140134+0000","last_peered":"2021-07-26T15:52:55.140134+0000","last_clean":"2021-07-26T15:52:55.140134+0000","last_became_active":"2021-07-26T15:52:54.267667+0000","last_became_peered":"2021-07-26T15:52:54.267667+0000","last_unstale":"2021-07-26T15:52:55.140134+0000","last_undegraded":"2021-07-26T15:52:55.140134+0000","last_fullsized":"2021-07-26T15:52:55.140134+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.134071+0000","last_change":"2021-07-26T15:52:54.268676+0000","last_active":"2021-07-26T15:52:56.134071+0000","last_peered":"2021-07-26T15:52:56.134071+0000","last_clean":"2021-07-26T15:52:56.134071+0000","last_became_active":"2021-07-26T15:52:54.267536+0000","last_became_peered":"2021-07-26T15:52:54.267536+0000","last_unstale":"2021-07-26T15:52:56.134071+0000","last_undegraded":"2021-07-26T15:52:56.134071+0000","last_fullsized":"2021-07-26T15:52:56.134071+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.134000+0000","last_change":"2021-07-26T15:52:54.141381+0000","last_active":"2021-07-26T15:52:56.134000+0000","last_peered":"2021-07-26T15:52:56.134000+0000","last_clean":"2021-07-26T15:52:56.134000+0000","last_became_active":"2021-07-26T15:52:54.140487+0000","last_became_peered":"2021-07-26T15:52:54.140487+0000","last_unstale":"2021-07-26T15:52:56.134000+0000","last_undegraded":"2021-07-26T15:52:56.134000+0000","last_fullsized":"2021-07-26T15:52:56.134000+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.133982+0000","last_change":"2021-07-26T15:52:21.242070+0000","last_active":"2021-07-26T15:52:56.133982+0000","last_peered":"2021-07-26T15:52:56.133982+0000","last_clean":"2021-07-26T15:52:56.133982+0000","last_became_active":"2021-07-26T15:52:21.241133+0000","last_became_peered":"2021-07-26T15:52:21.241133+0000","last_unstale":"2021-07-26T15:52:56.133982+0000","last_undegraded":"2021-07-26T15:52:56.133982+0000","last_fullsized":"2021-07-26T15:52:56.133982+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:50:12.120754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:50:12.120754+0000","last_clean_scrub_stamp":"2021-07-26T15:50:12.120754+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.133358+0000","last_change":"2021-07-26T15:52:54.140398+0000","last_active":"2021-07-26T15:52:56.133358+0000","last_peered":"2021-07-26T15:52:56.133358+0000","last_clean":"2021-07-26T15:52:56.133358+0000","last_became_active":"2021-07-26T15:52:54.139913+0000","last_became_peered":"2021-07-26T15:52:54.139913+0000","last_unstale":"2021-07-26T15:52:56.133358+0000","last_undegraded":"2021-07-26T15:52:56.133358+0000","last_fullsized":"2021-07-26T15:52:56.133358+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:55.140366+0000","last_change":"2021-07-26T15:52:54.553767+0000","last_active":"2021-07-26T15:52:55.140366+0000","last_peered":"2021-07-26T15:52:55.140366+0000","last_clean":"2021-07-26T15:52:55.140366+0000","last_became_active":"2021-07-26T15:52:54.553146+0000","last_became_peered":"2021-07-26T15:52:54.553146+0000","last_unstale":"2021-07-26T15:52:55.140366+0000","last_undegraded":"2021-07-26T15:52:55.140366+0000","last_fullsized":"2021-07-26T15:52:55.140366+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:56.133239+0000","last_change":"2021-07-26T15:52:54.140566+0000","last_active":"2021-07-26T15:52:56.133239+0000","last_peered":"2021-07-26T15:52:56.133239+0000","last_clean":"2021-07-26T15:52:56.133239+0000","last_became_active":"2021-07-26T15:52:54.139777+0000","last_became_peered":"2021-07-26T15:52:54.139777+0000","last_unstale":"2021-07-26T15:52:56.133239+0000","last_undegraded":"2021-07-26T15:52:56.133239+0000","last_fullsized":"2021-07-26T15:52:56.133239+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":53,"state":"active+clean","last_fresh":"2021-07-26T15:52:55.140104+0000","last_change":"2021-07-26T15:52:54.139520+0000","last_active":"2021-07-26T15:52:55.140104+0000","last_peered":"2021-07-26T15:52:55.140104+0000","last_clean":"2021-07-26T15:52:55.140104+0000","last_became_active":"2021-07-26T15:52:54.139051+0000","last_became_peered":"2021-07-26T15:52:54.139051+0000","last_unstale":"2021-07-26T15:52:55.140104+0000","last_undegraded":"2021-07-26T15:52:55.140104+0000","last_fullsized":"2021-07-26T15:52:55.140104+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":48,"seq":206158430252,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5320,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93739832,"statfs":{"total":95995035648,"available":95989587968,"internally_reserved":0,"allocated":524288,"data_stored":212738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.93600000000000005,"15min":0.92300000000000004},"min":{"1min":0.61399999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.284,"5min":1.498,"15min":1.498},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.03,"5min":0.95499999999999996,"15min":0.93500000000000005},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.70399999999999996}]},{"osd":1,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.96899999999999997,"15min":0.95399999999999996},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.417,"5min":1.454,"15min":1.454},"last":0.746},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.002,"15min":1.012},"min":{"1min":0.68899999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.93799999999999994}]},{"osd":2,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.96399999999999997,"15min":0.95799999999999996},"min":{"1min":0.71299999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"last":1.014},{"interface":"front","average":{"1min":0.997,"5min":1.0569999999999999,"15min":1.0720000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.0800000000000001}]},{"osd":3,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.995,"15min":1.0029999999999999},"min":{"1min":0.71999999999999997,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.171,"5min":1.407,"15min":1.407},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.105,"5min":1.115,"15min":1.121},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.607,"5min":1.607,"15min":1.607},"last":0.98699999999999999}]},{"osd":4,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.97999999999999998,"15min":0.98299999999999998},"min":{"1min":0.71599999999999997,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.333,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.161},{"interface":"front","average":{"1min":1.024,"5min":1.0409999999999999,"15min":1.04},"min":{"1min":0.73299999999999998,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.3460000000000001,"5min":1.373,"15min":1.373},"last":1.099}]},{"osd":5,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0820000000000001},"min":{"1min":0.71899999999999997,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3580000000000001,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.85699999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.522,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":1.0449999999999999}]},{"osd":6,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.204,"15min":1.1950000000000001},"min":{"1min":0.92700000000000005,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.5760000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1950000000000001,"15min":1.1890000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.542,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.1839999999999999}]}]},{"osd":6,"up_from":42,"seq":180388626481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5384,"kb_used_data":512,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739768,"statfs":{"total":95995035648,"available":95989522432,"internally_reserved":0,"allocated":524288,"data_stored":212738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.91800000000000004,"15min":0.92000000000000004},"min":{"1min":0.60499999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1970000000000001,"5min":1.456,"15min":1.456},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":1.016,"15min":1.038},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.454,"5min":2.8759999999999999,"15min":2.8759999999999999},"last":1.2569999999999999}]},{"osd":1,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.96099999999999997,"15min":0.96999999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.214,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":1.091},{"interface":"front","average":{"1min":1.0069999999999999,"5min":0.94599999999999995,"15min":0.92800000000000005},"min":{"1min":0.71399999999999997,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.3149999999999999,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.216}]},{"osd":2,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.98299999999999998,"15min":0.98499999999999999},"min":{"1min":0.72899999999999998,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.375,"5min":1.659,"15min":1.659},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0820000000000001,"15min":1.1100000000000001},"min":{"1min":0.76400000000000001,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.341,"5min":3.0539999999999998,"15min":3.0539999999999998},"last":0.89800000000000002}]},{"osd":3,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":1.028,"15min":1.0569999999999999},"min":{"1min":0.78800000000000003,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.137,"5min":3.1320000000000001,"15min":3.1320000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0960000000000001,"15min":1.0880000000000001},"min":{"1min":0.68100000000000005,"5min":0.623,"15min":0.623},"max":{"1min":1.421,"5min":2.794,"15min":2.794},"last":1.1200000000000001}]},{"osd":4,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0940000000000001,"15min":1.1160000000000001},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3680000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1220000000000001,"15min":1.1539999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.3500000000000001,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.1859999999999999}]},{"osd":5,"last update":"Mon Jul 26 15:55:00 2021","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1910000000000001,"15min":1.214},"min":{"1min":0.78400000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.423,"5min":4.0090000000000003,"15min":4.0090000000000003},"last":1.163},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.25,"15min":1.272},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.3899999999999999,"5min":3.875,"15min":3.875},"last":1.2350000000000001}]},{"osd":7,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.254,"15min":1.2669999999999999},"min":{"1min":0.89300000000000002,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.496,"5min":2.2639999999999998,"15min":2.2639999999999998},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.2949999999999999,"15min":1.3280000000000001},"min":{"1min":0.96299999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.3919999999999999,"5min":2.7210000000000001,"15min":2.7210000000000001},"last":1.288}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5644,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739508,"statfs":{"total":95995035648,"available":95989256192,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:54:58 2021","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73999999999999999,"15min":0.629},"min":{"1min":0.59499999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.0780000000000001,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.81699999999999995,"15min":0.69699999999999995},"min":{"1min":0.60799999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":0.92500000000000004}]},{"osd":2,"last update":"Mon Jul 26 15:55:20 2021","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.83499999999999996,"15min":0.76100000000000001},"min":{"1min":0.53100000000000003,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.252,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90900000000000003,"15min":0.82199999999999995},"min":{"1min":0.622,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3340000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.85199999999999998}]},{"osd":3,"last update":"Mon Jul 26 15:55:44 2021","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.89800000000000002,"15min":0.85099999999999998},"min":{"1min":0.58699999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2210000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.026,"5min":0.97899999999999998,"15min":0.91600000000000004},"min":{"1min":0.86199999999999999,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3220000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":1.0209999999999999}]},{"osd":4,"last update":"Mon Jul 26 15:55:10 2021","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.1200000000000001,"15min":1.0840000000000001},"min":{"1min":0.95099999999999996,"5min":0.497,"15min":0.497},"max":{"1min":1.407,"5min":1.736,"15min":1.736},"last":1.266},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1459999999999999,"15min":1.0980000000000001},"min":{"1min":0.80200000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.458,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.0589999999999999}]},{"osd":5,"last update":"Mon Jul 26 15:55:35 2021","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2130000000000001,"15min":1.1579999999999999},"min":{"1min":0.94999999999999996,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.7070000000000001,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.238,"5min":1.244,"15min":1.224},"min":{"1min":1.0269999999999999,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.544,"5min":1.627,"15min":1.627},"last":1.0880000000000001}]},{"osd":6,"last update":"Mon Jul 26 15:54:58 2021","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.3089999999999999,"15min":1.27},"min":{"1min":1.022,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.706,"5min":1.865,"15min":1.865},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.339,"15min":1.3120000000000001},"min":{"1min":1.1439999999999999,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.784,"5min":2.2759999999999998,"15min":2.2759999999999998},"last":1.1839999999999999}]},{"osd":7,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.3939999999999999,"15min":1.3999999999999999},"min":{"1min":1.0289999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.645,"5min":1.7809999999999999,"15min":1.7809999999999999},"last":1.302},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.3879999999999999,"15min":1.3759999999999999},"min":{"1min":1.2030000000000001,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.569,"5min":1.857,"15min":1.857},"last":1.371}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5708,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739444,"statfs":{"total":95995035648,"available":95989190656,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jul 26 15:54:56 2021","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.69499999999999995,"15min":0.63500000000000001},"min":{"1min":0.47999999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0549999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.80000000000000004,"15min":0.70999999999999996},"min":{"1min":0.52300000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.81200000000000006}]},{"osd":2,"last update":"Mon Jul 26 15:55:22 2021","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.74199999999999999},"min":{"1min":0.53500000000000003,"5min":0.503,"15min":0.503},"max":{"1min":1.0980000000000001,"5min":2.4390000000000001,"15min":2.4390000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.90200000000000002,"15min":0.85199999999999998},"min":{"1min":0.60599999999999998,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3819999999999999,"5min":1.496,"15min":1.496},"last":1.194}]},{"osd":3,"last update":"Mon Jul 26 15:54:46 2021","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.93500000000000005,"15min":0.89000000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.298,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.91900000000000004,"15min":0.89200000000000002},"min":{"1min":0.69799999999999995,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.6080000000000001,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.004}]},{"osd":4,"last update":"Mon Jul 26 15:55:06 2021","interfaces":[{"interface":"back","average":{"1min":1.1719999999999999,"5min":1.048,"15min":1.0069999999999999},"min":{"1min":0.79800000000000004,"5min":0.747,"15min":0.747},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1599999999999999,"15min":1.1579999999999999},"min":{"1min":0.91000000000000003,"5min":0.747,"15min":0.747},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":1.2589999999999999}]},{"osd":5,"last update":"Mon Jul 26 15:55:30 2021","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.1559999999999999,"15min":1.133},"min":{"1min":0.94399999999999995,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.4430000000000001,"5min":2.597,"15min":2.597},"last":1.167},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.1910000000000001,"15min":1.1679999999999999},"min":{"1min":0.95299999999999996,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":1.661,"5min":2.1240000000000001,"15min":2.1240000000000001},"last":1.2230000000000001}]},{"osd":6,"last update":"Mon Jul 26 15:55:02 2021","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.2669999999999999,"15min":1.2549999999999999},"min":{"1min":0.95399999999999996,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.296,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.7130000000000001,"5min":1.8140000000000001,"15min":1.8140000000000001},"last":1.502}]},{"osd":7,"last update":"Mon Jul 26 15:55:22 2021","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.2989999999999999,"15min":1.286},"min":{"1min":0.996,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.611,"5min":2.056,"15min":2.056},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3620000000000001,"15min":1.3720000000000001},"min":{"1min":0.91200000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.655,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.385}]}]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5580,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739572,"statfs":{"total":95995035648,"available":95989321728,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:55:20 2021","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76500000000000001,"15min":0.69899999999999995},"min":{"1min":0.61199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.1299999999999999,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.80900000000000005,"15min":0.71899999999999997},"min":{"1min":0.66500000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.0600000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.79200000000000004}]},{"osd":1,"last update":"Mon Jul 26 15:55:20 2021","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.90700000000000003,"15min":0.78500000000000003},"min":{"1min":0.70599999999999996,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.383,"5min":1.647,"15min":1.647},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.85599999999999998,"15min":0.77400000000000002},"min":{"1min":0.73799999999999999,"5min":0.379,"15min":0.379},"max":{"1min":1.2270000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.90600000000000003}]},{"osd":3,"last update":"Mon Jul 26 15:54:47 2021","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.95699999999999996,"15min":0.90300000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.333,"5min":1.546,"15min":1.546},"last":1.042},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.97999999999999998,"15min":0.93999999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.45,"5min":2.9710000000000001,"15min":2.9710000000000001},"last":1.0700000000000001}]},{"osd":4,"last update":"Mon Jul 26 15:55:16 2021","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.115,"15min":1.087},"min":{"1min":0.89000000000000001,"5min":0.625,"15min":0.625},"max":{"1min":1.3240000000000001,"5min":2.907,"15min":2.907},"last":1.23},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.208,"15min":1.153},"min":{"1min":0.94299999999999995,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.5589999999999999,"5min":1.843,"15min":1.843},"last":1.1419999999999999}]},{"osd":5,"last update":"Mon Jul 26 15:55:34 2021","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.272,"15min":1.244},"min":{"1min":0.96699999999999997,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.6799999999999999,"5min":2.121,"15min":2.121},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.1419999999999999,"15min":1.127},"min":{"1min":0.88300000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":1.4139999999999999}]},{"osd":6,"last update":"Mon Jul 26 15:55:02 2021","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2789999999999999,"15min":1.286},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6020000000000001,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2849999999999999,"15min":1.2769999999999999},"min":{"1min":0.97899999999999998,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":1.502}]},{"osd":7,"last update":"Mon Jul 26 15:55:28 2021","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.3480000000000001,"15min":1.369},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.569,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.262},{"interface":"front","average":{"1min":1.401,"5min":1.423,"15min":1.431},"min":{"1min":1.1319999999999999,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":1.7629999999999999,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.343}]}]},{"osd":3,"up_from":25,"seq":107374182464,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5516,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739636,"statfs":{"total":95995035648,"available":95989387264,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:54:49 2021","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.72999999999999998,"15min":0.69099999999999995},"min":{"1min":0.55300000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.83799999999999997,"15min":0.82999999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.1879999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.091}]},{"osd":1,"last update":"Mon Jul 26 15:54:49 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.88800000000000001,"15min":0.84599999999999997},"min":{"1min":0.68000000000000005,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.405,"5min":1.647,"15min":1.647},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.83299999999999996,"15min":0.84099999999999997},"min":{"1min":0.61099999999999999,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.089,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Mon Jul 26 15:54:49 2021","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.86599999999999999,"15min":0.84299999999999997},"min":{"1min":0.67800000000000005,"5min":0.623,"15min":0.623},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.90700000000000003,"15min":0.85099999999999998},"min":{"1min":0.627,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.466,"5min":1.4710000000000001,"15min":1.4710000000000001},"last":1.242}]},{"osd":4,"last update":"Mon Jul 26 15:55:10 2021","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.075,"15min":1.038},"min":{"1min":0.73699999999999999,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.504,"5min":1.5649999999999999,"15min":1.5649999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.119,"5min":1.0669999999999999,"15min":1.0609999999999999},"min":{"1min":0.84799999999999998,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.048}]},{"osd":5,"last update":"Mon Jul 26 15:55:43 2021","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.171,"15min":1.153},"min":{"1min":0.81599999999999995,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.728,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.337},{"interface":"front","average":{"1min":1.194,"5min":1.1830000000000001,"15min":1.1890000000000001},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":1.21}]},{"osd":6,"last update":"Mon Jul 26 15:54:56 2021","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.3,"15min":1.325},"min":{"1min":1.002,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":1.7509999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.302,"15min":1.2829999999999999},"min":{"1min":1.135,"5min":1,"15min":1},"max":{"1min":1.6739999999999999,"5min":1.712,"15min":1.712},"last":1.4350000000000001}]},{"osd":7,"last update":"Mon Jul 26 15:55:21 2021","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3740000000000001},"min":{"1min":1.071,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":1.748,"5min":1.786,"15min":1.786},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.325,"5min":1.3540000000000001,"15min":1.371},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.4059999999999999}]}]},{"osd":4,"up_from":30,"seq":128849018940,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5452,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739700,"statfs":{"total":95995035648,"available":95989452800,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.88400000000000001,"15min":0.84099999999999997},"min":{"1min":0.68600000000000005,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.2030000000000001,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.01},{"interface":"front","average":{"1min":0.996,"5min":0.91400000000000003,"15min":0.89400000000000002},"min":{"1min":0.69699999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.75}]},{"osd":1,"last update":"Mon Jul 26 15:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.91200000000000003,"15min":0.878},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.234,"5min":1.417,"15min":1.417},"last":1.198},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.95099999999999996,"15min":0.94099999999999995},"min":{"1min":0.70399999999999996,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.94399999999999995}]},{"osd":2,"last update":"Mon Jul 26 15:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.95599999999999996,"15min":0.93999999999999995},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3320000000000001,"5min":1.341,"15min":1.341},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.04,"5min":0.99199999999999999,"15min":0.97499999999999998},"min":{"1min":0.751,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.335,"5min":1.383,"15min":1.383},"last":0.90500000000000003}]},{"osd":3,"last update":"Mon Jul 26 15:55:09 2021","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.98399999999999999,"15min":0.95499999999999996},"min":{"1min":0.70599999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.1100000000000001,"15min":1.1259999999999999},"min":{"1min":0.92400000000000004,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.268,"5min":3.27,"15min":3.27},"last":1.2649999999999999}]},{"osd":5,"last update":"Mon Jul 26 15:55:32 2021","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.95799999999999996,"15min":0.96399999999999997},"min":{"1min":0.68999999999999995,"5min":0.624,"15min":0.624},"max":{"1min":1.2130000000000001,"5min":1.369,"15min":1.369},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.056,"5min":0.99399999999999999,"15min":0.94299999999999995},"min":{"1min":0.70199999999999996,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.345,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.80100000000000005}]},{"osd":6,"last update":"Mon Jul 26 15:54:58 2021","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.786,"15min":2.0920000000000001},"min":{"1min":0.81200000000000006,"5min":0.624,"15min":0.624},"max":{"1min":1.286,"5min":22.518000000000001,"15min":22.518000000000001},"last":1.335},{"interface":"front","average":{"1min":1.155,"5min":1.895,"15min":2.2050000000000001},"min":{"1min":0.95199999999999996,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.4910000000000001,"5min":23.016999999999999,"15min":23.016999999999999},"last":1.0009999999999999}]},{"osd":7,"last update":"Mon Jul 26 15:55:21 2021","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.121,"15min":1.1259999999999999},"min":{"1min":0.90600000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.4490000000000001,"5min":1.573,"15min":1.573},"last":0.88},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.94999999999999996,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.516,"5min":1.518,"15min":1.518},"last":1.056}]}]},{"osd":5,"up_from":36,"seq":154618822710,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5452,"kb_used_data":516,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739700,"statfs":{"total":95995035648,"available":95989452800,"internally_reserved":0,"allocated":528384,"data_stored":213053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 15:55:36 2021","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.875,"15min":0.84899999999999998},"min":{"1min":0.73199999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.1659999999999999,"5min":1.383,"15min":1.383},"last":1.095},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.99199999999999999,"15min":1.006},"min":{"1min":0.755,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3160000000000001,"5min":1.508,"15min":1.508},"last":0.85399999999999998}]},{"osd":1,"last update":"Mon Jul 26 15:55:36 2021","interfaces":[{"interface":"back","average":{"1min":0.999,"5min":0.97299999999999998,"15min":0.92700000000000005},"min":{"1min":0.66300000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"last":1.121},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.94699999999999995,"15min":0.93600000000000005},"min":{"1min":0.68500000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.242,"5min":1.302,"15min":1.302},"last":1.3520000000000001}]},{"osd":2,"last update":"Mon Jul 26 15:55:36 2021","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.95899999999999996,"15min":0.96799999999999997},"min":{"1min":0.80100000000000005,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.28,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.177},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0509999999999999,"15min":1.0349999999999999},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3560000000000001,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":0.93300000000000005}]},{"osd":3,"last update":"Mon Jul 26 15:55:36 2021","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.002,"15min":1.002},"min":{"1min":0.73099999999999998,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.1990000000000001,"5min":1.738,"15min":1.738},"last":1.028},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.107,"15min":1.0860000000000001},"min":{"1min":0.82099999999999995,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.48,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.2370000000000001}]},{"osd":4,"last update":"Mon Jul 26 15:55:36 2021","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92100000000000004,"15min":0.92800000000000005},"min":{"1min":0.60699999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.486},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.98499999999999999,"15min":0.996},"min":{"1min":0.65700000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.29,"5min":1.571,"15min":1.571},"last":0.89300000000000002}]},{"osd":6,"last update":"Mon Jul 26 15:54:58 2021","interfaces":[{"interface":"back","average":{"1min":0.97399999999999998,"5min":1.073,"15min":1.093},"min":{"1min":0.74099999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.216,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.115,"15min":1.1259999999999999},"min":{"1min":0.91800000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.341,"5min":1.738,"15min":1.738},"last":1.4199999999999999}]},{"osd":7,"last update":"Mon Jul 26 15:55:27 2021","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.1479999999999999,"15min":1.1699999999999999},"min":{"1min":0.71399999999999997,"5min":0.629,"15min":0.629},"max":{"1min":1.4319999999999999,"5min":1.621,"15min":1.621},"last":1.196},{"interface":"front","average":{"1min":1.0429999999999999,"5min":1.1120000000000001,"15min":1.135},"min":{"1min":0.82599999999999996,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4550000000000001,"5min":1.7190000000000001,"15min":1.7190000000000001},"last":1.2549999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-07-26T15:55:49.564 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-07-26T15:55:49.565 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-07-26T15:55:49.565 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-07-26T15:55:49.566 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph health --format=json 2021-07-26T15:55:50.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:50 smithi033 bash[14790]: cluster 2021-07-26T15:55:49.617304+0000 mgr.y (mgr.14146) 339 : cluster [DBG] pgmap v303: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:50.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:50 smithi033 bash[19094]: cluster 2021-07-26T15:55:49.617304+0000 mgr.y (mgr.14146) 339 : cluster [DBG] pgmap v303: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:50.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:50 smithi096 bash[15117]: cluster 2021-07-26T15:55:49.617304+0000 mgr.y (mgr.14146) 339 : cluster [DBG] pgmap v303: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:52.331 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:55:53.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:53 smithi033 bash[19094]: cluster 2021-07-26T15:55:51.618056+0000 mgr.y (mgr.14146) 340 : cluster [DBG] pgmap v304: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:53.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:53 smithi033 bash[14790]: cluster 2021-07-26T15:55:51.618056+0000 mgr.y (mgr.14146) 340 : cluster [DBG] pgmap v304: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:53.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:53 smithi096 bash[15117]: cluster 2021-07-26T15:55:51.618056+0000 mgr.y (mgr.14146) 340 : cluster [DBG] pgmap v304: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:55.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:55 smithi033 bash[19094]: cluster 2021-07-26T15:55:53.618707+0000 mgr.y (mgr.14146) 341 : cluster [DBG] pgmap v305: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:55.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:55 smithi033 bash[14790]: cluster 2021-07-26T15:55:53.618707+0000 mgr.y (mgr.14146) 341 : cluster [DBG] pgmap v305: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:55.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:55 smithi096 bash[15117]: cluster 2021-07-26T15:55:53.618707+0000 mgr.y (mgr.14146) 341 : cluster [DBG] pgmap v305: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:56.022 INFO:teuthology.orchestra.run.smithi033.stdout: 2021-07-26T15:55:56.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:56 smithi033 bash[14790]: cluster 2021-07-26T15:55:55.619528+0000 mgr.y (mgr.14146) 342 : cluster [DBG] pgmap v306: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:56.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:56 smithi033 bash[14790]: audit 2021-07-26T15:55:56.020558+0000 mon.a (mon.0) 634 : audit [DBG] from='client.? 172.21.15.33:0/615810524' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-07-26T15:55:56.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:56 smithi033 bash[19094]: cluster 2021-07-26T15:55:55.619528+0000 mgr.y (mgr.14146) 342 : cluster [DBG] pgmap v306: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:56.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:56 smithi033 bash[19094]: audit 2021-07-26T15:55:56.020558+0000 mon.a (mon.0) 634 : audit [DBG] from='client.? 172.21.15.33:0/615810524' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-07-26T15:55:56.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:56 smithi096 bash[15117]: cluster 2021-07-26T15:55:55.619528+0000 mgr.y (mgr.14146) 342 : cluster [DBG] pgmap v306: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:56.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:56 smithi096 bash[15117]: audit 2021-07-26T15:55:56.020558+0000 mon.a (mon.0) 634 : audit [DBG] from='client.? 172.21.15.33:0/615810524' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-07-26T15:55:56.732 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-07-26T15:55:56.732 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-07-26T15:55:56.733 INFO:tasks.cephadm:Setup complete, yielding 2021-07-26T15:55:56.734 INFO:teuthology.run_tasks:Running task print... 2021-07-26T15:55:56.767 INFO:teuthology.task.print:**** done end installing pacific cephadm ... 2021-07-26T15:55:56.767 INFO:teuthology.run_tasks:Running task print... 2021-07-26T15:55:56.808 INFO:teuthology.task.print:**** done start cephadm.shell ceph config set mgr... 2021-07-26T15:55:56.809 INFO:teuthology.run_tasks:Running task cephadm.shell... 2021-07-26T15:55:56.836 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2021-07-26T15:55:56.838 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2021-07-26T15:55:59.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:55:59 smithi033 bash[14790]: cluster 2021-07-26T15:55:57.620190+0000 mgr.y (mgr.14146) 343 : cluster [DBG] pgmap v307: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:59.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:55:59 smithi033 bash[19094]: cluster 2021-07-26T15:55:57.620190+0000 mgr.y (mgr.14146) 343 : cluster [DBG] pgmap v307: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:55:59.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:55:59 smithi096 bash[15117]: cluster 2021-07-26T15:55:57.620190+0000 mgr.y (mgr.14146) 343 : cluster [DBG] pgmap v307: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:01.129 INFO:teuthology.run_tasks:Running task print... 2021-07-26T15:56:01.142 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2021-07-26T15:56:01.143 INFO:teuthology.run_tasks:Running task print... 2021-07-26T15:56:01.197 INFO:teuthology.task.print:**** done start parallel 2021-07-26T15:56:01.198 INFO:teuthology.run_tasks:Running task parallel... 2021-07-26T15:56:01.226 INFO:teuthology.task.parallel:starting parallel... 2021-07-26T15:56:01.228 INFO:teuthology.task.parallel:In parallel, running task full_sequential... 2021-07-26T15:56:01.228 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2021-07-26T15:56:01.229 INFO:teuthology.task.print:**** done start ec-rados-default.yaml 2021-07-26T15:56:01.229 INFO:teuthology.task.full_sequential:In full_sequential, running task rados... 2021-07-26T15:56:01.232 INFO:tasks.rados:Beginning rados... 2021-07-26T15:56:01.233 INFO:tasks.rados:joining rados 2021-07-26T15:56:01.233 INFO:teuthology.task.parallel:In parallel, running task sequential... 2021-07-26T15:56:01.234 INFO:teuthology.task.sequential:In sequential, running task print... 2021-07-26T15:56:01.234 INFO:teuthology.task.print:**** done start upgrade, wait 2021-07-26T15:56:01.235 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2021-07-26T15:56:01.235 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi033.front.sepia.ceph.com 2021-07-26T15:56:01.236 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -e sha1=bccf07c244ef1754a7e8d345570b6a04f2ee5a7e -- bash -c 'ceph config set global log_to_journald false --force' 2021-07-26T15:56:01.237 INFO:tasks.rados:clients are ['client.0', 'client.1'] 2021-07-26T15:56:01.237 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd erasure-code-profile set teuthologyprofile k=2 m=1 crush-failure-domain=osd 2021-07-26T15:56:01.447 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[14790]: cluster 2021-07-26T15:55:59.620858+0000 mgr.y (mgr.14146) 344 : cluster [DBG] pgmap v308: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:01.447 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[14790]: audit 2021-07-26T15:56:00.463541+0000 mon.a (mon.0) 635 : audit [INF] from='client.? ' entity='client.admin' 2021-07-26T15:56:01.448 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[14790]: audit 2021-07-26T15:56:00.470334+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:01.448 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[14790]: audit 2021-07-26T15:56:00.472042+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:56:01.448 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[14790]: audit 2021-07-26T15:56:00.473105+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:56:01.449 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[14790]: audit 2021-07-26T15:56:00.480322+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:01.450 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[19094]: cluster 2021-07-26T15:55:59.620858+0000 mgr.y (mgr.14146) 344 : cluster [DBG] pgmap v308: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:01.450 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[19094]: audit 2021-07-26T15:56:00.463541+0000 mon.a (mon.0) 635 : audit [INF] from='client.? ' entity='client.admin' 2021-07-26T15:56:01.450 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[19094]: audit 2021-07-26T15:56:00.470334+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:01.451 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[19094]: audit 2021-07-26T15:56:00.472042+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:56:01.452 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[19094]: audit 2021-07-26T15:56:00.473105+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:56:01.453 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:01 smithi033 bash[19094]: audit 2021-07-26T15:56:00.480322+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:01.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:01 smithi096 bash[15117]: cluster 2021-07-26T15:55:59.620858+0000 mgr.y (mgr.14146) 344 : cluster [DBG] pgmap v308: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:01.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:01 smithi096 bash[15117]: audit 2021-07-26T15:56:00.463541+0000 mon.a (mon.0) 635 : audit [INF] from='client.? ' entity='client.admin' 2021-07-26T15:56:01.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:01 smithi096 bash[15117]: audit 2021-07-26T15:56:00.470334+0000 mon.a (mon.0) 636 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:01.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:01 smithi096 bash[15117]: audit 2021-07-26T15:56:00.472042+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:56:01.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:01 smithi096 bash[15117]: audit 2021-07-26T15:56:00.473105+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:56:01.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:01 smithi096 bash[15117]: audit 2021-07-26T15:56:00.480322+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:03.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:03 smithi033 bash[14790]: cluster 2021-07-26T15:56:01.621616+0000 mgr.y (mgr.14146) 345 : cluster [DBG] pgmap v309: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:03.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:03 smithi033 bash[19094]: cluster 2021-07-26T15:56:01.621616+0000 mgr.y (mgr.14146) 345 : cluster [DBG] pgmap v309: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:03.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:03 smithi096 bash[15117]: cluster 2021-07-26T15:56:01.621616+0000 mgr.y (mgr.14146) 345 : cluster [DBG] pgmap v309: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:04.009 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:56:05.333 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:05 smithi033 bash[14790]: cluster 2021-07-26T15:56:03.622271+0000 mgr.y (mgr.14146) 346 : cluster [DBG] pgmap v310: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:05.334 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:05 smithi033 bash[19094]: cluster 2021-07-26T15:56:03.622271+0000 mgr.y (mgr.14146) 346 : cluster [DBG] pgmap v310: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:05.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:05 smithi096 bash[15117]: cluster 2021-07-26T15:56:03.622271+0000 mgr.y (mgr.14146) 346 : cluster [DBG] pgmap v310: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:06.654 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[19094]: audit 2021-07-26T15:56:05.464604+0000 mon.a (mon.0) 640 : audit [INF] from='client.? 172.21.15.33:0/2305886071' entity='client.admin' 2021-07-26T15:56:06.654 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[19094]: audit 2021-07-26T15:56:05.473068+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:06.654 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[19094]: audit 2021-07-26T15:56:05.475747+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:56:06.655 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[19094]: audit 2021-07-26T15:56:05.476900+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:56:06.677 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[19094]: audit 2021-07-26T15:56:05.483920+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:06.677 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[19094]: cluster 2021-07-26T15:56:05.622983+0000 mgr.y (mgr.14146) 347 : cluster [DBG] pgmap v311: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:06.678 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[14790]: audit 2021-07-26T15:56:05.464604+0000 mon.a (mon.0) 640 : audit [INF] from='client.? 172.21.15.33:0/2305886071' entity='client.admin' 2021-07-26T15:56:06.678 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[14790]: audit 2021-07-26T15:56:05.473068+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:06.679 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[14790]: audit 2021-07-26T15:56:05.475747+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:56:06.679 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[14790]: audit 2021-07-26T15:56:05.476900+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:56:06.679 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[14790]: audit 2021-07-26T15:56:05.483920+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:06.679 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:06 smithi033 bash[14790]: cluster 2021-07-26T15:56:05.622983+0000 mgr.y (mgr.14146) 347 : cluster [DBG] pgmap v311: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:06.697 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -e sha1=bccf07c244ef1754a7e8d345570b6a04f2ee5a7e -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2021-07-26T15:56:06.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:06 smithi096 bash[15117]: audit 2021-07-26T15:56:05.464604+0000 mon.a (mon.0) 640 : audit [INF] from='client.? 172.21.15.33:0/2305886071' entity='client.admin' 2021-07-26T15:56:06.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:06 smithi096 bash[15117]: audit 2021-07-26T15:56:05.473068+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:06.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:06 smithi096 bash[15117]: audit 2021-07-26T15:56:05.475747+0000 mon.a (mon.0) 642 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:56:06.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:06 smithi096 bash[15117]: audit 2021-07-26T15:56:05.476900+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:56:06.742 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:06 smithi096 bash[15117]: audit 2021-07-26T15:56:05.483920+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:06.743 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:06 smithi096 bash[15117]: cluster 2021-07-26T15:56:05.622983+0000 mgr.y (mgr.14146) 347 : cluster [DBG] pgmap v311: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:08.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:08 smithi033 bash[14790]: cluster 2021-07-26T15:56:07.623674+0000 mgr.y (mgr.14146) 348 : cluster [DBG] pgmap v312: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:08.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:08 smithi033 bash[19094]: cluster 2021-07-26T15:56:07.623674+0000 mgr.y (mgr.14146) 348 : cluster [DBG] pgmap v312: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:08.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:08 smithi096 bash[15117]: cluster 2021-07-26T15:56:07.623674+0000 mgr.y (mgr.14146) 348 : cluster [DBG] pgmap v312: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:09.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:09 smithi033 bash[19094]: audit 2021-07-26T15:56:08.915480+0000 mon.a (mon.0) 645 : audit [INF] from='client.? 172.21.15.33:0/2901179863' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-07-26T15:56:09.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:09 smithi033 bash[14790]: audit 2021-07-26T15:56:08.915480+0000 mon.a (mon.0) 645 : audit [INF] from='client.? 172.21.15.33:0/2901179863' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-07-26T15:56:09.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:09 smithi096 bash[15117]: audit 2021-07-26T15:56:08.915480+0000 mon.a (mon.0) 645 : audit [INF] from='client.? 172.21.15.33:0/2901179863' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]: dispatch 2021-07-26T15:56:10.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:10 smithi033 bash[19094]: audit 2021-07-26T15:56:09.194133+0000 mon.a (mon.0) 646 : audit [INF] from='client.? 172.21.15.33:0/2901179863' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-07-26T15:56:10.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:10 smithi033 bash[19094]: cluster 2021-07-26T15:56:09.194258+0000 mon.a (mon.0) 647 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-07-26T15:56:10.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:10 smithi033 bash[19094]: cluster 2021-07-26T15:56:09.624347+0000 mgr.y (mgr.14146) 349 : cluster [DBG] pgmap v314: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:10.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:10 smithi033 bash[14790]: audit 2021-07-26T15:56:09.194133+0000 mon.a (mon.0) 646 : audit [INF] from='client.? 172.21.15.33:0/2901179863' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-07-26T15:56:10.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:10 smithi033 bash[14790]: cluster 2021-07-26T15:56:09.194258+0000 mon.a (mon.0) 647 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-07-26T15:56:10.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:10 smithi033 bash[14790]: cluster 2021-07-26T15:56:09.624347+0000 mgr.y (mgr.14146) 349 : cluster [DBG] pgmap v314: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:10 smithi096 bash[15117]: audit 2021-07-26T15:56:09.194133+0000 mon.a (mon.0) 646 : audit [INF] from='client.? 172.21.15.33:0/2901179863' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "teuthologyprofile", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]': finished 2021-07-26T15:56:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:10 smithi096 bash[15117]: cluster 2021-07-26T15:56:09.194258+0000 mon.a (mon.0) 647 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-07-26T15:56:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:10 smithi096 bash[15117]: cluster 2021-07-26T15:56:09.624347+0000 mgr.y (mgr.14146) 349 : cluster [DBG] pgmap v314: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:10.500 INFO:tasks.rados:starting run 0 out of 1 2021-07-26T15:56:10.501 INFO:tasks.cephadm.ceph_manager.ceph:creating pool_name unique_pool_0 2021-07-26T15:56:10.501 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd pool create unique_pool_0 16 16 erasure teuthologyprofile 2021-07-26T15:56:11.614 INFO:teuthology.orchestra.run.smithi033.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:56:12.427 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -e sha1=bccf07c244ef1754a7e8d345570b6a04f2ee5a7e -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done' 2021-07-26T15:56:12.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[19094]: audit 2021-07-26T15:56:11.603673+0000 mgr.y (mgr.14146) 350 : audit [DBG] from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:56:12.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[19094]: cephadm 2021-07-26T15:56:11.605159+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:56:12.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[19094]: audit 2021-07-26T15:56:11.612231+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:12.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[19094]: audit 2021-07-26T15:56:11.613445+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:12.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[19094]: audit 2021-07-26T15:56:11.616396+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:56:12.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[19094]: audit 2021-07-26T15:56:11.617768+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:56:12.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[19094]: audit 2021-07-26T15:56:11.624508+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:12.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[19094]: cluster 2021-07-26T15:56:11.625096+0000 mgr.y (mgr.14146) 352 : cluster [DBG] pgmap v315: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:12.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[19094]: cephadm 2021-07-26T15:56:11.630426+0000 mgr.y (mgr.14146) 353 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:56:12.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[19094]: audit 2021-07-26T15:56:11.690649+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:56:12.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[19094]: audit 2021-07-26T15:56:11.693622+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:56:12.714 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[14790]: audit 2021-07-26T15:56:11.603673+0000 mgr.y (mgr.14146) 350 : audit [DBG] from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:56:12.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[14790]: cephadm 2021-07-26T15:56:11.605159+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:56:12.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[14790]: audit 2021-07-26T15:56:11.612231+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:12.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[14790]: audit 2021-07-26T15:56:11.613445+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:12.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[14790]: audit 2021-07-26T15:56:11.616396+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:56:12.716 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[14790]: audit 2021-07-26T15:56:11.617768+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:56:12.716 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[14790]: audit 2021-07-26T15:56:11.624508+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:12.717 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[14790]: cluster 2021-07-26T15:56:11.625096+0000 mgr.y (mgr.14146) 352 : cluster [DBG] pgmap v315: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:12.718 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[14790]: cephadm 2021-07-26T15:56:11.630426+0000 mgr.y (mgr.14146) 353 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:56:12.718 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[14790]: audit 2021-07-26T15:56:11.690649+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:56:12.718 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:12 smithi033 bash[14790]: audit 2021-07-26T15:56:11.693622+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:56:12.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:12 smithi096 bash[15117]: audit 2021-07-26T15:56:11.603673+0000 mgr.y (mgr.14146) 350 : audit [DBG] from='client.14616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:56:12.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:12 smithi096 bash[15117]: cephadm 2021-07-26T15:56:11.605159+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:56:12.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:12 smithi096 bash[15117]: audit 2021-07-26T15:56:11.612231+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:12.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:12 smithi096 bash[15117]: audit 2021-07-26T15:56:11.613445+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:12.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:12 smithi096 bash[15117]: audit 2021-07-26T15:56:11.616396+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:56:12.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:12 smithi096 bash[15117]: audit 2021-07-26T15:56:11.617768+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:56:12.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:12 smithi096 bash[15117]: audit 2021-07-26T15:56:11.624508+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:12.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:12 smithi096 bash[15117]: cluster 2021-07-26T15:56:11.625096+0000 mgr.y (mgr.14146) 352 : cluster [DBG] pgmap v315: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:12.995 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:12 smithi096 bash[15117]: cephadm 2021-07-26T15:56:11.630426+0000 mgr.y (mgr.14146) 353 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:56:12.995 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:12 smithi096 bash[15117]: audit 2021-07-26T15:56:11.690649+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:56:12.995 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:12 smithi096 bash[15117]: audit 2021-07-26T15:56:11.693622+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:56:13.937 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:56:14.957 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:14 smithi033 bash[19094]: cluster 2021-07-26T15:56:13.625910+0000 mgr.y (mgr.14146) 354 : cluster [DBG] pgmap v316: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:14.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:14 smithi033 bash[14790]: cluster 2021-07-26T15:56:13.625910+0000 mgr.y (mgr.14146) 354 : cluster [DBG] pgmap v316: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:14.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:14 smithi096 bash[15117]: cluster 2021-07-26T15:56:13.625910+0000 mgr.y (mgr.14146) 354 : cluster [DBG] pgmap v316: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:16.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:16 smithi033 bash[19094]: cluster 2021-07-26T15:56:15.626443+0000 mgr.y (mgr.14146) 355 : cluster [DBG] pgmap v317: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:16.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:16 smithi033 bash[14790]: cluster 2021-07-26T15:56:15.626443+0000 mgr.y (mgr.14146) 355 : cluster [DBG] pgmap v317: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:16.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:16 smithi096 bash[15117]: cluster 2021-07-26T15:56:15.626443+0000 mgr.y (mgr.14146) 355 : cluster [DBG] pgmap v317: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:18.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:18 smithi033 bash[14790]: cluster 2021-07-26T15:56:17.626993+0000 mgr.y (mgr.14146) 356 : cluster [DBG] pgmap v318: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:18.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:18 smithi033 bash[19094]: cluster 2021-07-26T15:56:17.626993+0000 mgr.y (mgr.14146) 356 : cluster [DBG] pgmap v318: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:18.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:18 smithi096 bash[15117]: cluster 2021-07-26T15:56:17.626993+0000 mgr.y (mgr.14146) 356 : cluster [DBG] pgmap v318: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:20.957 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:20 smithi033 bash[14790]: cluster 2021-07-26T15:56:19.627457+0000 mgr.y (mgr.14146) 357 : cluster [DBG] pgmap v319: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:20.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:20 smithi033 bash[19094]: cluster 2021-07-26T15:56:19.627457+0000 mgr.y (mgr.14146) 357 : cluster [DBG] pgmap v319: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:20.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:20 smithi096 bash[15117]: cluster 2021-07-26T15:56:19.627457+0000 mgr.y (mgr.14146) 357 : cluster [DBG] pgmap v319: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:23.457 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:23 smithi033 bash[14790]: cluster 2021-07-26T15:56:21.627957+0000 mgr.y (mgr.14146) 358 : cluster [DBG] pgmap v320: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:23.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:23 smithi033 bash[19094]: cluster 2021-07-26T15:56:21.627957+0000 mgr.y (mgr.14146) 358 : cluster [DBG] pgmap v320: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:23.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:23 smithi096 bash[15117]: cluster 2021-07-26T15:56:21.627957+0000 mgr.y (mgr.14146) 358 : cluster [DBG] pgmap v320: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:24.457 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:24 smithi033 bash[19094]: cluster 2021-07-26T15:56:23.628619+0000 mgr.y (mgr.14146) 359 : cluster [DBG] pgmap v321: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:24.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:24 smithi033 bash[14790]: cluster 2021-07-26T15:56:23.628619+0000 mgr.y (mgr.14146) 359 : cluster [DBG] pgmap v321: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:24.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:24 smithi096 bash[15117]: cluster 2021-07-26T15:56:23.628619+0000 mgr.y (mgr.14146) 359 : cluster [DBG] pgmap v321: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:26.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:26 smithi033 bash[14790]: cluster 2021-07-26T15:56:25.629242+0000 mgr.y (mgr.14146) 360 : cluster [DBG] pgmap v322: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:26.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:26 smithi033 bash[19094]: cluster 2021-07-26T15:56:25.629242+0000 mgr.y (mgr.14146) 360 : cluster [DBG] pgmap v322: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:26.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:26 smithi096 bash[15117]: cluster 2021-07-26T15:56:25.629242+0000 mgr.y (mgr.14146) 360 : cluster [DBG] pgmap v322: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:28.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:28 smithi033 bash[14790]: cluster 2021-07-26T15:56:27.629741+0000 mgr.y (mgr.14146) 361 : cluster [DBG] pgmap v323: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:28.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:28 smithi033 bash[19094]: cluster 2021-07-26T15:56:27.629741+0000 mgr.y (mgr.14146) 361 : cluster [DBG] pgmap v323: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:28.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:28 smithi096 bash[15117]: cluster 2021-07-26T15:56:27.629741+0000 mgr.y (mgr.14146) 361 : cluster [DBG] pgmap v323: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:30.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:30 smithi033 bash[14790]: cluster 2021-07-26T15:56:29.630307+0000 mgr.y (mgr.14146) 362 : cluster [DBG] pgmap v324: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:30.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:30 smithi033 bash[19094]: cluster 2021-07-26T15:56:29.630307+0000 mgr.y (mgr.14146) 362 : cluster [DBG] pgmap v324: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:30.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:30 smithi096 bash[15117]: cluster 2021-07-26T15:56:29.630307+0000 mgr.y (mgr.14146) 362 : cluster [DBG] pgmap v324: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:32.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:32 smithi033 bash[14790]: cluster 2021-07-26T15:56:31.631100+0000 mgr.y (mgr.14146) 363 : cluster [DBG] pgmap v325: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:32.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:32 smithi033 bash[19094]: cluster 2021-07-26T15:56:31.631100+0000 mgr.y (mgr.14146) 363 : cluster [DBG] pgmap v325: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:32.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:32 smithi096 bash[15117]: cluster 2021-07-26T15:56:31.631100+0000 mgr.y (mgr.14146) 363 : cluster [DBG] pgmap v325: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:34.093 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T15:56:34.414 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T15:56:34.414 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (3m) 2m ago 3m 9.84M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T15:56:34.414 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (3m) 2m ago 3m 24.0M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T15:56:34.415 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (7m) 2m ago 7m 360M - 16.2.5 34f74fddb18e 993bd06a2266 2021-07-26T15:56:34.415 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:9283 running (10m) 2m ago 10m 406M - 16.2.5 34f74fddb18e 36288638414a 2021-07-26T15:56:34.415 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (10m) 2m ago 10m 49.4M 2048M 16.2.5 34f74fddb18e 85aee8c34dd9 2021-07-26T15:56:34.415 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (8m) 2m ago 8m 39.7M 2048M 16.2.5 34f74fddb18e dce67784fda4 2021-07-26T15:56:34.415 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (8m) 2m ago 8m 37.5M 2048M 16.2.5 34f74fddb18e 18be215b59d8 2021-07-26T15:56:34.416 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (3m) 2m ago 3m 3143k - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T15:56:34.416 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (3m) 2m ago 3m 3260k - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T15:56:34.416 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (7m) 2m ago 7m 37.6M 4065M 16.2.5 34f74fddb18e a4b4ebc84a97 2021-07-26T15:56:34.416 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (6m) 2m ago 7m 39.3M 4065M 16.2.5 34f74fddb18e 35137704568f 2021-07-26T15:56:34.417 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (6m) 2m ago 6m 38.1M 4065M 16.2.5 34f74fddb18e d351359286fd 2021-07-26T15:56:34.417 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (6m) 2m ago 6m 38.2M 4065M 16.2.5 34f74fddb18e 6b68e9927be6 2021-07-26T15:56:34.417 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (5m) 2m ago 5m 36.6M 4320M 16.2.5 34f74fddb18e 1aac82d5671e 2021-07-26T15:56:34.417 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (5m) 2m ago 5m 37.0M 4320M 16.2.5 34f74fddb18e 12b89782c2eb 2021-07-26T15:56:34.417 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (4m) 2m ago 4m 37.5M 4320M 16.2.5 34f74fddb18e 4fad5a8407d4 2021-07-26T15:56:34.418 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (4m) 2m ago 4m 36.5M 4320M 16.2.5 34f74fddb18e a988c60ad3d5 2021-07-26T15:56:34.418 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (3m) 2m ago 3m 19.2M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T15:56:34.803 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T15:56:34.804 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T15:56:34.804 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 3 2021-07-26T15:56:34.804 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:56:34.804 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T15:56:34.805 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 2 2021-07-26T15:56:34.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:56:34.805 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T15:56:34.805 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 8 2021-07-26T15:56:34.805 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:56:34.806 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T15:56:34.806 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T15:56:34.806 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 13 2021-07-26T15:56:34.806 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T15:56:34.807 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T15:56:34.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:34 smithi033 bash[19094]: cluster 2021-07-26T15:56:33.631801+0000 mgr.y (mgr.14146) 364 : cluster [DBG] pgmap v326: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:34.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:34 smithi033 bash[19094]: audit 2021-07-26T15:56:34.076109+0000 mgr.y (mgr.14146) 365 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:56:34.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:34 smithi033 bash[14790]: cluster 2021-07-26T15:56:33.631801+0000 mgr.y (mgr.14146) 364 : cluster [DBG] pgmap v326: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:34.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:34 smithi033 bash[14790]: audit 2021-07-26T15:56:34.076109+0000 mgr.y (mgr.14146) 365 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:56:34.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:34 smithi096 bash[15117]: cluster 2021-07-26T15:56:33.631801+0000 mgr.y (mgr.14146) 364 : cluster [DBG] pgmap v326: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:34.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:34 smithi096 bash[15117]: audit 2021-07-26T15:56:34.076109+0000 mgr.y (mgr.14146) 365 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:56:36.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:36 smithi033 bash[14790]: audit 2021-07-26T15:56:34.400065+0000 mgr.y (mgr.14146) 366 : audit [DBG] from='client.24550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:56:36.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:36 smithi033 bash[14790]: audit 2021-07-26T15:56:34.801236+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.33:0/2124708003' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:56:36.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:36 smithi033 bash[14790]: audit 2021-07-26T15:56:35.432567+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.15.33:0/1505753318' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2021-07-26T15:56:36.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:36 smithi033 bash[14790]: audit 2021-07-26T15:56:35.433126+0000 mon.a (mon.0) 655 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2021-07-26T15:56:36.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:36 smithi033 bash[19094]: audit 2021-07-26T15:56:34.400065+0000 mgr.y (mgr.14146) 366 : audit [DBG] from='client.24550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:56:36.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:36 smithi033 bash[19094]: audit 2021-07-26T15:56:34.801236+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.33:0/2124708003' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:56:36.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:36 smithi033 bash[19094]: audit 2021-07-26T15:56:35.432567+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.15.33:0/1505753318' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2021-07-26T15:56:36.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:36 smithi033 bash[19094]: audit 2021-07-26T15:56:35.433126+0000 mon.a (mon.0) 655 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2021-07-26T15:56:36.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:36 smithi096 bash[15117]: audit 2021-07-26T15:56:34.400065+0000 mgr.y (mgr.14146) 366 : audit [DBG] from='client.24550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:56:36.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:36 smithi096 bash[15117]: audit 2021-07-26T15:56:34.801236+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.33:0/2124708003' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:56:36.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:36 smithi096 bash[15117]: audit 2021-07-26T15:56:35.432567+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.15.33:0/1505753318' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2021-07-26T15:56:36.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:36 smithi096 bash[15117]: audit 2021-07-26T15:56:35.433126+0000 mon.a (mon.0) 655 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]: dispatch 2021-07-26T15:56:36.726 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'unique_pool_0' created 2021-07-26T15:56:37.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:37 smithi096 bash[15117]: cluster 2021-07-26T15:56:35.632463+0000 mgr.y (mgr.14146) 367 : cluster [DBG] pgmap v327: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:37.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:37 smithi096 bash[15117]: cluster 2021-07-26T15:56:36.139682+0000 mon.a (mon.0) 656 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-07-26T15:56:37.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:37 smithi096 bash[15117]: audit 2021-07-26T15:56:36.419688+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:37.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:37 smithi096 bash[15117]: audit 2021-07-26T15:56:36.422613+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:37.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:37 smithi096 bash[15117]: audit 2021-07-26T15:56:36.715776+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2021-07-26T15:56:37.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:37 smithi096 bash[15117]: cluster 2021-07-26T15:56:36.715938+0000 mon.a (mon.0) 660 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-07-26T15:56:37.355 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2021-07-26T15:56:37.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[14790]: cluster 2021-07-26T15:56:35.632463+0000 mgr.y (mgr.14146) 367 : cluster [DBG] pgmap v327: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:37.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[14790]: cluster 2021-07-26T15:56:36.139682+0000 mon.a (mon.0) 656 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-07-26T15:56:37.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[14790]: audit 2021-07-26T15:56:36.419688+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:37.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[14790]: audit 2021-07-26T15:56:36.422613+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:37.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[14790]: audit 2021-07-26T15:56:36.715776+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2021-07-26T15:56:37.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[14790]: cluster 2021-07-26T15:56:36.715938+0000 mon.a (mon.0) 660 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-07-26T15:56:37.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[19094]: cluster 2021-07-26T15:56:35.632463+0000 mgr.y (mgr.14146) 367 : cluster [DBG] pgmap v327: 9 pgs: 9 active+clean; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:37.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[19094]: cluster 2021-07-26T15:56:36.139682+0000 mon.a (mon.0) 656 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-07-26T15:56:37.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[19094]: audit 2021-07-26T15:56:36.419688+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:37.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[19094]: audit 2021-07-26T15:56:36.422613+0000 mon.a (mon.0) 658 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:56:37.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[19094]: audit 2021-07-26T15:56:36.715776+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "unique_pool_0", "pg_num": 16, "pgp_num": 16, "pool_type": "erasure", "erasure_code_profile": "teuthologyprofile"}]': finished 2021-07-26T15:56:37.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:37 smithi033 bash[19094]: cluster 2021-07-26T15:56:36.715938+0000 mon.a (mon.0) 660 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-07-26T15:56:38.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:38 smithi033 bash[14790]: cephadm 2021-07-26T15:56:36.420391+0000 mgr.y (mgr.14146) 368 : cephadm [INF] Upgrade: Target is version 17.0.0-6381-gbccf07c2 (unknown) 2021-07-26T15:56:38.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:38 smithi033 bash[14790]: cephadm 2021-07-26T15:56:36.420588+0000 mgr.y (mgr.14146) 369 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f'] 2021-07-26T15:56:38.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:38 smithi033 bash[14790]: cephadm 2021-07-26T15:56:36.424694+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:56:38.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:38 smithi033 bash[14790]: cephadm 2021-07-26T15:56:36.682855+0000 mgr.y (mgr.14146) 371 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f on smithi096 2021-07-26T15:56:38.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:38 smithi033 bash[14790]: cluster 2021-07-26T15:56:37.723132+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-07-26T15:56:38.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:38 smithi033 bash[19094]: cephadm 2021-07-26T15:56:36.420391+0000 mgr.y (mgr.14146) 368 : cephadm [INF] Upgrade: Target is version 17.0.0-6381-gbccf07c2 (unknown) 2021-07-26T15:56:38.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:38 smithi033 bash[19094]: cephadm 2021-07-26T15:56:36.420588+0000 mgr.y (mgr.14146) 369 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f'] 2021-07-26T15:56:38.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:38 smithi033 bash[19094]: cephadm 2021-07-26T15:56:36.424694+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:56:38.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:38 smithi033 bash[19094]: cephadm 2021-07-26T15:56:36.682855+0000 mgr.y (mgr.14146) 371 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f on smithi096 2021-07-26T15:56:38.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:38 smithi033 bash[19094]: cluster 2021-07-26T15:56:37.723132+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-07-26T15:56:38.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:38 smithi096 bash[15117]: cephadm 2021-07-26T15:56:36.420391+0000 mgr.y (mgr.14146) 368 : cephadm [INF] Upgrade: Target is version 17.0.0-6381-gbccf07c2 (unknown) 2021-07-26T15:56:38.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:38 smithi096 bash[15117]: cephadm 2021-07-26T15:56:36.420588+0000 mgr.y (mgr.14146) 369 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f'] 2021-07-26T15:56:38.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:38 smithi096 bash[15117]: cephadm 2021-07-26T15:56:36.424694+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:56:38.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:38 smithi096 bash[15117]: cephadm 2021-07-26T15:56:36.682855+0000 mgr.y (mgr.14146) 371 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f on smithi096 2021-07-26T15:56:38.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:38 smithi096 bash[15117]: cluster 2021-07-26T15:56:37.723132+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-07-26T15:56:39.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:39 smithi033 bash[14790]: cluster 2021-07-26T15:56:37.633269+0000 mgr.y (mgr.14146) 372 : cluster [DBG] pgmap v330: 25 pgs: 4 creating+peering, 9 active+clean, 12 unknown; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:39.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:39 smithi033 bash[14790]: cluster 2021-07-26T15:56:38.723899+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-07-26T15:56:39.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:39 smithi033 bash[19094]: cluster 2021-07-26T15:56:37.633269+0000 mgr.y (mgr.14146) 372 : cluster [DBG] pgmap v330: 25 pgs: 4 creating+peering, 9 active+clean, 12 unknown; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:39.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:39 smithi033 bash[19094]: cluster 2021-07-26T15:56:38.723899+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-07-26T15:56:39.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:39 smithi096 bash[15117]: cluster 2021-07-26T15:56:37.633269+0000 mgr.y (mgr.14146) 372 : cluster [DBG] pgmap v330: 25 pgs: 4 creating+peering, 9 active+clean, 12 unknown; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:39.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:39 smithi096 bash[15117]: cluster 2021-07-26T15:56:38.723899+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-07-26T15:56:40.132 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T15:56:41.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:41 smithi033 bash[14790]: cluster 2021-07-26T15:56:39.633837+0000 mgr.y (mgr.14146) 373 : cluster [DBG] pgmap v333: 25 pgs: 4 creating+peering, 10 active+clean, 11 unknown; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:41.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:41 smithi033 bash[19094]: cluster 2021-07-26T15:56:39.633837+0000 mgr.y (mgr.14146) 373 : cluster [DBG] pgmap v333: 25 pgs: 4 creating+peering, 10 active+clean, 11 unknown; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:41.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:41 smithi096 bash[15117]: cluster 2021-07-26T15:56:39.633837+0000 mgr.y (mgr.14146) 373 : cluster [DBG] pgmap v333: 25 pgs: 4 creating+peering, 10 active+clean, 11 unknown; 0 B data, 43 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:43.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:43 smithi033 bash[14790]: cluster 2021-07-26T15:56:41.634627+0000 mgr.y (mgr.14146) 374 : cluster [DBG] pgmap v334: 25 pgs: 4 creating+peering, 21 active+clean; 0 B data, 44 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:43.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:43 smithi033 bash[19094]: cluster 2021-07-26T15:56:41.634627+0000 mgr.y (mgr.14146) 374 : cluster [DBG] pgmap v334: 25 pgs: 4 creating+peering, 21 active+clean; 0 B data, 44 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:43.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:43 smithi096 bash[15117]: cluster 2021-07-26T15:56:41.634627+0000 mgr.y (mgr.14146) 374 : cluster [DBG] pgmap v334: 25 pgs: 4 creating+peering, 21 active+clean; 0 B data, 44 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:43.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:56:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:56:43.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:56:43.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:56:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:56:43.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:56:43.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:56:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:56:43.508Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=1 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T15:56:44.183 INFO:teuthology.orchestra.run.smithi033.stderr:enabled application 'rados' on pool 'unique_pool_0' 2021-07-26T15:56:44.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:44 smithi033 bash[19094]: audit 2021-07-26T15:56:43.609197+0000 mon.a (mon.0) 663 : audit [INF] from='client.? 172.21.15.33:0/3543361167' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:56:44.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:44 smithi033 bash[14790]: audit 2021-07-26T15:56:43.609197+0000 mon.a (mon.0) 663 : audit [INF] from='client.? 172.21.15.33:0/3543361167' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:56:44.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:44 smithi096 bash[15117]: audit 2021-07-26T15:56:43.609197+0000 mon.a (mon.0) 663 : audit [INF] from='client.? 172.21.15.33:0/3543361167' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:56:45.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:45 smithi033 bash[14790]: cluster 2021-07-26T15:56:43.635246+0000 mgr.y (mgr.14146) 375 : cluster [DBG] pgmap v335: 25 pgs: 25 active+clean; 0 B data, 44 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:45.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:45 smithi033 bash[14790]: audit 2021-07-26T15:56:44.177219+0000 mon.a (mon.0) 664 : audit [INF] from='client.? 172.21.15.33:0/3543361167' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-07-26T15:56:45.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:45 smithi033 bash[14790]: cluster 2021-07-26T15:56:44.177363+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-07-26T15:56:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:45 smithi033 bash[19094]: cluster 2021-07-26T15:56:43.635246+0000 mgr.y (mgr.14146) 375 : cluster [DBG] pgmap v335: 25 pgs: 25 active+clean; 0 B data, 44 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:45 smithi033 bash[19094]: audit 2021-07-26T15:56:44.177219+0000 mon.a (mon.0) 664 : audit [INF] from='client.? 172.21.15.33:0/3543361167' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-07-26T15:56:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:45 smithi033 bash[19094]: cluster 2021-07-26T15:56:44.177363+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-07-26T15:56:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:45 smithi096 bash[15117]: cluster 2021-07-26T15:56:43.635246+0000 mgr.y (mgr.14146) 375 : cluster [DBG] pgmap v335: 25 pgs: 25 active+clean; 0 B data, 44 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:45 smithi096 bash[15117]: audit 2021-07-26T15:56:44.177219+0000 mon.a (mon.0) 664 : audit [INF] from='client.? 172.21.15.33:0/3543361167' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "unique_pool_0", "app": "rados", "yes_i_really_mean_it": true}]': finished 2021-07-26T15:56:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:45 smithi096 bash[15117]: cluster 2021-07-26T15:56:44.177363+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-07-26T15:56:45.872 DEBUG:teuthology.orchestra.run.smithi033:> CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 0 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op append 100 --pool unique_pool_0 2021-07-26T15:56:45.892 INFO:tasks.rados.rados.0.smithi033.stdout:adding op weight read -> 100 2021-07-26T15:56:45.893 INFO:tasks.rados.rados.0.smithi033.stdout:adding op weight delete -> 50 2021-07-26T15:56:45.893 INFO:tasks.rados.rados.0.smithi033.stdout:adding op weight snap_create -> 50 2021-07-26T15:56:45.893 INFO:tasks.rados.rados.0.smithi033.stdout:adding op weight snap_remove -> 50 2021-07-26T15:56:45.893 INFO:tasks.rados.rados.0.smithi033.stdout:adding op weight rollback -> 50 2021-07-26T15:56:45.894 INFO:tasks.rados.rados.0.smithi033.stdout:adding op weight setattr -> 25 2021-07-26T15:56:45.894 INFO:tasks.rados.rados.0.smithi033.stdout:adding op weight rmattr -> 25 2021-07-26T15:56:45.894 INFO:tasks.rados.rados.0.smithi033.stdout:adding op weight copy_from -> 50 2021-07-26T15:56:45.894 INFO:tasks.rados.rados.0.smithi033.stdout:adding op weight append -> 100 2021-07-26T15:56:45.895 INFO:tasks.rados.rados.0.smithi033.stdout:ceph version 16.2.5-102-gc6a1fa5a (c6a1fa5a5e06fd971d97a2404f2b028c091eb255) pacific (stable) 2021-07-26T15:56:45.895 INFO:tasks.rados.rados.0.smithi033.stdout:Configuration: 2021-07-26T15:56:45.895 INFO:tasks.rados.rados.0.smithi033.stdout: Number of operations: 4000 2021-07-26T15:56:45.895 INFO:tasks.rados.rados.0.smithi033.stdout: Number of objects: 50 2021-07-26T15:56:45.895 INFO:tasks.rados.rados.0.smithi033.stdout: Max in flight operations: 16 2021-07-26T15:56:45.896 INFO:tasks.rados.rados.0.smithi033.stdout: Object size (in bytes): 4000000 2021-07-26T15:56:45.896 INFO:tasks.rados.rados.0.smithi033.stdout: Write stride min: 400000 2021-07-26T15:56:45.896 INFO:tasks.rados.rados.0.smithi033.stdout: Write stride max: 800000 2021-07-26T15:56:46.191 INFO:tasks.rados.rados.0.smithi033.stdout:1: write initial oid 1 2021-07-26T15:56:46.191 INFO:tasks.rados.rados.0.smithi033.stdout:1: seq_num 0 ranges {0=24576} 2021-07-26T15:56:46.191 INFO:tasks.rados.rados.0.smithi033.stdout:1: writing smithi03339061-1 from 0 to 24576 tid 1 2021-07-26T15:56:46.192 INFO:tasks.rados.rados.0.smithi033.stdout:2: write initial oid 2 2021-07-26T15:56:46.192 INFO:tasks.rados.rados.0.smithi033.stdout:2: seq_num 1 ranges {0=24576} 2021-07-26T15:56:46.192 INFO:tasks.rados.rados.0.smithi033.stdout:2: writing smithi03339061-2 from 0 to 24576 tid 1 2021-07-26T15:56:46.192 INFO:tasks.rados.rados.0.smithi033.stdout:3: write initial oid 3 2021-07-26T15:56:46.192 INFO:tasks.rados.rados.0.smithi033.stdout:3: seq_num 2 ranges {0=40960} 2021-07-26T15:56:46.194 INFO:tasks.rados.rados.0.smithi033.stdout:3: writing smithi03339061-3 from 0 to 40960 tid 1 2021-07-26T15:56:46.194 INFO:tasks.rados.rados.0.smithi033.stdout:4: write initial oid 4 2021-07-26T15:56:46.194 INFO:tasks.rados.rados.0.smithi033.stdout:4: seq_num 3 ranges {0=57344} 2021-07-26T15:56:46.194 INFO:tasks.rados.rados.0.smithi033.stdout:4: writing smithi03339061-4 from 0 to 57344 tid 1 2021-07-26T15:56:46.195 INFO:tasks.rados.rados.0.smithi033.stdout:5: write initial oid 5 2021-07-26T15:56:46.195 INFO:tasks.rados.rados.0.smithi033.stdout:5: seq_num 4 ranges {0=73728} 2021-07-26T15:56:46.195 INFO:tasks.rados.rados.0.smithi033.stdout:5: writing smithi03339061-5 from 0 to 73728 tid 1 2021-07-26T15:56:46.195 INFO:tasks.rados.rados.0.smithi033.stdout:6: write initial oid 6 2021-07-26T15:56:46.195 INFO:tasks.rados.rados.0.smithi033.stdout:6: seq_num 5 ranges {0=90112} 2021-07-26T15:56:46.196 INFO:tasks.rados.rados.0.smithi033.stdout:6: writing smithi03339061-6 from 0 to 90112 tid 1 2021-07-26T15:56:46.197 INFO:tasks.rados.rados.0.smithi033.stdout:7: write initial oid 7 2021-07-26T15:56:46.197 INFO:tasks.rados.rados.0.smithi033.stdout:7: seq_num 6 ranges {0=106496} 2021-07-26T15:56:46.197 INFO:tasks.rados.rados.0.smithi033.stdout:7: writing smithi03339061-7 from 0 to 106496 tid 1 2021-07-26T15:56:46.197 INFO:tasks.rados.rados.0.smithi033.stdout:8: write initial oid 8 2021-07-26T15:56:46.197 INFO:tasks.rados.rados.0.smithi033.stdout:8: seq_num 7 ranges {0=122880} 2021-07-26T15:56:46.198 INFO:tasks.rados.rados.0.smithi033.stdout:8: writing smithi03339061-8 from 0 to 122880 tid 1 2021-07-26T15:56:46.199 INFO:tasks.rados.rados.0.smithi033.stdout:9: write initial oid 9 2021-07-26T15:56:46.199 INFO:tasks.rados.rados.0.smithi033.stdout:9: seq_num 8 ranges {0=139264} 2021-07-26T15:56:46.199 INFO:tasks.rados.rados.0.smithi033.stdout:9: writing smithi03339061-9 from 0 to 139264 tid 1 2021-07-26T15:56:46.199 INFO:tasks.rados.rados.0.smithi033.stdout:10: write initial oid 10 2021-07-26T15:56:46.200 INFO:tasks.rados.rados.0.smithi033.stdout:10: seq_num 9 ranges {0=155648} 2021-07-26T15:56:46.201 INFO:tasks.rados.rados.0.smithi033.stdout:10: writing smithi03339061-10 from 0 to 155648 tid 1 2021-07-26T15:56:46.201 INFO:tasks.rados.rados.0.smithi033.stdout:11: write initial oid 11 2021-07-26T15:56:46.201 INFO:tasks.rados.rados.0.smithi033.stdout:11: seq_num 10 ranges {0=172032} 2021-07-26T15:56:46.202 INFO:tasks.rados.rados.0.smithi033.stdout:11: writing smithi03339061-11 from 0 to 172032 tid 1 2021-07-26T15:56:46.202 INFO:tasks.rados.rados.0.smithi033.stdout:12: write initial oid 12 2021-07-26T15:56:46.202 INFO:tasks.rados.rados.0.smithi033.stdout:12: seq_num 11 ranges {0=188416} 2021-07-26T15:56:46.203 INFO:tasks.rados.rados.0.smithi033.stdout:12: writing smithi03339061-12 from 0 to 188416 tid 1 2021-07-26T15:56:46.203 INFO:tasks.rados.rados.0.smithi033.stdout:13: write initial oid 13 2021-07-26T15:56:46.203 INFO:tasks.rados.rados.0.smithi033.stdout:13: seq_num 12 ranges {0=204800} 2021-07-26T15:56:46.205 INFO:tasks.rados.rados.0.smithi033.stdout:13: writing smithi03339061-13 from 0 to 204800 tid 1 2021-07-26T15:56:46.205 INFO:tasks.rados.rados.0.smithi033.stdout:14: write initial oid 14 2021-07-26T15:56:46.205 INFO:tasks.rados.rados.0.smithi033.stdout:14: seq_num 13 ranges {0=221184} 2021-07-26T15:56:46.207 INFO:tasks.rados.rados.0.smithi033.stdout:14: writing smithi03339061-14 from 0 to 221184 tid 1 2021-07-26T15:56:46.207 INFO:tasks.rados.rados.0.smithi033.stdout:15: write initial oid 15 2021-07-26T15:56:46.207 INFO:tasks.rados.rados.0.smithi033.stdout:15: seq_num 14 ranges {0=237568} 2021-07-26T15:56:46.209 INFO:tasks.rados.rados.0.smithi033.stdout:15: writing smithi03339061-15 from 0 to 237568 tid 1 2021-07-26T15:56:46.210 INFO:tasks.rados.rados.0.smithi033.stdout:16: write initial oid 16 2021-07-26T15:56:46.211 INFO:tasks.rados.rados.0.smithi033.stdout:16: seq_num 15 ranges {0=253952} 2021-07-26T15:56:46.213 INFO:tasks.rados.rados.0.smithi033.stdout:16: writing smithi03339061-16 from 0 to 253952 tid 1 2021-07-26T15:56:46.213 INFO:tasks.rados.rados.0.smithi033.stdout: waiting on 16 2021-07-26T15:56:46.214 INFO:tasks.rados.rados.0.smithi033.stdout:1: finishing write tid 1 to smithi03339061-1 2021-07-26T15:56:46.214 INFO:tasks.rados.rados.0.smithi033.stdout:3: finishing write tid 1 to smithi03339061-3 2021-07-26T15:56:46.214 INFO:tasks.rados.rados.0.smithi033.stdout:2: finishing write tid 1 to smithi03339061-2 2021-07-26T15:56:46.214 INFO:tasks.rados.rados.0.smithi033.stdout:1: finishing write tid 2 to smithi03339061-1 2021-07-26T15:56:46.214 INFO:tasks.rados.rados.0.smithi033.stdout:2: finishing write tid 2 to smithi03339061-2 2021-07-26T15:56:46.215 INFO:tasks.rados.rados.0.smithi033.stdout:5: finishing write tid 1 to smithi03339061-5 2021-07-26T15:56:46.215 INFO:tasks.rados.rados.0.smithi033.stdout:3: finishing write tid 2 to smithi03339061-3 2021-07-26T15:56:46.216 INFO:tasks.rados.rados.0.smithi033.stdout:4: finishing write tid 1 to smithi03339061-4 2021-07-26T15:56:46.216 INFO:tasks.rados.rados.0.smithi033.stdout:3: finishing write tid 3 to smithi03339061-3 2021-07-26T15:56:46.216 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 2 (ObjNum 2 snap 0 seq_num 2) dirty exists 2021-07-26T15:56:46.216 INFO:tasks.rados.rados.0.smithi033.stdout:3: left oid 3 (ObjNum 2 snap 0 seq_num 2) 2021-07-26T15:56:46.217 INFO:tasks.rados.rados.0.smithi033.stdout:1: finishing write tid 3 to smithi03339061-1 2021-07-26T15:56:46.217 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 2 (ObjNum 0 snap 0 seq_num 0) dirty exists 2021-07-26T15:56:46.217 INFO:tasks.rados.rados.0.smithi033.stdout:1: left oid 1 (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:56:46.217 INFO:tasks.rados.rados.0.smithi033.stdout:6: finishing write tid 1 to smithi03339061-6 2021-07-26T15:56:46.218 INFO:tasks.rados.rados.0.smithi033.stdout:10: finishing write tid 1 to smithi03339061-10 2021-07-26T15:56:46.218 INFO:tasks.rados.rados.0.smithi033.stdout:4: finishing write tid 2 to smithi03339061-4 2021-07-26T15:56:46.218 INFO:tasks.rados.rados.0.smithi033.stdout:5: finishing write tid 2 to smithi03339061-5 2021-07-26T15:56:46.218 INFO:tasks.rados.rados.0.smithi033.stdout:2: finishing write tid 3 to smithi03339061-2 2021-07-26T15:56:46.219 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2021-07-26T15:56:46.219 INFO:tasks.rados.rados.0.smithi033.stdout:2: left oid 2 (ObjNum 1 snap 0 seq_num 1) 2021-07-26T15:56:46.219 INFO:tasks.rados.rados.0.smithi033.stdout:7: finishing write tid 1 to smithi03339061-7 2021-07-26T15:56:46.219 INFO:tasks.rados.rados.0.smithi033.stdout:6: finishing write tid 2 to smithi03339061-6 2021-07-26T15:56:46.219 INFO:tasks.rados.rados.0.smithi033.stdout:8: finishing write tid 1 to smithi03339061-8 2021-07-26T15:56:46.220 INFO:tasks.rados.rados.0.smithi033.stdout:12: finishing write tid 1 to smithi03339061-12 2021-07-26T15:56:46.220 INFO:tasks.rados.rados.0.smithi033.stdout:5: finishing write tid 3 to smithi03339061-5 2021-07-26T15:56:46.220 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 2 (ObjNum 4 snap 0 seq_num 4) dirty exists 2021-07-26T15:56:46.220 INFO:tasks.rados.rados.0.smithi033.stdout:5: left oid 5 (ObjNum 4 snap 0 seq_num 4) 2021-07-26T15:56:46.220 INFO:tasks.rados.rados.0.smithi033.stdout:7: finishing write tid 2 to smithi03339061-7 2021-07-26T15:56:46.221 INFO:tasks.rados.rados.0.smithi033.stdout:6: finishing write tid 3 to smithi03339061-6 2021-07-26T15:56:46.221 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 2 (ObjNum 5 snap 0 seq_num 5) dirty exists 2021-07-26T15:56:46.221 INFO:tasks.rados.rados.0.smithi033.stdout:6: left oid 6 (ObjNum 5 snap 0 seq_num 5) 2021-07-26T15:56:46.221 INFO:tasks.rados.rados.0.smithi033.stdout:9: finishing write tid 1 to smithi03339061-9 2021-07-26T15:56:46.222 INFO:tasks.rados.rados.0.smithi033.stdout:4: finishing write tid 3 to smithi03339061-4 2021-07-26T15:56:46.222 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 2 (ObjNum 3 snap 0 seq_num 3) dirty exists 2021-07-26T15:56:46.222 INFO:tasks.rados.rados.0.smithi033.stdout:4: left oid 4 (ObjNum 3 snap 0 seq_num 3) 2021-07-26T15:56:46.222 INFO:tasks.rados.rados.0.smithi033.stdout:10: finishing write tid 2 to smithi03339061-10 2021-07-26T15:56:46.222 INFO:tasks.rados.rados.0.smithi033.stdout:12: finishing write tid 2 to smithi03339061-12 2021-07-26T15:56:46.223 INFO:tasks.rados.rados.0.smithi033.stdout:1: done (15 left) 2021-07-26T15:56:46.223 INFO:tasks.rados.rados.0.smithi033.stdout:2: done (14 left) 2021-07-26T15:56:46.223 INFO:tasks.rados.rados.0.smithi033.stdout:3: done (13 left) 2021-07-26T15:56:46.223 INFO:tasks.rados.rados.0.smithi033.stdout:4: done (12 left) 2021-07-26T15:56:46.223 INFO:tasks.rados.rados.0.smithi033.stdout:5: done (11 left) 2021-07-26T15:56:46.224 INFO:tasks.rados.rados.0.smithi033.stdout:6: done (10 left) 2021-07-26T15:56:46.224 INFO:tasks.rados.rados.0.smithi033.stdout:17: write initial oid 17 2021-07-26T15:56:46.224 INFO:tasks.rados.rados.0.smithi033.stdout:17: seq_num 16 ranges {0=270336} 2021-07-26T15:56:46.229 INFO:tasks.rados.rados.0.smithi033.stdout:17: writing smithi03339061-17 from 0 to 270336 tid 1 2021-07-26T15:56:46.229 INFO:tasks.rados.rados.0.smithi033.stdout:18: write initial oid 18 2021-07-26T15:56:46.230 INFO:tasks.rados.rados.0.smithi033.stdout:18: seq_num 17 ranges {0=286720} 2021-07-26T15:56:46.230 INFO:tasks.rados.rados.0.smithi033.stdout:18: writing smithi03339061-18 from 0 to 286720 tid 1 2021-07-26T15:56:46.230 INFO:tasks.rados.rados.0.smithi033.stdout:19: write initial oid 19 2021-07-26T15:56:46.230 INFO:tasks.rados.rados.0.smithi033.stdout:19: seq_num 18 ranges {0=303104} 2021-07-26T15:56:46.231 INFO:tasks.rados.rados.0.smithi033.stdout:19: writing smithi03339061-19 from 0 to 303104 tid 1 2021-07-26T15:56:46.231 INFO:tasks.rados.rados.0.smithi033.stdout:20: write initial oid 20 2021-07-26T15:56:46.231 INFO:tasks.rados.rados.0.smithi033.stdout:20: seq_num 19 ranges {0=319488} 2021-07-26T15:56:46.231 INFO:tasks.rados.rados.0.smithi033.stdout:20: writing smithi03339061-20 from 0 to 319488 tid 1 2021-07-26T15:56:46.232 INFO:tasks.rados.rados.0.smithi033.stdout:21: write initial oid 21 2021-07-26T15:56:46.233 INFO:tasks.rados.rados.0.smithi033.stdout:21: seq_num 20 ranges {0=344064} 2021-07-26T15:56:46.233 INFO:tasks.rados.rados.0.smithi033.stdout:21: writing smithi03339061-21 from 0 to 344064 tid 1 2021-07-26T15:56:46.233 INFO:tasks.rados.rados.0.smithi033.stdout:22: write initial oid 22 2021-07-26T15:56:46.234 INFO:tasks.rados.rados.0.smithi033.stdout:22: seq_num 21 ranges {0=360448} 2021-07-26T15:56:46.234 INFO:tasks.rados.rados.0.smithi033.stdout:22: writing smithi03339061-22 from 0 to 360448 tid 1 2021-07-26T15:56:46.234 INFO:tasks.rados.rados.0.smithi033.stdout: waiting on 16 2021-07-26T15:56:46.234 INFO:tasks.rados.rados.0.smithi033.stdout:7: finishing write tid 3 to smithi03339061-7 2021-07-26T15:56:46.234 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 2 (ObjNum 6 snap 0 seq_num 6) dirty exists 2021-07-26T15:56:46.235 INFO:tasks.rados.rados.0.smithi033.stdout:7: left oid 7 (ObjNum 6 snap 0 seq_num 6) 2021-07-26T15:56:46.235 INFO:tasks.rados.rados.0.smithi033.stdout:10: finishing write tid 3 to smithi03339061-10 2021-07-26T15:56:46.235 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 2 (ObjNum 9 snap 0 seq_num 9) dirty exists 2021-07-26T15:56:46.235 INFO:tasks.rados.rados.0.smithi033.stdout:10: left oid 10 (ObjNum 9 snap 0 seq_num 9) 2021-07-26T15:56:46.236 INFO:tasks.rados.rados.0.smithi033.stdout:11: finishing write tid 1 to smithi03339061-11 2021-07-26T15:56:46.236 INFO:tasks.rados.rados.0.smithi033.stdout:8: finishing write tid 2 to smithi03339061-8 2021-07-26T15:56:46.236 INFO:tasks.rados.rados.0.smithi033.stdout:12: finishing write tid 3 to smithi03339061-12 2021-07-26T15:56:46.236 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 4 (ObjNum 11 snap 0 seq_num 11) dirty exists 2021-07-26T15:56:46.236 INFO:tasks.rados.rados.0.smithi033.stdout:12: left oid 12 (ObjNum 11 snap 0 seq_num 11) 2021-07-26T15:56:46.237 INFO:tasks.rados.rados.0.smithi033.stdout:13: finishing write tid 1 to smithi03339061-13 2021-07-26T15:56:46.237 INFO:tasks.rados.rados.0.smithi033.stdout:11: finishing write tid 2 to smithi03339061-11 2021-07-26T15:56:46.237 INFO:tasks.rados.rados.0.smithi033.stdout:16: finishing write tid 1 to smithi03339061-16 2021-07-26T15:56:46.237 INFO:tasks.rados.rados.0.smithi033.stdout:15: finishing write tid 1 to smithi03339061-15 2021-07-26T15:56:46.237 INFO:tasks.rados.rados.0.smithi033.stdout:11: finishing write tid 3 to smithi03339061-11 2021-07-26T15:56:46.238 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 2 (ObjNum 10 snap 0 seq_num 10) dirty exists 2021-07-26T15:56:46.238 INFO:tasks.rados.rados.0.smithi033.stdout:11: left oid 11 (ObjNum 10 snap 0 seq_num 10) 2021-07-26T15:56:46.238 INFO:tasks.rados.rados.0.smithi033.stdout:14: finishing write tid 1 to smithi03339061-14 2021-07-26T15:56:46.238 INFO:tasks.rados.rados.0.smithi033.stdout:9: finishing write tid 2 to smithi03339061-9 2021-07-26T15:56:46.238 INFO:tasks.rados.rados.0.smithi033.stdout:15: finishing write tid 2 to smithi03339061-15 2021-07-26T15:56:46.239 INFO:tasks.rados.rados.0.smithi033.stdout:16: finishing write tid 2 to smithi03339061-16 2021-07-26T15:56:46.239 INFO:tasks.rados.rados.0.smithi033.stdout:8: finishing write tid 3 to smithi03339061-8 2021-07-26T15:56:46.239 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 3 (ObjNum 7 snap 0 seq_num 7) dirty exists 2021-07-26T15:56:46.239 INFO:tasks.rados.rados.0.smithi033.stdout:8: left oid 8 (ObjNum 7 snap 0 seq_num 7) 2021-07-26T15:56:46.241 INFO:tasks.rados.rados.0.smithi033.stdout:17: finishing write tid 1 to smithi03339061-17 2021-07-26T15:56:46.241 INFO:tasks.rados.rados.0.smithi033.stdout:13: finishing write tid 2 to smithi03339061-13 2021-07-26T15:56:46.242 INFO:tasks.rados.rados.0.smithi033.stdout:15: finishing write tid 3 to smithi03339061-15 2021-07-26T15:56:46.242 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 2 (ObjNum 14 snap 0 seq_num 14) dirty exists 2021-07-26T15:56:46.242 INFO:tasks.rados.rados.0.smithi033.stdout:15: left oid 15 (ObjNum 14 snap 0 seq_num 14) 2021-07-26T15:56:46.242 INFO:tasks.rados.rados.0.smithi033.stdout:16: finishing write tid 3 to smithi03339061-16 2021-07-26T15:56:46.243 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 2 (ObjNum 15 snap 0 seq_num 15) dirty exists 2021-07-26T15:56:46.243 INFO:tasks.rados.rados.0.smithi033.stdout:16: left oid 16 (ObjNum 15 snap 0 seq_num 15) 2021-07-26T15:56:46.243 INFO:tasks.rados.rados.0.smithi033.stdout:18: finishing write tid 1 to smithi03339061-18 2021-07-26T15:56:46.243 INFO:tasks.rados.rados.0.smithi033.stdout:14: finishing write tid 2 to smithi03339061-14 2021-07-26T15:56:46.243 INFO:tasks.rados.rados.0.smithi033.stdout:9: finishing write tid 3 to smithi03339061-9 2021-07-26T15:56:46.244 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 4 (ObjNum 8 snap 0 seq_num 8) dirty exists 2021-07-26T15:56:46.244 INFO:tasks.rados.rados.0.smithi033.stdout:9: left oid 9 (ObjNum 8 snap 0 seq_num 8) 2021-07-26T15:56:46.244 INFO:tasks.rados.rados.0.smithi033.stdout:18: finishing write tid 2 to smithi03339061-18 2021-07-26T15:56:46.244 INFO:tasks.rados.rados.0.smithi033.stdout:17: finishing write tid 2 to smithi03339061-17 2021-07-26T15:56:46.244 INFO:tasks.rados.rados.0.smithi033.stdout:19: finishing write tid 1 to smithi03339061-19 2021-07-26T15:56:46.245 INFO:tasks.rados.rados.0.smithi033.stdout:13: finishing write tid 3 to smithi03339061-13 2021-07-26T15:56:46.245 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 5 (ObjNum 12 snap 0 seq_num 12) dirty exists 2021-07-26T15:56:46.245 INFO:tasks.rados.rados.0.smithi033.stdout:13: left oid 13 (ObjNum 12 snap 0 seq_num 12) 2021-07-26T15:56:46.245 INFO:tasks.rados.rados.0.smithi033.stdout:17: finishing write tid 3 to smithi03339061-17 2021-07-26T15:56:46.246 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 2 (ObjNum 16 snap 0 seq_num 16) dirty exists 2021-07-26T15:56:46.246 INFO:tasks.rados.rados.0.smithi033.stdout:17: left oid 17 (ObjNum 16 snap 0 seq_num 16) 2021-07-26T15:56:46.246 INFO:tasks.rados.rados.0.smithi033.stdout:19: finishing write tid 2 to smithi03339061-19 2021-07-26T15:56:46.247 INFO:tasks.rados.rados.0.smithi033.stdout:14: finishing write tid 3 to smithi03339061-14 2021-07-26T15:56:46.247 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 6 (ObjNum 13 snap 0 seq_num 13) dirty exists 2021-07-26T15:56:46.247 INFO:tasks.rados.rados.0.smithi033.stdout:14: left oid 14 (ObjNum 13 snap 0 seq_num 13) 2021-07-26T15:56:46.247 INFO:tasks.rados.rados.0.smithi033.stdout:18: finishing write tid 3 to smithi03339061-18 2021-07-26T15:56:46.247 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 4 (ObjNum 17 snap 0 seq_num 17) dirty exists 2021-07-26T15:56:46.248 INFO:tasks.rados.rados.0.smithi033.stdout:18: left oid 18 (ObjNum 17 snap 0 seq_num 17) 2021-07-26T15:56:46.248 INFO:tasks.rados.rados.0.smithi033.stdout:20: finishing write tid 1 to smithi03339061-20 2021-07-26T15:56:46.248 INFO:tasks.rados.rados.0.smithi033.stdout:19: finishing write tid 3 to smithi03339061-19 2021-07-26T15:56:46.248 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 6 (ObjNum 18 snap 0 seq_num 18) dirty exists 2021-07-26T15:56:46.248 INFO:tasks.rados.rados.0.smithi033.stdout:19: left oid 19 (ObjNum 18 snap 0 seq_num 18) 2021-07-26T15:56:46.249 INFO:tasks.rados.rados.0.smithi033.stdout:7: done (15 left) 2021-07-26T15:56:46.249 INFO:tasks.rados.rados.0.smithi033.stdout:8: done (14 left) 2021-07-26T15:56:46.249 INFO:tasks.rados.rados.0.smithi033.stdout:9: done (13 left) 2021-07-26T15:56:46.249 INFO:tasks.rados.rados.0.smithi033.stdout:10: done (12 left) 2021-07-26T15:56:46.249 INFO:tasks.rados.rados.0.smithi033.stdout:11: done (11 left) 2021-07-26T15:56:46.250 INFO:tasks.rados.rados.0.smithi033.stdout:12: done (10 left) 2021-07-26T15:56:46.250 INFO:tasks.rados.rados.0.smithi033.stdout:13: done (9 left) 2021-07-26T15:56:46.250 INFO:tasks.rados.rados.0.smithi033.stdout:14: done (8 left) 2021-07-26T15:56:46.250 INFO:tasks.rados.rados.0.smithi033.stdout:15: done (7 left) 2021-07-26T15:56:46.251 INFO:tasks.rados.rados.0.smithi033.stdout:16: done (6 left) 2021-07-26T15:56:46.251 INFO:tasks.rados.rados.0.smithi033.stdout:17: done (5 left) 2021-07-26T15:56:46.251 INFO:tasks.rados.rados.0.smithi033.stdout:18: done (4 left) 2021-07-26T15:56:46.251 INFO:tasks.rados.rados.0.smithi033.stdout:19: done (3 left) 2021-07-26T15:56:46.251 INFO:tasks.rados.rados.0.smithi033.stdout:23: write initial oid 23 2021-07-26T15:56:46.252 INFO:tasks.rados.rados.0.smithi033.stdout:23: seq_num 22 ranges {0=376832} 2021-07-26T15:56:46.252 INFO:tasks.rados.rados.0.smithi033.stdout:23: writing smithi03339061-23 from 0 to 376832 tid 1 2021-07-26T15:56:46.252 INFO:tasks.rados.rados.0.smithi033.stdout:24: write initial oid 24 2021-07-26T15:56:46.252 INFO:tasks.rados.rados.0.smithi033.stdout:24: seq_num 23 ranges {0=393216} 2021-07-26T15:56:46.255 INFO:tasks.rados.rados.0.smithi033.stdout:24: writing smithi03339061-24 from 0 to 393216 tid 1 2021-07-26T15:56:46.255 INFO:tasks.rados.rados.0.smithi033.stdout:25: write initial oid 25 2021-07-26T15:56:46.255 INFO:tasks.rados.rados.0.smithi033.stdout:25: seq_num 24 ranges {0=409600} 2021-07-26T15:56:46.255 INFO:tasks.rados.rados.0.smithi033.stdout:25: writing smithi03339061-25 from 0 to 409600 tid 1 2021-07-26T15:56:46.256 INFO:tasks.rados.rados.0.smithi033.stdout:26: write initial oid 26 2021-07-26T15:56:46.256 INFO:tasks.rados.rados.0.smithi033.stdout:26: seq_num 25 ranges {0=425984} 2021-07-26T15:56:46.256 INFO:tasks.rados.rados.0.smithi033.stdout:26: writing smithi03339061-26 from 0 to 425984 tid 1 2021-07-26T15:56:46.256 INFO:tasks.rados.rados.0.smithi033.stdout:27: write initial oid 27 2021-07-26T15:56:46.257 INFO:tasks.rados.rados.0.smithi033.stdout:27: seq_num 26 ranges {0=442368} 2021-07-26T15:56:46.257 INFO:tasks.rados.rados.0.smithi033.stdout:27: writing smithi03339061-27 from 0 to 442368 tid 1 2021-07-26T15:56:46.257 INFO:tasks.rados.rados.0.smithi033.stdout:28: write initial oid 28 2021-07-26T15:56:46.257 INFO:tasks.rados.rados.0.smithi033.stdout:28: seq_num 27 ranges {0=458752} 2021-07-26T15:56:46.257 INFO:tasks.rados.rados.0.smithi033.stdout:28: writing smithi03339061-28 from 0 to 458752 tid 1 2021-07-26T15:56:46.258 INFO:tasks.rados.rados.0.smithi033.stdout:29: write initial oid 29 2021-07-26T15:56:46.258 INFO:tasks.rados.rados.0.smithi033.stdout:29: seq_num 28 ranges {0=475136} 2021-07-26T15:56:46.258 INFO:tasks.rados.rados.0.smithi033.stdout:29: writing smithi03339061-29 from 0 to 475136 tid 1 2021-07-26T15:56:46.258 INFO:tasks.rados.rados.0.smithi033.stdout:30: write initial oid 30 2021-07-26T15:56:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:30: seq_num 29 ranges {0=491520} 2021-07-26T15:56:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:30: writing smithi03339061-30 from 0 to 491520 tid 1 2021-07-26T15:56:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:31: write initial oid 31 2021-07-26T15:56:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:31: seq_num 30 ranges {0=507904} 2021-07-26T15:56:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:31: writing smithi03339061-31 from 0 to 507904 tid 1 2021-07-26T15:56:46.260 INFO:tasks.rados.rados.0.smithi033.stdout:32: write initial oid 32 2021-07-26T15:56:46.260 INFO:tasks.rados.rados.0.smithi033.stdout:32: seq_num 31 ranges {0=524288} 2021-07-26T15:56:46.260 INFO:tasks.rados.rados.0.smithi033.stdout:32: writing smithi03339061-32 from 0 to 524288 tid 1 2021-07-26T15:56:46.261 INFO:tasks.rados.rados.0.smithi033.stdout:33: write initial oid 33 2021-07-26T15:56:46.261 INFO:tasks.rados.rados.0.smithi033.stdout:33: seq_num 32 ranges {0=540672} 2021-07-26T15:56:46.262 INFO:tasks.rados.rados.0.smithi033.stdout:33: writing smithi03339061-33 from 0 to 540672 tid 1 2021-07-26T15:56:46.262 INFO:tasks.rados.rados.0.smithi033.stdout:34: write initial oid 34 2021-07-26T15:56:46.262 INFO:tasks.rados.rados.0.smithi033.stdout:34: seq_num 33 ranges {0=557056} 2021-07-26T15:56:46.265 INFO:tasks.rados.rados.0.smithi033.stdout:34: writing smithi03339061-34 from 0 to 557056 tid 1 2021-07-26T15:56:46.266 INFO:tasks.rados.rados.0.smithi033.stdout:21: finishing write tid 1 to smithi03339061-21 2021-07-26T15:56:46.266 INFO:tasks.rados.rados.0.smithi033.stdout:35: write initial oid 35 2021-07-26T15:56:46.266 INFO:tasks.rados.rados.0.smithi033.stdout:35: seq_num 34 ranges {0=573440} 2021-07-26T15:56:46.270 INFO:tasks.rados.rados.0.smithi033.stdout:35: writing smithi03339061-35 from 0 to 573440 tid 1 2021-07-26T15:56:46.270 INFO:tasks.rados.rados.0.smithi033.stdout: waiting on 16 2021-07-26T15:56:46.270 INFO:tasks.rados.rados.0.smithi033.stdout:20: finishing write tid 2 to smithi03339061-20 2021-07-26T15:56:46.270 INFO:tasks.rados.rados.0.smithi033.stdout:21: finishing write tid 2 to smithi03339061-21 2021-07-26T15:56:46.271 INFO:tasks.rados.rados.0.smithi033.stdout:20: finishing write tid 3 to smithi03339061-20 2021-07-26T15:56:46.271 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 8 (ObjNum 19 snap 0 seq_num 19) dirty exists 2021-07-26T15:56:46.271 INFO:tasks.rados.rados.0.smithi033.stdout:20: left oid 20 (ObjNum 19 snap 0 seq_num 19) 2021-07-26T15:56:46.271 INFO:tasks.rados.rados.0.smithi033.stdout:22: finishing write tid 1 to smithi03339061-22 2021-07-26T15:56:46.271 INFO:tasks.rados.rados.0.smithi033.stdout:20: done (15 left) 2021-07-26T15:56:46.272 INFO:tasks.rados.rados.0.smithi033.stdout:36: write initial oid 36 2021-07-26T15:56:46.272 INFO:tasks.rados.rados.0.smithi033.stdout:36: seq_num 35 ranges {0=589824} 2021-07-26T15:56:46.274 INFO:tasks.rados.rados.0.smithi033.stdout:36: writing smithi03339061-36 from 0 to 589824 tid 1 2021-07-26T15:56:46.275 INFO:tasks.rados.rados.0.smithi033.stdout: waiting on 16 2021-07-26T15:56:46.275 INFO:tasks.rados.rados.0.smithi033.stdout:21: finishing write tid 3 to smithi03339061-21 2021-07-26T15:56:46.275 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 4 (ObjNum 20 snap 0 seq_num 20) dirty exists 2021-07-26T15:56:46.275 INFO:tasks.rados.rados.0.smithi033.stdout:21: left oid 21 (ObjNum 20 snap 0 seq_num 20) 2021-07-26T15:56:46.276 INFO:tasks.rados.rados.0.smithi033.stdout:21: done (15 left) 2021-07-26T15:56:46.276 INFO:tasks.rados.rados.0.smithi033.stdout:37: write initial oid 37 2021-07-26T15:56:46.276 INFO:tasks.rados.rados.0.smithi033.stdout:37: seq_num 36 ranges {0=606208} 2021-07-26T15:56:46.278 INFO:tasks.rados.rados.0.smithi033.stdout:37: writing smithi03339061-37 from 0 to 606208 tid 1 2021-07-26T15:56:46.278 INFO:tasks.rados.rados.0.smithi033.stdout: waiting on 16 2021-07-26T15:56:46.278 INFO:tasks.rados.rados.0.smithi033.stdout:22: finishing write tid 2 to smithi03339061-22 2021-07-26T15:56:46.278 INFO:tasks.rados.rados.0.smithi033.stdout:22: finishing write tid 3 to smithi03339061-22 2021-07-26T15:56:46.279 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 6 (ObjNum 21 snap 0 seq_num 21) dirty exists 2021-07-26T15:56:46.279 INFO:tasks.rados.rados.0.smithi033.stdout:22: left oid 22 (ObjNum 21 snap 0 seq_num 21) 2021-07-26T15:56:46.279 INFO:tasks.rados.rados.0.smithi033.stdout:23: finishing write tid 1 to smithi03339061-23 2021-07-26T15:56:46.279 INFO:tasks.rados.rados.0.smithi033.stdout:22: done (15 left) 2021-07-26T15:56:46.279 INFO:tasks.rados.rados.0.smithi033.stdout:38: write initial oid 38 2021-07-26T15:56:46.280 INFO:tasks.rados.rados.0.smithi033.stdout:38: seq_num 37 ranges {0=622592} 2021-07-26T15:56:46.283 INFO:tasks.rados.rados.0.smithi033.stdout:38: writing smithi03339061-38 from 0 to 622592 tid 1 2021-07-26T15:56:46.283 INFO:tasks.rados.rados.0.smithi033.stdout: waiting on 16 2021-07-26T15:56:46.283 INFO:tasks.rados.rados.0.smithi033.stdout:23: finishing write tid 2 to smithi03339061-23 2021-07-26T15:56:46.284 INFO:tasks.rados.rados.0.smithi033.stdout:24: finishing write tid 1 to smithi03339061-24 2021-07-26T15:56:46.285 INFO:tasks.rados.rados.0.smithi033.stdout:23: finishing write tid 3 to smithi03339061-23 2021-07-26T15:56:46.285 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 6 (ObjNum 22 snap 0 seq_num 22) dirty exists 2021-07-26T15:56:46.285 INFO:tasks.rados.rados.0.smithi033.stdout:23: left oid 23 (ObjNum 22 snap 0 seq_num 22) 2021-07-26T15:56:46.286 INFO:tasks.rados.rados.0.smithi033.stdout:24: finishing write tid 2 to smithi03339061-24 2021-07-26T15:56:46.287 INFO:tasks.rados.rados.0.smithi033.stdout:25: finishing write tid 1 to smithi03339061-25 2021-07-26T15:56:46.287 INFO:tasks.rados.rados.0.smithi033.stdout:24: finishing write tid 3 to smithi03339061-24 2021-07-26T15:56:46.287 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 4 (ObjNum 23 snap 0 seq_num 23) dirty exists 2021-07-26T15:56:46.287 INFO:tasks.rados.rados.0.smithi033.stdout:24: left oid 24 (ObjNum 23 snap 0 seq_num 23) 2021-07-26T15:56:46.288 INFO:tasks.rados.rados.0.smithi033.stdout:25: finishing write tid 2 to smithi03339061-25 2021-07-26T15:56:46.288 INFO:tasks.rados.rados.0.smithi033.stdout:26: finishing write tid 1 to smithi03339061-26 2021-07-26T15:56:46.288 INFO:tasks.rados.rados.0.smithi033.stdout:25: finishing write tid 3 to smithi03339061-25 2021-07-26T15:56:46.288 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 4 (ObjNum 24 snap 0 seq_num 24) dirty exists 2021-07-26T15:56:46.288 INFO:tasks.rados.rados.0.smithi033.stdout:25: left oid 25 (ObjNum 24 snap 0 seq_num 24) 2021-07-26T15:56:46.289 INFO:tasks.rados.rados.0.smithi033.stdout:26: finishing write tid 2 to smithi03339061-26 2021-07-26T15:56:46.289 INFO:tasks.rados.rados.0.smithi033.stdout:27: finishing write tid 1 to smithi03339061-27 2021-07-26T15:56:46.289 INFO:tasks.rados.rados.0.smithi033.stdout:26: finishing write tid 3 to smithi03339061-26 2021-07-26T15:56:46.289 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 8 (ObjNum 25 snap 0 seq_num 25) dirty exists 2021-07-26T15:56:46.289 INFO:tasks.rados.rados.0.smithi033.stdout:26: left oid 26 (ObjNum 25 snap 0 seq_num 25) 2021-07-26T15:56:46.290 INFO:tasks.rados.rados.0.smithi033.stdout:27: finishing write tid 2 to smithi03339061-27 2021-07-26T15:56:46.290 INFO:tasks.rados.rados.0.smithi033.stdout:27: finishing write tid 3 to smithi03339061-27 2021-07-26T15:56:46.290 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 8 (ObjNum 26 snap 0 seq_num 26) dirty exists 2021-07-26T15:56:46.290 INFO:tasks.rados.rados.0.smithi033.stdout:27: left oid 27 (ObjNum 26 snap 0 seq_num 26) 2021-07-26T15:56:46.291 INFO:tasks.rados.rados.0.smithi033.stdout:28: finishing write tid 1 to smithi03339061-28 2021-07-26T15:56:46.291 INFO:tasks.rados.rados.0.smithi033.stdout:28: finishing write tid 2 to smithi03339061-28 2021-07-26T15:56:46.291 INFO:tasks.rados.rados.0.smithi033.stdout:29: finishing write tid 1 to smithi03339061-29 2021-07-26T15:56:46.291 INFO:tasks.rados.rados.0.smithi033.stdout:28: finishing write tid 3 to smithi03339061-28 2021-07-26T15:56:46.291 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 6 (ObjNum 27 snap 0 seq_num 27) dirty exists 2021-07-26T15:56:46.292 INFO:tasks.rados.rados.0.smithi033.stdout:28: left oid 28 (ObjNum 27 snap 0 seq_num 27) 2021-07-26T15:56:46.292 INFO:tasks.rados.rados.0.smithi033.stdout:29: finishing write tid 2 to smithi03339061-29 2021-07-26T15:56:46.292 INFO:tasks.rados.rados.0.smithi033.stdout:30: finishing write tid 1 to smithi03339061-30 2021-07-26T15:56:46.292 INFO:tasks.rados.rados.0.smithi033.stdout:29: finishing write tid 3 to smithi03339061-29 2021-07-26T15:56:46.293 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 2 (ObjNum 28 snap 0 seq_num 28) dirty exists 2021-07-26T15:56:46.293 INFO:tasks.rados.rados.0.smithi033.stdout:29: left oid 29 (ObjNum 28 snap 0 seq_num 28) 2021-07-26T15:56:46.293 INFO:tasks.rados.rados.0.smithi033.stdout:30: finishing write tid 2 to smithi03339061-30 2021-07-26T15:56:46.293 INFO:tasks.rados.rados.0.smithi033.stdout:30: finishing write tid 3 to smithi03339061-30 2021-07-26T15:56:46.293 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 6 (ObjNum 29 snap 0 seq_num 29) dirty exists 2021-07-26T15:56:46.294 INFO:tasks.rados.rados.0.smithi033.stdout:30: left oid 30 (ObjNum 29 snap 0 seq_num 29) 2021-07-26T15:56:46.294 INFO:tasks.rados.rados.0.smithi033.stdout:31: finishing write tid 1 to smithi03339061-31 2021-07-26T15:56:46.294 INFO:tasks.rados.rados.0.smithi033.stdout:31: finishing write tid 2 to smithi03339061-31 2021-07-26T15:56:46.294 INFO:tasks.rados.rados.0.smithi033.stdout:32: finishing write tid 1 to smithi03339061-32 2021-07-26T15:56:46.294 INFO:tasks.rados.rados.0.smithi033.stdout:31: finishing write tid 3 to smithi03339061-31 2021-07-26T15:56:46.295 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 2 (ObjNum 30 snap 0 seq_num 30) dirty exists 2021-07-26T15:56:46.295 INFO:tasks.rados.rados.0.smithi033.stdout:31: left oid 31 (ObjNum 30 snap 0 seq_num 30) 2021-07-26T15:56:46.295 INFO:tasks.rados.rados.0.smithi033.stdout:32: finishing write tid 2 to smithi03339061-32 2021-07-26T15:56:46.295 INFO:tasks.rados.rados.0.smithi033.stdout:32: finishing write tid 3 to smithi03339061-32 2021-07-26T15:56:46.296 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 6 (ObjNum 31 snap 0 seq_num 31) dirty exists 2021-07-26T15:56:46.296 INFO:tasks.rados.rados.0.smithi033.stdout:32: left oid 32 (ObjNum 31 snap 0 seq_num 31) 2021-07-26T15:56:46.296 INFO:tasks.rados.rados.0.smithi033.stdout:33: finishing write tid 1 to smithi03339061-33 2021-07-26T15:56:46.296 INFO:tasks.rados.rados.0.smithi033.stdout:23: done (15 left) 2021-07-26T15:56:46.296 INFO:tasks.rados.rados.0.smithi033.stdout:24: done (14 left) 2021-07-26T15:56:46.297 INFO:tasks.rados.rados.0.smithi033.stdout:25: done (13 left) 2021-07-26T15:56:46.297 INFO:tasks.rados.rados.0.smithi033.stdout:26: done (12 left) 2021-07-26T15:56:46.297 INFO:tasks.rados.rados.0.smithi033.stdout:27: done (11 left) 2021-07-26T15:56:46.297 INFO:tasks.rados.rados.0.smithi033.stdout:28: done (10 left) 2021-07-26T15:56:46.297 INFO:tasks.rados.rados.0.smithi033.stdout:29: done (9 left) 2021-07-26T15:56:46.298 INFO:tasks.rados.rados.0.smithi033.stdout:30: done (8 left) 2021-07-26T15:56:46.298 INFO:tasks.rados.rados.0.smithi033.stdout:31: done (7 left) 2021-07-26T15:56:46.298 INFO:tasks.rados.rados.0.smithi033.stdout:32: done (6 left) 2021-07-26T15:56:46.298 INFO:tasks.rados.rados.0.smithi033.stdout:39: write initial oid 39 2021-07-26T15:56:46.299 INFO:tasks.rados.rados.0.smithi033.stdout:39: seq_num 38 ranges {0=638976} 2021-07-26T15:56:46.300 INFO:tasks.rados.rados.0.smithi033.stdout:39: writing smithi03339061-39 from 0 to 638976 tid 1 2021-07-26T15:56:46.300 INFO:tasks.rados.rados.0.smithi033.stdout:40: write initial oid 40 2021-07-26T15:56:46.301 INFO:tasks.rados.rados.0.smithi033.stdout:40: seq_num 39 ranges {0=663552} 2021-07-26T15:56:46.301 INFO:tasks.rados.rados.0.smithi033.stdout:40: writing smithi03339061-40 from 0 to 663552 tid 1 2021-07-26T15:56:46.301 INFO:tasks.rados.rados.0.smithi033.stdout:41: write initial oid 41 2021-07-26T15:56:46.301 INFO:tasks.rados.rados.0.smithi033.stdout:41: seq_num 40 ranges {0=679936} 2021-07-26T15:56:46.301 INFO:tasks.rados.rados.0.smithi033.stdout:41: writing smithi03339061-41 from 0 to 679936 tid 1 2021-07-26T15:56:46.302 INFO:tasks.rados.rados.0.smithi033.stdout:42: write initial oid 42 2021-07-26T15:56:46.302 INFO:tasks.rados.rados.0.smithi033.stdout:42: seq_num 41 ranges {0=696320} 2021-07-26T15:56:46.302 INFO:tasks.rados.rados.0.smithi033.stdout:42: writing smithi03339061-42 from 0 to 696320 tid 1 2021-07-26T15:56:46.302 INFO:tasks.rados.rados.0.smithi033.stdout:43: write initial oid 43 2021-07-26T15:56:46.303 INFO:tasks.rados.rados.0.smithi033.stdout:43: seq_num 42 ranges {0=712704} 2021-07-26T15:56:46.304 INFO:tasks.rados.rados.0.smithi033.stdout:43: writing smithi03339061-43 from 0 to 712704 tid 1 2021-07-26T15:56:46.304 INFO:tasks.rados.rados.0.smithi033.stdout:44: write initial oid 44 2021-07-26T15:56:46.305 INFO:tasks.rados.rados.0.smithi033.stdout:44: seq_num 43 ranges {0=729088} 2021-07-26T15:56:46.309 INFO:tasks.rados.rados.0.smithi033.stdout:44: writing smithi03339061-44 from 0 to 729088 tid 1 2021-07-26T15:56:46.309 INFO:tasks.rados.rados.0.smithi033.stdout:45: write initial oid 45 2021-07-26T15:56:46.309 INFO:tasks.rados.rados.0.smithi033.stdout:45: seq_num 44 ranges {0=745472} 2021-07-26T15:56:46.314 INFO:tasks.rados.rados.0.smithi033.stdout:45: writing smithi03339061-45 from 0 to 745472 tid 1 2021-07-26T15:56:46.314 INFO:tasks.rados.rados.0.smithi033.stdout:46: write initial oid 46 2021-07-26T15:56:46.314 INFO:tasks.rados.rados.0.smithi033.stdout:46: seq_num 45 ranges {0=761856} 2021-07-26T15:56:46.319 INFO:tasks.rados.rados.0.smithi033.stdout:46: writing smithi03339061-46 from 0 to 761856 tid 1 2021-07-26T15:56:46.320 INFO:tasks.rados.rados.0.smithi033.stdout:47: write initial oid 47 2021-07-26T15:56:46.320 INFO:tasks.rados.rados.0.smithi033.stdout:47: seq_num 46 ranges {0=778240} 2021-07-26T15:56:46.324 INFO:tasks.rados.rados.0.smithi033.stdout:47: writing smithi03339061-47 from 0 to 778240 tid 1 2021-07-26T15:56:46.325 INFO:tasks.rados.rados.0.smithi033.stdout:48: write initial oid 48 2021-07-26T15:56:46.325 INFO:tasks.rados.rados.0.smithi033.stdout:48: seq_num 47 ranges {0=794624} 2021-07-26T15:56:46.330 INFO:tasks.rados.rados.0.smithi033.stdout:48: writing smithi03339061-48 from 0 to 794624 tid 1 2021-07-26T15:56:46.330 INFO:tasks.rados.rados.0.smithi033.stdout: waiting on 16 2021-07-26T15:56:46.330 INFO:tasks.rados.rados.0.smithi033.stdout:33: finishing write tid 2 to smithi03339061-33 2021-07-26T15:56:46.331 INFO:tasks.rados.rados.0.smithi033.stdout:33: finishing write tid 3 to smithi03339061-33 2021-07-26T15:56:46.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 10 (ObjNum 32 snap 0 seq_num 32) dirty exists 2021-07-26T15:56:46.331 INFO:tasks.rados.rados.0.smithi033.stdout:33: left oid 33 (ObjNum 32 snap 0 seq_num 32) 2021-07-26T15:56:46.332 INFO:tasks.rados.rados.0.smithi033.stdout:33: done (15 left) 2021-07-26T15:56:46.332 INFO:tasks.rados.rados.0.smithi033.stdout:49: write initial oid 49 2021-07-26T15:56:46.332 INFO:tasks.rados.rados.0.smithi033.stdout:49: seq_num 48 ranges {0=409600,409600=401408} 2021-07-26T15:56:46.333 INFO:tasks.rados.rados.0.smithi033.stdout:49: writing smithi03339061-49 from 0 to 409600 tid 1 2021-07-26T15:56:46.337 INFO:tasks.rados.rados.0.smithi033.stdout:49: writing smithi03339061-49 from 409600 to 811008 tid 2 2021-07-26T15:56:46.337 INFO:tasks.rados.rados.0.smithi033.stdout: waiting on 16 2021-07-26T15:56:46.337 INFO:tasks.rados.rados.0.smithi033.stdout:34: finishing write tid 1 to smithi03339061-34 2021-07-26T15:56:46.338 INFO:tasks.rados.rados.0.smithi033.stdout:34: finishing write tid 2 to smithi03339061-34 2021-07-26T15:56:46.338 INFO:tasks.rados.rados.0.smithi033.stdout:34: finishing write tid 3 to smithi03339061-34 2021-07-26T15:56:46.338 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 4 (ObjNum 33 snap 0 seq_num 33) dirty exists 2021-07-26T15:56:46.338 INFO:tasks.rados.rados.0.smithi033.stdout:34: left oid 34 (ObjNum 33 snap 0 seq_num 33) 2021-07-26T15:56:46.338 INFO:tasks.rados.rados.0.smithi033.stdout:35: finishing write tid 1 to smithi03339061-35 2021-07-26T15:56:46.339 INFO:tasks.rados.rados.0.smithi033.stdout:35: finishing write tid 2 to smithi03339061-35 2021-07-26T15:56:46.339 INFO:tasks.rados.rados.0.smithi033.stdout:35: finishing write tid 3 to smithi03339061-35 2021-07-26T15:56:46.339 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 8 (ObjNum 34 snap 0 seq_num 34) dirty exists 2021-07-26T15:56:46.339 INFO:tasks.rados.rados.0.smithi033.stdout:35: left oid 35 (ObjNum 34 snap 0 seq_num 34) 2021-07-26T15:56:46.340 INFO:tasks.rados.rados.0.smithi033.stdout:36: finishing write tid 1 to smithi03339061-36 2021-07-26T15:56:46.340 INFO:tasks.rados.rados.0.smithi033.stdout:36: finishing write tid 2 to smithi03339061-36 2021-07-26T15:56:46.340 INFO:tasks.rados.rados.0.smithi033.stdout:36: finishing write tid 3 to smithi03339061-36 2021-07-26T15:56:46.340 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 6 (ObjNum 35 snap 0 seq_num 35) dirty exists 2021-07-26T15:56:46.340 INFO:tasks.rados.rados.0.smithi033.stdout:36: left oid 36 (ObjNum 35 snap 0 seq_num 35) 2021-07-26T15:56:46.341 INFO:tasks.rados.rados.0.smithi033.stdout:37: finishing write tid 1 to smithi03339061-37 2021-07-26T15:56:46.341 INFO:tasks.rados.rados.0.smithi033.stdout:37: finishing write tid 2 to smithi03339061-37 2021-07-26T15:56:46.341 INFO:tasks.rados.rados.0.smithi033.stdout:37: finishing write tid 3 to smithi03339061-37 2021-07-26T15:56:46.341 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 8 (ObjNum 36 snap 0 seq_num 36) dirty exists 2021-07-26T15:56:46.341 INFO:tasks.rados.rados.0.smithi033.stdout:37: left oid 37 (ObjNum 36 snap 0 seq_num 36) 2021-07-26T15:56:46.342 INFO:tasks.rados.rados.0.smithi033.stdout:38: finishing write tid 1 to smithi03339061-38 2021-07-26T15:56:46.342 INFO:tasks.rados.rados.0.smithi033.stdout:38: finishing write tid 2 to smithi03339061-38 2021-07-26T15:56:46.342 INFO:tasks.rados.rados.0.smithi033.stdout:38: finishing write tid 3 to smithi03339061-38 2021-07-26T15:56:46.342 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 2 (ObjNum 37 snap 0 seq_num 37) dirty exists 2021-07-26T15:56:46.343 INFO:tasks.rados.rados.0.smithi033.stdout:38: left oid 38 (ObjNum 37 snap 0 seq_num 37) 2021-07-26T15:56:46.343 INFO:tasks.rados.rados.0.smithi033.stdout:39: finishing write tid 1 to smithi03339061-39 2021-07-26T15:56:46.343 INFO:tasks.rados.rados.0.smithi033.stdout:39: finishing write tid 2 to smithi03339061-39 2021-07-26T15:56:46.343 INFO:tasks.rados.rados.0.smithi033.stdout:39: finishing write tid 3 to smithi03339061-39 2021-07-26T15:56:46.344 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 10 (ObjNum 38 snap 0 seq_num 38) dirty exists 2021-07-26T15:56:46.344 INFO:tasks.rados.rados.0.smithi033.stdout:39: left oid 39 (ObjNum 38 snap 0 seq_num 38) 2021-07-26T15:56:46.344 INFO:tasks.rados.rados.0.smithi033.stdout:40: finishing write tid 1 to smithi03339061-40 2021-07-26T15:56:46.344 INFO:tasks.rados.rados.0.smithi033.stdout:40: finishing write tid 2 to smithi03339061-40 2021-07-26T15:56:46.345 INFO:tasks.rados.rados.0.smithi033.stdout:40: finishing write tid 3 to smithi03339061-40 2021-07-26T15:56:46.345 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 4 (ObjNum 39 snap 0 seq_num 39) dirty exists 2021-07-26T15:56:46.345 INFO:tasks.rados.rados.0.smithi033.stdout:40: left oid 40 (ObjNum 39 snap 0 seq_num 39) 2021-07-26T15:56:46.345 INFO:tasks.rados.rados.0.smithi033.stdout:41: finishing write tid 1 to smithi03339061-41 2021-07-26T15:56:46.345 INFO:tasks.rados.rados.0.smithi033.stdout:41: finishing write tid 2 to smithi03339061-41 2021-07-26T15:56:46.346 INFO:tasks.rados.rados.0.smithi033.stdout:41: finishing write tid 3 to smithi03339061-41 2021-07-26T15:56:46.346 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 4 (ObjNum 40 snap 0 seq_num 40) dirty exists 2021-07-26T15:56:46.346 INFO:tasks.rados.rados.0.smithi033.stdout:41: left oid 41 (ObjNum 40 snap 0 seq_num 40) 2021-07-26T15:56:46.346 INFO:tasks.rados.rados.0.smithi033.stdout:42: finishing write tid 1 to smithi03339061-42 2021-07-26T15:56:46.346 INFO:tasks.rados.rados.0.smithi033.stdout:42: finishing write tid 2 to smithi03339061-42 2021-07-26T15:56:46.347 INFO:tasks.rados.rados.0.smithi033.stdout:43: finishing write tid 1 to smithi03339061-43 2021-07-26T15:56:46.347 INFO:tasks.rados.rados.0.smithi033.stdout:42: finishing write tid 3 to smithi03339061-42 2021-07-26T15:56:46.347 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 4 (ObjNum 41 snap 0 seq_num 41) dirty exists 2021-07-26T15:56:46.348 INFO:tasks.rados.rados.0.smithi033.stdout:42: left oid 42 (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:56:46.348 INFO:tasks.rados.rados.0.smithi033.stdout:43: finishing write tid 2 to smithi03339061-43 2021-07-26T15:56:46.348 INFO:tasks.rados.rados.0.smithi033.stdout:43: finishing write tid 3 to smithi03339061-43 2021-07-26T15:56:46.348 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 6 (ObjNum 42 snap 0 seq_num 42) dirty exists 2021-07-26T15:56:46.348 INFO:tasks.rados.rados.0.smithi033.stdout:43: left oid 43 (ObjNum 42 snap 0 seq_num 42) 2021-07-26T15:56:46.349 INFO:tasks.rados.rados.0.smithi033.stdout:44: finishing write tid 1 to smithi03339061-44 2021-07-26T15:56:46.349 INFO:tasks.rados.rados.0.smithi033.stdout:44: finishing write tid 2 to smithi03339061-44 2021-07-26T15:56:46.349 INFO:tasks.rados.rados.0.smithi033.stdout:45: finishing write tid 1 to smithi03339061-45 2021-07-26T15:56:46.349 INFO:tasks.rados.rados.0.smithi033.stdout:44: finishing write tid 3 to smithi03339061-44 2021-07-26T15:56:46.349 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 10 (ObjNum 43 snap 0 seq_num 43) dirty exists 2021-07-26T15:56:46.350 INFO:tasks.rados.rados.0.smithi033.stdout:44: left oid 44 (ObjNum 43 snap 0 seq_num 43) 2021-07-26T15:56:46.350 INFO:tasks.rados.rados.0.smithi033.stdout:45: finishing write tid 2 to smithi03339061-45 2021-07-26T15:56:46.350 INFO:tasks.rados.rados.0.smithi033.stdout:45: finishing write tid 3 to smithi03339061-45 2021-07-26T15:56:46.350 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 12 (ObjNum 44 snap 0 seq_num 44) dirty exists 2021-07-26T15:56:46.351 INFO:tasks.rados.rados.0.smithi033.stdout:45: left oid 45 (ObjNum 44 snap 0 seq_num 44) 2021-07-26T15:56:46.351 INFO:tasks.rados.rados.0.smithi033.stdout:46: finishing write tid 1 to smithi03339061-46 2021-07-26T15:56:46.351 INFO:tasks.rados.rados.0.smithi033.stdout:46: finishing write tid 2 to smithi03339061-46 2021-07-26T15:56:46.351 INFO:tasks.rados.rados.0.smithi033.stdout:46: finishing write tid 3 to smithi03339061-46 2021-07-26T15:56:46.351 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 4 (ObjNum 45 snap 0 seq_num 45) dirty exists 2021-07-26T15:56:46.352 INFO:tasks.rados.rados.0.smithi033.stdout:46: left oid 46 (ObjNum 45 snap 0 seq_num 45) 2021-07-26T15:56:46.352 INFO:tasks.rados.rados.0.smithi033.stdout:47: finishing write tid 1 to smithi03339061-47 2021-07-26T15:56:46.352 INFO:tasks.rados.rados.0.smithi033.stdout:47: finishing write tid 2 to smithi03339061-47 2021-07-26T15:56:46.352 INFO:tasks.rados.rados.0.smithi033.stdout:47: finishing write tid 3 to smithi03339061-47 2021-07-26T15:56:46.352 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 10 (ObjNum 46 snap 0 seq_num 46) dirty exists 2021-07-26T15:56:46.353 INFO:tasks.rados.rados.0.smithi033.stdout:47: left oid 47 (ObjNum 46 snap 0 seq_num 46) 2021-07-26T15:56:46.353 INFO:tasks.rados.rados.0.smithi033.stdout:48: finishing write tid 1 to smithi03339061-48 2021-07-26T15:56:46.353 INFO:tasks.rados.rados.0.smithi033.stdout:34: done (15 left) 2021-07-26T15:56:46.353 INFO:tasks.rados.rados.0.smithi033.stdout:35: done (14 left) 2021-07-26T15:56:46.354 INFO:tasks.rados.rados.0.smithi033.stdout:36: done (13 left) 2021-07-26T15:56:46.354 INFO:tasks.rados.rados.0.smithi033.stdout:37: done (12 left) 2021-07-26T15:56:46.354 INFO:tasks.rados.rados.0.smithi033.stdout:38: done (11 left) 2021-07-26T15:56:46.354 INFO:tasks.rados.rados.0.smithi033.stdout:39: done (10 left) 2021-07-26T15:56:46.354 INFO:tasks.rados.rados.0.smithi033.stdout:40: done (9 left) 2021-07-26T15:56:46.355 INFO:tasks.rados.rados.0.smithi033.stdout:41: done (8 left) 2021-07-26T15:56:46.355 INFO:tasks.rados.rados.0.smithi033.stdout:42: done (7 left) 2021-07-26T15:56:46.355 INFO:tasks.rados.rados.0.smithi033.stdout:43: done (6 left) 2021-07-26T15:56:46.355 INFO:tasks.rados.rados.0.smithi033.stdout:44: done (5 left) 2021-07-26T15:56:46.355 INFO:tasks.rados.rados.0.smithi033.stdout:45: done (4 left) 2021-07-26T15:56:46.356 INFO:tasks.rados.rados.0.smithi033.stdout:46: done (3 left) 2021-07-26T15:56:46.356 INFO:tasks.rados.rados.0.smithi033.stdout:47: done (2 left) 2021-07-26T15:56:46.356 INFO:tasks.rados.rados.0.smithi033.stdout:50: write initial oid 50 2021-07-26T15:56:46.356 INFO:tasks.rados.rados.0.smithi033.stdout:50: seq_num 49 ranges {0=425984,425984=401408} 2021-07-26T15:56:46.360 INFO:tasks.rados.rados.0.smithi033.stdout:50: writing smithi03339061-50 from 0 to 425984 tid 1 2021-07-26T15:56:46.360 INFO:tasks.rados.rados.0.smithi033.stdout:50: writing smithi03339061-50 from 425984 to 827392 tid 2 2021-07-26T15:56:46.360 INFO:tasks.rados.rados.0.smithi033.stdout:51: copy_from oid 13 from oid 26 current snap is 0 2021-07-26T15:56:46.361 INFO:tasks.rados.rados.0.smithi033.stdout:49: finishing write tid 1 to smithi03339061-49 2021-07-26T15:56:46.361 INFO:tasks.rados.rados.0.smithi033.stdout:48: finishing write tid 2 to smithi03339061-48 2021-07-26T15:56:46.361 INFO:tasks.rados.rados.0.smithi033.stdout:48: finishing write tid 3 to smithi03339061-48 2021-07-26T15:56:46.361 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 8 (ObjNum 47 snap 0 seq_num 47) dirty exists 2021-07-26T15:56:46.362 INFO:tasks.rados.rados.0.smithi033.stdout:48: left oid 48 (ObjNum 47 snap 0 seq_num 47) 2021-07-26T15:56:46.362 INFO:tasks.rados.rados.0.smithi033.stdout:49: finishing write tid 2 to smithi03339061-49 2021-07-26T15:56:46.362 INFO:tasks.rados.rados.0.smithi033.stdout:49: finishing write tid 3 to smithi03339061-49 2021-07-26T15:56:46.362 INFO:tasks.rados.rados.0.smithi033.stdout:48: done (3 left) 2021-07-26T15:56:46.362 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 0 2021-07-26T15:56:46.363 INFO:tasks.rados.rados.0.smithi033.stdout:52: seq_num 50 ranges {622592=442368,1064960=401408} 2021-07-26T15:56:46.363 INFO:tasks.rados.rados.0.smithi033.stdout:52: writing smithi03339061-38 from 622592 to 1064960 tid 1 2021-07-26T15:56:46.363 INFO:tasks.rados.rados.0.smithi033.stdout:52: writing smithi03339061-38 from 1064960 to 1466368 tid 2 2021-07-26T15:56:46.363 INFO:tasks.rados.rados.0.smithi033.stdout:49: finishing write tid 4 to smithi03339061-49 2021-07-26T15:56:46.363 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 5 (ObjNum 48 snap 0 seq_num 48) dirty exists 2021-07-26T15:56:46.364 INFO:tasks.rados.rados.0.smithi033.stdout:49: left oid 49 (ObjNum 48 snap 0 seq_num 48) 2021-07-26T15:56:46.364 INFO:tasks.rados.rados.0.smithi033.stdout:50: finishing write tid 1 to smithi03339061-50 2021-07-26T15:56:46.364 INFO:tasks.rados.rados.0.smithi033.stdout:50: finishing write tid 2 to smithi03339061-50 2021-07-26T15:56:46.364 INFO:tasks.rados.rados.0.smithi033.stdout:50: finishing write tid 3 to smithi03339061-50 2021-07-26T15:56:46.365 INFO:tasks.rados.rados.0.smithi033.stdout:51: finishing copy_from to smithi03339061-13 2021-07-26T15:56:46.365 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 8 (ObjNum 25 snap 0 seq_num 25) dirty exists 2021-07-26T15:56:46.365 INFO:tasks.rados.rados.0.smithi033.stdout:51: finishing copy_from racing read to smithi03339061-13 2021-07-26T15:56:46.365 INFO:tasks.rados.rados.0.smithi033.stdout:50: finishing write tid 4 to smithi03339061-50 2021-07-26T15:56:46.365 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 9 (ObjNum 49 snap 0 seq_num 49) dirty exists 2021-07-26T15:56:46.366 INFO:tasks.rados.rados.0.smithi033.stdout:50: left oid 50 (ObjNum 49 snap 0 seq_num 49) 2021-07-26T15:56:46.366 INFO:tasks.rados.rados.0.smithi033.stdout:49: done (3 left) 2021-07-26T15:56:46.366 INFO:tasks.rados.rados.0.smithi033.stdout:50: done (2 left) 2021-07-26T15:56:46.366 INFO:tasks.rados.rados.0.smithi033.stdout:51: done (1 left) 2021-07-26T15:56:46.366 INFO:tasks.rados.rados.0.smithi033.stdout:53: rmattr oid 31 current snap is 0 2021-07-26T15:56:46.367 INFO:tasks.rados.rados.0.smithi033.stdout:53: done (1 left) 2021-07-26T15:56:46.367 INFO:tasks.rados.rados.0.smithi033.stdout:54: delete oid 25 current snap is 0 2021-07-26T15:56:46.367 INFO:tasks.rados.rados.0.smithi033.stdout:54: done (1 left) 2021-07-26T15:56:46.367 INFO:tasks.rados.rados.0.smithi033.stdout:55: read oid 15 snap -1 2021-07-26T15:56:46.367 INFO:tasks.rados.rados.0.smithi033.stdout:55: expect (ObjNum 14 snap 0 seq_num 14) 2021-07-26T15:56:46.368 INFO:tasks.rados.rados.0.smithi033.stdout:56: rollback oid 30 current snap is 0 2021-07-26T15:56:46.368 INFO:tasks.rados.rados.0.smithi033.stdout:56: done (2 left) 2021-07-26T15:56:46.368 INFO:tasks.rados.rados.0.smithi033.stdout:57: read oid 27 snap -1 2021-07-26T15:56:46.368 INFO:tasks.rados.rados.0.smithi033.stdout:57: expect (ObjNum 26 snap 0 seq_num 26) 2021-07-26T15:56:46.369 INFO:tasks.rados.rados.0.smithi033.stdout:58: copy_from oid 28 from oid 47 current snap is 0 2021-07-26T15:56:46.369 INFO:tasks.rados.rados.0.smithi033.stdout:59: rollback oid 45 current snap is 0 2021-07-26T15:56:46.369 INFO:tasks.rados.rados.0.smithi033.stdout:59: done (4 left) 2021-07-26T15:56:46.369 INFO:tasks.rados.rados.0.smithi033.stdout:60: copy_from oid 22 from oid 48 current snap is 0 2021-07-26T15:56:46.369 INFO:tasks.rados.rados.0.smithi033.stdout:61: delete oid 1 current snap is 0 2021-07-26T15:56:46.370 INFO:tasks.rados.rados.0.smithi033.stdout:52: finishing write tid 1 to smithi03339061-38 2021-07-26T15:56:46.370 INFO:tasks.rados.rados.0.smithi033.stdout:52: finishing write tid 2 to smithi03339061-38 2021-07-26T15:56:46.370 INFO:tasks.rados.rados.0.smithi033.stdout:61: done (5 left) 2021-07-26T15:56:46.370 INFO:tasks.rados.rados.0.smithi033.stdout:62: read oid 17 snap -1 2021-07-26T15:56:46.370 INFO:tasks.rados.rados.0.smithi033.stdout:62: expect (ObjNum 16 snap 0 seq_num 16) 2021-07-26T15:56:46.371 INFO:tasks.rados.rados.0.smithi033.stdout:63: snap_create 2021-07-26T15:56:46.371 INFO:tasks.rados.rados.0.smithi033.stdout:52: finishing write tid 3 to smithi03339061-38 2021-07-26T15:56:46.371 INFO:tasks.rados.rados.0.smithi033.stdout:52: finishing write tid 4 to smithi03339061-38 2021-07-26T15:56:46.371 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 5 (ObjNum 50 snap 0 seq_num 50) dirty exists 2021-07-26T15:56:46.371 INFO:tasks.rados.rados.0.smithi033.stdout:52: left oid 38 (ObjNum 50 snap 0 seq_num 50) 2021-07-26T15:56:46.372 INFO:tasks.rados.rados.0.smithi033.stdout:57: expect (ObjNum 26 snap 0 seq_num 26) 2021-07-26T15:56:46.372 INFO:tasks.rados.rados.0.smithi033.stdout:55: expect (ObjNum 14 snap 0 seq_num 14) 2021-07-26T15:56:46.377 INFO:tasks.rados.rados.0.smithi033.stdout:62: expect (ObjNum 16 snap 0 seq_num 16) 2021-07-26T15:56:46.384 INFO:tasks.rados.rados.0.smithi033.stdout:58: finishing copy_from to smithi03339061-28 2021-07-26T15:56:46.384 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 10 (ObjNum 46 snap 0 seq_num 46) dirty exists 2021-07-26T15:56:46.384 INFO:tasks.rados.rados.0.smithi033.stdout:58: finishing copy_from racing read to smithi03339061-28 2021-07-26T15:56:46.385 INFO:tasks.rados.rados.0.smithi033.stdout:60: finishing copy_from to smithi03339061-22 2021-07-26T15:56:46.385 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 8 (ObjNum 47 snap 0 seq_num 47) dirty exists 2021-07-26T15:56:46.385 INFO:tasks.rados.rados.0.smithi033.stdout:60: finishing copy_from racing read to smithi03339061-22 2021-07-26T15:56:46.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:46 smithi033 bash[14790]: cluster 2021-07-26T15:56:45.636014+0000 mgr.y (mgr.14146) 376 : cluster [DBG] pgmap v337: 25 pgs: 25 active+clean; 0 B data, 44 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:46.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:46 smithi033 bash[14790]: audit 2021-07-26T15:56:45.905205+0000 mon.a (mon.0) 666 : audit [INF] from='client.? ' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2021-07-26T15:56:46.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:46 smithi033 bash[14790]: audit 2021-07-26T15:56:45.905497+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.33:0/65585796' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2021-07-26T15:56:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:46 smithi033 bash[19094]: cluster 2021-07-26T15:56:45.636014+0000 mgr.y (mgr.14146) 376 : cluster [DBG] pgmap v337: 25 pgs: 25 active+clean; 0 B data, 44 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:46 smithi033 bash[19094]: audit 2021-07-26T15:56:45.905205+0000 mon.a (mon.0) 666 : audit [INF] from='client.? ' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2021-07-26T15:56:46.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:46 smithi033 bash[19094]: audit 2021-07-26T15:56:45.905497+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.33:0/65585796' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2021-07-26T15:56:46.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:46 smithi096 bash[15117]: cluster 2021-07-26T15:56:45.636014+0000 mgr.y (mgr.14146) 376 : cluster [DBG] pgmap v337: 25 pgs: 25 active+clean; 0 B data, 44 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:46.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:46 smithi096 bash[15117]: audit 2021-07-26T15:56:45.905205+0000 mon.a (mon.0) 666 : audit [INF] from='client.? ' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2021-07-26T15:56:46.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:46 smithi096 bash[15117]: audit 2021-07-26T15:56:45.905497+0000 mon.b (mon.2) 24 : audit [INF] from='client.? 172.21.15.33:0/65585796' entity='client.0' cmd=[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]: dispatch 2021-07-26T15:56:47.193 INFO:tasks.rados.rados.0.smithi033.stdout:52: done (6 left) 2021-07-26T15:56:47.193 INFO:tasks.rados.rados.0.smithi033.stdout:55: done (5 left) 2021-07-26T15:56:47.194 INFO:tasks.rados.rados.0.smithi033.stdout:57: done (4 left) 2021-07-26T15:56:47.194 INFO:tasks.rados.rados.0.smithi033.stdout:58: done (3 left) 2021-07-26T15:56:47.194 INFO:tasks.rados.rados.0.smithi033.stdout:60: done (2 left) 2021-07-26T15:56:47.194 INFO:tasks.rados.rados.0.smithi033.stdout:62: done (1 left) 2021-07-26T15:56:47.195 INFO:tasks.rados.rados.0.smithi033.stdout:63: done (0 left) 2021-07-26T15:56:47.195 INFO:tasks.rados.rados.0.smithi033.stdout:64: copy_from oid 15 from oid 2 current snap is 1 2021-07-26T15:56:47.195 INFO:tasks.rados.rados.0.smithi033.stdout:65: read oid 30 snap -1 2021-07-26T15:56:47.195 INFO:tasks.rados.rados.0.smithi033.stdout:65: expect (ObjNum 29 snap 0 seq_num 29) 2021-07-26T15:56:47.195 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 1 2021-07-26T15:56:47.196 INFO:tasks.rados.rados.0.smithi033.stdout:66: seq_num 53 ranges {376832=491520,868352=401408} 2021-07-26T15:56:47.199 INFO:tasks.rados.rados.0.smithi033.stdout:66: writing smithi03339061-23 from 376832 to 868352 tid 1 2021-07-26T15:56:47.202 INFO:tasks.rados.rados.0.smithi033.stdout:66: writing smithi03339061-23 from 868352 to 1269760 tid 2 2021-07-26T15:56:47.203 INFO:tasks.rados.rados.0.smithi033.stdout:67: rollback oid 10 current snap is 1 2021-07-26T15:56:47.203 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 10 to 0 2021-07-26T15:56:47.203 INFO:tasks.rados.rados.0.smithi033.stdout:68: setattr oid 32 current snap is 1 2021-07-26T15:56:47.205 INFO:tasks.rados.rados.0.smithi033.stdout:69: copy_from oid 7 from oid 17 current snap is 1 2021-07-26T15:56:47.206 INFO:tasks.rados.rados.0.smithi033.stdout:70: read oid 20 snap 0 2021-07-26T15:56:47.206 INFO:tasks.rados.rados.0.smithi033.stdout:70: expect (ObjNum 19 snap 0 seq_num 19) 2021-07-26T15:56:47.206 INFO:tasks.rados.rados.0.smithi033.stdout:71: copy_from oid 24 from oid 29 current snap is 1 2021-07-26T15:56:47.206 INFO:tasks.rados.rados.0.smithi033.stdout:72: rollback oid 6 current snap is 1 2021-07-26T15:56:47.206 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 0 2021-07-26T15:56:47.207 INFO:tasks.rados.rados.0.smithi033.stdout:73: read oid 13 snap 0 2021-07-26T15:56:47.207 INFO:tasks.rados.rados.0.smithi033.stdout:73: expect (ObjNum 25 snap 0 seq_num 25) 2021-07-26T15:56:47.207 INFO:tasks.rados.rados.0.smithi033.stdout:74: rmattr oid 4 current snap is 1 2021-07-26T15:56:47.207 INFO:tasks.rados.rados.0.smithi033.stdout:74: done (10 left) 2021-07-26T15:56:47.208 INFO:tasks.rados.rados.0.smithi033.stdout:75: copy_from oid 48 from oid 1 current snap is 1 2021-07-26T15:56:47.208 INFO:tasks.rados.rados.0.smithi033.stdout:76: read oid 27 snap -1 2021-07-26T15:56:47.208 INFO:tasks.rados.rados.0.smithi033.stdout:76: expect (ObjNum 26 snap 0 seq_num 26) 2021-07-26T15:56:47.208 INFO:tasks.rados.rados.0.smithi033.stdout:77: copy_from oid 28 from oid 34 current snap is 1 2021-07-26T15:56:47.209 INFO:tasks.rados.rados.0.smithi033.stdout:78: read oid 43 snap -1 2021-07-26T15:56:47.209 INFO:tasks.rados.rados.0.smithi033.stdout:78: expect (ObjNum 42 snap 0 seq_num 42) 2021-07-26T15:56:47.209 INFO:tasks.rados.rados.0.smithi033.stdout:79: setattr oid 14 current snap is 1 2021-07-26T15:56:47.209 INFO:tasks.rados.rados.0.smithi033.stdout:65: expect (ObjNum 29 snap 0 seq_num 29) 2021-07-26T15:56:47.225 INFO:tasks.rados.rados.0.smithi033.stdout:64: finishing copy_from to smithi03339061-15 2021-07-26T15:56:47.225 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2021-07-26T15:56:47.226 INFO:tasks.rados.rados.0.smithi033.stdout:64: finishing copy_from racing read to smithi03339061-15 2021-07-26T15:56:47.226 INFO:tasks.rados.rados.0.smithi033.stdout:66: finishing write tid 1 to smithi03339061-23 2021-07-26T15:56:47.226 INFO:tasks.rados.rados.0.smithi033.stdout:75: finishing copy_from to smithi03339061-48 2021-07-26T15:56:47.226 INFO:tasks.rados.rados.0.smithi033.stdout:75: got expected ENOENT (src dne) 2021-07-26T15:56:47.227 INFO:tasks.rados.rados.0.smithi033.stdout:75: finishing copy_from racing read to smithi03339061-48 2021-07-26T15:56:47.227 INFO:tasks.rados.rados.0.smithi033.stdout:70: expect (ObjNum 19 snap 0 seq_num 19) 2021-07-26T15:56:47.235 INFO:tasks.rados.rados.0.smithi033.stdout:66: finishing write tid 2 to smithi03339061-23 2021-07-26T15:56:47.235 INFO:tasks.rados.rados.0.smithi033.stdout:66: finishing write tid 3 to smithi03339061-23 2021-07-26T15:56:47.235 INFO:tasks.rados.rados.0.smithi033.stdout:64: done (14 left) 2021-07-26T15:56:47.236 INFO:tasks.rados.rados.0.smithi033.stdout:65: done (13 left) 2021-07-26T15:56:47.236 INFO:tasks.rados.rados.0.smithi033.stdout:70: done (12 left) 2021-07-26T15:56:47.236 INFO:tasks.rados.rados.0.smithi033.stdout:75: done (11 left) 2021-07-26T15:56:47.236 INFO:tasks.rados.rados.0.smithi033.stdout:80: snap_create 2021-07-26T15:56:47.236 INFO:tasks.rados.rados.0.smithi033.stdout:69: finishing copy_from to smithi03339061-7 2021-07-26T15:56:47.237 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 2 (ObjNum 16 snap 0 seq_num 16) dirty exists 2021-07-26T15:56:47.237 INFO:tasks.rados.rados.0.smithi033.stdout:69: finishing copy_from racing read to smithi03339061-7 2021-07-26T15:56:47.237 INFO:tasks.rados.rados.0.smithi033.stdout:78: expect (ObjNum 42 snap 0 seq_num 42) 2021-07-26T15:56:47.253 INFO:tasks.rados.rados.0.smithi033.stdout:66: finishing write tid 4 to smithi03339061-23 2021-07-26T15:56:47.253 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 14 (ObjNum 53 snap 1 seq_num 53) dirty exists 2021-07-26T15:56:47.254 INFO:tasks.rados.rados.0.smithi033.stdout:66: left oid 23 (ObjNum 53 snap 1 seq_num 53) 2021-07-26T15:56:47.254 INFO:tasks.rados.rados.0.smithi033.stdout:73: expect (ObjNum 25 snap 0 seq_num 25) 2021-07-26T15:56:47.264 INFO:tasks.rados.rados.0.smithi033.stdout:76: expect (ObjNum 26 snap 0 seq_num 26) 2021-07-26T15:56:47.277 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 12 (ObjNum 31 snap 0 seq_num 31) dirty exists 2021-07-26T15:56:47.277 INFO:tasks.rados.rados.0.smithi033.stdout:77: finishing copy_from to smithi03339061-28 2021-07-26T15:56:47.277 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 4 (ObjNum 33 snap 0 seq_num 33) dirty exists 2021-07-26T15:56:47.278 INFO:tasks.rados.rados.0.smithi033.stdout:67: finishing rollback tid 0 to smithi03339061-10 2021-07-26T15:56:47.278 INFO:tasks.rados.rados.0.smithi033.stdout:77: finishing copy_from racing read to smithi03339061-28 2021-07-26T15:56:47.278 INFO:tasks.rados.rados.0.smithi033.stdout:67: finishing rollback tid 1 to smithi03339061-10 2021-07-26T15:56:47.278 INFO:tasks.rados.rados.0.smithi033.stdout:67: finishing rollback tid 2 to smithi03339061-10 2021-07-26T15:56:47.279 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 14 (ObjNum 9 snap 0 seq_num 9) dirty exists 2021-07-26T15:56:47.279 INFO:tasks.rados.rados.0.smithi033.stdout:72: finishing rollback tid 0 to smithi03339061-6 2021-07-26T15:56:47.280 INFO:tasks.rados.rados.0.smithi033.stdout:72: finishing rollback tid 1 to smithi03339061-6 2021-07-26T15:56:47.280 INFO:tasks.rados.rados.0.smithi033.stdout:71: finishing copy_from to smithi03339061-24 2021-07-26T15:56:47.281 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 2 (ObjNum 28 snap 0 seq_num 28) dirty exists 2021-07-26T15:56:47.281 INFO:tasks.rados.rados.0.smithi033.stdout:72: finishing rollback tid 2 to smithi03339061-6 2021-07-26T15:56:47.281 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 17 (ObjNum 5 snap 0 seq_num 5) dirty exists 2021-07-26T15:56:47.282 INFO:tasks.rados.rados.0.smithi033.stdout:71: finishing copy_from racing read to smithi03339061-24 2021-07-26T15:56:47.282 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 13 (ObjNum 13 snap 0 seq_num 13) dirty exists 2021-07-26T15:56:47.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:47 smithi033 bash[19094]: audit 2021-07-26T15:56:46.188401+0000 mon.a (mon.0) 667 : audit [INF] from='client.? ' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2021-07-26T15:56:47.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:47 smithi033 bash[19094]: cluster 2021-07-26T15:56:46.188535+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-07-26T15:56:47.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:47 smithi033 bash[14790]: audit 2021-07-26T15:56:46.188401+0000 mon.a (mon.0) 667 : audit [INF] from='client.? ' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2021-07-26T15:56:47.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:47 smithi033 bash[14790]: cluster 2021-07-26T15:56:46.188535+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-07-26T15:56:47.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:47 smithi096 bash[15117]: audit 2021-07-26T15:56:46.188401+0000 mon.a (mon.0) 667 : audit [INF] from='client.? ' entity='client.0' cmd='[{"prefix": "osd pool set", "pool": "unique_pool_0", "var": "write_fadvise_dontneed", "val": "false"}]': finished 2021-07-26T15:56:47.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:47 smithi096 bash[15117]: cluster 2021-07-26T15:56:46.188535+0000 mon.a (mon.0) 668 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-07-26T15:56:48.214 INFO:tasks.rados.rados.0.smithi033.stdout:66: done (11 left) 2021-07-26T15:56:48.214 INFO:tasks.rados.rados.0.smithi033.stdout:67: done (10 left) 2021-07-26T15:56:48.215 INFO:tasks.rados.rados.0.smithi033.stdout:68: done (9 left) 2021-07-26T15:56:48.215 INFO:tasks.rados.rados.0.smithi033.stdout:69: done (8 left) 2021-07-26T15:56:48.215 INFO:tasks.rados.rados.0.smithi033.stdout:71: done (7 left) 2021-07-26T15:56:48.215 INFO:tasks.rados.rados.0.smithi033.stdout:72: done (6 left) 2021-07-26T15:56:48.215 INFO:tasks.rados.rados.0.smithi033.stdout:73: done (5 left) 2021-07-26T15:56:48.216 INFO:tasks.rados.rados.0.smithi033.stdout:76: done (4 left) 2021-07-26T15:56:48.216 INFO:tasks.rados.rados.0.smithi033.stdout:77: done (3 left) 2021-07-26T15:56:48.216 INFO:tasks.rados.rados.0.smithi033.stdout:78: done (2 left) 2021-07-26T15:56:48.216 INFO:tasks.rados.rados.0.smithi033.stdout:79: done (1 left) 2021-07-26T15:56:48.216 INFO:tasks.rados.rados.0.smithi033.stdout:80: done (0 left) 2021-07-26T15:56:48.217 INFO:tasks.rados.rados.0.smithi033.stdout:81: rollback oid 40 current snap is 2 2021-07-26T15:56:48.217 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 40 to 1 2021-07-26T15:56:48.218 INFO:tasks.rados.rados.0.smithi033.stdout:82: snap_create 2021-07-26T15:56:48.218 INFO:tasks.rados.rados.0.smithi033.stdout:81: finishing rollback tid 0 to smithi03339061-40 2021-07-26T15:56:48.219 INFO:tasks.rados.rados.0.smithi033.stdout:81: finishing rollback tid 1 to smithi03339061-40 2021-07-26T15:56:48.219 INFO:tasks.rados.rados.0.smithi033.stdout:81: finishing rollback tid 2 to smithi03339061-40 2021-07-26T15:56:48.219 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 8 (ObjNum 39 snap 0 seq_num 39) dirty exists 2021-07-26T15:56:48.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:48 smithi096 bash[15117]: cluster 2021-07-26T15:56:47.190797+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-07-26T15:56:48.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:48 smithi096 bash[15117]: cluster 2021-07-26T15:56:47.636628+0000 mgr.y (mgr.14146) 377 : cluster [DBG] pgmap v340: 25 pgs: 25 active+clean; 4.6 MiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:48.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:48 smithi033 bash[14790]: cluster 2021-07-26T15:56:47.190797+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-07-26T15:56:48.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:48 smithi033 bash[14790]: cluster 2021-07-26T15:56:47.636628+0000 mgr.y (mgr.14146) 377 : cluster [DBG] pgmap v340: 25 pgs: 25 active+clean; 4.6 MiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:48 smithi033 bash[19094]: cluster 2021-07-26T15:56:47.190797+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-07-26T15:56:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:48 smithi033 bash[19094]: cluster 2021-07-26T15:56:47.636628+0000 mgr.y (mgr.14146) 377 : cluster [DBG] pgmap v340: 25 pgs: 25 active+clean; 4.6 MiB data, 52 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:56:49.224 INFO:tasks.rados.rados.0.smithi033.stdout:81: done (1 left) 2021-07-26T15:56:49.224 INFO:tasks.rados.rados.0.smithi033.stdout:82: done (0 left) 2021-07-26T15:56:49.224 INFO:tasks.rados.rados.0.smithi033.stdout:83: rollback oid 9 current snap is 3 2021-07-26T15:56:49.225 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 9 to 0 2021-07-26T15:56:49.225 INFO:tasks.rados.rados.0.smithi033.stdout:84: read oid 20 snap 1 2021-07-26T15:56:49.225 INFO:tasks.rados.rados.0.smithi033.stdout:84: expect (ObjNum 19 snap 0 seq_num 19) 2021-07-26T15:56:49.225 INFO:tasks.rados.rados.0.smithi033.stdout:85: read oid 41 snap -1 2021-07-26T15:56:49.225 INFO:tasks.rados.rados.0.smithi033.stdout:85: expect (ObjNum 40 snap 0 seq_num 40) 2021-07-26T15:56:49.226 INFO:tasks.rados.rados.0.smithi033.stdout:86: read oid 5 snap -1 2021-07-26T15:56:49.226 INFO:tasks.rados.rados.0.smithi033.stdout:86: expect (ObjNum 4 snap 0 seq_num 4) 2021-07-26T15:56:49.226 INFO:tasks.rados.rados.0.smithi033.stdout:87: read oid 4 snap -1 2021-07-26T15:56:49.226 INFO:tasks.rados.rados.0.smithi033.stdout:87: expect (ObjNum 3 snap 0 seq_num 3) 2021-07-26T15:56:49.227 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 3 current snap is 3 2021-07-26T15:56:49.227 INFO:tasks.rados.rados.0.smithi033.stdout:88: seq_num 54 ranges {40960=507904,548864=401408} 2021-07-26T15:56:49.228 INFO:tasks.rados.rados.0.smithi033.stdout:88: writing smithi03339061-3 from 40960 to 548864 tid 1 2021-07-26T15:56:49.233 INFO:tasks.rados.rados.0.smithi033.stdout:88: writing smithi03339061-3 from 548864 to 950272 tid 2 2021-07-26T15:56:49.233 INFO:tasks.rados.rados.0.smithi033.stdout:89: read oid 27 snap -1 2021-07-26T15:56:49.233 INFO:tasks.rados.rados.0.smithi033.stdout:89: expect (ObjNum 26 snap 0 seq_num 26) 2021-07-26T15:56:49.234 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 17 current snap is 3 2021-07-26T15:56:49.234 INFO:tasks.rados.rados.0.smithi033.stdout:90: seq_num 55 ranges {270336=524288,794624=401408} 2021-07-26T15:56:49.239 INFO:tasks.rados.rados.0.smithi033.stdout:90: writing smithi03339061-17 from 270336 to 794624 tid 1 2021-07-26T15:56:49.242 INFO:tasks.rados.rados.0.smithi033.stdout:90: writing smithi03339061-17 from 794624 to 1196032 tid 2 2021-07-26T15:56:49.242 INFO:tasks.rados.rados.0.smithi033.stdout:91: rollback oid 36 current snap is 3 2021-07-26T15:56:49.243 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 36 to 2 2021-07-26T15:56:49.243 INFO:tasks.rados.rados.0.smithi033.stdout:83: finishing rollback tid 0 to smithi03339061-9 2021-07-26T15:56:49.243 INFO:tasks.rados.rados.0.smithi033.stdout:83: finishing rollback tid 1 to smithi03339061-9 2021-07-26T15:56:49.244 INFO:tasks.rados.rados.0.smithi033.stdout:83: finishing rollback tid 2 to smithi03339061-9 2021-07-26T15:56:49.244 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 12 (ObjNum 8 snap 0 seq_num 8) dirty exists 2021-07-26T15:56:49.244 INFO:tasks.rados.rados.0.smithi033.stdout:84: expect (ObjNum 19 snap 0 seq_num 19) 2021-07-26T15:56:49.253 INFO:tasks.rados.rados.0.smithi033.stdout:88: finishing write tid 1 to smithi03339061-3 2021-07-26T15:56:49.254 INFO:tasks.rados.rados.0.smithi033.stdout:85: expect (ObjNum 40 snap 0 seq_num 40) 2021-07-26T15:56:49.271 INFO:tasks.rados.rados.0.smithi033.stdout:88: finishing write tid 2 to smithi03339061-3 2021-07-26T15:56:49.272 INFO:tasks.rados.rados.0.smithi033.stdout:89: expect (ObjNum 26 snap 0 seq_num 26) 2021-07-26T15:56:49.283 INFO:tasks.rados.rados.0.smithi033.stdout:87: expect (ObjNum 3 snap 0 seq_num 3) 2021-07-26T15:56:49.284 INFO:tasks.rados.rados.0.smithi033.stdout:86: expect (ObjNum 4 snap 0 seq_num 4) 2021-07-26T15:56:49.287 INFO:tasks.rados.rados.0.smithi033.stdout:88: finishing write tid 3 to smithi03339061-3 2021-07-26T15:56:49.288 INFO:tasks.rados.rados.0.smithi033.stdout:88: finishing write tid 4 to smithi03339061-3 2021-07-26T15:56:49.288 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 8 (ObjNum 54 snap 3 seq_num 54) dirty exists 2021-07-26T15:56:49.288 INFO:tasks.rados.rados.0.smithi033.stdout:88: left oid 3 (ObjNum 54 snap 3 seq_num 54) 2021-07-26T15:56:49.288 INFO:tasks.rados.rados.0.smithi033.stdout:90: finishing write tid 1 to smithi03339061-17 2021-07-26T15:56:49.288 INFO:tasks.rados.rados.0.smithi033.stdout:90: finishing write tid 2 to smithi03339061-17 2021-07-26T15:56:49.289 INFO:tasks.rados.rados.0.smithi033.stdout:90: finishing write tid 3 to smithi03339061-17 2021-07-26T15:56:49.289 INFO:tasks.rados.rados.0.smithi033.stdout:91: finishing rollback tid 0 to smithi03339061-36 2021-07-26T15:56:49.289 INFO:tasks.rados.rados.0.smithi033.stdout:90: finishing write tid 4 to smithi03339061-17 2021-07-26T15:56:49.290 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 12 (ObjNum 55 snap 3 seq_num 55) dirty exists 2021-07-26T15:56:49.290 INFO:tasks.rados.rados.0.smithi033.stdout:90: left oid 17 (ObjNum 55 snap 3 seq_num 55) 2021-07-26T15:56:49.291 INFO:tasks.rados.rados.0.smithi033.stdout:91: finishing rollback tid 1 to smithi03339061-36 2021-07-26T15:56:49.291 INFO:tasks.rados.rados.0.smithi033.stdout:91: finishing rollback tid 2 to smithi03339061-36 2021-07-26T15:56:49.291 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 10 (ObjNum 35 snap 0 seq_num 35) dirty exists 2021-07-26T15:56:49.292 INFO:tasks.rados.rados.0.smithi033.stdout:83: done (8 left) 2021-07-26T15:56:49.292 INFO:tasks.rados.rados.0.smithi033.stdout:84: done (7 left) 2021-07-26T15:56:49.292 INFO:tasks.rados.rados.0.smithi033.stdout:85: done (6 left) 2021-07-26T15:56:49.292 INFO:tasks.rados.rados.0.smithi033.stdout:86: done (5 left) 2021-07-26T15:56:49.293 INFO:tasks.rados.rados.0.smithi033.stdout:87: done (4 left) 2021-07-26T15:56:49.293 INFO:tasks.rados.rados.0.smithi033.stdout:88: done (3 left) 2021-07-26T15:56:49.293 INFO:tasks.rados.rados.0.smithi033.stdout:89: done (2 left) 2021-07-26T15:56:49.293 INFO:tasks.rados.rados.0.smithi033.stdout:90: done (1 left) 2021-07-26T15:56:49.293 INFO:tasks.rados.rados.0.smithi033.stdout:91: done (0 left) 2021-07-26T15:56:49.294 INFO:tasks.rados.rados.0.smithi033.stdout:92: rollback oid 47 current snap is 3 2021-07-26T15:56:49.294 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 47 to 0 2021-07-26T15:56:49.294 INFO:tasks.rados.rados.0.smithi033.stdout:93: snap_create 2021-07-26T15:56:49.295 INFO:tasks.rados.rados.0.smithi033.stdout:92: finishing rollback tid 0 to smithi03339061-47 2021-07-26T15:56:49.295 INFO:tasks.rados.rados.0.smithi033.stdout:92: finishing rollback tid 1 to smithi03339061-47 2021-07-26T15:56:49.295 INFO:tasks.rados.rados.0.smithi033.stdout:92: finishing rollback tid 2 to smithi03339061-47 2021-07-26T15:56:49.296 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 20 (ObjNum 46 snap 0 seq_num 46) dirty exists 2021-07-26T15:56:49.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:49 smithi096 bash[15117]: cluster 2021-07-26T15:56:48.210547+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-07-26T15:56:49.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:49 smithi033 bash[14790]: cluster 2021-07-26T15:56:48.210547+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-07-26T15:56:49.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:49 smithi033 bash[19094]: cluster 2021-07-26T15:56:48.210547+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-07-26T15:56:50.231 INFO:tasks.rados.rados.0.smithi033.stdout:92: done (1 left) 2021-07-26T15:56:50.231 INFO:tasks.rados.rados.0.smithi033.stdout:93: done (0 left) 2021-07-26T15:56:50.232 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 4 2021-07-26T15:56:50.232 INFO:tasks.rados.rados.0.smithi033.stdout:94: seq_num 56 ranges {442368=540672,983040=401408} 2021-07-26T15:56:50.242 INFO:tasks.rados.rados.0.smithi033.stdout:94: writing smithi03339061-27 from 442368 to 983040 tid 1 2021-07-26T15:56:50.244 INFO:tasks.rados.rados.0.smithi033.stdout:94: writing smithi03339061-27 from 983040 to 1384448 tid 2 2021-07-26T15:56:50.244 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 4 2021-07-26T15:56:50.245 INFO:tasks.rados.rados.0.smithi033.stdout:95: seq_num 57 ranges {638976=557056,1196032=401408} 2021-07-26T15:56:50.251 INFO:tasks.rados.rados.0.smithi033.stdout:95: writing smithi03339061-39 from 638976 to 1196032 tid 1 2021-07-26T15:56:50.256 INFO:tasks.rados.rados.0.smithi033.stdout:95: writing smithi03339061-39 from 1196032 to 1597440 tid 2 2021-07-26T15:56:50.256 INFO:tasks.rados.rados.0.smithi033.stdout:96: read oid 45 snap -1 2021-07-26T15:56:50.257 INFO:tasks.rados.rados.0.smithi033.stdout:96: expect (ObjNum 44 snap 0 seq_num 44) 2021-07-26T15:56:50.257 INFO:tasks.rados.rados.0.smithi033.stdout:97: rollback oid 12 current snap is 4 2021-07-26T15:56:50.257 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 12 to 3 2021-07-26T15:56:50.257 INFO:tasks.rados.rados.0.smithi033.stdout:94: finishing write tid 1 to smithi03339061-27 2021-07-26T15:56:50.258 INFO:tasks.rados.rados.0.smithi033.stdout:94: finishing write tid 2 to smithi03339061-27 2021-07-26T15:56:50.258 INFO:tasks.rados.rados.0.smithi033.stdout:94: finishing write tid 3 to smithi03339061-27 2021-07-26T15:56:50.258 INFO:tasks.rados.rados.0.smithi033.stdout:94: finishing write tid 4 to smithi03339061-27 2021-07-26T15:56:50.258 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 20 (ObjNum 56 snap 4 seq_num 56) dirty exists 2021-07-26T15:56:50.258 INFO:tasks.rados.rados.0.smithi033.stdout:94: left oid 27 (ObjNum 56 snap 4 seq_num 56) 2021-07-26T15:56:50.259 INFO:tasks.rados.rados.0.smithi033.stdout:94: done (3 left) 2021-07-26T15:56:50.259 INFO:tasks.rados.rados.0.smithi033.stdout:98: snap_remove snap 0 2021-07-26T15:56:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:50 smithi096 bash[15117]: cluster 2021-07-26T15:56:49.220643+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-07-26T15:56:50.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:50 smithi096 bash[15117]: cluster 2021-07-26T15:56:49.637341+0000 mgr.y (mgr.14146) 378 : cluster [DBG] pgmap v343: 25 pgs: 25 active+clean; 5.3 MiB data, 57 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 294 KiB/s wr, 3 op/s 2021-07-26T15:56:50.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:50 smithi096 bash[15117]: audit 2021-07-26T15:56:50.083083+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:50.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:50 smithi033 bash[14790]: cluster 2021-07-26T15:56:49.220643+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-07-26T15:56:50.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:50 smithi033 bash[14790]: cluster 2021-07-26T15:56:49.637341+0000 mgr.y (mgr.14146) 378 : cluster [DBG] pgmap v343: 25 pgs: 25 active+clean; 5.3 MiB data, 57 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 294 KiB/s wr, 3 op/s 2021-07-26T15:56:50.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:50 smithi033 bash[14790]: audit 2021-07-26T15:56:50.083083+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:50.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:50 smithi033 bash[19094]: cluster 2021-07-26T15:56:49.220643+0000 mon.a (mon.0) 671 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-07-26T15:56:50.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:50 smithi033 bash[19094]: cluster 2021-07-26T15:56:49.637341+0000 mgr.y (mgr.14146) 378 : cluster [DBG] pgmap v343: 25 pgs: 25 active+clean; 5.3 MiB data, 57 MiB used, 715 GiB / 715 GiB avail; 835 B/s rd, 294 KiB/s wr, 3 op/s 2021-07-26T15:56:50.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:50 smithi033 bash[19094]: audit 2021-07-26T15:56:50.083083+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:56:51.235 INFO:tasks.rados.rados.0.smithi033.stdout:98: done (3 left) 2021-07-26T15:56:51.236 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 4 2021-07-26T15:56:51.236 INFO:tasks.rados.rados.0.smithi033.stdout:99: seq_num 58 ranges {73728=573440,647168=401408} 2021-07-26T15:56:51.241 INFO:tasks.rados.rados.0.smithi033.stdout:99: writing smithi03339061-5 from 73728 to 647168 tid 1 2021-07-26T15:56:51.245 INFO:tasks.rados.rados.0.smithi033.stdout:99: writing smithi03339061-5 from 647168 to 1048576 tid 2 2021-07-26T15:56:51.248 INFO:tasks.rados.rados.0.smithi033.stdout:97: finishing rollback tid 0 to smithi03339061-12 2021-07-26T15:56:51.248 INFO:tasks.rados.rados.0.smithi033.stdout:97: finishing rollback tid 1 to smithi03339061-12 2021-07-26T15:56:51.249 INFO:tasks.rados.rados.0.smithi033.stdout:97: finishing rollback tid 2 to smithi03339061-12 2021-07-26T15:56:51.249 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 13 (ObjNum 11 snap 0 seq_num 11) dirty exists 2021-07-26T15:56:51.249 INFO:tasks.rados.rados.0.smithi033.stdout:95: finishing write tid 1 to smithi03339061-39 2021-07-26T15:56:51.249 INFO:tasks.rados.rados.0.smithi033.stdout:95: finishing write tid 2 to smithi03339061-39 2021-07-26T15:56:51.250 INFO:tasks.rados.rados.0.smithi033.stdout:95: finishing write tid 3 to smithi03339061-39 2021-07-26T15:56:51.250 INFO:tasks.rados.rados.0.smithi033.stdout:96: expect (ObjNum 44 snap 0 seq_num 44) 2021-07-26T15:56:51.268 INFO:tasks.rados.rados.0.smithi033.stdout:95: finishing write tid 4 to smithi03339061-39 2021-07-26T15:56:51.269 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 24 (ObjNum 57 snap 4 seq_num 57) dirty exists 2021-07-26T15:56:51.269 INFO:tasks.rados.rados.0.smithi033.stdout:95: left oid 39 (ObjNum 57 snap 4 seq_num 57) 2021-07-26T15:56:51.269 INFO:tasks.rados.rados.0.smithi033.stdout:95: done (3 left) 2021-07-26T15:56:51.270 INFO:tasks.rados.rados.0.smithi033.stdout:96: done (2 left) 2021-07-26T15:56:51.270 INFO:tasks.rados.rados.0.smithi033.stdout:97: done (1 left) 2021-07-26T15:56:51.270 INFO:tasks.rados.rados.0.smithi033.stdout:100: read oid 1 snap -1 2021-07-26T15:56:51.270 INFO:tasks.rados.rados.0.smithi033.stdout:100: expect deleted 2021-07-26T15:56:51.271 INFO:tasks.rados.rados.0.smithi033.stdout:101: snap_create 2021-07-26T15:56:51.271 INFO:tasks.rados.rados.0.smithi033.stdout:99: finishing write tid 1 to smithi03339061-5 2021-07-26T15:56:51.272 INFO:tasks.rados.rados.0.smithi033.stdout:99: finishing write tid 2 to smithi03339061-5 2021-07-26T15:56:51.272 INFO:tasks.rados.rados.0.smithi033.stdout:99: finishing write tid 3 to smithi03339061-5 2021-07-26T15:56:51.272 INFO:tasks.rados.rados.0.smithi033.stdout:99: finishing write tid 4 to smithi03339061-5 2021-07-26T15:56:51.272 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 12 (ObjNum 58 snap 4 seq_num 58) dirty exists 2021-07-26T15:56:51.273 INFO:tasks.rados.rados.0.smithi033.stdout:99: left oid 5 (ObjNum 58 snap 4 seq_num 58) 2021-07-26T15:56:51.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:51 smithi033 bash[14790]: cluster 2021-07-26T15:56:50.228490+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-07-26T15:56:51.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:51 smithi033 bash[19094]: cluster 2021-07-26T15:56:50.228490+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-07-26T15:56:51.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:51 smithi096 bash[15117]: cluster 2021-07-26T15:56:50.228490+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-07-26T15:56:52.260 INFO:tasks.rados.rados.0.smithi033.stdout:99: done (2 left) 2021-07-26T15:56:52.260 INFO:tasks.rados.rados.0.smithi033.stdout:100: done (1 left) 2021-07-26T15:56:52.260 INFO:tasks.rados.rados.0.smithi033.stdout:101: done (0 left) 2021-07-26T15:56:52.260 INFO:tasks.rados.rados.0.smithi033.stdout:102: snap_remove snap 1 2021-07-26T15:56:52.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:52 smithi033 bash[14790]: cluster 2021-07-26T15:56:51.231536+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-07-26T15:56:52.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:52 smithi033 bash[14790]: cluster 2021-07-26T15:56:51.638014+0000 mgr.y (mgr.14146) 379 : cluster [DBG] pgmap v346: 25 pgs: 25 active+clean; 24 MiB data, 79 MiB used, 715 GiB / 715 GiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 61 op/s 2021-07-26T15:56:52.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:52 smithi033 bash[19094]: cluster 2021-07-26T15:56:51.231536+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-07-26T15:56:52.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:52 smithi033 bash[19094]: cluster 2021-07-26T15:56:51.638014+0000 mgr.y (mgr.14146) 379 : cluster [DBG] pgmap v346: 25 pgs: 25 active+clean; 24 MiB data, 79 MiB used, 715 GiB / 715 GiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 61 op/s 2021-07-26T15:56:52.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:52 smithi096 bash[15117]: cluster 2021-07-26T15:56:51.231536+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-07-26T15:56:52.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:52 smithi096 bash[15117]: cluster 2021-07-26T15:56:51.638014+0000 mgr.y (mgr.14146) 379 : cluster [DBG] pgmap v346: 25 pgs: 25 active+clean; 24 MiB data, 79 MiB used, 715 GiB / 715 GiB avail; 2.5 MiB/s rd, 4.9 MiB/s wr, 61 op/s 2021-07-26T15:56:53.259 INFO:tasks.rados.rados.0.smithi033.stdout:102: done (0 left) 2021-07-26T15:56:53.260 INFO:tasks.rados.rados.0.smithi033.stdout:103: read oid 29 snap 4 2021-07-26T15:56:53.260 INFO:tasks.rados.rados.0.smithi033.stdout:103: expect (ObjNum 28 snap 0 seq_num 28) 2021-07-26T15:56:53.260 INFO:tasks.rados.rados.0.smithi033.stdout:104: read oid 46 snap -1 2021-07-26T15:56:53.261 INFO:tasks.rados.rados.0.smithi033.stdout:104: expect (ObjNum 45 snap 0 seq_num 45) 2021-07-26T15:56:53.261 INFO:tasks.rados.rados.0.smithi033.stdout:105: copy_from oid 36 from oid 2 current snap is 5 2021-07-26T15:56:53.261 INFO:tasks.rados.rados.0.smithi033.stdout:106: rmattr oid 49 current snap is 5 2021-07-26T15:56:53.262 INFO:tasks.rados.rados.0.smithi033.stdout:106: done (3 left) 2021-07-26T15:56:53.262 INFO:tasks.rados.rados.0.smithi033.stdout:107: snap_remove snap 3 2021-07-26T15:56:53.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:53 smithi033 bash[14790]: cluster 2021-07-26T15:56:52.252829+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-07-26T15:56:53.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:53 smithi033 bash[19094]: cluster 2021-07-26T15:56:52.252829+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-07-26T15:56:53.710 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:56:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:56:53.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:56:53.710 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:56:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:56:53.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:56:53.710 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:56:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:56:53.508Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T15:56:53.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:53 smithi096 bash[15117]: cluster 2021-07-26T15:56:52.252829+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-07-26T15:56:54.278 INFO:tasks.rados.rados.0.smithi033.stdout:107: done (3 left) 2021-07-26T15:56:54.279 INFO:tasks.rados.rados.0.smithi033.stdout:108: rmattr oid 30 current snap is 5 2021-07-26T15:56:54.279 INFO:tasks.rados.rados.0.smithi033.stdout:108: done (3 left) 2021-07-26T15:56:54.279 INFO:tasks.rados.rados.0.smithi033.stdout:103: expect (ObjNum 28 snap 0 seq_num 28) 2021-07-26T15:56:54.294 INFO:tasks.rados.rados.0.smithi033.stdout:104: expect (ObjNum 45 snap 0 seq_num 45) 2021-07-26T15:56:54.315 INFO:tasks.rados.rados.0.smithi033.stdout:105: finishing copy_from to smithi03339061-36 2021-07-26T15:56:54.315 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2021-07-26T15:56:54.316 INFO:tasks.rados.rados.0.smithi033.stdout:105: finishing copy_from racing read to smithi03339061-36 2021-07-26T15:56:54.316 INFO:tasks.rados.rados.0.smithi033.stdout:109: read oid 42 snap 2 2021-07-26T15:56:54.316 INFO:tasks.rados.rados.0.smithi033.stdout:109: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:56:54.316 INFO:tasks.rados.rados.0.smithi033.stdout:103: done (3 left) 2021-07-26T15:56:54.317 INFO:tasks.rados.rados.0.smithi033.stdout:104: done (2 left) 2021-07-26T15:56:54.317 INFO:tasks.rados.rados.0.smithi033.stdout:105: done (1 left) 2021-07-26T15:56:54.317 INFO:tasks.rados.rados.0.smithi033.stdout:110: snap_remove snap 4 2021-07-26T15:56:54.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:54 smithi033 bash[19094]: cluster 2021-07-26T15:56:53.256696+0000 mon.a (mon.0) 676 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-07-26T15:56:54.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:54 smithi033 bash[19094]: cluster 2021-07-26T15:56:53.638710+0000 mgr.y (mgr.14146) 380 : cluster [DBG] pgmap v349: 25 pgs: 25 active+clean; 25 MiB data, 86 MiB used, 715 GiB / 715 GiB avail; 3.5 MiB/s rd, 5.3 MiB/s wr, 70 op/s 2021-07-26T15:56:54.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:54 smithi033 bash[14790]: cluster 2021-07-26T15:56:53.256696+0000 mon.a (mon.0) 676 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-07-26T15:56:54.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:54 smithi033 bash[14790]: cluster 2021-07-26T15:56:53.638710+0000 mgr.y (mgr.14146) 380 : cluster [DBG] pgmap v349: 25 pgs: 25 active+clean; 25 MiB data, 86 MiB used, 715 GiB / 715 GiB avail; 3.5 MiB/s rd, 5.3 MiB/s wr, 70 op/s 2021-07-26T15:56:54.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:54 smithi096 bash[15117]: cluster 2021-07-26T15:56:53.256696+0000 mon.a (mon.0) 676 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-07-26T15:56:54.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:54 smithi096 bash[15117]: cluster 2021-07-26T15:56:53.638710+0000 mgr.y (mgr.14146) 380 : cluster [DBG] pgmap v349: 25 pgs: 25 active+clean; 25 MiB data, 86 MiB used, 715 GiB / 715 GiB avail; 3.5 MiB/s rd, 5.3 MiB/s wr, 70 op/s 2021-07-26T15:56:55.286 INFO:tasks.rados.rados.0.smithi033.stdout:110: done (1 left) 2021-07-26T15:56:55.286 INFO:tasks.rados.rados.0.smithi033.stdout:111: copy_from oid 22 from oid 15 current snap is 5 2021-07-26T15:56:55.286 INFO:tasks.rados.rados.0.smithi033.stdout:109: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:56:55.309 INFO:tasks.rados.rados.0.smithi033.stdout:111: finishing copy_from to smithi03339061-22 2021-07-26T15:56:55.309 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2021-07-26T15:56:55.310 INFO:tasks.rados.rados.0.smithi033.stdout:111: finishing copy_from racing read to smithi03339061-22 2021-07-26T15:56:55.310 INFO:tasks.rados.rados.0.smithi033.stdout:109: done (1 left) 2021-07-26T15:56:55.310 INFO:tasks.rados.rados.0.smithi033.stdout:111: done (0 left) 2021-07-26T15:56:55.310 INFO:tasks.rados.rados.0.smithi033.stdout:112: read oid 22 snap 2 2021-07-26T15:56:55.311 INFO:tasks.rados.rados.0.smithi033.stdout:112: expect (ObjNum 47 snap 0 seq_num 47) 2021-07-26T15:56:55.311 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 5 2021-07-26T15:56:55.311 INFO:tasks.rados.rados.0.smithi033.stdout:113: seq_num 59 ranges {475136=598016,1073152=401408} 2021-07-26T15:56:55.317 INFO:tasks.rados.rados.0.smithi033.stdout:113: writing smithi03339061-24 from 475136 to 1073152 tid 1 2021-07-26T15:56:55.323 INFO:tasks.rados.rados.0.smithi033.stdout:113: writing smithi03339061-24 from 1073152 to 1474560 tid 2 2021-07-26T15:56:55.323 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 5 2021-07-26T15:56:55.324 INFO:tasks.rados.rados.0.smithi033.stdout:114: seq_num 60 ranges {712704=614400,1327104=401408} 2021-07-26T15:56:55.332 INFO:tasks.rados.rados.0.smithi033.stdout:114: writing smithi03339061-43 from 712704 to 1327104 tid 1 2021-07-26T15:56:55.333 INFO:tasks.rados.rados.0.smithi033.stdout:114: writing smithi03339061-43 from 1327104 to 1728512 tid 2 2021-07-26T15:56:55.334 INFO:tasks.rados.rados.0.smithi033.stdout:115: copy_from oid 11 from oid 16 current snap is 5 2021-07-26T15:56:55.334 INFO:tasks.rados.rados.0.smithi033.stdout:112: expect (ObjNum 47 snap 0 seq_num 47) 2021-07-26T15:56:55.357 INFO:tasks.rados.rados.0.smithi033.stdout:112: done (3 left) 2021-07-26T15:56:55.357 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 5 2021-07-26T15:56:55.357 INFO:tasks.rados.rados.0.smithi033.stdout:113: finishing write tid 1 to smithi03339061-24 2021-07-26T15:56:55.358 INFO:tasks.rados.rados.0.smithi033.stdout:113: finishing write tid 2 to smithi03339061-24 2021-07-26T15:56:55.358 INFO:tasks.rados.rados.0.smithi033.stdout:113: finishing write tid 3 to smithi03339061-24 2021-07-26T15:56:55.358 INFO:tasks.rados.rados.0.smithi033.stdout:113: finishing write tid 4 to smithi03339061-24 2021-07-26T15:56:55.358 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 32 (ObjNum 59 snap 5 seq_num 59) dirty exists 2021-07-26T15:56:55.359 INFO:tasks.rados.rados.0.smithi033.stdout:113: left oid 24 (ObjNum 59 snap 5 seq_num 59) 2021-07-26T15:56:55.359 INFO:tasks.rados.rados.0.smithi033.stdout:114: finishing write tid 1 to smithi03339061-43 2021-07-26T15:56:55.359 INFO:tasks.rados.rados.0.smithi033.stdout:114: finishing write tid 2 to smithi03339061-43 2021-07-26T15:56:55.359 INFO:tasks.rados.rados.0.smithi033.stdout:114: finishing write tid 3 to smithi03339061-43 2021-07-26T15:56:55.359 INFO:tasks.rados.rados.0.smithi033.stdout:114: finishing write tid 4 to smithi03339061-43 2021-07-26T15:56:55.360 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 20 (ObjNum 60 snap 5 seq_num 60) dirty exists 2021-07-26T15:56:55.360 INFO:tasks.rados.rados.0.smithi033.stdout:114: left oid 43 (ObjNum 60 snap 5 seq_num 60) 2021-07-26T15:56:55.362 INFO:tasks.rados.rados.0.smithi033.stdout:115: finishing copy_from to smithi03339061-11 2021-07-26T15:56:55.362 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 2 (ObjNum 15 snap 0 seq_num 15) dirty exists 2021-07-26T15:56:55.363 INFO:tasks.rados.rados.0.smithi033.stdout:115: finishing copy_from racing read to smithi03339061-11 2021-07-26T15:56:55.363 INFO:tasks.rados.rados.0.smithi033.stdout:116: seq_num 61 ranges {745472=630784,1376256=401408} 2021-07-26T15:56:55.364 INFO:tasks.rados.rados.0.smithi033.stdout:116: writing smithi03339061-45 from 745472 to 1376256 tid 1 2021-07-26T15:56:55.366 INFO:tasks.rados.rados.0.smithi033.stdout:116: writing smithi03339061-45 from 1376256 to 1777664 tid 2 2021-07-26T15:56:55.366 INFO:tasks.rados.rados.0.smithi033.stdout:113: done (3 left) 2021-07-26T15:56:55.367 INFO:tasks.rados.rados.0.smithi033.stdout:114: done (2 left) 2021-07-26T15:56:55.367 INFO:tasks.rados.rados.0.smithi033.stdout:115: done (1 left) 2021-07-26T15:56:55.367 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 5 2021-07-26T15:56:55.367 INFO:tasks.rados.rados.0.smithi033.stdout:117: seq_num 62 ranges {24576=647168,671744=401408} 2021-07-26T15:56:55.372 INFO:tasks.rados.rados.0.smithi033.stdout:117: writing smithi03339061-15 from 24576 to 671744 tid 1 2021-07-26T15:56:55.376 INFO:tasks.rados.rados.0.smithi033.stdout:117: writing smithi03339061-15 from 671744 to 1073152 tid 2 2021-07-26T15:56:55.377 INFO:tasks.rados.rados.0.smithi033.stdout:118: rollback oid 9 current snap is 5 2021-07-26T15:56:55.377 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 9 to 2 2021-07-26T15:56:55.377 INFO:tasks.rados.rados.0.smithi033.stdout:116: finishing write tid 1 to smithi03339061-45 2021-07-26T15:56:55.377 INFO:tasks.rados.rados.0.smithi033.stdout:116: finishing write tid 2 to smithi03339061-45 2021-07-26T15:56:55.378 INFO:tasks.rados.rados.0.smithi033.stdout:116: finishing write tid 3 to smithi03339061-45 2021-07-26T15:56:55.378 INFO:tasks.rados.rados.0.smithi033.stdout:119: delete oid 41 current snap is 5 2021-07-26T15:56:55.378 INFO:tasks.rados.rados.0.smithi033.stdout:116: finishing write tid 4 to smithi03339061-45 2021-07-26T15:56:55.378 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 25 (ObjNum 61 snap 5 seq_num 61) dirty exists 2021-07-26T15:56:55.378 INFO:tasks.rados.rados.0.smithi033.stdout:116: left oid 45 (ObjNum 61 snap 5 seq_num 61) 2021-07-26T15:56:55.380 INFO:tasks.rados.rados.0.smithi033.stdout:118: finishing rollback tid 0 to smithi03339061-9 2021-07-26T15:56:55.380 INFO:tasks.rados.rados.0.smithi033.stdout:116: done (3 left) 2021-07-26T15:56:55.381 INFO:tasks.rados.rados.0.smithi033.stdout:119: done (2 left) 2021-07-26T15:56:55.382 INFO:tasks.rados.rados.0.smithi033.stdout:120: read oid 44 snap -1 2021-07-26T15:56:55.382 INFO:tasks.rados.rados.0.smithi033.stdout:120: expect (ObjNum 43 snap 0 seq_num 43) 2021-07-26T15:56:55.382 INFO:tasks.rados.rados.0.smithi033.stdout:121: rollback oid 39 current snap is 5 2021-07-26T15:56:55.382 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 39 to 2 2021-07-26T15:56:55.382 INFO:tasks.rados.rados.0.smithi033.stdout:122: delete oid 17 current snap is 5 2021-07-26T15:56:55.383 INFO:tasks.rados.rados.0.smithi033.stdout:118: finishing rollback tid 1 to smithi03339061-9 2021-07-26T15:56:55.383 INFO:tasks.rados.rados.0.smithi033.stdout:118: finishing rollback tid 2 to smithi03339061-9 2021-07-26T15:56:55.383 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 19 (ObjNum 8 snap 0 seq_num 8) dirty exists 2021-07-26T15:56:55.385 INFO:tasks.rados.rados.0.smithi033.stdout:117: finishing write tid 1 to smithi03339061-15 2021-07-26T15:56:55.385 INFO:tasks.rados.rados.0.smithi033.stdout:117: finishing write tid 2 to smithi03339061-15 2021-07-26T15:56:55.385 INFO:tasks.rados.rados.0.smithi033.stdout:118: done (4 left) 2021-07-26T15:56:55.386 INFO:tasks.rados.rados.0.smithi033.stdout:122: done (3 left) 2021-07-26T15:56:55.386 INFO:tasks.rados.rados.0.smithi033.stdout:123: read oid 24 snap 2 2021-07-26T15:56:55.386 INFO:tasks.rados.rados.0.smithi033.stdout:123: expect (ObjNum 28 snap 0 seq_num 28) 2021-07-26T15:56:55.386 INFO:tasks.rados.rados.0.smithi033.stdout:124: rollback oid 27 current snap is 5 2021-07-26T15:56:55.386 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 27 to 2 2021-07-26T15:56:55.387 INFO:tasks.rados.rados.0.smithi033.stdout:125: delete oid 35 current snap is 5 2021-07-26T15:56:55.387 INFO:tasks.rados.rados.0.smithi033.stdout:117: finishing write tid 3 to smithi03339061-15 2021-07-26T15:56:55.387 INFO:tasks.rados.rados.0.smithi033.stdout:121: finishing rollback tid 0 to smithi03339061-39 2021-07-26T15:56:55.387 INFO:tasks.rados.rados.0.smithi033.stdout:121: finishing rollback tid 1 to smithi03339061-39 2021-07-26T15:56:55.387 INFO:tasks.rados.rados.0.smithi033.stdout:121: finishing rollback tid 2 to smithi03339061-39 2021-07-26T15:56:55.388 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 43 (ObjNum 38 snap 0 seq_num 38) dirty exists 2021-07-26T15:56:55.388 INFO:tasks.rados.rados.0.smithi033.stdout:117: finishing write tid 4 to smithi03339061-15 2021-07-26T15:56:55.388 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 13 (ObjNum 62 snap 5 seq_num 62) dirty exists 2021-07-26T15:56:55.388 INFO:tasks.rados.rados.0.smithi033.stdout:117: left oid 15 (ObjNum 62 snap 5 seq_num 62) 2021-07-26T15:56:55.389 INFO:tasks.rados.rados.0.smithi033.stdout:120: expect (ObjNum 43 snap 0 seq_num 43) 2021-07-26T15:56:55.406 INFO:tasks.rados.rados.0.smithi033.stdout:123: expect (ObjNum 28 snap 0 seq_num 28) 2021-07-26T15:56:55.419 INFO:tasks.rados.rados.0.smithi033.stdout:124: finishing rollback tid 0 to smithi03339061-27 2021-07-26T15:56:55.419 INFO:tasks.rados.rados.0.smithi033.stdout:124: finishing rollback tid 1 to smithi03339061-27 2021-07-26T15:56:55.420 INFO:tasks.rados.rados.0.smithi033.stdout:124: finishing rollback tid 2 to smithi03339061-27 2021-07-26T15:56:55.420 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 46 (ObjNum 26 snap 0 seq_num 26) dirty exists 2021-07-26T15:56:55.420 INFO:tasks.rados.rados.0.smithi033.stdout:117: done (5 left) 2021-07-26T15:56:55.420 INFO:tasks.rados.rados.0.smithi033.stdout:120: done (4 left) 2021-07-26T15:56:55.420 INFO:tasks.rados.rados.0.smithi033.stdout:121: done (3 left) 2021-07-26T15:56:55.421 INFO:tasks.rados.rados.0.smithi033.stdout:123: done (2 left) 2021-07-26T15:56:55.421 INFO:tasks.rados.rados.0.smithi033.stdout:124: done (1 left) 2021-07-26T15:56:55.421 INFO:tasks.rados.rados.0.smithi033.stdout:125: done (0 left) 2021-07-26T15:56:55.422 INFO:tasks.rados.rados.0.smithi033.stdout:126: setattr oid 35 current snap is 5 2021-07-26T15:56:55.422 INFO:tasks.rados.rados.0.smithi033.stdout:127: snap_create 2021-07-26T15:56:55.424 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 22 (ObjNum 2007477152 snap 22002 seq_num 2004516880) dirty exists 2021-07-26T15:56:55.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:55 smithi033 bash[14790]: cluster 2021-07-26T15:56:54.274824+0000 mon.a (mon.0) 677 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-07-26T15:56:55.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:55 smithi033 bash[19094]: cluster 2021-07-26T15:56:54.274824+0000 mon.a (mon.0) 677 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-07-26T15:56:55.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:55 smithi096 bash[15117]: cluster 2021-07-26T15:56:54.274824+0000 mon.a (mon.0) 677 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-07-26T15:56:56.289 INFO:tasks.rados.rados.0.smithi033.stdout:126: done (1 left) 2021-07-26T15:56:56.290 INFO:tasks.rados.rados.0.smithi033.stdout:127: done (0 left) 2021-07-26T15:56:56.290 INFO:tasks.rados.rados.0.smithi033.stdout:128: copy_from oid 25 from oid 6 current snap is 6 2021-07-26T15:56:56.290 INFO:tasks.rados.rados.0.smithi033.stdout:129: setattr oid 23 current snap is 6 2021-07-26T15:56:56.294 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 6 2021-07-26T15:56:56.294 INFO:tasks.rados.rados.0.smithi033.stdout:130: seq_num 66 ranges {1073152=712704,1785856=401408} 2021-07-26T15:56:56.306 INFO:tasks.rados.rados.0.smithi033.stdout:130: writing smithi03339061-15 from 1073152 to 1785856 tid 1 2021-07-26T15:56:56.308 INFO:tasks.rados.rados.0.smithi033.stdout:130: writing smithi03339061-15 from 1785856 to 2187264 tid 2 2021-07-26T15:56:56.308 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 6 2021-07-26T15:56:56.309 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 48 (ObjNum 53 snap 1 seq_num 53) dirty exists 2021-07-26T15:56:56.309 INFO:tasks.rados.rados.0.smithi033.stdout:131: seq_num 67 ranges {319488=729088,1048576=401408} 2021-07-26T15:56:56.314 INFO:tasks.rados.rados.0.smithi033.stdout:131: writing smithi03339061-20 from 319488 to 1048576 tid 1 2021-07-26T15:56:56.317 INFO:tasks.rados.rados.0.smithi033.stdout:131: writing smithi03339061-20 from 1048576 to 1449984 tid 2 2021-07-26T15:56:56.318 INFO:tasks.rados.rados.0.smithi033.stdout:129: done (3 left) 2021-07-26T15:56:56.318 INFO:tasks.rados.rados.0.smithi033.stdout:132: rollback oid 14 current snap is 6 2021-07-26T15:56:56.318 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 14 to 2 2021-07-26T15:56:56.318 INFO:tasks.rados.rados.0.smithi033.stdout:128: finishing copy_from to smithi03339061-25 2021-07-26T15:56:56.319 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 17 (ObjNum 5 snap 0 seq_num 5) dirty exists 2021-07-26T15:56:56.319 INFO:tasks.rados.rados.0.smithi033.stdout:133: read oid 31 snap -1 2021-07-26T15:56:56.319 INFO:tasks.rados.rados.0.smithi033.stdout:133: expect (ObjNum 30 snap 0 seq_num 30) 2021-07-26T15:56:56.319 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 6 2021-07-26T15:56:56.320 INFO:tasks.rados.rados.0.smithi033.stdout:128: finishing copy_from racing read to smithi03339061-25 2021-07-26T15:56:56.320 INFO:tasks.rados.rados.0.smithi033.stdout:134: seq_num 68 ranges {811008=745472,1556480=401408} 2021-07-26T15:56:56.326 INFO:tasks.rados.rados.0.smithi033.stdout:134: writing smithi03339061-49 from 811008 to 1556480 tid 1 2021-07-26T15:56:56.329 INFO:tasks.rados.rados.0.smithi033.stdout:134: writing smithi03339061-49 from 1556480 to 1957888 tid 2 2021-07-26T15:56:56.330 INFO:tasks.rados.rados.0.smithi033.stdout:128: done (5 left) 2021-07-26T15:56:56.330 INFO:tasks.rados.rados.0.smithi033.stdout:135: snap_create 2021-07-26T15:56:56.330 INFO:tasks.rados.rados.0.smithi033.stdout:130: finishing write tid 1 to smithi03339061-15 2021-07-26T15:56:56.330 INFO:tasks.rados.rados.0.smithi033.stdout:130: finishing write tid 2 to smithi03339061-15 2021-07-26T15:56:56.330 INFO:tasks.rados.rados.0.smithi033.stdout:130: finishing write tid 3 to smithi03339061-15 2021-07-26T15:56:56.331 INFO:tasks.rados.rados.0.smithi033.stdout:130: finishing write tid 4 to smithi03339061-15 2021-07-26T15:56:56.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 17 (ObjNum 66 snap 6 seq_num 66) dirty exists 2021-07-26T15:56:56.331 INFO:tasks.rados.rados.0.smithi033.stdout:130: left oid 15 (ObjNum 66 snap 6 seq_num 66) 2021-07-26T15:56:56.331 INFO:tasks.rados.rados.0.smithi033.stdout:131: finishing write tid 1 to smithi03339061-20 2021-07-26T15:56:56.332 INFO:tasks.rados.rados.0.smithi033.stdout:131: finishing write tid 2 to smithi03339061-20 2021-07-26T15:56:56.332 INFO:tasks.rados.rados.0.smithi033.stdout:131: finishing write tid 3 to smithi03339061-20 2021-07-26T15:56:56.332 INFO:tasks.rados.rados.0.smithi033.stdout:133: expect (ObjNum 30 snap 0 seq_num 30) 2021-07-26T15:56:56.344 INFO:tasks.rados.rados.0.smithi033.stdout:132: finishing rollback tid 0 to smithi03339061-14 2021-07-26T15:56:56.345 INFO:tasks.rados.rados.0.smithi033.stdout:131: finishing write tid 4 to smithi03339061-20 2021-07-26T15:56:56.345 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 19 (ObjNum 67 snap 6 seq_num 67) dirty exists 2021-07-26T15:56:56.345 INFO:tasks.rados.rados.0.smithi033.stdout:131: left oid 20 (ObjNum 67 snap 6 seq_num 67) 2021-07-26T15:56:56.345 INFO:tasks.rados.rados.0.smithi033.stdout:132: finishing rollback tid 1 to smithi03339061-14 2021-07-26T15:56:56.346 INFO:tasks.rados.rados.0.smithi033.stdout:132: finishing rollback tid 2 to smithi03339061-14 2021-07-26T15:56:56.346 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 23 (ObjNum 13 snap 0 seq_num 13) dirty exists 2021-07-26T15:56:56.346 INFO:tasks.rados.rados.0.smithi033.stdout:134: finishing write tid 1 to smithi03339061-49 2021-07-26T15:56:56.346 INFO:tasks.rados.rados.0.smithi033.stdout:134: finishing write tid 2 to smithi03339061-49 2021-07-26T15:56:56.347 INFO:tasks.rados.rados.0.smithi033.stdout:134: finishing write tid 3 to smithi03339061-49 2021-07-26T15:56:56.347 INFO:tasks.rados.rados.0.smithi033.stdout:134: finishing write tid 4 to smithi03339061-49 2021-07-26T15:56:56.347 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 21 (ObjNum 68 snap 6 seq_num 68) dirty exists 2021-07-26T15:56:56.347 INFO:tasks.rados.rados.0.smithi033.stdout:134: left oid 49 (ObjNum 68 snap 6 seq_num 68) 2021-07-26T15:56:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:56 smithi033 bash[14790]: cluster 2021-07-26T15:56:55.283790+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-07-26T15:56:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:56 smithi033 bash[14790]: cluster 2021-07-26T15:56:55.639388+0000 mgr.y (mgr.14146) 381 : cluster [DBG] pgmap v352: 25 pgs: 25 active+clean; 27 MiB data, 87 MiB used, 715 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.0 MiB/s wr, 16 op/s 2021-07-26T15:56:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:56 smithi033 bash[19094]: cluster 2021-07-26T15:56:55.283790+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-07-26T15:56:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:56 smithi033 bash[19094]: cluster 2021-07-26T15:56:55.639388+0000 mgr.y (mgr.14146) 381 : cluster [DBG] pgmap v352: 25 pgs: 25 active+clean; 27 MiB data, 87 MiB used, 715 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.0 MiB/s wr, 16 op/s 2021-07-26T15:56:56.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:56 smithi096 bash[15117]: cluster 2021-07-26T15:56:55.283790+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-07-26T15:56:56.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:56 smithi096 bash[15117]: cluster 2021-07-26T15:56:55.639388+0000 mgr.y (mgr.14146) 381 : cluster [DBG] pgmap v352: 25 pgs: 25 active+clean; 27 MiB data, 87 MiB used, 715 GiB / 715 GiB avail; 2.5 MiB/s rd, 1.0 MiB/s wr, 16 op/s 2021-07-26T15:56:57.307 INFO:tasks.rados.rados.0.smithi033.stdout:130: done (5 left) 2021-07-26T15:56:57.307 INFO:tasks.rados.rados.0.smithi033.stdout:131: done (4 left) 2021-07-26T15:56:57.308 INFO:tasks.rados.rados.0.smithi033.stdout:132: done (3 left) 2021-07-26T15:56:57.308 INFO:tasks.rados.rados.0.smithi033.stdout:133: done (2 left) 2021-07-26T15:56:57.308 INFO:tasks.rados.rados.0.smithi033.stdout:134: done (1 left) 2021-07-26T15:56:57.308 INFO:tasks.rados.rados.0.smithi033.stdout:135: done (0 left) 2021-07-26T15:56:57.309 INFO:tasks.rados.rados.0.smithi033.stdout:136: read oid 48 snap 5 2021-07-26T15:56:57.309 INFO:tasks.rados.rados.0.smithi033.stdout:136: expect (ObjNum 47 snap 0 seq_num 47) 2021-07-26T15:56:57.309 INFO:tasks.rados.rados.0.smithi033.stdout:137: read oid 49 snap 6 2021-07-26T15:56:57.309 INFO:tasks.rados.rados.0.smithi033.stdout:137: expect (ObjNum 68 snap 6 seq_num 68) 2021-07-26T15:56:57.309 INFO:tasks.rados.rados.0.smithi033.stdout:138: delete oid 44 current snap is 7 2021-07-26T15:56:57.312 INFO:tasks.rados.rados.0.smithi033.stdout:138: done (2 left) 2021-07-26T15:56:57.312 INFO:tasks.rados.rados.0.smithi033.stdout:139: rollback oid 23 current snap is 7 2021-07-26T15:56:57.312 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 23 to 5 2021-07-26T15:56:57.312 INFO:tasks.rados.rados.0.smithi033.stdout:140: read oid 30 snap -1 2021-07-26T15:56:57.313 INFO:tasks.rados.rados.0.smithi033.stdout:140: expect (ObjNum 29 snap 0 seq_num 29) 2021-07-26T15:56:57.313 INFO:tasks.rados.rados.0.smithi033.stdout:141: setattr oid 35 current snap is 7 2021-07-26T15:56:57.315 INFO:tasks.rados.rados.0.smithi033.stdout:142: delete oid 25 current snap is 7 2021-07-26T15:56:57.317 INFO:tasks.rados.rados.0.smithi033.stdout:140: expect (ObjNum 29 snap 0 seq_num 29) 2021-07-26T15:56:57.333 INFO:tasks.rados.rados.0.smithi033.stdout:139: finishing rollback tid 0 to smithi03339061-23 2021-07-26T15:56:57.334 INFO:tasks.rados.rados.0.smithi033.stdout:139: finishing rollback tid 1 to smithi03339061-23 2021-07-26T15:56:57.334 INFO:tasks.rados.rados.0.smithi033.stdout:139: finishing rollback tid 2 to smithi03339061-23 2021-07-26T15:56:57.334 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 52 (ObjNum 53 snap 1 seq_num 53) dirty exists 2021-07-26T15:56:57.334 INFO:tasks.rados.rados.0.smithi033.stdout:136: expect (ObjNum 47 snap 0 seq_num 47) 2021-07-26T15:56:57.354 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 24 (ObjNum 0 snap 32561 seq_num 2006504048) dirty exists 2021-07-26T15:56:57.355 INFO:tasks.rados.rados.0.smithi033.stdout:137: expect (ObjNum 68 snap 6 seq_num 68) 2021-07-26T15:56:57.420 INFO:tasks.rados.rados.0.smithi033.stdout:136: done (5 left) 2021-07-26T15:56:57.420 INFO:tasks.rados.rados.0.smithi033.stdout:137: done (4 left) 2021-07-26T15:56:57.421 INFO:tasks.rados.rados.0.smithi033.stdout:139: done (3 left) 2021-07-26T15:56:57.421 INFO:tasks.rados.rados.0.smithi033.stdout:140: done (2 left) 2021-07-26T15:56:57.421 INFO:tasks.rados.rados.0.smithi033.stdout:141: done (1 left) 2021-07-26T15:56:57.422 INFO:tasks.rados.rados.0.smithi033.stdout:142: done (0 left) 2021-07-26T15:56:57.422 INFO:tasks.rados.rados.0.smithi033.stdout:143: snap_remove snap 5 2021-07-26T15:56:57.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:57 smithi033 bash[14790]: cluster 2021-07-26T15:56:56.286881+0000 mon.a (mon.0) 679 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-07-26T15:56:57.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:57 smithi033 bash[19094]: cluster 2021-07-26T15:56:56.286881+0000 mon.a (mon.0) 679 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-07-26T15:56:57.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:57 smithi096 bash[15117]: cluster 2021-07-26T15:56:56.286881+0000 mon.a (mon.0) 679 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-07-26T15:56:58.319 INFO:tasks.rados.rados.0.smithi033.stdout:143: done (0 left) 2021-07-26T15:56:58.319 INFO:tasks.rados.rados.0.smithi033.stdout:144: setattr oid 28 current snap is 7 2021-07-26T15:56:58.321 INFO:tasks.rados.rados.0.smithi033.stdout:145: snap_remove snap 2 2021-07-26T15:56:58.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:58 smithi033 bash[14790]: cluster 2021-07-26T15:56:57.304912+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-07-26T15:56:58.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:58 smithi033 bash[14790]: cluster 2021-07-26T15:56:57.640101+0000 mgr.y (mgr.14146) 382 : cluster [DBG] pgmap v355: 25 pgs: 25 active+clean; 28 MiB data, 90 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 996 KiB/s wr, 8 op/s 2021-07-26T15:56:58.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:58 smithi033 bash[19094]: cluster 2021-07-26T15:56:57.304912+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-07-26T15:56:58.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:58 smithi033 bash[19094]: cluster 2021-07-26T15:56:57.640101+0000 mgr.y (mgr.14146) 382 : cluster [DBG] pgmap v355: 25 pgs: 25 active+clean; 28 MiB data, 90 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 996 KiB/s wr, 8 op/s 2021-07-26T15:56:58.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:58 smithi096 bash[15117]: cluster 2021-07-26T15:56:57.304912+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-07-26T15:56:58.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:58 smithi096 bash[15117]: cluster 2021-07-26T15:56:57.640101+0000 mgr.y (mgr.14146) 382 : cluster [DBG] pgmap v355: 25 pgs: 25 active+clean; 28 MiB data, 90 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 996 KiB/s wr, 8 op/s 2021-07-26T15:56:59.323 INFO:tasks.rados.rados.0.smithi033.stdout:145: done (1 left) 2021-07-26T15:56:59.324 INFO:tasks.rados.rados.0.smithi033.stdout:146: delete oid 6 current snap is 7 2021-07-26T15:56:59.324 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 23 (ObjNum 33 snap 0 seq_num 33) dirty exists 2021-07-26T15:56:59.335 INFO:tasks.rados.rados.0.smithi033.stdout:144: done (1 left) 2021-07-26T15:56:59.335 INFO:tasks.rados.rados.0.smithi033.stdout:146: done (0 left) 2021-07-26T15:56:59.336 INFO:tasks.rados.rados.0.smithi033.stdout:147: snap_remove snap 6 2021-07-26T15:56:59.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:56:59 smithi033 bash[14790]: cluster 2021-07-26T15:56:58.315407+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-07-26T15:56:59.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:56:59 smithi033 bash[19094]: cluster 2021-07-26T15:56:58.315407+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-07-26T15:56:59.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:56:59 smithi096 bash[15117]: cluster 2021-07-26T15:56:58.315407+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-07-26T15:56:59.739 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:56:59 smithi096 bash[20458]: debug 2021-07-26T15:56:59.324+0000 7f2dd473f700 -1 osd.5 pg_epoch: 74 pg[3.cs0( v 74'24 (0'0,74'24] local-lis/les=57/58 n=6 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [5,3,6]p5(0) r=0 lpr=57 luod=70'22 crt=70'22 lcod 70'20 mlcod 70'20 active+clean+snaptrim trimq=[4~1] ps=[2~2,5~1,7~1,b~1]] removing snap head 2021-07-26T15:56:59.740 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:56:59 smithi096 bash[17896]: debug 2021-07-26T15:56:59.312+0000 7f4648f9e700 -1 osd.4 pg_epoch: 74 pg[3.9s0( v 70'21 (0'0,70'21] local-lis/les=57/58 n=3 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [4,2,7]p4(0) r=0 lpr=57 crt=70'21 lcod 68'20 mlcod 68'20 active+clean+snaptrim trimq=[4~1] ps=[2~2,5~1,7~1,b~1]] removing snap head 2021-07-26T15:57:00.342 INFO:tasks.rados.rados.0.smithi033.stdout:147: done (0 left) 2021-07-26T15:57:00.342 INFO:tasks.rados.rados.0.smithi033.stdout:148: rollback oid 17 current snap is 7 2021-07-26T15:57:00.342 INFO:tasks.rados.rados.0.smithi033.stdout:148: done (0 left) 2021-07-26T15:57:00.343 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 7 2021-07-26T15:57:00.343 INFO:tasks.rados.rados.0.smithi033.stdout:149: seq_num 72 ranges {1728512=409600,2138112=524288,2662400=278528} 2021-07-26T15:57:00.357 INFO:tasks.rados.rados.0.smithi033.stdout:149: writing smithi03339061-43 from 1728512 to 2138112 tid 1 2021-07-26T15:57:00.360 INFO:tasks.rados.rados.0.smithi033.stdout:149: writing smithi03339061-43 from 2138112 to 2662400 tid 2 2021-07-26T15:57:00.362 INFO:tasks.rados.rados.0.smithi033.stdout:149: writing smithi03339061-43 from 2662400 to 2940928 tid 3 2021-07-26T15:57:00.363 INFO:tasks.rados.rados.0.smithi033.stdout:150: read oid 11 snap -1 2021-07-26T15:57:00.363 INFO:tasks.rados.rados.0.smithi033.stdout:150: expect (ObjNum 15 snap 0 seq_num 15) 2021-07-26T15:57:00.363 INFO:tasks.rados.rados.0.smithi033.stdout:151: read oid 6 snap -1 2021-07-26T15:57:00.363 INFO:tasks.rados.rados.0.smithi033.stdout:151: expect deleted 2021-07-26T15:57:00.364 INFO:tasks.rados.rados.0.smithi033.stdout:152: copy_from oid 18 from oid 46 current snap is 7 2021-07-26T15:57:00.364 INFO:tasks.rados.rados.0.smithi033.stdout:153: read oid 41 snap -1 2021-07-26T15:57:00.364 INFO:tasks.rados.rados.0.smithi033.stdout:153: expect deleted 2021-07-26T15:57:00.364 INFO:tasks.rados.rados.0.smithi033.stdout:154: copy_from oid 31 from oid 2 current snap is 7 2021-07-26T15:57:00.365 INFO:tasks.rados.rados.0.smithi033.stdout:155: copy_from oid 21 from oid 20 current snap is 7 2021-07-26T15:57:00.365 INFO:tasks.rados.rados.0.smithi033.stdout:156: snap_create 2021-07-26T15:57:00.372 INFO:tasks.rados.rados.0.smithi033.stdout:149: finishing write tid 1 to smithi03339061-43 2021-07-26T15:57:00.372 INFO:tasks.rados.rados.0.smithi033.stdout:149: finishing write tid 2 to smithi03339061-43 2021-07-26T15:57:00.373 INFO:tasks.rados.rados.0.smithi033.stdout:149: finishing write tid 3 to smithi03339061-43 2021-07-26T15:57:00.374 INFO:tasks.rados.rados.0.smithi033.stdout:149: finishing write tid 4 to smithi03339061-43 2021-07-26T15:57:00.375 INFO:tasks.rados.rados.0.smithi033.stdout:154: finishing copy_from to smithi03339061-31 2021-07-26T15:57:00.375 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 2 (ObjNum 1 snap 0 seq_num 1) dirty exists 2021-07-26T15:57:00.375 INFO:tasks.rados.rados.0.smithi033.stdout:154: finishing copy_from racing read to smithi03339061-31 2021-07-26T15:57:00.377 INFO:tasks.rados.rados.0.smithi033.stdout:149: finishing write tid 5 to smithi03339061-43 2021-07-26T15:57:00.377 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 32 (ObjNum 72 snap 7 seq_num 72) dirty exists 2021-07-26T15:57:00.377 INFO:tasks.rados.rados.0.smithi033.stdout:149: left oid 43 (ObjNum 72 snap 7 seq_num 72) 2021-07-26T15:57:00.378 INFO:tasks.rados.rados.0.smithi033.stdout:150: expect (ObjNum 15 snap 0 seq_num 15) 2021-07-26T15:57:00.386 INFO:tasks.rados.rados.0.smithi033.stdout:155: finishing copy_from to smithi03339061-21 2021-07-26T15:57:00.386 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 19 (ObjNum 67 snap 6 seq_num 67) dirty exists 2021-07-26T15:57:00.386 INFO:tasks.rados.rados.0.smithi033.stdout:152: finishing copy_from to smithi03339061-18 2021-07-26T15:57:00.387 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 4 (ObjNum 45 snap 0 seq_num 45) dirty exists 2021-07-26T15:57:00.387 INFO:tasks.rados.rados.0.smithi033.stdout:155: finishing copy_from racing read to smithi03339061-21 2021-07-26T15:57:00.387 INFO:tasks.rados.rados.0.smithi033.stdout:152: finishing copy_from racing read to smithi03339061-18 2021-07-26T15:57:00.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:00 smithi033 bash[14790]: cluster 2021-07-26T15:56:59.317349+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-07-26T15:57:00.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:00 smithi033 bash[14790]: cluster 2021-07-26T15:56:59.640808+0000 mgr.y (mgr.14146) 383 : cluster [DBG] pgmap v358: 25 pgs: 25 active+clean; 28 MiB data, 91 MiB used, 715 GiB / 715 GiB avail; 511 KiB/s rd, 526 KiB/s wr, 4 op/s 2021-07-26T15:57:00.709 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:57:00 smithi033 bash[21582]: debug 2021-07-26T15:57:00.352+0000 7f5fff48b700 -1 osd.0 pg_epoch: 75 pg[3.1s0( v 72'17 (0'0,72'17] local-lis/les=57/58 n=5 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [0,4,3]p0(0) r=0 lpr=57 crt=72'17 lcod 71'15 mlcod 71'15 active+clean+snaptrim trimq=[c~1] ps=[2~4,7~1,b~1]] removing snap head 2021-07-26T15:57:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:00 smithi033 bash[19094]: cluster 2021-07-26T15:56:59.317349+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-07-26T15:57:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:00 smithi033 bash[19094]: cluster 2021-07-26T15:56:59.640808+0000 mgr.y (mgr.14146) 383 : cluster [DBG] pgmap v358: 25 pgs: 25 active+clean; 28 MiB data, 91 MiB used, 715 GiB / 715 GiB avail; 511 KiB/s rd, 526 KiB/s wr, 4 op/s 2021-07-26T15:57:00.710 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:57:00 smithi033 bash[24389]: debug 2021-07-26T15:57:00.336+0000 7f93f6800700 -1 osd.1 pg_epoch: 75 pg[3.4s0( v 74'37 (0'0,74'37] local-lis/les=57/58 n=6 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [1,2,6]p1(0) r=0 lpr=57 crt=74'37 lcod 74'35 mlcod 74'35 active+clean+snaptrim trimq=[c~1] ps=[2~4,7~1,b~1]] removing snap head 2021-07-26T15:57:00.710 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:57:00 smithi033 bash[29474]: debug 2021-07-26T15:57:00.356+0000 7f0abb262700 -1 osd.3 pg_epoch: 75 pg[3.bs0( v 74'31 (0'0,74'31] local-lis/les=57/58 n=7 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [3,0,4]p3(0) r=0 lpr=57 crt=74'31 lcod 74'29 mlcod 74'29 active+clean+snaptrim trimq=[c~1] ps=[2~4,7~1,b~1]] removing snap head 2021-07-26T15:57:00.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:00 smithi096 bash[15117]: cluster 2021-07-26T15:56:59.317349+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-07-26T15:57:00.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:00 smithi096 bash[15117]: cluster 2021-07-26T15:56:59.640808+0000 mgr.y (mgr.14146) 383 : cluster [DBG] pgmap v358: 25 pgs: 25 active+clean; 28 MiB data, 91 MiB used, 715 GiB / 715 GiB avail; 511 KiB/s rd, 526 KiB/s wr, 4 op/s 2021-07-26T15:57:01.355 INFO:tasks.rados.rados.0.smithi033.stdout:149: done (7 left) 2021-07-26T15:57:01.355 INFO:tasks.rados.rados.0.smithi033.stdout:150: done (6 left) 2021-07-26T15:57:01.355 INFO:tasks.rados.rados.0.smithi033.stdout:151: done (5 left) 2021-07-26T15:57:01.356 INFO:tasks.rados.rados.0.smithi033.stdout:152: done (4 left) 2021-07-26T15:57:01.357 INFO:tasks.rados.rados.0.smithi033.stdout:153: done (3 left) 2021-07-26T15:57:01.357 INFO:tasks.rados.rados.0.smithi033.stdout:154: done (2 left) 2021-07-26T15:57:01.357 INFO:tasks.rados.rados.0.smithi033.stdout:155: done (1 left) 2021-07-26T15:57:01.357 INFO:tasks.rados.rados.0.smithi033.stdout:156: done (0 left) 2021-07-26T15:57:01.358 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 8 2021-07-26T15:57:01.358 INFO:tasks.rados.rados.0.smithi033.stdout:157: seq_num 73 ranges {139264=425984,565248=409600,974848=393216} 2021-07-26T15:57:01.360 INFO:tasks.rados.rados.0.smithi033.stdout:157: writing smithi03339061-9 from 139264 to 565248 tid 1 2021-07-26T15:57:01.362 INFO:tasks.rados.rados.0.smithi033.stdout:157: writing smithi03339061-9 from 565248 to 974848 tid 2 2021-07-26T15:57:01.365 INFO:tasks.rados.rados.0.smithi033.stdout:157: writing smithi03339061-9 from 974848 to 1368064 tid 3 2021-07-26T15:57:01.365 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 8 2021-07-26T15:57:01.365 INFO:tasks.rados.rados.0.smithi033.stdout:157: finishing write tid 1 to smithi03339061-9 2021-07-26T15:57:01.366 INFO:tasks.rados.rados.0.smithi033.stdout:158: seq_num 74 ranges {188416=442368,630784=696320,1327104=106496} 2021-07-26T15:57:01.368 INFO:tasks.rados.rados.0.smithi033.stdout:158: writing smithi03339061-12 from 188416 to 630784 tid 1 2021-07-26T15:57:01.373 INFO:tasks.rados.rados.0.smithi033.stdout:158: writing smithi03339061-12 from 630784 to 1327104 tid 2 2021-07-26T15:57:01.375 INFO:tasks.rados.rados.0.smithi033.stdout:158: writing smithi03339061-12 from 1327104 to 1433600 tid 3 2021-07-26T15:57:01.375 INFO:tasks.rados.rados.0.smithi033.stdout:159: rollback oid 22 current snap is 8 2021-07-26T15:57:01.375 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 22 to 7 2021-07-26T15:57:01.375 INFO:tasks.rados.rados.0.smithi033.stdout:157: finishing write tid 2 to smithi03339061-9 2021-07-26T15:57:01.376 INFO:tasks.rados.rados.0.smithi033.stdout:157: finishing write tid 3 to smithi03339061-9 2021-07-26T15:57:01.376 INFO:tasks.rados.rados.0.smithi033.stdout:157: finishing write tid 4 to smithi03339061-9 2021-07-26T15:57:01.376 INFO:tasks.rados.rados.0.smithi033.stdout:157: finishing write tid 5 to smithi03339061-9 2021-07-26T15:57:01.376 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 37 (ObjNum 73 snap 8 seq_num 73) dirty exists 2021-07-26T15:57:01.377 INFO:tasks.rados.rados.0.smithi033.stdout:157: left oid 9 (ObjNum 73 snap 8 seq_num 73) 2021-07-26T15:57:01.377 INFO:tasks.rados.rados.0.smithi033.stdout:157: done (2 left) 2021-07-26T15:57:01.377 INFO:tasks.rados.rados.0.smithi033.stdout:160: snap_create 2021-07-26T15:57:01.378 INFO:tasks.rados.rados.0.smithi033.stdout:158: finishing write tid 1 to smithi03339061-12 2021-07-26T15:57:01.379 INFO:tasks.rados.rados.0.smithi033.stdout:158: finishing write tid 2 to smithi03339061-12 2021-07-26T15:57:01.381 INFO:tasks.rados.rados.0.smithi033.stdout:159: finishing rollback tid 0 to smithi03339061-22 2021-07-26T15:57:01.381 INFO:tasks.rados.rados.0.smithi033.stdout:158: finishing write tid 3 to smithi03339061-12 2021-07-26T15:57:01.381 INFO:tasks.rados.rados.0.smithi033.stdout:159: finishing rollback tid 1 to smithi03339061-22 2021-07-26T15:57:01.381 INFO:tasks.rados.rados.0.smithi033.stdout:159: finishing rollback tid 2 to smithi03339061-22 2021-07-26T15:57:01.382 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 38 (ObjNum 1 snap 0 seq_num 1) dirty exists 2021-07-26T15:57:01.382 INFO:tasks.rados.rados.0.smithi033.stdout:158: finishing write tid 4 to smithi03339061-12 2021-07-26T15:57:01.383 INFO:tasks.rados.rados.0.smithi033.stdout:158: finishing write tid 5 to smithi03339061-12 2021-07-26T15:57:01.383 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 34 (ObjNum 74 snap 8 seq_num 74) dirty exists 2021-07-26T15:57:01.384 INFO:tasks.rados.rados.0.smithi033.stdout:158: left oid 12 (ObjNum 74 snap 8 seq_num 74) 2021-07-26T15:57:01.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:01 smithi033 bash[19094]: cluster 2021-07-26T15:57:00.339520+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-07-26T15:57:01.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:01 smithi033 bash[14790]: cluster 2021-07-26T15:57:00.339520+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-07-26T15:57:01.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:01 smithi096 bash[15117]: cluster 2021-07-26T15:57:00.339520+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-07-26T15:57:02.191 INFO:tasks.rados.rados.0.smithi033.stdout:158: done (2 left) 2021-07-26T15:57:02.191 INFO:tasks.rados.rados.0.smithi033.stdout:159: done (1 left) 2021-07-26T15:57:02.191 INFO:tasks.rados.rados.0.smithi033.stdout:160: done (0 left) 2021-07-26T15:57:02.192 INFO:tasks.rados.rados.0.smithi033.stdout:161: read oid 33 snap -1 2021-07-26T15:57:02.192 INFO:tasks.rados.rados.0.smithi033.stdout:161: expect (ObjNum 32 snap 0 seq_num 32) 2021-07-26T15:57:02.192 INFO:tasks.rados.rados.0.smithi033.stdout:162: read oid 45 snap -1 2021-07-26T15:57:02.193 INFO:tasks.rados.rados.0.smithi033.stdout:162: expect (ObjNum 61 snap 5 seq_num 61) 2021-07-26T15:57:02.193 INFO:tasks.rados.rados.0.smithi033.stdout:163: snap_create 2021-07-26T15:57:02.203 INFO:tasks.rados.rados.0.smithi033.stdout:161: expect (ObjNum 32 snap 0 seq_num 32) 2021-07-26T15:57:02.219 INFO:tasks.rados.rados.0.smithi033.stdout:162: expect (ObjNum 61 snap 5 seq_num 61) 2021-07-26T15:57:02.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:02 smithi033 bash[14790]: cluster 2021-07-26T15:57:01.352494+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-07-26T15:57:02.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:02 smithi033 bash[14790]: cluster 2021-07-26T15:57:01.641512+0000 mgr.y (mgr.14146) 384 : cluster [DBG] pgmap v361: 25 pgs: 25 active+clean; 29 MiB data, 94 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2021-07-26T15:57:02.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:02 smithi033 bash[14790]: cluster 2021-07-26T15:57:02.188441+0000 mon.a (mon.0) 685 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-07-26T15:57:02.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:02 smithi033 bash[19094]: cluster 2021-07-26T15:57:01.352494+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-07-26T15:57:02.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:02 smithi033 bash[19094]: cluster 2021-07-26T15:57:01.641512+0000 mgr.y (mgr.14146) 384 : cluster [DBG] pgmap v361: 25 pgs: 25 active+clean; 29 MiB data, 94 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2021-07-26T15:57:02.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:02 smithi033 bash[19094]: cluster 2021-07-26T15:57:02.188441+0000 mon.a (mon.0) 685 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-07-26T15:57:02.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:02 smithi096 bash[15117]: cluster 2021-07-26T15:57:01.352494+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-07-26T15:57:02.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:02 smithi096 bash[15117]: cluster 2021-07-26T15:57:01.641512+0000 mgr.y (mgr.14146) 384 : cluster [DBG] pgmap v361: 25 pgs: 25 active+clean; 29 MiB data, 94 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.4 MiB/s wr, 31 op/s 2021-07-26T15:57:02.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:02 smithi096 bash[15117]: cluster 2021-07-26T15:57:02.188441+0000 mon.a (mon.0) 685 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-07-26T15:57:03.202 INFO:tasks.rados.rados.0.smithi033.stdout:161: done (2 left) 2021-07-26T15:57:03.202 INFO:tasks.rados.rados.0.smithi033.stdout:162: done (1 left) 2021-07-26T15:57:03.202 INFO:tasks.rados.rados.0.smithi033.stdout:163: done (0 left) 2021-07-26T15:57:03.203 INFO:tasks.rados.rados.0.smithi033.stdout:164: copy_from oid 48 from oid 42 current snap is 10 2021-07-26T15:57:03.203 INFO:tasks.rados.rados.0.smithi033.stdout:165: delete oid 29 current snap is 10 2021-07-26T15:57:03.207 INFO:tasks.rados.rados.0.smithi033.stdout:165: done (1 left) 2021-07-26T15:57:03.208 INFO:tasks.rados.rados.0.smithi033.stdout:166: snap_create 2021-07-26T15:57:03.218 INFO:tasks.rados.rados.0.smithi033.stdout:164: finishing copy_from to smithi03339061-48 2021-07-26T15:57:03.218 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 4 (ObjNum 41 snap 0 seq_num 41) dirty exists 2021-07-26T15:57:03.219 INFO:tasks.rados.rados.0.smithi033.stdout:164: finishing copy_from racing read to smithi03339061-48 2021-07-26T15:57:03.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:03 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:03.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:57:03.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:03 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:03.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:57:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:03 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:03.509Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T15:57:04.213 INFO:tasks.rados.rados.0.smithi033.stdout:164: done (1 left) 2021-07-26T15:57:04.213 INFO:tasks.rados.rados.0.smithi033.stdout:166: done (0 left) 2021-07-26T15:57:04.214 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 11 2021-07-26T15:57:04.214 INFO:tasks.rados.rados.0.smithi033.stdout:167: seq_num 76 ranges {2940928=475136,3416064=458752,3874816=344064} 2021-07-26T15:57:04.235 INFO:tasks.rados.rados.0.smithi033.stdout:167: writing smithi03339061-43 from 2940928 to 3416064 tid 1 2021-07-26T15:57:04.237 INFO:tasks.rados.rados.0.smithi033.stdout:167: writing smithi03339061-43 from 3416064 to 3874816 tid 2 2021-07-26T15:57:04.239 INFO:tasks.rados.rados.0.smithi033.stdout:167: writing smithi03339061-43 from 3874816 to 4218880 tid 3 2021-07-26T15:57:04.239 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 11 2021-07-26T15:57:04.240 INFO:tasks.rados.rados.0.smithi033.stdout:168: seq_num 77 ranges {155648=491520,647168=794624,1441792=8192} 2021-07-26T15:57:04.243 INFO:tasks.rados.rados.0.smithi033.stdout:168: writing smithi03339061-10 from 155648 to 647168 tid 1 2021-07-26T15:57:04.249 INFO:tasks.rados.rados.0.smithi033.stdout:168: writing smithi03339061-10 from 647168 to 1441792 tid 2 2021-07-26T15:57:04.249 INFO:tasks.rados.rados.0.smithi033.stdout:168: writing smithi03339061-10 from 1441792 to 1449984 tid 3 2021-07-26T15:57:04.249 INFO:tasks.rados.rados.0.smithi033.stdout:169: snap_create 2021-07-26T15:57:04.250 INFO:tasks.rados.rados.0.smithi033.stdout:167: finishing write tid 1 to smithi03339061-43 2021-07-26T15:57:04.250 INFO:tasks.rados.rados.0.smithi033.stdout:167: finishing write tid 2 to smithi03339061-43 2021-07-26T15:57:04.250 INFO:tasks.rados.rados.0.smithi033.stdout:167: finishing write tid 3 to smithi03339061-43 2021-07-26T15:57:04.251 INFO:tasks.rados.rados.0.smithi033.stdout:167: finishing write tid 4 to smithi03339061-43 2021-07-26T15:57:04.251 INFO:tasks.rados.rados.0.smithi033.stdout:167: finishing write tid 5 to smithi03339061-43 2021-07-26T15:57:04.252 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 39 (ObjNum 76 snap 11 seq_num 76) dirty exists 2021-07-26T15:57:04.252 INFO:tasks.rados.rados.0.smithi033.stdout:167: left oid 43 (ObjNum 76 snap 11 seq_num 76) 2021-07-26T15:57:04.252 INFO:tasks.rados.rados.0.smithi033.stdout:168: finishing write tid 1 to smithi03339061-10 2021-07-26T15:57:04.254 INFO:tasks.rados.rados.0.smithi033.stdout:168: finishing write tid 2 to smithi03339061-10 2021-07-26T15:57:04.254 INFO:tasks.rados.rados.0.smithi033.stdout:168: finishing write tid 3 to smithi03339061-10 2021-07-26T15:57:04.255 INFO:tasks.rados.rados.0.smithi033.stdout:168: finishing write tid 4 to smithi03339061-10 2021-07-26T15:57:04.256 INFO:tasks.rados.rados.0.smithi033.stdout:168: finishing write tid 5 to smithi03339061-10 2021-07-26T15:57:04.256 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 41 (ObjNum 77 snap 11 seq_num 77) dirty exists 2021-07-26T15:57:04.256 INFO:tasks.rados.rados.0.smithi033.stdout:168: left oid 10 (ObjNum 77 snap 11 seq_num 77) 2021-07-26T15:57:04.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:04 smithi033 bash[14790]: cluster 2021-07-26T15:57:03.199579+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-07-26T15:57:04.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:04 smithi033 bash[14790]: cluster 2021-07-26T15:57:03.642210+0000 mgr.y (mgr.14146) 385 : cluster [DBG] pgmap v364: 25 pgs: 25 active+clean; 30 MiB data, 100 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 1.9 MiB/s wr, 39 op/s 2021-07-26T15:57:04.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:04 smithi033 bash[19094]: cluster 2021-07-26T15:57:03.199579+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-07-26T15:57:04.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:04 smithi033 bash[19094]: cluster 2021-07-26T15:57:03.642210+0000 mgr.y (mgr.14146) 385 : cluster [DBG] pgmap v364: 25 pgs: 25 active+clean; 30 MiB data, 100 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 1.9 MiB/s wr, 39 op/s 2021-07-26T15:57:04.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:04 smithi096 bash[15117]: cluster 2021-07-26T15:57:03.199579+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-07-26T15:57:04.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:04 smithi096 bash[15117]: cluster 2021-07-26T15:57:03.642210+0000 mgr.y (mgr.14146) 385 : cluster [DBG] pgmap v364: 25 pgs: 25 active+clean; 30 MiB data, 100 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 1.9 MiB/s wr, 39 op/s 2021-07-26T15:57:05.174 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T15:57:05.241 INFO:tasks.rados.rados.0.smithi033.stdout:167: done (2 left) 2021-07-26T15:57:05.241 INFO:tasks.rados.rados.0.smithi033.stdout:168: done (1 left) 2021-07-26T15:57:05.242 INFO:tasks.rados.rados.0.smithi033.stdout:169: done (0 left) 2021-07-26T15:57:05.242 INFO:tasks.rados.rados.0.smithi033.stdout:170: snap_create 2021-07-26T15:57:05.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:05 smithi096 bash[15117]: cluster 2021-07-26T15:57:04.210002+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-07-26T15:57:05.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:05 smithi096 bash[15117]: cephadm 2021-07-26T15:57:04.227053+0000 mgr.y (mgr.14146) 386 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:57:05.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:05 smithi096 bash[15117]: audit 2021-07-26T15:57:04.235333+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:05.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:05 smithi096 bash[15117]: audit 2021-07-26T15:57:04.236828+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:05.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:05 smithi096 bash[15117]: audit 2021-07-26T15:57:04.238393+0000 mon.a (mon.0) 690 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:57:05.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:05 smithi096 bash[15117]: audit 2021-07-26T15:57:04.240290+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:05.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:05 smithi096 bash[15117]: cephadm 2021-07-26T15:57:04.242141+0000 mgr.y (mgr.14146) 387 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:57:05.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:05 smithi096 bash[15117]: audit 2021-07-26T15:57:05.156012+0000 mgr.y (mgr.14146) 388 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:05.504 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T15:57:05.505 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (3m) 3m ago 4m 9.84M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T15:57:05.505 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (3m) 3m ago 3m 24.0M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T15:57:05.505 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (8m) 3m ago 8m 360M - 16.2.5 34f74fddb18e 993bd06a2266 2021-07-26T15:57:05.505 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:9283 running (10m) 3m ago 10m 406M - 16.2.5 34f74fddb18e 36288638414a 2021-07-26T15:57:05.506 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (10m) 3m ago 10m 49.4M 2048M 16.2.5 34f74fddb18e 85aee8c34dd9 2021-07-26T15:57:05.506 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (8m) 3m ago 8m 39.7M 2048M 16.2.5 34f74fddb18e dce67784fda4 2021-07-26T15:57:05.506 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (8m) 3m ago 8m 37.5M 2048M 16.2.5 34f74fddb18e 18be215b59d8 2021-07-26T15:57:05.506 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (4m) 3m ago 4m 3143k - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T15:57:05.506 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (4m) 3m ago 4m 3260k - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T15:57:05.507 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (7m) 3m ago 8m 37.6M 4065M 16.2.5 34f74fddb18e a4b4ebc84a97 2021-07-26T15:57:05.507 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (7m) 3m ago 7m 39.3M 4065M 16.2.5 34f74fddb18e 35137704568f 2021-07-26T15:57:05.507 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (7m) 3m ago 7m 38.1M 4065M 16.2.5 34f74fddb18e d351359286fd 2021-07-26T15:57:05.507 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (6m) 3m ago 6m 38.2M 4065M 16.2.5 34f74fddb18e 6b68e9927be6 2021-07-26T15:57:05.508 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (6m) 3m ago 6m 36.6M 4320M 16.2.5 34f74fddb18e 1aac82d5671e 2021-07-26T15:57:05.508 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (5m) 3m ago 5m 37.0M 4320M 16.2.5 34f74fddb18e 12b89782c2eb 2021-07-26T15:57:05.508 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (5m) 3m ago 5m 37.5M 4320M 16.2.5 34f74fddb18e 4fad5a8407d4 2021-07-26T15:57:05.508 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (4m) 3m ago 4m 36.5M 4320M 16.2.5 34f74fddb18e a988c60ad3d5 2021-07-26T15:57:05.508 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (3m) 3m ago 4m 19.2M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T15:57:05.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[14790]: cluster 2021-07-26T15:57:04.210002+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-07-26T15:57:05.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[14790]: cephadm 2021-07-26T15:57:04.227053+0000 mgr.y (mgr.14146) 386 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:57:05.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[14790]: audit 2021-07-26T15:57:04.235333+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:05.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[14790]: audit 2021-07-26T15:57:04.236828+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:05.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[14790]: audit 2021-07-26T15:57:04.238393+0000 mon.a (mon.0) 690 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:57:05.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[14790]: audit 2021-07-26T15:57:04.240290+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:05.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[14790]: cephadm 2021-07-26T15:57:04.242141+0000 mgr.y (mgr.14146) 387 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:57:05.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[14790]: audit 2021-07-26T15:57:05.156012+0000 mgr.y (mgr.14146) 388 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:05.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[19094]: cluster 2021-07-26T15:57:04.210002+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-07-26T15:57:05.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[19094]: cephadm 2021-07-26T15:57:04.227053+0000 mgr.y (mgr.14146) 386 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:57:05.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[19094]: audit 2021-07-26T15:57:04.235333+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:05.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[19094]: audit 2021-07-26T15:57:04.236828+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:05.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[19094]: audit 2021-07-26T15:57:04.238393+0000 mon.a (mon.0) 690 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:57:05.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[19094]: audit 2021-07-26T15:57:04.240290+0000 mon.a (mon.0) 691 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:05.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[19094]: cephadm 2021-07-26T15:57:04.242141+0000 mgr.y (mgr.14146) 387 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:57:05.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:05 smithi033 bash[19094]: audit 2021-07-26T15:57:05.156012+0000 mgr.y (mgr.14146) 388 : audit [DBG] from='client.24580 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:05.895 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T15:57:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T15:57:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 3 2021-07-26T15:57:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:57:05.896 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T15:57:05.897 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 2 2021-07-26T15:57:05.897 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:57:05.897 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T15:57:05.897 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 8 2021-07-26T15:57:05.899 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:57:05.899 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T15:57:05.900 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T15:57:05.900 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 13 2021-07-26T15:57:05.900 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T15:57:05.900 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T15:57:06.253 INFO:tasks.rados.rados.0.smithi033.stdout:170: done (0 left) 2021-07-26T15:57:06.259 INFO:tasks.rados.rados.0.smithi033.stdout:171: read oid 42 snap -1 2021-07-26T15:57:06.260 INFO:tasks.rados.rados.0.smithi033.stdout:171: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:57:06.260 INFO:tasks.rados.rados.0.smithi033.stdout:172: rmattr oid 17 current snap is 13 2021-07-26T15:57:06.260 INFO:tasks.rados.rados.0.smithi033.stdout:172: done (1 left) 2021-07-26T15:57:06.260 INFO:tasks.rados.rados.0.smithi033.stdout:173: setattr oid 28 current snap is 13 2021-07-26T15:57:06.261 INFO:tasks.rados.rados.0.smithi033.stdout:174: copy_from oid 33 from oid 16 current snap is 13 2021-07-26T15:57:06.262 INFO:tasks.rados.rados.0.smithi033.stdout:175: setattr oid 32 current snap is 13 2021-07-26T15:57:06.262 INFO:tasks.rados.rados.0.smithi033.stdout:176: snap_remove snap 9 2021-07-26T15:57:06.581 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:06 smithi096 bash[15117]: cluster 2021-07-26T15:57:05.236909+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-07-26T15:57:06.581 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:06 smithi096 bash[15117]: audit 2021-07-26T15:57:05.484782+0000 mgr.y (mgr.14146) 389 : audit [DBG] from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:06.581 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:06 smithi096 bash[15117]: cluster 2021-07-26T15:57:05.642706+0000 mgr.y (mgr.14146) 390 : cluster [DBG] pgmap v367: 25 pgs: 25 active+clean; 33 MiB data, 105 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2021-07-26T15:57:06.582 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:06 smithi096 bash[15117]: audit 2021-07-26T15:57:05.886139+0000 mon.a (mon.0) 693 : audit [DBG] from='client.? 172.21.15.33:0/2862420625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:57:06.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:06 smithi033 bash[19094]: cluster 2021-07-26T15:57:05.236909+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-07-26T15:57:06.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:06 smithi033 bash[19094]: audit 2021-07-26T15:57:05.484782+0000 mgr.y (mgr.14146) 389 : audit [DBG] from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:06.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:06 smithi033 bash[19094]: cluster 2021-07-26T15:57:05.642706+0000 mgr.y (mgr.14146) 390 : cluster [DBG] pgmap v367: 25 pgs: 25 active+clean; 33 MiB data, 105 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2021-07-26T15:57:06.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:06 smithi033 bash[19094]: audit 2021-07-26T15:57:05.886139+0000 mon.a (mon.0) 693 : audit [DBG] from='client.? 172.21.15.33:0/2862420625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:57:06.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:06 smithi033 bash[14790]: cluster 2021-07-26T15:57:05.236909+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-07-26T15:57:06.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:06 smithi033 bash[14790]: audit 2021-07-26T15:57:05.484782+0000 mgr.y (mgr.14146) 389 : audit [DBG] from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:06.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:06 smithi033 bash[14790]: cluster 2021-07-26T15:57:05.642706+0000 mgr.y (mgr.14146) 390 : cluster [DBG] pgmap v367: 25 pgs: 25 active+clean; 33 MiB data, 105 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.7 MiB/s wr, 16 op/s 2021-07-26T15:57:06.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:06 smithi033 bash[14790]: audit 2021-07-26T15:57:05.886139+0000 mon.a (mon.0) 693 : audit [DBG] from='client.? 172.21.15.33:0/2862420625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:57:06.848 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:06 smithi096 systemd[1]: Stopping Ceph mgr.x for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T15:57:06.849 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:06 smithi096 docker[30479]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:57:07.198 INFO:tasks.rados.rados.0.smithi033.stdout:176: done (4 left) 2021-07-26T15:57:07.198 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 13 2021-07-26T15:57:07.198 INFO:tasks.rados.rados.0.smithi033.stdout:177: seq_num 78 ranges {0=516096,516096=679936,1196032=122880} 2021-07-26T15:57:07.199 INFO:tasks.rados.rados.0.smithi033.stdout:177: writing smithi03339061-25 from 0 to 516096 tid 1 2021-07-26T15:57:07.200 INFO:tasks.rados.rados.0.smithi033.stdout:177: writing smithi03339061-25 from 516096 to 1196032 tid 2 2021-07-26T15:57:07.202 INFO:tasks.rados.rados.0.smithi033.stdout:177: writing smithi03339061-25 from 1196032 to 1318912 tid 3 2021-07-26T15:57:07.203 INFO:tasks.rados.rados.0.smithi033.stdout:171: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:57:07.223 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 36 (ObjNum 33 snap 0 seq_num 33) dirty exists 2021-07-26T15:57:07.224 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 21 (ObjNum 31 snap 0 seq_num 31) dirty exists 2021-07-26T15:57:07.224 INFO:tasks.rados.rados.0.smithi033.stdout:174: finishing copy_from to smithi03339061-33 2021-07-26T15:57:07.224 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 2 (ObjNum 15 snap 0 seq_num 15) dirty exists 2021-07-26T15:57:07.225 INFO:tasks.rados.rados.0.smithi033.stdout:174: finishing copy_from racing read to smithi03339061-33 2021-07-26T15:57:07.225 INFO:tasks.rados.rados.0.smithi033.stdout:177: finishing write tid 1 to smithi03339061-25 2021-07-26T15:57:07.225 INFO:tasks.rados.rados.0.smithi033.stdout:177: finishing write tid 2 to smithi03339061-25 2021-07-26T15:57:07.225 INFO:tasks.rados.rados.0.smithi033.stdout:171: done (4 left) 2021-07-26T15:57:07.226 INFO:tasks.rados.rados.0.smithi033.stdout:173: done (3 left) 2021-07-26T15:57:07.226 INFO:tasks.rados.rados.0.smithi033.stdout:174: done (2 left) 2021-07-26T15:57:07.226 INFO:tasks.rados.rados.0.smithi033.stdout:175: done (1 left) 2021-07-26T15:57:07.226 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 13 2021-07-26T15:57:07.226 INFO:tasks.rados.rados.0.smithi033.stdout:177: finishing write tid 3 to smithi03339061-25 2021-07-26T15:57:07.227 INFO:tasks.rados.rados.0.smithi033.stdout:177: finishing write tid 4 to smithi03339061-25 2021-07-26T15:57:07.227 INFO:tasks.rados.rados.0.smithi033.stdout:177: finishing write tid 5 to smithi03339061-25 2021-07-26T15:57:07.227 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 27 (ObjNum 78 snap 13 seq_num 78) dirty exists 2021-07-26T15:57:07.228 INFO:tasks.rados.rados.0.smithi033.stdout:177: left oid 25 (ObjNum 78 snap 13 seq_num 78) 2021-07-26T15:57:07.228 INFO:tasks.rados.rados.0.smithi033.stdout:178: seq_num 79 ranges {1777664=532480,2310144=565248,2875392=237568} 2021-07-26T15:57:07.241 INFO:tasks.rados.rados.0.smithi033.stdout:178: writing smithi03339061-45 from 1777664 to 2310144 tid 1 2021-07-26T15:57:07.242 INFO:tasks.rados.rados.0.smithi033.stdout:178: writing smithi03339061-45 from 2310144 to 2875392 tid 2 2021-07-26T15:57:07.243 INFO:tasks.rados.rados.0.smithi033.stdout:178: writing smithi03339061-45 from 2875392 to 3112960 tid 3 2021-07-26T15:57:07.244 INFO:tasks.rados.rados.0.smithi033.stdout:177: done (1 left) 2021-07-26T15:57:07.244 INFO:tasks.rados.rados.0.smithi033.stdout:179: snap_remove snap 11 2021-07-26T15:57:07.560 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:07 smithi096 docker[30479]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-mgr.x 2021-07-26T15:57:07.561 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:07 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.x.service: Main process exited, code=exited, status=143/n/a 2021-07-26T15:57:07.561 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:07 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.x.service: Failed with result 'exit-code'. 2021-07-26T15:57:07.561 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:07 smithi096 systemd[1]: Stopped Ceph mgr.x for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:57:07.561 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:07 smithi096 bash[15117]: cluster 2021-07-26T15:57:06.249717+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-07-26T15:57:07.562 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:07 smithi096 bash[15117]: cluster 2021-07-26T15:57:07.189400+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-07-26T15:57:07.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:07 smithi033 bash[14790]: cluster 2021-07-26T15:57:06.249717+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-07-26T15:57:07.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:07 smithi033 bash[14790]: cluster 2021-07-26T15:57:07.189400+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-07-26T15:57:07.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:07 smithi033 bash[19094]: cluster 2021-07-26T15:57:06.249717+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-07-26T15:57:07.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:07 smithi033 bash[19094]: cluster 2021-07-26T15:57:07.189400+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-07-26T15:57:07.987 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:07 smithi096 systemd[1]: Started Ceph mgr.x for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:57:07.988 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:07 smithi096 bash[30558]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:57:08.210 INFO:tasks.rados.rados.0.smithi033.stdout:179: done (1 left) 2021-07-26T15:57:08.211 INFO:tasks.rados.rados.0.smithi033.stdout:180: delete oid 22 current snap is 13 2021-07-26T15:57:08.211 INFO:tasks.rados.rados.0.smithi033.stdout:178: finishing write tid 1 to smithi03339061-45 2021-07-26T15:57:08.212 INFO:tasks.rados.rados.0.smithi033.stdout:178: finishing write tid 2 to smithi03339061-45 2021-07-26T15:57:08.212 INFO:tasks.rados.rados.0.smithi033.stdout:178: finishing write tid 3 to smithi03339061-45 2021-07-26T15:57:08.213 INFO:tasks.rados.rados.0.smithi033.stdout:178: finishing write tid 4 to smithi03339061-45 2021-07-26T15:57:08.213 INFO:tasks.rados.rados.0.smithi033.stdout:178: finishing write tid 5 to smithi03339061-45 2021-07-26T15:57:08.213 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 47 (ObjNum 79 snap 13 seq_num 79) dirty exists 2021-07-26T15:57:08.213 INFO:tasks.rados.rados.0.smithi033.stdout:178: left oid 45 (ObjNum 79 snap 13 seq_num 79) 2021-07-26T15:57:08.214 INFO:tasks.rados.rados.0.smithi033.stdout:178: done (1 left) 2021-07-26T15:57:08.215 INFO:tasks.rados.rados.0.smithi033.stdout:180: done (0 left) 2021-07-26T15:57:08.215 INFO:tasks.rados.rados.0.smithi033.stdout:181: snap_create 2021-07-26T15:57:08.981 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:08 smithi096 bash[15117]: cluster 2021-07-26T15:57:07.643339+0000 mgr.y (mgr.14146) 391 : cluster [DBG] pgmap v370: 25 pgs: 25 active+clean; 35 MiB data, 108 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 19 op/s 2021-07-26T15:57:08.981 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:08 smithi096 bash[15117]: audit 2021-07-26T15:57:07.721226+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:08.981 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:08 smithi096 bash[15117]: audit 2021-07-26T15:57:07.722849+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:08.982 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:08 smithi096 bash[15117]: audit 2021-07-26T15:57:07.725307+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:08.982 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:08 smithi096 bash[15117]: audit 2021-07-26T15:57:07.727219+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:08.982 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:08 smithi096 bash[15117]: audit 2021-07-26T15:57:07.991412+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:08.982 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:08 smithi096 bash[15117]: cluster 2021-07-26T15:57:08.206509+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-07-26T15:57:09.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[14790]: cluster 2021-07-26T15:57:07.643339+0000 mgr.y (mgr.14146) 391 : cluster [DBG] pgmap v370: 25 pgs: 25 active+clean; 35 MiB data, 108 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 19 op/s 2021-07-26T15:57:09.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[14790]: audit 2021-07-26T15:57:07.721226+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:09.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[14790]: audit 2021-07-26T15:57:07.722849+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:09.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[14790]: audit 2021-07-26T15:57:07.725307+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:09.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[14790]: audit 2021-07-26T15:57:07.727219+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:09.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[14790]: audit 2021-07-26T15:57:07.991412+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:09.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[14790]: cluster 2021-07-26T15:57:08.206509+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-07-26T15:57:09.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[19094]: cluster 2021-07-26T15:57:07.643339+0000 mgr.y (mgr.14146) 391 : cluster [DBG] pgmap v370: 25 pgs: 25 active+clean; 35 MiB data, 108 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 1.6 MiB/s wr, 19 op/s 2021-07-26T15:57:09.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[19094]: audit 2021-07-26T15:57:07.721226+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:09.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[19094]: audit 2021-07-26T15:57:07.722849+0000 mon.a (mon.0) 697 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:09.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[19094]: audit 2021-07-26T15:57:07.725307+0000 mon.a (mon.0) 698 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:09.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[19094]: audit 2021-07-26T15:57:07.727219+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:09.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[19094]: audit 2021-07-26T15:57:07.991412+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:09.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:08 smithi033 bash[19094]: cluster 2021-07-26T15:57:08.206509+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-07-26T15:57:09.212 INFO:tasks.rados.rados.0.smithi033.stdout:181: done (0 left) 2021-07-26T15:57:09.212 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 14 2021-07-26T15:57:09.213 INFO:tasks.rados.rados.0.smithi033.stdout:182: seq_num 81 ranges {24576=565248,589824=737280,1327104=65536} 2021-07-26T15:57:09.213 INFO:tasks.rados.rados.0.smithi033.stdout:182: writing smithi03339061-31 from 24576 to 589824 tid 1 2021-07-26T15:57:09.217 INFO:tasks.rados.rados.0.smithi033.stdout:182: writing smithi03339061-31 from 589824 to 1327104 tid 2 2021-07-26T15:57:09.218 INFO:tasks.rados.rados.0.smithi033.stdout:182: writing smithi03339061-31 from 1327104 to 1392640 tid 3 2021-07-26T15:57:09.218 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 16 current snap is 14 2021-07-26T15:57:09.218 INFO:tasks.rados.rados.0.smithi033.stdout:183: seq_num 82 ranges {253952=581632,835584=622592,1458176=180224} 2021-07-26T15:57:09.222 INFO:tasks.rados.rados.0.smithi033.stdout:183: writing smithi03339061-16 from 253952 to 835584 tid 1 2021-07-26T15:57:09.226 INFO:tasks.rados.rados.0.smithi033.stdout:183: writing smithi03339061-16 from 835584 to 1458176 tid 2 2021-07-26T15:57:09.228 INFO:tasks.rados.rados.0.smithi033.stdout:183: writing smithi03339061-16 from 1458176 to 1638400 tid 3 2021-07-26T15:57:09.228 INFO:tasks.rados.rados.0.smithi033.stdout:184: copy_from oid 10 from oid 39 current snap is 14 2021-07-26T15:57:09.229 INFO:tasks.rados.rados.0.smithi033.stdout:182: finishing write tid 1 to smithi03339061-31 2021-07-26T15:57:09.229 INFO:tasks.rados.rados.0.smithi033.stdout:182: finishing write tid 2 to smithi03339061-31 2021-07-26T15:57:09.229 INFO:tasks.rados.rados.0.smithi033.stdout:185: read oid 48 snap 10 2021-07-26T15:57:09.229 INFO:tasks.rados.rados.0.smithi033.stdout:185: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:57:09.229 INFO:tasks.rados.rados.0.smithi033.stdout:186: copy_from oid 50 from oid 1 current snap is 14 2021-07-26T15:57:09.230 INFO:tasks.rados.rados.0.smithi033.stdout:187: snap_remove snap 13 2021-07-26T15:57:09.237 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:08 smithi096 bash[30558]: debug 2021-07-26T15:57:08.976+0000 7f93a0a5d700 1 -- 172.21.15.96:0/1216161739 <== mon.2 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558ce4804340 con 0x558ce5576c00 2021-07-26T15:57:10.219 INFO:tasks.rados.rados.0.smithi033.stdout:187: done (5 left) 2021-07-26T15:57:10.220 INFO:tasks.rados.rados.0.smithi033.stdout:188: delete oid 18 current snap is 14 2021-07-26T15:57:10.220 INFO:tasks.rados.rados.0.smithi033.stdout:182: finishing write tid 3 to smithi03339061-31 2021-07-26T15:57:10.220 INFO:tasks.rados.rados.0.smithi033.stdout:182: finishing write tid 4 to smithi03339061-31 2021-07-26T15:57:10.221 INFO:tasks.rados.rados.0.smithi033.stdout:183: finishing write tid 1 to smithi03339061-16 2021-07-26T15:57:10.221 INFO:tasks.rados.rados.0.smithi033.stdout:182: finishing write tid 5 to smithi03339061-31 2021-07-26T15:57:10.222 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 8 (ObjNum 81 snap 14 seq_num 81) dirty exists 2021-07-26T15:57:10.222 INFO:tasks.rados.rados.0.smithi033.stdout:182: left oid 31 (ObjNum 81 snap 14 seq_num 81) 2021-07-26T15:57:10.222 INFO:tasks.rados.rados.0.smithi033.stdout:183: finishing write tid 2 to smithi03339061-16 2021-07-26T15:57:10.222 INFO:tasks.rados.rados.0.smithi033.stdout:183: finishing write tid 3 to smithi03339061-16 2021-07-26T15:57:10.222 INFO:tasks.rados.rados.0.smithi033.stdout:183: finishing write tid 4 to smithi03339061-16 2021-07-26T15:57:10.223 INFO:tasks.rados.rados.0.smithi033.stdout:183: finishing write tid 5 to smithi03339061-16 2021-07-26T15:57:10.223 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 34 (ObjNum 82 snap 14 seq_num 82) dirty exists 2021-07-26T15:57:10.223 INFO:tasks.rados.rados.0.smithi033.stdout:183: left oid 16 (ObjNum 82 snap 14 seq_num 82) 2021-07-26T15:57:10.223 INFO:tasks.rados.rados.0.smithi033.stdout:186: finishing copy_from to smithi03339061-50 2021-07-26T15:57:10.223 INFO:tasks.rados.rados.0.smithi033.stdout:186: got expected ENOENT (src dne) 2021-07-26T15:57:10.224 INFO:tasks.rados.rados.0.smithi033.stdout:186: finishing copy_from racing read to smithi03339061-50 2021-07-26T15:57:10.224 INFO:tasks.rados.rados.0.smithi033.stdout:185: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:57:10.239 INFO:tasks.rados.rados.0.smithi033.stdout:184: finishing copy_from to smithi03339061-10 2021-07-26T15:57:10.239 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 43 (ObjNum 38 snap 0 seq_num 38) dirty exists 2021-07-26T15:57:10.240 INFO:tasks.rados.rados.0.smithi033.stdout:184: finishing copy_from racing read to smithi03339061-10 2021-07-26T15:57:10.240 INFO:tasks.rados.rados.0.smithi033.stdout:182: done (5 left) 2021-07-26T15:57:10.240 INFO:tasks.rados.rados.0.smithi033.stdout:183: done (4 left) 2021-07-26T15:57:10.241 INFO:tasks.rados.rados.0.smithi033.stdout:184: done (3 left) 2021-07-26T15:57:10.241 INFO:tasks.rados.rados.0.smithi033.stdout:185: done (2 left) 2021-07-26T15:57:10.241 INFO:tasks.rados.rados.0.smithi033.stdout:186: done (1 left) 2021-07-26T15:57:10.241 INFO:tasks.rados.rados.0.smithi033.stdout:188: done (0 left) 2021-07-26T15:57:10.241 INFO:tasks.rados.rados.0.smithi033.stdout:189: snap_remove snap 10 2021-07-26T15:57:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:10 smithi096 bash[15117]: cluster 2021-07-26T15:57:09.205849+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-07-26T15:57:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:10 smithi096 bash[15117]: cluster 2021-07-26T15:57:09.644109+0000 mgr.y (mgr.14146) 392 : cluster [DBG] pgmap v373: 25 pgs: 25 active+clean; 35 MiB data, 109 MiB used, 715 GiB / 715 GiB avail; 510 KiB/s rd, 482 KiB/s wr, 12 op/s 2021-07-26T15:57:10.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:10 smithi033 bash[19094]: cluster 2021-07-26T15:57:09.205849+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-07-26T15:57:10.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:10 smithi033 bash[19094]: cluster 2021-07-26T15:57:09.644109+0000 mgr.y (mgr.14146) 392 : cluster [DBG] pgmap v373: 25 pgs: 25 active+clean; 35 MiB data, 109 MiB used, 715 GiB / 715 GiB avail; 510 KiB/s rd, 482 KiB/s wr, 12 op/s 2021-07-26T15:57:10.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:10 smithi033 bash[14790]: cluster 2021-07-26T15:57:09.205849+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-07-26T15:57:10.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:10 smithi033 bash[14790]: cluster 2021-07-26T15:57:09.644109+0000 mgr.y (mgr.14146) 392 : cluster [DBG] pgmap v373: 25 pgs: 25 active+clean; 35 MiB data, 109 MiB used, 715 GiB / 715 GiB avail; 510 KiB/s rd, 482 KiB/s wr, 12 op/s 2021-07-26T15:57:11.226 INFO:tasks.rados.rados.0.smithi033.stdout:189: done (0 left) 2021-07-26T15:57:11.226 INFO:tasks.rados.rados.0.smithi033.stdout:190: snap_create 2021-07-26T15:57:11.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:11 smithi096 bash[15117]: cluster 2021-07-26T15:57:10.214316+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-07-26T15:57:11.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:11 smithi033 bash[14790]: cluster 2021-07-26T15:57:10.214316+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-07-26T15:57:11.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:11 smithi033 bash[19094]: cluster 2021-07-26T15:57:10.214316+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-07-26T15:57:12.239 INFO:tasks.rados.rados.0.smithi033.stdout:190: done (0 left) 2021-07-26T15:57:12.240 INFO:tasks.rados.rados.0.smithi033.stdout:191: read oid 46 snap -1 2021-07-26T15:57:12.240 INFO:tasks.rados.rados.0.smithi033.stdout:191: expect (ObjNum 45 snap 0 seq_num 45) 2021-07-26T15:57:12.240 INFO:tasks.rados.rados.0.smithi033.stdout:192: read oid 7 snap 7 2021-07-26T15:57:12.240 INFO:tasks.rados.rados.0.smithi033.stdout:192: expect (ObjNum 16 snap 0 seq_num 16) 2021-07-26T15:57:12.240 INFO:tasks.rados.rados.0.smithi033.stdout:193: snap_create 2021-07-26T15:57:12.244 INFO:tasks.rados.rados.0.smithi033.stdout:192: expect (ObjNum 16 snap 0 seq_num 16) 2021-07-26T15:57:12.256 INFO:tasks.rados.rados.0.smithi033.stdout:191: expect (ObjNum 45 snap 0 seq_num 45) 2021-07-26T15:57:12.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:12 smithi096 bash[15117]: cluster 2021-07-26T15:57:11.223007+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-07-26T15:57:12.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:12 smithi096 bash[15117]: cluster 2021-07-26T15:57:11.644789+0000 mgr.y (mgr.14146) 393 : cluster [DBG] pgmap v376: 25 pgs: 25 active+clean; 38 MiB data, 117 MiB used, 715 GiB / 715 GiB avail; 511 KiB/s rd, 878 KiB/s wr, 4 op/s 2021-07-26T15:57:12.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:12 smithi096 bash[15117]: audit 2021-07-26T15:57:11.696766+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:12.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:12 smithi096 bash[15117]: audit 2021-07-26T15:57:11.697013+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:12.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:12 smithi033 bash[19094]: cluster 2021-07-26T15:57:11.223007+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-07-26T15:57:12.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:12 smithi033 bash[19094]: cluster 2021-07-26T15:57:11.644789+0000 mgr.y (mgr.14146) 393 : cluster [DBG] pgmap v376: 25 pgs: 25 active+clean; 38 MiB data, 117 MiB used, 715 GiB / 715 GiB avail; 511 KiB/s rd, 878 KiB/s wr, 4 op/s 2021-07-26T15:57:12.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:12 smithi033 bash[19094]: audit 2021-07-26T15:57:11.696766+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:12 smithi033 bash[19094]: audit 2021-07-26T15:57:11.697013+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:12.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:12 smithi033 bash[14790]: cluster 2021-07-26T15:57:11.223007+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-07-26T15:57:12.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:12 smithi033 bash[14790]: cluster 2021-07-26T15:57:11.644789+0000 mgr.y (mgr.14146) 393 : cluster [DBG] pgmap v376: 25 pgs: 25 active+clean; 38 MiB data, 117 MiB used, 715 GiB / 715 GiB avail; 511 KiB/s rd, 878 KiB/s wr, 4 op/s 2021-07-26T15:57:12.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:12 smithi033 bash[14790]: audit 2021-07-26T15:57:11.696766+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:12.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:12 smithi033 bash[14790]: audit 2021-07-26T15:57:11.697013+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:13.248 INFO:tasks.rados.rados.0.smithi033.stdout:191: done (2 left) 2021-07-26T15:57:13.248 INFO:tasks.rados.rados.0.smithi033.stdout:192: done (1 left) 2021-07-26T15:57:13.248 INFO:tasks.rados.rados.0.smithi033.stdout:193: done (0 left) 2021-07-26T15:57:13.249 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 16 2021-07-26T15:57:13.249 INFO:tasks.rados.rados.0.smithi033.stdout:194: seq_num 84 ranges {425984=614400,1040384=434176,1474560=368640} 2021-07-26T15:57:13.257 INFO:tasks.rados.rados.0.smithi033.stdout:194: writing smithi03339061-13 from 425984 to 1040384 tid 1 2021-07-26T15:57:13.261 INFO:tasks.rados.rados.0.smithi033.stdout:194: writing smithi03339061-13 from 1040384 to 1474560 tid 2 2021-07-26T15:57:13.264 INFO:tasks.rados.rados.0.smithi033.stdout:194: writing smithi03339061-13 from 1474560 to 1843200 tid 3 2021-07-26T15:57:13.264 INFO:tasks.rados.rados.0.smithi033.stdout:195: copy_from oid 15 from oid 5 current snap is 16 2021-07-26T15:57:13.265 INFO:tasks.rados.rados.0.smithi033.stdout:196: rollback oid 19 current snap is 16 2021-07-26T15:57:13.265 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 19 to 7 2021-07-26T15:57:13.265 INFO:tasks.rados.rados.0.smithi033.stdout:197: copy_from oid 21 from oid 24 current snap is 16 2021-07-26T15:57:13.265 INFO:tasks.rados.rados.0.smithi033.stdout:198: copy_from oid 3 from oid 7 current snap is 16 2021-07-26T15:57:13.265 INFO:tasks.rados.rados.0.smithi033.stdout:199: read oid 33 snap -1 2021-07-26T15:57:13.266 INFO:tasks.rados.rados.0.smithi033.stdout:199: expect (ObjNum 15 snap 0 seq_num 15) 2021-07-26T15:57:13.266 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 16 current snap is 16 2021-07-26T15:57:13.266 INFO:tasks.rados.rados.0.smithi033.stdout:200: seq_num 85 ranges {1638400=630784,2269184=720896,2990080=81920} 2021-07-26T15:57:13.277 INFO:tasks.rados.rados.0.smithi033.stdout:200: writing smithi03339061-16 from 1638400 to 2269184 tid 1 2021-07-26T15:57:13.282 INFO:tasks.rados.rados.0.smithi033.stdout:200: writing smithi03339061-16 from 2269184 to 2990080 tid 2 2021-07-26T15:57:13.283 INFO:tasks.rados.rados.0.smithi033.stdout:200: writing smithi03339061-16 from 2990080 to 3072000 tid 3 2021-07-26T15:57:13.283 INFO:tasks.rados.rados.0.smithi033.stdout:201: rmattr oid 34 current snap is 16 2021-07-26T15:57:13.283 INFO:tasks.rados.rados.0.smithi033.stdout:201: done (7 left) 2021-07-26T15:57:13.283 INFO:tasks.rados.rados.0.smithi033.stdout:202: snap_remove snap 12 2021-07-26T15:57:13.350 INFO:tasks.rados.rados.0.smithi033.stdout:202: done (7 left) 2021-07-26T15:57:13.350 INFO:tasks.rados.rados.0.smithi033.stdout:203: read oid 39 snap -1 2021-07-26T15:57:13.351 INFO:tasks.rados.rados.0.smithi033.stdout:203: expect (ObjNum 38 snap 0 seq_num 38) 2021-07-26T15:57:13.351 INFO:tasks.rados.rados.0.smithi033.stdout:204: rmattr oid 4 current snap is 16 2021-07-26T15:57:13.351 INFO:tasks.rados.rados.0.smithi033.stdout:204: done (8 left) 2021-07-26T15:57:13.351 INFO:tasks.rados.rados.0.smithi033.stdout:205: snap_create 2021-07-26T15:57:13.352 INFO:tasks.rados.rados.0.smithi033.stdout:194: finishing write tid 1 to smithi03339061-13 2021-07-26T15:57:13.352 INFO:tasks.rados.rados.0.smithi033.stdout:194: finishing write tid 2 to smithi03339061-13 2021-07-26T15:57:13.352 INFO:tasks.rados.rados.0.smithi033.stdout:196: finishing rollback tid 0 to smithi03339061-19 2021-07-26T15:57:13.352 INFO:tasks.rados.rados.0.smithi033.stdout:194: finishing write tid 3 to smithi03339061-13 2021-07-26T15:57:13.352 INFO:tasks.rados.rados.0.smithi033.stdout:196: finishing rollback tid 1 to smithi03339061-19 2021-07-26T15:57:13.353 INFO:tasks.rados.rados.0.smithi033.stdout:196: finishing rollback tid 2 to smithi03339061-19 2021-07-26T15:57:13.353 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 41 (ObjNum 18 snap 0 seq_num 18) dirty exists 2021-07-26T15:57:13.353 INFO:tasks.rados.rados.0.smithi033.stdout:194: finishing write tid 4 to smithi03339061-13 2021-07-26T15:57:13.353 INFO:tasks.rados.rados.0.smithi033.stdout:199: expect (ObjNum 15 snap 0 seq_num 15) 2021-07-26T15:57:13.361 INFO:tasks.rados.rados.0.smithi033.stdout:194: finishing write tid 5 to smithi03339061-13 2021-07-26T15:57:13.361 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 44 (ObjNum 84 snap 16 seq_num 84) dirty exists 2021-07-26T15:57:13.361 INFO:tasks.rados.rados.0.smithi033.stdout:194: left oid 13 (ObjNum 84 snap 16 seq_num 84) 2021-07-26T15:57:13.361 INFO:tasks.rados.rados.0.smithi033.stdout:195: finishing copy_from to smithi03339061-15 2021-07-26T15:57:13.362 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 12 (ObjNum 58 snap 4 seq_num 58) dirty exists 2021-07-26T15:57:13.362 INFO:tasks.rados.rados.0.smithi033.stdout:195: finishing copy_from racing read to smithi03339061-15 2021-07-26T15:57:13.362 INFO:tasks.rados.rados.0.smithi033.stdout:197: finishing copy_from to smithi03339061-21 2021-07-26T15:57:13.362 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 32 (ObjNum 59 snap 5 seq_num 59) dirty exists 2021-07-26T15:57:13.363 INFO:tasks.rados.rados.0.smithi033.stdout:197: finishing copy_from racing read to smithi03339061-21 2021-07-26T15:57:13.363 INFO:tasks.rados.rados.0.smithi033.stdout:200: finishing write tid 1 to smithi03339061-16 2021-07-26T15:57:13.363 INFO:tasks.rados.rados.0.smithi033.stdout:198: finishing copy_from to smithi03339061-3 2021-07-26T15:57:13.363 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 2 (ObjNum 16 snap 0 seq_num 16) dirty exists 2021-07-26T15:57:13.363 INFO:tasks.rados.rados.0.smithi033.stdout:198: finishing copy_from racing read to smithi03339061-3 2021-07-26T15:57:13.364 INFO:tasks.rados.rados.0.smithi033.stdout:200: finishing write tid 2 to smithi03339061-16 2021-07-26T15:57:13.364 INFO:tasks.rados.rados.0.smithi033.stdout:200: finishing write tid 3 to smithi03339061-16 2021-07-26T15:57:13.364 INFO:tasks.rados.rados.0.smithi033.stdout:200: finishing write tid 4 to smithi03339061-16 2021-07-26T15:57:13.364 INFO:tasks.rados.rados.0.smithi033.stdout:200: finishing write tid 5 to smithi03339061-16 2021-07-26T15:57:13.365 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 45 (ObjNum 85 snap 16 seq_num 85) dirty exists 2021-07-26T15:57:13.365 INFO:tasks.rados.rados.0.smithi033.stdout:200: left oid 16 (ObjNum 85 snap 16 seq_num 85) 2021-07-26T15:57:13.365 INFO:tasks.rados.rados.0.smithi033.stdout:203: expect (ObjNum 38 snap 0 seq_num 38) 2021-07-26T15:57:13.511 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:13 smithi033 bash[14790]: cluster 2021-07-26T15:57:12.236467+0000 mon.a (mon.0) 707 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-07-26T15:57:13.512 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:13 smithi033 bash[14790]: audit 2021-07-26T15:57:13.082141+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:13.512 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:13 smithi033 bash[19094]: cluster 2021-07-26T15:57:12.236467+0000 mon.a (mon.0) 707 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-07-26T15:57:13.512 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:13 smithi033 bash[19094]: audit 2021-07-26T15:57:13.082141+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:13.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:13 smithi096 bash[15117]: cluster 2021-07-26T15:57:12.236467+0000 mon.a (mon.0) 707 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-07-26T15:57:13.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:13 smithi096 bash[15117]: audit 2021-07-26T15:57:13.082141+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:13.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:13 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:13.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: dial tcp 172.21.15.96:8443: connect: connection refused" context_err="context deadline exceeded" 2021-07-26T15:57:13.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:13 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:13.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:57:13.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:13 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:13.509Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="Post https://172.21.15.96:8443/api/prometheus_receiver: dial tcp 172.21.15.96:8443: connect: connection refused; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T15:57:14.356 INFO:tasks.rados.rados.0.smithi033.stdout:194: done (8 left) 2021-07-26T15:57:14.356 INFO:tasks.rados.rados.0.smithi033.stdout:195: done (7 left) 2021-07-26T15:57:14.356 INFO:tasks.rados.rados.0.smithi033.stdout:196: done (6 left) 2021-07-26T15:57:14.357 INFO:tasks.rados.rados.0.smithi033.stdout:197: done (5 left) 2021-07-26T15:57:14.357 INFO:tasks.rados.rados.0.smithi033.stdout:198: done (4 left) 2021-07-26T15:57:14.357 INFO:tasks.rados.rados.0.smithi033.stdout:199: done (3 left) 2021-07-26T15:57:14.357 INFO:tasks.rados.rados.0.smithi033.stdout:200: done (2 left) 2021-07-26T15:57:14.358 INFO:tasks.rados.rados.0.smithi033.stdout:203: done (1 left) 2021-07-26T15:57:14.358 INFO:tasks.rados.rados.0.smithi033.stdout:205: done (0 left) 2021-07-26T15:57:14.358 INFO:tasks.rados.rados.0.smithi033.stdout:206: copy_from oid 17 from oid 8 current snap is 17 2021-07-26T15:57:14.358 INFO:tasks.rados.rados.0.smithi033.stdout:207: read oid 32 snap -1 2021-07-26T15:57:14.359 INFO:tasks.rados.rados.0.smithi033.stdout:207: expect (ObjNum 31 snap 0 seq_num 31) 2021-07-26T15:57:14.359 INFO:tasks.rados.rados.0.smithi033.stdout:208: snap_remove snap 8 2021-07-26T15:57:14.708 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[15053]: ignoring --setuser ceph since I am not root 2021-07-26T15:57:14.708 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[15053]: ignoring --setgroup ceph since I am not root 2021-07-26T15:57:14.708 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[15053]: debug 2021-07-26T15:57:14.368+0000 7f9cfeec2700 1 -- 172.21.15.33:0/3708775069 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55eb917024e0 con 0x55eb917f2c00 2021-07-26T15:57:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[19094]: cluster 2021-07-26T15:57:13.245415+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2021-07-26T15:57:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[19094]: audit 2021-07-26T15:57:13.317540+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[19094]: audit 2021-07-26T15:57:13.326006+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:14.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[19094]: cephadm 2021-07-26T15:57:13.327728+0000 mgr.y (mgr.14146) 394 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:57:14.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[19094]: cephadm 2021-07-26T15:57:13.333710+0000 mgr.y (mgr.14146) 395 : cephadm [INF] Failing over to other MGR 2021-07-26T15:57:14.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[19094]: audit 2021-07-26T15:57:13.334202+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-07-26T15:57:14.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[19094]: cluster 2021-07-26T15:57:13.344192+0000 mon.a (mon.0) 713 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-07-26T15:57:14.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[19094]: cluster 2021-07-26T15:57:13.645593+0000 mgr.y (mgr.14146) 396 : cluster [DBG] pgmap v380: 25 pgs: 25 active+clean; 41 MiB data, 123 MiB used, 715 GiB / 715 GiB avail; 595 KiB/s rd, 1.4 MiB/s wr, 7 op/s 2021-07-26T15:57:14.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[14790]: cluster 2021-07-26T15:57:13.245415+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2021-07-26T15:57:14.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[14790]: audit 2021-07-26T15:57:13.317540+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:14.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[14790]: audit 2021-07-26T15:57:13.326006+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:14.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[14790]: cephadm 2021-07-26T15:57:13.327728+0000 mgr.y (mgr.14146) 394 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:57:14.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[14790]: cephadm 2021-07-26T15:57:13.333710+0000 mgr.y (mgr.14146) 395 : cephadm [INF] Failing over to other MGR 2021-07-26T15:57:14.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[14790]: audit 2021-07-26T15:57:13.334202+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-07-26T15:57:14.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[14790]: cluster 2021-07-26T15:57:13.344192+0000 mon.a (mon.0) 713 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-07-26T15:57:14.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:14 smithi033 bash[14790]: cluster 2021-07-26T15:57:13.645593+0000 mgr.y (mgr.14146) 396 : cluster [DBG] pgmap v380: 25 pgs: 25 active+clean; 41 MiB data, 123 MiB used, 715 GiB / 715 GiB avail; 595 KiB/s rd, 1.4 MiB/s wr, 7 op/s 2021-07-26T15:57:14.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:14 smithi096 bash[15117]: cluster 2021-07-26T15:57:13.245415+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2021-07-26T15:57:14.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:14 smithi096 bash[15117]: audit 2021-07-26T15:57:13.317540+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' 2021-07-26T15:57:14.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:14 smithi096 bash[15117]: audit 2021-07-26T15:57:13.326006+0000 mon.a (mon.0) 711 : audit [DBG] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:14.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:14 smithi096 bash[15117]: cephadm 2021-07-26T15:57:13.327728+0000 mgr.y (mgr.14146) 394 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:57:14.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:14 smithi096 bash[15117]: cephadm 2021-07-26T15:57:13.333710+0000 mgr.y (mgr.14146) 395 : cephadm [INF] Failing over to other MGR 2021-07-26T15:57:14.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:14 smithi096 bash[15117]: audit 2021-07-26T15:57:13.334202+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2021-07-26T15:57:14.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:14 smithi096 bash[15117]: cluster 2021-07-26T15:57:13.344192+0000 mon.a (mon.0) 713 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2021-07-26T15:57:14.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:14 smithi096 bash[15117]: cluster 2021-07-26T15:57:13.645593+0000 mgr.y (mgr.14146) 396 : cluster [DBG] pgmap v380: 25 pgs: 25 active+clean; 41 MiB data, 123 MiB used, 715 GiB / 715 GiB avail; 595 KiB/s rd, 1.4 MiB/s wr, 7 op/s 2021-07-26T15:57:15.354 INFO:tasks.rados.rados.0.smithi033.stdout:208: done (2 left) 2021-07-26T15:57:15.355 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 17 2021-07-26T15:57:15.355 INFO:tasks.rados.rados.0.smithi033.stdout:209: seq_num 86 ranges {24576=647168,671744=606208,1277952=196608} 2021-07-26T15:57:15.363 INFO:tasks.rados.rados.0.smithi033.stdout:209: writing smithi03339061-2 from 24576 to 671744 tid 1 2021-07-26T15:57:15.367 INFO:tasks.rados.rados.0.smithi033.stdout:209: writing smithi03339061-2 from 671744 to 1277952 tid 2 2021-07-26T15:57:15.368 INFO:tasks.rados.rados.0.smithi033.stdout:209: writing smithi03339061-2 from 1277952 to 1474560 tid 3 2021-07-26T15:57:15.369 INFO:tasks.rados.rados.0.smithi033.stdout:210: copy_from oid 38 from oid 46 current snap is 17 2021-07-26T15:57:15.369 INFO:tasks.rados.rados.0.smithi033.stdout:207: expect (ObjNum 31 snap 0 seq_num 31) 2021-07-26T15:57:15.388 INFO:tasks.rados.rados.0.smithi033.stdout:206: finishing copy_from to smithi03339061-17 2021-07-26T15:57:15.389 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 3 (ObjNum 7 snap 0 seq_num 7) dirty exists 2021-07-26T15:57:15.389 INFO:tasks.rados.rados.0.smithi033.stdout:206: finishing copy_from racing read to smithi03339061-17 2021-07-26T15:57:15.389 INFO:tasks.rados.rados.0.smithi033.stdout:209: finishing write tid 1 to smithi03339061-2 2021-07-26T15:57:15.389 INFO:tasks.rados.rados.0.smithi033.stdout:209: finishing write tid 2 to smithi03339061-2 2021-07-26T15:57:15.390 INFO:tasks.rados.rados.0.smithi033.stdout:209: finishing write tid 3 to smithi03339061-2 2021-07-26T15:57:15.390 INFO:tasks.rados.rados.0.smithi033.stdout:209: finishing write tid 4 to smithi03339061-2 2021-07-26T15:57:15.390 INFO:tasks.rados.rados.0.smithi033.stdout:209: finishing write tid 5 to smithi03339061-2 2021-07-26T15:57:15.390 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 51 (ObjNum 86 snap 17 seq_num 86) dirty exists 2021-07-26T15:57:15.391 INFO:tasks.rados.rados.0.smithi033.stdout:209: left oid 2 (ObjNum 86 snap 17 seq_num 86) 2021-07-26T15:57:15.391 INFO:tasks.rados.rados.0.smithi033.stdout:210: finishing copy_from to smithi03339061-38 2021-07-26T15:57:15.391 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 4 (ObjNum 45 snap 0 seq_num 45) dirty exists 2021-07-26T15:57:15.391 INFO:tasks.rados.rados.0.smithi033.stdout:210: finishing copy_from racing read to smithi03339061-38 2021-07-26T15:57:15.391 INFO:tasks.rados.rados.0.smithi033.stdout:206: done (3 left) 2021-07-26T15:57:15.392 INFO:tasks.rados.rados.0.smithi033.stdout:207: done (2 left) 2021-07-26T15:57:15.392 INFO:tasks.rados.rados.0.smithi033.stdout:209: done (1 left) 2021-07-26T15:57:15.392 INFO:tasks.rados.rados.0.smithi033.stdout:210: done (0 left) 2021-07-26T15:57:15.392 INFO:tasks.rados.rados.0.smithi033.stdout:211: snap_remove snap 7 2021-07-26T15:57:15.561 INFO:tasks.rados.rados.0.smithi033.stdout:211: done (0 left) 2021-07-26T15:57:15.561 INFO:tasks.rados.rados.0.smithi033.stdout:212: rmattr oid 46 current snap is 17 2021-07-26T15:57:15.562 INFO:tasks.rados.rados.0.smithi033.stdout:212: done (0 left) 2021-07-26T15:57:15.562 INFO:tasks.rados.rados.0.smithi033.stdout:213: rmattr oid 47 current snap is 17 2021-07-26T15:57:15.562 INFO:tasks.rados.rados.0.smithi033.stdout:213: done (0 left) 2021-07-26T15:57:15.562 INFO:tasks.rados.rados.0.smithi033.stdout:214: rmattr oid 39 current snap is 17 2021-07-26T15:57:15.563 INFO:tasks.rados.rados.0.smithi033.stdout:214: done (0 left) 2021-07-26T15:57:15.563 INFO:tasks.rados.rados.0.smithi033.stdout:215: read oid 19 snap -1 2021-07-26T15:57:15.563 INFO:tasks.rados.rados.0.smithi033.stdout:215: expect (ObjNum 18 snap 0 seq_num 18) 2021-07-26T15:57:15.563 INFO:tasks.rados.rados.0.smithi033.stdout:216: read oid 38 snap -1 2021-07-26T15:57:15.564 INFO:tasks.rados.rados.0.smithi033.stdout:216: expect (ObjNum 45 snap 0 seq_num 45) 2021-07-26T15:57:15.564 INFO:tasks.rados.rados.0.smithi033.stdout:217: setattr oid 15 current snap is 17 2021-07-26T15:57:15.564 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 17 2021-07-26T15:57:15.565 INFO:tasks.rados.rados.0.smithi033.stdout:218: seq_num 87 ranges {0=663552,663552=491520,1155072=311296} 2021-07-26T15:57:15.573 INFO:tasks.rados.rados.0.smithi033.stdout:218: writing smithi03339061-1 from 0 to 663552 tid 1 2021-07-26T15:57:15.576 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:15 smithi033 bash[14790]: audit 2021-07-26T15:57:14.327065+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-07-26T15:57:15.577 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:15 smithi033 bash[14790]: cluster 2021-07-26T15:57:14.327293+0000 mon.a (mon.0) 715 : cluster [DBG] mgrmap e15: x(active, starting, since 0.991589s) 2021-07-26T15:57:15.577 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:15 smithi033 bash[14790]: cluster 2021-07-26T15:57:14.349893+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-07-26T15:57:15.577 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:15 smithi033 bash[19094]: audit 2021-07-26T15:57:14.327065+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-07-26T15:57:15.578 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:15 smithi033 bash[19094]: cluster 2021-07-26T15:57:14.327293+0000 mon.a (mon.0) 715 : cluster [DBG] mgrmap e15: x(active, starting, since 0.991589s) 2021-07-26T15:57:15.578 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:15 smithi033 bash[19094]: cluster 2021-07-26T15:57:14.349893+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-07-26T15:57:15.580 INFO:tasks.rados.rados.0.smithi033.stdout:218: writing smithi03339061-1 from 663552 to 1155072 tid 2 2021-07-26T15:57:15.585 INFO:tasks.rados.rados.0.smithi033.stdout:218: writing smithi03339061-1 from 1155072 to 1466368 tid 3 2021-07-26T15:57:15.585 INFO:tasks.rados.rados.0.smithi033.stdout:219: copy_from oid 26 from oid 10 current snap is 17 2021-07-26T15:57:15.586 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 39 (ObjNum 58 snap 4 seq_num 58) dirty exists 2021-07-26T15:57:15.586 INFO:tasks.rados.rados.0.smithi033.stdout:215: expect (ObjNum 18 snap 0 seq_num 18) 2021-07-26T15:57:15.594 INFO:tasks.rados.rados.0.smithi033.stdout:216: expect (ObjNum 45 snap 0 seq_num 45) 2021-07-26T15:57:15.616 INFO:tasks.rados.rados.0.smithi033.stdout:218: finishing write tid 1 to smithi03339061-1 2021-07-26T15:57:15.617 INFO:tasks.rados.rados.0.smithi033.stdout:218: finishing write tid 2 to smithi03339061-1 2021-07-26T15:57:15.617 INFO:tasks.rados.rados.0.smithi033.stdout:215: done (4 left) 2021-07-26T15:57:15.617 INFO:tasks.rados.rados.0.smithi033.stdout:216: done (3 left) 2021-07-26T15:57:15.618 INFO:tasks.rados.rados.0.smithi033.stdout:217: done (2 left) 2021-07-26T15:57:15.618 INFO:tasks.rados.rados.0.smithi033.stdout:220: snap_create 2021-07-26T15:57:15.618 INFO:tasks.rados.rados.0.smithi033.stdout:218: finishing write tid 3 to smithi03339061-1 2021-07-26T15:57:15.618 INFO:tasks.rados.rados.0.smithi033.stdout:218: finishing write tid 4 to smithi03339061-1 2021-07-26T15:57:15.619 INFO:tasks.rados.rados.0.smithi033.stdout:218: finishing write tid 5 to smithi03339061-1 2021-07-26T15:57:15.619 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 7 (ObjNum 87 snap 17 seq_num 87) dirty exists 2021-07-26T15:57:15.619 INFO:tasks.rados.rados.0.smithi033.stdout:218: left oid 1 (ObjNum 87 snap 17 seq_num 87) 2021-07-26T15:57:15.619 INFO:tasks.rados.rados.0.smithi033.stdout:219: finishing copy_from to smithi03339061-26 2021-07-26T15:57:15.619 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 43 (ObjNum 38 snap 0 seq_num 38) dirty exists 2021-07-26T15:57:15.620 INFO:tasks.rados.rados.0.smithi033.stdout:219: finishing copy_from racing read to smithi03339061-26 2021-07-26T15:57:15.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:15 smithi096 bash[15117]: audit 2021-07-26T15:57:14.327065+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.14146 172.21.15.33:0/847353932' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2021-07-26T15:57:15.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:15 smithi096 bash[15117]: cluster 2021-07-26T15:57:14.327293+0000 mon.a (mon.0) 715 : cluster [DBG] mgrmap e15: x(active, starting, since 0.991589s) 2021-07-26T15:57:15.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:15 smithi096 bash[15117]: cluster 2021-07-26T15:57:14.349893+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2021-07-26T15:57:15.739 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:57:15 smithi096 bash[25729]: debug 2021-07-26T15:57:15.564+0000 7fd5ef664700 -1 osd.7 pg_epoch: 92 pg[3.es0( v 91'10 (0'0,91'10] local-lis/les=57/58 n=3 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [7,4,1]p7(0) r=0 lpr=57 crt=91'10 lcod 82'8 mlcod 82'8 active+clean+snaptrim trimq=[10~1] ps=[11~5,18~1]] removing snap head 2021-07-26T15:57:15.958 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:57:15 smithi033 bash[29474]: debug 2021-07-26T15:57:15.568+0000 7f0abb262700 -1 osd.3 pg_epoch: 92 pg[3.bs0( v 92'81 (0'0,92'81] local-lis/les=57/58 n=8 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [3,0,4]p3(0) r=0 lpr=57 luod=91'79 crt=91'79 lcod 91'77 mlcod 91'77 active+clean+snaptrim trimq=[10~1] ps=[11~5,18~1]] removing snap head 2021-07-26T15:57:15.958 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:57:15 smithi033 bash[29474]: debug 2021-07-26T15:57:15.572+0000 7f0abb262700 -1 osd.3 pg_epoch: 92 pg[3.bs0( v 92'83 (0'0,92'83] local-lis/les=57/58 n=6 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [3,0,4]p3(0) r=0 lpr=57 crt=92'83 lcod 92'81 mlcod 92'81 active+clean+snaptrim trimq=[10~1] ps=[11~5,18~1]] removing snap head 2021-07-26T15:57:16.563 INFO:tasks.rados.rados.0.smithi033.stdout:218: done (2 left) 2021-07-26T15:57:16.563 INFO:tasks.rados.rados.0.smithi033.stdout:219: done (1 left) 2021-07-26T15:57:16.564 INFO:tasks.rados.rados.0.smithi033.stdout:220: done (0 left) 2021-07-26T15:57:16.564 INFO:tasks.rados.rados.0.smithi033.stdout:221: delete oid 31 current snap is 18 2021-07-26T15:57:16.568 INFO:tasks.rados.rados.0.smithi033.stdout:221: done (0 left) 2021-07-26T15:57:16.569 INFO:tasks.rados.rados.0.smithi033.stdout:222: delete oid 26 current snap is 18 2021-07-26T15:57:16.573 INFO:tasks.rados.rados.0.smithi033.stdout:222: done (0 left) 2021-07-26T15:57:16.573 INFO:tasks.rados.rados.0.smithi033.stdout:223: copy_from oid 20 from oid 42 current snap is 18 2021-07-26T15:57:16.573 INFO:tasks.rados.rados.0.smithi033.stdout:224: delete oid 5 current snap is 18 2021-07-26T15:57:16.579 INFO:tasks.rados.rados.0.smithi033.stdout:224: done (1 left) 2021-07-26T15:57:16.579 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 18 2021-07-26T15:57:16.579 INFO:tasks.rados.rados.0.smithi033.stdout:225: seq_num 91 ranges {1843200=729088,2572288=425984,2998272=376832} 2021-07-26T15:57:16.597 INFO:tasks.rados.rados.0.smithi033.stdout:225: writing smithi03339061-13 from 1843200 to 2572288 tid 1 2021-07-26T15:57:16.599 INFO:tasks.rados.rados.0.smithi033.stdout:225: writing smithi03339061-13 from 2572288 to 2998272 tid 2 2021-07-26T15:57:16.602 INFO:tasks.rados.rados.0.smithi033.stdout:225: writing smithi03339061-13 from 2998272 to 3375104 tid 3 2021-07-26T15:57:16.602 INFO:tasks.rados.rados.0.smithi033.stdout:226: read oid 19 snap -1 2021-07-26T15:57:16.603 INFO:tasks.rados.rados.0.smithi033.stdout:226: expect (ObjNum 18 snap 0 seq_num 18) 2021-07-26T15:57:16.603 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 18 2021-07-26T15:57:16.603 INFO:tasks.rados.rados.0.smithi033.stdout:223: finishing copy_from to smithi03339061-20 2021-07-26T15:57:16.603 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 4 (ObjNum 41 snap 0 seq_num 41) dirty exists 2021-07-26T15:57:16.604 INFO:tasks.rados.rados.0.smithi033.stdout:227: seq_num 92 ranges {1474560=745472,2220032=761856,2981888=40960} 2021-07-26T15:57:16.615 INFO:tasks.rados.rados.0.smithi033.stdout:227: writing smithi03339061-21 from 1474560 to 2220032 tid 1 2021-07-26T15:57:16.616 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[14790]: cluster 2021-07-26T15:57:15.349964+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-07-26T15:57:16.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[14790]: cluster 2021-07-26T15:57:15.549603+0000 mon.a (mon.0) 718 : cluster [INF] Active manager daemon x restarted 2021-07-26T15:57:16.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[14790]: cluster 2021-07-26T15:57:15.550863+0000 mon.a (mon.0) 719 : cluster [INF] Activating manager daemon x 2021-07-26T15:57:16.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[14790]: audit 2021-07-26T15:57:15.551888+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:57:16.617 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[14790]: cluster 2021-07-26T15:57:15.558502+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-07-26T15:57:16.618 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[14790]: audit 2021-07-26T15:57:15.563808+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:16.618 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[14790]: audit 2021-07-26T15:57:15.566824+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:57:16.618 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[14790]: audit 2021-07-26T15:57:15.569056+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:16.618 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[19094]: cluster 2021-07-26T15:57:15.349964+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-07-26T15:57:16.619 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[19094]: cluster 2021-07-26T15:57:15.549603+0000 mon.a (mon.0) 718 : cluster [INF] Active manager daemon x restarted 2021-07-26T15:57:16.619 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[19094]: cluster 2021-07-26T15:57:15.550863+0000 mon.a (mon.0) 719 : cluster [INF] Activating manager daemon x 2021-07-26T15:57:16.619 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[19094]: audit 2021-07-26T15:57:15.551888+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:57:16.619 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[19094]: cluster 2021-07-26T15:57:15.558502+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-07-26T15:57:16.620 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[19094]: audit 2021-07-26T15:57:15.563808+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:16.621 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[19094]: audit 2021-07-26T15:57:15.566824+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:57:16.621 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:16 smithi033 bash[19094]: audit 2021-07-26T15:57:15.569056+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:16.622 INFO:tasks.rados.rados.0.smithi033.stdout:227: writing smithi03339061-21 from 2220032 to 2981888 tid 2 2021-07-26T15:57:16.622 INFO:tasks.rados.rados.0.smithi033.stdout:227: writing smithi03339061-21 from 2981888 to 3022848 tid 3 2021-07-26T15:57:16.623 INFO:tasks.rados.rados.0.smithi033.stdout:228: delete oid 22 current snap is 18 2021-07-26T15:57:16.623 INFO:tasks.rados.rados.0.smithi033.stdout:223: finishing copy_from racing read to smithi03339061-20 2021-07-26T15:57:16.623 INFO:tasks.rados.rados.0.smithi033.stdout:225: finishing write tid 1 to smithi03339061-13 2021-07-26T15:57:16.623 INFO:tasks.rados.rados.0.smithi033.stdout:225: finishing write tid 2 to smithi03339061-13 2021-07-26T15:57:16.624 INFO:tasks.rados.rados.0.smithi033.stdout:225: finishing write tid 3 to smithi03339061-13 2021-07-26T15:57:16.624 INFO:tasks.rados.rados.0.smithi033.stdout:225: finishing write tid 4 to smithi03339061-13 2021-07-26T15:57:16.624 INFO:tasks.rados.rados.0.smithi033.stdout:226: expect (ObjNum 18 snap 0 seq_num 18) 2021-07-26T15:57:16.624 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:16 smithi096 bash[15117]: cluster 2021-07-26T15:57:15.349964+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2021-07-26T15:57:16.625 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:16 smithi096 bash[15117]: cluster 2021-07-26T15:57:15.549603+0000 mon.a (mon.0) 718 : cluster [INF] Active manager daemon x restarted 2021-07-26T15:57:16.625 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:16 smithi096 bash[15117]: cluster 2021-07-26T15:57:15.550863+0000 mon.a (mon.0) 719 : cluster [INF] Activating manager daemon x 2021-07-26T15:57:16.625 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:16 smithi096 bash[15117]: audit 2021-07-26T15:57:15.551888+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:57:16.625 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:16 smithi096 bash[15117]: cluster 2021-07-26T15:57:15.558502+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-07-26T15:57:16.626 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:16 smithi096 bash[15117]: audit 2021-07-26T15:57:15.563808+0000 mon.c (mon.1) 24 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:16.626 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:16 smithi096 bash[15117]: audit 2021-07-26T15:57:15.566824+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:57:16.627 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:16 smithi096 bash[15117]: audit 2021-07-26T15:57:15.569056+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:16.635 INFO:tasks.rados.rados.0.smithi033.stdout:225: finishing write tid 5 to smithi03339061-13 2021-07-26T15:57:16.635 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 57 (ObjNum 91 snap 18 seq_num 91) dirty exists 2021-07-26T15:57:16.635 INFO:tasks.rados.rados.0.smithi033.stdout:225: left oid 13 (ObjNum 91 snap 18 seq_num 91) 2021-07-26T15:57:16.636 INFO:tasks.rados.rados.0.smithi033.stdout:223: done (4 left) 2021-07-26T15:57:16.636 INFO:tasks.rados.rados.0.smithi033.stdout:225: done (3 left) 2021-07-26T15:57:16.636 INFO:tasks.rados.rados.0.smithi033.stdout:226: done (2 left) 2021-07-26T15:57:16.636 INFO:tasks.rados.rados.0.smithi033.stdout:228: done (1 left) 2021-07-26T15:57:16.637 INFO:tasks.rados.rados.0.smithi033.stdout:229: read oid 32 snap -1 2021-07-26T15:57:16.637 INFO:tasks.rados.rados.0.smithi033.stdout:229: expect (ObjNum 31 snap 0 seq_num 31) 2021-07-26T15:57:16.638 INFO:tasks.rados.rados.0.smithi033.stdout:230: rollback oid 26 current snap is 18 2021-07-26T15:57:16.638 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 26 to 17 2021-07-26T15:57:16.639 INFO:tasks.rados.rados.0.smithi033.stdout:227: finishing write tid 1 to smithi03339061-21 2021-07-26T15:57:16.639 INFO:tasks.rados.rados.0.smithi033.stdout:227: finishing write tid 2 to smithi03339061-21 2021-07-26T15:57:16.639 INFO:tasks.rados.rados.0.smithi033.stdout:227: finishing write tid 3 to smithi03339061-21 2021-07-26T15:57:16.640 INFO:tasks.rados.rados.0.smithi033.stdout:227: finishing write tid 4 to smithi03339061-21 2021-07-26T15:57:16.640 INFO:tasks.rados.rados.0.smithi033.stdout:227: finishing write tid 5 to smithi03339061-21 2021-07-26T15:57:16.640 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 76 (ObjNum 92 snap 18 seq_num 92) dirty exists 2021-07-26T15:57:16.641 INFO:tasks.rados.rados.0.smithi033.stdout:227: left oid 21 (ObjNum 92 snap 18 seq_num 92) 2021-07-26T15:57:16.642 INFO:tasks.rados.rados.0.smithi033.stdout:227: done (2 left) 2021-07-26T15:57:16.642 INFO:tasks.rados.rados.0.smithi033.stdout:231: read oid 38 snap -1 2021-07-26T15:57:16.642 INFO:tasks.rados.rados.0.smithi033.stdout:231: expect (ObjNum 45 snap 0 seq_num 45) 2021-07-26T15:57:16.642 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 18 2021-07-26T15:57:16.643 INFO:tasks.rados.rados.0.smithi033.stdout:232: seq_num 94 ranges {1048576=778240,1826816=532480,2359296=270336} 2021-07-26T15:57:16.651 INFO:tasks.rados.rados.0.smithi033.stdout:232: writing smithi03339061-15 from 1048576 to 1826816 tid 1 2021-07-26T15:57:16.657 INFO:tasks.rados.rados.0.smithi033.stdout:232: writing smithi03339061-15 from 1826816 to 2359296 tid 2 2021-07-26T15:57:16.662 INFO:tasks.rados.rados.0.smithi033.stdout:232: writing smithi03339061-15 from 2359296 to 2629632 tid 3 2021-07-26T15:57:16.662 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 18 2021-07-26T15:57:16.662 INFO:tasks.rados.rados.0.smithi033.stdout:233: seq_num 95 ranges {303104=794624,1097728=409600,1507328=393216} 2021-07-26T15:57:16.674 INFO:tasks.rados.rados.0.smithi033.stdout:233: writing smithi03339061-19 from 303104 to 1097728 tid 1 2021-07-26T15:57:16.680 INFO:tasks.rados.rados.0.smithi033.stdout:233: writing smithi03339061-19 from 1097728 to 1507328 tid 2 2021-07-26T15:57:16.688 INFO:tasks.rados.rados.0.smithi033.stdout:233: writing smithi03339061-19 from 1507328 to 1900544 tid 3 2021-07-26T15:57:16.688 INFO:tasks.rados.rados.0.smithi033.stdout:234: read oid 28 snap 16 2021-07-26T15:57:16.688 INFO:tasks.rados.rados.0.smithi033.stdout:234: expect (ObjNum 33 snap 0 seq_num 33) 2021-07-26T15:57:16.688 INFO:tasks.rados.rados.0.smithi033.stdout:235: snap_remove snap 15 2021-07-26T15:57:16.987 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:16 smithi096 bash[30558]: Warning: Permanently added '172.21.15.33' (ECDSA) to the list of known hosts. 2021-07-26T15:57:16.988 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:16 smithi096 bash[30558]: Warning: Permanently added '172.21.15.96' (ECDSA) to the list of known hosts. 2021-07-26T15:57:17.207 INFO:tasks.rados.rados.0.smithi033.stdout:235: done (6 left) 2021-07-26T15:57:17.208 INFO:tasks.rados.rados.0.smithi033.stdout:236: rollback oid 43 current snap is 18 2021-07-26T15:57:17.208 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 43 to 17 2021-07-26T15:57:17.208 INFO:tasks.rados.rados.0.smithi033.stdout:231: expect (ObjNum 45 snap 0 seq_num 45) 2021-07-26T15:57:17.238 INFO:tasks.rados.rados.0.smithi033.stdout:230: finishing rollback tid 1 to smithi03339061-26 2021-07-26T15:57:17.239 INFO:tasks.rados.rados.0.smithi033.stdout:230: finishing rollback tid 2 to smithi03339061-26 2021-07-26T15:57:17.239 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 94 (ObjNum 38 snap 0 seq_num 38) dirty exists 2021-07-26T15:57:17.239 INFO:tasks.rados.rados.0.smithi033.stdout:229: expect (ObjNum 31 snap 0 seq_num 31) 2021-07-26T15:57:17.261 INFO:tasks.rados.rados.0.smithi033.stdout:232: finishing write tid 1 to smithi03339061-15 2021-07-26T15:57:17.262 INFO:tasks.rados.rados.0.smithi033.stdout:232: finishing write tid 2 to smithi03339061-15 2021-07-26T15:57:17.262 INFO:tasks.rados.rados.0.smithi033.stdout:232: finishing write tid 3 to smithi03339061-15 2021-07-26T15:57:17.262 INFO:tasks.rados.rados.0.smithi033.stdout:232: finishing write tid 4 to smithi03339061-15 2021-07-26T15:57:17.262 INFO:tasks.rados.rados.0.smithi033.stdout:232: finishing write tid 5 to smithi03339061-15 2021-07-26T15:57:17.263 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 44 (ObjNum 94 snap 18 seq_num 94) dirty exists 2021-07-26T15:57:17.263 INFO:tasks.rados.rados.0.smithi033.stdout:232: left oid 15 (ObjNum 94 snap 18 seq_num 94) 2021-07-26T15:57:17.263 INFO:tasks.rados.rados.0.smithi033.stdout:233: finishing write tid 1 to smithi03339061-19 2021-07-26T15:57:17.263 INFO:tasks.rados.rados.0.smithi033.stdout:233: finishing write tid 2 to smithi03339061-19 2021-07-26T15:57:17.264 INFO:tasks.rados.rados.0.smithi033.stdout:233: finishing write tid 3 to smithi03339061-19 2021-07-26T15:57:17.264 INFO:tasks.rados.rados.0.smithi033.stdout:233: finishing write tid 4 to smithi03339061-19 2021-07-26T15:57:17.264 INFO:tasks.rados.rados.0.smithi033.stdout:234: expect (ObjNum 33 snap 0 seq_num 33) 2021-07-26T15:57:17.284 INFO:tasks.rados.rados.0.smithi033.stdout:233: finishing write tid 5 to smithi03339061-19 2021-07-26T15:57:17.284 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 54 (ObjNum 95 snap 18 seq_num 95) dirty exists 2021-07-26T15:57:17.284 INFO:tasks.rados.rados.0.smithi033.stdout:233: left oid 19 (ObjNum 95 snap 18 seq_num 95) 2021-07-26T15:57:17.285 INFO:tasks.rados.rados.0.smithi033.stdout:236: finishing rollback tid 0 to smithi03339061-43 2021-07-26T15:57:17.285 INFO:tasks.rados.rados.0.smithi033.stdout:236: finishing rollback tid 1 to smithi03339061-43 2021-07-26T15:57:17.286 INFO:tasks.rados.rados.0.smithi033.stdout:236: finishing rollback tid 2 to smithi03339061-43 2021-07-26T15:57:17.286 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 61 (ObjNum 76 snap 11 seq_num 76) dirty exists 2021-07-26T15:57:17.286 INFO:tasks.rados.rados.0.smithi033.stdout:229: done (6 left) 2021-07-26T15:57:17.287 INFO:tasks.rados.rados.0.smithi033.stdout:230: done (5 left) 2021-07-26T15:57:17.287 INFO:tasks.rados.rados.0.smithi033.stdout:231: done (4 left) 2021-07-26T15:57:17.287 INFO:tasks.rados.rados.0.smithi033.stdout:232: done (3 left) 2021-07-26T15:57:17.288 INFO:tasks.rados.rados.0.smithi033.stdout:233: done (2 left) 2021-07-26T15:57:17.288 INFO:tasks.rados.rados.0.smithi033.stdout:234: done (1 left) 2021-07-26T15:57:17.289 INFO:tasks.rados.rados.0.smithi033.stdout:236: done (0 left) 2021-07-26T15:57:17.289 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 18 2021-07-26T15:57:17.290 INFO:tasks.rados.rados.0.smithi033.stdout:237: seq_num 96 ranges {1900544=409600,2310144=696320,3006464=507904} 2021-07-26T15:57:17.303 INFO:tasks.rados.rados.0.smithi033.stdout:237: writing smithi03339061-19 from 1900544 to 2310144 tid 1 2021-07-26T15:57:17.307 INFO:tasks.rados.rados.0.smithi033.stdout:237: writing smithi03339061-19 from 2310144 to 3006464 tid 2 2021-07-26T15:57:17.310 INFO:tasks.rados.rados.0.smithi033.stdout:237: writing smithi03339061-19 from 3006464 to 3514368 tid 3 2021-07-26T15:57:17.310 INFO:tasks.rados.rados.0.smithi033.stdout:238: snap_remove snap 14 2021-07-26T15:57:17.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: cluster 2021-07-26T15:57:16.361197+0000 mon.a (mon.0) 721 : cluster [DBG] mgrmap e16: x(active, starting, since 0.810632s) 2021-07-26T15:57:17.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.364879+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:17.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.365047+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:17.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.365204+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:17.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.367506+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-07-26T15:57:17.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.368087+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:57:17.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.368492+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:57:17.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.368871+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:57:17.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.369250+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:57:17.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.369633+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:57:17.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.370011+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:57:17.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.370389+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:57:17.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.370768+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:57:17.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.372492+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:57:17.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.372786+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:57:17.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.373646+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:57:17.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: cluster 2021-07-26T15:57:16.403562+0000 mon.a (mon.0) 722 : cluster [INF] Manager daemon x is now available 2021-07-26T15:57:17.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: cluster 2021-07-26T15:57:16.560957+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-07-26T15:57:17.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.561409+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:17.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: cluster 2021-07-26T15:57:16.361197+0000 mon.a (mon.0) 721 : cluster [DBG] mgrmap e16: x(active, starting, since 0.810632s) 2021-07-26T15:57:17.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.364879+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:17.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.365047+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:17.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.365204+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:17.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.367506+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-07-26T15:57:17.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.368087+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:57:17.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.368492+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:57:17.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.368871+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:57:17.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.369250+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:57:17.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.369633+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:57:17.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.370011+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:57:17.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.370389+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:57:17.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.370768+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:57:17.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.372492+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:57:17.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.372786+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:57:17.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.373646+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:57:17.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: cluster 2021-07-26T15:57:16.403562+0000 mon.a (mon.0) 722 : cluster [INF] Manager daemon x is now available 2021-07-26T15:57:17.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: cluster 2021-07-26T15:57:16.560957+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-07-26T15:57:17.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.561409+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:17.718 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.564756+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:17.719 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.568027+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:17.719 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.569580+0000 mon.c (mon.1) 45 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2021-07-26T15:57:17.719 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.569981+0000 mon.c (mon.1) 46 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:17.719 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.570100+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2021-07-26T15:57:17.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.588762+0000 mon.c (mon.1) 47 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:17.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.589292+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:17.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.616231+0000 mon.c (mon.1) 48 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:17.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:16.616983+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:17.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:17.192694+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]': finished 2021-07-26T15:57:17.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: cluster 2021-07-26T15:57:17.193207+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-07-26T15:57:17.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:17.201311+0000 mon.c (mon.1) 49 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:57:17.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[14790]: audit 2021-07-26T15:57:17.202205+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:57:17.722 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.564756+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:17.722 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.568027+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:17.722 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.569580+0000 mon.c (mon.1) 45 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2021-07-26T15:57:17.722 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.569981+0000 mon.c (mon.1) 46 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:17.722 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.570100+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2021-07-26T15:57:17.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.588762+0000 mon.c (mon.1) 47 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:17.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.589292+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:17.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.616231+0000 mon.c (mon.1) 48 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:17.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:16.616983+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:17.724 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:17.192694+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]': finished 2021-07-26T15:57:17.724 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: cluster 2021-07-26T15:57:17.193207+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-07-26T15:57:17.724 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:17.201311+0000 mon.c (mon.1) 49 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:57:17.724 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:17 smithi033 bash[19094]: audit 2021-07-26T15:57:17.202205+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:57:17.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: cluster 2021-07-26T15:57:16.361197+0000 mon.a (mon.0) 721 : cluster [DBG] mgrmap e16: x(active, starting, since 0.810632s) 2021-07-26T15:57:17.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.364879+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:17.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.365047+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:17.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.365204+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:17.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.367506+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-07-26T15:57:17.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.368087+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:57:17.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.368492+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:57:17.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.368871+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:57:17.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.369250+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:57:17.741 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.369633+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:57:17.741 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.370011+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:57:17.741 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.370389+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:57:17.741 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.370768+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:57:17.742 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.372492+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:57:17.742 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.372786+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:57:17.742 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.373646+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:57:17.742 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: cluster 2021-07-26T15:57:16.403562+0000 mon.a (mon.0) 722 : cluster [INF] Manager daemon x is now available 2021-07-26T15:57:17.742 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: cluster 2021-07-26T15:57:16.560957+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-07-26T15:57:17.743 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.561409+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:17.743 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.564756+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:17.743 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.568027+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:17.743 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.569580+0000 mon.c (mon.1) 45 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2021-07-26T15:57:17.744 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.569981+0000 mon.c (mon.1) 46 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:17.744 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.570100+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]: dispatch 2021-07-26T15:57:17.744 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.588762+0000 mon.c (mon.1) 47 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:17.744 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.589292+0000 mon.a (mon.0) 725 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:17.745 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.616231+0000 mon.c (mon.1) 48 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:17.745 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:16.616983+0000 mon.a (mon.0) 726 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:17.745 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:17.192694+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr"}]': finished 2021-07-26T15:57:17.745 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: cluster 2021-07-26T15:57:17.193207+0000 mon.a (mon.0) 728 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-07-26T15:57:17.745 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:17.201311+0000 mon.c (mon.1) 49 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:57:17.746 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:17 smithi096 bash[15117]: audit 2021-07-26T15:57:17.202205+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2021-07-26T15:57:18.209 INFO:tasks.rados.rados.0.smithi033.stdout:237: finishing write tid 1 to smithi03339061-19 2021-07-26T15:57:18.210 INFO:tasks.rados.rados.0.smithi033.stdout:237: finishing write tid 2 to smithi03339061-19 2021-07-26T15:57:18.210 INFO:tasks.rados.rados.0.smithi033.stdout:237: finishing write tid 3 to smithi03339061-19 2021-07-26T15:57:18.211 INFO:tasks.rados.rados.0.smithi033.stdout:237: finishing write tid 4 to smithi03339061-19 2021-07-26T15:57:18.211 INFO:tasks.rados.rados.0.smithi033.stdout:237: finishing write tid 5 to smithi03339061-19 2021-07-26T15:57:18.211 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 60 (ObjNum 96 snap 18 seq_num 96) dirty exists 2021-07-26T15:57:18.211 INFO:tasks.rados.rados.0.smithi033.stdout:237: left oid 19 (ObjNum 96 snap 18 seq_num 96) 2021-07-26T15:57:18.212 INFO:tasks.rados.rados.0.smithi033.stdout:237: done (1 left) 2021-07-26T15:57:18.212 INFO:tasks.rados.rados.0.smithi033.stdout:238: done (0 left) 2021-07-26T15:57:18.212 INFO:tasks.rados.rados.0.smithi033.stdout:239: read oid 6 snap -1 2021-07-26T15:57:18.212 INFO:tasks.rados.rados.0.smithi033.stdout:239: expect deleted 2021-07-26T15:57:18.213 INFO:tasks.rados.rados.0.smithi033.stdout:240: delete oid 19 current snap is 18 2021-07-26T15:57:18.218 INFO:tasks.rados.rados.0.smithi033.stdout:239: done (1 left) 2021-07-26T15:57:18.219 INFO:tasks.rados.rados.0.smithi033.stdout:240: done (0 left) 2021-07-26T15:57:18.219 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 18 2021-07-26T15:57:18.219 INFO:tasks.rados.rados.0.smithi033.stdout:241: seq_num 98 ranges {491520=450560,942080=466944,1409024=737280} 2021-07-26T15:57:18.223 INFO:tasks.rados.rados.0.smithi033.stdout:241: writing smithi03339061-30 from 491520 to 942080 tid 1 2021-07-26T15:57:18.226 INFO:tasks.rados.rados.0.smithi033.stdout:241: writing smithi03339061-30 from 942080 to 1409024 tid 2 2021-07-26T15:57:18.231 INFO:tasks.rados.rados.0.smithi033.stdout:241: writing smithi03339061-30 from 1409024 to 2146304 tid 3 2021-07-26T15:57:18.232 INFO:tasks.rados.rados.0.smithi033.stdout:242: rmattr oid 17 current snap is 18 2021-07-26T15:57:18.232 INFO:tasks.rados.rados.0.smithi033.stdout:242: done (1 left) 2021-07-26T15:57:18.232 INFO:tasks.rados.rados.0.smithi033.stdout:243: snap_remove snap 16 2021-07-26T15:57:18.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:18 smithi033 bash[14790]: cluster 2021-07-26T15:57:17.376210+0000 mon.a (mon.0) 730 : cluster [DBG] mgrmap e17: x(active, since 1.82563s) 2021-07-26T15:57:18.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:18 smithi033 bash[14790]: cluster 2021-07-26T15:57:17.414014+0000 mgr.x (mgr.24598) 1 : cluster [DBG] pgmap v5: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:18.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:18 smithi033 bash[14790]: audit 2021-07-26T15:57:18.204043+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-07-26T15:57:18.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:18 smithi033 bash[14790]: cluster 2021-07-26T15:57:18.204249+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-07-26T15:57:18.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:18 smithi033 bash[19094]: cluster 2021-07-26T15:57:17.376210+0000 mon.a (mon.0) 730 : cluster [DBG] mgrmap e17: x(active, since 1.82563s) 2021-07-26T15:57:18.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:18 smithi033 bash[19094]: cluster 2021-07-26T15:57:17.414014+0000 mgr.x (mgr.24598) 1 : cluster [DBG] pgmap v5: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:18.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:18 smithi033 bash[19094]: audit 2021-07-26T15:57:18.204043+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-07-26T15:57:18.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:18 smithi033 bash[19094]: cluster 2021-07-26T15:57:18.204249+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-07-26T15:57:18.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:18 smithi096 bash[15117]: cluster 2021-07-26T15:57:17.376210+0000 mon.a (mon.0) 730 : cluster [DBG] mgrmap e17: x(active, since 1.82563s) 2021-07-26T15:57:18.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:18 smithi096 bash[15117]: cluster 2021-07-26T15:57:17.414014+0000 mgr.x (mgr.24598) 1 : cluster [DBG] pgmap v5: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:18.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:18 smithi096 bash[15117]: audit 2021-07-26T15:57:18.204043+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2021-07-26T15:57:18.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:18 smithi096 bash[15117]: cluster 2021-07-26T15:57:18.204249+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-07-26T15:57:19.211 INFO:tasks.rados.rados.0.smithi033.stdout:243: done (1 left) 2021-07-26T15:57:19.216 INFO:tasks.rados.rados.0.smithi033.stdout:244: snap_remove snap 17 2021-07-26T15:57:19.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:19 smithi033 bash[14790]: cluster 2021-07-26T15:57:18.374143+0000 mgr.x (mgr.24598) 2 : cluster [DBG] pgmap v7: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:19.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:19 smithi033 bash[14790]: cluster 2021-07-26T15:57:18.386388+0000 mon.a (mon.0) 733 : cluster [DBG] mgrmap e18: x(active, since 2s) 2021-07-26T15:57:19.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:19 smithi033 bash[14790]: cluster 2021-07-26T15:57:19.208022+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-07-26T15:57:19.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:19 smithi033 bash[14790]: audit 2021-07-26T15:57:19.272430+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:19.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:19 smithi033 bash[19094]: cluster 2021-07-26T15:57:18.374143+0000 mgr.x (mgr.24598) 2 : cluster [DBG] pgmap v7: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:19.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:19 smithi033 bash[19094]: cluster 2021-07-26T15:57:18.386388+0000 mon.a (mon.0) 733 : cluster [DBG] mgrmap e18: x(active, since 2s) 2021-07-26T15:57:19.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:19 smithi033 bash[19094]: cluster 2021-07-26T15:57:19.208022+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-07-26T15:57:19.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:19 smithi033 bash[19094]: audit 2021-07-26T15:57:19.272430+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:19.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:19 smithi096 bash[15117]: cluster 2021-07-26T15:57:18.374143+0000 mgr.x (mgr.24598) 2 : cluster [DBG] pgmap v7: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:19.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:19 smithi096 bash[15117]: cluster 2021-07-26T15:57:18.386388+0000 mon.a (mon.0) 733 : cluster [DBG] mgrmap e18: x(active, since 2s) 2021-07-26T15:57:19.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:19 smithi096 bash[15117]: cluster 2021-07-26T15:57:19.208022+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-07-26T15:57:19.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:19 smithi096 bash[15117]: audit 2021-07-26T15:57:19.272430+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:20.218 INFO:tasks.rados.rados.0.smithi033.stdout:244: done (1 left) 2021-07-26T15:57:20.219 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 18 2021-07-26T15:57:20.219 INFO:tasks.rados.rados.0.smithi033.stdout:245: seq_num 99 ranges {0=466944,466944=802816,1269760=401408} 2021-07-26T15:57:20.222 INFO:tasks.rados.rados.0.smithi033.stdout:245: writing smithi03339061-6 from 0 to 466944 tid 1 2021-07-26T15:57:20.231 INFO:tasks.rados.rados.0.smithi033.stdout:245: writing smithi03339061-6 from 466944 to 1269760 tid 2 2021-07-26T15:57:20.235 INFO:tasks.rados.rados.0.smithi033.stdout:245: writing smithi03339061-6 from 1269760 to 1671168 tid 3 2021-07-26T15:57:20.235 INFO:tasks.rados.rados.0.smithi033.stdout:246: read oid 11 snap -1 2021-07-26T15:57:20.236 INFO:tasks.rados.rados.0.smithi033.stdout:246: expect (ObjNum 15 snap 0 seq_num 15) 2021-07-26T15:57:20.236 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 18 2021-07-26T15:57:20.236 INFO:tasks.rados.rados.0.smithi033.stdout:247: seq_num 100 ranges {557056=483328,1040384=688128,1728512=516096} 2021-07-26T15:57:20.245 INFO:tasks.rados.rados.0.smithi033.stdout:247: writing smithi03339061-28 from 557056 to 1040384 tid 1 2021-07-26T15:57:20.252 INFO:tasks.rados.rados.0.smithi033.stdout:247: writing smithi03339061-28 from 1040384 to 1728512 tid 2 2021-07-26T15:57:20.258 INFO:tasks.rados.rados.0.smithi033.stdout:247: writing smithi03339061-28 from 1728512 to 2244608 tid 3 2021-07-26T15:57:20.259 INFO:tasks.rados.rados.0.smithi033.stdout:248: snap_create 2021-07-26T15:57:20.259 INFO:tasks.rados.rados.0.smithi033.stdout:241: finishing write tid 1 to smithi03339061-30 2021-07-26T15:57:20.259 INFO:tasks.rados.rados.0.smithi033.stdout:241: finishing write tid 2 to smithi03339061-30 2021-07-26T15:57:20.259 INFO:tasks.rados.rados.0.smithi033.stdout:241: finishing write tid 3 to smithi03339061-30 2021-07-26T15:57:20.259 INFO:tasks.rados.rados.0.smithi033.stdout:241: finishing write tid 4 to smithi03339061-30 2021-07-26T15:57:20.260 INFO:tasks.rados.rados.0.smithi033.stdout:241: finishing write tid 5 to smithi03339061-30 2021-07-26T15:57:20.260 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 60 (ObjNum 98 snap 18 seq_num 98) dirty exists 2021-07-26T15:57:20.260 INFO:tasks.rados.rados.0.smithi033.stdout:241: left oid 30 (ObjNum 98 snap 18 seq_num 98) 2021-07-26T15:57:20.260 INFO:tasks.rados.rados.0.smithi033.stdout:245: finishing write tid 1 to smithi03339061-6 2021-07-26T15:57:20.261 INFO:tasks.rados.rados.0.smithi033.stdout:245: finishing write tid 2 to smithi03339061-6 2021-07-26T15:57:20.261 INFO:tasks.rados.rados.0.smithi033.stdout:245: finishing write tid 3 to smithi03339061-6 2021-07-26T15:57:20.261 INFO:tasks.rados.rados.0.smithi033.stdout:246: expect (ObjNum 15 snap 0 seq_num 15) 2021-07-26T15:57:20.266 INFO:tasks.rados.rados.0.smithi033.stdout:245: finishing write tid 4 to smithi03339061-6 2021-07-26T15:57:20.266 INFO:tasks.rados.rados.0.smithi033.stdout:245: finishing write tid 5 to smithi03339061-6 2021-07-26T15:57:20.267 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 106 (ObjNum 99 snap 18 seq_num 99) dirty exists 2021-07-26T15:57:20.267 INFO:tasks.rados.rados.0.smithi033.stdout:245: left oid 6 (ObjNum 99 snap 18 seq_num 99) 2021-07-26T15:57:20.267 INFO:tasks.rados.rados.0.smithi033.stdout:247: finishing write tid 1 to smithi03339061-28 2021-07-26T15:57:20.267 INFO:tasks.rados.rados.0.smithi033.stdout:247: finishing write tid 2 to smithi03339061-28 2021-07-26T15:57:20.268 INFO:tasks.rados.rados.0.smithi033.stdout:247: finishing write tid 3 to smithi03339061-28 2021-07-26T15:57:20.268 INFO:tasks.rados.rados.0.smithi033.stdout:247: finishing write tid 4 to smithi03339061-28 2021-07-26T15:57:20.268 INFO:tasks.rados.rados.0.smithi033.stdout:247: finishing write tid 5 to smithi03339061-28 2021-07-26T15:57:20.268 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 67 (ObjNum 100 snap 18 seq_num 100) dirty exists 2021-07-26T15:57:20.268 INFO:tasks.rados.rados.0.smithi033.stdout:247: left oid 28 (ObjNum 100 snap 18 seq_num 100) 2021-07-26T15:57:20.489 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:57:20 smithi096 bash[25729]: debug 2021-07-26T15:57:20.204+0000 7fd5f2e6b700 -1 osd.7 pg_epoch: 97 pg[3.fs0( v 96'26 (0'0,96'26] local-lis/les=57/58 n=2 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [7,4,0]p7(0) r=0 lpr=57 crt=96'26 lcod 95'24 mlcod 95'24 active+clean+snaptrim trimq=[21~1] ps=[10~2,13~1,15~1,18~1,1b~2,1e~1]] removing snap head 2021-07-26T15:57:20.491 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:57:20 smithi096 bash[20458]: debug 2021-07-26T15:57:20.208+0000 7f2dd473f700 -1 osd.5 pg_epoch: 97 pg[3.cs0( v 97'71 (0'0,97'71] local-lis/les=57/58 n=4 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [5,3,6]p5(0) r=0 lpr=57 luod=96'69 crt=96'69 lcod 96'67 mlcod 96'67 active+clean+snaptrim trimq=[21~1] ps=[10~2,13~1,15~1,18~1,1b~2,1e~1]] removing snap head 2021-07-26T15:57:20.707 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:57:20 smithi033 bash[24389]: debug 2021-07-26T15:57:20.215+0000 7f93f8804700 -1 osd.1 pg_epoch: 97 pg[3.0s0( v 96'65 (0'0,96'65] local-lis/les=57/58 n=5 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [1,2,6]p1(0) r=0 lpr=57 crt=96'65 lcod 95'63 mlcod 95'63 active+clean+snaptrim trimq=[21~1] ps=[10~2,13~1,15~1,18~1,1b~2,1e~1]] removing snap head 2021-07-26T15:57:21.225 INFO:tasks.rados.rados.0.smithi033.stdout:241: done (4 left) 2021-07-26T15:57:21.225 INFO:tasks.rados.rados.0.smithi033.stdout:245: done (3 left) 2021-07-26T15:57:21.226 INFO:tasks.rados.rados.0.smithi033.stdout:246: done (2 left) 2021-07-26T15:57:21.226 INFO:tasks.rados.rados.0.smithi033.stdout:247: done (1 left) 2021-07-26T15:57:21.226 INFO:tasks.rados.rados.0.smithi033.stdout:248: done (0 left) 2021-07-26T15:57:21.226 INFO:tasks.rados.rados.0.smithi033.stdout:249: delete oid 41 current snap is 19 2021-07-26T15:57:21.233 INFO:tasks.rados.rados.0.smithi033.stdout:249: done (0 left) 2021-07-26T15:57:21.233 INFO:tasks.rados.rados.0.smithi033.stdout:250: read oid 13 snap -1 2021-07-26T15:57:21.234 INFO:tasks.rados.rados.0.smithi033.stdout:250: expect (ObjNum 91 snap 18 seq_num 91) 2021-07-26T15:57:21.234 INFO:tasks.rados.rados.0.smithi033.stdout:251: setattr oid 26 current snap is 19 2021-07-26T15:57:21.234 INFO:tasks.rados.rados.0.smithi033.stdout:252: copy_from oid 32 from oid 7 current snap is 19 2021-07-26T15:57:21.234 INFO:tasks.rados.rados.0.smithi033.stdout:253: read oid 22 snap -1 2021-07-26T15:57:21.235 INFO:tasks.rados.rados.0.smithi033.stdout:253: expect deleted 2021-07-26T15:57:21.235 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 19 2021-07-26T15:57:21.235 INFO:tasks.rados.rados.0.smithi033.stdout:254: seq_num 102 ranges {2629632=516096,3145728=450560,3596288=729088,4325376=24576} 2021-07-26T15:57:21.252 INFO:tasks.rados.rados.0.smithi033.stdout:254: writing smithi03339061-15 from 2629632 to 3145728 tid 1 2021-07-26T15:57:21.255 INFO:tasks.rados.rados.0.smithi033.stdout:254: writing smithi03339061-15 from 3145728 to 3596288 tid 2 2021-07-26T15:57:21.261 INFO:tasks.rados.rados.0.smithi033.stdout:254: writing smithi03339061-15 from 3596288 to 4325376 tid 3 2021-07-26T15:57:21.261 INFO:tasks.rados.rados.0.smithi033.stdout:254: writing smithi03339061-15 from 4325376 to 4349952 tid 4 2021-07-26T15:57:21.261 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 19 2021-07-26T15:57:21.261 INFO:tasks.rados.rados.0.smithi033.stdout:255: seq_num 103 ranges {1957888=532480,2490368=737280,3227648=466944} 2021-07-26T15:57:21.276 INFO:tasks.rados.rados.0.smithi033.stdout:255: writing smithi03339061-49 from 1957888 to 2490368 tid 1 2021-07-26T15:57:21.282 INFO:tasks.rados.rados.0.smithi033.stdout:255: writing smithi03339061-49 from 2490368 to 3227648 tid 2 2021-07-26T15:57:21.286 INFO:tasks.rados.rados.0.smithi033.stdout:255: writing smithi03339061-49 from 3227648 to 3694592 tid 3 2021-07-26T15:57:21.286 INFO:tasks.rados.rados.0.smithi033.stdout:256: rollback oid 33 current snap is 19 2021-07-26T15:57:21.286 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 18 2021-07-26T15:57:21.287 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 108 (ObjNum 38 snap 0 seq_num 38) dirty exists 2021-07-26T15:57:21.287 INFO:tasks.rados.rados.0.smithi033.stdout:250: expect (ObjNum 91 snap 18 seq_num 91) 2021-07-26T15:57:21.424 INFO:tasks.rados.rados.0.smithi033.stdout:252: finishing copy_from to smithi03339061-32 2021-07-26T15:57:21.424 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 2 (ObjNum 16 snap 0 seq_num 16) dirty exists 2021-07-26T15:57:21.424 INFO:tasks.rados.rados.0.smithi033.stdout:252: finishing copy_from racing read to smithi03339061-32 2021-07-26T15:57:21.425 INFO:tasks.rados.rados.0.smithi033.stdout:254: finishing write tid 1 to smithi03339061-15 2021-07-26T15:57:21.425 INFO:tasks.rados.rados.0.smithi033.stdout:254: finishing write tid 2 to smithi03339061-15 2021-07-26T15:57:21.425 INFO:tasks.rados.rados.0.smithi033.stdout:254: finishing write tid 3 to smithi03339061-15 2021-07-26T15:57:21.426 INFO:tasks.rados.rados.0.smithi033.stdout:254: finishing write tid 4 to smithi03339061-15 2021-07-26T15:57:21.427 INFO:tasks.rados.rados.0.smithi033.stdout:254: finishing write tid 5 to smithi03339061-15 2021-07-26T15:57:21.427 INFO:tasks.rados.rados.0.smithi033.stdout:254: finishing write tid 6 to smithi03339061-15 2021-07-26T15:57:21.427 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 58 (ObjNum 102 snap 19 seq_num 102) dirty exists 2021-07-26T15:57:21.427 INFO:tasks.rados.rados.0.smithi033.stdout:254: left oid 15 (ObjNum 102 snap 19 seq_num 102) 2021-07-26T15:57:21.428 INFO:tasks.rados.rados.0.smithi033.stdout:255: finishing write tid 1 to smithi03339061-49 2021-07-26T15:57:21.428 INFO:tasks.rados.rados.0.smithi033.stdout:250: done (6 left) 2021-07-26T15:57:21.429 INFO:tasks.rados.rados.0.smithi033.stdout:251: done (5 left) 2021-07-26T15:57:21.429 INFO:tasks.rados.rados.0.smithi033.stdout:252: done (4 left) 2021-07-26T15:57:21.429 INFO:tasks.rados.rados.0.smithi033.stdout:253: done (3 left) 2021-07-26T15:57:21.429 INFO:tasks.rados.rados.0.smithi033.stdout:254: done (2 left) 2021-07-26T15:57:21.430 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 19 2021-07-26T15:57:21.430 INFO:tasks.rados.rados.0.smithi033.stdout:255: finishing write tid 2 to smithi03339061-49 2021-07-26T15:57:21.430 INFO:tasks.rados.rados.0.smithi033.stdout:255: finishing write tid 3 to smithi03339061-49 2021-07-26T15:57:21.430 INFO:tasks.rados.rados.0.smithi033.stdout:255: finishing write tid 4 to smithi03339061-49 2021-07-26T15:57:21.431 INFO:tasks.rados.rados.0.smithi033.stdout:255: finishing write tid 5 to smithi03339061-49 2021-07-26T15:57:21.431 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 63 (ObjNum 103 snap 19 seq_num 103) dirty exists 2021-07-26T15:57:21.432 INFO:tasks.rados.rados.0.smithi033.stdout:255: left oid 49 (ObjNum 103 snap 19 seq_num 103) 2021-07-26T15:57:21.432 INFO:tasks.rados.rados.0.smithi033.stdout:256: finishing rollback tid 0 to smithi03339061-33 2021-07-26T15:57:21.432 INFO:tasks.rados.rados.0.smithi033.stdout:256: finishing rollback tid 1 to smithi03339061-33 2021-07-26T15:57:21.432 INFO:tasks.rados.rados.0.smithi033.stdout:256: finishing rollback tid 2 to smithi03339061-33 2021-07-26T15:57:21.432 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 112 (ObjNum 15 snap 0 seq_num 15) dirty exists 2021-07-26T15:57:21.433 INFO:tasks.rados.rados.0.smithi033.stdout:257: seq_num 104 ranges {638976=548864,1187840=622592,1810432=581632} 2021-07-26T15:57:21.437 INFO:tasks.rados.rados.0.smithi033.stdout:257: writing smithi03339061-10 from 638976 to 1187840 tid 1 2021-07-26T15:57:21.442 INFO:tasks.rados.rados.0.smithi033.stdout:257: writing smithi03339061-10 from 1187840 to 1810432 tid 2 2021-07-26T15:57:21.447 INFO:tasks.rados.rados.0.smithi033.stdout:257: writing smithi03339061-10 from 1810432 to 2392064 tid 3 2021-07-26T15:57:21.447 INFO:tasks.rados.rados.0.smithi033.stdout:255: done (2 left) 2021-07-26T15:57:21.447 INFO:tasks.rados.rados.0.smithi033.stdout:256: done (1 left) 2021-07-26T15:57:21.447 INFO:tasks.rados.rados.0.smithi033.stdout:258: read oid 33 snap -1 2021-07-26T15:57:21.448 INFO:tasks.rados.rados.0.smithi033.stdout:258: expect (ObjNum 15 snap 0 seq_num 15) 2021-07-26T15:57:21.448 INFO:tasks.rados.rados.0.smithi033.stdout:259: rollback oid 39 current snap is 19 2021-07-26T15:57:21.448 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 39 to 18 2021-07-26T15:57:21.449 INFO:tasks.rados.rados.0.smithi033.stdout:257: finishing write tid 1 to smithi03339061-10 2021-07-26T15:57:21.449 INFO:tasks.rados.rados.0.smithi033.stdout:260: rmattr oid 23 current snap is 19 2021-07-26T15:57:21.449 INFO:tasks.rados.rados.0.smithi033.stdout:260: done (3 left) 2021-07-26T15:57:21.449 INFO:tasks.rados.rados.0.smithi033.stdout:261: copy_from oid 8 from oid 7 current snap is 19 2021-07-26T15:57:21.450 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 19 2021-07-26T15:57:21.450 INFO:tasks.rados.rados.0.smithi033.stdout:262: seq_num 105 ranges {2146304=565248,2711552=507904,3219456=507904,3727360=188416} 2021-07-26T15:57:21.461 INFO:tasks.rados.rados.0.smithi033.stdout:262: writing smithi03339061-30 from 2146304 to 2711552 tid 1 2021-07-26T15:57:21.464 INFO:tasks.rados.rados.0.smithi033.stdout:262: writing smithi03339061-30 from 2711552 to 3219456 tid 2 2021-07-26T15:57:21.467 INFO:tasks.rados.rados.0.smithi033.stdout:262: writing smithi03339061-30 from 3219456 to 3727360 tid 3 2021-07-26T15:57:21.468 INFO:tasks.rados.rados.0.smithi033.stdout:262: writing smithi03339061-30 from 3727360 to 3915776 tid 4 2021-07-26T15:57:21.469 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 19 2021-07-26T15:57:21.469 INFO:tasks.rados.rados.0.smithi033.stdout:263: seq_num 106 ranges {1433600=581632,2015232=794624,2809856=409600} 2021-07-26T15:57:21.479 INFO:tasks.rados.rados.0.smithi033.stdout:263: writing smithi03339061-12 from 1433600 to 2015232 tid 1 2021-07-26T15:57:21.484 INFO:tasks.rados.rados.0.smithi033.stdout:263: writing smithi03339061-12 from 2015232 to 2809856 tid 2 2021-07-26T15:57:21.487 INFO:tasks.rados.rados.0.smithi033.stdout:263: writing smithi03339061-12 from 2809856 to 3219456 tid 3 2021-07-26T15:57:21.487 INFO:tasks.rados.rados.0.smithi033.stdout:264: read oid 45 snap 18 2021-07-26T15:57:21.487 INFO:tasks.rados.rados.0.smithi033.stdout:264: expect (ObjNum 79 snap 13 seq_num 79) 2021-07-26T15:57:21.488 INFO:tasks.rados.rados.0.smithi033.stdout:265: rmattr oid 16 current snap is 19 2021-07-26T15:57:21.488 INFO:tasks.rados.rados.0.smithi033.stdout:265: done (7 left) 2021-07-26T15:57:21.488 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 19 2021-07-26T15:57:21.488 INFO:tasks.rados.rados.0.smithi033.stdout:266: seq_num 107 ranges {696320=598016,1294336=729088,2023424=466944,2490368=8192} 2021-07-26T15:57:21.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:21 smithi096 bash[15117]: cluster 2021-07-26T15:57:20.206679+0000 mon.a (mon.0) 736 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-07-26T15:57:21.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:21 smithi096 bash[15117]: cluster 2021-07-26T15:57:20.374831+0000 mgr.x (mgr.24598) 3 : cluster [DBG] pgmap v10: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:21.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:21 smithi096 bash[15117]: cluster 2021-07-26T15:57:20.392665+0000 mon.a (mon.0) 737 : cluster [DBG] mgrmap e19: x(active, since 4s) 2021-07-26T15:57:21.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:21 smithi096 bash[15117]: cluster 2021-07-26T15:57:20.929798+0000 mon.a (mon.0) 738 : cluster [DBG] Standby manager daemon y started 2021-07-26T15:57:21.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:21 smithi096 bash[15117]: audit 2021-07-26T15:57:20.930316+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2021-07-26T15:57:21.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:21 smithi096 bash[15117]: audit 2021-07-26T15:57:20.931592+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:21.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:21 smithi096 bash[15117]: audit 2021-07-26T15:57:20.932952+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2021-07-26T15:57:21.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:21 smithi096 bash[15117]: audit 2021-07-26T15:57:20.933378+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:21.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:21 smithi096 bash[15117]: audit 2021-07-26T15:57:21.147036+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:21.494 INFO:tasks.rados.rados.0.smithi033.stdout:266: writing smithi03339061-48 from 696320 to 1294336 tid 1 2021-07-26T15:57:21.499 INFO:tasks.rados.rados.0.smithi033.stdout:266: writing smithi03339061-48 from 1294336 to 2023424 tid 2 2021-07-26T15:57:21.502 INFO:tasks.rados.rados.0.smithi033.stdout:266: writing smithi03339061-48 from 2023424 to 2490368 tid 3 2021-07-26T15:57:21.502 INFO:tasks.rados.rados.0.smithi033.stdout:266: writing smithi03339061-48 from 2490368 to 2498560 tid 4 2021-07-26T15:57:21.503 INFO:tasks.rados.rados.0.smithi033.stdout:267: read oid 47 snap -1 2021-07-26T15:57:21.503 INFO:tasks.rados.rados.0.smithi033.stdout:267: expect (ObjNum 46 snap 0 seq_num 46) 2021-07-26T15:57:21.503 INFO:tasks.rados.rados.0.smithi033.stdout:268: read oid 18 snap 18 2021-07-26T15:57:21.503 INFO:tasks.rados.rados.0.smithi033.stdout:268: expect deleted 2021-07-26T15:57:21.504 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 19 2021-07-26T15:57:21.504 INFO:tasks.rados.rados.0.smithi033.stdout:269: seq_num 108 ranges {1269760=614400,1884160=606208,2490368=598016} 2021-07-26T15:57:21.513 INFO:tasks.rados.rados.0.smithi033.stdout:269: writing smithi03339061-23 from 1269760 to 1884160 tid 1 2021-07-26T15:57:21.516 INFO:tasks.rados.rados.0.smithi033.stdout:269: writing smithi03339061-23 from 1884160 to 2490368 tid 2 2021-07-26T15:57:21.520 INFO:tasks.rados.rados.0.smithi033.stdout:269: writing smithi03339061-23 from 2490368 to 3088384 tid 3 2021-07-26T15:57:21.520 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 19 2021-07-26T15:57:21.520 INFO:tasks.rados.rados.0.smithi033.stdout:258: expect (ObjNum 15 snap 0 seq_num 15) 2021-07-26T15:57:21.531 INFO:tasks.rados.rados.0.smithi033.stdout:257: finishing write tid 2 to smithi03339061-10 2021-07-26T15:57:21.532 INFO:tasks.rados.rados.0.smithi033.stdout:257: finishing write tid 3 to smithi03339061-10 2021-07-26T15:57:21.532 INFO:tasks.rados.rados.0.smithi033.stdout:257: finishing write tid 4 to smithi03339061-10 2021-07-26T15:57:21.532 INFO:tasks.rados.rados.0.smithi033.stdout:259: finishing rollback tid 0 to smithi03339061-39 2021-07-26T15:57:21.532 INFO:tasks.rados.rados.0.smithi033.stdout:259: finishing rollback tid 1 to smithi03339061-39 2021-07-26T15:57:21.533 INFO:tasks.rados.rados.0.smithi033.stdout:259: finishing rollback tid 2 to smithi03339061-39 2021-07-26T15:57:21.533 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 88 (ObjNum 38 snap 0 seq_num 38) dirty exists 2021-07-26T15:57:21.533 INFO:tasks.rados.rados.0.smithi033.stdout:257: finishing write tid 5 to smithi03339061-10 2021-07-26T15:57:21.534 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 69 (ObjNum 104 snap 19 seq_num 104) dirty exists 2021-07-26T15:57:21.534 INFO:tasks.rados.rados.0.smithi033.stdout:257: left oid 10 (ObjNum 104 snap 19 seq_num 104) 2021-07-26T15:57:21.534 INFO:tasks.rados.rados.0.smithi033.stdout:261: finishing copy_from to smithi03339061-8 2021-07-26T15:57:21.534 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 2 (ObjNum 16 snap 0 seq_num 16) dirty exists 2021-07-26T15:57:21.535 INFO:tasks.rados.rados.0.smithi033.stdout:261: finishing copy_from racing read to smithi03339061-8 2021-07-26T15:57:21.535 INFO:tasks.rados.rados.0.smithi033.stdout:262: finishing write tid 1 to smithi03339061-30 2021-07-26T15:57:21.535 INFO:tasks.rados.rados.0.smithi033.stdout:262: finishing write tid 2 to smithi03339061-30 2021-07-26T15:57:21.535 INFO:tasks.rados.rados.0.smithi033.stdout:270: seq_num 109 ranges {442368=630784,1073152=491520,1564672=483328,2048000=229376} 2021-07-26T15:57:21.536 INFO:tasks.rados.rados.0.smithi033.stdout:270: writing smithi03339061-27 from 442368 to 1073152 tid 1 2021-07-26T15:57:21.538 INFO:tasks.rados.rados.0.smithi033.stdout:270: writing smithi03339061-27 from 1073152 to 1564672 tid 2 2021-07-26T15:57:21.542 INFO:tasks.rados.rados.0.smithi033.stdout:270: writing smithi03339061-27 from 1564672 to 2048000 tid 3 2021-07-26T15:57:21.545 INFO:tasks.rados.rados.0.smithi033.stdout:270: writing smithi03339061-27 from 2048000 to 2277376 tid 4 2021-07-26T15:57:21.545 INFO:tasks.rados.rados.0.smithi033.stdout:257: done (11 left) 2021-07-26T15:57:21.546 INFO:tasks.rados.rados.0.smithi033.stdout:258: done (10 left) 2021-07-26T15:57:21.546 INFO:tasks.rados.rados.0.smithi033.stdout:259: done (9 left) 2021-07-26T15:57:21.546 INFO:tasks.rados.rados.0.smithi033.stdout:261: done (8 left) 2021-07-26T15:57:21.546 INFO:tasks.rados.rados.0.smithi033.stdout:271: copy_from oid 41 from oid 6 current snap is 19 2021-07-26T15:57:21.547 INFO:tasks.rados.rados.0.smithi033.stdout:272: rollback oid 9 current snap is 19 2021-07-26T15:57:21.547 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 9 to 18 2021-07-26T15:57:21.547 INFO:tasks.rados.rados.0.smithi033.stdout:273: rollback oid 46 current snap is 19 2021-07-26T15:57:21.547 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 46 to 18 2021-07-26T15:57:21.548 INFO:tasks.rados.rados.0.smithi033.stdout:274: rmattr oid 24 current snap is 19 2021-07-26T15:57:21.548 INFO:tasks.rados.rados.0.smithi033.stdout:274: done (11 left) 2021-07-26T15:57:21.548 INFO:tasks.rados.rados.0.smithi033.stdout:275: rollback oid 1 current snap is 19 2021-07-26T15:57:21.548 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 1 to 18 2021-07-26T15:57:21.548 INFO:tasks.rados.rados.0.smithi033.stdout:262: finishing write tid 3 to smithi03339061-30 2021-07-26T15:57:21.549 INFO:tasks.rados.rados.0.smithi033.stdout:262: finishing write tid 4 to smithi03339061-30 2021-07-26T15:57:21.549 INFO:tasks.rados.rados.0.smithi033.stdout:262: finishing write tid 5 to smithi03339061-30 2021-07-26T15:57:21.549 INFO:tasks.rados.rados.0.smithi033.stdout:262: finishing write tid 6 to smithi03339061-30 2021-07-26T15:57:21.549 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 75 (ObjNum 105 snap 19 seq_num 105) dirty exists 2021-07-26T15:57:21.549 INFO:tasks.rados.rados.0.smithi033.stdout:262: left oid 30 (ObjNum 105 snap 19 seq_num 105) 2021-07-26T15:57:21.550 INFO:tasks.rados.rados.0.smithi033.stdout:262: done (11 left) 2021-07-26T15:57:21.550 INFO:tasks.rados.rados.0.smithi033.stdout:276: rmattr oid 19 current snap is 19 2021-07-26T15:57:21.550 INFO:tasks.rados.rados.0.smithi033.stdout:276: done (11 left) 2021-07-26T15:57:21.550 INFO:tasks.rados.rados.0.smithi033.stdout:277: copy_from oid 50 from oid 37 current snap is 19 2021-07-26T15:57:21.551 INFO:tasks.rados.rados.0.smithi033.stdout:263: finishing write tid 1 to smithi03339061-12 2021-07-26T15:57:21.551 INFO:tasks.rados.rados.0.smithi033.stdout:263: finishing write tid 2 to smithi03339061-12 2021-07-26T15:57:21.551 INFO:tasks.rados.rados.0.smithi033.stdout:263: finishing write tid 3 to smithi03339061-12 2021-07-26T15:57:21.551 INFO:tasks.rados.rados.0.smithi033.stdout:263: finishing write tid 4 to smithi03339061-12 2021-07-26T15:57:21.551 INFO:tasks.rados.rados.0.smithi033.stdout:263: finishing write tid 5 to smithi03339061-12 2021-07-26T15:57:21.552 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 72 (ObjNum 106 snap 19 seq_num 106) dirty exists 2021-07-26T15:57:21.552 INFO:tasks.rados.rados.0.smithi033.stdout:263: left oid 12 (ObjNum 106 snap 19 seq_num 106) 2021-07-26T15:57:21.552 INFO:tasks.rados.rados.0.smithi033.stdout:263: done (11 left) 2021-07-26T15:57:21.552 INFO:tasks.rados.rados.0.smithi033.stdout:278: rollback oid 35 current snap is 19 2021-07-26T15:57:21.552 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 18 2021-07-26T15:57:21.553 INFO:tasks.rados.rados.0.smithi033.stdout:264: expect (ObjNum 79 snap 13 seq_num 79) 2021-07-26T15:57:21.681 INFO:tasks.rados.rados.0.smithi033.stdout:266: finishing write tid 1 to smithi03339061-48 2021-07-26T15:57:21.682 INFO:tasks.rados.rados.0.smithi033.stdout:266: finishing write tid 2 to smithi03339061-48 2021-07-26T15:57:21.682 INFO:tasks.rados.rados.0.smithi033.stdout:266: finishing write tid 3 to smithi03339061-48 2021-07-26T15:57:21.682 INFO:tasks.rados.rados.0.smithi033.stdout:266: finishing write tid 4 to smithi03339061-48 2021-07-26T15:57:21.683 INFO:tasks.rados.rados.0.smithi033.stdout:267: expect (ObjNum 46 snap 0 seq_num 46) 2021-07-26T15:57:21.705 INFO:tasks.rados.rados.0.smithi033.stdout:266: finishing write tid 5 to smithi03339061-48 2021-07-26T15:57:21.705 INFO:tasks.rados.rados.0.smithi033.stdout:266: finishing write tid 6 to smithi03339061-48 2021-07-26T15:57:21.705 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 80 (ObjNum 107 snap 19 seq_num 107) dirty exists 2021-07-26T15:57:21.705 INFO:tasks.rados.rados.0.smithi033.stdout:266: left oid 48 (ObjNum 107 snap 19 seq_num 107) 2021-07-26T15:57:21.706 INFO:tasks.rados.rados.0.smithi033.stdout:269: finishing write tid 1 to smithi03339061-23 2021-07-26T15:57:21.706 INFO:tasks.rados.rados.0.smithi033.stdout:269: finishing write tid 2 to smithi03339061-23 2021-07-26T15:57:21.706 INFO:tasks.rados.rados.0.smithi033.stdout:264: done (11 left) 2021-07-26T15:57:21.706 INFO:tasks.rados.rados.0.smithi033.stdout:266: done (10 left) 2021-07-26T15:57:21.707 INFO:tasks.rados.rados.0.smithi033.stdout:267: done (9 left) 2021-07-26T15:57:21.707 INFO:tasks.rados.rados.0.smithi033.stdout:268: done (8 left) 2021-07-26T15:57:21.707 INFO:tasks.rados.rados.0.smithi033.stdout:279: snap_create 2021-07-26T15:57:21.707 INFO:tasks.rados.rados.0.smithi033.stdout:269: finishing write tid 3 to smithi03339061-23 2021-07-26T15:57:21.708 INFO:tasks.rados.rados.0.smithi033.stdout:269: finishing write tid 4 to smithi03339061-23 2021-07-26T15:57:21.709 INFO:tasks.rados.rados.0.smithi033.stdout:269: finishing write tid 5 to smithi03339061-23 2021-07-26T15:57:21.709 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 93 (ObjNum 108 snap 19 seq_num 108) dirty exists 2021-07-26T15:57:21.710 INFO:tasks.rados.rados.0.smithi033.stdout:269: left oid 23 (ObjNum 108 snap 19 seq_num 108) 2021-07-26T15:57:21.710 INFO:tasks.rados.rados.0.smithi033.stdout:270: finishing write tid 1 to smithi03339061-27 2021-07-26T15:57:21.710 INFO:tasks.rados.rados.0.smithi033.stdout:270: finishing write tid 2 to smithi03339061-27 2021-07-26T15:57:21.710 INFO:tasks.rados.rados.0.smithi033.stdout:273: finishing rollback tid 0 to smithi03339061-46 2021-07-26T15:57:21.710 INFO:tasks.rados.rados.0.smithi033.stdout:273: finishing rollback tid 1 to smithi03339061-46 2021-07-26T15:57:21.711 INFO:tasks.rados.rados.0.smithi033.stdout:273: finishing rollback tid 2 to smithi03339061-46 2021-07-26T15:57:21.711 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 16 (ObjNum 45 snap 0 seq_num 45) dirty exists 2021-07-26T15:57:21.711 INFO:tasks.rados.rados.0.smithi033.stdout:270: finishing write tid 3 to smithi03339061-27 2021-07-26T15:57:21.711 INFO:tasks.rados.rados.0.smithi033.stdout:275: finishing rollback tid 0 to smithi03339061-1 2021-07-26T15:57:21.712 INFO:tasks.rados.rados.0.smithi033.stdout:275: finishing rollback tid 1 to smithi03339061-1 2021-07-26T15:57:21.712 INFO:tasks.rados.rados.0.smithi033.stdout:270: finishing write tid 4 to smithi03339061-27 2021-07-26T15:57:21.712 INFO:tasks.rados.rados.0.smithi033.stdout:270: finishing write tid 5 to smithi03339061-27 2021-07-26T15:57:21.712 INFO:tasks.rados.rados.0.smithi033.stdout:270: finishing write tid 6 to smithi03339061-27 2021-07-26T15:57:21.712 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 99 (ObjNum 109 snap 19 seq_num 109) dirty exists 2021-07-26T15:57:21.713 INFO:tasks.rados.rados.0.smithi033.stdout:270: left oid 27 (ObjNum 109 snap 19 seq_num 109) 2021-07-26T15:57:21.713 INFO:tasks.rados.rados.0.smithi033.stdout:272: finishing rollback tid 0 to smithi03339061-9 2021-07-26T15:57:21.713 INFO:tasks.rados.rados.0.smithi033.stdout:275: finishing rollback tid 2 to smithi03339061-1 2021-07-26T15:57:21.713 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 11 (ObjNum 87 snap 17 seq_num 87) dirty exists 2021-07-26T15:57:21.713 INFO:tasks.rados.rados.0.smithi033.stdout:272: finishing rollback tid 1 to smithi03339061-9 2021-07-26T15:57:21.714 INFO:tasks.rados.rados.0.smithi033.stdout:272: finishing rollback tid 2 to smithi03339061-9 2021-07-26T15:57:21.714 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 73 (ObjNum 73 snap 8 seq_num 73) dirty exists 2021-07-26T15:57:21.714 INFO:tasks.rados.rados.0.smithi033.stdout:278: finishing rollback tid 0 to smithi03339061-35 2021-07-26T15:57:21.714 INFO:tasks.rados.rados.0.smithi033.stdout:278: finishing rollback tid 1 to smithi03339061-35 2021-07-26T15:57:21.715 INFO:tasks.rados.rados.0.smithi033.stdout:278: finishing rollback tid 2 to smithi03339061-35 2021-07-26T15:57:21.715 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 77 (ObjNum 2006205472 snap 22002 seq_num 2006472400) dirty exists 2021-07-26T15:57:21.715 INFO:tasks.rados.rados.0.smithi033.stdout:277: finishing copy_from to smithi03339061-50 2021-07-26T15:57:21.716 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 8 (ObjNum 36 snap 0 seq_num 36) dirty exists 2021-07-26T15:57:21.716 INFO:tasks.rados.rados.0.smithi033.stdout:277: finishing copy_from racing read to smithi03339061-50 2021-07-26T15:57:21.716 INFO:tasks.rados.rados.0.smithi033.stdout:271: finishing copy_from to smithi03339061-41 2021-07-26T15:57:21.716 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 106 (ObjNum 99 snap 18 seq_num 99) dirty exists 2021-07-26T15:57:21.717 INFO:tasks.rados.rados.0.smithi033.stdout:271: finishing copy_from racing read to smithi03339061-41 2021-07-26T15:57:21.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[19094]: cluster 2021-07-26T15:57:20.206679+0000 mon.a (mon.0) 736 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-07-26T15:57:21.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[19094]: cluster 2021-07-26T15:57:20.374831+0000 mgr.x (mgr.24598) 3 : cluster [DBG] pgmap v10: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:21.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[19094]: cluster 2021-07-26T15:57:20.392665+0000 mon.a (mon.0) 737 : cluster [DBG] mgrmap e19: x(active, since 4s) 2021-07-26T15:57:21.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[19094]: cluster 2021-07-26T15:57:20.929798+0000 mon.a (mon.0) 738 : cluster [DBG] Standby manager daemon y started 2021-07-26T15:57:21.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[19094]: audit 2021-07-26T15:57:20.930316+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2021-07-26T15:57:21.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[19094]: audit 2021-07-26T15:57:20.931592+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:21.719 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[19094]: audit 2021-07-26T15:57:20.932952+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2021-07-26T15:57:21.719 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[19094]: audit 2021-07-26T15:57:20.933378+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:21.719 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[19094]: audit 2021-07-26T15:57:21.147036+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:21.719 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[14790]: cluster 2021-07-26T15:57:20.206679+0000 mon.a (mon.0) 736 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-07-26T15:57:21.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[14790]: cluster 2021-07-26T15:57:20.374831+0000 mgr.x (mgr.24598) 3 : cluster [DBG] pgmap v10: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:21.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[14790]: cluster 2021-07-26T15:57:20.392665+0000 mon.a (mon.0) 737 : cluster [DBG] mgrmap e19: x(active, since 4s) 2021-07-26T15:57:21.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[14790]: cluster 2021-07-26T15:57:20.929798+0000 mon.a (mon.0) 738 : cluster [DBG] Standby manager daemon y started 2021-07-26T15:57:21.720 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[14790]: audit 2021-07-26T15:57:20.930316+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2021-07-26T15:57:21.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[14790]: audit 2021-07-26T15:57:20.931592+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:21.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[14790]: audit 2021-07-26T15:57:20.932952+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2021-07-26T15:57:21.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[14790]: audit 2021-07-26T15:57:20.933378+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.? 172.21.15.33:0/1393701959' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:21.721 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:21 smithi033 bash[14790]: audit 2021-07-26T15:57:21.147036+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.199 INFO:tasks.rados.rados.0.smithi033.stdout:269: done (8 left) 2021-07-26T15:57:22.200 INFO:tasks.rados.rados.0.smithi033.stdout:270: done (7 left) 2021-07-26T15:57:22.200 INFO:tasks.rados.rados.0.smithi033.stdout:271: done (6 left) 2021-07-26T15:57:22.200 INFO:tasks.rados.rados.0.smithi033.stdout:272: done (5 left) 2021-07-26T15:57:22.200 INFO:tasks.rados.rados.0.smithi033.stdout:273: done (4 left) 2021-07-26T15:57:22.201 INFO:tasks.rados.rados.0.smithi033.stdout:275: done (3 left) 2021-07-26T15:57:22.201 INFO:tasks.rados.rados.0.smithi033.stdout:277: done (2 left) 2021-07-26T15:57:22.201 INFO:tasks.rados.rados.0.smithi033.stdout:278: done (1 left) 2021-07-26T15:57:22.201 INFO:tasks.rados.rados.0.smithi033.stdout:279: done (0 left) 2021-07-26T15:57:22.202 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 16 current snap is 20 2021-07-26T15:57:22.202 INFO:tasks.rados.rados.0.smithi033.stdout:280: seq_num 110 ranges {3072000=647168,3719168=778240,4497408=425984} 2021-07-26T15:57:22.225 INFO:tasks.rados.rados.0.smithi033.stdout:280: writing smithi03339061-16 from 3072000 to 3719168 tid 1 2021-07-26T15:57:22.229 INFO:tasks.rados.rados.0.smithi033.stdout:280: writing smithi03339061-16 from 3719168 to 4497408 tid 2 2021-07-26T15:57:22.233 INFO:tasks.rados.rados.0.smithi033.stdout:280: writing smithi03339061-16 from 4497408 to 4923392 tid 3 2021-07-26T15:57:22.234 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 20 2021-07-26T15:57:22.234 INFO:tasks.rados.rados.0.smithi033.stdout:280: finishing write tid 1 to smithi03339061-16 2021-07-26T15:57:22.234 INFO:tasks.rados.rados.0.smithi033.stdout:281: seq_num 111 ranges {0=663552,663552=663552,1327104=450560,1777664=90112} 2021-07-26T15:57:22.236 INFO:tasks.rados.rados.0.smithi033.stdout:281: writing smithi03339061-18 from 0 to 663552 tid 1 2021-07-26T15:57:22.240 INFO:tasks.rados.rados.0.smithi033.stdout:281: writing smithi03339061-18 from 663552 to 1327104 tid 2 2021-07-26T15:57:22.243 INFO:tasks.rados.rados.0.smithi033.stdout:281: writing smithi03339061-18 from 1327104 to 1777664 tid 3 2021-07-26T15:57:22.245 INFO:tasks.rados.rados.0.smithi033.stdout:281: writing smithi03339061-18 from 1777664 to 1867776 tid 4 2021-07-26T15:57:22.245 INFO:tasks.rados.rados.0.smithi033.stdout:282: setattr oid 45 current snap is 20 2021-07-26T15:57:22.246 INFO:tasks.rados.rados.0.smithi033.stdout:280: finishing write tid 2 to smithi03339061-16 2021-07-26T15:57:22.246 INFO:tasks.rados.rados.0.smithi033.stdout:280: finishing write tid 3 to smithi03339061-16 2021-07-26T15:57:22.246 INFO:tasks.rados.rados.0.smithi033.stdout:280: finishing write tid 4 to smithi03339061-16 2021-07-26T15:57:22.246 INFO:tasks.rados.rados.0.smithi033.stdout:280: finishing write tid 5 to smithi03339061-16 2021-07-26T15:57:22.247 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 70 (ObjNum 110 snap 20 seq_num 110) dirty exists 2021-07-26T15:57:22.247 INFO:tasks.rados.rados.0.smithi033.stdout:280: left oid 16 (ObjNum 110 snap 20 seq_num 110) 2021-07-26T15:57:22.247 INFO:tasks.rados.rados.0.smithi033.stdout:281: finishing write tid 1 to smithi03339061-18 2021-07-26T15:57:22.247 INFO:tasks.rados.rados.0.smithi033.stdout:281: finishing write tid 2 to smithi03339061-18 2021-07-26T15:57:22.247 INFO:tasks.rados.rados.0.smithi033.stdout:280: done (2 left) 2021-07-26T15:57:22.248 INFO:tasks.rados.rados.0.smithi033.stdout:283: snap_remove snap 18 2021-07-26T15:57:22.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: cluster 2021-07-26T15:57:21.221847+0000 mon.a (mon.0) 740 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-07-26T15:57:22.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: cluster 2021-07-26T15:57:21.394327+0000 mon.a (mon.0) 741 : cluster [DBG] mgrmap e20: x(active, since 5s), standbys: y 2021-07-26T15:57:22.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.398741+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-07-26T15:57:22.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.400585+0000 mon.c (mon.1) 55 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.400961+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.402252+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.402555+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.403876+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.404255+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.405518+0000 mon.c (mon.1) 58 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.405830+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: cephadm 2021-07-26T15:57:21.408076+0000 mgr.x (mgr.24598) 4 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 3553M 2021-07-26T15:57:22.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.414027+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: cephadm 2021-07-26T15:57:21.416643+0000 mgr.x (mgr.24598) 5 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:57:22.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.505047+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: cephadm 2021-07-26T15:57:21.516304+0000 mgr.x (mgr.24598) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:22.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.555714+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.741357+0000 mon.c (mon.1) 59 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.741930+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.743764+0000 mon.c (mon.1) 60 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: cluster 2021-07-26T15:57:21.221847+0000 mon.a (mon.0) 740 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-07-26T15:57:22.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: cluster 2021-07-26T15:57:21.394327+0000 mon.a (mon.0) 741 : cluster [DBG] mgrmap e20: x(active, since 5s), standbys: y 2021-07-26T15:57:22.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.398741+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-07-26T15:57:22.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.400585+0000 mon.c (mon.1) 55 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.400961+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.402252+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.402555+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.403876+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.404255+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.405518+0000 mon.c (mon.1) 58 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.405830+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: cephadm 2021-07-26T15:57:21.408076+0000 mgr.x (mgr.24598) 4 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 3553M 2021-07-26T15:57:22.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.414027+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: cephadm 2021-07-26T15:57:21.416643+0000 mgr.x (mgr.24598) 5 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:57:22.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.505047+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: cephadm 2021-07-26T15:57:21.516304+0000 mgr.x (mgr.24598) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:22.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.555714+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.741357+0000 mon.c (mon.1) 59 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.741930+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.743764+0000 mon.c (mon.1) 60 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.744410+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.746290+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.470 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.746900+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.470 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.748683+0000 mon.c (mon.1) 62 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.470 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.749338+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.470 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: cephadm 2021-07-26T15:57:21.752083+0000 mgr.x (mgr.24598) 7 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 3552M 2021-07-26T15:57:22.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.760140+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: cephadm 2021-07-26T15:57:21.763030+0000 mgr.x (mgr.24598) 8 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:57:22.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: cephadm 2021-07-26T15:57:21.795898+0000 mgr.x (mgr.24598) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:22.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.832037+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.841215+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.847966+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: audit 2021-07-26T15:57:21.861342+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:22.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: cephadm 2021-07-26T15:57:21.864820+0000 mgr.x (mgr.24598) 10 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:57:22.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[14790]: cluster 2021-07-26T15:57:22.196256+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-07-26T15:57:22.473 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.744410+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.474 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.746290+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.474 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.746900+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.474 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.748683+0000 mon.c (mon.1) 62 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.749338+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: cephadm 2021-07-26T15:57:21.752083+0000 mgr.x (mgr.24598) 7 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 3552M 2021-07-26T15:57:22.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.760140+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: cephadm 2021-07-26T15:57:21.763030+0000 mgr.x (mgr.24598) 8 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:57:22.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: cephadm 2021-07-26T15:57:21.795898+0000 mgr.x (mgr.24598) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:22.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.832037+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.841215+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.847966+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: audit 2021-07-26T15:57:21.861342+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:22.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: cephadm 2021-07-26T15:57:21.864820+0000 mgr.x (mgr.24598) 10 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:57:22.478 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:22 smithi033 bash[19094]: cluster 2021-07-26T15:57:22.196256+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-07-26T15:57:22.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: cluster 2021-07-26T15:57:21.221847+0000 mon.a (mon.0) 740 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-07-26T15:57:22.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: cluster 2021-07-26T15:57:21.394327+0000 mon.a (mon.0) 741 : cluster [DBG] mgrmap e20: x(active, since 5s), standbys: y 2021-07-26T15:57:22.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.398741+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-07-26T15:57:22.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.400585+0000 mon.c (mon.1) 55 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.400961+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.402252+0000 mon.c (mon.1) 56 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.402555+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.403876+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.404255+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.405518+0000 mon.c (mon.1) 58 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.405830+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: cephadm 2021-07-26T15:57:21.408076+0000 mgr.x (mgr.24598) 4 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 3553M 2021-07-26T15:57:22.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.414027+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: cephadm 2021-07-26T15:57:21.416643+0000 mgr.x (mgr.24598) 5 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:57:22.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.505047+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: cephadm 2021-07-26T15:57:21.516304+0000 mgr.x (mgr.24598) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:22.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.555714+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.741357+0000 mon.c (mon.1) 59 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.741930+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.743764+0000 mon.c (mon.1) 60 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.744410+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.746290+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.746900+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.748683+0000 mon.c (mon.1) 62 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.749338+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2021-07-26T15:57:22.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: cephadm 2021-07-26T15:57:21.752083+0000 mgr.x (mgr.24598) 7 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 3552M 2021-07-26T15:57:22.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.760140+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: cephadm 2021-07-26T15:57:21.763030+0000 mgr.x (mgr.24598) 8 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:57:22.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: cephadm 2021-07-26T15:57:21.795898+0000 mgr.x (mgr.24598) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:22.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.832037+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.841215+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.847966+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:22.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: audit 2021-07-26T15:57:21.861342+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:22.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: cephadm 2021-07-26T15:57:21.864820+0000 mgr.x (mgr.24598) 10 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:57:22.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:22 smithi096 bash[15117]: cluster 2021-07-26T15:57:22.196256+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e99: 8 total, 8 up, 8 in 2021-07-26T15:57:23.235 INFO:tasks.rados.rados.0.smithi033.stdout:281: finishing write tid 3 to smithi03339061-18 2021-07-26T15:57:23.236 INFO:tasks.rados.rados.0.smithi033.stdout:281: finishing write tid 4 to smithi03339061-18 2021-07-26T15:57:23.237 INFO:tasks.rados.rados.0.smithi033.stdout:281: finishing write tid 5 to smithi03339061-18 2021-07-26T15:57:23.237 INFO:tasks.rados.rados.0.smithi033.stdout:281: finishing write tid 6 to smithi03339061-18 2021-07-26T15:57:23.237 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 117 (ObjNum 111 snap 20 seq_num 111) dirty exists 2021-07-26T15:57:23.237 INFO:tasks.rados.rados.0.smithi033.stdout:281: left oid 18 (ObjNum 111 snap 20 seq_num 111) 2021-07-26T15:57:23.238 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 119 (ObjNum 79 snap 13 seq_num 79) dirty exists 2021-07-26T15:57:23.238 INFO:tasks.rados.rados.0.smithi033.stdout:281: done (2 left) 2021-07-26T15:57:23.238 INFO:tasks.rados.rados.0.smithi033.stdout:282: done (1 left) 2021-07-26T15:57:23.238 INFO:tasks.rados.rados.0.smithi033.stdout:283: done (0 left) 2021-07-26T15:57:23.239 INFO:tasks.rados.rados.0.smithi033.stdout:284: setattr oid 40 current snap is 20 2021-07-26T15:57:23.240 INFO:tasks.rados.rados.0.smithi033.stdout:285: snap_create 2021-07-26T15:57:23.248 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 26 (ObjNum 39 snap 0 seq_num 39) dirty exists 2021-07-26T15:57:23.842 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:23 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:23.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: dial tcp 172.21.15.33:8443: connect: connection refused" context_err="context deadline exceeded" 2021-07-26T15:57:23.842 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:23 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:23.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:57:23.842 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:23 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:23.509Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: dial tcp 172.21.15.33:8443: connect: connection refused; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T15:57:24.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:23 smithi033 bash[14790]: cluster 2021-07-26T15:57:22.375494+0000 mgr.x (mgr.24598) 11 : cluster [DBG] pgmap v13: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:24.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:23 smithi033 bash[14790]: audit 2021-07-26T15:57:22.986871+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:24.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:23 smithi033 bash[14790]: cluster 2021-07-26T15:57:23.232305+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-07-26T15:57:24.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:23 smithi033 bash[19094]: cluster 2021-07-26T15:57:22.375494+0000 mgr.x (mgr.24598) 11 : cluster [DBG] pgmap v13: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:24.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:23 smithi033 bash[19094]: audit 2021-07-26T15:57:22.986871+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:24.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:23 smithi033 bash[19094]: cluster 2021-07-26T15:57:23.232305+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-07-26T15:57:24.240 INFO:tasks.rados.rados.0.smithi033.stdout:284: done (1 left) 2021-07-26T15:57:24.240 INFO:tasks.rados.rados.0.smithi033.stdout:285: done (0 left) 2021-07-26T15:57:24.241 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 21 2021-07-26T15:57:24.241 INFO:tasks.rados.rados.0.smithi033.stdout:286: seq_num 112 ranges {253952=679936,933888=548864,1482752=655360} 2021-07-26T15:57:24.247 INFO:tasks.rados.rados.0.smithi033.stdout:286: writing smithi03339061-33 from 253952 to 933888 tid 1 2021-07-26T15:57:24.251 INFO:tasks.rados.rados.0.smithi033.stdout:286: writing smithi03339061-33 from 933888 to 1482752 tid 2 2021-07-26T15:57:24.256 INFO:tasks.rados.rados.0.smithi033.stdout:286: writing smithi03339061-33 from 1482752 to 2138112 tid 3 2021-07-26T15:57:24.256 INFO:tasks.rados.rados.0.smithi033.stdout:287: copy_from oid 18 from oid 13 current snap is 21 2021-07-26T15:57:24.256 INFO:tasks.rados.rados.0.smithi033.stdout:288: snap_create 2021-07-26T15:57:24.258 INFO:tasks.rados.rados.0.smithi033.stdout:286: finishing write tid 1 to smithi03339061-33 2021-07-26T15:57:24.262 INFO:tasks.rados.rados.0.smithi033.stdout:286: finishing write tid 2 to smithi03339061-33 2021-07-26T15:57:24.263 INFO:tasks.rados.rados.0.smithi033.stdout:286: finishing write tid 3 to smithi03339061-33 2021-07-26T15:57:24.263 INFO:tasks.rados.rados.0.smithi033.stdout:286: finishing write tid 4 to smithi03339061-33 2021-07-26T15:57:24.264 INFO:tasks.rados.rados.0.smithi033.stdout:286: finishing write tid 5 to smithi03339061-33 2021-07-26T15:57:24.265 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 130 (ObjNum 112 snap 21 seq_num 112) dirty exists 2021-07-26T15:57:24.265 INFO:tasks.rados.rados.0.smithi033.stdout:286: left oid 33 (ObjNum 112 snap 21 seq_num 112) 2021-07-26T15:57:24.284 INFO:tasks.rados.rados.0.smithi033.stdout:287: finishing copy_from to smithi03339061-18 2021-07-26T15:57:24.284 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 57 (ObjNum 91 snap 18 seq_num 91) dirty exists 2021-07-26T15:57:24.284 INFO:tasks.rados.rados.0.smithi033.stdout:287: finishing copy_from racing read to smithi03339061-18 2021-07-26T15:57:24.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:23 smithi096 bash[15117]: cluster 2021-07-26T15:57:22.375494+0000 mgr.x (mgr.24598) 11 : cluster [DBG] pgmap v13: 25 pgs: 25 active+clean; 56 MiB data, 146 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:24.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:23 smithi096 bash[15117]: audit 2021-07-26T15:57:22.986871+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:24.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:23 smithi096 bash[15117]: cluster 2021-07-26T15:57:23.232305+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2021-07-26T15:57:25.248 INFO:tasks.rados.rados.0.smithi033.stdout:286: done (2 left) 2021-07-26T15:57:25.248 INFO:tasks.rados.rados.0.smithi033.stdout:287: done (1 left) 2021-07-26T15:57:25.248 INFO:tasks.rados.rados.0.smithi033.stdout:288: done (0 left) 2021-07-26T15:57:25.248 INFO:tasks.rados.rados.0.smithi033.stdout:289: snap_create 2021-07-26T15:57:25.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[14790]: cluster 2021-07-26T15:57:24.234941+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-07-26T15:57:25.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[14790]: cluster 2021-07-26T15:57:24.376212+0000 mgr.x (mgr.24598) 12 : cluster [DBG] pgmap v16: 25 pgs: 25 active+clean; 67 MiB data, 180 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 6.5 MiB/s wr, 92 op/s 2021-07-26T15:57:25.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[14790]: cephadm 2021-07-26T15:57:24.410641+0000 mgr.x (mgr.24598) 13 : cephadm [INF] Upgrade: Updating mgr.y 2021-07-26T15:57:25.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[14790]: audit 2021-07-26T15:57:24.418566+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:25.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[14790]: audit 2021-07-26T15:57:24.423481+0000 mon.c (mon.1) 64 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:25.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[14790]: audit 2021-07-26T15:57:24.424194+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:25.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[14790]: audit 2021-07-26T15:57:24.426289+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:57:25.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[14790]: audit 2021-07-26T15:57:24.428093+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:25.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[14790]: cephadm 2021-07-26T15:57:24.430805+0000 mgr.x (mgr.24598) 14 : cephadm [INF] Deploying daemon mgr.y on smithi033 2021-07-26T15:57:25.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[19094]: cluster 2021-07-26T15:57:24.234941+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-07-26T15:57:25.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[19094]: cluster 2021-07-26T15:57:24.376212+0000 mgr.x (mgr.24598) 12 : cluster [DBG] pgmap v16: 25 pgs: 25 active+clean; 67 MiB data, 180 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 6.5 MiB/s wr, 92 op/s 2021-07-26T15:57:25.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[19094]: cephadm 2021-07-26T15:57:24.410641+0000 mgr.x (mgr.24598) 13 : cephadm [INF] Upgrade: Updating mgr.y 2021-07-26T15:57:25.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[19094]: audit 2021-07-26T15:57:24.418566+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:25.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[19094]: audit 2021-07-26T15:57:24.423481+0000 mon.c (mon.1) 64 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:25.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[19094]: audit 2021-07-26T15:57:24.424194+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:25.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[19094]: audit 2021-07-26T15:57:24.426289+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:57:25.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[19094]: audit 2021-07-26T15:57:24.428093+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:25.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:25 smithi033 bash[19094]: cephadm 2021-07-26T15:57:24.430805+0000 mgr.x (mgr.24598) 14 : cephadm [INF] Deploying daemon mgr.y on smithi033 2021-07-26T15:57:25.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:25 smithi096 bash[15117]: cluster 2021-07-26T15:57:24.234941+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2021-07-26T15:57:25.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:25 smithi096 bash[15117]: cluster 2021-07-26T15:57:24.376212+0000 mgr.x (mgr.24598) 12 : cluster [DBG] pgmap v16: 25 pgs: 25 active+clean; 67 MiB data, 180 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 6.5 MiB/s wr, 92 op/s 2021-07-26T15:57:25.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:25 smithi096 bash[15117]: cephadm 2021-07-26T15:57:24.410641+0000 mgr.x (mgr.24598) 13 : cephadm [INF] Upgrade: Updating mgr.y 2021-07-26T15:57:25.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:25 smithi096 bash[15117]: audit 2021-07-26T15:57:24.418566+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:25.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:25 smithi096 bash[15117]: audit 2021-07-26T15:57:24.423481+0000 mon.c (mon.1) 64 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:25.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:25 smithi096 bash[15117]: audit 2021-07-26T15:57:24.424194+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:25.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:25 smithi096 bash[15117]: audit 2021-07-26T15:57:24.426289+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:57:25.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:25 smithi096 bash[15117]: audit 2021-07-26T15:57:24.428093+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:25.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:25 smithi096 bash[15117]: cephadm 2021-07-26T15:57:24.430805+0000 mgr.x (mgr.24598) 14 : cephadm [INF] Deploying daemon mgr.y on smithi033 2021-07-26T15:57:26.550 INFO:tasks.rados.rados.0.smithi033.stdout:289: done (0 left) 2021-07-26T15:57:26.551 INFO:tasks.rados.rados.0.smithi033.stdout:290: read oid 15 snap -1 2021-07-26T15:57:26.551 INFO:tasks.rados.rados.0.smithi033.stdout:290: expect (ObjNum 102 snap 19 seq_num 102) 2021-07-26T15:57:26.551 INFO:tasks.rados.rados.0.smithi033.stdout:291: snap_create 2021-07-26T15:57:26.582 INFO:tasks.rados.rados.0.smithi033.stdout:290: expect (ObjNum 102 snap 19 seq_num 102) 2021-07-26T15:57:26.952 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:26 smithi033 systemd[1]: Stopping Ceph mgr.y for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T15:57:26.952 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:26 smithi033 docker[39871]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:57:27.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:27 smithi033 bash[19094]: cluster 2021-07-26T15:57:25.245857+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-07-26T15:57:27.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:27 smithi033 bash[19094]: audit 2021-07-26T15:57:25.608824+0000 mon.a (mon.0) 764 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-07-26T15:57:27.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:27 smithi033 bash[14790]: cluster 2021-07-26T15:57:25.245857+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-07-26T15:57:27.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:27 smithi033 bash[14790]: audit 2021-07-26T15:57:25.608824+0000 mon.a (mon.0) 764 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-07-26T15:57:27.709 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:27 smithi033 docker[39871]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-mgr.y 2021-07-26T15:57:27.710 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:27 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=143/n/a 2021-07-26T15:57:27.710 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:27 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.y.service: Failed with result 'exit-code'. 2021-07-26T15:57:27.710 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:27 smithi033 systemd[1]: Stopped Ceph mgr.y for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:57:27.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:27 smithi096 bash[15117]: cluster 2021-07-26T15:57:25.245857+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e102: 8 total, 8 up, 8 in 2021-07-26T15:57:27.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:27 smithi096 bash[15117]: audit 2021-07-26T15:57:25.608824+0000 mon.a (mon.0) 764 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-07-26T15:57:28.208 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:27 smithi033 systemd[1]: Started Ceph mgr.y for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:57:28.208 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:27 smithi033 bash[39943]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:57:28.477 INFO:tasks.rados.rados.0.smithi033.stdout:290: done (1 left) 2021-07-26T15:57:28.478 INFO:tasks.rados.rados.0.smithi033.stdout:291: done (0 left) 2021-07-26T15:57:28.478 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 24 2021-07-26T15:57:28.478 INFO:tasks.rados.rados.0.smithi033.stdout:292: seq_num 113 ranges {3088384=696320,3784704=434176,4218880=466944,4685824=303104} 2021-07-26T15:57:28.501 INFO:tasks.rados.rados.0.smithi033.stdout:292: writing smithi03339061-23 from 3088384 to 3784704 tid 1 2021-07-26T15:57:28.503 INFO:tasks.rados.rados.0.smithi033.stdout:292: writing smithi03339061-23 from 3784704 to 4218880 tid 2 2021-07-26T15:57:28.506 INFO:tasks.rados.rados.0.smithi033.stdout:292: writing smithi03339061-23 from 4218880 to 4685824 tid 3 2021-07-26T15:57:28.508 INFO:tasks.rados.rados.0.smithi033.stdout:292: writing smithi03339061-23 from 4685824 to 4988928 tid 4 2021-07-26T15:57:28.509 INFO:tasks.rados.rados.0.smithi033.stdout:293: rollback oid 9 current snap is 24 2021-07-26T15:57:28.509 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 9 to 23 2021-07-26T15:57:28.509 INFO:tasks.rados.rados.0.smithi033.stdout:294: snap_remove snap 21 2021-07-26T15:57:28.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:25.609294+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:28.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:25.609697+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:28.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:25.610074+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:28.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: cluster 2021-07-26T15:57:26.376917+0000 mgr.x (mgr.24598) 15 : cluster [DBG] pgmap v18: 25 pgs: 25 active+clean; 67 MiB data, 180 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 6.3 MiB/s wr, 88 op/s 2021-07-26T15:57:28.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:26.538107+0000 mon.a (mon.0) 765 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-07-26T15:57:28.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:26.545486+0000 mon.c (mon.1) 70 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-07-26T15:57:28.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: cluster 2021-07-26T15:57:26.547369+0000 mon.a (mon.0) 766 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-07-26T15:57:28.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:27.449813+0000 mon.c (mon.1) 71 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-07-26T15:57:28.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:27.452642+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:28.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:27.452893+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:28.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:27.453111+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:28.741 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:27.463099+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:28.741 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:27.464245+0000 mon.b (mon.2) 25 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-07-26T15:57:28.741 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: cluster 2021-07-26T15:57:27.468963+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-07-26T15:57:28.741 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:27.469101+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:28.742 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:27.470295+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:28.742 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:28.347437+0000 mon.b (mon.2) 26 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-07-26T15:57:28.742 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:28.369762+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:28.742 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:28.372058+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:28.743 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:28.374666+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:28.743 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:28 smithi096 bash[15117]: audit 2021-07-26T15:57:28.376072+0000 mon.c (mon.1) 80 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:28.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:25.609294+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:28.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:25.609697+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:28.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:25.610074+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:28.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: cluster 2021-07-26T15:57:26.376917+0000 mgr.x (mgr.24598) 15 : cluster [DBG] pgmap v18: 25 pgs: 25 active+clean; 67 MiB data, 180 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 6.3 MiB/s wr, 88 op/s 2021-07-26T15:57:28.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:26.538107+0000 mon.a (mon.0) 765 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-07-26T15:57:28.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:26.545486+0000 mon.c (mon.1) 70 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-07-26T15:57:28.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: cluster 2021-07-26T15:57:26.547369+0000 mon.a (mon.0) 766 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-07-26T15:57:28.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:27.449813+0000 mon.c (mon.1) 71 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-07-26T15:57:28.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:27.452642+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:28.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:27.452893+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:28.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:27.453111+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:28.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:27.463099+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:28.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:27.464245+0000 mon.b (mon.2) 25 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-07-26T15:57:28.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: cluster 2021-07-26T15:57:27.468963+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-07-26T15:57:28.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:27.469101+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:28.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:27.470295+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:28.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:28.347437+0000 mon.b (mon.2) 26 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-07-26T15:57:28.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:28.369762+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:28.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:28.372058+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:28.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:28.374666+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:28.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[14790]: audit 2021-07-26T15:57:28.376072+0000 mon.c (mon.1) 80 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:28.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:25.609294+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:28.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:25.609697+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:28.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:25.610074+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:28.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: cluster 2021-07-26T15:57:26.376917+0000 mgr.x (mgr.24598) 15 : cluster [DBG] pgmap v18: 25 pgs: 25 active+clean; 67 MiB data, 180 MiB used, 715 GiB / 715 GiB avail; 5.3 MiB/s rd, 6.3 MiB/s wr, 88 op/s 2021-07-26T15:57:28.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:26.538107+0000 mon.a (mon.0) 765 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-07-26T15:57:28.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:26.545486+0000 mon.c (mon.1) 70 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-07-26T15:57:28.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: cluster 2021-07-26T15:57:26.547369+0000 mon.a (mon.0) 766 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-07-26T15:57:28.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:27.449813+0000 mon.c (mon.1) 71 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-07-26T15:57:28.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:27.452642+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:28.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:27.452893+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:28.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:27.453111+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:28.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:27.463099+0000 mon.c (mon.1) 75 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:28.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:27.464245+0000 mon.b (mon.2) 25 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2021-07-26T15:57:28.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: cluster 2021-07-26T15:57:27.468963+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-07-26T15:57:28.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:27.469101+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:28.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:27.470295+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:28.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:28.347437+0000 mon.b (mon.2) 26 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2021-07-26T15:57:28.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:28.369762+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:28.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:28.372058+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:28.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:28.374666+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:28.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:28 smithi033 bash[19094]: audit 2021-07-26T15:57:28.376072+0000 mon.c (mon.1) 80 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:29.458 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:29 smithi033 bash[39943]: debug 2021-07-26T15:57:29.271+0000 7fcd4093b700 1 -- 172.21.15.33:0/973069678 <== mon.1 v2:172.21.15.33:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556bf1fbc340 con 0x556bf2d2e400 2021-07-26T15:57:29.490 INFO:tasks.rados.rados.0.smithi033.stdout:294: done (2 left) 2021-07-26T15:57:29.491 INFO:tasks.rados.rados.0.smithi033.stdout:295: read oid 18 snap 22 2021-07-26T15:57:29.491 INFO:tasks.rados.rados.0.smithi033.stdout:295: expect (ObjNum 91 snap 18 seq_num 91) 2021-07-26T15:57:29.491 INFO:tasks.rados.rados.0.smithi033.stdout:296: snap_create 2021-07-26T15:57:29.491 INFO:tasks.rados.rados.0.smithi033.stdout:292: finishing write tid 1 to smithi03339061-23 2021-07-26T15:57:29.492 INFO:tasks.rados.rados.0.smithi033.stdout:292: finishing write tid 2 to smithi03339061-23 2021-07-26T15:57:29.492 INFO:tasks.rados.rados.0.smithi033.stdout:292: finishing write tid 3 to smithi03339061-23 2021-07-26T15:57:29.492 INFO:tasks.rados.rados.0.smithi033.stdout:292: finishing write tid 4 to smithi03339061-23 2021-07-26T15:57:29.493 INFO:tasks.rados.rados.0.smithi033.stdout:292: finishing write tid 5 to smithi03339061-23 2021-07-26T15:57:29.493 INFO:tasks.rados.rados.0.smithi033.stdout:292: finishing write tid 6 to smithi03339061-23 2021-07-26T15:57:29.493 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 111 (ObjNum 113 snap 24 seq_num 113) dirty exists 2021-07-26T15:57:29.493 INFO:tasks.rados.rados.0.smithi033.stdout:292: left oid 23 (ObjNum 113 snap 24 seq_num 113) 2021-07-26T15:57:29.494 INFO:tasks.rados.rados.0.smithi033.stdout:293: finishing rollback tid 0 to smithi03339061-9 2021-07-26T15:57:29.494 INFO:tasks.rados.rados.0.smithi033.stdout:293: finishing rollback tid 1 to smithi03339061-9 2021-07-26T15:57:29.494 INFO:tasks.rados.rados.0.smithi033.stdout:293: finishing rollback tid 2 to smithi03339061-9 2021-07-26T15:57:29.494 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 87 (ObjNum 73 snap 8 seq_num 73) dirty exists 2021-07-26T15:57:29.504 INFO:tasks.rados.rados.0.smithi033.stdout:295: expect (ObjNum 91 snap 18 seq_num 91) 2021-07-26T15:57:29.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:29 smithi096 bash[15117]: cluster 2021-07-26T15:57:28.377482+0000 mgr.x (mgr.24598) 16 : cluster [DBG] pgmap v21: 25 pgs: 25 active+clean; 70 MiB data, 198 MiB used, 715 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2021-07-26T15:57:29.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:29 smithi096 bash[15117]: cluster 2021-07-26T15:57:28.472512+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-07-26T15:57:29.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:29 smithi033 bash[14790]: cluster 2021-07-26T15:57:28.377482+0000 mgr.x (mgr.24598) 16 : cluster [DBG] pgmap v21: 25 pgs: 25 active+clean; 70 MiB data, 198 MiB used, 715 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2021-07-26T15:57:29.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:29 smithi033 bash[14790]: cluster 2021-07-26T15:57:28.472512+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-07-26T15:57:29.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:29 smithi033 bash[19094]: cluster 2021-07-26T15:57:28.377482+0000 mgr.x (mgr.24598) 16 : cluster [DBG] pgmap v21: 25 pgs: 25 active+clean; 70 MiB data, 198 MiB used, 715 GiB / 715 GiB avail; 3.0 MiB/s rd, 1.3 MiB/s wr, 15 op/s 2021-07-26T15:57:29.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:29 smithi033 bash[19094]: cluster 2021-07-26T15:57:28.472512+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-07-26T15:57:30.489 INFO:tasks.rados.rados.0.smithi033.stdout:292: done (3 left) 2021-07-26T15:57:30.489 INFO:tasks.rados.rados.0.smithi033.stdout:293: done (2 left) 2021-07-26T15:57:30.490 INFO:tasks.rados.rados.0.smithi033.stdout:295: done (1 left) 2021-07-26T15:57:30.491 INFO:tasks.rados.rados.0.smithi033.stdout:296: done (0 left) 2021-07-26T15:57:30.491 INFO:tasks.rados.rados.0.smithi033.stdout:297: read oid 23 snap -1 2021-07-26T15:57:30.491 INFO:tasks.rados.rados.0.smithi033.stdout:297: expect (ObjNum 113 snap 24 seq_num 113) 2021-07-26T15:57:30.491 INFO:tasks.rados.rados.0.smithi033.stdout:298: snap_remove snap 19 2021-07-26T15:57:30.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:30 smithi033 bash[14790]: cluster 2021-07-26T15:57:29.482904+0000 mon.a (mon.0) 770 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-07-26T15:57:30.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:30 smithi033 bash[19094]: cluster 2021-07-26T15:57:29.482904+0000 mon.a (mon.0) 770 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-07-26T15:57:30.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:30 smithi096 bash[15117]: cluster 2021-07-26T15:57:29.482904+0000 mon.a (mon.0) 770 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-07-26T15:57:31.503 INFO:tasks.rados.rados.0.smithi033.stdout:298: done (1 left) 2021-07-26T15:57:31.503 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 25 2021-07-26T15:57:31.504 INFO:tasks.rados.rados.0.smithi033.stdout:297: expect (ObjNum 113 snap 24 seq_num 113) 2021-07-26T15:57:31.730 INFO:tasks.rados.rados.0.smithi033.stdout:299: seq_num 114 ranges {3112960=712704,3825664=712704,4538368=491520} 2021-07-26T15:57:31.751 INFO:tasks.rados.rados.0.smithi033.stdout:299: writing smithi03339061-45 from 3112960 to 3825664 tid 1 2021-07-26T15:57:31.755 INFO:tasks.rados.rados.0.smithi033.stdout:299: writing smithi03339061-45 from 3825664 to 4538368 tid 2 2021-07-26T15:57:31.759 INFO:tasks.rados.rados.0.smithi033.stdout:299: writing smithi03339061-45 from 4538368 to 5029888 tid 3 2021-07-26T15:57:31.759 INFO:tasks.rados.rados.0.smithi033.stdout:297: done (1 left) 2021-07-26T15:57:31.760 INFO:tasks.rados.rados.0.smithi033.stdout:300: rollback oid 48 current snap is 25 2021-07-26T15:57:31.760 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 48 to 20 2021-07-26T15:57:31.760 INFO:tasks.rados.rados.0.smithi033.stdout:299: finishing write tid 1 to smithi03339061-45 2021-07-26T15:57:31.760 INFO:tasks.rados.rados.0.smithi033.stdout:301: snap_create 2021-07-26T15:57:31.762 INFO:tasks.rados.rados.0.smithi033.stdout:299: finishing write tid 2 to smithi03339061-45 2021-07-26T15:57:31.769 INFO:tasks.rados.rados.0.smithi033.stdout:299: finishing write tid 3 to smithi03339061-45 2021-07-26T15:57:31.769 INFO:tasks.rados.rados.0.smithi033.stdout:299: finishing write tid 4 to smithi03339061-45 2021-07-26T15:57:31.769 INFO:tasks.rados.rados.0.smithi033.stdout:299: finishing write tid 5 to smithi03339061-45 2021-07-26T15:57:31.769 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 141 (ObjNum 114 snap 25 seq_num 114) dirty exists 2021-07-26T15:57:31.770 INFO:tasks.rados.rados.0.smithi033.stdout:299: left oid 45 (ObjNum 114 snap 25 seq_num 114) 2021-07-26T15:57:31.770 INFO:tasks.rados.rados.0.smithi033.stdout:300: finishing rollback tid 0 to smithi03339061-48 2021-07-26T15:57:31.770 INFO:tasks.rados.rados.0.smithi033.stdout:300: finishing rollback tid 1 to smithi03339061-48 2021-07-26T15:57:31.770 INFO:tasks.rados.rados.0.smithi033.stdout:300: finishing rollback tid 2 to smithi03339061-48 2021-07-26T15:57:31.770 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 109 (ObjNum 107 snap 19 seq_num 107) dirty exists 2021-07-26T15:57:31.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:31 smithi033 bash[14790]: cluster 2021-07-26T15:57:30.378150+0000 mgr.x (mgr.24598) 17 : cluster [DBG] pgmap v24: 25 pgs: 25 active+clean; 70 MiB data, 198 MiB used, 715 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2021-07-26T15:57:31.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:31 smithi033 bash[14790]: cluster 2021-07-26T15:57:30.486249+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-07-26T15:57:31.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:31 smithi033 bash[19094]: cluster 2021-07-26T15:57:30.378150+0000 mgr.x (mgr.24598) 17 : cluster [DBG] pgmap v24: 25 pgs: 25 active+clean; 70 MiB data, 198 MiB used, 715 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2021-07-26T15:57:31.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:31 smithi033 bash[19094]: cluster 2021-07-26T15:57:30.486249+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-07-26T15:57:31.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:31 smithi096 bash[15117]: cluster 2021-07-26T15:57:30.378150+0000 mgr.x (mgr.24598) 17 : cluster [DBG] pgmap v24: 25 pgs: 25 active+clean; 70 MiB data, 198 MiB used, 715 GiB / 715 GiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 15 op/s 2021-07-26T15:57:31.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:31 smithi096 bash[15117]: cluster 2021-07-26T15:57:30.486249+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-07-26T15:57:32.526 INFO:tasks.rados.rados.0.smithi033.stdout:299: done (2 left) 2021-07-26T15:57:32.526 INFO:tasks.rados.rados.0.smithi033.stdout:300: done (1 left) 2021-07-26T15:57:32.526 INFO:tasks.rados.rados.0.smithi033.stdout:301: done (0 left) 2021-07-26T15:57:32.527 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 26 2021-07-26T15:57:32.527 INFO:tasks.rados.rados.0.smithi033.stdout:302: seq_num 115 ranges {3375104=729088,4104192=647168,4751360=434176,5185536=122880} 2021-07-26T15:57:32.548 INFO:tasks.rados.rados.0.smithi033.stdout:302: writing smithi03339061-18 from 3375104 to 4104192 tid 1 2021-07-26T15:57:32.554 INFO:tasks.rados.rados.0.smithi033.stdout:302: writing smithi03339061-18 from 4104192 to 4751360 tid 2 2021-07-26T15:57:32.557 INFO:tasks.rados.rados.0.smithi033.stdout:302: writing smithi03339061-18 from 4751360 to 5185536 tid 3 2021-07-26T15:57:32.558 INFO:tasks.rados.rados.0.smithi033.stdout:302: writing smithi03339061-18 from 5185536 to 5308416 tid 4 2021-07-26T15:57:32.558 INFO:tasks.rados.rados.0.smithi033.stdout:303: read oid 31 snap -1 2021-07-26T15:57:32.558 INFO:tasks.rados.rados.0.smithi033.stdout:303: expect deleted 2021-07-26T15:57:32.559 INFO:tasks.rados.rados.0.smithi033.stdout:304: read oid 5 snap -1 2021-07-26T15:57:32.559 INFO:tasks.rados.rados.0.smithi033.stdout:304: expect deleted 2021-07-26T15:57:32.559 INFO:tasks.rados.rados.0.smithi033.stdout:305: copy_from oid 21 from oid 32 current snap is 26 2021-07-26T15:57:32.559 INFO:tasks.rados.rados.0.smithi033.stdout:306: snap_create 2021-07-26T15:57:32.565 INFO:tasks.rados.rados.0.smithi033.stdout:302: finishing write tid 1 to smithi03339061-18 2021-07-26T15:57:32.565 INFO:tasks.rados.rados.0.smithi033.stdout:302: finishing write tid 2 to smithi03339061-18 2021-07-26T15:57:32.566 INFO:tasks.rados.rados.0.smithi033.stdout:302: finishing write tid 3 to smithi03339061-18 2021-07-26T15:57:32.566 INFO:tasks.rados.rados.0.smithi033.stdout:302: finishing write tid 4 to smithi03339061-18 2021-07-26T15:57:32.567 INFO:tasks.rados.rados.0.smithi033.stdout:302: finishing write tid 5 to smithi03339061-18 2021-07-26T15:57:32.568 INFO:tasks.rados.rados.0.smithi033.stdout:305: finishing copy_from to smithi03339061-21 2021-07-26T15:57:32.568 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 2 (ObjNum 16 snap 0 seq_num 16) dirty exists 2021-07-26T15:57:32.569 INFO:tasks.rados.rados.0.smithi033.stdout:302: finishing write tid 6 to smithi03339061-18 2021-07-26T15:57:32.569 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 147 (ObjNum 115 snap 26 seq_num 115) dirty exists 2021-07-26T15:57:32.569 INFO:tasks.rados.rados.0.smithi033.stdout:302: left oid 18 (ObjNum 115 snap 26 seq_num 115) 2021-07-26T15:57:32.569 INFO:tasks.rados.rados.0.smithi033.stdout:305: finishing copy_from racing read to smithi03339061-21 2021-07-26T15:57:32.626 INFO:tasks.rados.rados.0.smithi033.stdout:302: done (4 left) 2021-07-26T15:57:32.626 INFO:tasks.rados.rados.0.smithi033.stdout:303: done (3 left) 2021-07-26T15:57:32.626 INFO:tasks.rados.rados.0.smithi033.stdout:304: done (2 left) 2021-07-26T15:57:32.627 INFO:tasks.rados.rados.0.smithi033.stdout:305: done (1 left) 2021-07-26T15:57:32.627 INFO:tasks.rados.rados.0.smithi033.stdout:306: done (0 left) 2021-07-26T15:57:32.627 INFO:tasks.rados.rados.0.smithi033.stdout:307: read oid 41 snap -1 2021-07-26T15:57:32.627 INFO:tasks.rados.rados.0.smithi033.stdout:307: expect (ObjNum 99 snap 18 seq_num 99) 2021-07-26T15:57:32.627 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 16 current snap is 27 2021-07-26T15:57:32.628 INFO:tasks.rados.rados.0.smithi033.stdout:308: seq_num 116 ranges {4923392=745472,5668864=532480,6201344=638976,6840320=32768} 2021-07-26T15:57:32.661 INFO:tasks.rados.rados.0.smithi033.stdout:308: writing smithi03339061-16 from 4923392 to 5668864 tid 1 2021-07-26T15:57:32.664 INFO:tasks.rados.rados.0.smithi033.stdout:308: writing smithi03339061-16 from 5668864 to 6201344 tid 2 2021-07-26T15:57:32.668 INFO:tasks.rados.rados.0.smithi033.stdout:308: writing smithi03339061-16 from 6201344 to 6840320 tid 3 2021-07-26T15:57:32.669 INFO:tasks.rados.rados.0.smithi033.stdout:308: writing smithi03339061-16 from 6840320 to 6873088 tid 4 2021-07-26T15:57:32.669 INFO:tasks.rados.rados.0.smithi033.stdout:309: setattr oid 13 current snap is 27 2021-07-26T15:57:32.678 INFO:tasks.rados.rados.0.smithi033.stdout:307: expect (ObjNum 99 snap 18 seq_num 99) 2021-07-26T15:57:32.719 INFO:tasks.rados.rados.0.smithi033.stdout:308: finishing write tid 1 to smithi03339061-16 2021-07-26T15:57:32.720 INFO:tasks.rados.rados.0.smithi033.stdout:308: finishing write tid 2 to smithi03339061-16 2021-07-26T15:57:32.720 INFO:tasks.rados.rados.0.smithi033.stdout:308: finishing write tid 3 to smithi03339061-16 2021-07-26T15:57:32.720 INFO:tasks.rados.rados.0.smithi033.stdout:308: finishing write tid 4 to smithi03339061-16 2021-07-26T15:57:32.720 INFO:tasks.rados.rados.0.smithi033.stdout:308: finishing write tid 5 to smithi03339061-16 2021-07-26T15:57:32.721 INFO:tasks.rados.rados.0.smithi033.stdout:308: finishing write tid 6 to smithi03339061-16 2021-07-26T15:57:32.721 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 84 (ObjNum 116 snap 27 seq_num 116) dirty exists 2021-07-26T15:57:32.721 INFO:tasks.rados.rados.0.smithi033.stdout:308: left oid 16 (ObjNum 116 snap 27 seq_num 116) 2021-07-26T15:57:32.721 INFO:tasks.rados.rados.0.smithi033.stdout:307: done (2 left) 2021-07-26T15:57:32.721 INFO:tasks.rados.rados.0.smithi033.stdout:308: done (1 left) 2021-07-26T15:57:32.722 INFO:tasks.rados.rados.0.smithi033.stdout:310: delete oid 31 current snap is 27 2021-07-26T15:57:32.725 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 75 (ObjNum 91 snap 18 seq_num 91) dirty exists 2021-07-26T15:57:32.727 INFO:tasks.rados.rados.0.smithi033.stdout:309: done (1 left) 2021-07-26T15:57:32.727 INFO:tasks.rados.rados.0.smithi033.stdout:310: done (0 left) 2021-07-26T15:57:32.728 INFO:tasks.rados.rados.0.smithi033.stdout:311: read oid 35 snap -1 2021-07-26T15:57:32.728 INFO:tasks.rados.rados.0.smithi033.stdout:311: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:57:32.728 INFO:tasks.rados.rados.0.smithi033.stdout:312: rmattr oid 39 current snap is 27 2021-07-26T15:57:32.728 INFO:tasks.rados.rados.0.smithi033.stdout:312: done (1 left) 2021-07-26T15:57:32.729 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 27 2021-07-26T15:57:32.729 INFO:tasks.rados.rados.0.smithi033.stdout:313: seq_num 118 ranges {270336=786432,1056768=704512,1761280=499712} 2021-07-26T15:57:32.739 INFO:tasks.rados.rados.0.smithi033.stdout:313: writing smithi03339061-21 from 270336 to 1056768 tid 1 2021-07-26T15:57:32.743 INFO:tasks.rados.rados.0.smithi033.stdout:313: writing smithi03339061-21 from 1056768 to 1761280 tid 2 2021-07-26T15:57:32.746 INFO:tasks.rados.rados.0.smithi033.stdout:313: writing smithi03339061-21 from 1761280 to 2260992 tid 3 2021-07-26T15:57:32.747 INFO:tasks.rados.rados.0.smithi033.stdout:314: copy_from oid 38 from oid 14 current snap is 27 2021-07-26T15:57:32.747 INFO:tasks.rados.rados.0.smithi033.stdout:311: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:57:32.756 INFO:tasks.rados.rados.0.smithi033.stdout:313: finishing write tid 1 to smithi03339061-21 2021-07-26T15:57:32.756 INFO:tasks.rados.rados.0.smithi033.stdout:311: done (2 left) 2021-07-26T15:57:32.757 INFO:tasks.rados.rados.0.smithi033.stdout:315: rmattr oid 44 current snap is 27 2021-07-26T15:57:32.757 INFO:tasks.rados.rados.0.smithi033.stdout:315: done (2 left) 2021-07-26T15:57:32.757 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 27 2021-07-26T15:57:32.757 INFO:tasks.rados.rados.0.smithi033.stdout:313: finishing write tid 2 to smithi03339061-21 2021-07-26T15:57:32.757 INFO:tasks.rados.rados.0.smithi033.stdout:313: finishing write tid 3 to smithi03339061-21 2021-07-26T15:57:32.758 INFO:tasks.rados.rados.0.smithi033.stdout:313: finishing write tid 4 to smithi03339061-21 2021-07-26T15:57:32.758 INFO:tasks.rados.rados.0.smithi033.stdout:316: seq_num 119 ranges {4349952=802816,5152768=589824,5742592=409600,6152192=204800} 2021-07-26T15:57:32.786 INFO:tasks.rados.rados.0.smithi033.stdout:316: writing smithi03339061-15 from 4349952 to 5152768 tid 1 2021-07-26T15:57:32.789 INFO:tasks.rados.rados.0.smithi033.stdout:316: writing smithi03339061-15 from 5152768 to 5742592 tid 2 2021-07-26T15:57:32.792 INFO:tasks.rados.rados.0.smithi033.stdout:316: writing smithi03339061-15 from 5742592 to 6152192 tid 3 2021-07-26T15:57:32.794 INFO:tasks.rados.rados.0.smithi033.stdout:316: writing smithi03339061-15 from 6152192 to 6356992 tid 4 2021-07-26T15:57:32.794 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 27 2021-07-26T15:57:32.794 INFO:tasks.rados.rados.0.smithi033.stdout:314: finishing copy_from to smithi03339061-38 2021-07-26T15:57:32.794 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 23 (ObjNum 13 snap 0 seq_num 13) dirty exists 2021-07-26T15:57:32.795 INFO:tasks.rados.rados.0.smithi033.stdout:317: seq_num 120 ranges {0=417792,417792=475136,892928=622592,1515520=507904} 2021-07-26T15:57:32.795 INFO:tasks.rados.rados.0.smithi033.stdout:317: writing smithi03339061-22 from 0 to 417792 tid 1 2021-07-26T15:57:32.799 INFO:tasks.rados.rados.0.smithi033.stdout:317: writing smithi03339061-22 from 417792 to 892928 tid 2 2021-07-26T15:57:32.803 INFO:tasks.rados.rados.0.smithi033.stdout:317: writing smithi03339061-22 from 892928 to 1515520 tid 3 2021-07-26T15:57:32.808 INFO:tasks.rados.rados.0.smithi033.stdout:317: writing smithi03339061-22 from 1515520 to 2023424 tid 4 2021-07-26T15:57:32.808 INFO:tasks.rados.rados.0.smithi033.stdout:318: copy_from oid 23 from oid 11 current snap is 27 2021-07-26T15:57:32.808 INFO:tasks.rados.rados.0.smithi033.stdout:313: finishing write tid 5 to smithi03339061-21 2021-07-26T15:57:32.809 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 122 (ObjNum 118 snap 27 seq_num 118) dirty exists 2021-07-26T15:57:32.809 INFO:tasks.rados.rados.0.smithi033.stdout:313: left oid 21 (ObjNum 118 snap 27 seq_num 118) 2021-07-26T15:57:32.809 INFO:tasks.rados.rados.0.smithi033.stdout:313: done (4 left) 2021-07-26T15:57:32.809 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 3 current snap is 27 2021-07-26T15:57:32.810 INFO:tasks.rados.rados.0.smithi033.stdout:314: finishing copy_from racing read to smithi03339061-38 2021-07-26T15:57:32.810 INFO:tasks.rados.rados.0.smithi033.stdout:319: seq_num 121 ranges {270336=434176,704512=753664,1458176=425984,1884160=425984} 2021-07-26T15:57:32.811 INFO:tasks.rados.rados.0.smithi033.stdout:319: writing smithi03339061-3 from 270336 to 704512 tid 1 2021-07-26T15:57:32.815 INFO:tasks.rados.rados.0.smithi033.stdout:319: writing smithi03339061-3 from 704512 to 1458176 tid 2 2021-07-26T15:57:32.818 INFO:tasks.rados.rados.0.smithi033.stdout:319: writing smithi03339061-3 from 1458176 to 1884160 tid 3 2021-07-26T15:57:32.820 INFO:tasks.rados.rados.0.smithi033.stdout:319: writing smithi03339061-3 from 1884160 to 2310144 tid 4 2021-07-26T15:57:32.820 INFO:tasks.rados.rados.0.smithi033.stdout:314: done (4 left) 2021-07-26T15:57:32.821 INFO:tasks.rados.rados.0.smithi033.stdout:320: snap_remove snap 20 2021-07-26T15:57:32.822 INFO:tasks.rados.rados.0.smithi033.stdout:316: finishing write tid 1 to smithi03339061-15 2021-07-26T15:57:32.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:32 smithi033 bash[14790]: cluster 2021-07-26T15:57:31.498050+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-07-26T15:57:32.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:32 smithi033 bash[19094]: cluster 2021-07-26T15:57:31.498050+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-07-26T15:57:32.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:32 smithi096 bash[15117]: cluster 2021-07-26T15:57:31.498050+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-07-26T15:57:33.634 INFO:tasks.rados.rados.0.smithi033.stdout:320: done (4 left) 2021-07-26T15:57:33.634 INFO:tasks.rados.rados.0.smithi033.stdout:321: copy_from oid 43 from oid 12 current snap is 27 2021-07-26T15:57:33.634 INFO:tasks.rados.rados.0.smithi033.stdout:316: finishing write tid 2 to smithi03339061-15 2021-07-26T15:57:33.635 INFO:tasks.rados.rados.0.smithi033.stdout:316: finishing write tid 3 to smithi03339061-15 2021-07-26T15:57:33.635 INFO:tasks.rados.rados.0.smithi033.stdout:317: finishing write tid 1 to smithi03339061-22 2021-07-26T15:57:33.635 INFO:tasks.rados.rados.0.smithi033.stdout:316: finishing write tid 4 to smithi03339061-15 2021-07-26T15:57:33.635 INFO:tasks.rados.rados.0.smithi033.stdout:316: finishing write tid 5 to smithi03339061-15 2021-07-26T15:57:33.636 INFO:tasks.rados.rados.0.smithi033.stdout:317: finishing write tid 2 to smithi03339061-22 2021-07-26T15:57:33.636 INFO:tasks.rados.rados.0.smithi033.stdout:316: finishing write tid 6 to smithi03339061-15 2021-07-26T15:57:33.636 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 73 (ObjNum 119 snap 27 seq_num 119) dirty exists 2021-07-26T15:57:33.636 INFO:tasks.rados.rados.0.smithi033.stdout:316: left oid 15 (ObjNum 119 snap 27 seq_num 119) 2021-07-26T15:57:33.636 INFO:tasks.rados.rados.0.smithi033.stdout:317: finishing write tid 3 to smithi03339061-22 2021-07-26T15:57:33.637 INFO:tasks.rados.rados.0.smithi033.stdout:317: finishing write tid 4 to smithi03339061-22 2021-07-26T15:57:33.637 INFO:tasks.rados.rados.0.smithi033.stdout:317: finishing write tid 5 to smithi03339061-22 2021-07-26T15:57:33.637 INFO:tasks.rados.rados.0.smithi033.stdout:317: finishing write tid 6 to smithi03339061-22 2021-07-26T15:57:33.637 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 152 (ObjNum 120 snap 27 seq_num 120) dirty exists 2021-07-26T15:57:33.638 INFO:tasks.rados.rados.0.smithi033.stdout:317: left oid 22 (ObjNum 120 snap 27 seq_num 120) 2021-07-26T15:57:33.638 INFO:tasks.rados.rados.0.smithi033.stdout:318: finishing copy_from to smithi03339061-23 2021-07-26T15:57:33.638 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 2 (ObjNum 15 snap 0 seq_num 15) dirty exists 2021-07-26T15:57:33.639 INFO:tasks.rados.rados.0.smithi033.stdout:318: finishing copy_from racing read to smithi03339061-23 2021-07-26T15:57:33.639 INFO:tasks.rados.rados.0.smithi033.stdout:319: finishing write tid 1 to smithi03339061-3 2021-07-26T15:57:33.639 INFO:tasks.rados.rados.0.smithi033.stdout:319: finishing write tid 2 to smithi03339061-3 2021-07-26T15:57:33.639 INFO:tasks.rados.rados.0.smithi033.stdout:319: finishing write tid 3 to smithi03339061-3 2021-07-26T15:57:33.639 INFO:tasks.rados.rados.0.smithi033.stdout:319: finishing write tid 4 to smithi03339061-3 2021-07-26T15:57:33.640 INFO:tasks.rados.rados.0.smithi033.stdout:319: finishing write tid 5 to smithi03339061-3 2021-07-26T15:57:33.640 INFO:tasks.rados.rados.0.smithi033.stdout:319: finishing write tid 6 to smithi03339061-3 2021-07-26T15:57:33.640 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 32 (ObjNum 121 snap 27 seq_num 121) dirty exists 2021-07-26T15:57:33.641 INFO:tasks.rados.rados.0.smithi033.stdout:319: left oid 3 (ObjNum 121 snap 27 seq_num 121) 2021-07-26T15:57:33.641 INFO:tasks.rados.rados.0.smithi033.stdout:316: done (4 left) 2021-07-26T15:57:33.641 INFO:tasks.rados.rados.0.smithi033.stdout:317: done (3 left) 2021-07-26T15:57:33.641 INFO:tasks.rados.rados.0.smithi033.stdout:318: done (2 left) 2021-07-26T15:57:33.642 INFO:tasks.rados.rados.0.smithi033.stdout:319: done (1 left) 2021-07-26T15:57:33.643 INFO:tasks.rados.rados.0.smithi033.stdout:322: copy_from oid 19 from oid 27 current snap is 27 2021-07-26T15:57:33.643 INFO:tasks.rados.rados.0.smithi033.stdout:323: snap_create 2021-07-26T15:57:33.653 INFO:tasks.rados.rados.0.smithi033.stdout:322: finishing copy_from to smithi03339061-19 2021-07-26T15:57:33.654 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 99 (ObjNum 109 snap 19 seq_num 109) dirty exists 2021-07-26T15:57:33.654 INFO:tasks.rados.rados.0.smithi033.stdout:322: finishing copy_from racing read to smithi03339061-19 2021-07-26T15:57:33.668 INFO:tasks.rados.rados.0.smithi033.stdout:321: finishing copy_from to smithi03339061-43 2021-07-26T15:57:33.668 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 72 (ObjNum 106 snap 19 seq_num 106) dirty exists 2021-07-26T15:57:33.670 INFO:tasks.rados.rados.0.smithi033.stdout:321: finishing copy_from racing read to smithi03339061-43 2021-07-26T15:57:33.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:33.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: dial tcp 172.21.15.33:8443: connect: connection refused" context_err="context deadline exceeded" 2021-07-26T15:57:33.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:33.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:57:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:33.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: dial tcp 172.21.15.33:8443: connect: connection refused; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T15:57:33.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[14790]: cluster 2021-07-26T15:57:32.378850+0000 mgr.x (mgr.24598) 18 : cluster [DBG] pgmap v27: 25 pgs: 25 active+clean; 70 MiB data, 198 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:33.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[14790]: cluster 2021-07-26T15:57:32.522889+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2021-07-26T15:57:33.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[14790]: audit 2021-07-26T15:57:32.591592+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:33.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[14790]: audit 2021-07-26T15:57:32.600714+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:33.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[14790]: audit 2021-07-26T15:57:32.610491+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:33.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[14790]: cephadm 2021-07-26T15:57:32.614022+0000 mgr.x (mgr.24598) 19 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:57:33.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[14790]: audit 2021-07-26T15:57:32.615688+0000 mon.c (mon.1) 82 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2021-07-26T15:57:33.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[14790]: audit 2021-07-26T15:57:32.616235+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2021-07-26T15:57:33.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[14790]: cephadm 2021-07-26T15:57:32.616833+0000 mgr.x (mgr.24598) 20 : cephadm [INF] Failing over to other MGR 2021-07-26T15:57:33.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[14790]: cluster 2021-07-26T15:57:32.623398+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2021-07-26T15:57:33.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[19094]: cluster 2021-07-26T15:57:32.378850+0000 mgr.x (mgr.24598) 18 : cluster [DBG] pgmap v27: 25 pgs: 25 active+clean; 70 MiB data, 198 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:33.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[19094]: cluster 2021-07-26T15:57:32.522889+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2021-07-26T15:57:33.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[19094]: audit 2021-07-26T15:57:32.591592+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:33.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[19094]: audit 2021-07-26T15:57:32.600714+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:33.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[19094]: audit 2021-07-26T15:57:32.610491+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:33.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[19094]: cephadm 2021-07-26T15:57:32.614022+0000 mgr.x (mgr.24598) 19 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:57:33.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[19094]: audit 2021-07-26T15:57:32.615688+0000 mon.c (mon.1) 82 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2021-07-26T15:57:33.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[19094]: audit 2021-07-26T15:57:32.616235+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2021-07-26T15:57:33.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[19094]: cephadm 2021-07-26T15:57:32.616833+0000 mgr.x (mgr.24598) 20 : cephadm [INF] Failing over to other MGR 2021-07-26T15:57:33.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:33 smithi033 bash[19094]: cluster 2021-07-26T15:57:32.623398+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2021-07-26T15:57:33.987 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[30558]: debug 2021-07-26T15:57:33.603+0000 7f939e258700 -1 mgr handle_mgr_map I was active but no longer am 2021-07-26T15:57:33.988 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[30558]: ignoring --setuser ceph since I am not root 2021-07-26T15:57:33.988 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[30558]: ignoring --setgroup ceph since I am not root 2021-07-26T15:57:33.988 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[30558]: debug 2021-07-26T15:57:33.655+0000 7f6af37bc700 1 -- 172.21.15.96:0/3730857820 <== mon.2 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55aa7c09e340 con 0x55aa7ce10400 2021-07-26T15:57:33.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[15117]: cluster 2021-07-26T15:57:32.378850+0000 mgr.x (mgr.24598) 18 : cluster [DBG] pgmap v27: 25 pgs: 25 active+clean; 70 MiB data, 198 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:33.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[15117]: cluster 2021-07-26T15:57:32.522889+0000 mon.a (mon.0) 773 : cluster [DBG] osdmap e109: 8 total, 8 up, 8 in 2021-07-26T15:57:33.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[15117]: audit 2021-07-26T15:57:32.591592+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:33.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[15117]: audit 2021-07-26T15:57:32.600714+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.24598 ' entity='mgr.x' 2021-07-26T15:57:33.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[15117]: audit 2021-07-26T15:57:32.610491+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:33.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[15117]: cephadm 2021-07-26T15:57:32.614022+0000 mgr.x (mgr.24598) 19 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:57:33.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[15117]: audit 2021-07-26T15:57:32.615688+0000 mon.c (mon.1) 82 : audit [INF] from='mgr.24598 172.21.15.96:0/128617943' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2021-07-26T15:57:33.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[15117]: audit 2021-07-26T15:57:32.616235+0000 mon.a (mon.0) 776 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2021-07-26T15:57:33.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[15117]: cephadm 2021-07-26T15:57:32.616833+0000 mgr.x (mgr.24598) 20 : cephadm [INF] Failing over to other MGR 2021-07-26T15:57:33.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:33 smithi096 bash[15117]: cluster 2021-07-26T15:57:32.623398+0000 mon.a (mon.0) 777 : cluster [DBG] osdmap e110: 8 total, 8 up, 8 in 2021-07-26T15:57:34.635 INFO:tasks.rados.rados.0.smithi033.stdout:321: done (2 left) 2021-07-26T15:57:34.635 INFO:tasks.rados.rados.0.smithi033.stdout:322: done (1 left) 2021-07-26T15:57:34.635 INFO:tasks.rados.rados.0.smithi033.stdout:323: done (0 left) 2021-07-26T15:57:34.635 INFO:tasks.rados.rados.0.smithi033.stdout:324: read oid 15 snap -1 2021-07-26T15:57:34.636 INFO:tasks.rados.rados.0.smithi033.stdout:324: expect (ObjNum 119 snap 27 seq_num 119) 2021-07-26T15:57:34.636 INFO:tasks.rados.rados.0.smithi033.stdout:325: copy_from oid 39 from oid 19 current snap is 28 2021-07-26T15:57:34.636 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 28 2021-07-26T15:57:34.636 INFO:tasks.rados.rados.0.smithi033.stdout:326: seq_num 122 ranges {1368064=450560,1818624=688128,2506752=630784,3137536=286720} 2021-07-26T15:57:34.649 INFO:tasks.rados.rados.0.smithi033.stdout:326: writing smithi03339061-9 from 1368064 to 1818624 tid 1 2021-07-26T15:57:34.664 INFO:tasks.rados.rados.0.smithi033.stdout:326: writing smithi03339061-9 from 1818624 to 2506752 tid 2 2021-07-26T15:57:34.668 INFO:tasks.rados.rados.0.smithi033.stdout:326: writing smithi03339061-9 from 2506752 to 3137536 tid 3 2021-07-26T15:57:34.683 INFO:tasks.rados.rados.0.smithi033.stdout:326: writing smithi03339061-9 from 3137536 to 3424256 tid 4 2021-07-26T15:57:34.684 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 28 2021-07-26T15:57:34.684 INFO:tasks.rados.rados.0.smithi033.stdout:325: finishing copy_from to smithi03339061-39 2021-07-26T15:57:34.685 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 99 (ObjNum 109 snap 19 seq_num 109) dirty exists 2021-07-26T15:57:34.685 INFO:tasks.rados.rados.0.smithi033.stdout:327: seq_num 123 ranges {5029888=466944,5496832=573440,6070272=794624,6864896=237568} 2021-07-26T15:57:34.707 INFO:tasks.rados.rados.0.smithi033.stdout:327: writing smithi03339061-45 from 5029888 to 5496832 tid 1 2021-07-26T15:57:34.715 INFO:tasks.rados.rados.0.smithi033.stdout:327: writing smithi03339061-45 from 5496832 to 6070272 tid 2 2021-07-26T15:57:34.722 INFO:tasks.rados.rados.0.smithi033.stdout:327: writing smithi03339061-45 from 6070272 to 6864896 tid 3 2021-07-26T15:57:34.724 INFO:tasks.rados.rados.0.smithi033.stdout:327: writing smithi03339061-45 from 6864896 to 7102464 tid 4 2021-07-26T15:57:34.724 INFO:tasks.rados.rados.0.smithi033.stdout:328: snap_create 2021-07-26T15:57:34.724 INFO:tasks.rados.rados.0.smithi033.stdout:325: finishing copy_from racing read to smithi03339061-39 2021-07-26T15:57:34.724 INFO:tasks.rados.rados.0.smithi033.stdout:326: finishing write tid 1 to smithi03339061-9 2021-07-26T15:57:34.725 INFO:tasks.rados.rados.0.smithi033.stdout:326: finishing write tid 2 to smithi03339061-9 2021-07-26T15:57:34.725 INFO:tasks.rados.rados.0.smithi033.stdout:324: expect (ObjNum 119 snap 27 seq_num 119) 2021-07-26T15:57:34.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:34 smithi033 bash[14790]: audit 2021-07-26T15:57:33.607457+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2021-07-26T15:57:34.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:34 smithi033 bash[14790]: cluster 2021-07-26T15:57:33.607672+0000 mon.a (mon.0) 779 : cluster [DBG] mgrmap e21: y(active, starting, since 0.990293s) 2021-07-26T15:57:34.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:34 smithi033 bash[14790]: cluster 2021-07-26T15:57:33.630879+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2021-07-26T15:57:34.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:34 smithi033 bash[19094]: audit 2021-07-26T15:57:33.607457+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2021-07-26T15:57:34.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:34 smithi033 bash[19094]: cluster 2021-07-26T15:57:33.607672+0000 mon.a (mon.0) 779 : cluster [DBG] mgrmap e21: y(active, starting, since 0.990293s) 2021-07-26T15:57:34.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:34 smithi033 bash[19094]: cluster 2021-07-26T15:57:33.630879+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2021-07-26T15:57:34.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:34 smithi096 bash[15117]: audit 2021-07-26T15:57:33.607457+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.24598 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2021-07-26T15:57:34.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:34 smithi096 bash[15117]: cluster 2021-07-26T15:57:33.607672+0000 mon.a (mon.0) 779 : cluster [DBG] mgrmap e21: y(active, starting, since 0.990293s) 2021-07-26T15:57:34.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:34 smithi096 bash[15117]: cluster 2021-07-26T15:57:33.630879+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e111: 8 total, 8 up, 8 in 2021-07-26T15:57:35.054 INFO:tasks.rados.rados.0.smithi033.stdout:326: finishing write tid 3 to smithi03339061-9 2021-07-26T15:57:35.054 INFO:tasks.rados.rados.0.smithi033.stdout:326: finishing write tid 4 to smithi03339061-9 2021-07-26T15:57:35.055 INFO:tasks.rados.rados.0.smithi033.stdout:326: finishing write tid 5 to smithi03339061-9 2021-07-26T15:57:35.055 INFO:tasks.rados.rados.0.smithi033.stdout:326: finishing write tid 6 to smithi03339061-9 2021-07-26T15:57:35.055 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 104 (ObjNum 122 snap 28 seq_num 122) dirty exists 2021-07-26T15:57:35.055 INFO:tasks.rados.rados.0.smithi033.stdout:326: left oid 9 (ObjNum 122 snap 28 seq_num 122) 2021-07-26T15:57:35.056 INFO:tasks.rados.rados.0.smithi033.stdout:327: finishing write tid 1 to smithi03339061-45 2021-07-26T15:57:35.056 INFO:tasks.rados.rados.0.smithi033.stdout:327: finishing write tid 2 to smithi03339061-45 2021-07-26T15:57:35.056 INFO:tasks.rados.rados.0.smithi033.stdout:327: finishing write tid 3 to smithi03339061-45 2021-07-26T15:57:35.056 INFO:tasks.rados.rados.0.smithi033.stdout:327: finishing write tid 4 to smithi03339061-45 2021-07-26T15:57:35.057 INFO:tasks.rados.rados.0.smithi033.stdout:327: finishing write tid 5 to smithi03339061-45 2021-07-26T15:57:35.057 INFO:tasks.rados.rados.0.smithi033.stdout:327: finishing write tid 6 to smithi03339061-45 2021-07-26T15:57:35.057 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 164 (ObjNum 123 snap 28 seq_num 123) dirty exists 2021-07-26T15:57:35.057 INFO:tasks.rados.rados.0.smithi033.stdout:327: left oid 45 (ObjNum 123 snap 28 seq_num 123) 2021-07-26T15:57:35.635 INFO:tasks.rados.rados.0.smithi033.stdout:324: done (4 left) 2021-07-26T15:57:35.687 INFO:tasks.rados.rados.0.smithi033.stdout:325: done (3 left) 2021-07-26T15:57:35.688 INFO:tasks.rados.rados.0.smithi033.stdout:326: done (2 left) 2021-07-26T15:57:35.688 INFO:tasks.rados.rados.0.smithi033.stdout:327: done (1 left) 2021-07-26T15:57:35.689 INFO:tasks.rados.rados.0.smithi033.stdout:328: done (0 left) 2021-07-26T15:57:35.689 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 29 2021-07-26T15:57:35.689 INFO:tasks.rados.rados.0.smithi033.stdout:329: seq_num 124 ranges {0=483328,483328=458752,942080=598016,1540096=548864} 2021-07-26T15:57:35.690 INFO:tasks.rados.rados.0.smithi033.stdout:329: writing smithi03339061-5 from 0 to 483328 tid 1 2021-07-26T15:57:35.690 INFO:tasks.rados.rados.0.smithi033.stdout:329: writing smithi03339061-5 from 483328 to 942080 tid 2 2021-07-26T15:57:35.690 INFO:tasks.rados.rados.0.smithi033.stdout:329: writing smithi03339061-5 from 942080 to 1540096 tid 3 2021-07-26T15:57:35.691 INFO:tasks.rados.rados.0.smithi033.stdout:329: writing smithi03339061-5 from 1540096 to 2088960 tid 4 2021-07-26T15:57:35.691 INFO:tasks.rados.rados.0.smithi033.stdout:330: rollback oid 31 current snap is 29 2021-07-26T15:57:35.692 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 31 to 25 2021-07-26T15:57:35.692 INFO:tasks.rados.rados.0.smithi033.stdout:329: finishing write tid 1 to smithi03339061-5 2021-07-26T15:57:35.693 INFO:tasks.rados.rados.0.smithi033.stdout:329: finishing write tid 2 to smithi03339061-5 2021-07-26T15:57:35.693 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 29 2021-07-26T15:57:35.694 INFO:tasks.rados.rados.0.smithi033.stdout:331: seq_num 125 ranges {3694592=499712,4194304=745472,4939776=409600,5349376=450560} 2021-07-26T15:57:35.694 INFO:tasks.rados.rados.0.smithi033.stdout:331: writing smithi03339061-49 from 3694592 to 4194304 tid 1 2021-07-26T15:57:35.695 INFO:tasks.rados.rados.0.smithi033.stdout:331: writing smithi03339061-49 from 4194304 to 4939776 tid 2 2021-07-26T15:57:35.695 INFO:tasks.rados.rados.0.smithi033.stdout:331: writing smithi03339061-49 from 4939776 to 5349376 tid 3 2021-07-26T15:57:35.696 INFO:tasks.rados.rados.0.smithi033.stdout:331: writing smithi03339061-49 from 5349376 to 5799936 tid 4 2021-07-26T15:57:35.696 INFO:tasks.rados.rados.0.smithi033.stdout:332: rmattr oid 41 current snap is 29 2021-07-26T15:57:35.697 INFO:tasks.rados.rados.0.smithi033.stdout:332: done (3 left) 2021-07-26T15:57:35.697 INFO:tasks.rados.rados.0.smithi033.stdout:333: read oid 7 snap -1 2021-07-26T15:57:35.697 INFO:tasks.rados.rados.0.smithi033.stdout:333: expect (ObjNum 16 snap 0 seq_num 16) 2021-07-26T15:57:35.697 INFO:tasks.rados.rados.0.smithi033.stdout:334: snap_create 2021-07-26T15:57:35.697 INFO:tasks.rados.rados.0.smithi033.stdout:329: finishing write tid 3 to smithi03339061-5 2021-07-26T15:57:35.698 INFO:tasks.rados.rados.0.smithi033.stdout:330: finishing rollback tid 1 to smithi03339061-31 2021-07-26T15:57:35.698 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 0 (ObjNum 1 snap 32561 seq_num 2006196752) dirty dne 2021-07-26T15:57:35.698 INFO:tasks.rados.rados.0.smithi033.stdout:329: finishing write tid 4 to smithi03339061-5 2021-07-26T15:57:35.698 INFO:tasks.rados.rados.0.smithi033.stdout:329: finishing write tid 5 to smithi03339061-5 2021-07-26T15:57:35.699 INFO:tasks.rados.rados.0.smithi033.stdout:329: finishing write tid 6 to smithi03339061-5 2021-07-26T15:57:35.699 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 114 (ObjNum 124 snap 29 seq_num 124) dirty exists 2021-07-26T15:57:35.699 INFO:tasks.rados.rados.0.smithi033.stdout:329: left oid 5 (ObjNum 124 snap 29 seq_num 124) 2021-07-26T15:57:35.699 INFO:tasks.rados.rados.0.smithi033.stdout:331: finishing write tid 1 to smithi03339061-49 2021-07-26T15:57:35.699 INFO:tasks.rados.rados.0.smithi033.stdout:331: finishing write tid 2 to smithi03339061-49 2021-07-26T15:57:35.700 INFO:tasks.rados.rados.0.smithi033.stdout:333: expect (ObjNum 16 snap 0 seq_num 16) 2021-07-26T15:57:35.700 INFO:tasks.rados.rados.0.smithi033.stdout:331: finishing write tid 3 to smithi03339061-49 2021-07-26T15:57:35.701 INFO:tasks.rados.rados.0.smithi033.stdout:331: finishing write tid 4 to smithi03339061-49 2021-07-26T15:57:35.702 INFO:tasks.rados.rados.0.smithi033.stdout:331: finishing write tid 5 to smithi03339061-49 2021-07-26T15:57:35.702 INFO:tasks.rados.rados.0.smithi033.stdout:331: finishing write tid 6 to smithi03339061-49 2021-07-26T15:57:35.702 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 81 (ObjNum 125 snap 29 seq_num 125) dirty exists 2021-07-26T15:57:35.702 INFO:tasks.rados.rados.0.smithi033.stdout:331: left oid 49 (ObjNum 125 snap 29 seq_num 125) 2021-07-26T15:57:35.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:35 smithi033 bash[19094]: cluster 2021-07-26T15:57:34.631562+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-07-26T15:57:35.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:35 smithi033 bash[14790]: cluster 2021-07-26T15:57:34.631562+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-07-26T15:57:35.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:35 smithi096 bash[15117]: cluster 2021-07-26T15:57:34.631562+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e112: 8 total, 8 up, 8 in 2021-07-26T15:57:36.075 INFO:tasks.rados.rados.0.smithi033.stdout:329: done (4 left) 2021-07-26T15:57:36.075 INFO:tasks.rados.rados.0.smithi033.stdout:330: done (3 left) 2021-07-26T15:57:36.075 INFO:tasks.rados.rados.0.smithi033.stdout:331: done (2 left) 2021-07-26T15:57:36.075 INFO:tasks.rados.rados.0.smithi033.stdout:333: done (1 left) 2021-07-26T15:57:36.076 INFO:tasks.rados.rados.0.smithi033.stdout:334: done (0 left) 2021-07-26T15:57:36.076 INFO:tasks.rados.rados.0.smithi033.stdout:335: delete oid 49 current snap is 30 2021-07-26T15:57:36.078 INFO:tasks.rados.rados.0.smithi033.stdout:335: done (0 left) 2021-07-26T15:57:36.079 INFO:tasks.rados.rados.0.smithi033.stdout:336: rollback oid 18 current snap is 30 2021-07-26T15:57:36.079 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 18 to 29 2021-07-26T15:57:36.079 INFO:tasks.rados.rados.0.smithi033.stdout:337: snap_create 2021-07-26T15:57:36.086 INFO:tasks.rados.rados.0.smithi033.stdout:336: finishing rollback tid 0 to smithi03339061-18 2021-07-26T15:57:36.086 INFO:tasks.rados.rados.0.smithi033.stdout:336: finishing rollback tid 1 to smithi03339061-18 2021-07-26T15:57:36.087 INFO:tasks.rados.rados.0.smithi033.stdout:336: finishing rollback tid 2 to smithi03339061-18 2021-07-26T15:57:36.087 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 168 (ObjNum 115 snap 26 seq_num 115) dirty exists 2021-07-26T15:57:36.921 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[19094]: cluster 2021-07-26T15:57:35.631862+0000 mon.a (mon.0) 782 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-07-26T15:57:36.922 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[19094]: cluster 2021-07-26T15:57:36.065013+0000 mon.a (mon.0) 783 : cluster [INF] Active manager daemon y restarted 2021-07-26T15:57:36.922 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[19094]: cluster 2021-07-26T15:57:36.066250+0000 mon.a (mon.0) 784 : cluster [INF] Activating manager daemon y 2021-07-26T15:57:36.923 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[19094]: cluster 2021-07-26T15:57:36.071703+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-07-26T15:57:36.923 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[19094]: audit 2021-07-26T15:57:36.071889+0000 mon.a (mon.0) 786 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2021-07-26T15:57:36.923 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[19094]: audit 2021-07-26T15:57:36.072535+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:36.924 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[19094]: audit 2021-07-26T15:57:36.073988+0000 mon.a (mon.0) 788 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2021-07-26T15:57:36.924 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[19094]: audit 2021-07-26T15:57:36.074389+0000 mon.a (mon.0) 789 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:36.924 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[14790]: cluster 2021-07-26T15:57:35.631862+0000 mon.a (mon.0) 782 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-07-26T15:57:36.925 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[14790]: cluster 2021-07-26T15:57:36.065013+0000 mon.a (mon.0) 783 : cluster [INF] Active manager daemon y restarted 2021-07-26T15:57:36.925 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[14790]: cluster 2021-07-26T15:57:36.066250+0000 mon.a (mon.0) 784 : cluster [INF] Activating manager daemon y 2021-07-26T15:57:36.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[14790]: cluster 2021-07-26T15:57:36.071703+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-07-26T15:57:36.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[14790]: audit 2021-07-26T15:57:36.071889+0000 mon.a (mon.0) 786 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2021-07-26T15:57:36.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[14790]: audit 2021-07-26T15:57:36.072535+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:36.927 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[14790]: audit 2021-07-26T15:57:36.073988+0000 mon.a (mon.0) 788 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2021-07-26T15:57:36.927 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[14790]: audit 2021-07-26T15:57:36.074389+0000 mon.a (mon.0) 789 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:36.934 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:36 smithi096 bash[15117]: cluster 2021-07-26T15:57:35.631862+0000 mon.a (mon.0) 782 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-07-26T15:57:36.935 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:36 smithi096 bash[15117]: cluster 2021-07-26T15:57:36.065013+0000 mon.a (mon.0) 783 : cluster [INF] Active manager daemon y restarted 2021-07-26T15:57:36.935 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:36 smithi096 bash[15117]: cluster 2021-07-26T15:57:36.066250+0000 mon.a (mon.0) 784 : cluster [INF] Activating manager daemon y 2021-07-26T15:57:36.936 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:36 smithi096 bash[15117]: cluster 2021-07-26T15:57:36.071703+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-07-26T15:57:36.936 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:36 smithi096 bash[15117]: audit 2021-07-26T15:57:36.071889+0000 mon.a (mon.0) 786 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2021-07-26T15:57:36.936 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:36 smithi096 bash[15117]: audit 2021-07-26T15:57:36.072535+0000 mon.a (mon.0) 787 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:36.936 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:36 smithi096 bash[15117]: audit 2021-07-26T15:57:36.073988+0000 mon.a (mon.0) 788 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2021-07-26T15:57:36.936 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:36 smithi096 bash[15117]: audit 2021-07-26T15:57:36.074389+0000 mon.a (mon.0) 789 : audit [DBG] from='mgr.? 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:37.079 INFO:tasks.rados.rados.0.smithi033.stdout:336: done (1 left) 2021-07-26T15:57:37.080 INFO:tasks.rados.rados.0.smithi033.stdout:337: done (0 left) 2021-07-26T15:57:37.080 INFO:tasks.rados.rados.0.smithi033.stdout:338: rollback oid 41 current snap is 31 2021-07-26T15:57:37.081 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 41 to 26 2021-07-26T15:57:37.081 INFO:tasks.rados.rados.0.smithi033.stdout:339: rollback oid 18 current snap is 31 2021-07-26T15:57:37.082 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 18 to 27 2021-07-26T15:57:37.082 INFO:tasks.rados.rados.0.smithi033.stdout:340: rmattr oid 23 current snap is 31 2021-07-26T15:57:37.082 INFO:tasks.rados.rados.0.smithi033.stdout:340: done (2 left) 2021-07-26T15:57:37.083 INFO:tasks.rados.rados.0.smithi033.stdout:341: copy_from oid 43 from oid 10 current snap is 31 2021-07-26T15:57:37.083 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 31 2021-07-26T15:57:37.084 INFO:tasks.rados.rados.0.smithi033.stdout:342: seq_num 127 ranges {2277376=532480,2809856=507904,3317760=778240,4096000=319488} 2021-07-26T15:57:37.098 INFO:tasks.rados.rados.0.smithi033.stdout:342: writing smithi03339061-19 from 2277376 to 2809856 tid 1 2021-07-26T15:57:37.104 INFO:tasks.rados.rados.0.smithi033.stdout:342: writing smithi03339061-19 from 2809856 to 3317760 tid 2 2021-07-26T15:57:37.114 INFO:tasks.rados.rados.0.smithi033.stdout:342: writing smithi03339061-19 from 3317760 to 4096000 tid 3 2021-07-26T15:57:37.118 INFO:tasks.rados.rados.0.smithi033.stdout:342: writing smithi03339061-19 from 4096000 to 4415488 tid 4 2021-07-26T15:57:37.119 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 31 2021-07-26T15:57:37.119 INFO:tasks.rados.rados.0.smithi033.stdout:338: finishing rollback tid 0 to smithi03339061-41 2021-07-26T15:57:37.119 INFO:tasks.rados.rados.0.smithi033.stdout:343: seq_num 128 ranges {3375104=548864,3923968=794624,4718592=581632,5300224=229376} 2021-07-26T15:57:37.148 INFO:tasks.rados.rados.0.smithi033.stdout:343: writing smithi03339061-13 from 3375104 to 3923968 tid 1 2021-07-26T15:57:37.153 INFO:tasks.rados.rados.0.smithi033.stdout:343: writing smithi03339061-13 from 3923968 to 4718592 tid 2 2021-07-26T15:57:37.157 INFO:tasks.rados.rados.0.smithi033.stdout:343: writing smithi03339061-13 from 4718592 to 5300224 tid 3 2021-07-26T15:57:37.159 INFO:tasks.rados.rados.0.smithi033.stdout:343: writing smithi03339061-13 from 5300224 to 5529600 tid 4 2021-07-26T15:57:37.159 INFO:tasks.rados.rados.0.smithi033.stdout:344: setattr oid 26 current snap is 31 2021-07-26T15:57:37.159 INFO:tasks.rados.rados.0.smithi033.stdout:338: finishing rollback tid 1 to smithi03339061-41 2021-07-26T15:57:37.160 INFO:tasks.rados.rados.0.smithi033.stdout:338: finishing rollback tid 2 to smithi03339061-41 2021-07-26T15:57:37.160 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 117 (ObjNum 99 snap 18 seq_num 99) dirty exists 2021-07-26T15:57:37.160 INFO:tasks.rados.rados.0.smithi033.stdout:339: finishing rollback tid 0 to smithi03339061-18 2021-07-26T15:57:37.160 INFO:tasks.rados.rados.0.smithi033.stdout:339: finishing rollback tid 1 to smithi03339061-18 2021-07-26T15:57:37.161 INFO:tasks.rados.rados.0.smithi033.stdout:339: finishing rollback tid 2 to smithi03339061-18 2021-07-26T15:57:37.161 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 172 (ObjNum 115 snap 26 seq_num 115) dirty exists 2021-07-26T15:57:37.161 INFO:tasks.rados.rados.0.smithi033.stdout:341: finishing copy_from to smithi03339061-43 2021-07-26T15:57:37.161 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 69 (ObjNum 104 snap 19 seq_num 104) dirty exists 2021-07-26T15:57:37.161 INFO:tasks.rados.rados.0.smithi033.stdout:341: finishing copy_from racing read to smithi03339061-43 2021-07-26T15:57:37.162 INFO:tasks.rados.rados.0.smithi033.stdout:342: finishing write tid 1 to smithi03339061-19 2021-07-26T15:57:37.162 INFO:tasks.rados.rados.0.smithi033.stdout:342: finishing write tid 2 to smithi03339061-19 2021-07-26T15:57:37.162 INFO:tasks.rados.rados.0.smithi033.stdout:342: finishing write tid 3 to smithi03339061-19 2021-07-26T15:57:37.162 INFO:tasks.rados.rados.0.smithi033.stdout:342: finishing write tid 4 to smithi03339061-19 2021-07-26T15:57:37.163 INFO:tasks.rados.rados.0.smithi033.stdout:342: finishing write tid 5 to smithi03339061-19 2021-07-26T15:57:37.163 INFO:tasks.rados.rados.0.smithi033.stdout:342: finishing write tid 6 to smithi03339061-19 2021-07-26T15:57:37.163 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 109 (ObjNum 127 snap 31 seq_num 127) dirty exists 2021-07-26T15:57:37.163 INFO:tasks.rados.rados.0.smithi033.stdout:342: left oid 19 (ObjNum 127 snap 31 seq_num 127) 2021-07-26T15:57:37.164 INFO:tasks.rados.rados.0.smithi033.stdout:343: finishing write tid 1 to smithi03339061-13 2021-07-26T15:57:37.165 INFO:tasks.rados.rados.0.smithi033.stdout:338: done (5 left) 2021-07-26T15:57:37.165 INFO:tasks.rados.rados.0.smithi033.stdout:339: done (4 left) 2021-07-26T15:57:37.165 INFO:tasks.rados.rados.0.smithi033.stdout:341: done (3 left) 2021-07-26T15:57:37.165 INFO:tasks.rados.rados.0.smithi033.stdout:342: done (2 left) 2021-07-26T15:57:37.166 INFO:tasks.rados.rados.0.smithi033.stdout:345: snap_create 2021-07-26T15:57:37.166 INFO:tasks.rados.rados.0.smithi033.stdout:343: finishing write tid 2 to smithi03339061-13 2021-07-26T15:57:37.166 INFO:tasks.rados.rados.0.smithi033.stdout:343: finishing write tid 3 to smithi03339061-13 2021-07-26T15:57:37.167 INFO:tasks.rados.rados.0.smithi033.stdout:343: finishing write tid 4 to smithi03339061-13 2021-07-26T15:57:37.167 INFO:tasks.rados.rados.0.smithi033.stdout:343: finishing write tid 5 to smithi03339061-13 2021-07-26T15:57:37.167 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 174 (ObjNum 38 snap 0 seq_num 38) dirty exists 2021-07-26T15:57:37.168 INFO:tasks.rados.rados.0.smithi033.stdout:343: finishing write tid 6 to smithi03339061-13 2021-07-26T15:57:37.168 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 83 (ObjNum 128 snap 31 seq_num 128) dirty exists 2021-07-26T15:57:37.168 INFO:tasks.rados.rados.0.smithi033.stdout:343: left oid 13 (ObjNum 128 snap 31 seq_num 128) 2021-07-26T15:57:37.211 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[39943]: Warning: Permanently added '172.21.15.33' (ECDSA) to the list of known hosts. 2021-07-26T15:57:37.212 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:57:36 smithi033 bash[39943]: Warning: Permanently added '172.21.15.96' (ECDSA) to the list of known hosts. 2021-07-26T15:57:37.719 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T15:57:37.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: cluster 2021-07-26T15:57:36.654989+0000 mon.a (mon.0) 790 : cluster [DBG] mgrmap e22: y(active, starting, since 0.589007s) 2021-07-26T15:57:37.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.657124+0000 mon.a (mon.0) 791 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:37.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.657567+0000 mon.a (mon.0) 792 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:37.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.658057+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:37.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.658749+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-07-26T15:57:37.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.659192+0000 mon.a (mon.0) 795 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:57:37.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.659595+0000 mon.a (mon.0) 796 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:57:37.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.659881+0000 mon.a (mon.0) 797 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:57:37.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.660225+0000 mon.a (mon.0) 798 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:57:37.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.660541+0000 mon.a (mon.0) 799 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:57:37.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.660846+0000 mon.a (mon.0) 800 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:57:37.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.661132+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:57:37.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.661414+0000 mon.a (mon.0) 802 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:57:37.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.661720+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:57:37.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.661978+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:57:37.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.662538+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:57:37.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: cluster 2021-07-26T15:57:36.687235+0000 mon.a (mon.0) 806 : cluster [INF] Manager daemon y is now available 2021-07-26T15:57:37.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.851770+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:37.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.857576+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:37.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: cluster 2021-07-26T15:57:36.654989+0000 mon.a (mon.0) 790 : cluster [DBG] mgrmap e22: y(active, starting, since 0.589007s) 2021-07-26T15:57:37.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.657124+0000 mon.a (mon.0) 791 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:37.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.657567+0000 mon.a (mon.0) 792 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:37.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.658057+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:37.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.658749+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-07-26T15:57:37.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.659192+0000 mon.a (mon.0) 795 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:57:37.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.659595+0000 mon.a (mon.0) 796 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:57:37.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.659881+0000 mon.a (mon.0) 797 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:57:37.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.660225+0000 mon.a (mon.0) 798 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:57:37.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.660541+0000 mon.a (mon.0) 799 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:57:37.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.660846+0000 mon.a (mon.0) 800 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:57:37.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.661132+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:57:37.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.661414+0000 mon.a (mon.0) 802 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:57:37.967 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.661720+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:57:37.967 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.661978+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:57:37.967 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.662538+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:57:37.967 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: cluster 2021-07-26T15:57:36.687235+0000 mon.a (mon.0) 806 : cluster [INF] Manager daemon y is now available 2021-07-26T15:57:37.968 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.851770+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:37.968 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.857576+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:37.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.861119+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:37.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.863214+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:37.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.894383+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:37.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: audit 2021-07-26T15:57:36.925099+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:37.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[19094]: cluster 2021-07-26T15:57:37.074749+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-07-26T15:57:37.970 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.861119+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:37.970 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.863214+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:37.970 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.894383+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:37.970 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: audit 2021-07-26T15:57:36.925099+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:37.971 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:37 smithi033 bash[14790]: cluster 2021-07-26T15:57:37.074749+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-07-26T15:57:37.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: cluster 2021-07-26T15:57:36.654989+0000 mon.a (mon.0) 790 : cluster [DBG] mgrmap e22: y(active, starting, since 0.589007s) 2021-07-26T15:57:37.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.657124+0000 mon.a (mon.0) 791 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:57:37.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.657567+0000 mon.a (mon.0) 792 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:57:37.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.658057+0000 mon.a (mon.0) 793 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:57:37.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.658749+0000 mon.a (mon.0) 794 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-07-26T15:57:37.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.659192+0000 mon.a (mon.0) 795 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:57:37.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.659595+0000 mon.a (mon.0) 796 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:57:37.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.659881+0000 mon.a (mon.0) 797 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:57:37.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.660225+0000 mon.a (mon.0) 798 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:57:37.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.660541+0000 mon.a (mon.0) 799 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:57:37.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.660846+0000 mon.a (mon.0) 800 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:57:37.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.661132+0000 mon.a (mon.0) 801 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:57:37.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.661414+0000 mon.a (mon.0) 802 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:57:37.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.661720+0000 mon.a (mon.0) 803 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:57:37.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.661978+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:57:37.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.662538+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:57:37.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: cluster 2021-07-26T15:57:36.687235+0000 mon.a (mon.0) 806 : cluster [INF] Manager daemon y is now available 2021-07-26T15:57:37.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.851770+0000 mon.a (mon.0) 807 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:37.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.857576+0000 mon.a (mon.0) 808 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:37.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.861119+0000 mon.a (mon.0) 809 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:37.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.863214+0000 mon.a (mon.0) 810 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:37.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.894383+0000 mon.a (mon.0) 811 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:57:37.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: audit 2021-07-26T15:57:36.925099+0000 mon.a (mon.0) 812 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:57:37.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:37 smithi096 bash[15117]: cluster 2021-07-26T15:57:37.074749+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-07-26T15:57:38.060 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T15:57:38.061 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (4m) 5s ago 4m 14.2M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T15:57:38.061 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (4m) 16s ago 4m 25.5M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T15:57:38.061 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (30s) 16s ago 8m 402M - 17.0.0-6381-gbccf07c2 6cdb40438e66 d77790033e7a 2021-07-26T15:57:38.061 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (10s) 5s ago 11m 87.0M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T15:57:38.062 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (11m) 5s ago 11m 55.1M 2048M 16.2.5 34f74fddb18e 85aee8c34dd9 2021-07-26T15:57:38.062 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (9m) 16s ago 9m 43.9M 2048M 16.2.5 34f74fddb18e dce67784fda4 2021-07-26T15:57:38.062 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (9m) 5s ago 9m 45.4M 2048M 16.2.5 34f74fddb18e 18be215b59d8 2021-07-26T15:57:38.062 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (4m) 5s ago 4m 10.6M - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T15:57:38.062 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (4m) 16s ago 4m 11.1M - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T15:57:38.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (8m) 5s ago 8m 62.5M 3553M 16.2.5 34f74fddb18e a4b4ebc84a97 2021-07-26T15:57:38.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (8m) 5s ago 8m 59.0M 3553M 16.2.5 34f74fddb18e 35137704568f 2021-07-26T15:57:38.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (7m) 5s ago 7m 54.2M 3553M 16.2.5 34f74fddb18e d351359286fd 2021-07-26T15:57:38.063 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (7m) 5s ago 7m 88.5M 3553M 16.2.5 34f74fddb18e 6b68e9927be6 2021-07-26T15:57:38.064 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (6m) 16s ago 6m 52.7M 3552M 16.2.5 34f74fddb18e 1aac82d5671e 2021-07-26T15:57:38.064 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (6m) 16s ago 6m 51.7M 3552M 16.2.5 34f74fddb18e 12b89782c2eb 2021-07-26T15:57:38.064 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (5m) 16s ago 5m 50.5M 3552M 16.2.5 34f74fddb18e 4fad5a8407d4 2021-07-26T15:57:38.064 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (5m) 16s ago 5m 47.3M 3552M 16.2.5 34f74fddb18e a988c60ad3d5 2021-07-26T15:57:38.064 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (4m) 16s ago 5m 32.6M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T15:57:38.081 INFO:tasks.rados.rados.0.smithi033.stdout:343: done (2 left) 2021-07-26T15:57:38.081 INFO:tasks.rados.rados.0.smithi033.stdout:344: done (1 left) 2021-07-26T15:57:38.082 INFO:tasks.rados.rados.0.smithi033.stdout:345: done (0 left) 2021-07-26T15:57:38.082 INFO:tasks.rados.rados.0.smithi033.stdout:346: copy_from oid 34 from oid 46 current snap is 32 2021-07-26T15:57:38.082 INFO:tasks.rados.rados.0.smithi033.stdout:347: snap_remove snap 23 2021-07-26T15:57:38.444 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T15:57:38.445 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T15:57:38.445 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 3 2021-07-26T15:57:38.445 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:57:38.445 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T15:57:38.446 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 1 2021-07-26T15:57:38.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:57:38.446 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T15:57:38.446 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 8 2021-07-26T15:57:38.446 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:57:38.447 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T15:57:38.447 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T15:57:38.447 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 11, 2021-07-26T15:57:38.447 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 1 2021-07-26T15:57:38.448 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T15:57:38.448 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T15:57:38.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[14790]: cluster 2021-07-26T15:57:37.673081+0000 mon.a (mon.0) 814 : cluster [DBG] mgrmap e23: y(active, since 1.60711s) 2021-07-26T15:57:38.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[14790]: audit 2021-07-26T15:57:37.698397+0000 mgr.y (mgr.14712) 1 : audit [DBG] from='client.24649 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:38.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[14790]: cluster 2021-07-26T15:57:37.700858+0000 mgr.y (mgr.14712) 2 : cluster [DBG] pgmap v4: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:38.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[14790]: audit 2021-07-26T15:57:38.039240+0000 mgr.y (mgr.14712) 3 : audit [DBG] from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:38.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[14790]: cluster 2021-07-26T15:57:38.078626+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-07-26T15:57:38.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[14790]: audit 2021-07-26T15:57:38.441910+0000 mon.c (mon.1) 83 : audit [DBG] from='client.? 172.21.15.33:0/2936213542' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:57:38.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[19094]: cluster 2021-07-26T15:57:37.673081+0000 mon.a (mon.0) 814 : cluster [DBG] mgrmap e23: y(active, since 1.60711s) 2021-07-26T15:57:38.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[19094]: audit 2021-07-26T15:57:37.698397+0000 mgr.y (mgr.14712) 1 : audit [DBG] from='client.24649 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:38.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[19094]: cluster 2021-07-26T15:57:37.700858+0000 mgr.y (mgr.14712) 2 : cluster [DBG] pgmap v4: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:38.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[19094]: audit 2021-07-26T15:57:38.039240+0000 mgr.y (mgr.14712) 3 : audit [DBG] from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:38.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[19094]: cluster 2021-07-26T15:57:38.078626+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-07-26T15:57:38.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:38 smithi033 bash[19094]: audit 2021-07-26T15:57:38.441910+0000 mon.c (mon.1) 83 : audit [DBG] from='client.? 172.21.15.33:0/2936213542' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:57:38.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:38 smithi096 bash[15117]: cluster 2021-07-26T15:57:37.673081+0000 mon.a (mon.0) 814 : cluster [DBG] mgrmap e23: y(active, since 1.60711s) 2021-07-26T15:57:38.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:38 smithi096 bash[15117]: audit 2021-07-26T15:57:37.698397+0000 mgr.y (mgr.14712) 1 : audit [DBG] from='client.24649 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:38.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:38 smithi096 bash[15117]: cluster 2021-07-26T15:57:37.700858+0000 mgr.y (mgr.14712) 2 : cluster [DBG] pgmap v4: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:38.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:38 smithi096 bash[15117]: audit 2021-07-26T15:57:38.039240+0000 mgr.y (mgr.14712) 3 : audit [DBG] from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:57:38.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:38 smithi096 bash[15117]: cluster 2021-07-26T15:57:38.078626+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-07-26T15:57:38.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:38 smithi096 bash[15117]: audit 2021-07-26T15:57:38.441910+0000 mon.c (mon.1) 83 : audit [DBG] from='client.? 172.21.15.33:0/2936213542' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:57:39.086 INFO:tasks.rados.rados.0.smithi033.stdout:347: done (1 left) 2021-07-26T15:57:39.087 INFO:tasks.rados.rados.0.smithi033.stdout:348: rollback oid 45 current snap is 32 2021-07-26T15:57:39.087 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 45 to 24 2021-07-26T15:57:39.087 INFO:tasks.rados.rados.0.smithi033.stdout:349: read oid 20 snap -1 2021-07-26T15:57:39.087 INFO:tasks.rados.rados.0.smithi033.stdout:349: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:57:39.087 INFO:tasks.rados.rados.0.smithi033.stdout:350: read oid 37 snap -1 2021-07-26T15:57:39.088 INFO:tasks.rados.rados.0.smithi033.stdout:350: expect (ObjNum 36 snap 0 seq_num 36) 2021-07-26T15:57:39.088 INFO:tasks.rados.rados.0.smithi033.stdout:351: delete oid 28 current snap is 32 2021-07-26T15:57:39.088 INFO:tasks.rados.rados.0.smithi033.stdout:346: finishing copy_from to smithi03339061-34 2021-07-26T15:57:39.088 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 16 (ObjNum 45 snap 0 seq_num 45) dirty exists 2021-07-26T15:57:39.089 INFO:tasks.rados.rados.0.smithi033.stdout:346: finishing copy_from racing read to smithi03339061-34 2021-07-26T15:57:39.096 INFO:tasks.rados.rados.0.smithi033.stdout:350: expect (ObjNum 36 snap 0 seq_num 36) 2021-07-26T15:57:39.115 INFO:tasks.rados.rados.0.smithi033.stdout:349: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:57:39.136 INFO:tasks.rados.rados.0.smithi033.stdout:348: finishing rollback tid 0 to smithi03339061-45 2021-07-26T15:57:39.137 INFO:tasks.rados.rados.0.smithi033.stdout:348: finishing rollback tid 1 to smithi03339061-45 2021-07-26T15:57:39.137 INFO:tasks.rados.rados.0.smithi033.stdout:348: finishing rollback tid 2 to smithi03339061-45 2021-07-26T15:57:39.137 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 178 (ObjNum 79 snap 13 seq_num 79) dirty exists 2021-07-26T15:57:39.138 INFO:tasks.rados.rados.0.smithi033.stdout:346: done (4 left) 2021-07-26T15:57:39.138 INFO:tasks.rados.rados.0.smithi033.stdout:348: done (3 left) 2021-07-26T15:57:39.139 INFO:tasks.rados.rados.0.smithi033.stdout:349: done (2 left) 2021-07-26T15:57:39.139 INFO:tasks.rados.rados.0.smithi033.stdout:350: done (1 left) 2021-07-26T15:57:39.140 INFO:tasks.rados.rados.0.smithi033.stdout:351: done (0 left) 2021-07-26T15:57:39.140 INFO:tasks.rados.rados.0.smithi033.stdout:352: rollback oid 5 current snap is 32 2021-07-26T15:57:39.140 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 5 to 29 2021-07-26T15:57:39.141 INFO:tasks.rados.rados.0.smithi033.stdout:353: snap_remove snap 30 2021-07-26T15:57:39.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:39 smithi033 bash[19094]: cluster 2021-07-26T15:57:38.660632+0000 mgr.y (mgr.14712) 4 : cluster [DBG] pgmap v6: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:39.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:39 smithi033 bash[19094]: cluster 2021-07-26T15:57:38.687213+0000 mon.a (mon.0) 816 : cluster [DBG] mgrmap e24: y(active, since 2s) 2021-07-26T15:57:39.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:39 smithi033 bash[19094]: cluster 2021-07-26T15:57:39.083188+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-07-26T15:57:39.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:39 smithi033 bash[14790]: cluster 2021-07-26T15:57:38.660632+0000 mgr.y (mgr.14712) 4 : cluster [DBG] pgmap v6: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:39.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:39 smithi033 bash[14790]: cluster 2021-07-26T15:57:38.687213+0000 mon.a (mon.0) 816 : cluster [DBG] mgrmap e24: y(active, since 2s) 2021-07-26T15:57:39.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:39 smithi033 bash[14790]: cluster 2021-07-26T15:57:39.083188+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-07-26T15:57:39.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:39 smithi096 bash[15117]: cluster 2021-07-26T15:57:38.660632+0000 mgr.y (mgr.14712) 4 : cluster [DBG] pgmap v6: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:39.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:39 smithi096 bash[15117]: cluster 2021-07-26T15:57:38.687213+0000 mon.a (mon.0) 816 : cluster [DBG] mgrmap e24: y(active, since 2s) 2021-07-26T15:57:39.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:39 smithi096 bash[15117]: cluster 2021-07-26T15:57:39.083188+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-07-26T15:57:40.088 INFO:tasks.rados.rados.0.smithi033.stdout:353: done (1 left) 2021-07-26T15:57:40.088 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 32 2021-07-26T15:57:40.088 INFO:tasks.rados.rados.0.smithi033.stdout:354: seq_num 130 ranges {2138112=581632,2719744=614400,3334144=598016,3932160=393216} 2021-07-26T15:57:40.107 INFO:tasks.rados.rados.0.smithi033.stdout:354: writing smithi03339061-33 from 2138112 to 2719744 tid 1 2021-07-26T15:57:40.111 INFO:tasks.rados.rados.0.smithi033.stdout:354: writing smithi03339061-33 from 2719744 to 3334144 tid 2 2021-07-26T15:57:40.117 INFO:tasks.rados.rados.0.smithi033.stdout:354: writing smithi03339061-33 from 3334144 to 3932160 tid 3 2021-07-26T15:57:40.120 INFO:tasks.rados.rados.0.smithi033.stdout:354: writing smithi03339061-33 from 3932160 to 4325376 tid 4 2021-07-26T15:57:40.121 INFO:tasks.rados.rados.0.smithi033.stdout:352: finishing rollback tid 0 to smithi03339061-5 2021-07-26T15:57:40.121 INFO:tasks.rados.rados.0.smithi033.stdout:352: finishing rollback tid 1 to smithi03339061-5 2021-07-26T15:57:40.122 INFO:tasks.rados.rados.0.smithi033.stdout:352: finishing rollback tid 2 to smithi03339061-5 2021-07-26T15:57:40.122 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 120 (ObjNum 124 snap 29 seq_num 124) dirty exists 2021-07-26T15:57:40.122 INFO:tasks.rados.rados.0.smithi033.stdout:354: finishing write tid 1 to smithi03339061-33 2021-07-26T15:57:40.122 INFO:tasks.rados.rados.0.smithi033.stdout:354: finishing write tid 2 to smithi03339061-33 2021-07-26T15:57:40.122 INFO:tasks.rados.rados.0.smithi033.stdout:352: done (1 left) 2021-07-26T15:57:40.123 INFO:tasks.rados.rados.0.smithi033.stdout:355: read oid 45 snap -1 2021-07-26T15:57:40.123 INFO:tasks.rados.rados.0.smithi033.stdout:355: expect (ObjNum 79 snap 13 seq_num 79) 2021-07-26T15:57:40.123 INFO:tasks.rados.rados.0.smithi033.stdout:356: copy_from oid 21 from oid 20 current snap is 32 2021-07-26T15:57:40.124 INFO:tasks.rados.rados.0.smithi033.stdout:357: setattr oid 34 current snap is 32 2021-07-26T15:57:40.124 INFO:tasks.rados.rados.0.smithi033.stdout:358: read oid 24 snap -1 2021-07-26T15:57:40.125 INFO:tasks.rados.rados.0.smithi033.stdout:358: expect (ObjNum 59 snap 5 seq_num 59) 2021-07-26T15:57:40.125 INFO:tasks.rados.rados.0.smithi033.stdout:359: snap_create 2021-07-26T15:57:40.125 INFO:tasks.rados.rados.0.smithi033.stdout:354: finishing write tid 3 to smithi03339061-33 2021-07-26T15:57:40.125 INFO:tasks.rados.rados.0.smithi033.stdout:354: finishing write tid 4 to smithi03339061-33 2021-07-26T15:57:40.132 INFO:tasks.rados.rados.0.smithi033.stdout:358: expect (ObjNum 59 snap 5 seq_num 59) 2021-07-26T15:57:40.184 INFO:tasks.rados.rados.0.smithi033.stdout:354: finishing write tid 5 to smithi03339061-33 2021-07-26T15:57:40.184 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 31 (ObjNum 45 snap 0 seq_num 45) dirty exists 2021-07-26T15:57:40.185 INFO:tasks.rados.rados.0.smithi033.stdout:356: finishing copy_from to smithi03339061-21 2021-07-26T15:57:40.185 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 4 (ObjNum 41 snap 0 seq_num 41) dirty exists 2021-07-26T15:57:40.185 INFO:tasks.rados.rados.0.smithi033.stdout:355: expect (ObjNum 79 snap 13 seq_num 79) 2021-07-26T15:57:40.320 INFO:tasks.rados.rados.0.smithi033.stdout:354: finishing write tid 6 to smithi03339061-33 2021-07-26T15:57:40.321 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 196 (ObjNum 130 snap 32 seq_num 130) dirty exists 2021-07-26T15:57:40.321 INFO:tasks.rados.rados.0.smithi033.stdout:354: left oid 33 (ObjNum 130 snap 32 seq_num 130) 2021-07-26T15:57:40.321 INFO:tasks.rados.rados.0.smithi033.stdout:356: finishing copy_from racing read to smithi03339061-21 2021-07-26T15:57:41.101 INFO:tasks.rados.rados.0.smithi033.stdout:354: done (5 left) 2021-07-26T15:57:41.101 INFO:tasks.rados.rados.0.smithi033.stdout:355: done (4 left) 2021-07-26T15:57:41.102 INFO:tasks.rados.rados.0.smithi033.stdout:356: done (3 left) 2021-07-26T15:57:41.102 INFO:tasks.rados.rados.0.smithi033.stdout:357: done (2 left) 2021-07-26T15:57:41.102 INFO:tasks.rados.rados.0.smithi033.stdout:358: done (1 left) 2021-07-26T15:57:41.102 INFO:tasks.rados.rados.0.smithi033.stdout:359: done (0 left) 2021-07-26T15:57:41.102 INFO:tasks.rados.rados.0.smithi033.stdout:360: read oid 31 snap -1 2021-07-26T15:57:41.103 INFO:tasks.rados.rados.0.smithi033.stdout:360: expect deleted 2021-07-26T15:57:41.103 INFO:tasks.rados.rados.0.smithi033.stdout:361: rollback oid 22 current snap is 33 2021-07-26T15:57:41.103 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 22 to 26 2021-07-26T15:57:41.103 INFO:tasks.rados.rados.0.smithi033.stdout:362: read oid 48 snap -1 2021-07-26T15:57:41.104 INFO:tasks.rados.rados.0.smithi033.stdout:362: expect (ObjNum 107 snap 19 seq_num 107) 2021-07-26T15:57:41.104 INFO:tasks.rados.rados.0.smithi033.stdout:363: read oid 3 snap 32 2021-07-26T15:57:41.105 INFO:tasks.rados.rados.0.smithi033.stdout:363: expect (ObjNum 121 snap 27 seq_num 121) 2021-07-26T15:57:41.105 INFO:tasks.rados.rados.0.smithi033.stdout:364: snap_remove snap 28 2021-07-26T15:57:41.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[14790]: cluster 2021-07-26T15:57:40.083123+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-07-26T15:57:41.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[14790]: cluster 2021-07-26T15:57:40.150742+0000 mon.a (mon.0) 819 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:57:41.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[14790]: audit 2021-07-26T15:57:40.151995+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:57:41.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[14790]: audit 2021-07-26T15:57:40.154367+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:41.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[14790]: audit 2021-07-26T15:57:40.155370+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:57:41.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[14790]: audit 2021-07-26T15:57:40.155738+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:41.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[19094]: cluster 2021-07-26T15:57:40.083123+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-07-26T15:57:41.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[19094]: cluster 2021-07-26T15:57:40.150742+0000 mon.a (mon.0) 819 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:57:41.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[19094]: audit 2021-07-26T15:57:40.151995+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:57:41.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[19094]: audit 2021-07-26T15:57:40.154367+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:41.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[19094]: audit 2021-07-26T15:57:40.155370+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:57:41.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:41 smithi033 bash[19094]: audit 2021-07-26T15:57:40.155738+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:41.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:41 smithi096 bash[15117]: cluster 2021-07-26T15:57:40.083123+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-07-26T15:57:41.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:41 smithi096 bash[15117]: cluster 2021-07-26T15:57:40.150742+0000 mon.a (mon.0) 819 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:57:41.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:41 smithi096 bash[15117]: audit 2021-07-26T15:57:40.151995+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:57:41.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:41 smithi096 bash[15117]: audit 2021-07-26T15:57:40.154367+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:41.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:41 smithi096 bash[15117]: audit 2021-07-26T15:57:40.155370+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:57:41.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:41 smithi096 bash[15117]: audit 2021-07-26T15:57:40.155738+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.? 172.21.15.96:0/1312790535' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:42.099 INFO:tasks.rados.rados.0.smithi033.stdout:364: done (4 left) 2021-07-26T15:57:42.099 INFO:tasks.rados.rados.0.smithi033.stdout:365: read oid 18 snap -1 2021-07-26T15:57:42.099 INFO:tasks.rados.rados.0.smithi033.stdout:365: expect (ObjNum 115 snap 26 seq_num 115) 2021-07-26T15:57:42.099 INFO:tasks.rados.rados.0.smithi033.stdout:366: snap_remove snap 27 2021-07-26T15:57:42.212 INFO:tasks.rados.rados.0.smithi033.stdout:366: done (5 left) 2021-07-26T15:57:42.213 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 33 2021-07-26T15:57:42.213 INFO:tasks.rados.rados.0.smithi033.stdout:367: seq_num 131 ranges {1318912=598016,1916928=499712,2416640=753664,3170304=352256} 2021-07-26T15:57:42.219 INFO:tasks.rados.rados.0.smithi033.stdout:367: writing smithi03339061-25 from 1318912 to 1916928 tid 1 2021-07-26T15:57:42.223 INFO:tasks.rados.rados.0.smithi033.stdout:367: writing smithi03339061-25 from 1916928 to 2416640 tid 2 2021-07-26T15:57:42.228 INFO:tasks.rados.rados.0.smithi033.stdout:367: writing smithi03339061-25 from 2416640 to 3170304 tid 3 2021-07-26T15:57:42.231 INFO:tasks.rados.rados.0.smithi033.stdout:367: writing smithi03339061-25 from 3170304 to 3522560 tid 4 2021-07-26T15:57:42.231 INFO:tasks.rados.rados.0.smithi033.stdout:361: finishing rollback tid 0 to smithi03339061-22 2021-07-26T15:57:42.232 INFO:tasks.rados.rados.0.smithi033.stdout:361: finishing rollback tid 1 to smithi03339061-22 2021-07-26T15:57:42.232 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 199 (ObjNum 2006491504 snap 22002 seq_num 1257811808) dirty dne 2021-07-26T15:57:42.232 INFO:tasks.rados.rados.0.smithi033.stdout:362: expect (ObjNum 107 snap 19 seq_num 107) 2021-07-26T15:57:42.312 INFO:tasks.rados.rados.0.smithi033.stdout:363: expect (ObjNum 121 snap 27 seq_num 121) 2021-07-26T15:57:42.378 INFO:tasks.rados.rados.0.smithi033.stdout:365: expect (ObjNum 115 snap 26 seq_num 115) 2021-07-26T15:57:42.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[19094]: cluster 2021-07-26T15:57:40.661424+0000 mgr.y (mgr.14712) 5 : cluster [DBG] pgmap v9: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:42.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[19094]: cluster 2021-07-26T15:57:41.097591+0000 mon.a (mon.0) 820 : cluster [DBG] mgrmap e25: y(active, since 5s), standbys: x 2021-07-26T15:57:42.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[19094]: cluster 2021-07-26T15:57:41.097690+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-07-26T15:57:42.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[19094]: audit 2021-07-26T15:57:41.098557+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-07-26T15:57:42.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[19094]: audit 2021-07-26T15:57:41.517240+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[19094]: audit 2021-07-26T15:57:41.534579+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[19094]: audit 2021-07-26T15:57:41.836063+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[19094]: audit 2021-07-26T15:57:41.842451+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[19094]: audit 2021-07-26T15:57:41.849836+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[19094]: audit 2021-07-26T15:57:41.856637+0000 mon.a (mon.0) 828 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:42.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[14790]: cluster 2021-07-26T15:57:40.661424+0000 mgr.y (mgr.14712) 5 : cluster [DBG] pgmap v9: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:42.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[14790]: cluster 2021-07-26T15:57:41.097591+0000 mon.a (mon.0) 820 : cluster [DBG] mgrmap e25: y(active, since 5s), standbys: x 2021-07-26T15:57:42.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[14790]: cluster 2021-07-26T15:57:41.097690+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-07-26T15:57:42.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[14790]: audit 2021-07-26T15:57:41.098557+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-07-26T15:57:42.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[14790]: audit 2021-07-26T15:57:41.517240+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[14790]: audit 2021-07-26T15:57:41.534579+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[14790]: audit 2021-07-26T15:57:41.836063+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[14790]: audit 2021-07-26T15:57:41.842451+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[14790]: audit 2021-07-26T15:57:41.849836+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:42 smithi033 bash[14790]: audit 2021-07-26T15:57:41.856637+0000 mon.a (mon.0) 828 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:42.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:42 smithi096 bash[15117]: cluster 2021-07-26T15:57:40.661424+0000 mgr.y (mgr.14712) 5 : cluster [DBG] pgmap v9: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:42.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:42 smithi096 bash[15117]: cluster 2021-07-26T15:57:41.097591+0000 mon.a (mon.0) 820 : cluster [DBG] mgrmap e25: y(active, since 5s), standbys: x 2021-07-26T15:57:42.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:42 smithi096 bash[15117]: cluster 2021-07-26T15:57:41.097690+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-07-26T15:57:42.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:42 smithi096 bash[15117]: audit 2021-07-26T15:57:41.098557+0000 mon.a (mon.0) 822 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-07-26T15:57:42.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:42 smithi096 bash[15117]: audit 2021-07-26T15:57:41.517240+0000 mon.a (mon.0) 823 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:42 smithi096 bash[15117]: audit 2021-07-26T15:57:41.534579+0000 mon.a (mon.0) 824 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:42 smithi096 bash[15117]: audit 2021-07-26T15:57:41.836063+0000 mon.a (mon.0) 825 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:42 smithi096 bash[15117]: audit 2021-07-26T15:57:41.842451+0000 mon.a (mon.0) 826 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:42 smithi096 bash[15117]: audit 2021-07-26T15:57:41.849836+0000 mon.a (mon.0) 827 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:42.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:42 smithi096 bash[15117]: audit 2021-07-26T15:57:41.856637+0000 mon.a (mon.0) 828 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:42.614 INFO:tasks.rados.rados.0.smithi033.stdout:367: finishing write tid 1 to smithi03339061-25 2021-07-26T15:57:42.614 INFO:tasks.rados.rados.0.smithi033.stdout:367: finishing write tid 2 to smithi03339061-25 2021-07-26T15:57:42.614 INFO:tasks.rados.rados.0.smithi033.stdout:367: finishing write tid 3 to smithi03339061-25 2021-07-26T15:57:42.615 INFO:tasks.rados.rados.0.smithi033.stdout:367: finishing write tid 4 to smithi03339061-25 2021-07-26T15:57:42.615 INFO:tasks.rados.rados.0.smithi033.stdout:367: finishing write tid 5 to smithi03339061-25 2021-07-26T15:57:42.615 INFO:tasks.rados.rados.0.smithi033.stdout:367: finishing write tid 6 to smithi03339061-25 2021-07-26T15:57:42.615 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 94 (ObjNum 131 snap 33 seq_num 131) dirty exists 2021-07-26T15:57:42.616 INFO:tasks.rados.rados.0.smithi033.stdout:367: left oid 25 (ObjNum 131 snap 33 seq_num 131) 2021-07-26T15:57:42.616 INFO:tasks.rados.rados.0.smithi033.stdout:360: done (5 left) 2021-07-26T15:57:42.616 INFO:tasks.rados.rados.0.smithi033.stdout:361: done (4 left) 2021-07-26T15:57:42.616 INFO:tasks.rados.rados.0.smithi033.stdout:362: done (3 left) 2021-07-26T15:57:42.616 INFO:tasks.rados.rados.0.smithi033.stdout:363: done (2 left) 2021-07-26T15:57:42.617 INFO:tasks.rados.rados.0.smithi033.stdout:365: done (1 left) 2021-07-26T15:57:42.617 INFO:tasks.rados.rados.0.smithi033.stdout:367: done (0 left) 2021-07-26T15:57:42.617 INFO:tasks.rados.rados.0.smithi033.stdout:368: delete oid 47 current snap is 33 2021-07-26T15:57:42.618 INFO:tasks.rados.rados.0.smithi033.stdout:368: done (0 left) 2021-07-26T15:57:42.618 INFO:tasks.rados.rados.0.smithi033.stdout:369: rollback oid 29 current snap is 33 2021-07-26T15:57:42.618 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 22 2021-07-26T15:57:42.619 INFO:tasks.rados.rados.0.smithi033.stdout:370: rmattr oid 34 current snap is 33 2021-07-26T15:57:42.619 INFO:tasks.rados.rados.0.smithi033.stdout:371: snap_remove snap 24 2021-07-26T15:57:43.229 INFO:tasks.rados.rados.0.smithi033.stdout:369: finishing rollback tid 1 to smithi03339061-29 2021-07-26T15:57:43.229 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 0 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T15:57:43.230 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 37 (ObjNum 45 snap 0 seq_num 45) dirty exists 2021-07-26T15:57:43.230 INFO:tasks.rados.rados.0.smithi033.stdout:369: done (2 left) 2021-07-26T15:57:43.230 INFO:tasks.rados.rados.0.smithi033.stdout:370: done (1 left) 2021-07-26T15:57:43.230 INFO:tasks.rados.rados.0.smithi033.stdout:371: done (0 left) 2021-07-26T15:57:43.231 INFO:tasks.rados.rados.0.smithi033.stdout:372: read oid 44 snap -1 2021-07-26T15:57:43.231 INFO:tasks.rados.rados.0.smithi033.stdout:372: expect deleted 2021-07-26T15:57:43.231 INFO:tasks.rados.rados.0.smithi033.stdout:373: copy_from oid 13 from oid 32 current snap is 33 2021-07-26T15:57:43.231 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 33 2021-07-26T15:57:43.231 INFO:tasks.rados.rados.0.smithi033.stdout:374: seq_num 133 ranges {2277376=630784,2908160=663552,3571712=770048,4341760=172032} 2021-07-26T15:57:43.247 INFO:tasks.rados.rados.0.smithi033.stdout:374: writing smithi03339061-27 from 2277376 to 2908160 tid 1 2021-07-26T15:57:43.250 INFO:tasks.rados.rados.0.smithi033.stdout:374: writing smithi03339061-27 from 2908160 to 3571712 tid 2 2021-07-26T15:57:43.255 INFO:tasks.rados.rados.0.smithi033.stdout:374: writing smithi03339061-27 from 3571712 to 4341760 tid 3 2021-07-26T15:57:43.257 INFO:tasks.rados.rados.0.smithi033.stdout:374: writing smithi03339061-27 from 4341760 to 4513792 tid 4 2021-07-26T15:57:43.257 INFO:tasks.rados.rados.0.smithi033.stdout:375: copy_from oid 5 from oid 22 current snap is 33 2021-07-26T15:57:43.258 INFO:tasks.rados.rados.0.smithi033.stdout:373: finishing copy_from to smithi03339061-13 2021-07-26T15:57:43.258 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 2 (ObjNum 16 snap 0 seq_num 16) dirty exists 2021-07-26T15:57:43.258 INFO:tasks.rados.rados.0.smithi033.stdout:373: finishing copy_from racing read to smithi03339061-13 2021-07-26T15:57:43.258 INFO:tasks.rados.rados.0.smithi033.stdout:374: finishing write tid 1 to smithi03339061-27 2021-07-26T15:57:43.259 INFO:tasks.rados.rados.0.smithi033.stdout:374: finishing write tid 2 to smithi03339061-27 2021-07-26T15:57:43.259 INFO:tasks.rados.rados.0.smithi033.stdout:372: done (3 left) 2021-07-26T15:57:43.259 INFO:tasks.rados.rados.0.smithi033.stdout:373: done (2 left) 2021-07-26T15:57:43.259 INFO:tasks.rados.rados.0.smithi033.stdout:376: snap_create 2021-07-26T15:57:43.260 INFO:tasks.rados.rados.0.smithi033.stdout:375: finishing copy_from to smithi03339061-5 2021-07-26T15:57:43.260 INFO:tasks.rados.rados.0.smithi033.stdout:375: got expected ENOENT (src dne) 2021-07-26T15:57:43.261 INFO:tasks.rados.rados.0.smithi033.stdout:375: finishing copy_from racing read to smithi03339061-5 2021-07-26T15:57:43.261 INFO:tasks.rados.rados.0.smithi033.stdout:374: finishing write tid 3 to smithi03339061-27 2021-07-26T15:57:43.261 INFO:tasks.rados.rados.0.smithi033.stdout:374: finishing write tid 4 to smithi03339061-27 2021-07-26T15:57:43.261 INFO:tasks.rados.rados.0.smithi033.stdout:374: finishing write tid 5 to smithi03339061-27 2021-07-26T15:57:43.262 INFO:tasks.rados.rados.0.smithi033.stdout:374: finishing write tid 6 to smithi03339061-27 2021-07-26T15:57:43.262 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 156 (ObjNum 133 snap 33 seq_num 133) dirty exists 2021-07-26T15:57:43.262 INFO:tasks.rados.rados.0.smithi033.stdout:374: left oid 27 (ObjNum 133 snap 33 seq_num 133) 2021-07-26T15:57:43.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[19094]: cephadm 2021-07-26T15:57:41.767651+0000 mgr.y (mgr.14712) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:57:43.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[19094]: cephadm 2021-07-26T15:57:41.776604+0000 mgr.y (mgr.14712) 7 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:57:43.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[19094]: cephadm 2021-07-26T15:57:41.793043+0000 mgr.y (mgr.14712) 8 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:43.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[19094]: cephadm 2021-07-26T15:57:41.799023+0000 mgr.y (mgr.14712) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:43.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[19094]: cluster 2021-07-26T15:57:42.096115+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-07-26T15:57:43.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[19094]: cluster 2021-07-26T15:57:42.201066+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-07-26T15:57:43.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[14790]: cephadm 2021-07-26T15:57:41.767651+0000 mgr.y (mgr.14712) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:57:43.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[14790]: cephadm 2021-07-26T15:57:41.776604+0000 mgr.y (mgr.14712) 7 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:57:43.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[14790]: cephadm 2021-07-26T15:57:41.793043+0000 mgr.y (mgr.14712) 8 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:43.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[14790]: cephadm 2021-07-26T15:57:41.799023+0000 mgr.y (mgr.14712) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:43.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[14790]: cluster 2021-07-26T15:57:42.096115+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-07-26T15:57:43.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[14790]: cluster 2021-07-26T15:57:42.201066+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-07-26T15:57:43.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:43 smithi096 bash[15117]: cephadm 2021-07-26T15:57:41.767651+0000 mgr.y (mgr.14712) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:57:43.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:43 smithi096 bash[15117]: cephadm 2021-07-26T15:57:41.776604+0000 mgr.y (mgr.14712) 7 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:57:43.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:43 smithi096 bash[15117]: cephadm 2021-07-26T15:57:41.793043+0000 mgr.y (mgr.14712) 8 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:43.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:43 smithi096 bash[15117]: cephadm 2021-07-26T15:57:41.799023+0000 mgr.y (mgr.14712) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:57:43.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:43 smithi096 bash[15117]: cluster 2021-07-26T15:57:42.096115+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-07-26T15:57:43.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:43 smithi096 bash[15117]: cluster 2021-07-26T15:57:42.201066+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-07-26T15:57:43.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:43.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:57:43.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:43.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:57:43.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:43.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T15:57:44.235 INFO:tasks.rados.rados.0.smithi033.stdout:374: done (2 left) 2021-07-26T15:57:44.235 INFO:tasks.rados.rados.0.smithi033.stdout:375: done (1 left) 2021-07-26T15:57:44.235 INFO:tasks.rados.rados.0.smithi033.stdout:376: done (0 left) 2021-07-26T15:57:44.236 INFO:tasks.rados.rados.0.smithi033.stdout:377: read oid 36 snap -1 2021-07-26T15:57:44.236 INFO:tasks.rados.rados.0.smithi033.stdout:377: expect (ObjNum 1 snap 0 seq_num 1) 2021-07-26T15:57:44.236 INFO:tasks.rados.rados.0.smithi033.stdout:378: delete oid 21 current snap is 34 2021-07-26T15:57:44.243 INFO:tasks.rados.rados.0.smithi033.stdout:378: done (1 left) 2021-07-26T15:57:44.243 INFO:tasks.rados.rados.0.smithi033.stdout:379: rmattr oid 9 current snap is 34 2021-07-26T15:57:44.244 INFO:tasks.rados.rados.0.smithi033.stdout:379: done (1 left) 2021-07-26T15:57:44.244 INFO:tasks.rados.rados.0.smithi033.stdout:380: rmattr oid 32 current snap is 34 2021-07-26T15:57:44.244 INFO:tasks.rados.rados.0.smithi033.stdout:380: done (1 left) 2021-07-26T15:57:44.245 INFO:tasks.rados.rados.0.smithi033.stdout:381: rmattr oid 6 current snap is 34 2021-07-26T15:57:44.245 INFO:tasks.rados.rados.0.smithi033.stdout:381: done (1 left) 2021-07-26T15:57:44.246 INFO:tasks.rados.rados.0.smithi033.stdout:382: copy_from oid 15 from oid 19 current snap is 34 2021-07-26T15:57:44.246 INFO:tasks.rados.rados.0.smithi033.stdout:383: delete oid 3 current snap is 34 2021-07-26T15:57:44.247 INFO:tasks.rados.rados.0.smithi033.stdout:377: expect (ObjNum 1 snap 0 seq_num 1) 2021-07-26T15:57:44.249 INFO:tasks.rados.rados.0.smithi033.stdout:377: done (2 left) 2021-07-26T15:57:44.249 INFO:tasks.rados.rados.0.smithi033.stdout:383: done (1 left) 2021-07-26T15:57:44.250 INFO:tasks.rados.rados.0.smithi033.stdout:384: rollback oid 14 current snap is 34 2021-07-26T15:57:44.250 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 14 to 29 2021-07-26T15:57:44.251 INFO:tasks.rados.rados.0.smithi033.stdout:385: read oid 20 snap -1 2021-07-26T15:57:44.251 INFO:tasks.rados.rados.0.smithi033.stdout:385: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:57:44.251 INFO:tasks.rados.rados.0.smithi033.stdout:386: snap_remove snap 33 2021-07-26T15:57:44.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:44 smithi096 bash[15117]: cluster 2021-07-26T15:57:42.662140+0000 mgr.y (mgr.14712) 10 : cluster [DBG] pgmap v13: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:44.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:44 smithi096 bash[15117]: cluster 2021-07-26T15:57:43.224267+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-07-26T15:57:44.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:44 smithi033 bash[14790]: cluster 2021-07-26T15:57:42.662140+0000 mgr.y (mgr.14712) 10 : cluster [DBG] pgmap v13: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:44.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:44 smithi033 bash[14790]: cluster 2021-07-26T15:57:43.224267+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-07-26T15:57:44.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:44 smithi033 bash[19094]: cluster 2021-07-26T15:57:42.662140+0000 mgr.y (mgr.14712) 10 : cluster [DBG] pgmap v13: 25 pgs: 25 active+clean; 106 MiB data, 264 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:44.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:44 smithi033 bash[19094]: cluster 2021-07-26T15:57:43.224267+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-07-26T15:57:45.251 INFO:tasks.rados.rados.0.smithi033.stdout:386: done (3 left) 2021-07-26T15:57:45.251 INFO:tasks.rados.rados.0.smithi033.stdout:387: delete oid 4 current snap is 34 2021-07-26T15:57:45.252 INFO:tasks.rados.rados.0.smithi033.stdout:384: finishing rollback tid 0 to smithi03339061-14 2021-07-26T15:57:45.252 INFO:tasks.rados.rados.0.smithi033.stdout:384: finishing rollback tid 1 to smithi03339061-14 2021-07-26T15:57:45.252 INFO:tasks.rados.rados.0.smithi033.stdout:384: finishing rollback tid 2 to smithi03339061-14 2021-07-26T15:57:45.252 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 99 (ObjNum 13 snap 0 seq_num 13) dirty exists 2021-07-26T15:57:45.253 INFO:tasks.rados.rados.0.smithi033.stdout:385: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:57:45.270 INFO:tasks.rados.rados.0.smithi033.stdout:382: finishing copy_from to smithi03339061-15 2021-07-26T15:57:45.271 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 109 (ObjNum 127 snap 31 seq_num 127) dirty exists 2021-07-26T15:57:45.271 INFO:tasks.rados.rados.0.smithi033.stdout:382: finishing copy_from racing read to smithi03339061-15 2021-07-26T15:57:45.271 INFO:tasks.rados.rados.0.smithi033.stdout:382: done (3 left) 2021-07-26T15:57:45.272 INFO:tasks.rados.rados.0.smithi033.stdout:384: done (2 left) 2021-07-26T15:57:45.272 INFO:tasks.rados.rados.0.smithi033.stdout:385: done (1 left) 2021-07-26T15:57:45.272 INFO:tasks.rados.rados.0.smithi033.stdout:387: done (0 left) 2021-07-26T15:57:45.272 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 34 2021-07-26T15:57:45.272 INFO:tasks.rados.rados.0.smithi033.stdout:388: seq_num 137 ranges {3219456=704512,3923968=655360,4579328=753664,5332992=196608} 2021-07-26T15:57:45.297 INFO:tasks.rados.rados.0.smithi033.stdout:388: writing smithi03339061-12 from 3219456 to 3923968 tid 1 2021-07-26T15:57:45.300 INFO:tasks.rados.rados.0.smithi033.stdout:388: writing smithi03339061-12 from 3923968 to 4579328 tid 2 2021-07-26T15:57:45.305 INFO:tasks.rados.rados.0.smithi033.stdout:388: writing smithi03339061-12 from 4579328 to 5332992 tid 3 2021-07-26T15:57:45.306 INFO:tasks.rados.rados.0.smithi033.stdout:388: writing smithi03339061-12 from 5332992 to 5529600 tid 4 2021-07-26T15:57:45.307 INFO:tasks.rados.rados.0.smithi033.stdout:389: snap_remove snap 25 2021-07-26T15:57:45.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:45 smithi096 bash[15117]: cephadm 2021-07-26T15:57:44.215023+0000 mgr.y (mgr.14712) 11 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:57:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:45 smithi096 bash[15117]: audit 2021-07-26T15:57:44.216265+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:45 smithi096 bash[15117]: audit 2021-07-26T15:57:44.225090+0000 mon.a (mon.0) 833 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:57:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:45 smithi096 bash[15117]: cluster 2021-07-26T15:57:44.232593+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-07-26T15:57:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:45 smithi096 bash[15117]: audit 2021-07-26T15:57:44.233002+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:45 smithi096 bash[15117]: cephadm 2021-07-26T15:57:44.234426+0000 mgr.y (mgr.14712) 12 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:57:45.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[19094]: cephadm 2021-07-26T15:57:44.215023+0000 mgr.y (mgr.14712) 11 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:57:45.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[19094]: audit 2021-07-26T15:57:44.216265+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:45.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[19094]: audit 2021-07-26T15:57:44.225090+0000 mon.a (mon.0) 833 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:57:45.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[19094]: cluster 2021-07-26T15:57:44.232593+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-07-26T15:57:45.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[19094]: audit 2021-07-26T15:57:44.233002+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:45.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[19094]: cephadm 2021-07-26T15:57:44.234426+0000 mgr.y (mgr.14712) 12 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:57:45.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[14790]: cephadm 2021-07-26T15:57:44.215023+0000 mgr.y (mgr.14712) 11 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:57:45.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[14790]: audit 2021-07-26T15:57:44.216265+0000 mon.a (mon.0) 832 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:57:45.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[14790]: audit 2021-07-26T15:57:44.225090+0000 mon.a (mon.0) 833 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:57:45.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[14790]: cluster 2021-07-26T15:57:44.232593+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-07-26T15:57:45.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[14790]: audit 2021-07-26T15:57:44.233002+0000 mon.a (mon.0) 835 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:45.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:45 smithi033 bash[14790]: cephadm 2021-07-26T15:57:44.234426+0000 mgr.y (mgr.14712) 12 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:57:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:389: done (1 left) 2021-07-26T15:57:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:390: snap_remove snap 32 2021-07-26T15:57:46.517 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:46 smithi096 bash[15117]: cluster 2021-07-26T15:57:44.662881+0000 mgr.y (mgr.14712) 13 : cluster [DBG] pgmap v16: 25 pgs: 25 active+clean; 112 MiB data, 292 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2021-07-26T15:57:46.517 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:46 smithi096 bash[15117]: cluster 2021-07-26T15:57:45.244797+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-07-26T15:57:46.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:46 smithi033 bash[19094]: cluster 2021-07-26T15:57:44.662881+0000 mgr.y (mgr.14712) 13 : cluster [DBG] pgmap v16: 25 pgs: 25 active+clean; 112 MiB data, 292 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2021-07-26T15:57:46.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:46 smithi033 bash[19094]: cluster 2021-07-26T15:57:45.244797+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-07-26T15:57:46.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:46 smithi033 bash[14790]: cluster 2021-07-26T15:57:44.662881+0000 mgr.y (mgr.14712) 13 : cluster [DBG] pgmap v16: 25 pgs: 25 active+clean; 112 MiB data, 292 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.6 MiB/s wr, 26 op/s 2021-07-26T15:57:46.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:46 smithi033 bash[14790]: cluster 2021-07-26T15:57:45.244797+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-07-26T15:57:46.789 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:46 smithi096 systemd[1]: Stopping Ceph mgr.x for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T15:57:47.056 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:46 smithi096 docker[32488]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:57:47.208 INFO:tasks.rados.rados.0.smithi033.stdout:390: done (1 left) 2021-07-26T15:57:47.209 INFO:tasks.rados.rados.0.smithi033.stdout:391: snap_remove snap 31 2021-07-26T15:57:47.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:47 smithi096 bash[15117]: cluster 2021-07-26T15:57:46.255304+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-07-26T15:57:47.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:47 smithi096 bash[15117]: cluster 2021-07-26T15:57:47.204824+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-07-26T15:57:47.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:47 smithi033 bash[19094]: cluster 2021-07-26T15:57:46.255304+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-07-26T15:57:47.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:47 smithi033 bash[19094]: cluster 2021-07-26T15:57:47.204824+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-07-26T15:57:47.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:47 smithi033 bash[14790]: cluster 2021-07-26T15:57:46.255304+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-07-26T15:57:47.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:47 smithi033 bash[14790]: cluster 2021-07-26T15:57:47.204824+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-07-26T15:57:47.821 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:47 smithi096 docker[32488]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-mgr.x 2021-07-26T15:57:47.822 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:47 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.x.service: Main process exited, code=exited, status=143/n/a 2021-07-26T15:57:47.822 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:47 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mgr.x.service: Failed with result 'exit-code'. 2021-07-26T15:57:47.822 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:47 smithi096 systemd[1]: Stopped Ceph mgr.x for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:57:47.822 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:47 smithi096 systemd[1]: Started Ceph mgr.x for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:57:48.220 INFO:tasks.rados.rados.0.smithi033.stdout:391: done (1 left) 2021-07-26T15:57:48.220 INFO:tasks.rados.rados.0.smithi033.stdout:392: snap_remove snap 26 2021-07-26T15:57:48.237 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:47 smithi096 bash[32559]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:57:48.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[19094]: cluster 2021-07-26T15:57:46.663613+0000 mgr.y (mgr.14712) 14 : cluster [DBG] pgmap v19: 25 pgs: 25 active+clean; 112 MiB data, 292 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2021-07-26T15:57:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[19094]: audit 2021-07-26T15:57:47.856737+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[19094]: audit 2021-07-26T15:57:47.858593+0000 mon.a (mon.0) 840 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[19094]: audit 2021-07-26T15:57:47.861091+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[19094]: audit 2021-07-26T15:57:47.863408+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[19094]: cluster 2021-07-26T15:57:48.217802+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-07-26T15:57:48.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[14790]: cluster 2021-07-26T15:57:46.663613+0000 mgr.y (mgr.14712) 14 : cluster [DBG] pgmap v19: 25 pgs: 25 active+clean; 112 MiB data, 292 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2021-07-26T15:57:48.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[14790]: audit 2021-07-26T15:57:47.856737+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:48.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[14790]: audit 2021-07-26T15:57:47.858593+0000 mon.a (mon.0) 840 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:48.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[14790]: audit 2021-07-26T15:57:47.861091+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:48.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[14790]: audit 2021-07-26T15:57:47.863408+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:48.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:48 smithi033 bash[14790]: cluster 2021-07-26T15:57:48.217802+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-07-26T15:57:48.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:48 smithi096 bash[15117]: cluster 2021-07-26T15:57:46.663613+0000 mgr.y (mgr.14712) 14 : cluster [DBG] pgmap v19: 25 pgs: 25 active+clean; 112 MiB data, 292 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 1.4 MiB/s wr, 23 op/s 2021-07-26T15:57:48.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:48 smithi096 bash[15117]: audit 2021-07-26T15:57:47.856737+0000 mon.a (mon.0) 839 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:48.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:48 smithi096 bash[15117]: audit 2021-07-26T15:57:47.858593+0000 mon.a (mon.0) 840 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:48.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:48 smithi096 bash[15117]: audit 2021-07-26T15:57:47.861091+0000 mon.a (mon.0) 841 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:48.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:48 smithi096 bash[15117]: audit 2021-07-26T15:57:47.863408+0000 mon.a (mon.0) 842 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:57:48.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:48 smithi096 bash[15117]: cluster 2021-07-26T15:57:48.217802+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-07-26T15:57:49.224 INFO:tasks.rados.rados.0.smithi033.stdout:392: done (1 left) 2021-07-26T15:57:49.224 INFO:tasks.rados.rados.0.smithi033.stdout:393: setattr oid 21 current snap is 34 2021-07-26T15:57:49.225 INFO:tasks.rados.rados.0.smithi033.stdout:388: finishing write tid 1 to smithi03339061-12 2021-07-26T15:57:49.225 INFO:tasks.rados.rados.0.smithi033.stdout:388: finishing write tid 2 to smithi03339061-12 2021-07-26T15:57:49.225 INFO:tasks.rados.rados.0.smithi033.stdout:388: finishing write tid 3 to smithi03339061-12 2021-07-26T15:57:49.226 INFO:tasks.rados.rados.0.smithi033.stdout:388: finishing write tid 4 to smithi03339061-12 2021-07-26T15:57:49.226 INFO:tasks.rados.rados.0.smithi033.stdout:388: finishing write tid 5 to smithi03339061-12 2021-07-26T15:57:49.227 INFO:tasks.rados.rados.0.smithi033.stdout:388: finishing write tid 6 to smithi03339061-12 2021-07-26T15:57:49.227 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 90 (ObjNum 137 snap 34 seq_num 137) dirty exists 2021-07-26T15:57:49.228 INFO:tasks.rados.rados.0.smithi033.stdout:388: left oid 12 (ObjNum 137 snap 34 seq_num 137) 2021-07-26T15:57:49.229 INFO:tasks.rados.rados.0.smithi033.stdout:388: done (1 left) 2021-07-26T15:57:49.229 INFO:tasks.rados.rados.0.smithi033.stdout:394: read oid 27 snap -1 2021-07-26T15:57:49.229 INFO:tasks.rados.rados.0.smithi033.stdout:394: expect (ObjNum 133 snap 33 seq_num 133) 2021-07-26T15:57:49.229 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 34 2021-07-26T15:57:49.230 INFO:tasks.rados.rados.0.smithi033.stdout:395: seq_num 138 ranges {270336=720896,991232=540672,1531904=557056,2088960=507904} 2021-07-26T15:57:49.233 INFO:tasks.rados.rados.0.smithi033.stdout:395: writing smithi03339061-32 from 270336 to 991232 tid 1 2021-07-26T15:57:49.237 INFO:tasks.rados.rados.0.smithi033.stdout:395: writing smithi03339061-32 from 991232 to 1531904 tid 2 2021-07-26T15:57:49.241 INFO:tasks.rados.rados.0.smithi033.stdout:395: writing smithi03339061-32 from 1531904 to 2088960 tid 3 2021-07-26T15:57:49.245 INFO:tasks.rados.rados.0.smithi033.stdout:395: writing smithi03339061-32 from 2088960 to 2596864 tid 4 2021-07-26T15:57:49.245 INFO:tasks.rados.rados.0.smithi033.stdout:396: setattr oid 8 current snap is 34 2021-07-26T15:57:49.246 INFO:tasks.rados.rados.0.smithi033.stdout:395: finishing write tid 1 to smithi03339061-32 2021-07-26T15:57:49.246 INFO:tasks.rados.rados.0.smithi033.stdout:395: finishing write tid 2 to smithi03339061-32 2021-07-26T15:57:49.247 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 177 (ObjNum 1 snap 22002 seq_num 2007085728) dirty exists 2021-07-26T15:57:49.249 INFO:tasks.rados.rados.0.smithi033.stdout:393: done (3 left) 2021-07-26T15:57:49.249 INFO:tasks.rados.rados.0.smithi033.stdout:397: read oid 26 snap -1 2021-07-26T15:57:49.249 INFO:tasks.rados.rados.0.smithi033.stdout:397: expect (ObjNum 38 snap 0 seq_num 38) 2021-07-26T15:57:49.250 INFO:tasks.rados.rados.0.smithi033.stdout:398: copy_from oid 28 from oid 22 current snap is 34 2021-07-26T15:57:49.250 INFO:tasks.rados.rados.0.smithi033.stdout:399: snap_create 2021-07-26T15:57:49.250 INFO:tasks.rados.rados.0.smithi033.stdout:395: finishing write tid 3 to smithi03339061-32 2021-07-26T15:57:49.251 INFO:tasks.rados.rados.0.smithi033.stdout:395: finishing write tid 4 to smithi03339061-32 2021-07-26T15:57:49.251 INFO:tasks.rados.rados.0.smithi033.stdout:395: finishing write tid 5 to smithi03339061-32 2021-07-26T15:57:49.252 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 124 (ObjNum 16 snap 0 seq_num 16) dirty exists 2021-07-26T15:57:49.253 INFO:tasks.rados.rados.0.smithi033.stdout:395: finishing write tid 6 to smithi03339061-32 2021-07-26T15:57:49.254 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 116 (ObjNum 138 snap 34 seq_num 138) dirty exists 2021-07-26T15:57:49.254 INFO:tasks.rados.rados.0.smithi033.stdout:395: left oid 32 (ObjNum 138 snap 34 seq_num 138) 2021-07-26T15:57:49.257 INFO:tasks.rados.rados.0.smithi033.stdout:397: expect (ObjNum 38 snap 0 seq_num 38) 2021-07-26T15:57:49.280 INFO:tasks.rados.rados.0.smithi033.stdout:394: expect (ObjNum 133 snap 33 seq_num 133) 2021-07-26T15:57:49.445 INFO:tasks.rados.rados.0.smithi033.stdout:398: finishing copy_from to smithi03339061-28 2021-07-26T15:57:49.446 INFO:tasks.rados.rados.0.smithi033.stdout:398: got expected ENOENT (src dne) 2021-07-26T15:57:49.446 INFO:tasks.rados.rados.0.smithi033.stdout:398: finishing copy_from racing read to smithi03339061-28 2021-07-26T15:57:49.488 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:49 smithi096 bash[32559]: debug 2021-07-26T15:57:49.231+0000 7f504c718700 1 -- 172.21.15.96:0/2264855500 <== mon.2 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d588565080 con 0x55d589244400 2021-07-26T15:57:49.489 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:57:49 smithi096 bash[32559]: debug 2021-07-26T15:57:49.231+0000 7f504c718700 1 -- 172.21.15.96:0/2264855500 <== mon.2 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d5884d2340 con 0x55d589244400 2021-07-26T15:57:50.224 INFO:tasks.rados.rados.0.smithi033.stdout:394: done (5 left) 2021-07-26T15:57:50.224 INFO:tasks.rados.rados.0.smithi033.stdout:395: done (4 left) 2021-07-26T15:57:50.224 INFO:tasks.rados.rados.0.smithi033.stdout:396: done (3 left) 2021-07-26T15:57:50.224 INFO:tasks.rados.rados.0.smithi033.stdout:397: done (2 left) 2021-07-26T15:57:50.225 INFO:tasks.rados.rados.0.smithi033.stdout:398: done (1 left) 2021-07-26T15:57:50.225 INFO:tasks.rados.rados.0.smithi033.stdout:399: done (0 left) 2021-07-26T15:57:50.225 INFO:tasks.rados.rados.0.smithi033.stdout:400: delete oid 4 current snap is 35 2021-07-26T15:57:50.227 INFO:tasks.rados.rados.0.smithi033.stdout:400: done (0 left) 2021-07-26T15:57:50.227 INFO:tasks.rados.rados.0.smithi033.stdout:401: snap_create 2021-07-26T15:57:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:50 smithi096 bash[15117]: cluster 2021-07-26T15:57:48.664338+0000 mgr.y (mgr.14712) 15 : cluster [DBG] pgmap v22: 25 pgs: 25 active+clean; 120 MiB data, 314 MiB used, 715 GiB / 715 GiB avail; 529 KiB/s rd, 2.2 MiB/s wr, 7 op/s 2021-07-26T15:57:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:50 smithi096 bash[15117]: cluster 2021-07-26T15:57:49.220826+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-07-26T15:57:50.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:50 smithi033 bash[14790]: cluster 2021-07-26T15:57:48.664338+0000 mgr.y (mgr.14712) 15 : cluster [DBG] pgmap v22: 25 pgs: 25 active+clean; 120 MiB data, 314 MiB used, 715 GiB / 715 GiB avail; 529 KiB/s rd, 2.2 MiB/s wr, 7 op/s 2021-07-26T15:57:50.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:50 smithi033 bash[14790]: cluster 2021-07-26T15:57:49.220826+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-07-26T15:57:50.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:50 smithi033 bash[19094]: cluster 2021-07-26T15:57:48.664338+0000 mgr.y (mgr.14712) 15 : cluster [DBG] pgmap v22: 25 pgs: 25 active+clean; 120 MiB data, 314 MiB used, 715 GiB / 715 GiB avail; 529 KiB/s rd, 2.2 MiB/s wr, 7 op/s 2021-07-26T15:57:50.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:50 smithi033 bash[19094]: cluster 2021-07-26T15:57:49.220826+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-07-26T15:57:51.235 INFO:tasks.rados.rados.0.smithi033.stdout:401: done (0 left) 2021-07-26T15:57:51.235 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 36 2021-07-26T15:57:51.235 INFO:tasks.rados.rados.0.smithi033.stdout:402: seq_num 140 ranges {0=753664,753664=704512,1458176=524288,1982464=376832} 2021-07-26T15:57:51.241 INFO:tasks.rados.rados.0.smithi033.stdout:402: writing smithi03339061-28 from 0 to 753664 tid 1 2021-07-26T15:57:51.247 INFO:tasks.rados.rados.0.smithi033.stdout:402: writing smithi03339061-28 from 753664 to 1458176 tid 2 2021-07-26T15:57:51.250 INFO:tasks.rados.rados.0.smithi033.stdout:402: writing smithi03339061-28 from 1458176 to 1982464 tid 3 2021-07-26T15:57:51.253 INFO:tasks.rados.rados.0.smithi033.stdout:402: writing smithi03339061-28 from 1982464 to 2359296 tid 4 2021-07-26T15:57:51.253 INFO:tasks.rados.rados.0.smithi033.stdout:403: rollback oid 34 current snap is 36 2021-07-26T15:57:51.253 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 34 to 35 2021-07-26T15:57:51.253 INFO:tasks.rados.rados.0.smithi033.stdout:404: delete oid 8 current snap is 36 2021-07-26T15:57:51.255 INFO:tasks.rados.rados.0.smithi033.stdout:402: finishing write tid 1 to smithi03339061-28 2021-07-26T15:57:51.256 INFO:tasks.rados.rados.0.smithi033.stdout:402: finishing write tid 2 to smithi03339061-28 2021-07-26T15:57:51.257 INFO:tasks.rados.rados.0.smithi033.stdout:402: finishing write tid 3 to smithi03339061-28 2021-07-26T15:57:51.259 INFO:tasks.rados.rados.0.smithi033.stdout:402: finishing write tid 4 to smithi03339061-28 2021-07-26T15:57:51.260 INFO:tasks.rados.rados.0.smithi033.stdout:404: done (2 left) 2021-07-26T15:57:51.260 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 36 2021-07-26T15:57:51.260 INFO:tasks.rados.rados.0.smithi033.stdout:405: seq_num 142 ranges {0=786432,786432=475136,1261568=540672,1802240=589824} 2021-07-26T15:57:51.267 INFO:tasks.rados.rados.0.smithi033.stdout:405: writing smithi03339061-47 from 0 to 786432 tid 1 2021-07-26T15:57:51.270 INFO:tasks.rados.rados.0.smithi033.stdout:405: writing smithi03339061-47 from 786432 to 1261568 tid 2 2021-07-26T15:57:51.274 INFO:tasks.rados.rados.0.smithi033.stdout:405: writing smithi03339061-47 from 1261568 to 1802240 tid 3 2021-07-26T15:57:51.279 INFO:tasks.rados.rados.0.smithi033.stdout:405: writing smithi03339061-47 from 1802240 to 2392064 tid 4 2021-07-26T15:57:51.279 INFO:tasks.rados.rados.0.smithi033.stdout:406: snap_create 2021-07-26T15:57:51.279 INFO:tasks.rados.rados.0.smithi033.stdout:403: finishing rollback tid 0 to smithi03339061-34 2021-07-26T15:57:51.280 INFO:tasks.rados.rados.0.smithi033.stdout:402: finishing write tid 5 to smithi03339061-28 2021-07-26T15:57:51.280 INFO:tasks.rados.rados.0.smithi033.stdout:403: finishing rollback tid 1 to smithi03339061-34 2021-07-26T15:57:51.280 INFO:tasks.rados.rados.0.smithi033.stdout:403: finishing rollback tid 2 to smithi03339061-34 2021-07-26T15:57:51.280 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 51 (ObjNum 45 snap 0 seq_num 45) dirty exists 2021-07-26T15:57:51.281 INFO:tasks.rados.rados.0.smithi033.stdout:402: finishing write tid 6 to smithi03339061-28 2021-07-26T15:57:51.281 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 109 (ObjNum 140 snap 36 seq_num 140) dirty exists 2021-07-26T15:57:51.281 INFO:tasks.rados.rados.0.smithi033.stdout:402: left oid 28 (ObjNum 140 snap 36 seq_num 140) 2021-07-26T15:57:51.281 INFO:tasks.rados.rados.0.smithi033.stdout:405: finishing write tid 1 to smithi03339061-47 2021-07-26T15:57:51.282 INFO:tasks.rados.rados.0.smithi033.stdout:405: finishing write tid 2 to smithi03339061-47 2021-07-26T15:57:51.282 INFO:tasks.rados.rados.0.smithi033.stdout:405: finishing write tid 3 to smithi03339061-47 2021-07-26T15:57:51.283 INFO:tasks.rados.rados.0.smithi033.stdout:405: finishing write tid 4 to smithi03339061-47 2021-07-26T15:57:51.283 INFO:tasks.rados.rados.0.smithi033.stdout:405: finishing write tid 5 to smithi03339061-47 2021-07-26T15:57:51.285 INFO:tasks.rados.rados.0.smithi033.stdout:405: finishing write tid 6 to smithi03339061-47 2021-07-26T15:57:51.285 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 96 (ObjNum 142 snap 36 seq_num 142) dirty exists 2021-07-26T15:57:51.285 INFO:tasks.rados.rados.0.smithi033.stdout:405: left oid 47 (ObjNum 142 snap 36 seq_num 142) 2021-07-26T15:57:51.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:51 smithi033 bash[14790]: cluster 2021-07-26T15:57:50.221075+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-07-26T15:57:51.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:51 smithi033 bash[19094]: cluster 2021-07-26T15:57:50.221075+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-07-26T15:57:51.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:51 smithi096 bash[15117]: cluster 2021-07-26T15:57:50.221075+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-07-26T15:57:52.211 INFO:tasks.rados.rados.0.smithi033.stdout:402: done (3 left) 2021-07-26T15:57:52.212 INFO:tasks.rados.rados.0.smithi033.stdout:403: done (2 left) 2021-07-26T15:57:52.212 INFO:tasks.rados.rados.0.smithi033.stdout:405: done (1 left) 2021-07-26T15:57:52.212 INFO:tasks.rados.rados.0.smithi033.stdout:406: done (0 left) 2021-07-26T15:57:52.212 INFO:tasks.rados.rados.0.smithi033.stdout:407: read oid 45 snap -1 2021-07-26T15:57:52.212 INFO:tasks.rados.rados.0.smithi033.stdout:407: expect (ObjNum 79 snap 13 seq_num 79) 2021-07-26T15:57:52.213 INFO:tasks.rados.rados.0.smithi033.stdout:408: rmattr oid 18 current snap is 37 2021-07-26T15:57:52.213 INFO:tasks.rados.rados.0.smithi033.stdout:408: done (1 left) 2021-07-26T15:57:52.213 INFO:tasks.rados.rados.0.smithi033.stdout:409: read oid 28 snap -1 2021-07-26T15:57:52.213 INFO:tasks.rados.rados.0.smithi033.stdout:409: expect (ObjNum 140 snap 36 seq_num 140) 2021-07-26T15:57:52.213 INFO:tasks.rados.rados.0.smithi033.stdout:410: copy_from oid 19 from oid 20 current snap is 37 2021-07-26T15:57:52.214 INFO:tasks.rados.rados.0.smithi033.stdout:411: rmattr oid 26 current snap is 37 2021-07-26T15:57:52.214 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 37 2021-07-26T15:57:52.214 INFO:tasks.rados.rados.0.smithi033.stdout:412: seq_num 143 ranges {253952=802816,1056768=761856,1818624=745472,2564096=98304} 2021-07-26T15:57:52.218 INFO:tasks.rados.rados.0.smithi033.stdout:412: writing smithi03339061-23 from 253952 to 1056768 tid 1 2021-07-26T15:57:52.223 INFO:tasks.rados.rados.0.smithi033.stdout:412: writing smithi03339061-23 from 1056768 to 1818624 tid 2 2021-07-26T15:57:52.228 INFO:tasks.rados.rados.0.smithi033.stdout:412: writing smithi03339061-23 from 1818624 to 2564096 tid 3 2021-07-26T15:57:52.229 INFO:tasks.rados.rados.0.smithi033.stdout:412: writing smithi03339061-23 from 2564096 to 2662400 tid 4 2021-07-26T15:57:52.229 INFO:tasks.rados.rados.0.smithi033.stdout:413: delete oid 42 current snap is 37 2021-07-26T15:57:52.229 INFO:tasks.rados.rados.0.smithi033.stdout:410: finishing copy_from to smithi03339061-19 2021-07-26T15:57:52.230 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 4 (ObjNum 41 snap 0 seq_num 41) dirty exists 2021-07-26T15:57:52.230 INFO:tasks.rados.rados.0.smithi033.stdout:410: finishing copy_from racing read to smithi03339061-19 2021-07-26T15:57:52.230 INFO:tasks.rados.rados.0.smithi033.stdout:412: finishing write tid 1 to smithi03339061-23 2021-07-26T15:57:52.231 INFO:tasks.rados.rados.0.smithi033.stdout:407: expect (ObjNum 79 snap 13 seq_num 79) 2021-07-26T15:57:52.360 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 253 (ObjNum 38 snap 0 seq_num 38) dirty exists 2021-07-26T15:57:52.361 INFO:tasks.rados.rados.0.smithi033.stdout:409: expect (ObjNum 140 snap 36 seq_num 140) 2021-07-26T15:57:52.423 INFO:tasks.rados.rados.0.smithi033.stdout:412: finishing write tid 2 to smithi03339061-23 2021-07-26T15:57:52.424 INFO:tasks.rados.rados.0.smithi033.stdout:412: finishing write tid 3 to smithi03339061-23 2021-07-26T15:57:52.424 INFO:tasks.rados.rados.0.smithi033.stdout:412: finishing write tid 4 to smithi03339061-23 2021-07-26T15:57:52.424 INFO:tasks.rados.rados.0.smithi033.stdout:412: finishing write tid 5 to smithi03339061-23 2021-07-26T15:57:52.424 INFO:tasks.rados.rados.0.smithi033.stdout:412: finishing write tid 6 to smithi03339061-23 2021-07-26T15:57:52.425 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 191 (ObjNum 143 snap 37 seq_num 143) dirty exists 2021-07-26T15:57:52.425 INFO:tasks.rados.rados.0.smithi033.stdout:412: left oid 23 (ObjNum 143 snap 37 seq_num 143) 2021-07-26T15:57:52.425 INFO:tasks.rados.rados.0.smithi033.stdout:407: done (5 left) 2021-07-26T15:57:52.425 INFO:tasks.rados.rados.0.smithi033.stdout:409: done (4 left) 2021-07-26T15:57:52.425 INFO:tasks.rados.rados.0.smithi033.stdout:410: done (3 left) 2021-07-26T15:57:52.426 INFO:tasks.rados.rados.0.smithi033.stdout:411: done (2 left) 2021-07-26T15:57:52.426 INFO:tasks.rados.rados.0.smithi033.stdout:412: done (1 left) 2021-07-26T15:57:52.426 INFO:tasks.rados.rados.0.smithi033.stdout:413: done (0 left) 2021-07-26T15:57:52.426 INFO:tasks.rados.rados.0.smithi033.stdout:414: delete oid 47 current snap is 37 2021-07-26T15:57:52.427 INFO:tasks.rados.rados.0.smithi033.stdout:414: done (0 left) 2021-07-26T15:57:52.428 INFO:tasks.rados.rados.0.smithi033.stdout:415: read oid 33 snap 36 2021-07-26T15:57:52.428 INFO:tasks.rados.rados.0.smithi033.stdout:415: expect (ObjNum 130 snap 32 seq_num 130) 2021-07-26T15:57:52.428 INFO:tasks.rados.rados.0.smithi033.stdout:416: setattr oid 15 current snap is 37 2021-07-26T15:57:52.429 INFO:tasks.rados.rados.0.smithi033.stdout:417: setattr oid 29 current snap is 37 2021-07-26T15:57:52.431 INFO:tasks.rados.rados.0.smithi033.stdout:418: delete oid 34 current snap is 37 2021-07-26T15:57:52.434 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 19 (ObjNum 1332374358 snap 1735615597 seq_num 1819107163) dirty exists 2021-07-26T15:57:52.436 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 113 (ObjNum 127 snap 31 seq_num 127) dirty exists 2021-07-26T15:57:52.437 INFO:tasks.rados.rados.0.smithi033.stdout:416: done (3 left) 2021-07-26T15:57:52.438 INFO:tasks.rados.rados.0.smithi033.stdout:417: done (2 left) 2021-07-26T15:57:52.438 INFO:tasks.rados.rados.0.smithi033.stdout:418: done (1 left) 2021-07-26T15:57:52.438 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 37 2021-07-26T15:57:52.438 INFO:tasks.rados.rados.0.smithi033.stdout:419: seq_num 147 ranges {2359296=65536} 2021-07-26T15:57:52.455 INFO:tasks.rados.rados.0.smithi033.stdout:419: writing smithi03339061-28 from 2359296 to 2424832 tid 1 2021-07-26T15:57:52.455 INFO:tasks.rados.rados.0.smithi033.stdout:420: snap_remove snap 35 2021-07-26T15:57:52.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:52 smithi033 bash[14790]: cluster 2021-07-26T15:57:50.665079+0000 mgr.y (mgr.14712) 16 : cluster [DBG] pgmap v25: 25 pgs: 25 active+clean; 120 MiB data, 314 MiB used, 715 GiB / 715 GiB avail; 529 KiB/s rd, 2.2 MiB/s wr, 7 op/s 2021-07-26T15:57:52.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:52 smithi033 bash[14790]: cluster 2021-07-26T15:57:51.232539+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-07-26T15:57:52.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:52 smithi033 bash[14790]: cluster 2021-07-26T15:57:52.208002+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-07-26T15:57:52.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:52 smithi033 bash[19094]: cluster 2021-07-26T15:57:50.665079+0000 mgr.y (mgr.14712) 16 : cluster [DBG] pgmap v25: 25 pgs: 25 active+clean; 120 MiB data, 314 MiB used, 715 GiB / 715 GiB avail; 529 KiB/s rd, 2.2 MiB/s wr, 7 op/s 2021-07-26T15:57:52.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:52 smithi033 bash[19094]: cluster 2021-07-26T15:57:51.232539+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-07-26T15:57:52.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:52 smithi033 bash[19094]: cluster 2021-07-26T15:57:52.208002+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-07-26T15:57:52.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:52 smithi096 bash[15117]: cluster 2021-07-26T15:57:50.665079+0000 mgr.y (mgr.14712) 16 : cluster [DBG] pgmap v25: 25 pgs: 25 active+clean; 120 MiB data, 314 MiB used, 715 GiB / 715 GiB avail; 529 KiB/s rd, 2.2 MiB/s wr, 7 op/s 2021-07-26T15:57:52.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:52 smithi096 bash[15117]: cluster 2021-07-26T15:57:51.232539+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-07-26T15:57:52.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:52 smithi096 bash[15117]: cluster 2021-07-26T15:57:52.208002+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-07-26T15:57:53.262 INFO:tasks.rados.rados.0.smithi033.stdout:420: done (2 left) 2021-07-26T15:57:53.262 INFO:tasks.rados.rados.0.smithi033.stdout:421: delete oid 13 current snap is 37 2021-07-26T15:57:53.263 INFO:tasks.rados.rados.0.smithi033.stdout:415: expect (ObjNum 130 snap 32 seq_num 130) 2021-07-26T15:57:53.422 INFO:tasks.rados.rados.0.smithi033.stdout:419: finishing write tid 1 to smithi03339061-28 2021-07-26T15:57:53.423 INFO:tasks.rados.rados.0.smithi033.stdout:419: finishing write tid 2 to smithi03339061-28 2021-07-26T15:57:53.423 INFO:tasks.rados.rados.0.smithi033.stdout:419: finishing write tid 3 to smithi03339061-28 2021-07-26T15:57:53.423 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 112 (ObjNum 147 snap 37 seq_num 147) dirty exists 2021-07-26T15:57:53.423 INFO:tasks.rados.rados.0.smithi033.stdout:419: left oid 28 (ObjNum 147 snap 37 seq_num 147) 2021-07-26T15:57:53.423 INFO:tasks.rados.rados.0.smithi033.stdout:415: done (2 left) 2021-07-26T15:57:53.424 INFO:tasks.rados.rados.0.smithi033.stdout:419: done (1 left) 2021-07-26T15:57:53.424 INFO:tasks.rados.rados.0.smithi033.stdout:421: done (0 left) 2021-07-26T15:57:53.424 INFO:tasks.rados.rados.0.smithi033.stdout:422: rollback oid 9 current snap is 37 2021-07-26T15:57:53.424 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 9 to 36 2021-07-26T15:57:53.425 INFO:tasks.rados.rados.0.smithi033.stdout:423: read oid 11 snap 29 2021-07-26T15:57:53.425 INFO:tasks.rados.rados.0.smithi033.stdout:423: expect (ObjNum 15 snap 0 seq_num 15) 2021-07-26T15:57:53.425 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 37 2021-07-26T15:57:53.425 INFO:tasks.rados.rados.0.smithi033.stdout:424: seq_num 149 ranges {2662400=98304} 2021-07-26T15:57:53.446 INFO:tasks.rados.rados.0.smithi033.stdout:424: writing smithi03339061-23 from 2662400 to 2760704 tid 1 2021-07-26T15:57:53.446 INFO:tasks.rados.rados.0.smithi033.stdout:425: delete oid 7 current snap is 37 2021-07-26T15:57:53.446 INFO:tasks.rados.rados.0.smithi033.stdout:422: finishing rollback tid 0 to smithi03339061-9 2021-07-26T15:57:53.447 INFO:tasks.rados.rados.0.smithi033.stdout:422: finishing rollback tid 1 to smithi03339061-9 2021-07-26T15:57:53.447 INFO:tasks.rados.rados.0.smithi033.stdout:422: finishing rollback tid 2 to smithi03339061-9 2021-07-26T15:57:53.447 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 136 (ObjNum 122 snap 28 seq_num 122) dirty exists 2021-07-26T15:57:53.447 INFO:tasks.rados.rados.0.smithi033.stdout:423: expect (ObjNum 15 snap 0 seq_num 15) 2021-07-26T15:57:53.461 INFO:tasks.rados.rados.0.smithi033.stdout:424: finishing write tid 1 to smithi03339061-23 2021-07-26T15:57:53.461 INFO:tasks.rados.rados.0.smithi033.stdout:422: done (3 left) 2021-07-26T15:57:53.462 INFO:tasks.rados.rados.0.smithi033.stdout:423: done (2 left) 2021-07-26T15:57:53.462 INFO:tasks.rados.rados.0.smithi033.stdout:425: done (1 left) 2021-07-26T15:57:53.462 INFO:tasks.rados.rados.0.smithi033.stdout:426: read oid 26 snap 36 2021-07-26T15:57:53.462 INFO:tasks.rados.rados.0.smithi033.stdout:426: expect (ObjNum 38 snap 0 seq_num 38) 2021-07-26T15:57:53.462 INFO:tasks.rados.rados.0.smithi033.stdout:424: finishing write tid 2 to smithi03339061-23 2021-07-26T15:57:53.463 INFO:tasks.rados.rados.0.smithi033.stdout:424: finishing write tid 3 to smithi03339061-23 2021-07-26T15:57:53.463 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 195 (ObjNum 149 snap 37 seq_num 149) dirty exists 2021-07-26T15:57:53.463 INFO:tasks.rados.rados.0.smithi033.stdout:424: left oid 23 (ObjNum 149 snap 37 seq_num 149) 2021-07-26T15:57:53.463 INFO:tasks.rados.rados.0.smithi033.stdout:424: done (1 left) 2021-07-26T15:57:53.463 INFO:tasks.rados.rados.0.smithi033.stdout:427: snap_create 2021-07-26T15:57:53.464 INFO:tasks.rados.rados.0.smithi033.stdout:426: expect (ObjNum 38 snap 0 seq_num 38) 2021-07-26T15:57:53.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:53.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:57:53.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:53.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: dial tcp 172.21.15.96:8443: connect: connection refused" context_err="context deadline exceeded" 2021-07-26T15:57:53.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:57:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:57:53.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: dial tcp 172.21.15.96:8443: connect: connection refused" 2021-07-26T15:57:54.304 INFO:tasks.rados.rados.0.smithi033.stdout:426: done (1 left) 2021-07-26T15:57:54.304 INFO:tasks.rados.rados.0.smithi033.stdout:427: done (0 left) 2021-07-26T15:57:54.304 INFO:tasks.rados.rados.0.smithi033.stdout:428: copy_from oid 1 from oid 7 current snap is 38 2021-07-26T15:57:54.305 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 38 2021-07-26T15:57:54.305 INFO:tasks.rados.rados.0.smithi033.stdout:429: seq_num 151 ranges {2498560=131072} 2021-07-26T15:57:54.324 INFO:tasks.rados.rados.0.smithi033.stdout:429: writing smithi03339061-48 from 2498560 to 2629632 tid 1 2021-07-26T15:57:54.324 INFO:tasks.rados.rados.0.smithi033.stdout:430: rmattr oid 50 current snap is 38 2021-07-26T15:57:54.324 INFO:tasks.rados.rados.0.smithi033.stdout:430: done (2 left) 2021-07-26T15:57:54.325 INFO:tasks.rados.rados.0.smithi033.stdout:431: delete oid 43 current snap is 38 2021-07-26T15:57:54.325 INFO:tasks.rados.rados.0.smithi033.stdout:428: finishing copy_from to smithi03339061-1 2021-07-26T15:57:54.325 INFO:tasks.rados.rados.0.smithi033.stdout:428: got expected ENOENT (src dne) 2021-07-26T15:57:54.325 INFO:tasks.rados.rados.0.smithi033.stdout:428: finishing copy_from racing read to smithi03339061-1 2021-07-26T15:57:54.332 INFO:tasks.rados.rados.0.smithi033.stdout:429: finishing write tid 1 to smithi03339061-48 2021-07-26T15:57:54.333 INFO:tasks.rados.rados.0.smithi033.stdout:429: finishing write tid 2 to smithi03339061-48 2021-07-26T15:57:54.334 INFO:tasks.rados.rados.0.smithi033.stdout:428: done (2 left) 2021-07-26T15:57:54.334 INFO:tasks.rados.rados.0.smithi033.stdout:431: done (1 left) 2021-07-26T15:57:54.334 INFO:tasks.rados.rados.0.smithi033.stdout:432: read oid 26 snap -1 2021-07-26T15:57:54.334 INFO:tasks.rados.rados.0.smithi033.stdout:432: expect (ObjNum 38 snap 0 seq_num 38) 2021-07-26T15:57:54.335 INFO:tasks.rados.rados.0.smithi033.stdout:433: rmattr oid 1 current snap is 38 2021-07-26T15:57:54.335 INFO:tasks.rados.rados.0.smithi033.stdout:433: done (2 left) 2021-07-26T15:57:54.335 INFO:tasks.rados.rados.0.smithi033.stdout:434: setattr oid 27 current snap is 38 2021-07-26T15:57:54.336 INFO:tasks.rados.rados.0.smithi033.stdout:435: rmattr oid 19 current snap is 38 2021-07-26T15:57:54.336 INFO:tasks.rados.rados.0.smithi033.stdout:435: done (3 left) 2021-07-26T15:57:54.336 INFO:tasks.rados.rados.0.smithi033.stdout:436: setattr oid 37 current snap is 38 2021-07-26T15:57:54.337 INFO:tasks.rados.rados.0.smithi033.stdout:429: finishing write tid 3 to smithi03339061-48 2021-07-26T15:57:54.337 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 145 (ObjNum 151 snap 38 seq_num 151) dirty exists 2021-07-26T15:57:54.337 INFO:tasks.rados.rados.0.smithi033.stdout:429: left oid 48 (ObjNum 151 snap 38 seq_num 151) 2021-07-26T15:57:54.337 INFO:tasks.rados.rados.0.smithi033.stdout:429: done (3 left) 2021-07-26T15:57:54.338 INFO:tasks.rados.rados.0.smithi033.stdout:437: snap_create 2021-07-26T15:57:54.340 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 199 (ObjNum 133 snap 33 seq_num 133) dirty exists 2021-07-26T15:57:54.342 INFO:tasks.rados.rados.0.smithi033.stdout:432: expect (ObjNum 38 snap 0 seq_num 38) 2021-07-26T15:57:54.365 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 100 (ObjNum 36 snap 0 seq_num 36) dirty exists 2021-07-26T15:57:54.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: cluster 2021-07-26T15:57:52.665830+0000 mgr.y (mgr.14712) 17 : cluster [DBG] pgmap v28: 25 pgs: 25 active+clean; 120 MiB data, 314 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:54.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: audit 2021-07-26T15:57:53.237442+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:54.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: audit 2021-07-26T15:57:53.246577+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:54.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: cluster 2021-07-26T15:57:53.259742+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-07-26T15:57:54.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: audit 2021-07-26T15:57:53.262586+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:54.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: audit 2021-07-26T15:57:53.269213+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:57:54.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: cephadm 2021-07-26T15:57:53.270293+0000 mgr.y (mgr.14712) 18 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-07-26T15:57:54.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: audit 2021-07-26T15:57:53.277507+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:54.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: audit 2021-07-26T15:57:53.278683+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-07-26T15:57:54.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: audit 2021-07-26T15:57:53.285950+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-07-26T15:57:54.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: audit 2021-07-26T15:57:53.287153+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-07-26T15:57:54.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: audit 2021-07-26T15:57:53.294049+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-07-26T15:57:54.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: audit 2021-07-26T15:57:53.295624+0000 mon.a (mon.0) 858 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:57:54.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[14790]: audit 2021-07-26T15:57:53.296942+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-07-26T15:57:54.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: cluster 2021-07-26T15:57:52.665830+0000 mgr.y (mgr.14712) 17 : cluster [DBG] pgmap v28: 25 pgs: 25 active+clean; 120 MiB data, 314 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:54.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: audit 2021-07-26T15:57:53.237442+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:54.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: audit 2021-07-26T15:57:53.246577+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:54.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: cluster 2021-07-26T15:57:53.259742+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-07-26T15:57:54.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: audit 2021-07-26T15:57:53.262586+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:54.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: audit 2021-07-26T15:57:53.269213+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:57:54.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: cephadm 2021-07-26T15:57:53.270293+0000 mgr.y (mgr.14712) 18 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-07-26T15:57:54.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: audit 2021-07-26T15:57:53.277507+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:54.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: audit 2021-07-26T15:57:53.278683+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-07-26T15:57:54.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: audit 2021-07-26T15:57:53.285950+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-07-26T15:57:54.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: audit 2021-07-26T15:57:53.287153+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-07-26T15:57:54.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: audit 2021-07-26T15:57:53.294049+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-07-26T15:57:54.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: audit 2021-07-26T15:57:53.295624+0000 mon.a (mon.0) 858 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:57:54.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:54 smithi033 bash[19094]: audit 2021-07-26T15:57:53.296942+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-07-26T15:57:54.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: cluster 2021-07-26T15:57:52.665830+0000 mgr.y (mgr.14712) 17 : cluster [DBG] pgmap v28: 25 pgs: 25 active+clean; 120 MiB data, 314 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:57:54.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: audit 2021-07-26T15:57:53.237442+0000 mon.a (mon.0) 848 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:54.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: audit 2021-07-26T15:57:53.246577+0000 mon.a (mon.0) 849 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:54.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: cluster 2021-07-26T15:57:53.259742+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-07-26T15:57:54.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: audit 2021-07-26T15:57:53.262586+0000 mon.a (mon.0) 851 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:57:54.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: audit 2021-07-26T15:57:53.269213+0000 mon.a (mon.0) 852 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:57:54.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: cephadm 2021-07-26T15:57:53.270293+0000 mgr.y (mgr.14712) 18 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-07-26T15:57:54.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: audit 2021-07-26T15:57:53.277507+0000 mon.a (mon.0) 853 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:54.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: audit 2021-07-26T15:57:53.278683+0000 mon.a (mon.0) 854 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2021-07-26T15:57:54.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: audit 2021-07-26T15:57:53.285950+0000 mon.a (mon.0) 855 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2021-07-26T15:57:54.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: audit 2021-07-26T15:57:53.287153+0000 mon.a (mon.0) 856 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2021-07-26T15:57:54.741 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: audit 2021-07-26T15:57:53.294049+0000 mon.a (mon.0) 857 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2021-07-26T15:57:54.741 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: audit 2021-07-26T15:57:53.295624+0000 mon.a (mon.0) 858 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:57:54.741 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:54 smithi096 bash[15117]: audit 2021-07-26T15:57:53.296942+0000 mon.a (mon.0) 859 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2021-07-26T15:57:55.310 INFO:tasks.rados.rados.0.smithi033.stdout:432: done (3 left) 2021-07-26T15:57:55.311 INFO:tasks.rados.rados.0.smithi033.stdout:434: done (2 left) 2021-07-26T15:57:55.311 INFO:tasks.rados.rados.0.smithi033.stdout:436: done (1 left) 2021-07-26T15:57:55.311 INFO:tasks.rados.rados.0.smithi033.stdout:437: done (0 left) 2021-07-26T15:57:55.312 INFO:tasks.rados.rados.0.smithi033.stdout:438: setattr oid 39 current snap is 39 2021-07-26T15:57:55.312 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 39 2021-07-26T15:57:55.312 INFO:tasks.rados.rados.0.smithi033.stdout:439: seq_num 153 ranges {0=163840} 2021-07-26T15:57:55.313 INFO:tasks.rados.rados.0.smithi033.stdout:439: writing smithi03339061-22 from 0 to 163840 tid 1 2021-07-26T15:57:55.313 INFO:tasks.rados.rados.0.smithi033.stdout:440: snap_remove snap 38 2021-07-26T15:57:55.378 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:55 smithi033 bash[19094]: cephadm 2021-07-26T15:57:53.297863+0000 mgr.y (mgr.14712) 19 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2021-07-26T15:57:55.379 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:55 smithi033 bash[19094]: cluster 2021-07-26T15:57:54.301171+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-07-26T15:57:55.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:55 smithi033 bash[14790]: cephadm 2021-07-26T15:57:53.297863+0000 mgr.y (mgr.14712) 19 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2021-07-26T15:57:55.379 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:55 smithi033 bash[14790]: cluster 2021-07-26T15:57:54.301171+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-07-26T15:57:55.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:55 smithi096 bash[15117]: cephadm 2021-07-26T15:57:53.297863+0000 mgr.y (mgr.14712) 19 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2021-07-26T15:57:55.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:55 smithi096 bash[15117]: cluster 2021-07-26T15:57:54.301171+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-07-26T15:57:56.317 INFO:tasks.rados.rados.0.smithi033.stdout:440: done (2 left) 2021-07-26T15:57:56.318 INFO:tasks.rados.rados.0.smithi033.stdout:441: rmattr oid 7 current snap is 39 2021-07-26T15:57:56.319 INFO:tasks.rados.rados.0.smithi033.stdout:441: done (2 left) 2021-07-26T15:57:56.319 INFO:tasks.rados.rados.0.smithi033.stdout:442: copy_from oid 19 from oid 37 current snap is 39 2021-07-26T15:57:56.319 INFO:tasks.rados.rados.0.smithi033.stdout:439: finishing write tid 1 to smithi03339061-22 2021-07-26T15:57:56.320 INFO:tasks.rados.rados.0.smithi033.stdout:439: finishing write tid 2 to smithi03339061-22 2021-07-26T15:57:56.320 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 201 (ObjNum 109 snap 19 seq_num 109) dirty exists 2021-07-26T15:57:56.321 INFO:tasks.rados.rados.0.smithi033.stdout:439: finishing write tid 3 to smithi03339061-22 2021-07-26T15:57:56.321 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 257 (ObjNum 153 snap 39 seq_num 153) dirty exists 2021-07-26T15:57:56.322 INFO:tasks.rados.rados.0.smithi033.stdout:439: left oid 22 (ObjNum 153 snap 39 seq_num 153) 2021-07-26T15:57:56.322 INFO:tasks.rados.rados.0.smithi033.stdout:438: done (2 left) 2021-07-26T15:57:56.323 INFO:tasks.rados.rados.0.smithi033.stdout:439: done (1 left) 2021-07-26T15:57:56.323 INFO:tasks.rados.rados.0.smithi033.stdout:443: copy_from oid 48 from oid 31 current snap is 39 2021-07-26T15:57:56.323 INFO:tasks.rados.rados.0.smithi033.stdout:444: delete oid 16 current snap is 39 2021-07-26T15:57:56.329 INFO:tasks.rados.rados.0.smithi033.stdout:444: done (2 left) 2021-07-26T15:57:56.330 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 39 2021-07-26T15:57:56.331 INFO:tasks.rados.rados.0.smithi033.stdout:445: seq_num 155 ranges {0=204800} 2021-07-26T15:57:56.331 INFO:tasks.rados.rados.0.smithi033.stdout:445: writing smithi03339061-21 from 0 to 204800 tid 1 2021-07-26T15:57:56.332 INFO:tasks.rados.rados.0.smithi033.stdout:446: delete oid 39 current snap is 39 2021-07-26T15:57:56.332 INFO:tasks.rados.rados.0.smithi033.stdout:443: finishing copy_from to smithi03339061-48 2021-07-26T15:57:56.332 INFO:tasks.rados.rados.0.smithi033.stdout:443: got expected ENOENT (src dne) 2021-07-26T15:57:56.333 INFO:tasks.rados.rados.0.smithi033.stdout:443: finishing copy_from racing read to smithi03339061-48 2021-07-26T15:57:56.335 INFO:tasks.rados.rados.0.smithi033.stdout:442: finishing copy_from to smithi03339061-19 2021-07-26T15:57:56.335 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 100 (ObjNum 36 snap 0 seq_num 36) dirty exists 2021-07-26T15:57:56.336 INFO:tasks.rados.rados.0.smithi033.stdout:442: finishing copy_from racing read to smithi03339061-19 2021-07-26T15:57:56.336 INFO:tasks.rados.rados.0.smithi033.stdout:445: finishing write tid 1 to smithi03339061-21 2021-07-26T15:57:56.336 INFO:tasks.rados.rados.0.smithi033.stdout:445: finishing write tid 2 to smithi03339061-21 2021-07-26T15:57:56.337 INFO:tasks.rados.rados.0.smithi033.stdout:442: done (3 left) 2021-07-26T15:57:56.337 INFO:tasks.rados.rados.0.smithi033.stdout:443: done (2 left) 2021-07-26T15:57:56.338 INFO:tasks.rados.rados.0.smithi033.stdout:446: done (1 left) 2021-07-26T15:57:56.338 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 39 2021-07-26T15:57:56.339 INFO:tasks.rados.rados.0.smithi033.stdout:447: seq_num 157 ranges {4415488=237568} 2021-07-26T15:57:56.360 INFO:tasks.rados.rados.0.smithi033.stdout:447: writing smithi03339061-15 from 4415488 to 4653056 tid 1 2021-07-26T15:57:56.361 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 39 2021-07-26T15:57:56.361 INFO:tasks.rados.rados.0.smithi033.stdout:448: seq_num 158 ranges {0=253952} 2021-07-26T15:57:56.362 INFO:tasks.rados.rados.0.smithi033.stdout:448: writing smithi03339061-29 from 0 to 253952 tid 1 2021-07-26T15:57:56.362 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 39 2021-07-26T15:57:56.362 INFO:tasks.rados.rados.0.smithi033.stdout:449: seq_num 159 ranges {3915776=270336} 2021-07-26T15:57:56.385 INFO:tasks.rados.rados.0.smithi033.stdout:449: writing smithi03339061-30 from 3915776 to 4186112 tid 1 2021-07-26T15:57:56.385 INFO:tasks.rados.rados.0.smithi033.stdout:450: read oid 41 snap -1 2021-07-26T15:57:56.386 INFO:tasks.rados.rados.0.smithi033.stdout:450: expect (ObjNum 99 snap 18 seq_num 99) 2021-07-26T15:57:56.386 INFO:tasks.rados.rados.0.smithi033.stdout:451: snap_remove snap 34 2021-07-26T15:57:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: cluster 2021-07-26T15:57:54.666609+0000 mgr.y (mgr.14712) 20 : cluster [DBG] pgmap v31: 25 pgs: 25 active+clean; 126 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 36 op/s 2021-07-26T15:57:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: cluster 2021-07-26T15:57:55.308278+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-07-26T15:57:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: cluster 2021-07-26T15:57:55.733405+0000 mon.a (mon.0) 862 : cluster [DBG] Standby manager daemon x restarted 2021-07-26T15:57:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: cluster 2021-07-26T15:57:55.733796+0000 mon.a (mon.0) 863 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:57:56.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: audit 2021-07-26T15:57:55.735339+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:57:56.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: audit 2021-07-26T15:57:55.736444+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:56.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: audit 2021-07-26T15:57:55.738359+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:57:56.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: audit 2021-07-26T15:57:55.739458+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:56.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: audit 2021-07-26T15:57:55.988687+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:56.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: audit 2021-07-26T15:57:55.989938+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:57:56.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: audit 2021-07-26T15:57:55.991134+0000 mon.a (mon.0) 866 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:57:56.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[14790]: audit 2021-07-26T15:57:55.992186+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:56.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: cluster 2021-07-26T15:57:54.666609+0000 mgr.y (mgr.14712) 20 : cluster [DBG] pgmap v31: 25 pgs: 25 active+clean; 126 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 36 op/s 2021-07-26T15:57:56.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: cluster 2021-07-26T15:57:55.308278+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-07-26T15:57:56.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: cluster 2021-07-26T15:57:55.733405+0000 mon.a (mon.0) 862 : cluster [DBG] Standby manager daemon x restarted 2021-07-26T15:57:56.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: cluster 2021-07-26T15:57:55.733796+0000 mon.a (mon.0) 863 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:57:56.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: audit 2021-07-26T15:57:55.735339+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:57:56.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: audit 2021-07-26T15:57:55.736444+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:56.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: audit 2021-07-26T15:57:55.738359+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:57:56.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: audit 2021-07-26T15:57:55.739458+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:56.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: audit 2021-07-26T15:57:55.988687+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:56.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: audit 2021-07-26T15:57:55.989938+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:57:56.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: audit 2021-07-26T15:57:55.991134+0000 mon.a (mon.0) 866 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:57:56.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:56 smithi033 bash[19094]: audit 2021-07-26T15:57:55.992186+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:56.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: cluster 2021-07-26T15:57:54.666609+0000 mgr.y (mgr.14712) 20 : cluster [DBG] pgmap v31: 25 pgs: 25 active+clean; 126 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 36 op/s 2021-07-26T15:57:56.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: cluster 2021-07-26T15:57:55.308278+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-07-26T15:57:56.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: cluster 2021-07-26T15:57:55.733405+0000 mon.a (mon.0) 862 : cluster [DBG] Standby manager daemon x restarted 2021-07-26T15:57:56.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: cluster 2021-07-26T15:57:55.733796+0000 mon.a (mon.0) 863 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:57:56.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: audit 2021-07-26T15:57:55.735339+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:57:56.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: audit 2021-07-26T15:57:55.736444+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:57:56.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: audit 2021-07-26T15:57:55.738359+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:57:56.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: audit 2021-07-26T15:57:55.739458+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.96:0/3153822928' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:57:56.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: audit 2021-07-26T15:57:55.988687+0000 mon.a (mon.0) 864 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' 2021-07-26T15:57:56.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: audit 2021-07-26T15:57:55.989938+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:57:56.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: audit 2021-07-26T15:57:55.991134+0000 mon.a (mon.0) 866 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:57:56.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:56 smithi096 bash[15117]: audit 2021-07-26T15:57:55.992186+0000 mon.a (mon.0) 867 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:57:57.213 INFO:tasks.rados.rados.0.smithi033.stdout:445: finishing write tid 3 to smithi03339061-21 2021-07-26T15:57:57.213 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 206 (ObjNum 155 snap 39 seq_num 155) dirty exists 2021-07-26T15:57:57.214 INFO:tasks.rados.rados.0.smithi033.stdout:445: left oid 21 (ObjNum 155 snap 39 seq_num 155) 2021-07-26T15:57:57.214 INFO:tasks.rados.rados.0.smithi033.stdout:447: finishing write tid 1 to smithi03339061-15 2021-07-26T15:57:57.214 INFO:tasks.rados.rados.0.smithi033.stdout:447: finishing write tid 2 to smithi03339061-15 2021-07-26T15:57:57.214 INFO:tasks.rados.rados.0.smithi033.stdout:447: finishing write tid 3 to smithi03339061-15 2021-07-26T15:57:57.215 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 118 (ObjNum 157 snap 39 seq_num 157) dirty exists 2021-07-26T15:57:57.215 INFO:tasks.rados.rados.0.smithi033.stdout:447: left oid 15 (ObjNum 157 snap 39 seq_num 157) 2021-07-26T15:57:57.215 INFO:tasks.rados.rados.0.smithi033.stdout:448: finishing write tid 1 to smithi03339061-29 2021-07-26T15:57:57.215 INFO:tasks.rados.rados.0.smithi033.stdout:448: finishing write tid 2 to smithi03339061-29 2021-07-26T15:57:57.215 INFO:tasks.rados.rados.0.smithi033.stdout:448: finishing write tid 3 to smithi03339061-29 2021-07-26T15:57:57.216 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 22 (ObjNum 158 snap 39 seq_num 158) dirty exists 2021-07-26T15:57:57.216 INFO:tasks.rados.rados.0.smithi033.stdout:448: left oid 29 (ObjNum 158 snap 39 seq_num 158) 2021-07-26T15:57:57.216 INFO:tasks.rados.rados.0.smithi033.stdout:449: finishing write tid 1 to smithi03339061-30 2021-07-26T15:57:57.216 INFO:tasks.rados.rados.0.smithi033.stdout:449: finishing write tid 2 to smithi03339061-30 2021-07-26T15:57:57.217 INFO:tasks.rados.rados.0.smithi033.stdout:449: finishing write tid 3 to smithi03339061-30 2021-07-26T15:57:57.217 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 103 (ObjNum 159 snap 39 seq_num 159) dirty exists 2021-07-26T15:57:57.217 INFO:tasks.rados.rados.0.smithi033.stdout:449: left oid 30 (ObjNum 159 snap 39 seq_num 159) 2021-07-26T15:57:57.217 INFO:tasks.rados.rados.0.smithi033.stdout:450: expect (ObjNum 99 snap 18 seq_num 99) 2021-07-26T15:57:57.271 INFO:tasks.rados.rados.0.smithi033.stdout:445: done (5 left) 2021-07-26T15:57:57.272 INFO:tasks.rados.rados.0.smithi033.stdout:447: done (4 left) 2021-07-26T15:57:57.272 INFO:tasks.rados.rados.0.smithi033.stdout:448: done (3 left) 2021-07-26T15:57:57.273 INFO:tasks.rados.rados.0.smithi033.stdout:449: done (2 left) 2021-07-26T15:57:57.273 INFO:tasks.rados.rados.0.smithi033.stdout:450: done (1 left) 2021-07-26T15:57:57.273 INFO:tasks.rados.rados.0.smithi033.stdout:451: done (0 left) 2021-07-26T15:57:57.273 INFO:tasks.rados.rados.0.smithi033.stdout:452: rollback oid 1 current snap is 39 2021-07-26T15:57:57.274 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 1 to 29 2021-07-26T15:57:57.274 INFO:tasks.rados.rados.0.smithi033.stdout:453: delete oid 32 current snap is 39 2021-07-26T15:57:57.275 INFO:tasks.rados.rados.0.smithi033.stdout:453: done (1 left) 2021-07-26T15:57:57.275 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 39 2021-07-26T15:57:57.275 INFO:tasks.rados.rados.0.smithi033.stdout:454: seq_num 161 ranges {0=303104} 2021-07-26T15:57:57.277 INFO:tasks.rados.rados.0.smithi033.stdout:454: writing smithi03339061-4 from 0 to 303104 tid 1 2021-07-26T15:57:57.277 INFO:tasks.rados.rados.0.smithi033.stdout:452: finishing rollback tid 0 to smithi03339061-1 2021-07-26T15:57:57.277 INFO:tasks.rados.rados.0.smithi033.stdout:452: finishing rollback tid 1 to smithi03339061-1 2021-07-26T15:57:57.277 INFO:tasks.rados.rados.0.smithi033.stdout:455: snap_remove snap 36 2021-07-26T15:57:57.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:57 smithi033 bash[14790]: cephadm 2021-07-26T15:57:55.979187+0000 mgr.y (mgr.14712) 21 : cephadm [INF] Upgrade: Updating mon.a 2021-07-26T15:57:57.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:57 smithi033 bash[14790]: cephadm 2021-07-26T15:57:55.993141+0000 mgr.y (mgr.14712) 22 : cephadm [INF] Deploying daemon mon.a on smithi033 2021-07-26T15:57:57.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:57 smithi033 bash[14790]: cluster 2021-07-26T15:57:56.312485+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-07-26T15:57:57.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:57 smithi033 bash[14790]: cluster 2021-07-26T15:57:56.324419+0000 mon.a (mon.0) 869 : cluster [DBG] mgrmap e26: y(active, since 20s), standbys: x 2021-07-26T15:57:57.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:57 smithi033 bash[14790]: cluster 2021-07-26T15:57:57.210132+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-07-26T15:57:57.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:57 smithi033 bash[19094]: cephadm 2021-07-26T15:57:55.979187+0000 mgr.y (mgr.14712) 21 : cephadm [INF] Upgrade: Updating mon.a 2021-07-26T15:57:57.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:57 smithi033 bash[19094]: cephadm 2021-07-26T15:57:55.993141+0000 mgr.y (mgr.14712) 22 : cephadm [INF] Deploying daemon mon.a on smithi033 2021-07-26T15:57:57.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:57 smithi033 bash[19094]: cluster 2021-07-26T15:57:56.312485+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-07-26T15:57:57.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:57 smithi033 bash[19094]: cluster 2021-07-26T15:57:56.324419+0000 mon.a (mon.0) 869 : cluster [DBG] mgrmap e26: y(active, since 20s), standbys: x 2021-07-26T15:57:57.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:57 smithi033 bash[19094]: cluster 2021-07-26T15:57:57.210132+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-07-26T15:57:57.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:57 smithi096 bash[15117]: cephadm 2021-07-26T15:57:55.979187+0000 mgr.y (mgr.14712) 21 : cephadm [INF] Upgrade: Updating mon.a 2021-07-26T15:57:57.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:57 smithi096 bash[15117]: cephadm 2021-07-26T15:57:55.993141+0000 mgr.y (mgr.14712) 22 : cephadm [INF] Deploying daemon mon.a on smithi033 2021-07-26T15:57:57.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:57 smithi096 bash[15117]: cluster 2021-07-26T15:57:56.312485+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-07-26T15:57:57.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:57 smithi096 bash[15117]: cluster 2021-07-26T15:57:56.324419+0000 mon.a (mon.0) 869 : cluster [DBG] mgrmap e26: y(active, since 20s), standbys: x 2021-07-26T15:57:57.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:57 smithi096 bash[15117]: cluster 2021-07-26T15:57:57.210132+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-07-26T15:57:58.259 INFO:tasks.rados.rados.0.smithi033.stdout:455: done (2 left) 2021-07-26T15:57:58.259 INFO:tasks.rados.rados.0.smithi033.stdout:456: copy_from oid 14 from oid 43 current snap is 39 2021-07-26T15:57:58.260 INFO:tasks.rados.rados.0.smithi033.stdout:452: finishing rollback tid 2 to smithi03339061-1 2021-07-26T15:57:58.260 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 17 (ObjNum 87 snap 17 seq_num 87) dirty exists 2021-07-26T15:57:58.261 INFO:tasks.rados.rados.0.smithi033.stdout:454: finishing write tid 1 to smithi03339061-4 2021-07-26T15:57:58.261 INFO:tasks.rados.rados.0.smithi033.stdout:454: finishing write tid 2 to smithi03339061-4 2021-07-26T15:57:58.261 INFO:tasks.rados.rados.0.smithi033.stdout:454: finishing write tid 3 to smithi03339061-4 2021-07-26T15:57:58.261 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 134 (ObjNum 161 snap 39 seq_num 161) dirty exists 2021-07-26T15:57:58.262 INFO:tasks.rados.rados.0.smithi033.stdout:454: left oid 4 (ObjNum 161 snap 39 seq_num 161) 2021-07-26T15:57:58.262 INFO:tasks.rados.rados.0.smithi033.stdout:452: done (2 left) 2021-07-26T15:57:58.262 INFO:tasks.rados.rados.0.smithi033.stdout:454: done (1 left) 2021-07-26T15:57:58.262 INFO:tasks.rados.rados.0.smithi033.stdout:457: setattr oid 27 current snap is 39 2021-07-26T15:57:58.263 INFO:tasks.rados.rados.0.smithi033.stdout:458: rollback oid 3 current snap is 39 2021-07-26T15:57:58.263 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 3 to 29 2021-07-26T15:57:58.264 INFO:tasks.rados.rados.0.smithi033.stdout:459: setattr oid 40 current snap is 39 2021-07-26T15:57:58.264 INFO:tasks.rados.rados.0.smithi033.stdout:460: snap_create 2021-07-26T15:57:58.272 INFO:tasks.rados.rados.0.smithi033.stdout:458: finishing rollback tid 1 to smithi03339061-3 2021-07-26T15:57:58.272 INFO:tasks.rados.rados.0.smithi033.stdout:458: finishing rollback tid 2 to smithi03339061-3 2021-07-26T15:57:58.273 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 58 (ObjNum 121 snap 27 seq_num 121) dirty exists 2021-07-26T15:57:58.274 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 218 (ObjNum 133 snap 33 seq_num 133) dirty exists 2021-07-26T15:57:58.274 INFO:tasks.rados.rados.0.smithi033.stdout:456: finishing copy_from to smithi03339061-14 2021-07-26T15:57:58.275 INFO:tasks.rados.rados.0.smithi033.stdout:456: got expected ENOENT (src dne) 2021-07-26T15:57:58.275 INFO:tasks.rados.rados.0.smithi033.stdout:456: finishing copy_from racing read to smithi03339061-14 2021-07-26T15:57:58.276 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 30 (ObjNum 39 snap 0 seq_num 39) dirty exists 2021-07-26T15:57:58.387 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:58 smithi033 bash[14790]: cluster 2021-07-26T15:57:56.667340+0000 mgr.y (mgr.14712) 23 : cluster [DBG] pgmap v34: 25 pgs: 25 active+clean; 126 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 36 op/s 2021-07-26T15:57:58.387 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:58 smithi033 systemd[1]: Stopping Ceph mon.a for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T15:57:58.388 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:57:58 smithi033 bash[19094]: cluster 2021-07-26T15:57:56.667340+0000 mgr.y (mgr.14712) 23 : cluster [DBG] pgmap v34: 25 pgs: 25 active+clean; 126 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 36 op/s 2021-07-26T15:57:58.661 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:58 smithi033 docker[41275]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:57:58.661 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:58 smithi033 bash[14790]: debug 2021-07-26T15:57:58.455+0000 7fbccef5c700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2021-07-26T15:57:58.661 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:58 smithi033 bash[14790]: debug 2021-07-26T15:57:58.455+0000 7fbccef5c700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2021-07-26T15:57:58.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:57:58 smithi096 bash[15117]: cluster 2021-07-26T15:57:56.667340+0000 mgr.y (mgr.14712) 23 : cluster [DBG] pgmap v34: 25 pgs: 25 active+clean; 126 MiB data, 330 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 36 op/s 2021-07-26T15:57:59.625 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:59 smithi033 docker[41275]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-mon.a 2021-07-26T15:57:59.626 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:59 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.a.service: Succeeded. 2021-07-26T15:57:59.626 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:59 smithi033 systemd[1]: Stopped Ceph mon.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:57:59.626 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:59 smithi033 systemd[1]: Started Ceph mon.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:57:59.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:57:59 smithi033 bash[41341]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:58:01.213 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.847+0000 7fc4e6ab2700 0 set uid:gid to 167:167 (ceph:ceph) 2021-07-26T15:58:01.213 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.847+0000 7fc4e6ab2700 0 ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev), process ceph-mon, pid 7 2021-07-26T15:58:01.214 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.847+0000 7fc4e6ab2700 0 pidfile_write: ignore empty --pid-file 2021-07-26T15:58:01.214 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 0 load: jerasure load: lrc 2021-07-26T15:58:01.214 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: RocksDB version: 6.15.5 2021-07-26T15:58:01.215 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-07-26T15:58:01.215 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Compile date Jul 24 2021 2021-07-26T15:58:01.215 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: DB SUMMARY 2021-07-26T15:58:01.215 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: DB Session ID: LDJ9T58WRBKZUPUHA577 2021-07-26T15:58:01.216 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: CURRENT file: CURRENT 2021-07-26T15:58:01.216 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: IDENTITY file: IDENTITY 2021-07-26T15:58:01.216 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 771 Bytes 2021-07-26T15:58:01.216 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000020.sst 2021-07-26T15:58:01.217 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000018.log size: 8426267 ; 2021-07-26T15:58:01.217 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.error_if_exists: 0 2021-07-26T15:58:01.217 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.create_if_missing: 0 2021-07-26T15:58:01.217 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.paranoid_checks: 1 2021-07-26T15:58:01.218 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-07-26T15:58:01.218 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.env: 0x559942084a20 2021-07-26T15:58:01.218 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.fs: Posix File System 2021-07-26T15:58:01.218 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.info_log: 0x559944786080 2021-07-26T15:58:01.218 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_file_opening_threads: 16 2021-07-26T15:58:01.219 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.statistics: (nil) 2021-07-26T15:58:01.219 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.use_fsync: 0 2021-07-26T15:58:01.220 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_log_file_size: 0 2021-07-26T15:58:01.220 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-07-26T15:58:01.220 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-07-26T15:58:01.220 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.keep_log_file_num: 1000 2021-07-26T15:58:01.221 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.recycle_log_file_num: 0 2021-07-26T15:58:01.221 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.allow_fallocate: 1 2021-07-26T15:58:01.221 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.allow_mmap_reads: 0 2021-07-26T15:58:01.221 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.allow_mmap_writes: 0 2021-07-26T15:58:01.222 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.use_direct_reads: 0 2021-07-26T15:58:01.222 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-07-26T15:58:01.222 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.create_missing_column_families: 0 2021-07-26T15:58:01.223 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.db_log_dir: 2021-07-26T15:58:01.223 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-07-26T15:58:01.223 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-07-26T15:58:01.223 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-07-26T15:58:01.224 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-07-26T15:58:01.224 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-07-26T15:58:01.224 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-07-26T15:58:01.225 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-07-26T15:58:01.225 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.advise_random_on_open: 1 2021-07-26T15:58:01.225 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.db_write_buffer_size: 0 2021-07-26T15:58:01.226 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.write_buffer_manager: 0x5599447fbd40 2021-07-26T15:58:01.226 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-07-26T15:58:01.226 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-07-26T15:58:01.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-07-26T15:58:01.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-07-26T15:58:01.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.rate_limiter: (nil) 2021-07-26T15:58:01.227 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-07-26T15:58:01.228 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.wal_recovery_mode: 2 2021-07-26T15:58:01.228 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.enable_thread_tracking: 0 2021-07-26T15:58:01.228 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.enable_pipelined_write: 0 2021-07-26T15:58:01.229 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.unordered_write: 0 2021-07-26T15:58:01.229 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-07-26T15:58:01.229 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-07-26T15:58:01.229 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-07-26T15:58:01.229 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-07-26T15:58:01.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.row_cache: None 2021-07-26T15:58:01.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.wal_filter: None 2021-07-26T15:58:01.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-07-26T15:58:01.230 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.allow_ingest_behind: 0 2021-07-26T15:58:01.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.preserve_deletes: 0 2021-07-26T15:58:01.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.two_write_queues: 0 2021-07-26T15:58:01.231 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.manual_wal_flush: 0 2021-07-26T15:58:01.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.atomic_flush: 0 2021-07-26T15:58:01.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-07-26T15:58:01.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-07-26T15:58:01.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-07-26T15:58:01.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.log_readahead_size: 0 2021-07-26T15:58:01.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2021-07-26T15:58:01.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.best_efforts_recovery: 0 2021-07-26T15:58:01.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-07-26T15:58:01.233 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-07-26T15:58:01.234 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.allow_data_in_errors: 0 2021-07-26T15:58:01.234 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.db_host_id: __hostname__ 2021-07-26T15:58:01.234 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_background_jobs: 2 2021-07-26T15:58:01.234 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_background_compactions: -1 2021-07-26T15:58:01.235 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_subcompactions: 1 2021-07-26T15:58:01.235 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-07-26T15:58:01.235 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-07-26T15:58:01.235 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-07-26T15:58:01.236 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_total_wal_size: 0 2021-07-26T15:58:01.236 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-07-26T15:58:01.236 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-07-26T15:58:01.236 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-07-26T15:58:01.236 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-07-26T15:58:01.237 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_open_files: -1 2021-07-26T15:58:01.237 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.bytes_per_sync: 0 2021-07-26T15:58:01.237 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-07-26T15:58:01.237 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-07-26T15:58:01.238 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_readahead_size: 0 2021-07-26T15:58:01.241 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_background_flushes: -1 2021-07-26T15:58:01.241 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Compression algorithms supported: 2021-07-26T15:58:01.241 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-07-26T15:58:01.241 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: kZSTD supported: 0 2021-07-26T15:58:01.242 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: kXpressCompression supported: 0 2021-07-26T15:58:01.242 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: kLZ4HCCompression supported: 1 2021-07-26T15:58:01.243 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: kLZ4Compression supported: 1 2021-07-26T15:58:01.243 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: kBZip2Compression supported: 0 2021-07-26T15:58:01.243 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: kZlibCompression supported: 1 2021-07-26T15:58:01.243 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: kSnappyCompression supported: 1 2021-07-26T15:58:01.243 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-07-26T15:58:01.244 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2021-07-26T15:58:01.244 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-07-26T15:58:01.244 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-07-26T15:58:01.244 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.merge_operator: 2021-07-26T15:58:01.245 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_filter: None 2021-07-26T15:58:01.245 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_filter_factory: None 2021-07-26T15:58:01.245 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.sst_partitioner_factory: None 2021-07-26T15:58:01.245 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-07-26T15:58:01.246 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-07-26T15:58:01.246 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559944751ba8) 2021-07-26T15:58:01.246 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: cache_index_and_filter_blocks: 1 2021-07-26T15:58:01.246 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: cache_index_and_filter_blocks_with_high_priority: 0 2021-07-26T15:58:01.247 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-07-26T15:58:01.247 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: pin_top_level_index_and_filter: 1 2021-07-26T15:58:01.247 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: index_type: 0 2021-07-26T15:58:01.248 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: data_block_index_type: 0 2021-07-26T15:58:01.248 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: index_shortening: 1 2021-07-26T15:58:01.248 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: data_block_hash_table_util_ratio: 0.750000 2021-07-26T15:58:01.248 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: hash_index_allow_collision: 1 2021-07-26T15:58:01.249 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: checksum: 1 2021-07-26T15:58:01.249 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: no_block_cache: 0 2021-07-26T15:58:01.249 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: block_cache: 0x559944782c10 2021-07-26T15:58:01.249 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: block_cache_name: BinnedLRUCache 2021-07-26T15:58:01.249 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: block_cache_options: 2021-07-26T15:58:01.250 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: capacity : 536870912 2021-07-26T15:58:01.250 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: num_shard_bits : 4 2021-07-26T15:58:01.250 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: strict_capacity_limit : 0 2021-07-26T15:58:01.250 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: high_pri_pool_ratio: 0.000 2021-07-26T15:58:01.251 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: block_cache_compressed: (nil) 2021-07-26T15:58:01.251 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: persistent_cache: (nil) 2021-07-26T15:58:01.252 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: block_size: 4096 2021-07-26T15:58:01.252 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: block_size_deviation: 10 2021-07-26T15:58:01.252 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: block_restart_interval: 16 2021-07-26T15:58:01.252 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: index_block_restart_interval: 1 2021-07-26T15:58:01.253 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: metadata_block_size: 4096 2021-07-26T15:58:01.253 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: partition_filters: 0 2021-07-26T15:58:01.253 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: use_delta_encoding: 1 2021-07-26T15:58:01.253 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: filter_policy: rocksdb.BuiltinBloomFilter 2021-07-26T15:58:01.253 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: whole_key_filtering: 1 2021-07-26T15:58:01.254 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: verify_compression: 0 2021-07-26T15:58:01.254 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: read_amp_bytes_per_bit: 0 2021-07-26T15:58:01.255 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: format_version: 4 2021-07-26T15:58:01.255 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: enable_index_compression: 1 2021-07-26T15:58:01.255 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: block_align: 0 2021-07-26T15:58:01.256 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.write_buffer_size: 33554432 2021-07-26T15:58:01.256 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_write_buffer_number: 2 2021-07-26T15:58:01.257 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compression: NoCompression 2021-07-26T15:58:01.257 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.bottommost_compression: Disabled 2021-07-26T15:58:01.257 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.prefix_extractor: nullptr 2021-07-26T15:58:01.258 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-07-26T15:58:01.258 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.num_levels: 7 2021-07-26T15:58:01.259 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-07-26T15:58:01.259 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-07-26T15:58:01.259 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-07-26T15:58:01.260 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-07-26T15:58:01.260 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-07-26T15:58:01.260 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-07-26T15:58:01.261 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-07-26T15:58:01.262 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:58:01.262 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-07-26T15:58:01.263 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-07-26T15:58:01.263 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-07-26T15:58:01.264 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compression_opts.level: 32767 2021-07-26T15:58:01.264 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compression_opts.strategy: 0 2021-07-26T15:58:01.264 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-07-26T15:58:01.264 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:58:01.265 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compression_opts.parallel_threads: 1 2021-07-26T15:58:01.265 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compression_opts.enabled: false 2021-07-26T15:58:01.265 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-07-26T15:58:01.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-07-26T15:58:01.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-07-26T15:58:01.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.target_file_size_base: 67108864 2021-07-26T15:58:01.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-07-26T15:58:01.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-07-26T15:58:01.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-07-26T15:58:01.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-07-26T15:58:01.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-07-26T15:58:01.267 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-07-26T15:58:01.268 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-07-26T15:58:01.268 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-07-26T15:58:01.268 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-07-26T15:58:01.268 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-07-26T15:58:01.269 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-07-26T15:58:01.269 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-07-26T15:58:01.269 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-07-26T15:58:01.269 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.arena_block_size: 4194304 2021-07-26T15:58:01.269 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-07-26T15:58:01.270 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-07-26T15:58:01.270 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-07-26T15:58:01.270 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.disable_auto_compactions: 0 2021-07-26T15:58:01.271 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-07-26T15:58:01.271 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-07-26T15:58:01.271 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-07-26T15:58:01.271 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-07-26T15:58:01.272 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-07-26T15:58:01.272 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-07-26T15:58:01.272 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-07-26T15:58:01.274 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-07-26T15:58:01.274 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-07-26T15:58:01.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-07-26T15:58:01.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.table_properties_collectors: 2021-07-26T15:58:01.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.inplace_update_support: 0 2021-07-26T15:58:01.275 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-07-26T15:58:01.276 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-07-26T15:58:01.277 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-07-26T15:58:01.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-07-26T15:58:01.278 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.bloom_locality: 0 2021-07-26T15:58:01.279 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.max_successive_merges: 0 2021-07-26T15:58:01.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-07-26T15:58:01.280 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.paranoid_file_checks: 0 2021-07-26T15:58:01.281 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.force_consistency_checks: 1 2021-07-26T15:58:01.281 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.report_bg_io_stats: 0 2021-07-26T15:58:01.282 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.ttl: 2592000 2021-07-26T15:58:01.282 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-07-26T15:58:01.283 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.enable_blob_files: false 2021-07-26T15:58:01.283 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.min_blob_size: 0 2021-07-26T15:58:01.284 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.blob_file_size: 268435456 2021-07-26T15:58:01.284 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.blob_compression_type: NoCompression 2021-07-26T15:58:01.285 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.enable_blob_garbage_collection: false 2021-07-26T15:58:01.285 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-07-26T15:58:01.286 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-07-26T15:58:01.286 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 22, last_sequence is 9045, log_number is 18,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-07-26T15:58:01.287 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 18 2021-07-26T15:58:01.287 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.851+0000 7fc4e6ab2700 4 rocksdb: [db/version_set.cc:4083] Creating manifest 22 2021-07-26T15:58:01.287 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.855+0000 7fc4e6ab2700 4 rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-07-26T15:58:01.288 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.855+0000 7fc4e6ab2700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627315080856744, "job": 1, "event": "recovery_started", "wal_files": [18]} 2021-07-26T15:58:01.288 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.855+0000 7fc4e6ab2700 4 rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #18 mode 2 2021-07-26T15:58:01.291 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.867+0000 7fc4e6ab2700 3 rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-07-26T15:58:01.292 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.883+0000 7fc4e6ab2700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627315080884009, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 23, "file_size": 8172115, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 8158508, "index_size": 10681, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1989, "raw_key_size": 16729, "raw_average_key_size": 22, "raw_value_size": 8136884, "raw_average_value_size": 10863, "num_data_blocks": 458, "num_entries": 749, "num_deletions": 40, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1627315080, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "cfcea3ce-5c1c-4e47-9f1c-ddb1743f9a30", "db_session_id": "LDJ9T58WRBKZUPUHA577"}} 2021-07-26T15:58:01.292 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.883+0000 7fc4e6ab2700 4 rocksdb: [db/version_set.cc:4083] Creating manifest 24 2021-07-26T15:58:01.293 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.883+0000 7fc4e6ab2700 4 rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-07-26T15:58:01.293 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.883+0000 7fc4e6ab2700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627315080884967, "job": 1, "event": "recovery_finished"} 2021-07-26T15:58:01.297 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.883+0000 7fc4e6ab2700 4 rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000018.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-07-26T15:58:01.298 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.883+0000 7fc4e6ab2700 4 rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55994479ea80 2021-07-26T15:58:01.298 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.883+0000 7fc4e6ab2700 4 rocksdb: DB pointer 0x5599447ae000 2021-07-26T15:58:01.298 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.883+0000 7fc4d66c8700 4 rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-07-26T15:58:01.299 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.883+0000 7fc4d66c8700 4 rocksdb: [db/db_impl/db_impl.cc:903] 2021-07-26T15:58:01.299 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: ** DB Stats ** 2021-07-26T15:58:01.299 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:58:01.299 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-07-26T15:58:01.299 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-07-26T15:58:01.300 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:58:01.306 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-07-26T15:58:01.306 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-07-26T15:58:01.306 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:58:01.307 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: ** Compaction Stats [default] ** 2021-07-26T15:58:01.307 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:01.307 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:01.307 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: L0 1/0 7.79 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 553.6 0.01 0.00 1 0.014 0 0 2021-07-26T15:58:01.308 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: L6 1/0 17.41 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:58:01.308 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Sum 2/0 25.21 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 553.6 0.01 0.00 1 0.014 0 0 2021-07-26T15:58:01.308 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 553.6 0.01 0.00 1 0.014 0 0 2021-07-26T15:58:01.308 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: ** Compaction Stats [default] ** 2021-07-26T15:58:01.309 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:01.309 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:01.309 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 553.6 0.01 0.00 1 0.014 0 0 2021-07-26T15:58:01.309 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:58:01.309 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Flush(GB): cumulative 0.008, interval 0.008 2021-07-26T15:58:01.310 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:58:01.310 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:58:01.310 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:58:01.310 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:58:01.310 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Cumulative compaction: 0.01 GB write, 234.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:01.311 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Interval compaction: 0.01 GB write, 234.34 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:01.311 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:58:01.311 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:58:01.311 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: ** Compaction Stats [default] ** 2021-07-26T15:58:01.312 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:01.312 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:01.312 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: L0 1/0 7.79 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 553.6 0.01 0.00 1 0.014 0 0 2021-07-26T15:58:01.312 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: L6 1/0 17.41 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:58:01.312 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Sum 2/0 25.21 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 553.6 0.01 0.00 1 0.014 0 0 2021-07-26T15:58:01.313 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:58:01.313 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: ** Compaction Stats [default] ** 2021-07-26T15:58:01.313 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:01.313 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:01.314 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 553.6 0.01 0.00 1 0.014 0 0 2021-07-26T15:58:01.314 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:58:01.314 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Flush(GB): cumulative 0.008, interval 0.000 2021-07-26T15:58:01.314 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:58:01.314 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:58:01.315 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:58:01.315 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:58:01.316 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Cumulative compaction: 0.01 GB write, 233.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:01.316 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:01.316 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:58:01.317 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:58:01.317 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.887+0000 7fc4e6ab2700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] at bind addrs [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:58:01.317 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.887+0000 7fc4e6ab2700 1 mon.a@-1(???) e3 preinit fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:58:01.317 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.887+0000 7fc4e6ab2700 0 mon.a@-1(???).mds e1 new map 2021-07-26T15:58:01.317 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.887+0000 7fc4e6ab2700 0 mon.a@-1(???).mds e1 print_map 2021-07-26T15:58:01.318 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: e1 2021-07-26T15:58:01.318 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: enable_multiple, ever_enabled_multiple: 1,1 2021-07-26T15:58:01.318 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-07-26T15:58:01.319 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: legacy client fscid: -1 2021-07-26T15:58:01.319 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: 2021-07-26T15:58:01.319 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: No filesystems configured 2021-07-26T15:58:01.319 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.887+0000 7fc4e6ab2700 0 mon.a@-1(???).osd e137 crush map has features 3314933069571702784, adjusting msgr requires 2021-07-26T15:58:01.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.887+0000 7fc4e6ab2700 0 mon.a@-1(???).osd e137 crush map has features 288514119978713088, adjusting msgr requires 2021-07-26T15:58:01.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.887+0000 7fc4e6ab2700 0 mon.a@-1(???).osd e137 crush map has features 288514119978713088, adjusting msgr requires 2021-07-26T15:58:01.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.887+0000 7fc4e6ab2700 0 mon.a@-1(???).osd e137 crush map has features 288514119978713088, adjusting msgr requires 2021-07-26T15:58:01.321 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:00 smithi033 bash[41341]: debug 2021-07-26T15:58:00.887+0000 7fc4e6ab2700 1 mon.a@-1(???).paxosservice(auth 1..17) refresh upgraded, format 0 -> 3 2021-07-26T15:58:01.609 INFO:tasks.rados.rados.0.smithi033.stdout:456: done (4 left) 2021-07-26T15:58:01.609 INFO:tasks.rados.rados.0.smithi033.stdout:457: done (3 left) 2021-07-26T15:58:01.609 INFO:tasks.rados.rados.0.smithi033.stdout:458: done (2 left) 2021-07-26T15:58:01.610 INFO:tasks.rados.rados.0.smithi033.stdout:459: done (1 left) 2021-07-26T15:58:01.610 INFO:tasks.rados.rados.0.smithi033.stdout:460: done (0 left) 2021-07-26T15:58:01.610 INFO:tasks.rados.rados.0.smithi033.stdout:461: snap_create 2021-07-26T15:58:01.958 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[39943]: ignoring --setuser ceph since I am not root 2021-07-26T15:58:01.958 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[39943]: ignoring --setgroup ceph since I am not root 2021-07-26T15:58:01.959 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[39943]: debug 2021-07-26T15:58:01.607+0000 7fa502715700 1 -- 172.21.15.33:0/1608414526 <== mon.1 v2:172.21.15.33:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d402e7e340 con 0x55d403bf0400 2021-07-26T15:58:01.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: audit 2021-07-26T15:57:58.468278+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:58:01.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: audit 2021-07-26T15:57:58.470372+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:58:01.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: audit 2021-07-26T15:57:58.471239+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:58:01.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: cluster 2021-07-26T15:57:58.668067+0000 mgr.y (mgr.14712) 24 : cluster [DBG] pgmap v37: 25 pgs: 25 active+clean; 128 MiB data, 346 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 554 KiB/s wr, 29 op/s 2021-07-26T15:58:01.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: cluster 2021-07-26T15:58:00.668808+0000 mgr.y (mgr.14712) 25 : cluster [DBG] pgmap v38: 25 pgs: 25 active+clean; 128 MiB data, 346 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 413 KiB/s wr, 21 op/s 2021-07-26T15:58:01.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: cluster 2021-07-26T15:58:01.509227+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-07-26T15:58:01.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: cluster 2021-07-26T15:58:01.531458+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:58:01.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: cluster 2021-07-26T15:58:01.539779+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:58:01.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: cluster 2021-07-26T15:58:01.539834+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-07-26T15:58:01.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: cluster 2021-07-26T15:58:01.539867+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-07-26T15:58:01.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: cluster 2021-07-26T15:58:01.540912+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e26: y(active, since 25s), standbys: x 2021-07-26T15:58:01.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: cluster 2021-07-26T15:58:01.557703+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e27: y(active, since 25s), standbys: x 2021-07-26T15:58:01.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: cluster 2021-07-26T15:58:01.557820+0000 mon.a (mon.0) 8 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:01.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:01 smithi033 bash[19094]: audit 2021-07-26T15:58:01.558350+0000 mon.a (mon.0) 9 : audit [INF] from='mgr.14712 ' entity='' 2021-07-26T15:58:01.987 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[32559]: ignoring --setuser ceph since I am not root 2021-07-26T15:58:01.988 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[32559]: ignoring --setgroup ceph since I am not root 2021-07-26T15:58:01.988 INFO:journalctl@ceph.mgr.x.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[32559]: debug 2021-07-26T15:58:01.603+0000 7fd03b115700 1 -- 172.21.15.96:0/4221879522 <== mon.2 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ca2201e340 con 0x55ca22d90800 2021-07-26T15:58:01.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: audit 2021-07-26T15:57:58.468278+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:58:01.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: audit 2021-07-26T15:57:58.470372+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:58:01.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: audit 2021-07-26T15:57:58.471239+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.14712 172.21.15.33:0/3882225048' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:58:01.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: cluster 2021-07-26T15:57:58.668067+0000 mgr.y (mgr.14712) 24 : cluster [DBG] pgmap v37: 25 pgs: 25 active+clean; 128 MiB data, 346 MiB used, 715 GiB / 715 GiB avail; 2.4 MiB/s rd, 554 KiB/s wr, 29 op/s 2021-07-26T15:58:01.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: cluster 2021-07-26T15:58:00.668808+0000 mgr.y (mgr.14712) 25 : cluster [DBG] pgmap v38: 25 pgs: 25 active+clean; 128 MiB data, 346 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 413 KiB/s wr, 21 op/s 2021-07-26T15:58:01.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: cluster 2021-07-26T15:58:01.509227+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2021-07-26T15:58:01.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: cluster 2021-07-26T15:58:01.531458+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:58:01.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: cluster 2021-07-26T15:58:01.539779+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:58:01.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: cluster 2021-07-26T15:58:01.539834+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-07-26T15:58:01.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: cluster 2021-07-26T15:58:01.539867+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-07-26T15:58:01.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: cluster 2021-07-26T15:58:01.540912+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e26: y(active, since 25s), standbys: x 2021-07-26T15:58:01.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: cluster 2021-07-26T15:58:01.557703+0000 mon.a (mon.0) 7 : cluster [DBG] mgrmap e27: y(active, since 25s), standbys: x 2021-07-26T15:58:01.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: cluster 2021-07-26T15:58:01.557820+0000 mon.a (mon.0) 8 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:01.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:01 smithi096 bash[15117]: audit 2021-07-26T15:58:01.558350+0000 mon.a (mon.0) 9 : audit [INF] from='mgr.14712 ' entity='' 2021-07-26T15:58:02.613 INFO:tasks.rados.rados.0.smithi033.stdout:461: done (0 left) 2021-07-26T15:58:02.614 INFO:tasks.rados.rados.0.smithi033.stdout:462: setattr oid 4 current snap is 41 2021-07-26T15:58:02.617 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 41 2021-07-26T15:58:02.617 INFO:tasks.rados.rados.0.smithi033.stdout:463: seq_num 162 ranges {221184=319488} 2021-07-26T15:58:02.621 INFO:tasks.rados.rados.0.smithi033.stdout:463: writing smithi03339061-14 from 221184 to 540672 tid 1 2021-07-26T15:58:02.622 INFO:tasks.rados.rados.0.smithi033.stdout:464: read oid 16 snap 40 2021-07-26T15:58:02.622 INFO:tasks.rados.rados.0.smithi033.stdout:464: expect deleted 2021-07-26T15:58:02.622 INFO:tasks.rados.rados.0.smithi033.stdout:465: rmattr oid 10 current snap is 41 2021-07-26T15:58:02.622 INFO:tasks.rados.rados.0.smithi033.stdout:465: done (3 left) 2021-07-26T15:58:02.623 INFO:tasks.rados.rados.0.smithi033.stdout:466: copy_from oid 41 from oid 17 current snap is 41 2021-07-26T15:58:02.623 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 138 (ObjNum 161 snap 39 seq_num 161) dirty exists 2021-07-26T15:58:02.623 INFO:tasks.rados.rados.0.smithi033.stdout:462: done (3 left) 2021-07-26T15:58:02.623 INFO:tasks.rados.rados.0.smithi033.stdout:467: delete oid 22 current snap is 41 2021-07-26T15:58:02.625 INFO:tasks.rados.rados.0.smithi033.stdout:463: finishing write tid 1 to smithi03339061-14 2021-07-26T15:58:02.626 INFO:tasks.rados.rados.0.smithi033.stdout:463: finishing write tid 2 to smithi03339061-14 2021-07-26T15:58:02.627 INFO:tasks.rados.rados.0.smithi033.stdout:464: done (3 left) 2021-07-26T15:58:02.627 INFO:tasks.rados.rados.0.smithi033.stdout:467: done (2 left) 2021-07-26T15:58:02.627 INFO:tasks.rados.rados.0.smithi033.stdout:468: rmattr oid 20 current snap is 41 2021-07-26T15:58:02.628 INFO:tasks.rados.rados.0.smithi033.stdout:468: done (2 left) 2021-07-26T15:58:02.628 INFO:tasks.rados.rados.0.smithi033.stdout:469: rollback oid 47 current snap is 41 2021-07-26T15:58:02.628 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 47 to 40 2021-07-26T15:58:02.628 INFO:tasks.rados.rados.0.smithi033.stdout:470: copy_from oid 2 from oid 48 current snap is 41 2021-07-26T15:58:02.628 INFO:tasks.rados.rados.0.smithi033.stdout:471: read oid 4 snap -1 2021-07-26T15:58:02.629 INFO:tasks.rados.rados.0.smithi033.stdout:471: expect (ObjNum 161 snap 39 seq_num 161) 2021-07-26T15:58:02.629 INFO:tasks.rados.rados.0.smithi033.stdout:472: snap_remove snap 29 2021-07-26T15:58:02.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:02 smithi033 bash[19094]: cluster 2021-07-26T15:58:01.606824+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-07-26T15:58:02.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:02 smithi096 bash[15117]: cluster 2021-07-26T15:58:01.606824+0000 mon.a (mon.0) 10 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-07-26T15:58:03.637 INFO:tasks.rados.rados.0.smithi033.stdout:463: finishing write tid 3 to smithi03339061-14 2021-07-26T15:58:03.637 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 141 (ObjNum 162 snap 41 seq_num 162) dirty exists 2021-07-26T15:58:03.637 INFO:tasks.rados.rados.0.smithi033.stdout:463: left oid 14 (ObjNum 162 snap 41 seq_num 162) 2021-07-26T15:58:03.637 INFO:tasks.rados.rados.0.smithi033.stdout:469: finishing rollback tid 1 to smithi03339061-47 2021-07-26T15:58:03.638 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 98 (ObjNum 2006297856 snap 22002 seq_num 2006297856) dirty dne 2021-07-26T15:58:03.639 INFO:tasks.rados.rados.0.smithi033.stdout:471: expect (ObjNum 161 snap 39 seq_num 161) 2021-07-26T15:58:03.652 INFO:tasks.rados.rados.0.smithi033.stdout:466: finishing copy_from to smithi03339061-41 2021-07-26T15:58:03.653 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 3 (ObjNum 7 snap 0 seq_num 7) dirty exists 2021-07-26T15:58:03.653 INFO:tasks.rados.rados.0.smithi033.stdout:466: finishing copy_from racing read to smithi03339061-41 2021-07-26T15:58:03.653 INFO:tasks.rados.rados.0.smithi033.stdout:470: finishing copy_from to smithi03339061-2 2021-07-26T15:58:03.653 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 145 (ObjNum 151 snap 38 seq_num 151) dirty exists 2021-07-26T15:58:03.653 INFO:tasks.rados.rados.0.smithi033.stdout:470: finishing copy_from racing read to smithi03339061-2 2021-07-26T15:58:03.654 INFO:tasks.rados.rados.0.smithi033.stdout:463: done (5 left) 2021-07-26T15:58:03.654 INFO:tasks.rados.rados.0.smithi033.stdout:466: done (4 left) 2021-07-26T15:58:03.654 INFO:tasks.rados.rados.0.smithi033.stdout:469: done (3 left) 2021-07-26T15:58:03.654 INFO:tasks.rados.rados.0.smithi033.stdout:470: done (2 left) 2021-07-26T15:58:03.655 INFO:tasks.rados.rados.0.smithi033.stdout:471: done (1 left) 2021-07-26T15:58:03.655 INFO:tasks.rados.rados.0.smithi033.stdout:472: done (0 left) 2021-07-26T15:58:03.655 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 41 2021-07-26T15:58:03.655 INFO:tasks.rados.rados.0.smithi033.stdout:473: seq_num 164 ranges {540672=352256} 2021-07-26T15:58:03.657 INFO:tasks.rados.rados.0.smithi033.stdout:473: writing smithi03339061-14 from 540672 to 892928 tid 1 2021-07-26T15:58:03.657 INFO:tasks.rados.rados.0.smithi033.stdout:474: delete oid 1 current snap is 41 2021-07-26T15:58:03.659 INFO:tasks.rados.rados.0.smithi033.stdout:474: done (1 left) 2021-07-26T15:58:03.660 INFO:tasks.rados.rados.0.smithi033.stdout:475: snap_create 2021-07-26T15:58:03.662 INFO:tasks.rados.rados.0.smithi033.stdout:473: finishing write tid 1 to smithi03339061-14 2021-07-26T15:58:03.662 INFO:tasks.rados.rados.0.smithi033.stdout:473: finishing write tid 2 to smithi03339061-14 2021-07-26T15:58:03.662 INFO:tasks.rados.rados.0.smithi033.stdout:473: finishing write tid 3 to smithi03339061-14 2021-07-26T15:58:03.663 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 149 (ObjNum 164 snap 41 seq_num 164) dirty exists 2021-07-26T15:58:03.663 INFO:tasks.rados.rados.0.smithi033.stdout:473: left oid 14 (ObjNum 164 snap 41 seq_num 164) 2021-07-26T15:58:03.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:03 smithi033 bash[19094]: cluster 2021-07-26T15:58:02.610733+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-07-26T15:58:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:03 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:03.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:03 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:03.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:03 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:03.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T15:58:03.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:03 smithi096 bash[15117]: cluster 2021-07-26T15:58:02.610733+0000 mon.a (mon.0) 11 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-07-26T15:58:04.638 INFO:tasks.rados.rados.0.smithi033.stdout:473: done (1 left) 2021-07-26T15:58:04.639 INFO:tasks.rados.rados.0.smithi033.stdout:475: done (0 left) 2021-07-26T15:58:04.639 INFO:tasks.rados.rados.0.smithi033.stdout:476: snap_create 2021-07-26T15:58:04.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:04 smithi033 bash[19094]: cluster 2021-07-26T15:58:03.626869+0000 mon.a (mon.0) 12 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-07-26T15:58:04.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:04 smithi096 bash[15117]: cluster 2021-07-26T15:58:03.626869+0000 mon.a (mon.0) 12 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-07-26T15:58:05.651 INFO:tasks.rados.rados.0.smithi033.stdout:476: done (0 left) 2021-07-26T15:58:05.651 INFO:tasks.rados.rados.0.smithi033.stdout:477: snap_remove snap 22 2021-07-26T15:58:05.910 INFO:tasks.rados.rados.0.smithi033.stdout:477: done (0 left) 2021-07-26T15:58:05.910 INFO:tasks.rados.rados.0.smithi033.stdout:478: read oid 21 snap -1 2021-07-26T15:58:05.911 INFO:tasks.rados.rados.0.smithi033.stdout:478: expect (ObjNum 155 snap 39 seq_num 155) 2021-07-26T15:58:05.911 INFO:tasks.rados.rados.0.smithi033.stdout:479: snap_remove snap 37 2021-07-26T15:58:05.911 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:05 smithi033 bash[19094]: cluster 2021-07-26T15:58:04.636192+0000 mon.a (mon.0) 13 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-07-26T15:58:05.918 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:05 smithi096 bash[15117]: cluster 2021-07-26T15:58:04.636192+0000 mon.a (mon.0) 13 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-07-26T15:58:06.208 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:58:05 smithi033 bash[29474]: debug 2021-07-26T15:58:05.915+0000 7f0ab925e700 -1 osd.3 pg_epoch: 143 pg[3.7s0( v 143'122 (0'0,143'122] local-lis/les=57/58 n=8 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [3,0,7]p3(0) r=0 lpr=57 luod=140'120 crt=140'120 lcod 140'118 mlcod 140'118 active+clean+snaptrim trimq=[2b~1] ps=[35~1,46~1]] removing snap head 2021-07-26T15:58:06.209 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:58:05 smithi033 bash[29474]: debug 2021-07-26T15:58:05.935+0000 7f0abfa6b700 -1 osd.3 pg_epoch: 143 pg[3.2s0( v 140'238 (0'0,140'238] local-lis/les=57/58 n=13 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [3,5,6]p3(0) r=0 lpr=57 crt=140'238 lcod 140'236 mlcod 140'236 active+clean+snaptrim trimq=[2b~1] ps=[35~1,46~1]] removing snap head 2021-07-26T15:58:06.209 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:58:05 smithi033 bash[24389]: debug 2021-07-26T15:58:05.907+0000 7f93f8804700 -1 osd.1 pg_epoch: 143 pg[3.0s0( v 143'156 (0'0,143'156] local-lis/les=57/58 n=6 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [1,2,6]p1(0) r=0 lpr=57 luod=140'154 crt=140'154 lcod 140'152 mlcod 140'152 active+clean+snaptrim trimq=[2b~1] ps=[35~1,46~1]] removing snap head 2021-07-26T15:58:06.209 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:58:05 smithi033 bash[24389]: debug 2021-07-26T15:58:05.927+0000 7f93f27f8700 -1 osd.1 pg_epoch: 143 pg[3.4s0( v 143'153 (0'0,143'153] local-lis/les=57/58 n=7 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [1,2,6]p1(0) r=0 lpr=57 crt=143'153 lcod 143'151 mlcod 143'151 active+clean+snaptrim trimq=[2b~1] ps=[35~1,46~1]] removing snap head 2021-07-26T15:58:06.238 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:58:05 smithi096 bash[17896]: debug 2021-07-26T15:58:05.919+0000 7f4643f94700 -1 osd.4 pg_epoch: 143 pg[3.3s0( v 140'126 (0'0,140'126] local-lis/les=57/58 n=5 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [4,1,0]p4(0) r=0 lpr=57 crt=140'126 lcod 140'124 mlcod 140'124 active+clean+snaptrim trimq=[2b~1] ps=[35~1,46~1]] removing snap head 2021-07-26T15:58:06.238 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:58:05 smithi096 bash[23105]: debug 2021-07-26T15:58:05.911+0000 7f3de10ce700 -1 osd.6 pg_epoch: 143 pg[3.as0( v 140'64 (0'0,140'64] local-lis/les=57/58 n=4 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [6,4,1]p6(0) r=0 lpr=57 crt=140'64 lcod 140'62 mlcod 140'62 active+clean+snaptrim trimq=[2b~1] ps=[35~1,46~1]] removing snap head 2021-07-26T15:58:06.239 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:58:05 smithi096 bash[25729]: debug 2021-07-26T15:58:05.919+0000 7fd5f3e6d700 -1 osd.7 pg_epoch: 143 pg[3.ds0( v 140'61 (0'0,140'61] local-lis/les=57/58 n=4 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [7,5,3]p7(0) r=0 lpr=57 crt=140'61 lcod 137'59 mlcod 137'59 active+clean+snaptrim trimq=[2b~1] ps=[35~1,46~1]] removing snap head 2021-07-26T15:58:06.914 INFO:tasks.rados.rados.0.smithi033.stdout:478: expect (ObjNum 155 snap 39 seq_num 155) 2021-07-26T15:58:06.919 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:06 smithi033 bash[19094]: cluster 2021-07-26T15:58:05.648127+0000 mon.a (mon.0) 14 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-07-26T15:58:06.919 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:06 smithi033 bash[19094]: cluster 2021-07-26T15:58:05.906878+0000 mon.a (mon.0) 15 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-07-26T15:58:06.929 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:06 smithi096 bash[15117]: cluster 2021-07-26T15:58:05.648127+0000 mon.a (mon.0) 14 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-07-26T15:58:06.929 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:06 smithi096 bash[15117]: cluster 2021-07-26T15:58:05.906878+0000 mon.a (mon.0) 15 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-07-26T15:58:06.929 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:58:06 smithi096 bash[20458]: debug 2021-07-26T15:58:06.923+0000 7f2dd0737700 -1 osd.5 pg_epoch: 144 pg[3.cs0( v 144'173 (0'0,144'173] local-lis/les=57/58 n=6 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [5,3,6]p5(0) r=0 lpr=57 luod=143'171 crt=143'171 lcod 143'169 mlcod 143'169 active+clean+snaptrim trimq=[48~1] ps=[2b~1,35~1,46~1]] removing snap head 2021-07-26T15:58:06.937 INFO:tasks.rados.rados.0.smithi033.stdout:478: done (1 left) 2021-07-26T15:58:06.937 INFO:tasks.rados.rados.0.smithi033.stdout:479: done (0 left) 2021-07-26T15:58:06.937 INFO:tasks.rados.rados.0.smithi033.stdout:480: snap_remove snap 41 2021-07-26T15:58:07.208 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:58:06 smithi033 bash[29474]: debug 2021-07-26T15:58:06.915+0000 7f0abfa6b700 -1 osd.3 pg_epoch: 144 pg[3.2s0( v 144'250 (0'0,144'250] local-lis/les=57/58 n=6 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [3,5,6]p3(0) r=0 lpr=57 luod=143'248 crt=143'248 lcod 143'246 mlcod 143'246 active+clean+snaptrim trimq=[48~1] ps=[2b~1,35~1,46~1]] removing snap head 2021-07-26T15:58:07.210 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:58:06 smithi033 bash[21582]: debug 2021-07-26T15:58:06.915+0000 7f5ffb483700 -1 osd.0 pg_epoch: 144 pg[3.1s0( v 143'138 (0'0,143'138] local-lis/les=57/58 n=6 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [0,4,3]p0(0) r=0 lpr=57 crt=143'138 lcod 143'136 mlcod 143'136 active+clean+snaptrim trimq=[48~1] ps=[2b~1,35~1,46~1]] removing snap head 2021-07-26T15:58:07.210 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:58:06 smithi033 bash[21582]: debug 2021-07-26T15:58:06.915+0000 7f5ffb483700 -1 osd.0 pg_epoch: 144 pg[3.1s0( v 144'140 (0'0,144'140] local-lis/les=57/58 n=4 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [0,4,3]p0(0) r=0 lpr=57 luod=143'138 crt=143'138 lcod 143'136 mlcod 143'136 active+clean+snaptrim trimq=[48~1] ps=[2b~1,35~1,46~1]] removing snap head 2021-07-26T15:58:07.916 INFO:tasks.rados.rados.0.smithi033.stdout:480: done (0 left) 2021-07-26T15:58:07.916 INFO:tasks.rados.rados.0.smithi033.stdout:481: copy_from oid 40 from oid 18 current snap is 43 2021-07-26T15:58:07.916 INFO:tasks.rados.rados.0.smithi033.stdout:482: rollback oid 8 current snap is 43 2021-07-26T15:58:07.917 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 8 to 42 2021-07-26T15:58:07.917 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 43 2021-07-26T15:58:07.917 INFO:tasks.rados.rados.0.smithi033.stdout:483: seq_num 166 ranges {0=385024} 2021-07-26T15:58:07.920 INFO:tasks.rados.rados.0.smithi033.stdout:483: writing smithi03339061-43 from 0 to 385024 tid 1 2021-07-26T15:58:07.920 INFO:tasks.rados.rados.0.smithi033.stdout:484: snap_create 2021-07-26T15:58:07.920 INFO:tasks.rados.rados.0.smithi033.stdout:482: finishing rollback tid 1 to smithi03339061-8 2021-07-26T15:58:07.921 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 0 (ObjNum 1 snap 32561 seq_num 2006374544) dirty dne 2021-07-26T15:58:07.925 INFO:tasks.rados.rados.0.smithi033.stdout:483: finishing write tid 1 to smithi03339061-43 2021-07-26T15:58:07.925 INFO:tasks.rados.rados.0.smithi033.stdout:483: finishing write tid 2 to smithi03339061-43 2021-07-26T15:58:07.927 INFO:tasks.rados.rados.0.smithi033.stdout:483: finishing write tid 3 to smithi03339061-43 2021-07-26T15:58:07.928 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 179 (ObjNum 166 snap 43 seq_num 166) dirty exists 2021-07-26T15:58:07.928 INFO:tasks.rados.rados.0.smithi033.stdout:483: left oid 43 (ObjNum 166 snap 43 seq_num 166) 2021-07-26T15:58:07.959 INFO:tasks.rados.rados.0.smithi033.stdout:481: finishing copy_from to smithi03339061-40 2021-07-26T15:58:07.960 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 172 (ObjNum 115 snap 26 seq_num 115) dirty exists 2021-07-26T15:58:07.960 INFO:tasks.rados.rados.0.smithi033.stdout:481: finishing copy_from racing read to smithi03339061-40 2021-07-26T15:58:08.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:07 smithi033 bash[19094]: cluster 2021-07-26T15:58:06.910377+0000 mon.a (mon.0) 16 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-07-26T15:58:08.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:07 smithi096 bash[15117]: cluster 2021-07-26T15:58:06.910377+0000 mon.a (mon.0) 16 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-07-26T15:58:08.306 INFO:tasks.rados.rados.0.smithi033.stdout:481: done (3 left) 2021-07-26T15:58:08.307 INFO:tasks.rados.rados.0.smithi033.stdout:482: done (2 left) 2021-07-26T15:58:08.307 INFO:tasks.rados.rados.0.smithi033.stdout:483: done (1 left) 2021-07-26T15:58:08.307 INFO:tasks.rados.rados.0.smithi033.stdout:484: done (0 left) 2021-07-26T15:58:08.307 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 17 current snap is 44 2021-07-26T15:58:08.308 INFO:tasks.rados.rados.0.smithi033.stdout:485: seq_num 167 ranges {122880=401408} 2021-07-26T15:58:08.312 INFO:tasks.rados.rados.0.smithi033.stdout:485: writing smithi03339061-17 from 122880 to 524288 tid 1 2021-07-26T15:58:08.312 INFO:tasks.rados.rados.0.smithi033.stdout:486: copy_from oid 28 from oid 42 current snap is 44 2021-07-26T15:58:08.312 INFO:tasks.rados.rados.0.smithi033.stdout:487: rollback oid 15 current snap is 44 2021-07-26T15:58:08.312 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 15 to 42 2021-07-26T15:58:08.313 INFO:tasks.rados.rados.0.smithi033.stdout:488: rollback oid 33 current snap is 44 2021-07-26T15:58:08.313 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 43 2021-07-26T15:58:08.313 INFO:tasks.rados.rados.0.smithi033.stdout:489: delete oid 46 current snap is 44 2021-07-26T15:58:08.322 INFO:tasks.rados.rados.0.smithi033.stdout:486: finishing copy_from to smithi03339061-28 2021-07-26T15:58:08.322 INFO:tasks.rados.rados.0.smithi033.stdout:486: got expected ENOENT (src dne) 2021-07-26T15:58:08.322 INFO:tasks.rados.rados.0.smithi033.stdout:486: finishing copy_from racing read to smithi03339061-28 2021-07-26T15:58:08.323 INFO:tasks.rados.rados.0.smithi033.stdout:486: done (4 left) 2021-07-26T15:58:08.324 INFO:tasks.rados.rados.0.smithi033.stdout:489: done (3 left) 2021-07-26T15:58:08.324 INFO:tasks.rados.rados.0.smithi033.stdout:490: read oid 22 snap 39 2021-07-26T15:58:08.324 INFO:tasks.rados.rados.0.smithi033.stdout:490: expect (ObjNum 153 snap 39 seq_num 153) 2021-07-26T15:58:08.324 INFO:tasks.rados.rados.0.smithi033.stdout:491: read oid 4 snap -1 2021-07-26T15:58:08.325 INFO:tasks.rados.rados.0.smithi033.stdout:491: expect (ObjNum 161 snap 39 seq_num 161) 2021-07-26T15:58:08.325 INFO:tasks.rados.rados.0.smithi033.stdout:492: rmattr oid 37 current snap is 44 2021-07-26T15:58:08.325 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 44 2021-07-26T15:58:08.325 INFO:tasks.rados.rados.0.smithi033.stdout:493: seq_num 169 ranges {0=434176} 2021-07-26T15:58:08.329 INFO:tasks.rados.rados.0.smithi033.stdout:493: writing smithi03339061-7 from 0 to 434176 tid 1 2021-07-26T15:58:08.330 INFO:tasks.rados.rados.0.smithi033.stdout:494: read oid 19 snap -1 2021-07-26T15:58:08.330 INFO:tasks.rados.rados.0.smithi033.stdout:494: expect (ObjNum 36 snap 0 seq_num 36) 2021-07-26T15:58:08.330 INFO:tasks.rados.rados.0.smithi033.stdout:495: read oid 18 snap -1 2021-07-26T15:58:08.330 INFO:tasks.rados.rados.0.smithi033.stdout:495: expect (ObjNum 115 snap 26 seq_num 115) 2021-07-26T15:58:08.331 INFO:tasks.rados.rados.0.smithi033.stdout:496: rollback oid 6 current snap is 44 2021-07-26T15:58:08.331 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 42 2021-07-26T15:58:08.331 INFO:tasks.rados.rados.0.smithi033.stdout:497: delete oid 48 current snap is 44 2021-07-26T15:58:08.331 INFO:tasks.rados.rados.0.smithi033.stdout:487: finishing rollback tid 0 to smithi03339061-15 2021-07-26T15:58:08.332 INFO:tasks.rados.rados.0.smithi033.stdout:487: finishing rollback tid 1 to smithi03339061-15 2021-07-26T15:58:08.332 INFO:tasks.rados.rados.0.smithi033.stdout:485: finishing write tid 1 to smithi03339061-17 2021-07-26T15:58:08.332 INFO:tasks.rados.rados.0.smithi033.stdout:488: finishing rollback tid 0 to smithi03339061-33 2021-07-26T15:58:08.332 INFO:tasks.rados.rados.0.smithi033.stdout:488: finishing rollback tid 1 to smithi03339061-33 2021-07-26T15:58:08.332 INFO:tasks.rados.rados.0.smithi033.stdout:488: finishing rollback tid 2 to smithi03339061-33 2021-07-26T15:58:08.333 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 285 (ObjNum 130 snap 32 seq_num 130) dirty exists 2021-07-26T15:58:08.333 INFO:tasks.rados.rados.0.smithi033.stdout:487: finishing rollback tid 2 to smithi03339061-15 2021-07-26T15:58:08.333 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 136 (ObjNum 157 snap 39 seq_num 157) dirty exists 2021-07-26T15:58:08.333 INFO:tasks.rados.rados.0.smithi033.stdout:485: finishing write tid 2 to smithi03339061-17 2021-07-26T15:58:08.333 INFO:tasks.rados.rados.0.smithi033.stdout:485: finishing write tid 3 to smithi03339061-17 2021-07-26T15:58:08.334 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 174 (ObjNum 167 snap 44 seq_num 167) dirty exists 2021-07-26T15:58:08.334 INFO:tasks.rados.rados.0.smithi033.stdout:485: left oid 17 (ObjNum 167 snap 44 seq_num 167) 2021-07-26T15:58:08.334 INFO:tasks.rados.rados.0.smithi033.stdout:491: expect (ObjNum 161 snap 39 seq_num 161) 2021-07-26T15:58:08.345 INFO:tasks.rados.rados.0.smithi033.stdout:485: done (10 left) 2021-07-26T15:58:08.346 INFO:tasks.rados.rados.0.smithi033.stdout:487: done (9 left) 2021-07-26T15:58:08.346 INFO:tasks.rados.rados.0.smithi033.stdout:488: done (8 left) 2021-07-26T15:58:08.346 INFO:tasks.rados.rados.0.smithi033.stdout:491: done (7 left) 2021-07-26T15:58:08.346 INFO:tasks.rados.rados.0.smithi033.stdout:497: done (6 left) 2021-07-26T15:58:08.347 INFO:tasks.rados.rados.0.smithi033.stdout:498: rmattr oid 9 current snap is 44 2021-07-26T15:58:08.347 INFO:tasks.rados.rados.0.smithi033.stdout:498: done (6 left) 2021-07-26T15:58:08.347 INFO:tasks.rados.rados.0.smithi033.stdout:499: snap_create 2021-07-26T15:58:08.347 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 132 (ObjNum 36 snap 0 seq_num 36) dirty exists 2021-07-26T15:58:08.347 INFO:tasks.rados.rados.0.smithi033.stdout:490: expect (ObjNum 153 snap 39 seq_num 153) 2021-07-26T15:58:08.351 INFO:tasks.rados.rados.0.smithi033.stdout:494: expect (ObjNum 36 snap 0 seq_num 36) 2021-07-26T15:58:08.369 INFO:tasks.rados.rados.0.smithi033.stdout:493: finishing write tid 1 to smithi03339061-7 2021-07-26T15:58:08.369 INFO:tasks.rados.rados.0.smithi033.stdout:493: finishing write tid 2 to smithi03339061-7 2021-07-26T15:58:08.369 INFO:tasks.rados.rados.0.smithi033.stdout:496: finishing rollback tid 0 to smithi03339061-6 2021-07-26T15:58:08.370 INFO:tasks.rados.rados.0.smithi033.stdout:496: finishing rollback tid 1 to smithi03339061-6 2021-07-26T15:58:08.370 INFO:tasks.rados.rados.0.smithi033.stdout:496: finishing rollback tid 2 to smithi03339061-6 2021-07-26T15:58:08.370 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 289 (ObjNum 99 snap 18 seq_num 99) dirty exists 2021-07-26T15:58:08.370 INFO:tasks.rados.rados.0.smithi033.stdout:493: finishing write tid 3 to smithi03339061-7 2021-07-26T15:58:08.370 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 256 (ObjNum 169 snap 44 seq_num 169) dirty exists 2021-07-26T15:58:08.371 INFO:tasks.rados.rados.0.smithi033.stdout:493: left oid 7 (ObjNum 169 snap 44 seq_num 169) 2021-07-26T15:58:08.371 INFO:tasks.rados.rados.0.smithi033.stdout:495: expect (ObjNum 115 snap 26 seq_num 115) 2021-07-26T15:58:09.180 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:08 smithi033 bash[19094]: cluster 2021-07-26T15:58:07.912962+0000 mon.a (mon.0) 17 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-07-26T15:58:09.180 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:08 smithi033 bash[19094]: cluster 2021-07-26T15:58:07.939603+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x restarted 2021-07-26T15:58:09.180 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:08 smithi033 bash[19094]: cluster 2021-07-26T15:58:07.939726+0000 mon.a (mon.0) 19 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:58:09.181 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:08 smithi033 bash[19094]: audit 2021-07-26T15:58:07.943205+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.? 172.21.15.96:0/1002878273' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:58:09.181 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:08 smithi033 bash[19094]: audit 2021-07-26T15:58:07.944166+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.? 172.21.15.96:0/1002878273' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:58:09.181 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:08 smithi033 bash[19094]: audit 2021-07-26T15:58:07.945642+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.? 172.21.15.96:0/1002878273' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:58:09.182 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:08 smithi033 bash[19094]: audit 2021-07-26T15:58:07.946256+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.? 172.21.15.96:0/1002878273' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:58:09.182 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:08 smithi033 bash[19094]: cluster 2021-07-26T15:58:08.293237+0000 mon.a (mon.0) 20 : cluster [INF] Active manager daemon y restarted 2021-07-26T15:58:09.182 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:08 smithi033 bash[19094]: cluster 2021-07-26T15:58:08.294759+0000 mon.a (mon.0) 21 : cluster [INF] Activating manager daemon y 2021-07-26T15:58:09.183 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:08 smithi033 bash[19094]: cluster 2021-07-26T15:58:08.300924+0000 mon.a (mon.0) 22 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-07-26T15:58:09.197 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:08 smithi096 bash[15117]: cluster 2021-07-26T15:58:07.912962+0000 mon.a (mon.0) 17 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-07-26T15:58:09.197 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:08 smithi096 bash[15117]: cluster 2021-07-26T15:58:07.939603+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x restarted 2021-07-26T15:58:09.198 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:08 smithi096 bash[15117]: cluster 2021-07-26T15:58:07.939726+0000 mon.a (mon.0) 19 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:58:09.198 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:08 smithi096 bash[15117]: audit 2021-07-26T15:58:07.943205+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.? 172.21.15.96:0/1002878273' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2021-07-26T15:58:09.198 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:08 smithi096 bash[15117]: audit 2021-07-26T15:58:07.944166+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.? 172.21.15.96:0/1002878273' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-07-26T15:58:09.198 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:08 smithi096 bash[15117]: audit 2021-07-26T15:58:07.945642+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.? 172.21.15.96:0/1002878273' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2021-07-26T15:58:09.199 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:08 smithi096 bash[15117]: audit 2021-07-26T15:58:07.946256+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.? 172.21.15.96:0/1002878273' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-07-26T15:58:09.199 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:08 smithi096 bash[15117]: cluster 2021-07-26T15:58:08.293237+0000 mon.a (mon.0) 20 : cluster [INF] Active manager daemon y restarted 2021-07-26T15:58:09.199 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:08 smithi096 bash[15117]: cluster 2021-07-26T15:58:08.294759+0000 mon.a (mon.0) 21 : cluster [INF] Activating manager daemon y 2021-07-26T15:58:09.199 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:08 smithi096 bash[15117]: cluster 2021-07-26T15:58:08.300924+0000 mon.a (mon.0) 22 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-07-26T15:58:09.305 INFO:tasks.rados.rados.0.smithi033.stdout:490: done (6 left) 2021-07-26T15:58:09.306 INFO:tasks.rados.rados.0.smithi033.stdout:492: done (5 left) 2021-07-26T15:58:09.307 INFO:tasks.rados.rados.0.smithi033.stdout:493: done (4 left) 2021-07-26T15:58:09.307 INFO:tasks.rados.rados.0.smithi033.stdout:494: done (3 left) 2021-07-26T15:58:09.307 INFO:tasks.rados.rados.0.smithi033.stdout:495: done (2 left) 2021-07-26T15:58:09.307 INFO:tasks.rados.rados.0.smithi033.stdout:496: done (1 left) 2021-07-26T15:58:09.307 INFO:tasks.rados.rados.0.smithi033.stdout:499: done (0 left) 2021-07-26T15:58:09.308 INFO:tasks.rados.rados.0.smithi033.stdout:500: delete oid 37 current snap is 45 2021-07-26T15:58:09.311 INFO:tasks.rados.rados.0.smithi033.stdout:500: done (0 left) 2021-07-26T15:58:09.312 INFO:tasks.rados.rados.0.smithi033.stdout:501: read oid 28 snap 44 2021-07-26T15:58:09.312 INFO:tasks.rados.rados.0.smithi033.stdout:501: expect (ObjNum 147 snap 37 seq_num 147) 2021-07-26T15:58:09.312 INFO:tasks.rados.rados.0.smithi033.stdout:502: read oid 2 snap 39 2021-07-26T15:58:09.312 INFO:tasks.rados.rados.0.smithi033.stdout:502: expect (ObjNum 86 snap 17 seq_num 86) 2021-07-26T15:58:09.313 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 45 2021-07-26T15:58:09.313 INFO:tasks.rados.rados.0.smithi033.stdout:503: seq_num 172 ranges {0=483328} 2021-07-26T15:58:09.318 INFO:tasks.rados.rados.0.smithi033.stdout:503: writing smithi03339061-42 from 0 to 483328 tid 1 2021-07-26T15:58:09.318 INFO:tasks.rados.rados.0.smithi033.stdout:504: snap_create 2021-07-26T15:58:09.327 INFO:tasks.rados.rados.0.smithi033.stdout:503: finishing write tid 1 to smithi03339061-42 2021-07-26T15:58:09.327 INFO:tasks.rados.rados.0.smithi033.stdout:503: finishing write tid 2 to smithi03339061-42 2021-07-26T15:58:09.330 INFO:tasks.rados.rados.0.smithi033.stdout:503: finishing write tid 3 to smithi03339061-42 2021-07-26T15:58:09.330 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 70 (ObjNum 172 snap 45 seq_num 172) dirty exists 2021-07-26T15:58:09.330 INFO:tasks.rados.rados.0.smithi033.stdout:503: left oid 42 (ObjNum 172 snap 45 seq_num 172) 2021-07-26T15:58:09.331 INFO:tasks.rados.rados.0.smithi033.stdout:501: expect (ObjNum 147 snap 37 seq_num 147) 2021-07-26T15:58:09.443 INFO:tasks.rados.rados.0.smithi033.stdout:502: expect (ObjNum 86 snap 17 seq_num 86) 2021-07-26T15:58:09.458 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[39943]: Warning: Permanently added '172.21.15.33' (ECDSA) to the list of known hosts. 2021-07-26T15:58:09.458 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[39943]: Warning: Permanently added '172.21.15.96' (ECDSA) to the list of known hosts. 2021-07-26T15:58:09.967 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T15:58:10.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: cluster 2021-07-26T15:58:08.932566+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e28: y(active, starting, since 0.637993s), standbys: x 2021-07-26T15:58:10.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.936779+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:58:10.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.936970+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:58:10.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.937164+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:58:10.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.938732+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-07-26T15:58:10.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.939184+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-07-26T15:58:10.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.939621+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:58:10.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.939958+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:58:10.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.940242+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:58:10.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.940561+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:58:10.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.940958+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:58:10.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.941343+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:58:10.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.941659+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:58:10.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.942069+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:58:10.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.942385+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:58:10.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.942741+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:58:10.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:08.943287+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:58:10.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: cluster 2021-07-26T15:58:08.952903+0000 mon.a (mon.0) 24 : cluster [INF] Manager daemon y is now available 2021-07-26T15:58:10.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:09.107958+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:10.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:09.113491+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:10.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:09.116981+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:10.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:09.120495+0000 mon.c (mon.1) 107 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:10.214 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:09.146184+0000 mon.c (mon.1) 108 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:58:10.214 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:09.146710+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:58:10.214 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:09.178858+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:58:10.215 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:09.179402+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:58:10.215 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: cluster 2021-07-26T15:58:09.302495+0000 mon.a (mon.0) 27 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-07-26T15:58:10.215 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:09 smithi033 bash[19094]: audit 2021-07-26T15:58:09.729498+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:10.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: cluster 2021-07-26T15:58:08.932566+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e28: y(active, starting, since 0.637993s), standbys: x 2021-07-26T15:58:10.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.936779+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:58:10.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.936970+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:58:10.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.937164+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:58:10.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.938732+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-07-26T15:58:10.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.939184+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-07-26T15:58:10.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.939621+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:58:10.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.939958+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:58:10.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.940242+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T15:58:10.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.940561+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:58:10.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.940958+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:58:10.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.941343+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:58:10.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.941659+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:58:10.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.942069+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:58:10.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.942385+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:58:10.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.942741+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:58:10.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:08.943287+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:58:10.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: cluster 2021-07-26T15:58:08.952903+0000 mon.a (mon.0) 24 : cluster [INF] Manager daemon y is now available 2021-07-26T15:58:10.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:09.107958+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:10.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:09.113491+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:10.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:09.116981+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:10.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:09.120495+0000 mon.c (mon.1) 107 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:10.243 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:09.146184+0000 mon.c (mon.1) 108 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:58:10.243 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:09.146710+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:58:10.243 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:09.178858+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:58:10.244 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:09.179402+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:58:10.244 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: cluster 2021-07-26T15:58:09.302495+0000 mon.a (mon.0) 27 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-07-26T15:58:10.244 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:09 smithi096 bash[15117]: audit 2021-07-26T15:58:09.729498+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:10.296 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T15:58:10.296 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (4m) 28s ago 5m 14.3M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T15:58:10.297 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (4m) 17s ago 4m 25.3M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T15:58:10.297 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (22s) 17s ago 9m 124M - 17.0.0-6381-gbccf07c2 6cdb40438e66 909ec99bd712 2021-07-26T15:58:10.298 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (42s) 28s ago 11m 399M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T15:58:10.298 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 starting - - - 2048M 2021-07-26T15:58:10.299 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (9m) 17s ago 9m 51.5M 2048M 16.2.5 34f74fddb18e dce67784fda4 2021-07-26T15:58:10.299 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (9m) 28s ago 9m 48.2M 2048M 16.2.5 34f74fddb18e 18be215b59d8 2021-07-26T15:58:10.299 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (5m) 28s ago 5m 10.7M - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T15:58:10.300 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (5m) 17s ago 5m 11.2M - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T15:58:10.300 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (9m) 28s ago 9m 70.0M 3553M 16.2.5 34f74fddb18e a4b4ebc84a97 2021-07-26T15:58:10.300 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (8m) 28s ago 8m 69.5M 3553M 16.2.5 34f74fddb18e 35137704568f 2021-07-26T15:58:10.301 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (8m) 28s ago 8m 59.0M 3553M 16.2.5 34f74fddb18e d351359286fd 2021-07-26T15:58:10.301 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (7m) 28s ago 7m 95.8M 3553M 16.2.5 34f74fddb18e 6b68e9927be6 2021-07-26T15:58:10.301 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (7m) 17s ago 7m 75.2M 3552M 16.2.5 34f74fddb18e 1aac82d5671e 2021-07-26T15:58:10.302 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (6m) 17s ago 6m 72.6M 3552M 16.2.5 34f74fddb18e 12b89782c2eb 2021-07-26T15:58:10.302 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (6m) 17s ago 6m 58.8M 3552M 16.2.5 34f74fddb18e 4fad5a8407d4 2021-07-26T15:58:10.303 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (5m) 17s ago 6m 52.8M 3552M 16.2.5 34f74fddb18e a988c60ad3d5 2021-07-26T15:58:10.303 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (4m) 17s ago 5m 35.2M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T15:58:10.311 INFO:tasks.rados.rados.0.smithi033.stdout:501: done (3 left) 2021-07-26T15:58:10.311 INFO:tasks.rados.rados.0.smithi033.stdout:502: done (2 left) 2021-07-26T15:58:10.312 INFO:tasks.rados.rados.0.smithi033.stdout:503: done (1 left) 2021-07-26T15:58:10.312 INFO:tasks.rados.rados.0.smithi033.stdout:504: done (0 left) 2021-07-26T15:58:10.312 INFO:tasks.rados.rados.0.smithi033.stdout:505: setattr oid 5 current snap is 46 2021-07-26T15:58:10.313 INFO:tasks.rados.rados.0.smithi033.stdout:506: rollback oid 50 current snap is 46 2021-07-26T15:58:10.314 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 50 to 44 2021-07-26T15:58:10.314 INFO:tasks.rados.rados.0.smithi033.stdout:507: setattr oid 47 current snap is 46 2021-07-26T15:58:10.317 INFO:tasks.rados.rados.0.smithi033.stdout:508: rollback oid 10 current snap is 46 2021-07-26T15:58:10.317 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 10 to 40 2021-07-26T15:58:10.317 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 46 2021-07-26T15:58:10.317 INFO:tasks.rados.rados.0.smithi033.stdout:509: seq_num 173 ranges {253952=499712} 2021-07-26T15:58:10.325 INFO:tasks.rados.rados.0.smithi033.stdout:509: writing smithi03339061-11 from 253952 to 753664 tid 1 2021-07-26T15:58:10.325 INFO:tasks.rados.rados.0.smithi033.stdout:510: snap_remove snap 39 2021-07-26T15:58:10.688 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T15:58:10.688 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T15:58:10.689 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 2, 2021-07-26T15:58:10.689 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 1 2021-07-26T15:58:10.689 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:58:10.689 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T15:58:10.690 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T15:58:10.690 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:58:10.690 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T15:58:10.690 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 8 2021-07-26T15:58:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:58:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T15:58:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T15:58:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 10, 2021-07-26T15:58:10.691 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T15:58:10.692 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T15:58:10.692 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T15:58:11.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:10 smithi096 bash[15117]: cluster 2021-07-26T15:58:09.943740+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e29: y(active, since 1.64918s), standbys: x 2021-07-26T15:58:11.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:10 smithi096 bash[15117]: audit 2021-07-26T15:58:09.946524+0000 mgr.y (mgr.34104) 1 : audit [DBG] from='client.34110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:11.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:10 smithi096 bash[15117]: cluster 2021-07-26T15:58:09.956269+0000 mgr.y (mgr.34104) 2 : cluster [DBG] pgmap v4: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:11.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:10 smithi096 bash[15117]: audit 2021-07-26T15:58:10.272343+0000 mgr.y (mgr.34104) 3 : audit [DBG] from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:11.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:10 smithi096 bash[15117]: cluster 2021-07-26T15:58:10.304990+0000 mon.a (mon.0) 30 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-07-26T15:58:11.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:10 smithi096 bash[15117]: audit 2021-07-26T15:58:10.685873+0000 mon.c (mon.1) 110 : audit [DBG] from='client.? 172.21.15.33:0/3747067038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:11.316 INFO:tasks.rados.rados.0.smithi033.stdout:510: done (5 left) 2021-07-26T15:58:11.316 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 46 2021-07-26T15:58:11.317 INFO:tasks.rados.rados.0.smithi033.stdout:506: finishing rollback tid 0 to smithi03339061-50 2021-07-26T15:58:11.317 INFO:tasks.rados.rados.0.smithi033.stdout:511: seq_num 174 ranges {2760704=516096} 2021-07-26T15:58:11.340 INFO:tasks.rados.rados.0.smithi033.stdout:511: writing smithi03339061-23 from 2760704 to 3276800 tid 1 2021-07-26T15:58:11.340 INFO:tasks.rados.rados.0.smithi033.stdout:512: rollback oid 20 current snap is 46 2021-07-26T15:58:11.340 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 20 to 40 2021-07-26T15:58:11.341 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 183 (ObjNum 124 snap 29 seq_num 124) dirty exists 2021-07-26T15:58:11.341 INFO:tasks.rados.rados.0.smithi033.stdout:506: finishing rollback tid 1 to smithi03339061-50 2021-07-26T15:58:11.341 INFO:tasks.rados.rados.0.smithi033.stdout:506: finishing rollback tid 2 to smithi03339061-50 2021-07-26T15:58:11.341 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 146 (ObjNum 36 snap 0 seq_num 36) dirty exists 2021-07-26T15:58:11.341 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 135 (ObjNum 2006280304 snap 22002 seq_num 2006460528) dirty exists 2021-07-26T15:58:11.342 INFO:tasks.rados.rados.0.smithi033.stdout:508: finishing rollback tid 0 to smithi03339061-10 2021-07-26T15:58:11.342 INFO:tasks.rados.rados.0.smithi033.stdout:508: finishing rollback tid 1 to smithi03339061-10 2021-07-26T15:58:11.342 INFO:tasks.rados.rados.0.smithi033.stdout:508: finishing rollback tid 2 to smithi03339061-10 2021-07-26T15:58:11.342 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 139 (ObjNum 104 snap 19 seq_num 104) dirty exists 2021-07-26T15:58:11.343 INFO:tasks.rados.rados.0.smithi033.stdout:509: finishing write tid 1 to smithi03339061-11 2021-07-26T15:58:11.343 INFO:tasks.rados.rados.0.smithi033.stdout:509: finishing write tid 2 to smithi03339061-11 2021-07-26T15:58:11.343 INFO:tasks.rados.rados.0.smithi033.stdout:505: done (6 left) 2021-07-26T15:58:11.343 INFO:tasks.rados.rados.0.smithi033.stdout:506: done (5 left) 2021-07-26T15:58:11.343 INFO:tasks.rados.rados.0.smithi033.stdout:507: done (4 left) 2021-07-26T15:58:11.344 INFO:tasks.rados.rados.0.smithi033.stdout:508: done (3 left) 2021-07-26T15:58:11.344 INFO:tasks.rados.rados.0.smithi033.stdout:513: rmattr oid 49 current snap is 46 2021-07-26T15:58:11.344 INFO:tasks.rados.rados.0.smithi033.stdout:513: done (3 left) 2021-07-26T15:58:11.344 INFO:tasks.rados.rados.0.smithi033.stdout:514: read oid 19 snap -1 2021-07-26T15:58:11.345 INFO:tasks.rados.rados.0.smithi033.stdout:514: expect (ObjNum 36 snap 0 seq_num 36) 2021-07-26T15:58:11.345 INFO:tasks.rados.rados.0.smithi033.stdout:515: snap_remove snap 44 2021-07-26T15:58:11.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:10 smithi033 bash[19094]: cluster 2021-07-26T15:58:09.943740+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e29: y(active, since 1.64918s), standbys: x 2021-07-26T15:58:11.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:10 smithi033 bash[19094]: audit 2021-07-26T15:58:09.946524+0000 mgr.y (mgr.34104) 1 : audit [DBG] from='client.34110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:11.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:10 smithi033 bash[19094]: cluster 2021-07-26T15:58:09.956269+0000 mgr.y (mgr.34104) 2 : cluster [DBG] pgmap v4: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:11.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:10 smithi033 bash[19094]: audit 2021-07-26T15:58:10.272343+0000 mgr.y (mgr.34104) 3 : audit [DBG] from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:11.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:10 smithi033 bash[19094]: cluster 2021-07-26T15:58:10.304990+0000 mon.a (mon.0) 30 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-07-26T15:58:11.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:10 smithi033 bash[19094]: audit 2021-07-26T15:58:10.685873+0000 mon.c (mon.1) 110 : audit [DBG] from='client.? 172.21.15.33:0/3747067038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:12.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:11 smithi096 bash[15117]: cluster 2021-07-26T15:58:10.941034+0000 mgr.y (mgr.34104) 4 : cluster [DBG] pgmap v6: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:12.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:11 smithi096 bash[15117]: cluster 2021-07-26T15:58:10.963014+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e30: y(active, since 2s), standbys: x 2021-07-26T15:58:12.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:11 smithi096 bash[15117]: cluster 2021-07-26T15:58:11.309085+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-07-26T15:58:12.315 INFO:tasks.rados.rados.0.smithi033.stdout:515: done (4 left) 2021-07-26T15:58:12.315 INFO:tasks.rados.rados.0.smithi033.stdout:516: snap_create 2021-07-26T15:58:12.317 INFO:tasks.rados.rados.0.smithi033.stdout:509: finishing write tid 3 to smithi03339061-11 2021-07-26T15:58:12.318 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 66 (ObjNum 173 snap 46 seq_num 173) dirty exists 2021-07-26T15:58:12.318 INFO:tasks.rados.rados.0.smithi033.stdout:509: left oid 11 (ObjNum 173 snap 46 seq_num 173) 2021-07-26T15:58:12.318 INFO:tasks.rados.rados.0.smithi033.stdout:512: finishing rollback tid 0 to smithi03339061-20 2021-07-26T15:58:12.318 INFO:tasks.rados.rados.0.smithi033.stdout:514: expect (ObjNum 36 snap 0 seq_num 36) 2021-07-26T15:58:12.337 INFO:tasks.rados.rados.0.smithi033.stdout:512: finishing rollback tid 1 to smithi03339061-20 2021-07-26T15:58:12.337 INFO:tasks.rados.rados.0.smithi033.stdout:511: finishing write tid 1 to smithi03339061-23 2021-07-26T15:58:12.337 INFO:tasks.rados.rados.0.smithi033.stdout:512: finishing rollback tid 2 to smithi03339061-20 2021-07-26T15:58:12.338 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 165 (ObjNum 41 snap 0 seq_num 41) dirty exists 2021-07-26T15:58:12.338 INFO:tasks.rados.rados.0.smithi033.stdout:511: finishing write tid 2 to smithi03339061-23 2021-07-26T15:58:12.338 INFO:tasks.rados.rados.0.smithi033.stdout:511: finishing write tid 3 to smithi03339061-23 2021-07-26T15:58:12.338 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 259 (ObjNum 174 snap 46 seq_num 174) dirty exists 2021-07-26T15:58:12.338 INFO:tasks.rados.rados.0.smithi033.stdout:511: left oid 23 (ObjNum 174 snap 46 seq_num 174) 2021-07-26T15:58:12.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:11 smithi033 bash[19094]: cluster 2021-07-26T15:58:10.941034+0000 mgr.y (mgr.34104) 4 : cluster [DBG] pgmap v6: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:12.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:11 smithi033 bash[19094]: cluster 2021-07-26T15:58:10.963014+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e30: y(active, since 2s), standbys: x 2021-07-26T15:58:12.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:11 smithi033 bash[19094]: cluster 2021-07-26T15:58:11.309085+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-07-26T15:58:13.327 INFO:tasks.rados.rados.0.smithi033.stdout:509: done (4 left) 2021-07-26T15:58:13.328 INFO:tasks.rados.rados.0.smithi033.stdout:511: done (3 left) 2021-07-26T15:58:13.328 INFO:tasks.rados.rados.0.smithi033.stdout:512: done (2 left) 2021-07-26T15:58:13.328 INFO:tasks.rados.rados.0.smithi033.stdout:514: done (1 left) 2021-07-26T15:58:13.328 INFO:tasks.rados.rados.0.smithi033.stdout:516: done (0 left) 2021-07-26T15:58:13.328 INFO:tasks.rados.rados.0.smithi033.stdout:517: read oid 47 snap -1 2021-07-26T15:58:13.329 INFO:tasks.rados.rados.0.smithi033.stdout:517: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:58:13.329 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 47 2021-07-26T15:58:13.329 INFO:tasks.rados.rados.0.smithi033.stdout:518: seq_num 175 ranges {385024=540672} 2021-07-26T15:58:13.334 INFO:tasks.rados.rados.0.smithi033.stdout:518: writing smithi03339061-43 from 385024 to 925696 tid 1 2021-07-26T15:58:13.335 INFO:tasks.rados.rados.0.smithi033.stdout:519: rollback oid 29 current snap is 47 2021-07-26T15:58:13.335 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 42 2021-07-26T15:58:13.335 INFO:tasks.rados.rados.0.smithi033.stdout:517: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:58:13.338 INFO:tasks.rados.rados.0.smithi033.stdout:517: done (2 left) 2021-07-26T15:58:13.339 INFO:tasks.rados.rados.0.smithi033.stdout:520: delete oid 27 current snap is 47 2021-07-26T15:58:13.342 INFO:tasks.rados.rados.0.smithi033.stdout:519: finishing rollback tid 0 to smithi03339061-29 2021-07-26T15:58:13.343 INFO:tasks.rados.rados.0.smithi033.stdout:519: finishing rollback tid 1 to smithi03339061-29 2021-07-26T15:58:13.343 INFO:tasks.rados.rados.0.smithi033.stdout:519: finishing rollback tid 2 to smithi03339061-29 2021-07-26T15:58:13.343 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 32 (ObjNum 158 snap 39 seq_num 158) dirty exists 2021-07-26T15:58:13.347 INFO:tasks.rados.rados.0.smithi033.stdout:518: finishing write tid 1 to smithi03339061-43 2021-07-26T15:58:13.347 INFO:tasks.rados.rados.0.smithi033.stdout:518: finishing write tid 2 to smithi03339061-43 2021-07-26T15:58:13.347 INFO:tasks.rados.rados.0.smithi033.stdout:519: done (2 left) 2021-07-26T15:58:13.347 INFO:tasks.rados.rados.0.smithi033.stdout:520: done (1 left) 2021-07-26T15:58:13.348 INFO:tasks.rados.rados.0.smithi033.stdout:521: read oid 38 snap -1 2021-07-26T15:58:13.348 INFO:tasks.rados.rados.0.smithi033.stdout:521: expect (ObjNum 13 snap 0 seq_num 13) 2021-07-26T15:58:13.348 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 47 2021-07-26T15:58:13.348 INFO:tasks.rados.rados.0.smithi033.stdout:522: seq_num 177 ranges {2392064=573440} 2021-07-26T15:58:13.368 INFO:tasks.rados.rados.0.smithi033.stdout:522: writing smithi03339061-10 from 2392064 to 2965504 tid 1 2021-07-26T15:58:13.368 INFO:tasks.rados.rados.0.smithi033.stdout:523: delete oid 13 current snap is 47 2021-07-26T15:58:13.368 INFO:tasks.rados.rados.0.smithi033.stdout:518: finishing write tid 3 to smithi03339061-43 2021-07-26T15:58:13.369 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 194 (ObjNum 175 snap 47 seq_num 175) dirty exists 2021-07-26T15:58:13.369 INFO:tasks.rados.rados.0.smithi033.stdout:518: left oid 43 (ObjNum 175 snap 47 seq_num 175) 2021-07-26T15:58:13.369 INFO:tasks.rados.rados.0.smithi033.stdout:521: expect (ObjNum 13 snap 0 seq_num 13) 2021-07-26T15:58:13.380 INFO:tasks.rados.rados.0.smithi033.stdout:522: finishing write tid 1 to smithi03339061-10 2021-07-26T15:58:13.380 INFO:tasks.rados.rados.0.smithi033.stdout:518: done (3 left) 2021-07-26T15:58:13.381 INFO:tasks.rados.rados.0.smithi033.stdout:521: done (2 left) 2021-07-26T15:58:13.381 INFO:tasks.rados.rados.0.smithi033.stdout:523: done (1 left) 2021-07-26T15:58:13.381 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 47 2021-07-26T15:58:13.381 INFO:tasks.rados.rados.0.smithi033.stdout:522: finishing write tid 2 to smithi03339061-10 2021-07-26T15:58:13.381 INFO:tasks.rados.rados.0.smithi033.stdout:524: seq_num 179 ranges {2424832=606208} 2021-07-26T15:58:13.400 INFO:tasks.rados.rados.0.smithi033.stdout:524: writing smithi03339061-28 from 2424832 to 3031040 tid 1 2021-07-26T15:58:13.400 INFO:tasks.rados.rados.0.smithi033.stdout:525: read oid 34 snap -1 2021-07-26T15:58:13.400 INFO:tasks.rados.rados.0.smithi033.stdout:525: expect deleted 2021-07-26T15:58:13.401 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 47 2021-07-26T15:58:13.401 INFO:tasks.rados.rados.0.smithi033.stdout:522: finishing write tid 3 to smithi03339061-10 2021-07-26T15:58:13.401 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 150 (ObjNum 177 snap 47 seq_num 177) dirty exists 2021-07-26T15:58:13.401 INFO:tasks.rados.rados.0.smithi033.stdout:522: left oid 10 (ObjNum 177 snap 47 seq_num 177) 2021-07-26T15:58:13.402 INFO:tasks.rados.rados.0.smithi033.stdout:526: seq_num 180 ranges {204800=622592} 2021-07-26T15:58:13.405 INFO:tasks.rados.rados.0.smithi033.stdout:526: writing smithi03339061-21 from 204800 to 827392 tid 1 2021-07-26T15:58:13.405 INFO:tasks.rados.rados.0.smithi033.stdout:522: done (3 left) 2021-07-26T15:58:13.405 INFO:tasks.rados.rados.0.smithi033.stdout:527: rollback oid 10 current snap is 47 2021-07-26T15:58:13.406 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 10 to 46 2021-07-26T15:58:13.406 INFO:tasks.rados.rados.0.smithi033.stdout:525: done (3 left) 2021-07-26T15:58:13.406 INFO:tasks.rados.rados.0.smithi033.stdout:528: rollback oid 37 current snap is 47 2021-07-26T15:58:13.406 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 37 to 40 2021-07-26T15:58:13.406 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 44 current snap is 47 2021-07-26T15:58:13.407 INFO:tasks.rados.rados.0.smithi033.stdout:529: seq_num 181 ranges {0=638976} 2021-07-26T15:58:13.410 INFO:tasks.rados.rados.0.smithi033.stdout:529: writing smithi03339061-44 from 0 to 638976 tid 1 2021-07-26T15:58:13.410 INFO:tasks.rados.rados.0.smithi033.stdout:530: rollback oid 27 current snap is 47 2021-07-26T15:58:13.410 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 27 to 46 2021-07-26T15:58:13.410 INFO:tasks.rados.rados.0.smithi033.stdout:531: read oid 18 snap -1 2021-07-26T15:58:13.411 INFO:tasks.rados.rados.0.smithi033.stdout:531: expect (ObjNum 115 snap 26 seq_num 115) 2021-07-26T15:58:13.411 INFO:tasks.rados.rados.0.smithi033.stdout:532: rollback oid 31 current snap is 47 2021-07-26T15:58:13.411 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 31 to 46 2021-07-26T15:58:13.411 INFO:tasks.rados.rados.0.smithi033.stdout:524: finishing write tid 1 to smithi03339061-28 2021-07-26T15:58:13.412 INFO:tasks.rados.rados.0.smithi033.stdout:524: finishing write tid 2 to smithi03339061-28 2021-07-26T15:58:13.412 INFO:tasks.rados.rados.0.smithi033.stdout:524: finishing write tid 3 to smithi03339061-28 2021-07-26T15:58:13.412 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 147 (ObjNum 179 snap 47 seq_num 179) dirty exists 2021-07-26T15:58:13.412 INFO:tasks.rados.rados.0.smithi033.stdout:524: left oid 28 (ObjNum 179 snap 47 seq_num 179) 2021-07-26T15:58:13.412 INFO:tasks.rados.rados.0.smithi033.stdout:524: done (7 left) 2021-07-26T15:58:13.413 INFO:tasks.rados.rados.0.smithi033.stdout:533: read oid 16 snap -1 2021-07-26T15:58:13.413 INFO:tasks.rados.rados.0.smithi033.stdout:533: expect deleted 2021-07-26T15:58:13.413 INFO:tasks.rados.rados.0.smithi033.stdout:534: rollback oid 48 current snap is 47 2021-07-26T15:58:13.413 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 48 to 46 2021-07-26T15:58:13.413 INFO:tasks.rados.rados.0.smithi033.stdout:535: snap_create 2021-07-26T15:58:13.414 INFO:tasks.rados.rados.0.smithi033.stdout:527: finishing rollback tid 0 to smithi03339061-10 2021-07-26T15:58:13.417 INFO:tasks.rados.rados.0.smithi033.stdout:527: finishing rollback tid 1 to smithi03339061-10 2021-07-26T15:58:13.418 INFO:tasks.rados.rados.0.smithi033.stdout:527: finishing rollback tid 2 to smithi03339061-10 2021-07-26T15:58:13.418 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 153 (ObjNum 104 snap 19 seq_num 104) dirty exists 2021-07-26T15:58:13.419 INFO:tasks.rados.rados.0.smithi033.stdout:532: finishing rollback tid 1 to smithi03339061-31 2021-07-26T15:58:13.419 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 0 (ObjNum 2006295280 snap 22002 seq_num 809055027) dirty dne 2021-07-26T15:58:13.419 INFO:tasks.rados.rados.0.smithi033.stdout:534: finishing rollback tid 1 to smithi03339061-48 2021-07-26T15:58:13.420 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 181 (ObjNum 2004939200 snap 22002 seq_num 2006481648) dirty dne 2021-07-26T15:58:13.420 INFO:tasks.rados.rados.0.smithi033.stdout:529: finishing write tid 1 to smithi03339061-44 2021-07-26T15:58:13.420 INFO:tasks.rados.rados.0.smithi033.stdout:526: finishing write tid 1 to smithi03339061-21 2021-07-26T15:58:13.420 INFO:tasks.rados.rados.0.smithi033.stdout:529: finishing write tid 2 to smithi03339061-44 2021-07-26T15:58:13.422 INFO:tasks.rados.rados.0.smithi033.stdout:529: finishing write tid 3 to smithi03339061-44 2021-07-26T15:58:13.422 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 170 (ObjNum 181 snap 47 seq_num 181) dirty exists 2021-07-26T15:58:13.422 INFO:tasks.rados.rados.0.smithi033.stdout:529: left oid 44 (ObjNum 181 snap 47 seq_num 181) 2021-07-26T15:58:13.423 INFO:tasks.rados.rados.0.smithi033.stdout:528: finishing rollback tid 1 to smithi03339061-37 2021-07-26T15:58:13.423 INFO:tasks.rados.rados.0.smithi033.stdout:528: finishing rollback tid 2 to smithi03339061-37 2021-07-26T15:58:13.423 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 155 (ObjNum 36 snap 0 seq_num 36) dirty exists 2021-07-26T15:58:13.424 INFO:tasks.rados.rados.0.smithi033.stdout:526: finishing write tid 2 to smithi03339061-21 2021-07-26T15:58:13.424 INFO:tasks.rados.rados.0.smithi033.stdout:530: finishing rollback tid 1 to smithi03339061-27 2021-07-26T15:58:13.425 INFO:tasks.rados.rados.0.smithi033.stdout:526: finishing write tid 3 to smithi03339061-21 2021-07-26T15:58:13.425 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 266 (ObjNum 180 snap 47 seq_num 180) dirty exists 2021-07-26T15:58:13.425 INFO:tasks.rados.rados.0.smithi033.stdout:526: left oid 21 (ObjNum 180 snap 47 seq_num 180) 2021-07-26T15:58:13.427 INFO:tasks.rados.rados.0.smithi033.stdout:530: finishing rollback tid 2 to smithi03339061-27 2021-07-26T15:58:13.427 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 268 (ObjNum 133 snap 33 seq_num 133) dirty exists 2021-07-26T15:58:13.430 INFO:tasks.rados.rados.0.smithi033.stdout:531: expect (ObjNum 115 snap 26 seq_num 115) 2021-07-26T15:58:13.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:13 smithi033 bash[19094]: cluster 2021-07-26T15:58:12.310196+0000 mon.a (mon.0) 33 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-07-26T15:58:13.708 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:13 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:13.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:13.709 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:13 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:13.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:13.709 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:13 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:13.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T15:58:13.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:13 smithi096 bash[15117]: cluster 2021-07-26T15:58:12.310196+0000 mon.a (mon.0) 33 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-07-26T15:58:14.336 INFO:tasks.rados.rados.0.smithi033.stdout:526: done (9 left) 2021-07-26T15:58:14.336 INFO:tasks.rados.rados.0.smithi033.stdout:527: done (8 left) 2021-07-26T15:58:14.337 INFO:tasks.rados.rados.0.smithi033.stdout:528: done (7 left) 2021-07-26T15:58:14.337 INFO:tasks.rados.rados.0.smithi033.stdout:529: done (6 left) 2021-07-26T15:58:14.337 INFO:tasks.rados.rados.0.smithi033.stdout:530: done (5 left) 2021-07-26T15:58:14.337 INFO:tasks.rados.rados.0.smithi033.stdout:531: done (4 left) 2021-07-26T15:58:14.337 INFO:tasks.rados.rados.0.smithi033.stdout:532: done (3 left) 2021-07-26T15:58:14.338 INFO:tasks.rados.rados.0.smithi033.stdout:533: done (2 left) 2021-07-26T15:58:14.338 INFO:tasks.rados.rados.0.smithi033.stdout:534: done (1 left) 2021-07-26T15:58:14.338 INFO:tasks.rados.rados.0.smithi033.stdout:535: done (0 left) 2021-07-26T15:58:14.338 INFO:tasks.rados.rados.0.smithi033.stdout:536: rollback oid 42 current snap is 48 2021-07-26T15:58:14.339 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 42 to 40 2021-07-26T15:58:14.339 INFO:tasks.rados.rados.0.smithi033.stdout:537: copy_from oid 3 from oid 1 current snap is 48 2021-07-26T15:58:14.339 INFO:tasks.rados.rados.0.smithi033.stdout:538: snap_remove snap 43 2021-07-26T15:58:14.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:14 smithi033 bash[19094]: cluster 2021-07-26T15:58:12.941829+0000 mgr.y (mgr.34104) 5 : cluster [DBG] pgmap v9: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:14.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:14 smithi033 bash[19094]: cluster 2021-07-26T15:58:13.321835+0000 mon.a (mon.0) 34 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-07-26T15:58:14.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:14 smithi033 bash[19094]: audit 2021-07-26T15:58:13.729636+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:14 smithi033 bash[19094]: audit 2021-07-26T15:58:14.154633+0000 mon.a (mon.0) 36 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:14 smithi033 bash[19094]: audit 2021-07-26T15:58:14.190403+0000 mon.a (mon.0) 37 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:14.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:14 smithi096 bash[15117]: cluster 2021-07-26T15:58:12.941829+0000 mgr.y (mgr.34104) 5 : cluster [DBG] pgmap v9: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:14.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:14 smithi096 bash[15117]: cluster 2021-07-26T15:58:13.321835+0000 mon.a (mon.0) 34 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-07-26T15:58:14.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:14 smithi096 bash[15117]: audit 2021-07-26T15:58:13.729636+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:14.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:14 smithi096 bash[15117]: audit 2021-07-26T15:58:14.154633+0000 mon.a (mon.0) 36 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:14.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:14 smithi096 bash[15117]: audit 2021-07-26T15:58:14.190403+0000 mon.a (mon.0) 37 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:15.344 INFO:tasks.rados.rados.0.smithi033.stdout:538: done (2 left) 2021-07-26T15:58:15.344 INFO:tasks.rados.rados.0.smithi033.stdout:539: read oid 15 snap -1 2021-07-26T15:58:15.344 INFO:tasks.rados.rados.0.smithi033.stdout:539: expect (ObjNum 157 snap 39 seq_num 157) 2021-07-26T15:58:15.344 INFO:tasks.rados.rados.0.smithi033.stdout:540: delete oid 34 current snap is 48 2021-07-26T15:58:15.345 INFO:tasks.rados.rados.0.smithi033.stdout:536: finishing rollback tid 0 to smithi03339061-42 2021-07-26T15:58:15.345 INFO:tasks.rados.rados.0.smithi033.stdout:536: finishing rollback tid 1 to smithi03339061-42 2021-07-26T15:58:15.345 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 73 (ObjNum 1058724944 snap 32561 seq_num 2007444848) dirty dne 2021-07-26T15:58:15.345 INFO:tasks.rados.rados.0.smithi033.stdout:537: finishing copy_from to smithi03339061-3 2021-07-26T15:58:15.346 INFO:tasks.rados.rados.0.smithi033.stdout:537: got expected ENOENT (src dne) 2021-07-26T15:58:15.346 INFO:tasks.rados.rados.0.smithi033.stdout:537: finishing copy_from racing read to smithi03339061-3 2021-07-26T15:58:15.351 INFO:tasks.rados.rados.0.smithi033.stdout:536: done (3 left) 2021-07-26T15:58:15.351 INFO:tasks.rados.rados.0.smithi033.stdout:537: done (2 left) 2021-07-26T15:58:15.352 INFO:tasks.rados.rados.0.smithi033.stdout:540: done (1 left) 2021-07-26T15:58:15.352 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 3 current snap is 48 2021-07-26T15:58:15.352 INFO:tasks.rados.rados.0.smithi033.stdout:541: seq_num 183 ranges {2310144=671744} 2021-07-26T15:58:15.371 INFO:tasks.rados.rados.0.smithi033.stdout:541: writing smithi03339061-3 from 2310144 to 2981888 tid 1 2021-07-26T15:58:15.372 INFO:tasks.rados.rados.0.smithi033.stdout:542: read oid 28 snap -1 2021-07-26T15:58:15.373 INFO:tasks.rados.rados.0.smithi033.stdout:542: expect (ObjNum 179 snap 47 seq_num 179) 2021-07-26T15:58:15.373 INFO:tasks.rados.rados.0.smithi033.stdout:543: rollback oid 6 current snap is 48 2021-07-26T15:58:15.373 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 46 2021-07-26T15:58:15.374 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 16 current snap is 48 2021-07-26T15:58:15.374 INFO:tasks.rados.rados.0.smithi033.stdout:544: seq_num 184 ranges {0=688128} 2021-07-26T15:58:15.375 INFO:tasks.rados.rados.0.smithi033.stdout:544: writing smithi03339061-16 from 0 to 688128 tid 1 2021-07-26T15:58:15.376 INFO:tasks.rados.rados.0.smithi033.stdout:545: snap_create 2021-07-26T15:58:15.376 INFO:tasks.rados.rados.0.smithi033.stdout:543: finishing rollback tid 0 to smithi03339061-6 2021-07-26T15:58:15.376 INFO:tasks.rados.rados.0.smithi033.stdout:543: finishing rollback tid 1 to smithi03339061-6 2021-07-26T15:58:15.377 INFO:tasks.rados.rados.0.smithi033.stdout:543: finishing rollback tid 2 to smithi03339061-6 2021-07-26T15:58:15.378 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 303 (ObjNum 99 snap 18 seq_num 99) dirty exists 2021-07-26T15:58:15.378 INFO:tasks.rados.rados.0.smithi033.stdout:541: finishing write tid 1 to smithi03339061-3 2021-07-26T15:58:15.378 INFO:tasks.rados.rados.0.smithi033.stdout:541: finishing write tid 2 to smithi03339061-3 2021-07-26T15:58:15.379 INFO:tasks.rados.rados.0.smithi033.stdout:541: finishing write tid 3 to smithi03339061-3 2021-07-26T15:58:15.380 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 76 (ObjNum 183 snap 48 seq_num 183) dirty exists 2021-07-26T15:58:15.380 INFO:tasks.rados.rados.0.smithi033.stdout:541: left oid 3 (ObjNum 183 snap 48 seq_num 183) 2021-07-26T15:58:15.383 INFO:tasks.rados.rados.0.smithi033.stdout:544: finishing write tid 1 to smithi03339061-16 2021-07-26T15:58:15.383 INFO:tasks.rados.rados.0.smithi033.stdout:544: finishing write tid 2 to smithi03339061-16 2021-07-26T15:58:15.385 INFO:tasks.rados.rados.0.smithi033.stdout:544: finishing write tid 3 to smithi03339061-16 2021-07-26T15:58:15.385 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 154 (ObjNum 184 snap 48 seq_num 184) dirty exists 2021-07-26T15:58:15.385 INFO:tasks.rados.rados.0.smithi033.stdout:544: left oid 16 (ObjNum 184 snap 48 seq_num 184) 2021-07-26T15:58:15.389 INFO:tasks.rados.rados.0.smithi033.stdout:539: expect (ObjNum 157 snap 39 seq_num 157) 2021-07-26T15:58:15.638 INFO:tasks.rados.rados.0.smithi033.stdout:542: expect (ObjNum 179 snap 47 seq_num 179) 2021-07-26T15:58:15.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: cephadm 2021-07-26T15:58:13.974535+0000 mgr.y (mgr.34104) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:58:15.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: cephadm 2021-07-26T15:58:13.998791+0000 mgr.y (mgr.34104) 7 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:15.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: cluster 2021-07-26T15:58:14.333588+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-07-26T15:58:15.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: cephadm 2021-07-26T15:58:14.437155+0000 mgr.y (mgr.34104) 8 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:58:15.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: cephadm 2021-07-26T15:58:14.463185+0000 mgr.y (mgr.34104) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:15.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: audit 2021-07-26T15:58:14.501425+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:15.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: audit 2021-07-26T15:58:14.512014+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:15.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: audit 2021-07-26T15:58:14.520270+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:15.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: audit 2021-07-26T15:58:14.522612+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:15.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: audit 2021-07-26T15:58:14.524588+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:58:15.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: audit 2021-07-26T15:58:14.525918+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-07-26T15:58:15.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:15 smithi033 bash[19094]: cephadm 2021-07-26T15:58:14.526835+0000 mgr.y (mgr.34104) 10 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2021-07-26T15:58:15.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: cephadm 2021-07-26T15:58:13.974535+0000 mgr.y (mgr.34104) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:58:15.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: cephadm 2021-07-26T15:58:13.998791+0000 mgr.y (mgr.34104) 7 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:15.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: cluster 2021-07-26T15:58:14.333588+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-07-26T15:58:15.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: cephadm 2021-07-26T15:58:14.437155+0000 mgr.y (mgr.34104) 8 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:58:15.738 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: cephadm 2021-07-26T15:58:14.463185+0000 mgr.y (mgr.34104) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:15.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: audit 2021-07-26T15:58:14.501425+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:15.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: audit 2021-07-26T15:58:14.512014+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:15.746 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: audit 2021-07-26T15:58:14.520270+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:15.746 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: audit 2021-07-26T15:58:14.522612+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:15.747 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: audit 2021-07-26T15:58:14.524588+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:58:15.747 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: audit 2021-07-26T15:58:14.525918+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-07-26T15:58:15.747 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:15 smithi096 bash[15117]: cephadm 2021-07-26T15:58:14.526835+0000 mgr.y (mgr.34104) 10 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2021-07-26T15:58:15.917 INFO:tasks.rados.rados.0.smithi033.stdout:539: done (5 left) 2021-07-26T15:58:15.918 INFO:tasks.rados.rados.0.smithi033.stdout:541: done (4 left) 2021-07-26T15:58:15.918 INFO:tasks.rados.rados.0.smithi033.stdout:542: done (3 left) 2021-07-26T15:58:15.918 INFO:tasks.rados.rados.0.smithi033.stdout:543: done (2 left) 2021-07-26T15:58:15.918 INFO:tasks.rados.rados.0.smithi033.stdout:544: done (1 left) 2021-07-26T15:58:15.919 INFO:tasks.rados.rados.0.smithi033.stdout:545: done (0 left) 2021-07-26T15:58:15.919 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 49 2021-07-26T15:58:15.920 INFO:tasks.rados.rados.0.smithi033.stdout:546: seq_num 185 ranges {5308416=704512} 2021-07-26T15:58:15.955 INFO:tasks.rados.rados.0.smithi033.stdout:546: writing smithi03339061-18 from 5308416 to 6012928 tid 1 2021-07-26T15:58:15.955 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 49 2021-07-26T15:58:15.956 INFO:tasks.rados.rados.0.smithi033.stdout:547: seq_num 186 ranges {0=720896} 2021-07-26T15:58:15.959 INFO:tasks.rados.rados.0.smithi033.stdout:547: writing smithi03339061-39 from 0 to 720896 tid 1 2021-07-26T15:58:15.959 INFO:tasks.rados.rados.0.smithi033.stdout:548: setattr oid 49 current snap is 49 2021-07-26T15:58:15.960 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 49 2021-07-26T15:58:15.960 INFO:tasks.rados.rados.0.smithi033.stdout:549: seq_num 187 ranges {606208=737280} 2021-07-26T15:58:15.969 INFO:tasks.rados.rados.0.smithi033.stdout:549: writing smithi03339061-50 from 606208 to 1343488 tid 1 2021-07-26T15:58:15.969 INFO:tasks.rados.rados.0.smithi033.stdout:550: rollback oid 3 current snap is 49 2021-07-26T15:58:15.969 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 3 to 42 2021-07-26T15:58:15.969 INFO:tasks.rados.rados.0.smithi033.stdout:547: finishing write tid 1 to smithi03339061-39 2021-07-26T15:58:15.970 INFO:tasks.rados.rados.0.smithi033.stdout:546: finishing write tid 1 to smithi03339061-18 2021-07-26T15:58:15.970 INFO:tasks.rados.rados.0.smithi033.stdout:547: finishing write tid 2 to smithi03339061-39 2021-07-26T15:58:15.970 INFO:tasks.rados.rados.0.smithi033.stdout:546: finishing write tid 2 to smithi03339061-18 2021-07-26T15:58:15.970 INFO:tasks.rados.rados.0.smithi033.stdout:551: copy_from oid 45 from oid 12 current snap is 49 2021-07-26T15:58:15.970 INFO:tasks.rados.rados.0.smithi033.stdout:552: snap_remove snap 48 2021-07-26T15:58:16.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:16 smithi033 bash[19094]: cluster 2021-07-26T15:58:14.942730+0000 mgr.y (mgr.34104) 11 : cluster [DBG] pgmap v12: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:16.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:16 smithi033 bash[19094]: cluster 2021-07-26T15:58:15.338488+0000 mon.a (mon.0) 41 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-07-26T15:58:16.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:16 smithi033 bash[19094]: cluster 2021-07-26T15:58:15.914077+0000 mon.a (mon.0) 42 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-07-26T15:58:16.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:16 smithi096 bash[15117]: cluster 2021-07-26T15:58:14.942730+0000 mgr.y (mgr.34104) 11 : cluster [DBG] pgmap v12: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:16.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:16 smithi096 bash[15117]: cluster 2021-07-26T15:58:15.338488+0000 mon.a (mon.0) 41 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-07-26T15:58:16.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:16 smithi096 bash[15117]: cluster 2021-07-26T15:58:15.914077+0000 mon.a (mon.0) 42 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-07-26T15:58:16.933 INFO:tasks.rados.rados.0.smithi033.stdout:546: finishing write tid 3 to smithi03339061-18 2021-07-26T15:58:16.933 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 306 (ObjNum 185 snap 49 seq_num 185) dirty exists 2021-07-26T15:58:16.933 INFO:tasks.rados.rados.0.smithi033.stdout:546: left oid 18 (ObjNum 185 snap 49 seq_num 185) 2021-07-26T15:58:16.933 INFO:tasks.rados.rados.0.smithi033.stdout:547: finishing write tid 3 to smithi03339061-39 2021-07-26T15:58:16.934 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 276 (ObjNum 186 snap 49 seq_num 186) dirty exists 2021-07-26T15:58:16.934 INFO:tasks.rados.rados.0.smithi033.stdout:547: left oid 39 (ObjNum 186 snap 49 seq_num 186) 2021-07-26T15:58:16.934 INFO:tasks.rados.rados.0.smithi033.stdout:549: finishing write tid 1 to smithi03339061-50 2021-07-26T15:58:16.934 INFO:tasks.rados.rados.0.smithi033.stdout:550: finishing rollback tid 0 to smithi03339061-3 2021-07-26T15:58:16.935 INFO:tasks.rados.rados.0.smithi033.stdout:550: finishing rollback tid 1 to smithi03339061-3 2021-07-26T15:58:16.935 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 141 (ObjNum 2006420080 snap 22002 seq_num 2006552128) dirty exists 2021-07-26T15:58:16.935 INFO:tasks.rados.rados.0.smithi033.stdout:549: finishing write tid 2 to smithi03339061-50 2021-07-26T15:58:16.935 INFO:tasks.rados.rados.0.smithi033.stdout:550: finishing rollback tid 2 to smithi03339061-3 2021-07-26T15:58:16.936 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 80 (ObjNum 121 snap 27 seq_num 121) dirty exists 2021-07-26T15:58:16.936 INFO:tasks.rados.rados.0.smithi033.stdout:549: finishing write tid 3 to smithi03339061-50 2021-07-26T15:58:16.936 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 157 (ObjNum 187 snap 49 seq_num 187) dirty exists 2021-07-26T15:58:16.936 INFO:tasks.rados.rados.0.smithi033.stdout:549: left oid 50 (ObjNum 187 snap 49 seq_num 187) 2021-07-26T15:58:16.936 INFO:tasks.rados.rados.0.smithi033.stdout:551: finishing copy_from to smithi03339061-45 2021-07-26T15:58:16.937 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 90 (ObjNum 137 snap 34 seq_num 137) dirty exists 2021-07-26T15:58:16.937 INFO:tasks.rados.rados.0.smithi033.stdout:551: finishing copy_from racing read to smithi03339061-45 2021-07-26T15:58:16.937 INFO:tasks.rados.rados.0.smithi033.stdout:546: done (6 left) 2021-07-26T15:58:16.937 INFO:tasks.rados.rados.0.smithi033.stdout:547: done (5 left) 2021-07-26T15:58:16.937 INFO:tasks.rados.rados.0.smithi033.stdout:548: done (4 left) 2021-07-26T15:58:16.938 INFO:tasks.rados.rados.0.smithi033.stdout:549: done (3 left) 2021-07-26T15:58:16.938 INFO:tasks.rados.rados.0.smithi033.stdout:550: done (2 left) 2021-07-26T15:58:16.938 INFO:tasks.rados.rados.0.smithi033.stdout:551: done (1 left) 2021-07-26T15:58:16.938 INFO:tasks.rados.rados.0.smithi033.stdout:552: done (0 left) 2021-07-26T15:58:16.939 INFO:tasks.rados.rados.0.smithi033.stdout:553: copy_from oid 21 from oid 20 current snap is 49 2021-07-26T15:58:16.939 INFO:tasks.rados.rados.0.smithi033.stdout:554: read oid 44 snap 42 2021-07-26T15:58:16.939 INFO:tasks.rados.rados.0.smithi033.stdout:554: expect deleted 2021-07-26T15:58:16.939 INFO:tasks.rados.rados.0.smithi033.stdout:555: copy_from oid 46 from oid 10 current snap is 49 2021-07-26T15:58:16.940 INFO:tasks.rados.rados.0.smithi033.stdout:556: delete oid 19 current snap is 49 2021-07-26T15:58:16.941 INFO:tasks.rados.rados.0.smithi033.stdout:554: done (3 left) 2021-07-26T15:58:16.941 INFO:tasks.rados.rados.0.smithi033.stdout:556: done (2 left) 2021-07-26T15:58:16.941 INFO:tasks.rados.rados.0.smithi033.stdout:557: snap_create 2021-07-26T15:58:16.946 INFO:tasks.rados.rados.0.smithi033.stdout:553: finishing copy_from to smithi03339061-21 2021-07-26T15:58:16.946 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 165 (ObjNum 41 snap 0 seq_num 41) dirty exists 2021-07-26T15:58:16.946 INFO:tasks.rados.rados.0.smithi033.stdout:553: finishing copy_from racing read to smithi03339061-21 2021-07-26T15:58:16.955 INFO:tasks.rados.rados.0.smithi033.stdout:555: finishing copy_from to smithi03339061-46 2021-07-26T15:58:16.955 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 153 (ObjNum 104 snap 19 seq_num 104) dirty exists 2021-07-26T15:58:16.956 INFO:tasks.rados.rados.0.smithi033.stdout:555: finishing copy_from racing read to smithi03339061-46 2021-07-26T15:58:17.940 INFO:tasks.rados.rados.0.smithi033.stdout:553: done (2 left) 2021-07-26T15:58:17.941 INFO:tasks.rados.rados.0.smithi033.stdout:555: done (1 left) 2021-07-26T15:58:17.941 INFO:tasks.rados.rados.0.smithi033.stdout:557: done (0 left) 2021-07-26T15:58:17.941 INFO:tasks.rados.rados.0.smithi033.stdout:558: read oid 45 snap -1 2021-07-26T15:58:17.941 INFO:tasks.rados.rados.0.smithi033.stdout:558: expect (ObjNum 137 snap 34 seq_num 137) 2021-07-26T15:58:17.941 INFO:tasks.rados.rados.0.smithi033.stdout:559: copy_from oid 49 from oid 4 current snap is 50 2021-07-26T15:58:17.942 INFO:tasks.rados.rados.0.smithi033.stdout:560: snap_remove snap 40 2021-07-26T15:58:18.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:17 smithi033 bash[19094]: cluster 2021-07-26T15:58:16.925337+0000 mon.a (mon.0) 43 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-07-26T15:58:18.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:17 smithi033 bash[19094]: cluster 2021-07-26T15:58:16.943225+0000 mgr.y (mgr.34104) 12 : cluster [DBG] pgmap v16: 25 pgs: 25 active+clean; 83 MiB data, 299 MiB used, 715 GiB / 715 GiB avail; 4.9 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2021-07-26T15:58:18.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:17 smithi033 bash[19094]: cephadm 2021-07-26T15:58:17.467946+0000 mgr.y (mgr.34104) 13 : cephadm [INF] Upgrade: Updating mon.c 2021-07-26T15:58:18.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:17 smithi033 bash[19094]: audit 2021-07-26T15:58:17.474594+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:18.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:17 smithi033 bash[19094]: audit 2021-07-26T15:58:17.481007+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:18.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:17 smithi033 bash[19094]: audit 2021-07-26T15:58:17.482988+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:18.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:17 smithi033 bash[19094]: audit 2021-07-26T15:58:17.484681+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:18.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:17 smithi033 bash[19094]: cephadm 2021-07-26T15:58:17.485945+0000 mgr.y (mgr.34104) 14 : cephadm [INF] Deploying daemon mon.c on smithi033 2021-07-26T15:58:18.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:17 smithi096 bash[15117]: cluster 2021-07-26T15:58:16.925337+0000 mon.a (mon.0) 43 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-07-26T15:58:18.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:17 smithi096 bash[15117]: cluster 2021-07-26T15:58:16.943225+0000 mgr.y (mgr.34104) 12 : cluster [DBG] pgmap v16: 25 pgs: 25 active+clean; 83 MiB data, 299 MiB used, 715 GiB / 715 GiB avail; 4.9 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2021-07-26T15:58:18.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:17 smithi096 bash[15117]: cephadm 2021-07-26T15:58:17.467946+0000 mgr.y (mgr.34104) 13 : cephadm [INF] Upgrade: Updating mon.c 2021-07-26T15:58:18.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:17 smithi096 bash[15117]: audit 2021-07-26T15:58:17.474594+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:18.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:17 smithi096 bash[15117]: audit 2021-07-26T15:58:17.481007+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:18.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:17 smithi096 bash[15117]: audit 2021-07-26T15:58:17.482988+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:18.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:17 smithi096 bash[15117]: audit 2021-07-26T15:58:17.484681+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:18.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:17 smithi096 bash[15117]: cephadm 2021-07-26T15:58:17.485945+0000 mgr.y (mgr.34104) 14 : cephadm [INF] Deploying daemon mon.c on smithi033 2021-07-26T15:58:18.948 INFO:tasks.rados.rados.0.smithi033.stdout:560: done (2 left) 2021-07-26T15:58:18.948 INFO:tasks.rados.rados.0.smithi033.stdout:561: rollback oid 14 current snap is 50 2021-07-26T15:58:18.948 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 14 to 49 2021-07-26T15:58:18.952 INFO:tasks.rados.rados.0.smithi033.stdout:559: finishing copy_from to smithi03339061-49 2021-07-26T15:58:18.953 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 138 (ObjNum 161 snap 39 seq_num 161) dirty exists 2021-07-26T15:58:18.953 INFO:tasks.rados.rados.0.smithi033.stdout:559: finishing copy_from racing read to smithi03339061-49 2021-07-26T15:58:18.953 INFO:tasks.rados.rados.0.smithi033.stdout:558: expect (ObjNum 137 snap 34 seq_num 137) 2021-07-26T15:58:19.193 INFO:tasks.rados.rados.0.smithi033.stdout:561: finishing rollback tid 0 to smithi03339061-14 2021-07-26T15:58:19.195 INFO:tasks.rados.rados.0.smithi033.stdout:561: finishing rollback tid 1 to smithi03339061-14 2021-07-26T15:58:19.195 INFO:tasks.rados.rados.0.smithi033.stdout:561: finishing rollback tid 2 to smithi03339061-14 2021-07-26T15:58:19.195 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 176 (ObjNum 164 snap 41 seq_num 164) dirty exists 2021-07-26T15:58:19.195 INFO:tasks.rados.rados.0.smithi033.stdout:558: done (2 left) 2021-07-26T15:58:19.196 INFO:tasks.rados.rados.0.smithi033.stdout:559: done (1 left) 2021-07-26T15:58:19.196 INFO:tasks.rados.rados.0.smithi033.stdout:561: done (0 left) 2021-07-26T15:58:19.196 INFO:tasks.rados.rados.0.smithi033.stdout:562: snap_create 2021-07-26T15:58:19.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:18 smithi033 bash[19094]: cluster 2021-07-26T15:58:17.935205+0000 mon.a (mon.0) 46 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-07-26T15:58:19.208 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:58:18 smithi033 bash[29474]: debug 2021-07-26T15:58:18.954+0000 7f0abf26a700 -1 osd.3 pg_epoch: 157 pg[3.bs0( v 157'314 (0'0,157'314] local-lis/les=57/58 n=12 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [3,0,4]p3(0) r=0 lpr=57 luod=155'312 crt=155'312 lcod 155'310 mlcod 155'310 active+clean+snaptrim trimq=[4e~1] ps=[4d~1,55~2,5d~1]] removing snap head 2021-07-26T15:58:19.209 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:58:18 smithi033 bash[21582]: debug 2021-07-26T15:58:18.942+0000 7f5ff8c7e700 -1 osd.0 pg_epoch: 157 pg[3.6s0( v 149'29 (0'0,149'29] local-lis/les=57/58 n=2 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [0,1,4]p0(0) r=0 lpr=57 crt=149'29 lcod 144'27 mlcod 144'27 active+clean+snaptrim trimq=[4e~1] ps=[4d~1,55~2,5d~1]] removing snap head 2021-07-26T15:58:19.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:18 smithi096 bash[15117]: cluster 2021-07-26T15:58:17.935205+0000 mon.a (mon.0) 46 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-07-26T15:58:19.959 INFO:tasks.rados.rados.0.smithi033.stdout:562: done (0 left) 2021-07-26T15:58:19.959 INFO:tasks.rados.rados.0.smithi033.stdout:563: copy_from oid 16 from oid 10 current snap is 51 2021-07-26T15:58:19.959 INFO:tasks.rados.rados.0.smithi033.stdout:564: snap_remove snap 46 2021-07-26T15:58:20.067 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:19 smithi033 bash[19094]: cluster 2021-07-26T15:58:18.943714+0000 mgr.y (mgr.34104) 15 : cluster [DBG] pgmap v19: 25 pgs: 25 active+clean; 83 MiB data, 299 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:20.067 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:19 smithi033 bash[19094]: cluster 2021-07-26T15:58:18.945406+0000 mon.a (mon.0) 47 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-07-26T15:58:20.067 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:20 smithi033 systemd[1]: Stopping Ceph mon.c for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T15:58:20.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:19 smithi096 bash[15117]: cluster 2021-07-26T15:58:18.943714+0000 mgr.y (mgr.34104) 15 : cluster [DBG] pgmap v19: 25 pgs: 25 active+clean; 83 MiB data, 299 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:20.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:19 smithi096 bash[15117]: cluster 2021-07-26T15:58:18.945406+0000 mon.a (mon.0) 47 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-07-26T15:58:20.390 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:20 smithi033 docker[42311]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:58:20.391 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:20 smithi033 bash[19094]: debug 2021-07-26T15:58:20.142+0000 7ffbc0dd8700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2021-07-26T15:58:20.391 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:20 smithi033 bash[19094]: debug 2021-07-26T15:58:20.142+0000 7ffbc0dd8700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2021-07-26T15:58:21.232 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:20 smithi033 docker[42311]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-mon.c 2021-07-26T15:58:21.233 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:20 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.c.service: Succeeded. 2021-07-26T15:58:21.233 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:20 smithi033 systemd[1]: Stopped Ceph mon.c for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:58:21.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:21 smithi033 systemd[1]: Started Ceph mon.c for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:58:21.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:21 smithi033 bash[42377]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:58:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.598+0000 7f7c4ded7700 0 set uid:gid to 167:167 (ceph:ceph) 2021-07-26T15:58:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.598+0000 7f7c4ded7700 0 ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev), process ceph-mon, pid 8 2021-07-26T15:58:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.598+0000 7f7c4ded7700 0 pidfile_write: ignore empty --pid-file 2021-07-26T15:58:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.602+0000 7f7c4ded7700 0 load: jerasure load: lrc 2021-07-26T15:58:22.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: RocksDB version: 6.15.5 2021-07-26T15:58:22.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-07-26T15:58:22.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Compile date Jul 24 2021 2021-07-26T15:58:22.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: DB SUMMARY 2021-07-26T15:58:22.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: DB Session ID: O757LYNFJ4SDXRLUFZ03 2021-07-26T15:58:22.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: CURRENT file: CURRENT 2021-07-26T15:58:22.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: IDENTITY file: IDENTITY 2021-07-26T15:58:22.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 882 Bytes 2021-07-26T15:58:22.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000020.sst 2021-07-26T15:58:22.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000018.log size: 2898726 ; 2021-07-26T15:58:22.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.error_if_exists: 0 2021-07-26T15:58:22.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.create_if_missing: 0 2021-07-26T15:58:22.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.paranoid_checks: 1 2021-07-26T15:58:22.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-07-26T15:58:22.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.env: 0x55c747695a20 2021-07-26T15:58:22.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.fs: Posix File System 2021-07-26T15:58:22.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.info_log: 0x55c7482f4080 2021-07-26T15:58:22.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_file_opening_threads: 16 2021-07-26T15:58:22.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.statistics: (nil) 2021-07-26T15:58:22.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.use_fsync: 0 2021-07-26T15:58:22.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_log_file_size: 0 2021-07-26T15:58:22.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-07-26T15:58:22.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-07-26T15:58:22.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.keep_log_file_num: 1000 2021-07-26T15:58:22.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.recycle_log_file_num: 0 2021-07-26T15:58:22.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.allow_fallocate: 1 2021-07-26T15:58:22.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.allow_mmap_reads: 0 2021-07-26T15:58:22.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.allow_mmap_writes: 0 2021-07-26T15:58:22.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.use_direct_reads: 0 2021-07-26T15:58:22.970 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-07-26T15:58:22.970 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.create_missing_column_families: 0 2021-07-26T15:58:22.970 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.db_log_dir: 2021-07-26T15:58:22.970 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-07-26T15:58:22.970 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-07-26T15:58:22.971 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-07-26T15:58:22.971 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-07-26T15:58:22.971 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-07-26T15:58:22.971 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-07-26T15:58:22.972 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-07-26T15:58:22.972 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.advise_random_on_open: 1 2021-07-26T15:58:22.972 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.db_write_buffer_size: 0 2021-07-26T15:58:22.972 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.write_buffer_manager: 0x55c748369d40 2021-07-26T15:58:22.972 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-07-26T15:58:22.973 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-07-26T15:58:22.973 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-07-26T15:58:22.973 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-07-26T15:58:22.973 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.rate_limiter: (nil) 2021-07-26T15:58:22.973 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-07-26T15:58:22.974 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.wal_recovery_mode: 2 2021-07-26T15:58:22.974 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.enable_thread_tracking: 0 2021-07-26T15:58:22.974 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.enable_pipelined_write: 0 2021-07-26T15:58:22.974 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.unordered_write: 0 2021-07-26T15:58:22.975 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-07-26T15:58:22.975 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-07-26T15:58:22.975 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-07-26T15:58:22.975 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-07-26T15:58:22.975 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.row_cache: None 2021-07-26T15:58:22.976 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.wal_filter: None 2021-07-26T15:58:22.976 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-07-26T15:58:22.976 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.allow_ingest_behind: 0 2021-07-26T15:58:22.976 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.preserve_deletes: 0 2021-07-26T15:58:22.976 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.two_write_queues: 0 2021-07-26T15:58:22.977 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.manual_wal_flush: 0 2021-07-26T15:58:22.977 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.atomic_flush: 0 2021-07-26T15:58:22.977 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-07-26T15:58:22.977 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-07-26T15:58:22.977 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-07-26T15:58:22.978 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.log_readahead_size: 0 2021-07-26T15:58:22.978 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2021-07-26T15:58:22.978 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.best_efforts_recovery: 0 2021-07-26T15:58:22.978 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-07-26T15:58:22.979 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-07-26T15:58:22.979 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.allow_data_in_errors: 0 2021-07-26T15:58:22.979 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.db_host_id: __hostname__ 2021-07-26T15:58:22.979 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_background_jobs: 2 2021-07-26T15:58:22.979 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_background_compactions: -1 2021-07-26T15:58:22.980 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_subcompactions: 1 2021-07-26T15:58:22.980 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-07-26T15:58:22.980 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-07-26T15:58:22.981 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-07-26T15:58:22.981 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_total_wal_size: 0 2021-07-26T15:58:22.981 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-07-26T15:58:22.981 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-07-26T15:58:22.981 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-07-26T15:58:22.982 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-07-26T15:58:22.983 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_open_files: -1 2021-07-26T15:58:22.983 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.bytes_per_sync: 0 2021-07-26T15:58:22.983 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-07-26T15:58:22.983 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-07-26T15:58:22.984 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_readahead_size: 0 2021-07-26T15:58:22.984 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_background_flushes: -1 2021-07-26T15:58:22.984 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Compression algorithms supported: 2021-07-26T15:58:22.984 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-07-26T15:58:22.985 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: kZSTD supported: 0 2021-07-26T15:58:22.985 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: kXpressCompression supported: 0 2021-07-26T15:58:22.985 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: kLZ4HCCompression supported: 1 2021-07-26T15:58:22.985 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: kLZ4Compression supported: 1 2021-07-26T15:58:22.985 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: kBZip2Compression supported: 0 2021-07-26T15:58:22.986 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: kZlibCompression supported: 1 2021-07-26T15:58:22.986 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: kSnappyCompression supported: 1 2021-07-26T15:58:22.986 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-07-26T15:58:22.986 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2021-07-26T15:58:22.987 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-07-26T15:58:22.987 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-07-26T15:58:22.987 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.merge_operator: 2021-07-26T15:58:22.987 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_filter: None 2021-07-26T15:58:22.987 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_filter_factory: None 2021-07-26T15:58:22.989 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.sst_partitioner_factory: None 2021-07-26T15:58:22.989 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-07-26T15:58:22.989 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-07-26T15:58:22.990 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c7482bfba8) 2021-07-26T15:58:22.990 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: cache_index_and_filter_blocks: 1 2021-07-26T15:58:22.990 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: cache_index_and_filter_blocks_with_high_priority: 0 2021-07-26T15:58:22.990 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-07-26T15:58:22.991 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: pin_top_level_index_and_filter: 1 2021-07-26T15:58:22.991 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: index_type: 0 2021-07-26T15:58:22.991 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: data_block_index_type: 0 2021-07-26T15:58:22.992 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: index_shortening: 1 2021-07-26T15:58:22.992 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: data_block_hash_table_util_ratio: 0.750000 2021-07-26T15:58:22.992 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: hash_index_allow_collision: 1 2021-07-26T15:58:22.992 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: checksum: 1 2021-07-26T15:58:22.992 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: no_block_cache: 0 2021-07-26T15:58:22.993 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: block_cache: 0x55c7482f0c10 2021-07-26T15:58:22.993 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: block_cache_name: BinnedLRUCache 2021-07-26T15:58:22.997 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: block_cache_options: 2021-07-26T15:58:22.998 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: capacity : 536870912 2021-07-26T15:58:23.000 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: num_shard_bits : 4 2021-07-26T15:58:23.000 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: strict_capacity_limit : 0 2021-07-26T15:58:23.000 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: high_pri_pool_ratio: 0.000 2021-07-26T15:58:23.000 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: block_cache_compressed: (nil) 2021-07-26T15:58:23.001 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: persistent_cache: (nil) 2021-07-26T15:58:23.001 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: block_size: 4096 2021-07-26T15:58:23.001 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: block_size_deviation: 10 2021-07-26T15:58:23.001 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: block_restart_interval: 16 2021-07-26T15:58:23.002 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: index_block_restart_interval: 1 2021-07-26T15:58:23.002 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: metadata_block_size: 4096 2021-07-26T15:58:23.002 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: partition_filters: 0 2021-07-26T15:58:23.002 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: use_delta_encoding: 1 2021-07-26T15:58:23.003 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: filter_policy: rocksdb.BuiltinBloomFilter 2021-07-26T15:58:23.003 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: whole_key_filtering: 1 2021-07-26T15:58:23.003 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: verify_compression: 0 2021-07-26T15:58:23.003 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: read_amp_bytes_per_bit: 0 2021-07-26T15:58:23.003 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: format_version: 4 2021-07-26T15:58:23.004 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: enable_index_compression: 1 2021-07-26T15:58:23.004 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: block_align: 0 2021-07-26T15:58:23.004 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.write_buffer_size: 33554432 2021-07-26T15:58:23.004 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_write_buffer_number: 2 2021-07-26T15:58:23.005 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compression: NoCompression 2021-07-26T15:58:23.005 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.bottommost_compression: Disabled 2021-07-26T15:58:23.005 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.prefix_extractor: nullptr 2021-07-26T15:58:23.005 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-07-26T15:58:23.006 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.num_levels: 7 2021-07-26T15:58:23.006 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-07-26T15:58:23.006 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-07-26T15:58:23.006 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-07-26T15:58:23.007 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-07-26T15:58:23.007 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-07-26T15:58:23.007 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-07-26T15:58:23.007 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-07-26T15:58:23.008 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:58:23.008 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-07-26T15:58:23.008 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-07-26T15:58:23.008 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-07-26T15:58:23.008 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compression_opts.level: 32767 2021-07-26T15:58:23.009 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compression_opts.strategy: 0 2021-07-26T15:58:23.009 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-07-26T15:58:23.009 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:58:23.009 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compression_opts.parallel_threads: 1 2021-07-26T15:58:23.010 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compression_opts.enabled: false 2021-07-26T15:58:23.010 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-07-26T15:58:23.010 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-07-26T15:58:23.010 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-07-26T15:58:23.010 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.target_file_size_base: 67108864 2021-07-26T15:58:23.011 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-07-26T15:58:23.011 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-07-26T15:58:23.011 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-07-26T15:58:23.011 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-07-26T15:58:23.012 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-07-26T15:58:23.012 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-07-26T15:58:23.012 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-07-26T15:58:23.012 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-07-26T15:58:23.012 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-07-26T15:58:23.013 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-07-26T15:58:23.013 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-07-26T15:58:23.013 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-07-26T15:58:23.013 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-07-26T15:58:23.014 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.arena_block_size: 4194304 2021-07-26T15:58:23.014 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-07-26T15:58:23.014 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-07-26T15:58:23.014 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-07-26T15:58:23.014 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.disable_auto_compactions: 0 2021-07-26T15:58:23.015 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-07-26T15:58:23.015 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-07-26T15:58:23.015 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-07-26T15:58:23.015 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-07-26T15:58:23.016 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-07-26T15:58:23.016 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-07-26T15:58:23.016 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-07-26T15:58:23.016 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-07-26T15:58:23.016 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-07-26T15:58:23.017 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-07-26T15:58:23.017 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.table_properties_collectors: 2021-07-26T15:58:23.017 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.inplace_update_support: 0 2021-07-26T15:58:23.017 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-07-26T15:58:23.018 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-07-26T15:58:23.018 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-07-26T15:58:23.018 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-07-26T15:58:23.018 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.bloom_locality: 0 2021-07-26T15:58:23.018 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.max_successive_merges: 0 2021-07-26T15:58:23.019 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-07-26T15:58:23.019 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.paranoid_file_checks: 0 2021-07-26T15:58:23.019 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.force_consistency_checks: 1 2021-07-26T15:58:23.019 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.report_bg_io_stats: 0 2021-07-26T15:58:23.019 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.ttl: 2592000 2021-07-26T15:58:23.020 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-07-26T15:58:23.020 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.enable_blob_files: false 2021-07-26T15:58:23.020 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.min_blob_size: 0 2021-07-26T15:58:23.020 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.blob_file_size: 268435456 2021-07-26T15:58:23.021 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.blob_compression_type: NoCompression 2021-07-26T15:58:23.021 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.enable_blob_garbage_collection: false 2021-07-26T15:58:23.021 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-07-26T15:58:23.021 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-07-26T15:58:23.021 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 22, last_sequence is 12215, log_number is 18,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-07-26T15:58:23.022 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 18 2021-07-26T15:58:23.022 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: [db/version_set.cc:4083] Creating manifest 22 2021-07-26T15:58:23.022 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.606+0000 7f7c4ded7700 4 rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-07-26T15:58:23.023 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.610+0000 7f7c4ded7700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627315102611923, "job": 1, "event": "recovery_started", "wal_files": [18]} 2021-07-26T15:58:23.024 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.610+0000 7f7c4ded7700 4 rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #18 mode 2 2021-07-26T15:58:23.024 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.614+0000 7f7c4ded7700 3 rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-07-26T15:58:23.024 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.618+0000 7f7c4ded7700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627315102620764, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 23, "file_size": 1897799, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 1894452, "index_size": 1963, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 453, "raw_key_size": 3948, "raw_average_key_size": 23, "raw_value_size": 1889754, "raw_average_value_size": 11384, "num_data_blocks": 86, "num_entries": 166, "num_deletions": 8, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1627315102, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "55bf7d20-e43e-4b91-9d4f-0c30ea4f5678", "db_session_id": "O757LYNFJ4SDXRLUFZ03"}} 2021-07-26T15:58:23.025 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.618+0000 7f7c4ded7700 4 rocksdb: [db/version_set.cc:4083] Creating manifest 24 2021-07-26T15:58:23.025 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.618+0000 7f7c4ded7700 4 rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-07-26T15:58:23.025 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.618+0000 7f7c4ded7700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627315102623259, "job": 1, "event": "recovery_finished"} 2021-07-26T15:58:23.026 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.622+0000 7f7c4ded7700 4 rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000018.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-07-26T15:58:23.026 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.622+0000 7f7c4ded7700 4 rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55c74830ca80 2021-07-26T15:58:23.026 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.622+0000 7f7c4ded7700 4 rocksdb: DB pointer 0x55c74831c000 2021-07-26T15:58:23.026 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.622+0000 7f7c3daed700 4 rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-07-26T15:58:23.026 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.622+0000 7f7c3daed700 4 rocksdb: [db/db_impl/db_impl.cc:903] 2021-07-26T15:58:23.027 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: ** DB Stats ** 2021-07-26T15:58:23.027 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:58:23.027 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-07-26T15:58:23.027 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-07-26T15:58:23.028 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:58:23.028 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-07-26T15:58:23.028 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-07-26T15:58:23.028 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:58:23.028 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: ** Compaction Stats [default] ** 2021-07-26T15:58:23.029 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:23.029 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:23.029 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: L0 1/0 1.81 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 513.2 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:23.029 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: L6 1/0 22.38 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:58:23.030 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Sum 2/0 24.19 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 513.2 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:23.030 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 513.2 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:23.030 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: ** Compaction Stats [default] ** 2021-07-26T15:58:23.030 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:23.030 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:23.031 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 513.2 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:23.031 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:58:23.031 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Flush(GB): cumulative 0.002, interval 0.002 2021-07-26T15:58:23.032 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:58:23.032 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:58:23.032 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:58:23.032 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:58:23.032 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Cumulative compaction: 0.00 GB write, 108.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:23.033 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Interval compaction: 0.00 GB write, 108.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:23.033 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:58:23.033 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:58:23.033 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: ** Compaction Stats [default] ** 2021-07-26T15:58:23.033 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:23.034 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:23.034 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: L0 1/0 1.81 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 513.2 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:23.034 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: L6 1/0 22.38 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:58:23.034 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Sum 2/0 24.19 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 513.2 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:23.035 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:58:23.035 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: ** Compaction Stats [default] ** 2021-07-26T15:58:23.035 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:23.035 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:23.035 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 513.2 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:23.036 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:58:23.036 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Flush(GB): cumulative 0.002, interval 0.000 2021-07-26T15:58:23.036 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:58:23.036 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:58:23.037 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:58:23.037 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:58:23.037 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Cumulative compaction: 0.00 GB write, 107.97 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:23.037 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:23.037 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:58:23.038 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:58:23.038 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.622+0000 7f7c4ded7700 0 starting mon.c rank 1 at public addrs [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] at bind addrs [v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:58:23.038 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.622+0000 7f7c4ded7700 1 mon.c@-1(???) e3 preinit fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:58:23.038 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.622+0000 7f7c4ded7700 0 mon.c@-1(???).mds e1 new map 2021-07-26T15:58:23.038 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.622+0000 7f7c4ded7700 0 mon.c@-1(???).mds e1 print_map 2021-07-26T15:58:23.039 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: e1 2021-07-26T15:58:23.039 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: enable_multiple, ever_enabled_multiple: 1,1 2021-07-26T15:58:23.039 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-07-26T15:58:23.039 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: legacy client fscid: -1 2021-07-26T15:58:23.040 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: 2021-07-26T15:58:23.040 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: No filesystems configured 2021-07-26T15:58:23.040 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.626+0000 7f7c4ded7700 0 mon.c@-1(???).osd e158 crush map has features 3314933069571702784, adjusting msgr requires 2021-07-26T15:58:23.040 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.626+0000 7f7c4ded7700 0 mon.c@-1(???).osd e158 crush map has features 288514119978713088, adjusting msgr requires 2021-07-26T15:58:23.040 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.626+0000 7f7c4ded7700 0 mon.c@-1(???).osd e158 crush map has features 288514119978713088, adjusting msgr requires 2021-07-26T15:58:23.041 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.626+0000 7f7c4ded7700 0 mon.c@-1(???).osd e158 crush map has features 288514119978713088, adjusting msgr requires 2021-07-26T15:58:23.041 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:22 smithi033 bash[42377]: debug 2021-07-26T15:58:22.626+0000 7f7c4ded7700 1 mon.c@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2021-07-26T15:58:23.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:23 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:23.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:23.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:23 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:23.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:23 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:23.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T15:58:24.565 INFO:tasks.rados.rados.0.smithi033.stdout:564: done (1 left) 2021-07-26T15:58:24.565 INFO:tasks.rados.rados.0.smithi033.stdout:565: read oid 35 snap -1 2021-07-26T15:58:24.565 INFO:tasks.rados.rados.0.smithi033.stdout:565: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:58:24.566 INFO:tasks.rados.rados.0.smithi033.stdout:566: copy_from oid 27 from oid 13 current snap is 51 2021-07-26T15:58:24.566 INFO:tasks.rados.rados.0.smithi033.stdout:563: finishing copy_from to smithi03339061-16 2021-07-26T15:58:24.566 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 153 (ObjNum 104 snap 19 seq_num 104) dirty exists 2021-07-26T15:58:24.566 INFO:tasks.rados.rados.0.smithi033.stdout:563: finishing copy_from racing read to smithi03339061-16 2021-07-26T15:58:24.567 INFO:tasks.rados.rados.0.smithi033.stdout:563: done (2 left) 2021-07-26T15:58:24.567 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 51 2021-07-26T15:58:24.567 INFO:tasks.rados.rados.0.smithi033.stdout:567: seq_num 189 ranges {221184=770048} 2021-07-26T15:58:24.568 INFO:tasks.rados.rados.0.smithi033.stdout:567: writing smithi03339061-38 from 221184 to 991232 tid 1 2021-07-26T15:58:24.568 INFO:tasks.rados.rados.0.smithi033.stdout:568: rollback oid 15 current snap is 51 2021-07-26T15:58:24.568 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 15 to 50 2021-07-26T15:58:24.569 INFO:tasks.rados.rados.0.smithi033.stdout:565: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:58:24.573 INFO:tasks.rados.rados.0.smithi033.stdout:566: finishing copy_from to smithi03339061-27 2021-07-26T15:58:24.574 INFO:tasks.rados.rados.0.smithi033.stdout:566: got expected ENOENT (src dne) 2021-07-26T15:58:24.574 INFO:tasks.rados.rados.0.smithi033.stdout:565: done (3 left) 2021-07-26T15:58:24.574 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 51 2021-07-26T15:58:24.574 INFO:tasks.rados.rados.0.smithi033.stdout:569: seq_num 190 ranges {892928=786432} 2021-07-26T15:58:24.587 INFO:tasks.rados.rados.0.smithi033.stdout:569: writing smithi03339061-14 from 892928 to 1679360 tid 1 2021-07-26T15:58:24.587 INFO:tasks.rados.rados.0.smithi033.stdout:570: rollback oid 26 current snap is 51 2021-07-26T15:58:24.588 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 26 to 42 2021-07-26T15:58:24.588 INFO:tasks.rados.rados.0.smithi033.stdout:568: finishing rollback tid 0 to smithi03339061-15 2021-07-26T15:58:24.588 INFO:tasks.rados.rados.0.smithi033.stdout:568: finishing rollback tid 1 to smithi03339061-15 2021-07-26T15:58:24.588 INFO:tasks.rados.rados.0.smithi033.stdout:567: finishing write tid 1 to smithi03339061-38 2021-07-26T15:58:24.588 INFO:tasks.rados.rados.0.smithi033.stdout:567: finishing write tid 2 to smithi03339061-38 2021-07-26T15:58:24.589 INFO:tasks.rados.rados.0.smithi033.stdout:568: finishing rollback tid 2 to smithi03339061-15 2021-07-26T15:58:24.589 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 149 (ObjNum 157 snap 39 seq_num 157) dirty exists 2021-07-26T15:58:24.589 INFO:tasks.rados.rados.0.smithi033.stdout:568: done (4 left) 2021-07-26T15:58:24.590 INFO:tasks.rados.rados.0.smithi033.stdout:571: rollback oid 15 current snap is 51 2021-07-26T15:58:24.590 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 15 to 45 2021-07-26T15:58:24.590 INFO:tasks.rados.rados.0.smithi033.stdout:566: finishing copy_from racing read to smithi03339061-27 2021-07-26T15:58:24.592 INFO:tasks.rados.rados.0.smithi033.stdout:567: finishing write tid 3 to smithi03339061-38 2021-07-26T15:58:24.593 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 32 (ObjNum 189 snap 51 seq_num 189) dirty exists 2021-07-26T15:58:24.593 INFO:tasks.rados.rados.0.smithi033.stdout:567: left oid 38 (ObjNum 189 snap 51 seq_num 189) 2021-07-26T15:58:24.593 INFO:tasks.rados.rados.0.smithi033.stdout:566: done (4 left) 2021-07-26T15:58:24.593 INFO:tasks.rados.rados.0.smithi033.stdout:567: done (3 left) 2021-07-26T15:58:24.593 INFO:tasks.rados.rados.0.smithi033.stdout:572: read oid 2 snap 50 2021-07-26T15:58:24.594 INFO:tasks.rados.rados.0.smithi033.stdout:572: expect (ObjNum 151 snap 38 seq_num 151) 2021-07-26T15:58:24.594 INFO:tasks.rados.rados.0.smithi033.stdout:573: copy_from oid 18 from oid 44 current snap is 51 2021-07-26T15:58:24.594 INFO:tasks.rados.rados.0.smithi033.stdout:574: snap_remove snap 49 2021-07-26T15:58:24.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: cluster 2021-07-26T15:58:20.944491+0000 mgr.y (mgr.34104) 16 : cluster [DBG] pgmap v21: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 9.4 MiB/s rd, 3.0 MiB/s wr, 15 op/s 2021-07-26T15:58:24.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: cluster 2021-07-26T15:58:22.837684+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-07-26T15:58:24.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: cluster 2021-07-26T15:58:22.945194+0000 mgr.y (mgr.34104) 17 : cluster [DBG] pgmap v22: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2021-07-26T15:58:24.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: cluster 2021-07-26T15:58:23.529855+0000 mon.a (mon.0) 49 : cluster [INF] mon.a calling monitor election 2021-07-26T15:58:24.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: cluster 2021-07-26T15:58:23.533380+0000 mon.a (mon.0) 50 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:58:24.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: cluster 2021-07-26T15:58:23.542921+0000 mon.a (mon.0) 51 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:58:24.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: cluster 2021-07-26T15:58:23.543040+0000 mon.a (mon.0) 52 : cluster [DBG] fsmap 2021-07-26T15:58:24.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: cluster 2021-07-26T15:58:23.543112+0000 mon.a (mon.0) 53 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-07-26T15:58:24.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: cluster 2021-07-26T15:58:23.543691+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e30: y(active, since 15s), standbys: x 2021-07-26T15:58:24.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: cluster 2021-07-26T15:58:23.549266+0000 mon.a (mon.0) 55 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:24.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: audit 2021-07-26T15:58:23.554392+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:24.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: audit 2021-07-26T15:58:23.558738+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:24.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: audit 2021-07-26T15:58:23.561487+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:24.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:24 smithi096 bash[15117]: audit 2021-07-26T15:58:23.563384+0000 mon.b (mon.2) 43 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:25.573 INFO:tasks.rados.rados.0.smithi033.stdout:571: finishing rollback tid 0 to smithi03339061-15 2021-07-26T15:58:25.573 INFO:tasks.rados.rados.0.smithi033.stdout:570: finishing rollback tid 0 to smithi03339061-26 2021-07-26T15:58:25.573 INFO:tasks.rados.rados.0.smithi033.stdout:570: finishing rollback tid 1 to smithi03339061-26 2021-07-26T15:58:25.574 INFO:tasks.rados.rados.0.smithi033.stdout:571: finishing rollback tid 1 to smithi03339061-15 2021-07-26T15:58:25.574 INFO:tasks.rados.rados.0.smithi033.stdout:571: finishing rollback tid 2 to smithi03339061-15 2021-07-26T15:58:25.574 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 152 (ObjNum 157 snap 39 seq_num 157) dirty exists 2021-07-26T15:58:25.574 INFO:tasks.rados.rados.0.smithi033.stdout:570: finishing rollback tid 2 to smithi03339061-26 2021-07-26T15:58:25.575 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 332 (ObjNum 38 snap 0 seq_num 38) dirty exists 2021-07-26T15:58:25.575 INFO:tasks.rados.rados.0.smithi033.stdout:569: finishing write tid 1 to smithi03339061-14 2021-07-26T15:58:25.575 INFO:tasks.rados.rados.0.smithi033.stdout:569: finishing write tid 2 to smithi03339061-14 2021-07-26T15:58:25.575 INFO:tasks.rados.rados.0.smithi033.stdout:569: finishing write tid 3 to smithi03339061-14 2021-07-26T15:58:25.576 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 187 (ObjNum 190 snap 51 seq_num 190) dirty exists 2021-07-26T15:58:25.576 INFO:tasks.rados.rados.0.smithi033.stdout:569: left oid 14 (ObjNum 190 snap 51 seq_num 190) 2021-07-26T15:58:25.576 INFO:tasks.rados.rados.0.smithi033.stdout:573: finishing copy_from to smithi03339061-18 2021-07-26T15:58:25.576 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 170 (ObjNum 181 snap 47 seq_num 181) dirty exists 2021-07-26T15:58:25.576 INFO:tasks.rados.rados.0.smithi033.stdout:572: expect (ObjNum 151 snap 38 seq_num 151) 2021-07-26T15:58:25.700 INFO:tasks.rados.rados.0.smithi033.stdout:573: finishing copy_from racing read to smithi03339061-18 2021-07-26T15:58:25.700 INFO:tasks.rados.rados.0.smithi033.stdout:569: done (5 left) 2021-07-26T15:58:25.700 INFO:tasks.rados.rados.0.smithi033.stdout:570: done (4 left) 2021-07-26T15:58:25.701 INFO:tasks.rados.rados.0.smithi033.stdout:571: done (3 left) 2021-07-26T15:58:25.701 INFO:tasks.rados.rados.0.smithi033.stdout:572: done (2 left) 2021-07-26T15:58:25.701 INFO:tasks.rados.rados.0.smithi033.stdout:573: done (1 left) 2021-07-26T15:58:25.701 INFO:tasks.rados.rados.0.smithi033.stdout:574: done (0 left) 2021-07-26T15:58:25.701 INFO:tasks.rados.rados.0.smithi033.stdout:575: copy_from oid 17 from oid 42 current snap is 51 2021-07-26T15:58:25.702 INFO:tasks.rados.rados.0.smithi033.stdout:576: snap_create 2021-07-26T15:58:25.702 INFO:tasks.rados.rados.0.smithi033.stdout:575: finishing copy_from to smithi03339061-17 2021-07-26T15:58:25.702 INFO:tasks.rados.rados.0.smithi033.stdout:575: got expected ENOENT (src dne) 2021-07-26T15:58:25.703 INFO:tasks.rados.rados.0.smithi033.stdout:575: finishing copy_from racing read to smithi03339061-17 2021-07-26T15:58:25.921 INFO:tasks.rados.rados.0.smithi033.stdout:575: done (1 left) 2021-07-26T15:58:25.922 INFO:tasks.rados.rados.0.smithi033.stdout:576: done (0 left) 2021-07-26T15:58:25.922 INFO:tasks.rados.rados.0.smithi033.stdout:577: setattr oid 21 current snap is 52 2021-07-26T15:58:25.925 INFO:tasks.rados.rados.0.smithi033.stdout:578: rmattr oid 25 current snap is 52 2021-07-26T15:58:25.925 INFO:tasks.rados.rados.0.smithi033.stdout:578: done (1 left) 2021-07-26T15:58:25.925 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 52 2021-07-26T15:58:25.925 INFO:tasks.rados.rados.0.smithi033.stdout:579: seq_num 191 ranges {4186112=802816} 2021-07-26T15:58:25.955 INFO:tasks.rados.rados.0.smithi033.stdout:579: writing smithi03339061-30 from 4186112 to 4988928 tid 1 2021-07-26T15:58:25.956 INFO:tasks.rados.rados.0.smithi033.stdout:580: snap_create 2021-07-26T15:58:25.956 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 290 (ObjNum 41 snap 0 seq_num 41) dirty exists 2021-07-26T15:58:25.961 INFO:tasks.rados.rados.0.smithi033.stdout:579: finishing write tid 1 to smithi03339061-30 2021-07-26T15:58:25.962 INFO:tasks.rados.rados.0.smithi033.stdout:579: finishing write tid 2 to smithi03339061-30 2021-07-26T15:58:25.963 INFO:tasks.rados.rados.0.smithi033.stdout:579: finishing write tid 3 to smithi03339061-30 2021-07-26T15:58:25.964 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 168 (ObjNum 191 snap 52 seq_num 191) dirty exists 2021-07-26T15:58:25.964 INFO:tasks.rados.rados.0.smithi033.stdout:579: left oid 30 (ObjNum 191 snap 52 seq_num 191) 2021-07-26T15:58:25.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:25 smithi096 bash[15117]: cluster 2021-07-26T15:58:24.554841+0000 mon.a (mon.0) 57 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-07-26T15:58:26.932 INFO:tasks.rados.rados.0.smithi033.stdout:577: done (2 left) 2021-07-26T15:58:26.933 INFO:tasks.rados.rados.0.smithi033.stdout:579: done (1 left) 2021-07-26T15:58:26.933 INFO:tasks.rados.rados.0.smithi033.stdout:580: done (0 left) 2021-07-26T15:58:26.933 INFO:tasks.rados.rados.0.smithi033.stdout:581: snap_remove snap 42 2021-07-26T15:58:26.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:26 smithi096 bash[15117]: cluster 2021-07-26T15:58:24.945922+0000 mgr.y (mgr.34104) 18 : cluster [DBG] pgmap v24: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2021-07-26T15:58:26.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:26 smithi096 bash[15117]: cluster 2021-07-26T15:58:25.569529+0000 mon.a (mon.0) 58 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-07-26T15:58:26.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:26 smithi096 bash[15117]: cluster 2021-07-26T15:58:25.918508+0000 mon.a (mon.0) 59 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-07-26T15:58:27.946 INFO:tasks.rados.rados.0.smithi033.stdout:581: done (0 left) 2021-07-26T15:58:27.947 INFO:tasks.rados.rados.0.smithi033.stdout:582: snap_remove snap 50 2021-07-26T15:58:28.237 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:58:27 smithi096 bash[20458]: debug 2021-07-26T15:58:27.951+0000 7f2dd473f700 -1 osd.5 pg_epoch: 163 pg[3.cs0( v 159'209 (0'0,159'209] local-lis/les=57/58 n=7 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [5,3,6]p5(0) r=0 lpr=57 crt=159'209 lcod 157'207 mlcod 157'207 active+clean+snaptrim trimq=[51~1] ps=[5a~1,5f~1]] removing snap head 2021-07-26T15:58:28.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:27 smithi096 bash[15117]: cluster 2021-07-26T15:58:26.929164+0000 mon.a (mon.0) 60 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-07-26T15:58:28.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:27 smithi096 bash[15117]: cluster 2021-07-26T15:58:26.946544+0000 mgr.y (mgr.34104) 19 : cluster [DBG] pgmap v28: 25 pgs: 25 active+clean; 94 MiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2021-07-26T15:58:28.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:27 smithi096 bash[15117]: audit 2021-07-26T15:58:27.899481+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:28.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:27 smithi096 bash[15117]: audit 2021-07-26T15:58:27.910678+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:28.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:27 smithi096 bash[15117]: audit 2021-07-26T15:58:27.923064+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:28.949 INFO:tasks.rados.rados.0.smithi033.stdout:582: done (0 left) 2021-07-26T15:58:28.950 INFO:tasks.rados.rados.0.smithi033.stdout:583: rollback oid 12 current snap is 53 2021-07-26T15:58:28.950 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 12 to 52 2021-07-26T15:58:28.950 INFO:tasks.rados.rados.0.smithi033.stdout:584: read oid 21 snap -1 2021-07-26T15:58:28.951 INFO:tasks.rados.rados.0.smithi033.stdout:584: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:58:28.951 INFO:tasks.rados.rados.0.smithi033.stdout:585: rmattr oid 8 current snap is 53 2021-07-26T15:58:28.951 INFO:tasks.rados.rados.0.smithi033.stdout:585: done (2 left) 2021-07-26T15:58:28.951 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 53 2021-07-26T15:58:28.952 INFO:tasks.rados.rados.0.smithi033.stdout:586: seq_num 192 ranges {1474560=417792,1892352=401408} 2021-07-26T15:58:28.960 INFO:tasks.rados.rados.0.smithi033.stdout:586: writing smithi03339061-24 from 1474560 to 1892352 tid 1 2021-07-26T15:58:28.964 INFO:tasks.rados.rados.0.smithi033.stdout:586: writing smithi03339061-24 from 1892352 to 2293760 tid 2 2021-07-26T15:58:28.964 INFO:tasks.rados.rados.0.smithi033.stdout:587: rollback oid 6 current snap is 53 2021-07-26T15:58:28.964 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 47 2021-07-26T15:58:28.965 INFO:tasks.rados.rados.0.smithi033.stdout:583: finishing rollback tid 0 to smithi03339061-12 2021-07-26T15:58:28.965 INFO:tasks.rados.rados.0.smithi033.stdout:583: finishing rollback tid 1 to smithi03339061-12 2021-07-26T15:58:28.965 INFO:tasks.rados.rados.0.smithi033.stdout:583: finishing rollback tid 2 to smithi03339061-12 2021-07-26T15:58:28.965 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 150 (ObjNum 137 snap 34 seq_num 137) dirty exists 2021-07-26T15:58:28.966 INFO:tasks.rados.rados.0.smithi033.stdout:583: done (3 left) 2021-07-26T15:58:28.967 INFO:tasks.rados.rados.0.smithi033.stdout:588: read oid 29 snap -1 2021-07-26T15:58:28.967 INFO:tasks.rados.rados.0.smithi033.stdout:588: expect (ObjNum 158 snap 39 seq_num 158) 2021-07-26T15:58:28.967 INFO:tasks.rados.rados.0.smithi033.stdout:589: snap_remove snap 45 2021-07-26T15:58:29.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:28 smithi096 bash[15117]: audit 2021-07-26T15:58:27.926428+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:29.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:28 smithi096 bash[15117]: cluster 2021-07-26T15:58:27.942559+0000 mon.a (mon.0) 63 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-07-26T15:58:29.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:28 smithi096 bash[15117]: audit 2021-07-26T15:58:27.946370+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:58:29.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:28 smithi096 bash[15117]: audit 2021-07-26T15:58:27.952534+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-07-26T15:58:29.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:28 smithi096 bash[15117]: cephadm 2021-07-26T15:58:27.954196+0000 mgr.y (mgr.34104) 20 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2021-07-26T15:58:29.972 INFO:tasks.rados.rados.0.smithi033.stdout:589: done (4 left) 2021-07-26T15:58:29.972 INFO:tasks.rados.rados.0.smithi033.stdout:590: read oid 9 snap -1 2021-07-26T15:58:29.973 INFO:tasks.rados.rados.0.smithi033.stdout:590: expect (ObjNum 122 snap 28 seq_num 122) 2021-07-26T15:58:29.973 INFO:tasks.rados.rados.0.smithi033.stdout:591: setattr oid 44 current snap is 53 2021-07-26T15:58:29.973 INFO:tasks.rados.rados.0.smithi033.stdout:584: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:58:30.002 INFO:tasks.rados.rados.0.smithi033.stdout:587: finishing rollback tid 0 to smithi03339061-6 2021-07-26T15:58:30.003 INFO:tasks.rados.rados.0.smithi033.stdout:588: expect (ObjNum 158 snap 39 seq_num 158) 2021-07-26T15:58:30.012 INFO:tasks.rados.rados.0.smithi033.stdout:587: finishing rollback tid 1 to smithi03339061-6 2021-07-26T15:58:30.012 INFO:tasks.rados.rados.0.smithi033.stdout:586: finishing write tid 1 to smithi03339061-24 2021-07-26T15:58:30.013 INFO:tasks.rados.rados.0.smithi033.stdout:586: finishing write tid 2 to smithi03339061-24 2021-07-26T15:58:30.013 INFO:tasks.rados.rados.0.smithi033.stdout:587: finishing rollback tid 2 to smithi03339061-6 2021-07-26T15:58:30.013 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 356 (ObjNum 99 snap 18 seq_num 99) dirty exists 2021-07-26T15:58:30.013 INFO:tasks.rados.rados.0.smithi033.stdout:586: finishing write tid 3 to smithi03339061-24 2021-07-26T15:58:30.014 INFO:tasks.rados.rados.0.smithi033.stdout:586: finishing write tid 4 to smithi03339061-24 2021-07-26T15:58:30.014 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 180 (ObjNum 192 snap 53 seq_num 192) dirty exists 2021-07-26T15:58:30.014 INFO:tasks.rados.rados.0.smithi033.stdout:586: left oid 24 (ObjNum 192 snap 53 seq_num 192) 2021-07-26T15:58:30.014 INFO:tasks.rados.rados.0.smithi033.stdout:590: expect (ObjNum 122 snap 28 seq_num 122) 2021-07-26T15:58:30.129 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 201 (ObjNum 181 snap 47 seq_num 181) dirty exists 2021-07-26T15:58:30.129 INFO:tasks.rados.rados.0.smithi033.stdout:584: done (5 left) 2021-07-26T15:58:30.129 INFO:tasks.rados.rados.0.smithi033.stdout:586: done (4 left) 2021-07-26T15:58:30.130 INFO:tasks.rados.rados.0.smithi033.stdout:587: done (3 left) 2021-07-26T15:58:30.130 INFO:tasks.rados.rados.0.smithi033.stdout:588: done (2 left) 2021-07-26T15:58:30.130 INFO:tasks.rados.rados.0.smithi033.stdout:590: done (1 left) 2021-07-26T15:58:30.130 INFO:tasks.rados.rados.0.smithi033.stdout:591: done (0 left) 2021-07-26T15:58:30.131 INFO:tasks.rados.rados.0.smithi033.stdout:592: delete oid 45 current snap is 53 2021-07-26T15:58:30.133 INFO:tasks.rados.rados.0.smithi033.stdout:592: done (0 left) 2021-07-26T15:58:30.133 INFO:tasks.rados.rados.0.smithi033.stdout:593: read oid 9 snap 52 2021-07-26T15:58:30.133 INFO:tasks.rados.rados.0.smithi033.stdout:593: expect (ObjNum 122 snap 28 seq_num 122) 2021-07-26T15:58:30.133 INFO:tasks.rados.rados.0.smithi033.stdout:594: read oid 13 snap -1 2021-07-26T15:58:30.133 INFO:tasks.rados.rados.0.smithi033.stdout:594: expect deleted 2021-07-26T15:58:30.134 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 53 2021-07-26T15:58:30.134 INFO:tasks.rados.rados.0.smithi033.stdout:595: seq_num 194 ranges {753664=458752,1212416=401408} 2021-07-26T15:58:30.148 INFO:tasks.rados.rados.0.smithi033.stdout:595: writing smithi03339061-11 from 753664 to 1212416 tid 1 2021-07-26T15:58:30.151 INFO:tasks.rados.rados.0.smithi033.stdout:595: writing smithi03339061-11 from 1212416 to 1613824 tid 2 2021-07-26T15:58:30.151 INFO:tasks.rados.rados.0.smithi033.stdout:596: read oid 39 snap -1 2021-07-26T15:58:30.151 INFO:tasks.rados.rados.0.smithi033.stdout:596: expect (ObjNum 186 snap 49 seq_num 186) 2021-07-26T15:58:30.151 INFO:tasks.rados.rados.0.smithi033.stdout:597: rollback oid 19 current snap is 53 2021-07-26T15:58:30.151 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 19 to 47 2021-07-26T15:58:30.152 INFO:tasks.rados.rados.0.smithi033.stdout:593: expect (ObjNum 122 snap 28 seq_num 122) 2021-07-26T15:58:30.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:29 smithi096 bash[15117]: cluster 2021-07-26T15:58:28.942693+0000 mon.a (mon.0) 64 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-07-26T15:58:30.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:29 smithi096 bash[15117]: cluster 2021-07-26T15:58:28.947207+0000 mgr.y (mgr.34104) 21 : cluster [DBG] pgmap v31: 25 pgs: 25 active+clean; 94 MiB data, 323 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:30.273 INFO:tasks.rados.rados.0.smithi033.stdout:597: finishing rollback tid 1 to smithi03339061-19 2021-07-26T15:58:30.274 INFO:tasks.rados.rados.0.smithi033.stdout:596: expect (ObjNum 186 snap 49 seq_num 186) 2021-07-26T15:58:30.293 INFO:tasks.rados.rados.0.smithi033.stdout:595: finishing write tid 1 to smithi03339061-11 2021-07-26T15:58:30.293 INFO:tasks.rados.rados.0.smithi033.stdout:597: finishing rollback tid 2 to smithi03339061-19 2021-07-26T15:58:30.293 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 172 (ObjNum 36 snap 0 seq_num 36) dirty exists 2021-07-26T15:58:30.294 INFO:tasks.rados.rados.0.smithi033.stdout:595: finishing write tid 2 to smithi03339061-11 2021-07-26T15:58:30.294 INFO:tasks.rados.rados.0.smithi033.stdout:595: finishing write tid 3 to smithi03339061-11 2021-07-26T15:58:30.294 INFO:tasks.rados.rados.0.smithi033.stdout:595: finishing write tid 4 to smithi03339061-11 2021-07-26T15:58:30.294 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 83 (ObjNum 194 snap 53 seq_num 194) dirty exists 2021-07-26T15:58:30.295 INFO:tasks.rados.rados.0.smithi033.stdout:595: left oid 11 (ObjNum 194 snap 53 seq_num 194) 2021-07-26T15:58:30.295 INFO:tasks.rados.rados.0.smithi033.stdout:593: done (4 left) 2021-07-26T15:58:30.295 INFO:tasks.rados.rados.0.smithi033.stdout:594: done (3 left) 2021-07-26T15:58:30.295 INFO:tasks.rados.rados.0.smithi033.stdout:595: done (2 left) 2021-07-26T15:58:30.296 INFO:tasks.rados.rados.0.smithi033.stdout:596: done (1 left) 2021-07-26T15:58:30.296 INFO:tasks.rados.rados.0.smithi033.stdout:597: done (0 left) 2021-07-26T15:58:30.296 INFO:tasks.rados.rados.0.smithi033.stdout:598: setattr oid 24 current snap is 53 2021-07-26T15:58:30.297 INFO:tasks.rados.rados.0.smithi033.stdout:599: delete oid 28 current snap is 53 2021-07-26T15:58:30.301 INFO:tasks.rados.rados.0.smithi033.stdout:599: done (1 left) 2021-07-26T15:58:30.301 INFO:tasks.rados.rados.0.smithi033.stdout:600: rollback oid 31 current snap is 53 2021-07-26T15:58:30.301 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 31 to 47 2021-07-26T15:58:30.302 INFO:tasks.rados.rados.0.smithi033.stdout:601: setattr oid 4 current snap is 53 2021-07-26T15:58:30.303 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 187 (ObjNum 192 snap 53 seq_num 192) dirty exists 2021-07-26T15:58:30.303 INFO:tasks.rados.rados.0.smithi033.stdout:600: finishing rollback tid 1 to smithi03339061-31 2021-07-26T15:58:30.304 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 0 (ObjNum 2006203000 snap 22002 seq_num 2007343520) dirty dne 2021-07-26T15:58:30.307 INFO:tasks.rados.rados.0.smithi033.stdout:598: done (2 left) 2021-07-26T15:58:30.307 INFO:tasks.rados.rados.0.smithi033.stdout:600: done (1 left) 2021-07-26T15:58:30.307 INFO:tasks.rados.rados.0.smithi033.stdout:602: setattr oid 6 current snap is 53 2021-07-26T15:58:30.311 INFO:tasks.rados.rados.0.smithi033.stdout:603: snap_remove snap 51 2021-07-26T15:58:31.221 INFO:tasks.rados.rados.0.smithi033.stdout:603: done (2 left) 2021-07-26T15:58:31.222 INFO:tasks.rados.rados.0.smithi033.stdout:604: delete oid 25 current snap is 53 2021-07-26T15:58:31.222 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 203 (ObjNum 161 snap 39 seq_num 161) dirty exists 2021-07-26T15:58:31.222 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 367 (ObjNum 99 snap 18 seq_num 99) dirty exists 2021-07-26T15:58:31.228 INFO:tasks.rados.rados.0.smithi033.stdout:601: done (2 left) 2021-07-26T15:58:31.228 INFO:tasks.rados.rados.0.smithi033.stdout:602: done (1 left) 2021-07-26T15:58:31.228 INFO:tasks.rados.rados.0.smithi033.stdout:604: done (0 left) 2021-07-26T15:58:31.228 INFO:tasks.rados.rados.0.smithi033.stdout:605: read oid 42 snap -1 2021-07-26T15:58:31.229 INFO:tasks.rados.rados.0.smithi033.stdout:605: expect deleted 2021-07-26T15:58:31.229 INFO:tasks.rados.rados.0.smithi033.stdout:606: read oid 24 snap -1 2021-07-26T15:58:31.229 INFO:tasks.rados.rados.0.smithi033.stdout:606: expect (ObjNum 192 snap 53 seq_num 192) 2021-07-26T15:58:31.229 INFO:tasks.rados.rados.0.smithi033.stdout:607: rmattr oid 45 current snap is 53 2021-07-26T15:58:31.229 INFO:tasks.rados.rados.0.smithi033.stdout:607: done (2 left) 2021-07-26T15:58:31.230 INFO:tasks.rados.rados.0.smithi033.stdout:608: snap_remove snap 52 2021-07-26T15:58:31.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:30 smithi096 bash[15117]: cluster 2021-07-26T15:58:29.969035+0000 mon.a (mon.0) 65 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-07-26T15:58:31.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:30 smithi096 bash[15117]: cephadm 2021-07-26T15:58:30.205012+0000 mgr.y (mgr.34104) 22 : cephadm [INF] Upgrade: Updating mon.b 2021-07-26T15:58:31.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:30 smithi096 bash[15117]: audit 2021-07-26T15:58:30.212899+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:31.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:30 smithi096 bash[15117]: audit 2021-07-26T15:58:30.219067+0000 mon.b (mon.2) 48 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:31.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:30 smithi096 bash[15117]: audit 2021-07-26T15:58:30.219204+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:31.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:30 smithi096 bash[15117]: cephadm 2021-07-26T15:58:30.223078+0000 mgr.y (mgr.34104) 23 : cephadm [INF] Deploying daemon mon.b on smithi096 2021-07-26T15:58:31.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:30 smithi096 bash[15117]: audit 2021-07-26T15:58:30.223514+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:32.227 INFO:tasks.rados.rados.0.smithi033.stdout:608: done (2 left) 2021-07-26T15:58:32.228 INFO:tasks.rados.rados.0.smithi033.stdout:609: setattr oid 22 current snap is 53 2021-07-26T15:58:32.229 INFO:tasks.rados.rados.0.smithi033.stdout:606: expect (ObjNum 192 snap 53 seq_num 192) 2021-07-26T15:58:32.327 INFO:tasks.rados.rados.0.smithi033.stdout:605: done (2 left) 2021-07-26T15:58:32.328 INFO:tasks.rados.rados.0.smithi033.stdout:606: done (1 left) 2021-07-26T15:58:32.328 INFO:tasks.rados.rados.0.smithi033.stdout:610: snap_create 2021-07-26T15:58:32.332 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 376 (ObjNum 0 snap 0 seq_num 0) dirty exists 2021-07-26T15:58:32.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:32 smithi096 bash[15117]: cluster 2021-07-26T15:58:30.947933+0000 mgr.y (mgr.34104) 24 : cluster [DBG] pgmap v33: 25 pgs: 25 active+clean; 90 MiB data, 336 MiB used, 715 GiB / 715 GiB avail; 718 KiB/s rd, 394 KiB/s wr, 9 op/s 2021-07-26T15:58:32.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:32 smithi096 bash[15117]: cluster 2021-07-26T15:58:31.218641+0000 mon.a (mon.0) 68 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-07-26T15:58:32.954 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:32 smithi096 systemd[1]: Stopping Ceph mon.b for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T15:58:32.954 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:32 smithi096 docker[33914]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:58:32.955 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:32 smithi096 bash[15117]: debug 2021-07-26T15:58:32.671+0000 7f291caa8700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2021-07-26T15:58:32.955 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:32 smithi096 bash[15117]: debug 2021-07-26T15:58:32.671+0000 7f291caa8700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2021-07-26T15:58:33.798 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:33 smithi096 docker[33914]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-mon.b 2021-07-26T15:58:33.799 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:33 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@mon.b.service: Succeeded. 2021-07-26T15:58:33.799 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:33 smithi096 systemd[1]: Stopped Ceph mon.b for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:58:33.799 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:33 smithi096 systemd[1]: Started Ceph mon.b for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:58:33.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:33 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:33.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:33 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:33.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:33 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:33.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T15:58:34.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:33 smithi096 bash[33981]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:58:35.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.911+0000 7fb69c3ff700 0 set uid:gid to 167:167 (ceph:ceph) 2021-07-26T15:58:35.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.911+0000 7fb69c3ff700 0 ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev), process ceph-mon, pid 7 2021-07-26T15:58:35.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.911+0000 7fb69c3ff700 0 pidfile_write: ignore empty --pid-file 2021-07-26T15:58:35.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 0 load: jerasure load: lrc 2021-07-26T15:58:35.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: RocksDB version: 6.15.5 2021-07-26T15:58:35.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-07-26T15:58:35.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Compile date Jul 24 2021 2021-07-26T15:58:35.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: DB SUMMARY 2021-07-26T15:58:35.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: DB Session ID: C273U2ZELH2H428L4FGS 2021-07-26T15:58:35.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: CURRENT file: CURRENT 2021-07-26T15:58:35.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: IDENTITY file: IDENTITY 2021-07-26T15:58:35.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 882 Bytes 2021-07-26T15:58:35.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000020.sst 2021-07-26T15:58:35.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000018.log size: 4047784 ; 2021-07-26T15:58:35.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.error_if_exists: 0 2021-07-26T15:58:35.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.create_if_missing: 0 2021-07-26T15:58:35.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.paranoid_checks: 1 2021-07-26T15:58:35.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.track_and_verify_wals_in_manifest: 0 2021-07-26T15:58:35.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.env: 0x559ed2dc9a20 2021-07-26T15:58:35.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.fs: Posix File System 2021-07-26T15:58:35.242 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.info_log: 0x559ed53ac080 2021-07-26T15:58:35.243 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_file_opening_threads: 16 2021-07-26T15:58:35.243 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.statistics: (nil) 2021-07-26T15:58:35.243 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.use_fsync: 0 2021-07-26T15:58:35.244 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_log_file_size: 0 2021-07-26T15:58:35.244 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-07-26T15:58:35.244 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-07-26T15:58:35.245 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.keep_log_file_num: 1000 2021-07-26T15:58:35.246 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.recycle_log_file_num: 0 2021-07-26T15:58:35.246 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.allow_fallocate: 1 2021-07-26T15:58:35.246 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.allow_mmap_reads: 0 2021-07-26T15:58:35.247 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.allow_mmap_writes: 0 2021-07-26T15:58:35.247 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.use_direct_reads: 0 2021-07-26T15:58:35.247 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-07-26T15:58:35.248 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.create_missing_column_families: 0 2021-07-26T15:58:35.248 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.db_log_dir: 2021-07-26T15:58:35.248 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-07-26T15:58:35.249 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-07-26T15:58:35.249 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-07-26T15:58:35.249 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-07-26T15:58:35.249 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-07-26T15:58:35.249 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-07-26T15:58:35.250 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-07-26T15:58:35.250 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.advise_random_on_open: 1 2021-07-26T15:58:35.250 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.db_write_buffer_size: 0 2021-07-26T15:58:35.250 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.write_buffer_manager: 0x559ed5421d40 2021-07-26T15:58:35.251 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-07-26T15:58:35.251 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-07-26T15:58:35.251 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-07-26T15:58:35.251 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-07-26T15:58:35.252 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.rate_limiter: (nil) 2021-07-26T15:58:35.252 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-07-26T15:58:35.252 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.wal_recovery_mode: 2 2021-07-26T15:58:35.252 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.enable_thread_tracking: 0 2021-07-26T15:58:35.254 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.enable_pipelined_write: 0 2021-07-26T15:58:35.254 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.unordered_write: 0 2021-07-26T15:58:35.254 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-07-26T15:58:35.255 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-07-26T15:58:35.256 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-07-26T15:58:35.256 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-07-26T15:58:35.257 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.row_cache: None 2021-07-26T15:58:35.257 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.wal_filter: None 2021-07-26T15:58:35.257 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-07-26T15:58:35.257 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.allow_ingest_behind: 0 2021-07-26T15:58:35.258 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.preserve_deletes: 0 2021-07-26T15:58:35.258 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.two_write_queues: 0 2021-07-26T15:58:35.258 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.manual_wal_flush: 0 2021-07-26T15:58:35.258 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.atomic_flush: 0 2021-07-26T15:58:35.259 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-07-26T15:58:35.259 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-07-26T15:58:35.259 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-07-26T15:58:35.259 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.log_readahead_size: 0 2021-07-26T15:58:35.260 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.file_checksum_gen_factory: Unknown 2021-07-26T15:58:35.260 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.best_efforts_recovery: 0 2021-07-26T15:58:35.260 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_bgerror_resume_count: 2147483647 2021-07-26T15:58:35.260 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.bgerror_resume_retry_interval: 1000000 2021-07-26T15:58:35.261 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.allow_data_in_errors: 0 2021-07-26T15:58:35.261 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.db_host_id: __hostname__ 2021-07-26T15:58:35.261 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_background_jobs: 2 2021-07-26T15:58:35.261 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_background_compactions: -1 2021-07-26T15:58:35.262 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_subcompactions: 1 2021-07-26T15:58:35.262 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-07-26T15:58:35.262 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-07-26T15:58:35.262 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-07-26T15:58:35.263 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_total_wal_size: 0 2021-07-26T15:58:35.263 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-07-26T15:58:35.263 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-07-26T15:58:35.263 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-07-26T15:58:35.264 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-07-26T15:58:35.264 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_open_files: -1 2021-07-26T15:58:35.264 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.bytes_per_sync: 0 2021-07-26T15:58:35.264 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-07-26T15:58:35.265 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-07-26T15:58:35.265 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_readahead_size: 0 2021-07-26T15:58:35.265 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_background_flushes: -1 2021-07-26T15:58:35.265 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Compression algorithms supported: 2021-07-26T15:58:35.265 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-07-26T15:58:35.266 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: kZSTD supported: 0 2021-07-26T15:58:35.266 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: kXpressCompression supported: 0 2021-07-26T15:58:35.266 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: kLZ4HCCompression supported: 1 2021-07-26T15:58:35.266 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: kLZ4Compression supported: 1 2021-07-26T15:58:35.267 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: kBZip2Compression supported: 0 2021-07-26T15:58:35.267 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: kZlibCompression supported: 1 2021-07-26T15:58:35.267 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: kSnappyCompression supported: 1 2021-07-26T15:58:35.267 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-07-26T15:58:35.268 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2021-07-26T15:58:35.268 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2021-07-26T15:58:35.268 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-07-26T15:58:35.268 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.merge_operator: 2021-07-26T15:58:35.269 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_filter: None 2021-07-26T15:58:35.269 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_filter_factory: None 2021-07-26T15:58:35.269 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.sst_partitioner_factory: None 2021-07-26T15:58:35.269 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-07-26T15:58:35.269 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-07-26T15:58:35.270 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559ed5377ba8) 2021-07-26T15:58:35.270 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: cache_index_and_filter_blocks: 1 2021-07-26T15:58:35.270 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: cache_index_and_filter_blocks_with_high_priority: 0 2021-07-26T15:58:35.270 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-07-26T15:58:35.271 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: pin_top_level_index_and_filter: 1 2021-07-26T15:58:35.271 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: index_type: 0 2021-07-26T15:58:35.271 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: data_block_index_type: 0 2021-07-26T15:58:35.271 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: index_shortening: 1 2021-07-26T15:58:35.271 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: data_block_hash_table_util_ratio: 0.750000 2021-07-26T15:58:35.272 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: hash_index_allow_collision: 1 2021-07-26T15:58:35.272 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: checksum: 1 2021-07-26T15:58:35.272 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: no_block_cache: 0 2021-07-26T15:58:35.272 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: block_cache: 0x559ed53a8c10 2021-07-26T15:58:35.273 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: block_cache_name: BinnedLRUCache 2021-07-26T15:58:35.273 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: block_cache_options: 2021-07-26T15:58:35.273 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: capacity : 536870912 2021-07-26T15:58:35.273 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: num_shard_bits : 4 2021-07-26T15:58:35.274 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: strict_capacity_limit : 0 2021-07-26T15:58:35.274 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: high_pri_pool_ratio: 0.000 2021-07-26T15:58:35.274 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: block_cache_compressed: (nil) 2021-07-26T15:58:35.274 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: persistent_cache: (nil) 2021-07-26T15:58:35.274 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: block_size: 4096 2021-07-26T15:58:35.275 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: block_size_deviation: 10 2021-07-26T15:58:35.275 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: block_restart_interval: 16 2021-07-26T15:58:35.275 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: index_block_restart_interval: 1 2021-07-26T15:58:35.275 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: metadata_block_size: 4096 2021-07-26T15:58:35.276 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: partition_filters: 0 2021-07-26T15:58:35.276 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: use_delta_encoding: 1 2021-07-26T15:58:35.276 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: filter_policy: rocksdb.BuiltinBloomFilter 2021-07-26T15:58:35.276 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: whole_key_filtering: 1 2021-07-26T15:58:35.277 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: verify_compression: 0 2021-07-26T15:58:35.277 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: read_amp_bytes_per_bit: 0 2021-07-26T15:58:35.277 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: format_version: 4 2021-07-26T15:58:35.277 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: enable_index_compression: 1 2021-07-26T15:58:35.277 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: block_align: 0 2021-07-26T15:58:35.278 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.write_buffer_size: 33554432 2021-07-26T15:58:35.278 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_write_buffer_number: 2 2021-07-26T15:58:35.278 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compression: NoCompression 2021-07-26T15:58:35.278 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.bottommost_compression: Disabled 2021-07-26T15:58:35.279 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.prefix_extractor: nullptr 2021-07-26T15:58:35.279 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-07-26T15:58:35.279 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.num_levels: 7 2021-07-26T15:58:35.279 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-07-26T15:58:35.279 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-07-26T15:58:35.280 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-07-26T15:58:35.280 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-07-26T15:58:35.280 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-07-26T15:58:35.280 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-07-26T15:58:35.281 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-07-26T15:58:35.281 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:58:35.281 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2021-07-26T15:58:35.281 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-07-26T15:58:35.282 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-07-26T15:58:35.282 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compression_opts.level: 32767 2021-07-26T15:58:35.282 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compression_opts.strategy: 0 2021-07-26T15:58:35.282 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-07-26T15:58:35.282 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-07-26T15:58:35.283 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compression_opts.parallel_threads: 1 2021-07-26T15:58:35.283 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compression_opts.enabled: false 2021-07-26T15:58:35.283 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-07-26T15:58:35.283 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-07-26T15:58:35.284 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-07-26T15:58:35.284 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.target_file_size_base: 67108864 2021-07-26T15:58:35.284 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-07-26T15:58:35.284 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-07-26T15:58:35.284 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-07-26T15:58:35.285 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-07-26T15:58:35.285 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-07-26T15:58:35.285 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-07-26T15:58:35.285 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-07-26T15:58:35.286 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-07-26T15:58:35.286 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-07-26T15:58:35.286 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-07-26T15:58:35.286 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-07-26T15:58:35.287 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-07-26T15:58:35.287 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-07-26T15:58:35.287 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.arena_block_size: 4194304 2021-07-26T15:58:35.287 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-07-26T15:58:35.287 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-07-26T15:58:35.288 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-07-26T15:58:35.288 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.disable_auto_compactions: 0 2021-07-26T15:58:35.288 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-07-26T15:58:35.288 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-07-26T15:58:35.289 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-07-26T15:58:35.289 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-07-26T15:58:35.289 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-07-26T15:58:35.289 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-07-26T15:58:35.290 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-07-26T15:58:35.290 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-07-26T15:58:35.290 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-07-26T15:58:35.290 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-07-26T15:58:35.291 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.table_properties_collectors: 2021-07-26T15:58:35.291 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.inplace_update_support: 0 2021-07-26T15:58:35.291 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-07-26T15:58:35.291 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-07-26T15:58:35.292 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-07-26T15:58:35.292 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-07-26T15:58:35.292 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.bloom_locality: 0 2021-07-26T15:58:35.292 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.max_successive_merges: 0 2021-07-26T15:58:35.292 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-07-26T15:58:35.293 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.paranoid_file_checks: 0 2021-07-26T15:58:35.293 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.force_consistency_checks: 1 2021-07-26T15:58:35.293 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.report_bg_io_stats: 0 2021-07-26T15:58:35.293 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.ttl: 2592000 2021-07-26T15:58:35.294 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-07-26T15:58:35.294 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.enable_blob_files: false 2021-07-26T15:58:35.294 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.min_blob_size: 0 2021-07-26T15:58:35.294 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.blob_file_size: 268435456 2021-07-26T15:58:35.294 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.blob_compression_type: NoCompression 2021-07-26T15:58:35.295 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.enable_blob_garbage_collection: false 2021-07-26T15:58:35.295 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.915+0000 7fb69c3ff700 4 rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2021-07-26T15:58:35.295 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.919+0000 7fb69c3ff700 4 rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-07-26T15:58:35.295 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.919+0000 7fb69c3ff700 4 rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 22, last_sequence is 12148, log_number is 18,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-07-26T15:58:35.296 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.919+0000 7fb69c3ff700 4 rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 18 2021-07-26T15:58:35.296 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.919+0000 7fb69c3ff700 4 rocksdb: [db/version_set.cc:4083] Creating manifest 22 2021-07-26T15:58:35.296 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.919+0000 7fb69c3ff700 4 rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-07-26T15:58:35.296 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.919+0000 7fb69c3ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627315114921843, "job": 1, "event": "recovery_started", "wal_files": [18]} 2021-07-26T15:58:35.297 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.919+0000 7fb69c3ff700 4 rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #18 mode 2 2021-07-26T15:58:35.297 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.927+0000 7fb69c3ff700 3 rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-07-26T15:58:35.297 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.931+0000 7fb69c3ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627315114931397, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 23, "file_size": 2638268, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 2633500, "index_size": 3123, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 5924, "raw_average_key_size": 23, "raw_value_size": 2626429, "raw_average_value_size": 10422, "num_data_blocks": 135, "num_entries": 252, "num_deletions": 16, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1627315114, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "157c5169-e865-4345-a01c-0e763562d770", "db_session_id": "C273U2ZELH2H428L4FGS"}} 2021-07-26T15:58:35.297 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.931+0000 7fb69c3ff700 4 rocksdb: [db/version_set.cc:4083] Creating manifest 24 2021-07-26T15:58:35.297 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.931+0000 7fb69c3ff700 4 rocksdb: [db/version_set.cc:3459] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2021-07-26T15:58:35.298 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.931+0000 7fb69c3ff700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1627315114932753, "job": 1, "event": "recovery_finished"} 2021-07-26T15:58:35.298 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.931+0000 7fb69c3ff700 4 rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000018.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2021-07-26T15:58:35.298 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.931+0000 7fb69c3ff700 4 rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x559ed53c4a80 2021-07-26T15:58:35.298 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.931+0000 7fb69c3ff700 4 rocksdb: DB pointer 0x559ed53d4000 2021-07-26T15:58:35.299 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.931+0000 7fb68c015700 4 rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2021-07-26T15:58:35.299 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.931+0000 7fb68c015700 4 rocksdb: [db/db_impl/db_impl.cc:903] 2021-07-26T15:58:35.299 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: ** DB Stats ** 2021-07-26T15:58:35.299 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:58:35.300 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-07-26T15:58:35.300 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-07-26T15:58:35.300 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:58:35.300 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-07-26T15:58:35.300 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-07-26T15:58:35.301 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-07-26T15:58:35.301 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: ** Compaction Stats [default] ** 2021-07-26T15:58:35.301 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:35.301 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:35.302 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: L0 1/0 2.52 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 638.9 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:35.302 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: L6 1/0 22.38 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:58:35.302 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Sum 2/0 24.89 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 638.9 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:35.302 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 638.9 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:35.303 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: ** Compaction Stats [default] ** 2021-07-26T15:58:35.303 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:35.303 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:35.303 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 638.9 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:35.304 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:58:35.304 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Flush(GB): cumulative 0.002, interval 0.002 2021-07-26T15:58:35.304 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:58:35.304 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:58:35.304 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:58:35.305 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:58:35.305 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Cumulative compaction: 0.00 GB write, 143.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:35.305 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Interval compaction: 0.00 GB write, 143.80 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:35.305 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:58:35.306 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:58:35.306 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: ** Compaction Stats [default] ** 2021-07-26T15:58:35.306 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:35.307 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:35.307 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: L0 1/0 2.52 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 638.9 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:35.307 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: L6 1/0 22.38 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:58:35.307 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Sum 2/0 24.89 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 638.9 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:35.307 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-07-26T15:58:35.308 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: ** Compaction Stats [default] ** 2021-07-26T15:58:35.308 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-07-26T15:58:35.308 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-07-26T15:58:35.308 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 638.9 0.00 0.00 1 0.004 0 0 2021-07-26T15:58:35.309 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Uptime(secs): 0.0 total, 0.0 interval 2021-07-26T15:58:35.309 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Flush(GB): cumulative 0.002, interval 0.000 2021-07-26T15:58:35.309 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: AddFile(GB): cumulative 0.000, interval 0.000 2021-07-26T15:58:35.309 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: AddFile(Total Files): cumulative 0, interval 0 2021-07-26T15:58:35.310 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: AddFile(L0 Files): cumulative 0, interval 0 2021-07-26T15:58:35.310 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: AddFile(Keys): cumulative 0, interval 0 2021-07-26T15:58:35.310 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Cumulative compaction: 0.00 GB write, 143.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:35.310 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-07-26T15:58:35.311 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-07-26T15:58:35.311 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: ** File Read Latency Histogram By Level [default] ** 2021-07-26T15:58:35.311 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.935+0000 7fb69c3ff700 0 starting mon.b rank 2 at public addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] at bind addrs [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:58:35.311 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.935+0000 7fb69c3ff700 1 mon.b@-1(???) e3 preinit fsid 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:58:35.312 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.935+0000 7fb69c3ff700 0 mon.b@-1(???).mds e1 new map 2021-07-26T15:58:35.312 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.935+0000 7fb69c3ff700 0 mon.b@-1(???).mds e1 print_map 2021-07-26T15:58:35.312 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: e1 2021-07-26T15:58:35.312 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: enable_multiple, ever_enabled_multiple: 1,1 2021-07-26T15:58:35.312 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-07-26T15:58:35.313 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: legacy client fscid: -1 2021-07-26T15:58:35.313 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: 2021-07-26T15:58:35.313 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: No filesystems configured 2021-07-26T15:58:35.313 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.935+0000 7fb69c3ff700 0 mon.b@-1(???).osd e167 crush map has features 3314933069571702784, adjusting msgr requires 2021-07-26T15:58:35.314 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.935+0000 7fb69c3ff700 0 mon.b@-1(???).osd e167 crush map has features 288514119978713088, adjusting msgr requires 2021-07-26T15:58:35.314 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.935+0000 7fb69c3ff700 0 mon.b@-1(???).osd e167 crush map has features 288514119978713088, adjusting msgr requires 2021-07-26T15:58:35.314 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.935+0000 7fb69c3ff700 0 mon.b@-1(???).osd e167 crush map has features 288514119978713088, adjusting msgr requires 2021-07-26T15:58:35.314 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:34 smithi096 bash[33981]: debug 2021-07-26T15:58:34.935+0000 7fb69c3ff700 1 mon.b@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2021-07-26T15:58:37.293 INFO:tasks.rados.rados.0.smithi033.stdout:609: done (1 left) 2021-07-26T15:58:37.293 INFO:tasks.rados.rados.0.smithi033.stdout:610: done (0 left) 2021-07-26T15:58:37.293 INFO:tasks.rados.rados.0.smithi033.stdout:611: rollback oid 47 current snap is 54 2021-07-26T15:58:37.293 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 47 to 47 2021-07-26T15:58:37.294 INFO:tasks.rados.rados.0.smithi033.stdout:612: read oid 10 snap -1 2021-07-26T15:58:37.294 INFO:tasks.rados.rados.0.smithi033.stdout:612: expect (ObjNum 104 snap 19 seq_num 104) 2021-07-26T15:58:37.294 INFO:tasks.rados.rados.0.smithi033.stdout:613: read oid 42 snap 47 2021-07-26T15:58:37.294 INFO:tasks.rados.rados.0.smithi033.stdout:613: expect (ObjNum 172 snap 45 seq_num 172) 2021-07-26T15:58:37.295 INFO:tasks.rados.rados.0.smithi033.stdout:614: snap_remove snap 53 2021-07-26T15:58:37.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:46:09.081256+0000 mon.a (mon.0) 0 : [INF] mkfs 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:58:37.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:52:34.716022+0000 mgr.y (mgr.14146) 224 : cephadm [INF] Saving service grafana spec with placement smithi096=a;count:1 2021-07-26T15:58:37.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:52:42.054047+0000 mgr.y (mgr.14146) 229 : cephadm [INF] Deploying daemon node-exporter.a on smithi033 2021-07-26T15:58:37.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:52:42.805395+0000 mgr.y (mgr.14146) 230 : cephadm [INF] Deploying daemon node-exporter.b on smithi096 2021-07-26T15:58:37.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:52:43.558909+0000 mgr.y (mgr.14146) 232 : cephadm [INF] Deploying daemon alertmanager.a on smithi033 2021-07-26T15:58:37.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:52:57.837815+0000 mgr.y (mgr.14146) 241 : cephadm [INF] Deploying daemon grafana.a on smithi096 2021-07-26T15:58:37.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:53:20.290330+0000 mgr.y (mgr.14146) 253 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-07-26T15:58:37.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:53:20.294862+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi033 2021-07-26T15:58:37.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:53:26.688016+0000 mgr.y (mgr.14146) 258 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-07-26T15:58:37.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:53:26.690944+0000 mgr.y (mgr.14146) 259 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi096 2021-07-26T15:58:37.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:56:11.605159+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:58:37.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:56:11.630426+0000 mgr.y (mgr.14146) 353 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:58:37.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:56:36.420391+0000 mgr.y (mgr.14146) 368 : cephadm [INF] Upgrade: Target is version 17.0.0-6381-gbccf07c2 (unknown) 2021-07-26T15:58:37.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:56:36.420588+0000 mgr.y (mgr.14146) 369 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f'] 2021-07-26T15:58:37.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:56:36.424694+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:58:37.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:56:36.682855+0000 mgr.y (mgr.14146) 371 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f on smithi096 2021-07-26T15:58:37.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:04.227053+0000 mgr.y (mgr.14146) 386 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:58:37.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:04.242141+0000 mgr.y (mgr.14146) 387 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:58:37.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:13.327728+0000 mgr.y (mgr.14146) 394 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:58:37.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:13.333710+0000 mgr.y (mgr.14146) 395 : cephadm [INF] Failing over to other MGR 2021-07-26T15:58:37.714 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:21.408076+0000 mgr.x (mgr.24598) 4 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 3553M 2021-07-26T15:58:37.714 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:21.416643+0000 mgr.x (mgr.24598) 5 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:58:37.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:21.516304+0000 mgr.x (mgr.24598) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:46:09.081256+0000 mon.a (mon.0) 0 : [INF] mkfs 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:58:37.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:52:34.716022+0000 mgr.y (mgr.14146) 224 : cephadm [INF] Saving service grafana spec with placement smithi096=a;count:1 2021-07-26T15:58:37.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:52:42.054047+0000 mgr.y (mgr.14146) 229 : cephadm [INF] Deploying daemon node-exporter.a on smithi033 2021-07-26T15:58:37.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:52:42.805395+0000 mgr.y (mgr.14146) 230 : cephadm [INF] Deploying daemon node-exporter.b on smithi096 2021-07-26T15:58:37.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:52:43.558909+0000 mgr.y (mgr.14146) 232 : cephadm [INF] Deploying daemon alertmanager.a on smithi033 2021-07-26T15:58:37.716 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:52:57.837815+0000 mgr.y (mgr.14146) 241 : cephadm [INF] Deploying daemon grafana.a on smithi096 2021-07-26T15:58:37.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:53:20.290330+0000 mgr.y (mgr.14146) 253 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-07-26T15:58:37.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:53:20.294862+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi033 2021-07-26T15:58:37.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:53:26.688016+0000 mgr.y (mgr.14146) 258 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-07-26T15:58:37.717 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:53:26.690944+0000 mgr.y (mgr.14146) 259 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi096 2021-07-26T15:58:37.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:56:11.605159+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:58:37.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:56:11.630426+0000 mgr.y (mgr.14146) 353 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:58:37.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:56:36.420391+0000 mgr.y (mgr.14146) 368 : cephadm [INF] Upgrade: Target is version 17.0.0-6381-gbccf07c2 (unknown) 2021-07-26T15:58:37.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:56:36.420588+0000 mgr.y (mgr.14146) 369 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f'] 2021-07-26T15:58:37.718 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:56:36.424694+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:58:37.719 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:56:36.682855+0000 mgr.y (mgr.14146) 371 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f on smithi096 2021-07-26T15:58:37.719 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:04.227053+0000 mgr.y (mgr.14146) 386 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:58:37.719 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:04.242141+0000 mgr.y (mgr.14146) 387 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:58:37.719 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:13.327728+0000 mgr.y (mgr.14146) 394 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:58:37.720 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:13.333710+0000 mgr.y (mgr.14146) 395 : cephadm [INF] Failing over to other MGR 2021-07-26T15:58:37.720 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:21.408076+0000 mgr.x (mgr.24598) 4 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 3553M 2021-07-26T15:58:37.720 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:21.416643+0000 mgr.x (mgr.24598) 5 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:58:37.720 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:21.516304+0000 mgr.x (mgr.24598) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.720 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:21.752083+0000 mgr.x (mgr.24598) 7 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 3552M 2021-07-26T15:58:37.721 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:21.763030+0000 mgr.x (mgr.24598) 8 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:58:37.721 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:21.795898+0000 mgr.x (mgr.24598) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.721 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:21.864820+0000 mgr.x (mgr.24598) 10 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:58:37.721 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:24.410641+0000 mgr.x (mgr.24598) 13 : cephadm [INF] Upgrade: Updating mgr.y 2021-07-26T15:58:37.721 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:24.430805+0000 mgr.x (mgr.24598) 14 : cephadm [INF] Deploying daemon mgr.y on smithi033 2021-07-26T15:58:37.722 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:32.614022+0000 mgr.x (mgr.24598) 19 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:58:37.722 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:32.616833+0000 mgr.x (mgr.24598) 20 : cephadm [INF] Failing over to other MGR 2021-07-26T15:58:37.722 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:41.767651+0000 mgr.y (mgr.14712) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:58:37.722 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:41.776604+0000 mgr.y (mgr.14712) 7 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:58:37.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:41.793043+0000 mgr.y (mgr.14712) 8 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:41.799023+0000 mgr.y (mgr.14712) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:44.215023+0000 mgr.y (mgr.14712) 11 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:58:37.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:44.234426+0000 mgr.y (mgr.14712) 12 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:58:37.723 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:53.270293+0000 mgr.y (mgr.14712) 18 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-07-26T15:58:37.724 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:53.297863+0000 mgr.y (mgr.14712) 19 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2021-07-26T15:58:37.724 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:55.979187+0000 mgr.y (mgr.14712) 21 : cephadm [INF] Upgrade: Updating mon.a 2021-07-26T15:58:37.724 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:57:55.993141+0000 mgr.y (mgr.14712) 22 : cephadm [INF] Deploying daemon mon.a on smithi033 2021-07-26T15:58:37.724 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:07.912962+0000 mon.a (mon.0) 17 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-07-26T15:58:37.725 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:07.939603+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x restarted 2021-07-26T15:58:37.725 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:07.939726+0000 mon.a (mon.0) 19 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:58:37.725 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:08.293237+0000 mon.a (mon.0) 20 : cluster [INF] Active manager daemon y restarted 2021-07-26T15:58:37.725 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:08.294759+0000 mon.a (mon.0) 21 : cluster [INF] Activating manager daemon y 2021-07-26T15:58:37.725 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:08.300924+0000 mon.a (mon.0) 22 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-07-26T15:58:37.726 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:08.932566+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e28: y(active, starting, since 0.637993s), standbys: x 2021-07-26T15:58:37.726 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:08.940561+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:58:37.726 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:21.752083+0000 mgr.x (mgr.24598) 7 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 3552M 2021-07-26T15:58:37.727 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:21.763030+0000 mgr.x (mgr.24598) 8 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:58:37.727 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:21.795898+0000 mgr.x (mgr.24598) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.727 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:21.864820+0000 mgr.x (mgr.24598) 10 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:58:37.727 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:24.410641+0000 mgr.x (mgr.24598) 13 : cephadm [INF] Upgrade: Updating mgr.y 2021-07-26T15:58:37.727 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:24.430805+0000 mgr.x (mgr.24598) 14 : cephadm [INF] Deploying daemon mgr.y on smithi033 2021-07-26T15:58:37.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:32.614022+0000 mgr.x (mgr.24598) 19 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:58:37.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:32.616833+0000 mgr.x (mgr.24598) 20 : cephadm [INF] Failing over to other MGR 2021-07-26T15:58:37.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:41.767651+0000 mgr.y (mgr.14712) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:58:37.728 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:41.776604+0000 mgr.y (mgr.14712) 7 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:58:37.729 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:41.793043+0000 mgr.y (mgr.14712) 8 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.729 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:41.799023+0000 mgr.y (mgr.14712) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.729 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:44.215023+0000 mgr.y (mgr.14712) 11 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:58:37.729 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:44.234426+0000 mgr.y (mgr.14712) 12 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:58:37.729 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:53.270293+0000 mgr.y (mgr.14712) 18 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-07-26T15:58:37.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:53.297863+0000 mgr.y (mgr.14712) 19 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2021-07-26T15:58:37.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:55.979187+0000 mgr.y (mgr.14712) 21 : cephadm [INF] Upgrade: Updating mon.a 2021-07-26T15:58:37.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:57:55.993141+0000 mgr.y (mgr.14712) 22 : cephadm [INF] Deploying daemon mon.a on smithi033 2021-07-26T15:58:37.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:07.912962+0000 mon.a (mon.0) 17 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-07-26T15:58:37.730 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:07.939603+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x restarted 2021-07-26T15:58:37.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:07.939726+0000 mon.a (mon.0) 19 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:58:37.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:08.293237+0000 mon.a (mon.0) 20 : cluster [INF] Active manager daemon y restarted 2021-07-26T15:58:37.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:08.294759+0000 mon.a (mon.0) 21 : cluster [INF] Activating manager daemon y 2021-07-26T15:58:37.731 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:08.300924+0000 mon.a (mon.0) 22 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-07-26T15:58:37.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:08.932566+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e28: y(active, starting, since 0.637993s), standbys: x 2021-07-26T15:58:37.732 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:08.940561+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:58:37.732 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:08.940958+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:58:37.732 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:08.941343+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:58:37.733 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:08.941659+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:58:37.733 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:08.942069+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:58:37.733 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:08.942385+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:58:37.733 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:08.942741+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:58:37.734 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:08.943287+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:58:37.734 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:08.952903+0000 mon.a (mon.0) 24 : cluster [INF] Manager daemon y is now available 2021-07-26T15:58:37.734 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:09.107958+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.734 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:09.113491+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.734 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:09.116981+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.735 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:09.120495+0000 mon.c (mon.1) 107 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:37.735 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:09.146184+0000 mon.c (mon.1) 108 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:58:37.735 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:09.146710+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:58:37.735 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:09.178858+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:58:37.736 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:09.179402+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:58:37.736 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:09.302495+0000 mon.a (mon.0) 27 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-07-26T15:58:37.736 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:09.729498+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.736 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:09.943740+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e29: y(active, since 1.64918s), standbys: x 2021-07-26T15:58:37.737 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:08.940958+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:58:37.737 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:08.941343+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:58:37.737 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:08.941659+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:58:37.737 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:08.942069+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:58:37.738 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:08.942385+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:58:37.738 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:08.942741+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:58:37.738 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:08.943287+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:58:37.738 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:08.952903+0000 mon.a (mon.0) 24 : cluster [INF] Manager daemon y is now available 2021-07-26T15:58:37.739 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:09.107958+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.739 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:09.113491+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.739 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:09.116981+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.739 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:09.120495+0000 mon.c (mon.1) 107 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:37.739 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:09.146184+0000 mon.c (mon.1) 108 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:58:37.740 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:09.146710+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:58:37.740 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:09.178858+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:58:37.740 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:09.179402+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:58:37.740 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:09.302495+0000 mon.a (mon.0) 27 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-07-26T15:58:37.741 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:09.729498+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.741 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:09.943740+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e29: y(active, since 1.64918s), standbys: x 2021-07-26T15:58:37.741 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:09.946524+0000 mgr.y (mgr.34104) 1 : audit [DBG] from='client.34110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:37.742 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:09.956269+0000 mgr.y (mgr.34104) 2 : cluster [DBG] pgmap v4: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.742 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:10.272343+0000 mgr.y (mgr.34104) 3 : audit [DBG] from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:37.742 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:10.304990+0000 mon.a (mon.0) 30 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-07-26T15:58:37.742 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:10.685873+0000 mon.c (mon.1) 110 : audit [DBG] from='client.? 172.21.15.33:0/3747067038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:37.742 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:10.941034+0000 mgr.y (mgr.34104) 4 : cluster [DBG] pgmap v6: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.743 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:10.963014+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e30: y(active, since 2s), standbys: x 2021-07-26T15:58:37.743 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:11.309085+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-07-26T15:58:37.743 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:12.310196+0000 mon.a (mon.0) 33 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-07-26T15:58:37.743 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:12.941829+0000 mgr.y (mgr.34104) 5 : cluster [DBG] pgmap v9: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.744 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:13.321835+0000 mon.a (mon.0) 34 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-07-26T15:58:37.744 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:13.729636+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.744 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:58:13.974535+0000 mgr.y (mgr.34104) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:58:37.744 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:58:13.998791+0000 mgr.y (mgr.34104) 7 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.744 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:14.154633+0000 mon.a (mon.0) 36 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.745 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:14.190403+0000 mon.a (mon.0) 37 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.745 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:14.333588+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-07-26T15:58:37.745 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:58:14.437155+0000 mgr.y (mgr.34104) 8 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:58:37.745 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:58:14.463185+0000 mgr.y (mgr.34104) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.745 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:14.501425+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.746 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:14.512014+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.746 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:14.520270+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.746 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:14.522612+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:37.746 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:14.524588+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:58:37.747 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:09.946524+0000 mgr.y (mgr.34104) 1 : audit [DBG] from='client.34110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:37.747 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:09.956269+0000 mgr.y (mgr.34104) 2 : cluster [DBG] pgmap v4: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.747 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:10.272343+0000 mgr.y (mgr.34104) 3 : audit [DBG] from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:37.748 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:10.304990+0000 mon.a (mon.0) 30 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-07-26T15:58:37.748 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:10.685873+0000 mon.c (mon.1) 110 : audit [DBG] from='client.? 172.21.15.33:0/3747067038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:37.748 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:10.941034+0000 mgr.y (mgr.34104) 4 : cluster [DBG] pgmap v6: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.748 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:10.963014+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e30: y(active, since 2s), standbys: x 2021-07-26T15:58:37.749 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:11.309085+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-07-26T15:58:37.749 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:12.310196+0000 mon.a (mon.0) 33 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-07-26T15:58:37.749 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:12.941829+0000 mgr.y (mgr.34104) 5 : cluster [DBG] pgmap v9: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.749 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:13.321835+0000 mon.a (mon.0) 34 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-07-26T15:58:37.749 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:13.729636+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.750 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:58:13.974535+0000 mgr.y (mgr.34104) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:58:37.750 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:58:13.998791+0000 mgr.y (mgr.34104) 7 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.750 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:14.154633+0000 mon.a (mon.0) 36 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.750 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:14.190403+0000 mon.a (mon.0) 37 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:14.333588+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-07-26T15:58:37.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:58:14.437155+0000 mgr.y (mgr.34104) 8 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:58:37.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:58:14.463185+0000 mgr.y (mgr.34104) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:14.501425+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.751 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:14.512014+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.752 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:14.520270+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.752 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:14.522612+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:37.752 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:14.524588+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:58:37.752 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:14.525918+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-07-26T15:58:37.753 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:58:14.526835+0000 mgr.y (mgr.34104) 10 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2021-07-26T15:58:37.753 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:14.942730+0000 mgr.y (mgr.34104) 11 : cluster [DBG] pgmap v12: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.753 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:15.338488+0000 mon.a (mon.0) 41 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-07-26T15:58:37.753 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:15.914077+0000 mon.a (mon.0) 42 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-07-26T15:58:37.753 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:16.925337+0000 mon.a (mon.0) 43 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-07-26T15:58:37.754 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:16.943225+0000 mgr.y (mgr.34104) 12 : cluster [DBG] pgmap v16: 25 pgs: 25 active+clean; 83 MiB data, 299 MiB used, 715 GiB / 715 GiB avail; 4.9 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2021-07-26T15:58:37.754 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:58:17.467946+0000 mgr.y (mgr.34104) 13 : cephadm [INF] Upgrade: Updating mon.c 2021-07-26T15:58:37.754 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:17.474594+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.754 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:17.481007+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:37.755 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:17.482988+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:37.755 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:17.484681+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.755 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:58:17.485945+0000 mgr.y (mgr.34104) 14 : cephadm [INF] Deploying daemon mon.c on smithi033 2021-07-26T15:58:37.755 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:17.935205+0000 mon.a (mon.0) 46 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-07-26T15:58:37.755 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:18.943714+0000 mgr.y (mgr.34104) 15 : cluster [DBG] pgmap v19: 25 pgs: 25 active+clean; 83 MiB data, 299 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.756 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:18.945406+0000 mon.a (mon.0) 47 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-07-26T15:58:37.756 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:20.944491+0000 mgr.y (mgr.34104) 16 : cluster [DBG] pgmap v21: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 9.4 MiB/s rd, 3.0 MiB/s wr, 15 op/s 2021-07-26T15:58:37.756 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:22.837684+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-07-26T15:58:37.756 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:22.945194+0000 mgr.y (mgr.34104) 17 : cluster [DBG] pgmap v22: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2021-07-26T15:58:37.756 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:23.529855+0000 mon.a (mon.0) 49 : cluster [INF] mon.a calling monitor election 2021-07-26T15:58:37.757 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:23.533380+0000 mon.a (mon.0) 50 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:58:37.757 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:23.542921+0000 mon.a (mon.0) 51 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:58:37.757 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:14.525918+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-07-26T15:58:37.758 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:58:14.526835+0000 mgr.y (mgr.34104) 10 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2021-07-26T15:58:37.758 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:14.942730+0000 mgr.y (mgr.34104) 11 : cluster [DBG] pgmap v12: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.758 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:15.338488+0000 mon.a (mon.0) 41 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-07-26T15:58:37.758 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:15.914077+0000 mon.a (mon.0) 42 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-07-26T15:58:37.759 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:16.925337+0000 mon.a (mon.0) 43 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-07-26T15:58:37.759 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:16.943225+0000 mgr.y (mgr.34104) 12 : cluster [DBG] pgmap v16: 25 pgs: 25 active+clean; 83 MiB data, 299 MiB used, 715 GiB / 715 GiB avail; 4.9 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2021-07-26T15:58:37.759 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:58:17.467946+0000 mgr.y (mgr.34104) 13 : cephadm [INF] Upgrade: Updating mon.c 2021-07-26T15:58:37.759 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:17.474594+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.759 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:17.481007+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:37.760 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:17.482988+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:37.760 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:17.484681+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.760 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:58:17.485945+0000 mgr.y (mgr.34104) 14 : cephadm [INF] Deploying daemon mon.c on smithi033 2021-07-26T15:58:37.760 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:17.935205+0000 mon.a (mon.0) 46 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-07-26T15:58:37.760 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:18.943714+0000 mgr.y (mgr.34104) 15 : cluster [DBG] pgmap v19: 25 pgs: 25 active+clean; 83 MiB data, 299 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.761 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:18.945406+0000 mon.a (mon.0) 47 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-07-26T15:58:37.761 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:20.944491+0000 mgr.y (mgr.34104) 16 : cluster [DBG] pgmap v21: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 9.4 MiB/s rd, 3.0 MiB/s wr, 15 op/s 2021-07-26T15:58:37.761 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:22.837684+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-07-26T15:58:37.761 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:22.945194+0000 mgr.y (mgr.34104) 17 : cluster [DBG] pgmap v22: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2021-07-26T15:58:37.762 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:23.529855+0000 mon.a (mon.0) 49 : cluster [INF] mon.a calling monitor election 2021-07-26T15:58:37.762 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:23.533380+0000 mon.a (mon.0) 50 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:58:37.762 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:23.542921+0000 mon.a (mon.0) 51 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:58:37.762 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:23.543040+0000 mon.a (mon.0) 52 : cluster [DBG] fsmap 2021-07-26T15:58:37.763 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:23.543112+0000 mon.a (mon.0) 53 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-07-26T15:58:37.763 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:23.543691+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e30: y(active, since 15s), standbys: x 2021-07-26T15:58:37.763 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:23.549266+0000 mon.a (mon.0) 55 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:37.763 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:23.554392+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:23.558738+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:23.561487+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:23.563384+0000 mon.b (mon.2) 43 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:37.764 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:24.554841+0000 mon.a (mon.0) 57 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-07-26T15:58:37.765 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:24.945922+0000 mgr.y (mgr.34104) 18 : cluster [DBG] pgmap v24: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2021-07-26T15:58:37.765 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:25.569529+0000 mon.a (mon.0) 58 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-07-26T15:58:37.765 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:25.918508+0000 mon.a (mon.0) 59 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-07-26T15:58:37.765 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:26.929164+0000 mon.a (mon.0) 60 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-07-26T15:58:37.765 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:26.946544+0000 mgr.y (mgr.34104) 19 : cluster [DBG] pgmap v28: 25 pgs: 25 active+clean; 94 MiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2021-07-26T15:58:37.766 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:27.899481+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.766 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:27.910678+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.766 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:27.923064+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.767 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:27.926428+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:37.767 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:27.942559+0000 mon.a (mon.0) 63 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-07-26T15:58:37.767 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:27.946370+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:58:37.767 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:27.952534+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-07-26T15:58:37.767 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:58:27.954196+0000 mgr.y (mgr.34104) 20 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2021-07-26T15:58:37.768 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:28.942693+0000 mon.a (mon.0) 64 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-07-26T15:58:37.768 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:23.543040+0000 mon.a (mon.0) 52 : cluster [DBG] fsmap 2021-07-26T15:58:37.768 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:23.543112+0000 mon.a (mon.0) 53 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-07-26T15:58:37.769 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:23.543691+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e30: y(active, since 15s), standbys: x 2021-07-26T15:58:37.769 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:23.549266+0000 mon.a (mon.0) 55 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:37.769 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:23.554392+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.769 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:23.558738+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.770 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:23.561487+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.770 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:23.563384+0000 mon.b (mon.2) 43 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:37.770 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:24.554841+0000 mon.a (mon.0) 57 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-07-26T15:58:37.770 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:24.945922+0000 mgr.y (mgr.34104) 18 : cluster [DBG] pgmap v24: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2021-07-26T15:58:37.770 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:25.569529+0000 mon.a (mon.0) 58 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-07-26T15:58:37.771 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:25.918508+0000 mon.a (mon.0) 59 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-07-26T15:58:37.771 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:26.929164+0000 mon.a (mon.0) 60 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-07-26T15:58:37.771 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:26.946544+0000 mgr.y (mgr.34104) 19 : cluster [DBG] pgmap v28: 25 pgs: 25 active+clean; 94 MiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2021-07-26T15:58:37.771 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:27.899481+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.772 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:27.910678+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.772 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:27.923064+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.772 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:27.926428+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:37.772 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:27.942559+0000 mon.a (mon.0) 63 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-07-26T15:58:37.772 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:27.946370+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:58:37.773 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:27.952534+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-07-26T15:58:37.773 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:58:27.954196+0000 mgr.y (mgr.34104) 20 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2021-07-26T15:58:37.773 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:28.942693+0000 mon.a (mon.0) 64 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-07-26T15:58:37.774 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:28.947207+0000 mgr.y (mgr.34104) 21 : cluster [DBG] pgmap v31: 25 pgs: 25 active+clean; 94 MiB data, 323 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.774 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:29.969035+0000 mon.a (mon.0) 65 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-07-26T15:58:37.774 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:58:30.205012+0000 mgr.y (mgr.34104) 22 : cephadm [INF] Upgrade: Updating mon.b 2021-07-26T15:58:37.774 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:30.212899+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:30.219067+0000 mon.b (mon.2) 48 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:37.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:30.219204+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:37.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cephadm 2021-07-26T15:58:30.223078+0000 mgr.y (mgr.34104) 23 : cephadm [INF] Deploying daemon mon.b on smithi096 2021-07-26T15:58:37.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:30.223514+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.775 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:30.947933+0000 mgr.y (mgr.34104) 24 : cluster [DBG] pgmap v33: 25 pgs: 25 active+clean; 90 MiB data, 336 MiB used, 715 GiB / 715 GiB avail; 718 KiB/s rd, 394 KiB/s wr, 9 op/s 2021-07-26T15:58:37.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:31.218641+0000 mon.a (mon.0) 68 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-07-26T15:58:37.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:32.219395+0000 mon.a (mon.0) 69 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-07-26T15:58:37.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:32.678915+0000 mon.c (mon.1) 2 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:58:37.776 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:32.680669+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:58:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:32.683001+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:58:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:36.285266+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:58:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:36.285480+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:58:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:36.285679+0000 mon.c (mon.1) 7 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:58:37.777 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:36.286598+0000 mon.a (mon.0) 76 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:37.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:36.287865+0000 mon.c (mon.1) 8 : cluster [INF] mon.c calling monitor election 2021-07-26T15:58:37.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:36.287940+0000 mon.a (mon.0) 77 : cluster [INF] mon.a calling monitor election 2021-07-26T15:58:37.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:36.290267+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-07-26T15:58:37.778 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:36.290988+0000 mon.a (mon.0) 78 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:58:37.779 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:28.947207+0000 mgr.y (mgr.34104) 21 : cluster [DBG] pgmap v31: 25 pgs: 25 active+clean; 94 MiB data, 323 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.779 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:29.969035+0000 mon.a (mon.0) 65 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-07-26T15:58:37.779 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:58:30.205012+0000 mgr.y (mgr.34104) 22 : cephadm [INF] Upgrade: Updating mon.b 2021-07-26T15:58:37.779 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:30.212899+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.780 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:30.219067+0000 mon.b (mon.2) 48 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:37.780 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:30.219204+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:37.780 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cephadm 2021-07-26T15:58:30.223078+0000 mgr.y (mgr.34104) 23 : cephadm [INF] Deploying daemon mon.b on smithi096 2021-07-26T15:58:37.780 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:30.223514+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.781 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:30.947933+0000 mgr.y (mgr.34104) 24 : cluster [DBG] pgmap v33: 25 pgs: 25 active+clean; 90 MiB data, 336 MiB used, 715 GiB / 715 GiB avail; 718 KiB/s rd, 394 KiB/s wr, 9 op/s 2021-07-26T15:58:37.781 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:31.218641+0000 mon.a (mon.0) 68 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-07-26T15:58:37.781 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:32.219395+0000 mon.a (mon.0) 69 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-07-26T15:58:37.781 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:32.678915+0000 mon.c (mon.1) 2 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:58:37.781 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:32.680669+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:58:37.782 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:32.683001+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:58:37.782 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:36.285266+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:58:37.782 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:36.285480+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:58:37.782 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:36.285679+0000 mon.c (mon.1) 7 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:58:37.783 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:36.286598+0000 mon.a (mon.0) 76 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:37.783 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:36.287865+0000 mon.c (mon.1) 8 : cluster [INF] mon.c calling monitor election 2021-07-26T15:58:37.783 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:36.287940+0000 mon.a (mon.0) 77 : cluster [INF] mon.a calling monitor election 2021-07-26T15:58:37.783 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:36.290267+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-07-26T15:58:37.783 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:36.290988+0000 mon.a (mon.0) 78 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:58:37.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:36.297258+0000 mon.a (mon.0) 79 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:58:37.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:36.297320+0000 mon.a (mon.0) 80 : cluster [DBG] fsmap 2021-07-26T15:58:37.784 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:36.297362+0000 mon.a (mon.0) 81 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-07-26T15:58:37.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:36.297780+0000 mon.a (mon.0) 82 : cluster [DBG] mgrmap e30: y(active, since 28s), standbys: x 2021-07-26T15:58:37.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: cluster 2021-07-26T15:58:36.303539+0000 mon.a (mon.0) 83 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:37.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:36.309535+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34104 ' entity='' 2021-07-26T15:58:37.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:36.312003+0000 mon.c (mon.1) 9 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.785 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:36.314144+0000 mon.c (mon.1) 10 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.786 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[41341]: audit 2021-07-26T15:58:36.315914+0000 mon.c (mon.1) 11 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:37.786 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:36.297258+0000 mon.a (mon.0) 79 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:58:37.786 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:36.297320+0000 mon.a (mon.0) 80 : cluster [DBG] fsmap 2021-07-26T15:58:37.787 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:36.297362+0000 mon.a (mon.0) 81 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-07-26T15:58:37.787 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:36.297780+0000 mon.a (mon.0) 82 : cluster [DBG] mgrmap e30: y(active, since 28s), standbys: x 2021-07-26T15:58:37.787 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: cluster 2021-07-26T15:58:36.303539+0000 mon.a (mon.0) 83 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:37.787 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:36.309535+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34104 ' entity='' 2021-07-26T15:58:37.787 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:36.312003+0000 mon.c (mon.1) 9 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.788 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:36.314144+0000 mon.c (mon.1) 10 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.788 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:37 smithi033 bash[42377]: audit 2021-07-26T15:58:36.315914+0000 mon.c (mon.1) 11 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:37.789 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:46:09.081256+0000 mon.a (mon.0) 0 : [INF] mkfs 7e62724e-ee28-11eb-8c23-001a4aab830c 2021-07-26T15:58:37.790 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:52:34.716022+0000 mgr.y (mgr.14146) 224 : cephadm [INF] Saving service grafana spec with placement smithi096=a;count:1 2021-07-26T15:58:37.790 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:52:42.054047+0000 mgr.y (mgr.14146) 229 : cephadm [INF] Deploying daemon node-exporter.a on smithi033 2021-07-26T15:58:37.790 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:52:42.805395+0000 mgr.y (mgr.14146) 230 : cephadm [INF] Deploying daemon node-exporter.b on smithi096 2021-07-26T15:58:37.790 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:52:43.558909+0000 mgr.y (mgr.14146) 232 : cephadm [INF] Deploying daemon alertmanager.a on smithi033 2021-07-26T15:58:37.791 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:52:57.837815+0000 mgr.y (mgr.14146) 241 : cephadm [INF] Deploying daemon grafana.a on smithi096 2021-07-26T15:58:37.791 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:53:20.290330+0000 mgr.y (mgr.14146) 253 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-07-26T15:58:37.791 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:53:20.294862+0000 mgr.y (mgr.14146) 254 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi033 2021-07-26T15:58:37.791 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:53:26.688016+0000 mgr.y (mgr.14146) 258 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-07-26T15:58:37.791 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:53:26.690944+0000 mgr.y (mgr.14146) 259 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi096 2021-07-26T15:58:37.792 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:56:11.605159+0000 mgr.y (mgr.14146) 351 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:58:37.792 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:56:11.630426+0000 mgr.y (mgr.14146) 353 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:58:37.792 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:56:36.420391+0000 mgr.y (mgr.14146) 368 : cephadm [INF] Upgrade: Target is version 17.0.0-6381-gbccf07c2 (unknown) 2021-07-26T15:58:37.792 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:56:36.420588+0000 mgr.y (mgr.14146) 369 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f, digests ['quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f'] 2021-07-26T15:58:37.792 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:56:36.424694+0000 mgr.y (mgr.14146) 370 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:58:37.793 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:56:36.682855+0000 mgr.y (mgr.14146) 371 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:67e488f4500e461b30826121bd40591c300504e54b7f51ac497f9cc91d13998f on smithi096 2021-07-26T15:58:37.793 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:04.227053+0000 mgr.y (mgr.14146) 386 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:58:37.793 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:04.242141+0000 mgr.y (mgr.14146) 387 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:58:37.793 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:13.327728+0000 mgr.y (mgr.14146) 394 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2021-07-26T15:58:37.794 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:13.333710+0000 mgr.y (mgr.14146) 395 : cephadm [INF] Failing over to other MGR 2021-07-26T15:58:37.794 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:21.408076+0000 mgr.x (mgr.24598) 4 : cephadm [INF] Adjusting osd_memory_target on smithi033 to 3553M 2021-07-26T15:58:37.794 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:21.416643+0000 mgr.x (mgr.24598) 5 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:58:37.794 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:21.516304+0000 mgr.x (mgr.24598) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.795 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:21.752083+0000 mgr.x (mgr.24598) 7 : cephadm [INF] Adjusting osd_memory_target on smithi096 to 3552M 2021-07-26T15:58:37.795 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:21.763030+0000 mgr.x (mgr.24598) 8 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:58:37.795 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:21.795898+0000 mgr.x (mgr.24598) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.795 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:21.864820+0000 mgr.x (mgr.24598) 10 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:58:37.795 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:24.410641+0000 mgr.x (mgr.24598) 13 : cephadm [INF] Upgrade: Updating mgr.y 2021-07-26T15:58:37.796 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:24.430805+0000 mgr.x (mgr.24598) 14 : cephadm [INF] Deploying daemon mgr.y on smithi033 2021-07-26T15:58:37.796 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:32.614022+0000 mgr.x (mgr.24598) 19 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2021-07-26T15:58:37.796 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:32.616833+0000 mgr.x (mgr.24598) 20 : cephadm [INF] Failing over to other MGR 2021-07-26T15:58:37.796 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:41.767651+0000 mgr.y (mgr.14712) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:58:37.797 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:41.776604+0000 mgr.y (mgr.14712) 7 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:58:37.797 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:41.793043+0000 mgr.y (mgr.14712) 8 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.797 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:41.799023+0000 mgr.y (mgr.14712) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.797 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:44.215023+0000 mgr.y (mgr.14712) 11 : cephadm [INF] Upgrade: Updating mgr.x 2021-07-26T15:58:37.797 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:44.234426+0000 mgr.y (mgr.14712) 12 : cephadm [INF] Deploying daemon mgr.x on smithi096 2021-07-26T15:58:37.798 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:53.270293+0000 mgr.y (mgr.14712) 18 : cephadm [INF] Upgrade: Setting container_image for all mgr 2021-07-26T15:58:37.798 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:53.297863+0000 mgr.y (mgr.14712) 19 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2021-07-26T15:58:37.798 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:55.979187+0000 mgr.y (mgr.14712) 21 : cephadm [INF] Upgrade: Updating mon.a 2021-07-26T15:58:37.798 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:57:55.993141+0000 mgr.y (mgr.14712) 22 : cephadm [INF] Deploying daemon mon.a on smithi033 2021-07-26T15:58:37.798 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:07.912962+0000 mon.a (mon.0) 17 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-07-26T15:58:37.799 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:07.939603+0000 mon.a (mon.0) 18 : cluster [DBG] Standby manager daemon x restarted 2021-07-26T15:58:37.799 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:07.939726+0000 mon.a (mon.0) 19 : cluster [DBG] Standby manager daemon x started 2021-07-26T15:58:37.799 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:08.293237+0000 mon.a (mon.0) 20 : cluster [INF] Active manager daemon y restarted 2021-07-26T15:58:37.799 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:08.294759+0000 mon.a (mon.0) 21 : cluster [INF] Activating manager daemon y 2021-07-26T15:58:37.800 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:08.300924+0000 mon.a (mon.0) 22 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-07-26T15:58:37.800 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:08.932566+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e28: y(active, starting, since 0.637993s), standbys: x 2021-07-26T15:58:37.800 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:08.940561+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T15:58:37.800 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:08.940958+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T15:58:37.800 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:08.941343+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T15:58:37.801 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:08.941659+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T15:58:37.801 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:08.942069+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T15:58:37.801 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:08.942385+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-07-26T15:58:37.801 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:08.942741+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-07-26T15:58:37.802 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:08.943287+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-07-26T15:58:37.802 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:08.952903+0000 mon.a (mon.0) 24 : cluster [INF] Manager daemon y is now available 2021-07-26T15:58:37.802 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:09.107958+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.802 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:09.113491+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.802 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:09.116981+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.803 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:09.120495+0000 mon.c (mon.1) 107 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:37.803 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:09.146184+0000 mon.c (mon.1) 108 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:58:37.803 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:09.146710+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:58:37.803 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:09.178858+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:58:37.804 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:09.179402+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:58:37.804 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:09.302495+0000 mon.a (mon.0) 27 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-07-26T15:58:37.804 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:09.729498+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.804 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:09.943740+0000 mon.a (mon.0) 29 : cluster [DBG] mgrmap e29: y(active, since 1.64918s), standbys: x 2021-07-26T15:58:37.804 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:09.946524+0000 mgr.y (mgr.34104) 1 : audit [DBG] from='client.34110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:37.805 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:09.956269+0000 mgr.y (mgr.34104) 2 : cluster [DBG] pgmap v4: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.805 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:10.272343+0000 mgr.y (mgr.34104) 3 : audit [DBG] from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:37.805 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:10.304990+0000 mon.a (mon.0) 30 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-07-26T15:58:37.805 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:10.685873+0000 mon.c (mon.1) 110 : audit [DBG] from='client.? 172.21.15.33:0/3747067038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:37.806 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:10.941034+0000 mgr.y (mgr.34104) 4 : cluster [DBG] pgmap v6: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.806 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:10.963014+0000 mon.a (mon.0) 31 : cluster [DBG] mgrmap e30: y(active, since 2s), standbys: x 2021-07-26T15:58:37.806 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:11.309085+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-07-26T15:58:37.807 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:12.310196+0000 mon.a (mon.0) 33 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-07-26T15:58:37.807 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:12.941829+0000 mgr.y (mgr.34104) 5 : cluster [DBG] pgmap v9: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.807 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:13.321835+0000 mon.a (mon.0) 34 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-07-26T15:58:37.807 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:13.729636+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.808 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:58:13.974535+0000 mgr.y (mgr.34104) 6 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.conf 2021-07-26T15:58:37.808 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:58:13.998791+0000 mgr.y (mgr.34104) 7 : cephadm [INF] Updating smithi033:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.808 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:14.154633+0000 mon.a (mon.0) 36 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.808 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:14.190403+0000 mon.a (mon.0) 37 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.808 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:14.333588+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-07-26T15:58:37.809 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:58:14.437155+0000 mgr.y (mgr.34104) 8 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.conf 2021-07-26T15:58:37.809 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:58:14.463185+0000 mgr.y (mgr.34104) 9 : cephadm [INF] Updating smithi096:/etc/ceph/ceph.client.admin.keyring 2021-07-26T15:58:37.809 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:14.501425+0000 mon.a (mon.0) 39 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.809 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:14.512014+0000 mon.a (mon.0) 40 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.809 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:14.520270+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.810 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:14.522612+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:37.810 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:14.524588+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:58:37.810 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:14.525918+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2021-07-26T15:58:37.810 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:58:14.526835+0000 mgr.y (mgr.34104) 10 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2021-07-26T15:58:37.811 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:14.942730+0000 mgr.y (mgr.34104) 11 : cluster [DBG] pgmap v12: 25 pgs: 25 active+clean; 75 MiB data, 288 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.811 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:15.338488+0000 mon.a (mon.0) 41 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-07-26T15:58:37.811 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:15.914077+0000 mon.a (mon.0) 42 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-07-26T15:58:37.811 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:16.925337+0000 mon.a (mon.0) 43 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-07-26T15:58:37.811 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:16.943225+0000 mgr.y (mgr.34104) 12 : cluster [DBG] pgmap v16: 25 pgs: 25 active+clean; 83 MiB data, 299 MiB used, 715 GiB / 715 GiB avail; 4.9 MiB/s rd, 1.1 MiB/s wr, 25 op/s 2021-07-26T15:58:37.812 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:58:17.467946+0000 mgr.y (mgr.34104) 13 : cephadm [INF] Upgrade: Updating mon.c 2021-07-26T15:58:37.812 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:17.474594+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.812 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:17.481007+0000 mon.c (mon.1) 115 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:37.812 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:17.482988+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:37.813 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:17.484681+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.813 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:58:17.485945+0000 mgr.y (mgr.34104) 14 : cephadm [INF] Deploying daemon mon.c on smithi033 2021-07-26T15:58:37.813 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:17.935205+0000 mon.a (mon.0) 46 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-07-26T15:58:37.813 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:18.943714+0000 mgr.y (mgr.34104) 15 : cluster [DBG] pgmap v19: 25 pgs: 25 active+clean; 83 MiB data, 299 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.813 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:18.945406+0000 mon.a (mon.0) 47 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-07-26T15:58:37.814 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:20.944491+0000 mgr.y (mgr.34104) 16 : cluster [DBG] pgmap v21: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 9.4 MiB/s rd, 3.0 MiB/s wr, 15 op/s 2021-07-26T15:58:37.814 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:22.837684+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-07-26T15:58:37.814 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:22.945194+0000 mgr.y (mgr.34104) 17 : cluster [DBG] pgmap v22: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2021-07-26T15:58:37.814 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:23.529855+0000 mon.a (mon.0) 49 : cluster [INF] mon.a calling monitor election 2021-07-26T15:58:37.815 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:23.533380+0000 mon.a (mon.0) 50 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:58:37.815 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:23.542921+0000 mon.a (mon.0) 51 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:58:37.815 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:23.543040+0000 mon.a (mon.0) 52 : cluster [DBG] fsmap 2021-07-26T15:58:37.815 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:23.543112+0000 mon.a (mon.0) 53 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-07-26T15:58:37.815 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:23.543691+0000 mon.a (mon.0) 54 : cluster [DBG] mgrmap e30: y(active, since 15s), standbys: x 2021-07-26T15:58:37.816 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:23.549266+0000 mon.a (mon.0) 55 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:37.816 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:23.554392+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.816 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:23.558738+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.816 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:23.561487+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.816 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:23.563384+0000 mon.b (mon.2) 43 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:37.817 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:24.554841+0000 mon.a (mon.0) 57 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-07-26T15:58:37.817 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:24.945922+0000 mgr.y (mgr.34104) 18 : cluster [DBG] pgmap v24: 25 pgs: 25 active+clean; 90 MiB data, 318 MiB used, 715 GiB / 715 GiB avail; 6.3 MiB/s rd, 2.0 MiB/s wr, 10 op/s 2021-07-26T15:58:37.817 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:25.569529+0000 mon.a (mon.0) 58 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-07-26T15:58:37.817 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:25.918508+0000 mon.a (mon.0) 59 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-07-26T15:58:37.818 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:26.929164+0000 mon.a (mon.0) 60 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-07-26T15:58:37.818 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:26.946544+0000 mgr.y (mgr.34104) 19 : cluster [DBG] pgmap v28: 25 pgs: 25 active+clean; 94 MiB data, 323 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2021-07-26T15:58:37.818 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:27.899481+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.818 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:27.910678+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.818 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:27.923064+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.819 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:27.926428+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:37.819 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:27.942559+0000 mon.a (mon.0) 63 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-07-26T15:58:37.819 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:27.946370+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2021-07-26T15:58:37.819 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:27.952534+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2021-07-26T15:58:37.819 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:58:27.954196+0000 mgr.y (mgr.34104) 20 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2021-07-26T15:58:37.820 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:28.942693+0000 mon.a (mon.0) 64 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-07-26T15:58:37.820 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:28.947207+0000 mgr.y (mgr.34104) 21 : cluster [DBG] pgmap v31: 25 pgs: 25 active+clean; 94 MiB data, 323 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:58:37.820 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:29.969035+0000 mon.a (mon.0) 65 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-07-26T15:58:37.820 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:58:30.205012+0000 mgr.y (mgr.34104) 22 : cephadm [INF] Upgrade: Updating mon.b 2021-07-26T15:58:37.821 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:30.212899+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:37.821 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:30.219067+0000 mon.b (mon.2) 48 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:37.821 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:30.219204+0000 mon.a (mon.0) 67 : audit [DBG] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:37.821 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cephadm 2021-07-26T15:58:30.223078+0000 mgr.y (mgr.34104) 23 : cephadm [INF] Deploying daemon mon.b on smithi096 2021-07-26T15:58:37.821 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:30.223514+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.822 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:30.947933+0000 mgr.y (mgr.34104) 24 : cluster [DBG] pgmap v33: 25 pgs: 25 active+clean; 90 MiB data, 336 MiB used, 715 GiB / 715 GiB avail; 718 KiB/s rd, 394 KiB/s wr, 9 op/s 2021-07-26T15:58:37.822 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:31.218641+0000 mon.a (mon.0) 68 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-07-26T15:58:37.822 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:32.219395+0000 mon.a (mon.0) 69 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-07-26T15:58:37.822 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:32.678915+0000 mon.c (mon.1) 2 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:58:37.823 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:32.680669+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:58:37.823 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:32.683001+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:58:37.823 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:36.285266+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2021-07-26T15:58:37.823 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:36.285480+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-07-26T15:58:37.823 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:36.285679+0000 mon.c (mon.1) 7 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-07-26T15:58:37.824 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:36.286598+0000 mon.a (mon.0) 76 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:37.824 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:36.287865+0000 mon.c (mon.1) 8 : cluster [INF] mon.c calling monitor election 2021-07-26T15:58:37.824 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:36.287940+0000 mon.a (mon.0) 77 : cluster [INF] mon.a calling monitor election 2021-07-26T15:58:37.824 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:36.290267+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2021-07-26T15:58:37.824 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:36.290988+0000 mon.a (mon.0) 78 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-07-26T15:58:37.825 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:36.297258+0000 mon.a (mon.0) 79 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0],b=[v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0],c=[v2:172.21.15.33:3301/0,v1:172.21.15.33:6790/0]} 2021-07-26T15:58:37.825 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:36.297320+0000 mon.a (mon.0) 80 : cluster [DBG] fsmap 2021-07-26T15:58:37.825 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:36.297362+0000 mon.a (mon.0) 81 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-07-26T15:58:37.825 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:36.297780+0000 mon.a (mon.0) 82 : cluster [DBG] mgrmap e30: y(active, since 28s), standbys: x 2021-07-26T15:58:37.826 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: cluster 2021-07-26T15:58:36.303539+0000 mon.a (mon.0) 83 : cluster [INF] overall HEALTH_OK 2021-07-26T15:58:37.826 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:36.309535+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.34104 ' entity='' 2021-07-26T15:58:37.826 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:36.312003+0000 mon.c (mon.1) 9 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:58:37.826 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:36.314144+0000 mon.c (mon.1) 10 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:37.826 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:37 smithi096 bash[33981]: audit 2021-07-26T15:58:36.315914+0000 mon.c (mon.1) 11 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:58:38.308 INFO:tasks.rados.rados.0.smithi033.stdout:614: done (3 left) 2021-07-26T15:58:38.309 INFO:tasks.rados.rados.0.smithi033.stdout:615: rmattr oid 46 current snap is 54 2021-07-26T15:58:38.309 INFO:tasks.rados.rados.0.smithi033.stdout:615: done (3 left) 2021-07-26T15:58:38.309 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 54 2021-07-26T15:58:38.310 INFO:tasks.rados.rados.0.smithi033.stdout:616: seq_num 197 ranges {5308416=507904,5816320=401408} 2021-07-26T15:58:38.343 INFO:tasks.rados.rados.0.smithi033.stdout:616: writing smithi03339061-40 from 5308416 to 5816320 tid 1 2021-07-26T15:58:38.345 INFO:tasks.rados.rados.0.smithi033.stdout:616: writing smithi03339061-40 from 5816320 to 6217728 tid 2 2021-07-26T15:58:38.345 INFO:tasks.rados.rados.0.smithi033.stdout:617: read oid 36 snap -1 2021-07-26T15:58:38.346 INFO:tasks.rados.rados.0.smithi033.stdout:617: expect (ObjNum 1 snap 0 seq_num 1) 2021-07-26T15:58:38.346 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 16 current snap is 54 2021-07-26T15:58:38.346 INFO:tasks.rados.rados.0.smithi033.stdout:618: seq_num 198 ranges {2392064=524288,2916352=401408} 2021-07-26T15:58:38.362 INFO:tasks.rados.rados.0.smithi033.stdout:618: writing smithi03339061-16 from 2392064 to 2916352 tid 1 2021-07-26T15:58:38.364 INFO:tasks.rados.rados.0.smithi033.stdout:618: writing smithi03339061-16 from 2916352 to 3317760 tid 2 2021-07-26T15:58:38.365 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 54 2021-07-26T15:58:38.365 INFO:tasks.rados.rados.0.smithi033.stdout:619: seq_num 199 ranges {303104=540672,843776=401408} 2021-07-26T15:58:38.369 INFO:tasks.rados.rados.0.smithi033.stdout:619: writing smithi03339061-4 from 303104 to 843776 tid 1 2021-07-26T15:58:38.372 INFO:tasks.rados.rados.0.smithi033.stdout:619: writing smithi03339061-4 from 843776 to 1245184 tid 2 2021-07-26T15:58:38.372 INFO:tasks.rados.rados.0.smithi033.stdout:620: read oid 34 snap 47 2021-07-26T15:58:38.373 INFO:tasks.rados.rados.0.smithi033.stdout:620: expect deleted 2021-07-26T15:58:38.373 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 54 2021-07-26T15:58:38.373 INFO:tasks.rados.rados.0.smithi033.stdout:621: seq_num 200 ranges {606208=557056,1163264=401408} 2021-07-26T15:58:38.380 INFO:tasks.rados.rados.0.smithi033.stdout:621: writing smithi03339061-19 from 606208 to 1163264 tid 1 2021-07-26T15:58:38.382 INFO:tasks.rados.rados.0.smithi033.stdout:621: writing smithi03339061-19 from 1163264 to 1564672 tid 2 2021-07-26T15:58:38.382 INFO:tasks.rados.rados.0.smithi033.stdout:622: rmattr oid 44 current snap is 54 2021-07-26T15:58:38.383 INFO:tasks.rados.rados.0.smithi033.stdout:611: finishing rollback tid 0 to smithi03339061-47 2021-07-26T15:58:38.383 INFO:tasks.rados.rados.0.smithi033.stdout:613: expect (ObjNum 172 snap 45 seq_num 172) 2021-07-26T15:58:38.398 INFO:tasks.rados.rados.0.smithi033.stdout:611: finishing rollback tid 1 to smithi03339061-47 2021-07-26T15:58:38.398 INFO:tasks.rados.rados.0.smithi033.stdout:611: finishing rollback tid 2 to smithi03339061-47 2021-07-26T15:58:38.399 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 197 (ObjNum 2006453472 snap 22002 seq_num 2006029168) dirty exists 2021-07-26T15:58:38.399 INFO:tasks.rados.rados.0.smithi033.stdout:611: done (9 left) 2021-07-26T15:58:38.399 INFO:tasks.rados.rados.0.smithi033.stdout:613: done (8 left) 2021-07-26T15:58:38.399 INFO:tasks.rados.rados.0.smithi033.stdout:623: rmattr oid 29 current snap is 54 2021-07-26T15:58:38.399 INFO:tasks.rados.rados.0.smithi033.stdout:612: expect (ObjNum 104 snap 19 seq_num 104) 2021-07-26T15:58:38.471 INFO:tasks.rados.rados.0.smithi033.stdout:617: expect (ObjNum 1 snap 0 seq_num 1) 2021-07-26T15:58:38.474 INFO:tasks.rados.rados.0.smithi033.stdout:616: finishing write tid 1 to smithi03339061-40 2021-07-26T15:58:38.474 INFO:tasks.rados.rados.0.smithi033.stdout:616: finishing write tid 2 to smithi03339061-40 2021-07-26T15:58:38.474 INFO:tasks.rados.rados.0.smithi033.stdout:616: finishing write tid 3 to smithi03339061-40 2021-07-26T15:58:38.475 INFO:tasks.rados.rados.0.smithi033.stdout:612: done (8 left) 2021-07-26T15:58:38.475 INFO:tasks.rados.rados.0.smithi033.stdout:617: done (7 left) 2021-07-26T15:58:38.475 INFO:tasks.rados.rados.0.smithi033.stdout:624: rmattr oid 49 current snap is 54 2021-07-26T15:58:38.475 INFO:tasks.rados.rados.0.smithi033.stdout:616: finishing write tid 4 to smithi03339061-40 2021-07-26T15:58:38.475 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 177 (ObjNum 197 snap 54 seq_num 197) dirty exists 2021-07-26T15:58:38.476 INFO:tasks.rados.rados.0.smithi033.stdout:616: left oid 40 (ObjNum 197 snap 54 seq_num 197) 2021-07-26T15:58:38.476 INFO:tasks.rados.rados.0.smithi033.stdout:618: finishing write tid 1 to smithi03339061-16 2021-07-26T15:58:38.476 INFO:tasks.rados.rados.0.smithi033.stdout:618: finishing write tid 2 to smithi03339061-16 2021-07-26T15:58:38.476 INFO:tasks.rados.rados.0.smithi033.stdout:618: finishing write tid 3 to smithi03339061-16 2021-07-26T15:58:38.477 INFO:tasks.rados.rados.0.smithi033.stdout:618: finishing write tid 4 to smithi03339061-16 2021-07-26T15:58:38.477 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 180 (ObjNum 198 snap 54 seq_num 198) dirty exists 2021-07-26T15:58:38.477 INFO:tasks.rados.rados.0.smithi033.stdout:618: left oid 16 (ObjNum 198 snap 54 seq_num 198) 2021-07-26T15:58:38.477 INFO:tasks.rados.rados.0.smithi033.stdout:619: finishing write tid 1 to smithi03339061-4 2021-07-26T15:58:38.477 INFO:tasks.rados.rados.0.smithi033.stdout:619: finishing write tid 2 to smithi03339061-4 2021-07-26T15:58:38.478 INFO:tasks.rados.rados.0.smithi033.stdout:619: finishing write tid 3 to smithi03339061-4 2021-07-26T15:58:38.478 INFO:tasks.rados.rados.0.smithi033.stdout:621: finishing write tid 1 to smithi03339061-19 2021-07-26T15:58:38.478 INFO:tasks.rados.rados.0.smithi033.stdout:619: finishing write tid 4 to smithi03339061-4 2021-07-26T15:58:38.478 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 214 (ObjNum 199 snap 54 seq_num 199) dirty exists 2021-07-26T15:58:38.478 INFO:tasks.rados.rados.0.smithi033.stdout:619: left oid 4 (ObjNum 199 snap 54 seq_num 199) 2021-07-26T15:58:38.479 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 215 (ObjNum 181 snap 47 seq_num 181) dirty exists 2021-07-26T15:58:38.479 INFO:tasks.rados.rados.0.smithi033.stdout:621: finishing write tid 2 to smithi03339061-19 2021-07-26T15:58:38.479 INFO:tasks.rados.rados.0.smithi033.stdout:621: finishing write tid 3 to smithi03339061-19 2021-07-26T15:58:38.479 INFO:tasks.rados.rados.0.smithi033.stdout:621: finishing write tid 4 to smithi03339061-19 2021-07-26T15:58:38.479 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 175 (ObjNum 200 snap 54 seq_num 200) dirty exists 2021-07-26T15:58:38.480 INFO:tasks.rados.rados.0.smithi033.stdout:621: left oid 19 (ObjNum 200 snap 54 seq_num 200) 2021-07-26T15:58:38.480 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 154 (ObjNum 158 snap 39 seq_num 158) dirty exists 2021-07-26T15:58:38.481 INFO:tasks.rados.rados.0.smithi033.stdout:616: done (7 left) 2021-07-26T15:58:38.481 INFO:tasks.rados.rados.0.smithi033.stdout:618: done (6 left) 2021-07-26T15:58:38.481 INFO:tasks.rados.rados.0.smithi033.stdout:619: done (5 left) 2021-07-26T15:58:38.481 INFO:tasks.rados.rados.0.smithi033.stdout:620: done (4 left) 2021-07-26T15:58:38.481 INFO:tasks.rados.rados.0.smithi033.stdout:621: done (3 left) 2021-07-26T15:58:38.482 INFO:tasks.rados.rados.0.smithi033.stdout:622: done (2 left) 2021-07-26T15:58:38.482 INFO:tasks.rados.rados.0.smithi033.stdout:623: done (1 left) 2021-07-26T15:58:38.482 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 54 2021-07-26T15:58:38.482 INFO:tasks.rados.rados.0.smithi033.stdout:625: seq_num 201 ranges {2392064=573440,2965504=401408} 2021-07-26T15:58:38.499 INFO:tasks.rados.rados.0.smithi033.stdout:625: writing smithi03339061-46 from 2392064 to 2965504 tid 1 2021-07-26T15:58:38.501 INFO:tasks.rados.rados.0.smithi033.stdout:625: writing smithi03339061-46 from 2965504 to 3366912 tid 2 2021-07-26T15:58:38.501 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 54 2021-07-26T15:58:38.501 INFO:tasks.rados.rados.0.smithi033.stdout:626: seq_num 202 ranges {0=589824,589824=401408} 2021-07-26T15:58:38.504 INFO:tasks.rados.rados.0.smithi033.stdout:626: writing smithi03339061-31 from 0 to 589824 tid 1 2021-07-26T15:58:38.507 INFO:tasks.rados.rados.0.smithi033.stdout:626: writing smithi03339061-31 from 589824 to 991232 tid 2 2021-07-26T15:58:38.507 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 54 2021-07-26T15:58:38.507 INFO:tasks.rados.rados.0.smithi033.stdout:627: seq_num 203 ranges {4988928=606208,5595136=401408} 2021-07-26T15:58:38.538 INFO:tasks.rados.rados.0.smithi033.stdout:627: writing smithi03339061-30 from 4988928 to 5595136 tid 1 2021-07-26T15:58:38.541 INFO:tasks.rados.rados.0.smithi033.stdout:627: writing smithi03339061-30 from 5595136 to 5996544 tid 2 2021-07-26T15:58:38.541 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 163 (ObjNum 161 snap 39 seq_num 161) dirty exists 2021-07-26T15:58:38.541 INFO:tasks.rados.rados.0.smithi033.stdout:628: read oid 5 snap -1 2021-07-26T15:58:38.541 INFO:tasks.rados.rados.0.smithi033.stdout:628: expect (ObjNum 124 snap 29 seq_num 124) 2021-07-26T15:58:38.542 INFO:tasks.rados.rados.0.smithi033.stdout:624: done (4 left) 2021-07-26T15:58:38.542 INFO:tasks.rados.rados.0.smithi033.stdout:629: setattr oid 19 current snap is 54 2021-07-26T15:58:38.542 INFO:tasks.rados.rados.0.smithi033.stdout:625: finishing write tid 1 to smithi03339061-46 2021-07-26T15:58:38.542 INFO:tasks.rados.rados.0.smithi033.stdout:625: finishing write tid 2 to smithi03339061-46 2021-07-26T15:58:38.542 INFO:tasks.rados.rados.0.smithi033.stdout:625: finishing write tid 3 to smithi03339061-46 2021-07-26T15:58:38.543 INFO:tasks.rados.rados.0.smithi033.stdout:625: finishing write tid 4 to smithi03339061-46 2021-07-26T15:58:38.543 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 157 (ObjNum 201 snap 54 seq_num 201) dirty exists 2021-07-26T15:58:38.544 INFO:tasks.rados.rados.0.smithi033.stdout:625: left oid 46 (ObjNum 201 snap 54 seq_num 201) 2021-07-26T15:58:38.545 INFO:tasks.rados.rados.0.smithi033.stdout:626: finishing write tid 1 to smithi03339061-31 2021-07-26T15:58:38.545 INFO:tasks.rados.rados.0.smithi033.stdout:626: finishing write tid 2 to smithi03339061-31 2021-07-26T15:58:38.545 INFO:tasks.rados.rados.0.smithi033.stdout:626: finishing write tid 3 to smithi03339061-31 2021-07-26T15:58:38.545 INFO:tasks.rados.rados.0.smithi033.stdout:626: finishing write tid 4 to smithi03339061-31 2021-07-26T15:58:38.546 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 34 (ObjNum 202 snap 54 seq_num 202) dirty exists 2021-07-26T15:58:38.546 INFO:tasks.rados.rados.0.smithi033.stdout:626: left oid 31 (ObjNum 202 snap 54 seq_num 202) 2021-07-26T15:58:38.547 INFO:tasks.rados.rados.0.smithi033.stdout:625: done (4 left) 2021-07-26T15:58:38.547 INFO:tasks.rados.rados.0.smithi033.stdout:626: done (3 left) 2021-07-26T15:58:38.547 INFO:tasks.rados.rados.0.smithi033.stdout:630: snap_create 2021-07-26T15:58:38.547 INFO:tasks.rados.rados.0.smithi033.stdout:627: finishing write tid 1 to smithi03339061-30 2021-07-26T15:58:38.548 INFO:tasks.rados.rados.0.smithi033.stdout:627: finishing write tid 2 to smithi03339061-30 2021-07-26T15:58:38.548 INFO:tasks.rados.rados.0.smithi033.stdout:627: finishing write tid 3 to smithi03339061-30 2021-07-26T15:58:38.548 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 176 (ObjNum 200 snap 54 seq_num 200) dirty exists 2021-07-26T15:58:38.549 INFO:tasks.rados.rados.0.smithi033.stdout:627: finishing write tid 4 to smithi03339061-30 2021-07-26T15:58:38.549 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 202 (ObjNum 203 snap 54 seq_num 203) dirty exists 2021-07-26T15:58:38.550 INFO:tasks.rados.rados.0.smithi033.stdout:627: left oid 30 (ObjNum 203 snap 54 seq_num 203) 2021-07-26T15:58:38.560 INFO:tasks.rados.rados.0.smithi033.stdout:628: expect (ObjNum 124 snap 29 seq_num 124) 2021-07-26T15:58:38.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:38 smithi033 bash[41341]: cluster 2021-07-26T15:58:36.950126+0000 mgr.y (mgr.34104) 27 : cluster [DBG] pgmap v38: 25 pgs: 25 active+clean; 81 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 120 KiB/s wr, 17 op/s 2021-07-26T15:58:38.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:38 smithi033 bash[41341]: cluster 2021-07-26T15:58:37.289398+0000 mon.a (mon.0) 85 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-07-26T15:58:38.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:38 smithi033 bash[42377]: cluster 2021-07-26T15:58:36.950126+0000 mgr.y (mgr.34104) 27 : cluster [DBG] pgmap v38: 25 pgs: 25 active+clean; 81 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 120 KiB/s wr, 17 op/s 2021-07-26T15:58:38.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:38 smithi033 bash[42377]: cluster 2021-07-26T15:58:37.289398+0000 mon.a (mon.0) 85 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-07-26T15:58:38.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:38 smithi096 bash[33981]: cluster 2021-07-26T15:58:36.950126+0000 mgr.y (mgr.34104) 27 : cluster [DBG] pgmap v38: 25 pgs: 25 active+clean; 81 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 120 KiB/s wr, 17 op/s 2021-07-26T15:58:38.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:38 smithi096 bash[33981]: cluster 2021-07-26T15:58:37.289398+0000 mon.a (mon.0) 85 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-07-26T15:58:39.325 INFO:tasks.rados.rados.0.smithi033.stdout:627: done (3 left) 2021-07-26T15:58:39.325 INFO:tasks.rados.rados.0.smithi033.stdout:628: done (2 left) 2021-07-26T15:58:39.326 INFO:tasks.rados.rados.0.smithi033.stdout:629: done (1 left) 2021-07-26T15:58:39.326 INFO:tasks.rados.rados.0.smithi033.stdout:630: done (0 left) 2021-07-26T15:58:39.326 INFO:tasks.rados.rados.0.smithi033.stdout:631: rollback oid 32 current snap is 55 2021-07-26T15:58:39.326 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 32 to 54 2021-07-26T15:58:39.327 INFO:tasks.rados.rados.0.smithi033.stdout:632: snap_remove snap 47 2021-07-26T15:58:39.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:39 smithi033 bash[41341]: cluster 2021-07-26T15:58:38.305010+0000 mon.a (mon.0) 86 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-07-26T15:58:39.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:39 smithi033 bash[42377]: cluster 2021-07-26T15:58:38.305010+0000 mon.a (mon.0) 86 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-07-26T15:58:39.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:39 smithi096 bash[33981]: cluster 2021-07-26T15:58:38.305010+0000 mon.a (mon.0) 86 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-07-26T15:58:40.336 INFO:tasks.rados.rados.0.smithi033.stdout:632: done (1 left) 2021-07-26T15:58:40.336 INFO:tasks.rados.rados.0.smithi033.stdout:633: read oid 21 snap -1 2021-07-26T15:58:40.336 INFO:tasks.rados.rados.0.smithi033.stdout:633: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:58:40.336 INFO:tasks.rados.rados.0.smithi033.stdout:634: rollback oid 33 current snap is 55 2021-07-26T15:58:40.337 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 54 2021-07-26T15:58:40.337 INFO:tasks.rados.rados.0.smithi033.stdout:635: copy_from oid 27 from oid 8 current snap is 55 2021-07-26T15:58:40.337 INFO:tasks.rados.rados.0.smithi033.stdout:636: read oid 39 snap -1 2021-07-26T15:58:40.338 INFO:tasks.rados.rados.0.smithi033.stdout:636: expect (ObjNum 186 snap 49 seq_num 186) 2021-07-26T15:58:40.338 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 55 2021-07-26T15:58:40.338 INFO:tasks.rados.rados.0.smithi033.stdout:637: seq_num 204 ranges {5996544=622592,6619136=401408} 2021-07-26T15:58:40.378 INFO:tasks.rados.rados.0.smithi033.stdout:637: writing smithi03339061-30 from 5996544 to 6619136 tid 1 2021-07-26T15:58:40.378 INFO:tasks.rados.rados.0.smithi033.stdout:637: writing smithi03339061-30 from 6619136 to 7020544 tid 2 2021-07-26T15:58:40.378 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 55 2021-07-26T15:58:40.379 INFO:tasks.rados.rados.0.smithi033.stdout:631: finishing rollback tid 1 to smithi03339061-32 2021-07-26T15:58:40.379 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 0 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T15:58:40.379 INFO:tasks.rados.rados.0.smithi033.stdout:638: seq_num 205 ranges {991232=638976,1630208=401408} 2021-07-26T15:58:40.386 INFO:tasks.rados.rados.0.smithi033.stdout:638: writing smithi03339061-38 from 991232 to 1630208 tid 1 2021-07-26T15:58:40.388 INFO:tasks.rados.rados.0.smithi033.stdout:638: writing smithi03339061-38 from 1630208 to 2031616 tid 2 2021-07-26T15:58:40.389 INFO:tasks.rados.rados.0.smithi033.stdout:631: done (6 left) 2021-07-26T15:58:40.389 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 55 2021-07-26T15:58:40.389 INFO:tasks.rados.rados.0.smithi033.stdout:639: seq_num 206 ranges {2629632=655360,3284992=401408} 2021-07-26T15:58:40.408 INFO:tasks.rados.rados.0.smithi033.stdout:639: writing smithi03339061-2 from 2629632 to 3284992 tid 1 2021-07-26T15:58:40.410 INFO:tasks.rados.rados.0.smithi033.stdout:639: writing smithi03339061-2 from 3284992 to 3686400 tid 2 2021-07-26T15:58:40.410 INFO:tasks.rados.rados.0.smithi033.stdout:640: copy_from oid 26 from oid 37 current snap is 55 2021-07-26T15:58:40.410 INFO:tasks.rados.rados.0.smithi033.stdout:635: finishing copy_from to smithi03339061-27 2021-07-26T15:58:40.411 INFO:tasks.rados.rados.0.smithi033.stdout:635: got expected ENOENT (src dne) 2021-07-26T15:58:40.411 INFO:tasks.rados.rados.0.smithi033.stdout:635: finishing copy_from racing read to smithi03339061-27 2021-07-26T15:58:40.411 INFO:tasks.rados.rados.0.smithi033.stdout:633: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:58:40.441 INFO:tasks.rados.rados.0.smithi033.stdout:636: expect (ObjNum 186 snap 49 seq_num 186) 2021-07-26T15:58:40.461 INFO:tasks.rados.rados.0.smithi033.stdout:634: finishing rollback tid 0 to smithi03339061-33 2021-07-26T15:58:40.462 INFO:tasks.rados.rados.0.smithi033.stdout:634: finishing rollback tid 1 to smithi03339061-33 2021-07-26T15:58:40.463 INFO:tasks.rados.rados.0.smithi033.stdout:634: finishing rollback tid 2 to smithi03339061-33 2021-07-26T15:58:40.463 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 384 (ObjNum 130 snap 32 seq_num 130) dirty exists 2021-07-26T15:58:40.463 INFO:tasks.rados.rados.0.smithi033.stdout:637: finishing write tid 1 to smithi03339061-30 2021-07-26T15:58:40.463 INFO:tasks.rados.rados.0.smithi033.stdout:637: finishing write tid 2 to smithi03339061-30 2021-07-26T15:58:40.463 INFO:tasks.rados.rados.0.smithi033.stdout:637: finishing write tid 3 to smithi03339061-30 2021-07-26T15:58:40.464 INFO:tasks.rados.rados.0.smithi033.stdout:637: finishing write tid 4 to smithi03339061-30 2021-07-26T15:58:40.464 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 212 (ObjNum 204 snap 55 seq_num 204) dirty exists 2021-07-26T15:58:40.464 INFO:tasks.rados.rados.0.smithi033.stdout:637: left oid 30 (ObjNum 204 snap 55 seq_num 204) 2021-07-26T15:58:40.464 INFO:tasks.rados.rados.0.smithi033.stdout:638: finishing write tid 1 to smithi03339061-38 2021-07-26T15:58:40.465 INFO:tasks.rados.rados.0.smithi033.stdout:638: finishing write tid 2 to smithi03339061-38 2021-07-26T15:58:40.465 INFO:tasks.rados.rados.0.smithi033.stdout:638: finishing write tid 3 to smithi03339061-38 2021-07-26T15:58:40.465 INFO:tasks.rados.rados.0.smithi033.stdout:633: done (7 left) 2021-07-26T15:58:40.465 INFO:tasks.rados.rados.0.smithi033.stdout:634: done (6 left) 2021-07-26T15:58:40.465 INFO:tasks.rados.rados.0.smithi033.stdout:635: done (5 left) 2021-07-26T15:58:40.466 INFO:tasks.rados.rados.0.smithi033.stdout:636: done (4 left) 2021-07-26T15:58:40.466 INFO:tasks.rados.rados.0.smithi033.stdout:637: done (3 left) 2021-07-26T15:58:40.466 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 55 2021-07-26T15:58:40.467 INFO:tasks.rados.rados.0.smithi033.stdout:638: finishing write tid 4 to smithi03339061-38 2021-07-26T15:58:40.467 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 46 (ObjNum 205 snap 55 seq_num 205) dirty exists 2021-07-26T15:58:40.467 INFO:tasks.rados.rados.0.smithi033.stdout:638: left oid 38 (ObjNum 205 snap 55 seq_num 205) 2021-07-26T15:58:40.467 INFO:tasks.rados.rados.0.smithi033.stdout:639: finishing write tid 1 to smithi03339061-2 2021-07-26T15:58:40.467 INFO:tasks.rados.rados.0.smithi033.stdout:639: finishing write tid 2 to smithi03339061-2 2021-07-26T15:58:40.468 INFO:tasks.rados.rados.0.smithi033.stdout:639: finishing write tid 3 to smithi03339061-2 2021-07-26T15:58:40.468 INFO:tasks.rados.rados.0.smithi033.stdout:639: finishing write tid 4 to smithi03339061-2 2021-07-26T15:58:40.468 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 171 (ObjNum 206 snap 55 seq_num 206) dirty exists 2021-07-26T15:58:40.468 INFO:tasks.rados.rados.0.smithi033.stdout:639: left oid 2 (ObjNum 206 snap 55 seq_num 206) 2021-07-26T15:58:40.468 INFO:tasks.rados.rados.0.smithi033.stdout:640: finishing copy_from to smithi03339061-26 2021-07-26T15:58:40.469 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 155 (ObjNum 36 snap 0 seq_num 36) dirty exists 2021-07-26T15:58:40.469 INFO:tasks.rados.rados.0.smithi033.stdout:641: seq_num 207 ranges {1671168=671744,2342912=401408} 2021-07-26T15:58:40.483 INFO:tasks.rados.rados.0.smithi033.stdout:641: writing smithi03339061-6 from 1671168 to 2342912 tid 1 2021-07-26T15:58:40.485 INFO:tasks.rados.rados.0.smithi033.stdout:641: writing smithi03339061-6 from 2342912 to 2744320 tid 2 2021-07-26T15:58:40.486 INFO:tasks.rados.rados.0.smithi033.stdout:638: done (3 left) 2021-07-26T15:58:40.486 INFO:tasks.rados.rados.0.smithi033.stdout:639: done (2 left) 2021-07-26T15:58:40.486 INFO:tasks.rados.rados.0.smithi033.stdout:642: delete oid 33 current snap is 55 2021-07-26T15:58:40.486 INFO:tasks.rados.rados.0.smithi033.stdout:640: finishing copy_from racing read to smithi03339061-26 2021-07-26T15:58:40.492 INFO:tasks.rados.rados.0.smithi033.stdout:641: finishing write tid 1 to smithi03339061-6 2021-07-26T15:58:40.492 INFO:tasks.rados.rados.0.smithi033.stdout:641: finishing write tid 2 to smithi03339061-6 2021-07-26T15:58:40.493 INFO:tasks.rados.rados.0.smithi033.stdout:641: finishing write tid 3 to smithi03339061-6 2021-07-26T15:58:40.495 INFO:tasks.rados.rados.0.smithi033.stdout:640: done (2 left) 2021-07-26T15:58:40.496 INFO:tasks.rados.rados.0.smithi033.stdout:642: done (1 left) 2021-07-26T15:58:40.498 INFO:tasks.rados.rados.0.smithi033.stdout:643: snap_remove snap 54 2021-07-26T15:58:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:40 smithi033 bash[41341]: cluster 2021-07-26T15:58:38.951002+0000 mgr.y (mgr.34104) 28 : cluster [DBG] pgmap v41: 25 pgs: 25 active+clean; 81 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 125 KiB/s wr, 18 op/s 2021-07-26T15:58:40.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:40 smithi033 bash[41341]: cluster 2021-07-26T15:58:39.321934+0000 mon.a (mon.0) 87 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-07-26T15:58:40.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:40 smithi033 bash[42377]: cluster 2021-07-26T15:58:38.951002+0000 mgr.y (mgr.34104) 28 : cluster [DBG] pgmap v41: 25 pgs: 25 active+clean; 81 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 125 KiB/s wr, 18 op/s 2021-07-26T15:58:40.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:40 smithi033 bash[42377]: cluster 2021-07-26T15:58:39.321934+0000 mon.a (mon.0) 87 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-07-26T15:58:40.711 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:58:40 smithi033 bash[29474]: debug 2021-07-26T15:58:40.326+0000 7f0abf26a700 -1 osd.3 pg_epoch: 171 pg[3.bs0( v 167'376 (0'0,167'376] local-lis/les=57/58 n=10 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [3,0,4]p3(0) r=0 lpr=57 crt=167'376 lcod 167'375 mlcod 167'375 active+clean+snaptrim trimq=[5b~1] ps=[51~1,57~1,5a~1,5f~1,61~1,64~2,6b~1]] removing snap head 2021-07-26T15:58:40.712 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:58:40 smithi033 bash[21582]: debug 2021-07-26T15:58:40.338+0000 7f5fff48b700 -1 osd.0 pg_epoch: 171 pg[3.1s0( v 171'182 (0'0,171'182] local-lis/les=57/58 n=4 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [0,4,3]p0(0) r=0 lpr=57 luod=169'180 crt=169'180 lcod 169'179 mlcod 169'179 active+clean+snaptrim trimq=[5b~1] ps=[51~1,57~1,5a~1,5f~1,61~1,64~2,6b~1]] removing snap head 2021-07-26T15:58:40.737 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 15:58:40 smithi096 bash[23105]: debug 2021-07-26T15:58:40.339+0000 7f3ddd0c6700 -1 osd.6 pg_epoch: 171 pg[3.as0( v 165'94 (0'0,165'94] local-lis/les=57/58 n=4 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [6,4,1]p6(0) r=0 lpr=57 crt=165'94 lcod 165'92 mlcod 165'92 active+clean+snaptrim trimq=[5b~1] ps=[51~1,57~1,5a~1,5f~1,61~1,64~2,6b~1]] removing snap head 2021-07-26T15:58:40.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:40 smithi096 bash[33981]: cluster 2021-07-26T15:58:38.951002+0000 mgr.y (mgr.34104) 28 : cluster [DBG] pgmap v41: 25 pgs: 25 active+clean; 81 MiB data, 338 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 125 KiB/s wr, 18 op/s 2021-07-26T15:58:40.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:40 smithi096 bash[33981]: cluster 2021-07-26T15:58:39.321934+0000 mon.a (mon.0) 87 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-07-26T15:58:40.738 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:58:40 smithi096 bash[20458]: debug 2021-07-26T15:58:40.343+0000 7f2dd3f3e700 -1 osd.5 pg_epoch: 171 pg[3.5s0( v 171'165 (0'0,171'165] local-lis/les=57/58 n=4 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [5,3,2]p5(0) r=0 lpr=57 luod=167'163 crt=167'163 lcod 167'161 mlcod 167'161 active+clean+snaptrim trimq=[5b~1] ps=[51~1,57~1,5a~1,5f~1,61~1,64~2,6b~1]] removing snap head 2021-07-26T15:58:40.928 INFO:tasks.rados.rados.0.smithi033.stdout:643: done (1 left) 2021-07-26T15:58:40.928 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 55 2021-07-26T15:58:40.929 INFO:tasks.rados.rados.0.smithi033.stdout:641: finishing write tid 4 to smithi03339061-6 2021-07-26T15:58:40.929 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 394 (ObjNum 207 snap 55 seq_num 207) dirty exists 2021-07-26T15:58:40.929 INFO:tasks.rados.rados.0.smithi033.stdout:641: left oid 6 (ObjNum 207 snap 55 seq_num 207) 2021-07-26T15:58:40.930 INFO:tasks.rados.rados.0.smithi033.stdout:644: seq_num 209 ranges {0=704512,704512=401408} 2021-07-26T15:58:40.933 INFO:tasks.rados.rados.0.smithi033.stdout:644: writing smithi03339061-35 from 0 to 704512 tid 1 2021-07-26T15:58:40.935 INFO:tasks.rados.rados.0.smithi033.stdout:644: writing smithi03339061-35 from 704512 to 1105920 tid 2 2021-07-26T15:58:40.936 INFO:tasks.rados.rados.0.smithi033.stdout:641: done (1 left) 2021-07-26T15:58:40.936 INFO:tasks.rados.rados.0.smithi033.stdout:645: read oid 29 snap -1 2021-07-26T15:58:40.936 INFO:tasks.rados.rados.0.smithi033.stdout:645: expect (ObjNum 158 snap 39 seq_num 158) 2021-07-26T15:58:40.936 INFO:tasks.rados.rados.0.smithi033.stdout:646: delete oid 5 current snap is 55 2021-07-26T15:58:40.938 INFO:tasks.rados.rados.0.smithi033.stdout:644: finishing write tid 1 to smithi03339061-35 2021-07-26T15:58:40.940 INFO:tasks.rados.rados.0.smithi033.stdout:644: finishing write tid 2 to smithi03339061-35 2021-07-26T15:58:40.941 INFO:tasks.rados.rados.0.smithi033.stdout:644: finishing write tid 3 to smithi03339061-35 2021-07-26T15:58:40.944 INFO:tasks.rados.rados.0.smithi033.stdout:646: done (2 left) 2021-07-26T15:58:40.945 INFO:tasks.rados.rados.0.smithi033.stdout:647: read oid 38 snap -1 2021-07-26T15:58:40.945 INFO:tasks.rados.rados.0.smithi033.stdout:647: expect (ObjNum 205 snap 55 seq_num 205) 2021-07-26T15:58:40.945 INFO:tasks.rados.rados.0.smithi033.stdout:648: setattr oid 31 current snap is 55 2021-07-26T15:58:40.945 INFO:tasks.rados.rados.0.smithi033.stdout:644: finishing write tid 4 to smithi03339061-35 2021-07-26T15:58:40.946 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 181 (ObjNum 209 snap 55 seq_num 209) dirty exists 2021-07-26T15:58:40.946 INFO:tasks.rados.rados.0.smithi033.stdout:644: left oid 35 (ObjNum 209 snap 55 seq_num 209) 2021-07-26T15:58:40.957 INFO:tasks.rados.rados.0.smithi033.stdout:645: expect (ObjNum 158 snap 39 seq_num 158) 2021-07-26T15:58:40.959 INFO:tasks.rados.rados.0.smithi033.stdout:644: done (3 left) 2021-07-26T15:58:40.959 INFO:tasks.rados.rados.0.smithi033.stdout:645: done (2 left) 2021-07-26T15:58:40.959 INFO:tasks.rados.rados.0.smithi033.stdout:649: rollback oid 17 current snap is 55 2021-07-26T15:58:40.960 INFO:tasks.rados.rados.0.smithi033.stdout:649: done (2 left) 2021-07-26T15:58:40.960 INFO:tasks.rados.rados.0.smithi033.stdout:650: delete oid 2 current snap is 55 2021-07-26T15:58:40.960 INFO:tasks.rados.rados.0.smithi033.stdout:647: expect (ObjNum 205 snap 55 seq_num 205) 2021-07-26T15:58:41.041 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 35 (ObjNum 202 snap 54 seq_num 202) dirty exists 2021-07-26T15:58:41.042 INFO:tasks.rados.rados.0.smithi033.stdout:647: done (2 left) 2021-07-26T15:58:41.042 INFO:tasks.rados.rados.0.smithi033.stdout:648: done (1 left) 2021-07-26T15:58:41.042 INFO:tasks.rados.rados.0.smithi033.stdout:650: done (0 left) 2021-07-26T15:58:41.043 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 55 2021-07-26T15:58:41.043 INFO:tasks.rados.rados.0.smithi033.stdout:651: seq_num 212 ranges {1245184=753664,1998848=401408} 2021-07-26T15:58:41.058 INFO:tasks.rados.rados.0.smithi033.stdout:651: writing smithi03339061-4 from 1245184 to 1998848 tid 1 2021-07-26T15:58:41.062 INFO:tasks.rados.rados.0.smithi033.stdout:651: writing smithi03339061-4 from 1998848 to 2400256 tid 2 2021-07-26T15:58:41.062 INFO:tasks.rados.rados.0.smithi033.stdout:652: read oid 11 snap -1 2021-07-26T15:58:41.063 INFO:tasks.rados.rados.0.smithi033.stdout:652: expect (ObjNum 194 snap 53 seq_num 194) 2021-07-26T15:58:41.063 INFO:tasks.rados.rados.0.smithi033.stdout:653: read oid 42 snap -1 2021-07-26T15:58:41.064 INFO:tasks.rados.rados.0.smithi033.stdout:653: expect deleted 2021-07-26T15:58:41.064 INFO:tasks.rados.rados.0.smithi033.stdout:654: snap_create 2021-07-26T15:58:41.066 INFO:tasks.rados.rados.0.smithi033.stdout:651: finishing write tid 1 to smithi03339061-4 2021-07-26T15:58:41.067 INFO:tasks.rados.rados.0.smithi033.stdout:651: finishing write tid 2 to smithi03339061-4 2021-07-26T15:58:41.068 INFO:tasks.rados.rados.0.smithi033.stdout:651: finishing write tid 3 to smithi03339061-4 2021-07-26T15:58:41.070 INFO:tasks.rados.rados.0.smithi033.stdout:651: finishing write tid 4 to smithi03339061-4 2021-07-26T15:58:41.070 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 224 (ObjNum 212 snap 55 seq_num 212) dirty exists 2021-07-26T15:58:41.071 INFO:tasks.rados.rados.0.smithi033.stdout:651: left oid 4 (ObjNum 212 snap 55 seq_num 212) 2021-07-26T15:58:41.074 INFO:tasks.rados.rados.0.smithi033.stdout:652: expect (ObjNum 194 snap 53 seq_num 194) 2021-07-26T15:58:41.105 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T15:58:41.208 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:58:40 smithi033 bash[29474]: debug 2021-07-26T15:58:40.950+0000 7f0abb262700 -1 osd.3 pg_epoch: 172 pg[3.bs0( v 172'397 (0'0,172'397] local-lis/les=57/58 n=7 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [3,0,4]p3(0) r=0 lpr=57 luod=171'395 crt=171'395 lcod 171'394 mlcod 171'394 active+clean+snaptrim trimq=[6d~1] ps=[5b~1,6b~1]] removing snap head 2021-07-26T15:58:41.435 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T15:58:41.436 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (5m) 13s ago 5m 14.5M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T15:58:41.436 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (5m) 0s ago 5m 25.5M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T15:58:41.436 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (53s) 0s ago 9m 372M - 17.0.0-6381-gbccf07c2 6cdb40438e66 909ec99bd712 2021-07-26T15:58:41.437 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (73s) 13s ago 12m 408M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T15:58:41.437 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (41s) 13s ago 12m 40.3M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 7649338580a7 2021-07-26T15:58:41.437 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (7s) 0s ago 10m 21.0M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 5a3d2fea4cb3 2021-07-26T15:58:41.437 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (20s) 13s ago 10m 19.7M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 76ce8786552e 2021-07-26T15:58:41.438 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (5m) 13s ago 5m 10.9M - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T15:58:41.438 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (5m) 0s ago 5m 11.3M - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T15:58:41.439 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (9m) 13s ago 9m 89.6M 3553M 16.2.5 34f74fddb18e a4b4ebc84a97 2021-07-26T15:58:41.439 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (9m) 13s ago 9m 77.5M 3553M 16.2.5 34f74fddb18e 35137704568f 2021-07-26T15:58:41.439 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (8m) 13s ago 8m 65.4M 3553M 16.2.5 34f74fddb18e d351359286fd 2021-07-26T15:58:41.439 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (8m) 13s ago 8m 124M 3553M 16.2.5 34f74fddb18e 6b68e9927be6 2021-07-26T15:58:41.440 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (7m) 0s ago 7m 88.5M 3552M 16.2.5 34f74fddb18e 1aac82d5671e 2021-07-26T15:58:41.440 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (7m) 0s ago 7m 83.8M 3552M 16.2.5 34f74fddb18e 12b89782c2eb 2021-07-26T15:58:41.440 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (6m) 0s ago 7m 74.8M 3552M 16.2.5 34f74fddb18e 4fad5a8407d4 2021-07-26T15:58:41.440 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (6m) 0s ago 6m 70.1M 3552M 16.2.5 34f74fddb18e a988c60ad3d5 2021-07-26T15:58:41.440 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (5m) 0s ago 6m 38.1M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T15:58:41.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[41341]: cluster 2021-07-26T15:58:40.332129+0000 mon.a (mon.0) 88 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-07-26T15:58:41.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[41341]: audit 2021-07-26T15:58:40.777085+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:41.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[41341]: audit 2021-07-26T15:58:40.786478+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:41.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[41341]: audit 2021-07-26T15:58:40.791233+0000 mon.c (mon.1) 12 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:41.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[41341]: audit 2021-07-26T15:58:40.792321+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:41.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[41341]: audit 2021-07-26T15:58:40.793350+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:41.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[41341]: cluster 2021-07-26T15:58:40.920838+0000 mon.a (mon.0) 91 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-07-26T15:58:41.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[42377]: cluster 2021-07-26T15:58:40.332129+0000 mon.a (mon.0) 88 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-07-26T15:58:41.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[42377]: audit 2021-07-26T15:58:40.777085+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:41.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[42377]: audit 2021-07-26T15:58:40.786478+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:41.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[42377]: audit 2021-07-26T15:58:40.791233+0000 mon.c (mon.1) 12 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:41.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[42377]: audit 2021-07-26T15:58:40.792321+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:41.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[42377]: audit 2021-07-26T15:58:40.793350+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:41.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:41 smithi033 bash[42377]: cluster 2021-07-26T15:58:40.920838+0000 mon.a (mon.0) 91 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-07-26T15:58:41.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:41 smithi096 bash[33981]: cluster 2021-07-26T15:58:40.332129+0000 mon.a (mon.0) 88 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-07-26T15:58:41.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:41 smithi096 bash[33981]: audit 2021-07-26T15:58:40.777085+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:41.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:41 smithi096 bash[33981]: audit 2021-07-26T15:58:40.786478+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:41.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:41 smithi096 bash[33981]: audit 2021-07-26T15:58:40.791233+0000 mon.c (mon.1) 12 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:41.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:41 smithi096 bash[33981]: audit 2021-07-26T15:58:40.792321+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:41.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:41 smithi096 bash[33981]: audit 2021-07-26T15:58:40.793350+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:41.740 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:41 smithi096 bash[33981]: cluster 2021-07-26T15:58:40.920838+0000 mon.a (mon.0) 91 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-07-26T15:58:41.834 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T15:58:41.835 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T15:58:41.835 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T15:58:41.835 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:58:41.835 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T15:58:41.836 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T15:58:41.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:58:41.836 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T15:58:41.836 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 8 2021-07-26T15:58:41.836 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:58:41.837 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T15:58:41.837 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T15:58:41.837 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 8, 2021-07-26T15:58:41.837 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 5 2021-07-26T15:58:41.837 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T15:58:41.838 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T15:58:41.940 INFO:tasks.rados.rados.0.smithi033.stdout:651: done (3 left) 2021-07-26T15:58:41.941 INFO:tasks.rados.rados.0.smithi033.stdout:652: done (2 left) 2021-07-26T15:58:41.941 INFO:tasks.rados.rados.0.smithi033.stdout:653: done (1 left) 2021-07-26T15:58:41.941 INFO:tasks.rados.rados.0.smithi033.stdout:654: done (0 left) 2021-07-26T15:58:41.941 INFO:tasks.rados.rados.0.smithi033.stdout:655: setattr oid 26 current snap is 56 2021-07-26T15:58:41.943 INFO:tasks.rados.rados.0.smithi033.stdout:656: snap_remove snap 55 2021-07-26T15:58:42.650 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[41341]: cephadm 2021-07-26T15:58:40.790888+0000 mgr.y (mgr.34104) 29 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-07-26T15:58:42.651 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[41341]: cephadm 2021-07-26T15:58:40.794231+0000 mgr.y (mgr.34104) 30 : cephadm [INF] Reconfiguring daemon mon.a on smithi033 2021-07-26T15:58:42.651 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[41341]: cluster 2021-07-26T15:58:40.951535+0000 mgr.y (mgr.34104) 31 : cluster [DBG] pgmap v45: 25 pgs: 25 active+clean; 88 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 20 op/s 2021-07-26T15:58:42.651 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[41341]: audit 2021-07-26T15:58:41.089701+0000 mgr.y (mgr.34104) 32 : audit [DBG] from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:42.652 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[41341]: audit 2021-07-26T15:58:41.415645+0000 mgr.y (mgr.34104) 33 : audit [DBG] from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:42.652 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[41341]: audit 2021-07-26T15:58:41.831849+0000 mon.a (mon.0) 92 : audit [DBG] from='client.? 172.21.15.33:0/1021669749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:42.652 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[41341]: cluster 2021-07-26T15:58:41.938423+0000 mon.a (mon.0) 93 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-07-26T15:58:42.652 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[42377]: cephadm 2021-07-26T15:58:40.790888+0000 mgr.y (mgr.34104) 29 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-07-26T15:58:42.653 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[42377]: cephadm 2021-07-26T15:58:40.794231+0000 mgr.y (mgr.34104) 30 : cephadm [INF] Reconfiguring daemon mon.a on smithi033 2021-07-26T15:58:42.653 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[42377]: cluster 2021-07-26T15:58:40.951535+0000 mgr.y (mgr.34104) 31 : cluster [DBG] pgmap v45: 25 pgs: 25 active+clean; 88 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 20 op/s 2021-07-26T15:58:42.653 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[42377]: audit 2021-07-26T15:58:41.089701+0000 mgr.y (mgr.34104) 32 : audit [DBG] from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:42.653 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[42377]: audit 2021-07-26T15:58:41.415645+0000 mgr.y (mgr.34104) 33 : audit [DBG] from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:42.653 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[42377]: audit 2021-07-26T15:58:41.831849+0000 mon.a (mon.0) 92 : audit [DBG] from='client.? 172.21.15.33:0/1021669749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:42.654 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:42 smithi033 bash[42377]: cluster 2021-07-26T15:58:41.938423+0000 mon.a (mon.0) 93 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-07-26T15:58:42.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:42 smithi096 bash[33981]: cephadm 2021-07-26T15:58:40.790888+0000 mgr.y (mgr.34104) 29 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-07-26T15:58:42.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:42 smithi096 bash[33981]: cephadm 2021-07-26T15:58:40.794231+0000 mgr.y (mgr.34104) 30 : cephadm [INF] Reconfiguring daemon mon.a on smithi033 2021-07-26T15:58:42.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:42 smithi096 bash[33981]: cluster 2021-07-26T15:58:40.951535+0000 mgr.y (mgr.34104) 31 : cluster [DBG] pgmap v45: 25 pgs: 25 active+clean; 88 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.7 MiB/s wr, 20 op/s 2021-07-26T15:58:42.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:42 smithi096 bash[33981]: audit 2021-07-26T15:58:41.089701+0000 mgr.y (mgr.34104) 32 : audit [DBG] from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:42.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:42 smithi096 bash[33981]: audit 2021-07-26T15:58:41.415645+0000 mgr.y (mgr.34104) 33 : audit [DBG] from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:58:42.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:42 smithi096 bash[33981]: audit 2021-07-26T15:58:41.831849+0000 mon.a (mon.0) 92 : audit [DBG] from='client.? 172.21.15.33:0/1021669749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:58:42.739 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:42 smithi096 bash[33981]: cluster 2021-07-26T15:58:41.938423+0000 mon.a (mon.0) 93 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-07-26T15:58:42.945 INFO:tasks.rados.rados.0.smithi033.stdout:656: done (1 left) 2021-07-26T15:58:42.946 INFO:tasks.rados.rados.0.smithi033.stdout:657: delete oid 10 current snap is 56 2021-07-26T15:58:42.946 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 403 (ObjNum 36 snap 0 seq_num 36) dirty exists 2021-07-26T15:58:42.949 INFO:tasks.rados.rados.0.smithi033.stdout:655: done (1 left) 2021-07-26T15:58:42.949 INFO:tasks.rados.rados.0.smithi033.stdout:657: done (0 left) 2021-07-26T15:58:42.949 INFO:tasks.rados.rados.0.smithi033.stdout:658: snap_create 2021-07-26T15:58:43.947 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:43.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:43.947 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:43.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:43.948 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:43.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T15:58:43.950 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[41341]: cluster 2021-07-26T15:58:42.942755+0000 mon.a (mon.0) 94 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-07-26T15:58:43.950 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[41341]: cluster 2021-07-26T15:58:42.951997+0000 mgr.y (mgr.34104) 34 : cluster [DBG] pgmap v48: 25 pgs: 25 active+clean; 88 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.8 MiB/s wr, 20 op/s 2021-07-26T15:58:43.950 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[41341]: audit 2021-07-26T15:58:43.465365+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:43.950 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[41341]: cephadm 2021-07-26T15:58:43.467819+0000 mgr.y (mgr.34104) 35 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-07-26T15:58:43.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[41341]: audit 2021-07-26T15:58:43.468435+0000 mon.c (mon.1) 15 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:58:43.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[41341]: audit 2021-07-26T15:58:43.469115+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:58:43.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[41341]: audit 2021-07-26T15:58:43.471382+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:58:43.951 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[41341]: audit 2021-07-26T15:58:43.473159+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:43.952 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[41341]: cephadm 2021-07-26T15:58:43.474650+0000 mgr.y (mgr.34104) 36 : cephadm [INF] Reconfiguring daemon mgr.y on smithi033 2021-07-26T15:58:43.952 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[42377]: cluster 2021-07-26T15:58:42.942755+0000 mon.a (mon.0) 94 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-07-26T15:58:43.955 INFO:tasks.rados.rados.0.smithi033.stdout:658: done (0 left) 2021-07-26T15:58:43.955 INFO:tasks.rados.rados.0.smithi033.stdout:659: setattr oid 43 current snap is 57 2021-07-26T15:58:43.956 INFO:tasks.rados.rados.0.smithi033.stdout:660: snap_remove snap 56 2021-07-26T15:58:44.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[42377]: cluster 2021-07-26T15:58:42.951997+0000 mgr.y (mgr.34104) 34 : cluster [DBG] pgmap v48: 25 pgs: 25 active+clean; 88 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.8 MiB/s wr, 20 op/s 2021-07-26T15:58:44.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[42377]: audit 2021-07-26T15:58:43.465365+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:44.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[42377]: cephadm 2021-07-26T15:58:43.467819+0000 mgr.y (mgr.34104) 35 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-07-26T15:58:44.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[42377]: audit 2021-07-26T15:58:43.468435+0000 mon.c (mon.1) 15 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:58:44.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[42377]: audit 2021-07-26T15:58:43.469115+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:58:44.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[42377]: audit 2021-07-26T15:58:43.471382+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:58:44.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[42377]: audit 2021-07-26T15:58:43.473159+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:44.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:43 smithi033 bash[42377]: cephadm 2021-07-26T15:58:43.474650+0000 mgr.y (mgr.34104) 36 : cephadm [INF] Reconfiguring daemon mgr.y on smithi033 2021-07-26T15:58:44.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:43 smithi096 bash[33981]: cluster 2021-07-26T15:58:42.942755+0000 mon.a (mon.0) 94 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-07-26T15:58:44.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:43 smithi096 bash[33981]: cluster 2021-07-26T15:58:42.951997+0000 mgr.y (mgr.34104) 34 : cluster [DBG] pgmap v48: 25 pgs: 25 active+clean; 88 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 3.9 MiB/s rd, 1.8 MiB/s wr, 20 op/s 2021-07-26T15:58:44.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:43 smithi096 bash[33981]: audit 2021-07-26T15:58:43.465365+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:44.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:43 smithi096 bash[33981]: cephadm 2021-07-26T15:58:43.467819+0000 mgr.y (mgr.34104) 35 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-07-26T15:58:44.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:43 smithi096 bash[33981]: audit 2021-07-26T15:58:43.468435+0000 mon.c (mon.1) 15 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:58:44.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:43 smithi096 bash[33981]: audit 2021-07-26T15:58:43.469115+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:58:44.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:43 smithi096 bash[33981]: audit 2021-07-26T15:58:43.471382+0000 mon.c (mon.1) 16 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:58:44.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:43 smithi096 bash[33981]: audit 2021-07-26T15:58:43.473159+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:44.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:43 smithi096 bash[33981]: cephadm 2021-07-26T15:58:43.474650+0000 mgr.y (mgr.34104) 36 : cephadm [INF] Reconfiguring daemon mgr.y on smithi033 2021-07-26T15:58:44.954 INFO:tasks.rados.rados.0.smithi033.stdout:660: done (1 left) 2021-07-26T15:58:44.955 INFO:tasks.rados.rados.0.smithi033.stdout:661: read oid 21 snap -1 2021-07-26T15:58:44.955 INFO:tasks.rados.rados.0.smithi033.stdout:661: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:58:44.956 INFO:tasks.rados.rados.0.smithi033.stdout:662: rollback oid 5 current snap is 57 2021-07-26T15:58:44.957 INFO:tasks.rados.rados.0.smithi033.stdout:662: done (2 left) 2021-07-26T15:58:44.957 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 34 current snap is 57 2021-07-26T15:58:44.957 INFO:tasks.rados.rados.0.smithi033.stdout:663: seq_num 214 ranges {0=794624,794624=401408} 2021-07-26T15:58:44.960 INFO:tasks.rados.rados.0.smithi033.stdout:663: writing smithi03339061-34 from 0 to 794624 tid 1 2021-07-26T15:58:44.963 INFO:tasks.rados.rados.0.smithi033.stdout:663: writing smithi03339061-34 from 794624 to 1196032 tid 2 2021-07-26T15:58:44.963 INFO:tasks.rados.rados.0.smithi033.stdout:664: snap_create 2021-07-26T15:58:44.963 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 220 (ObjNum 175 snap 47 seq_num 175) dirty exists 2021-07-26T15:58:44.964 INFO:tasks.rados.rados.0.smithi033.stdout:661: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:58:44.987 INFO:tasks.rados.rados.0.smithi033.stdout:663: finishing write tid 1 to smithi03339061-34 2021-07-26T15:58:44.988 INFO:tasks.rados.rados.0.smithi033.stdout:663: finishing write tid 2 to smithi03339061-34 2021-07-26T15:58:44.988 INFO:tasks.rados.rados.0.smithi033.stdout:663: finishing write tid 3 to smithi03339061-34 2021-07-26T15:58:44.989 INFO:tasks.rados.rados.0.smithi033.stdout:663: finishing write tid 4 to smithi03339061-34 2021-07-26T15:58:44.989 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 92 (ObjNum 214 snap 57 seq_num 214) dirty exists 2021-07-26T15:58:44.989 INFO:tasks.rados.rados.0.smithi033.stdout:663: left oid 34 (ObjNum 214 snap 57 seq_num 214) 2021-07-26T15:58:45.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:44 smithi033 bash[42377]: cluster 2021-07-26T15:58:43.949367+0000 mon.a (mon.0) 97 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-07-26T15:58:45.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:44 smithi033 bash[41341]: cluster 2021-07-26T15:58:43.949367+0000 mon.a (mon.0) 97 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-07-26T15:58:45.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:44 smithi096 bash[33981]: cluster 2021-07-26T15:58:43.949367+0000 mon.a (mon.0) 97 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-07-26T15:58:45.977 INFO:tasks.rados.rados.0.smithi033.stdout:659: done (3 left) 2021-07-26T15:58:45.977 INFO:tasks.rados.rados.0.smithi033.stdout:661: done (2 left) 2021-07-26T15:58:45.978 INFO:tasks.rados.rados.0.smithi033.stdout:663: done (1 left) 2021-07-26T15:58:45.978 INFO:tasks.rados.rados.0.smithi033.stdout:664: done (0 left) 2021-07-26T15:58:45.978 INFO:tasks.rados.rados.0.smithi033.stdout:665: setattr oid 40 current snap is 58 2021-07-26T15:58:45.981 INFO:tasks.rados.rados.0.smithi033.stdout:666: rmattr oid 21 current snap is 58 2021-07-26T15:58:45.981 INFO:tasks.rados.rados.0.smithi033.stdout:667: read oid 22 snap -1 2021-07-26T15:58:45.981 INFO:tasks.rados.rados.0.smithi033.stdout:667: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:58:45.981 INFO:tasks.rados.rados.0.smithi033.stdout:668: snap_create 2021-07-26T15:58:45.985 INFO:tasks.rados.rados.0.smithi033.stdout:667: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:58:45.988 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 178 (ObjNum 197 snap 54 seq_num 197) dirty exists 2021-07-26T15:58:45.989 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 310 (ObjNum 41 snap 0 seq_num 41) dirty exists 2021-07-26T15:58:46.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:45 smithi096 bash[33981]: cluster 2021-07-26T15:58:44.950104+0000 mon.a (mon.0) 98 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-07-26T15:58:46.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:45 smithi096 bash[33981]: cluster 2021-07-26T15:58:44.953159+0000 mgr.y (mgr.34104) 37 : cluster [DBG] pgmap v51: 25 pgs: 25 active+clean; 68 MiB data, 336 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2021-07-26T15:58:46.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:45 smithi096 bash[33981]: audit 2021-07-26T15:58:45.803725+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:46.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:45 smithi096 bash[33981]: audit 2021-07-26T15:58:45.806256+0000 mon.c (mon.1) 18 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:46.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:45 smithi096 bash[33981]: audit 2021-07-26T15:58:45.807793+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:46.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:45 smithi096 bash[33981]: audit 2021-07-26T15:58:45.809469+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:46.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[42377]: cluster 2021-07-26T15:58:44.950104+0000 mon.a (mon.0) 98 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-07-26T15:58:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[42377]: cluster 2021-07-26T15:58:44.953159+0000 mgr.y (mgr.34104) 37 : cluster [DBG] pgmap v51: 25 pgs: 25 active+clean; 68 MiB data, 336 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2021-07-26T15:58:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[42377]: audit 2021-07-26T15:58:45.803725+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[42377]: audit 2021-07-26T15:58:45.806256+0000 mon.c (mon.1) 18 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[42377]: audit 2021-07-26T15:58:45.807793+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:46.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[42377]: audit 2021-07-26T15:58:45.809469+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:46.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[41341]: cluster 2021-07-26T15:58:44.950104+0000 mon.a (mon.0) 98 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-07-26T15:58:46.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[41341]: cluster 2021-07-26T15:58:44.953159+0000 mgr.y (mgr.34104) 37 : cluster [DBG] pgmap v51: 25 pgs: 25 active+clean; 68 MiB data, 336 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.1 MiB/s wr, 26 op/s 2021-07-26T15:58:46.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[41341]: audit 2021-07-26T15:58:45.803725+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:46.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[41341]: audit 2021-07-26T15:58:45.806256+0000 mon.c (mon.1) 18 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:46.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[41341]: audit 2021-07-26T15:58:45.807793+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:46.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:45 smithi033 bash[41341]: audit 2021-07-26T15:58:45.809469+0000 mon.c (mon.1) 20 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:46.989 INFO:tasks.rados.rados.0.smithi033.stdout:665: done (3 left) 2021-07-26T15:58:46.990 INFO:tasks.rados.rados.0.smithi033.stdout:666: done (2 left) 2021-07-26T15:58:46.990 INFO:tasks.rados.rados.0.smithi033.stdout:667: done (1 left) 2021-07-26T15:58:46.990 INFO:tasks.rados.rados.0.smithi033.stdout:668: done (0 left) 2021-07-26T15:58:46.990 INFO:tasks.rados.rados.0.smithi033.stdout:669: snap_remove snap 57 2021-07-26T15:58:47.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:46 smithi096 bash[33981]: cephadm 2021-07-26T15:58:45.805706+0000 mgr.y (mgr.34104) 38 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-07-26T15:58:47.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:46 smithi096 bash[33981]: cephadm 2021-07-26T15:58:45.811137+0000 mgr.y (mgr.34104) 39 : cephadm [INF] Reconfiguring daemon mon.c on smithi033 2021-07-26T15:58:47.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:46 smithi096 bash[33981]: cluster 2021-07-26T15:58:45.974823+0000 mon.a (mon.0) 100 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-07-26T15:58:47.238 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:46 smithi033 bash[41341]: cephadm 2021-07-26T15:58:45.805706+0000 mgr.y (mgr.34104) 38 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-07-26T15:58:47.238 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:46 smithi033 bash[41341]: cephadm 2021-07-26T15:58:45.811137+0000 mgr.y (mgr.34104) 39 : cephadm [INF] Reconfiguring daemon mon.c on smithi033 2021-07-26T15:58:47.238 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:46 smithi033 bash[41341]: cluster 2021-07-26T15:58:45.974823+0000 mon.a (mon.0) 100 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-07-26T15:58:47.239 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:46 smithi033 bash[42377]: cephadm 2021-07-26T15:58:45.805706+0000 mgr.y (mgr.34104) 38 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-07-26T15:58:47.239 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:46 smithi033 bash[42377]: cephadm 2021-07-26T15:58:45.811137+0000 mgr.y (mgr.34104) 39 : cephadm [INF] Reconfiguring daemon mon.c on smithi033 2021-07-26T15:58:47.240 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:46 smithi033 bash[42377]: cluster 2021-07-26T15:58:45.974823+0000 mon.a (mon.0) 100 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-07-26T15:58:47.994 INFO:tasks.rados.rados.0.smithi033.stdout:669: done (0 left) 2021-07-26T15:58:47.994 INFO:tasks.rados.rados.0.smithi033.stdout:670: snap_create 2021-07-26T15:58:48.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:47 smithi033 bash[42377]: cluster 2021-07-26T15:58:46.953794+0000 mgr.y (mgr.34104) 40 : cluster [DBG] pgmap v53: 25 pgs: 25 active+clean; 66 MiB data, 334 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2021-07-26T15:58:48.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:47 smithi033 bash[42377]: cluster 2021-07-26T15:58:46.986833+0000 mon.a (mon.0) 101 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-07-26T15:58:48.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:47 smithi033 bash[42377]: audit 2021-07-26T15:58:47.967973+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:47 smithi033 bash[41341]: cluster 2021-07-26T15:58:46.953794+0000 mgr.y (mgr.34104) 40 : cluster [DBG] pgmap v53: 25 pgs: 25 active+clean; 66 MiB data, 334 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2021-07-26T15:58:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:47 smithi033 bash[41341]: cluster 2021-07-26T15:58:46.986833+0000 mon.a (mon.0) 101 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-07-26T15:58:48.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:47 smithi033 bash[41341]: audit 2021-07-26T15:58:47.967973+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:48.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:47 smithi096 bash[33981]: cluster 2021-07-26T15:58:46.953794+0000 mgr.y (mgr.34104) 40 : cluster [DBG] pgmap v53: 25 pgs: 25 active+clean; 66 MiB data, 334 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2021-07-26T15:58:48.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:47 smithi096 bash[33981]: cluster 2021-07-26T15:58:46.986833+0000 mon.a (mon.0) 101 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-07-26T15:58:48.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:47 smithi096 bash[33981]: audit 2021-07-26T15:58:47.967973+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:49.005 INFO:tasks.rados.rados.0.smithi033.stdout:670: done (0 left) 2021-07-26T15:58:49.005 INFO:tasks.rados.rados.0.smithi033.stdout:671: read oid 1 snap -1 2021-07-26T15:58:49.006 INFO:tasks.rados.rados.0.smithi033.stdout:671: expect deleted 2021-07-26T15:58:49.006 INFO:tasks.rados.rados.0.smithi033.stdout:672: rollback oid 50 current snap is 60 2021-07-26T15:58:49.006 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 50 to 59 2021-07-26T15:58:49.006 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 60 2021-07-26T15:58:49.007 INFO:tasks.rados.rados.0.smithi033.stdout:673: seq_num 215 ranges {0=409600,409600=532480,942080=270336} 2021-07-26T15:58:49.010 INFO:tasks.rados.rados.0.smithi033.stdout:673: writing smithi03339061-22 from 0 to 409600 tid 1 2021-07-26T15:58:49.014 INFO:tasks.rados.rados.0.smithi033.stdout:673: writing smithi03339061-22 from 409600 to 942080 tid 2 2021-07-26T15:58:49.017 INFO:tasks.rados.rados.0.smithi033.stdout:673: writing smithi03339061-22 from 942080 to 1212416 tid 3 2021-07-26T15:58:49.017 INFO:tasks.rados.rados.0.smithi033.stdout:674: read oid 9 snap -1 2021-07-26T15:58:49.017 INFO:tasks.rados.rados.0.smithi033.stdout:674: expect (ObjNum 122 snap 28 seq_num 122) 2021-07-26T15:58:49.018 INFO:tasks.rados.rados.0.smithi033.stdout:672: finishing rollback tid 0 to smithi03339061-50 2021-07-26T15:58:49.018 INFO:tasks.rados.rados.0.smithi033.stdout:672: finishing rollback tid 1 to smithi03339061-50 2021-07-26T15:58:49.018 INFO:tasks.rados.rados.0.smithi033.stdout:672: finishing rollback tid 2 to smithi03339061-50 2021-07-26T15:58:49.019 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 188 (ObjNum 187 snap 49 seq_num 187) dirty exists 2021-07-26T15:58:49.019 INFO:tasks.rados.rados.0.smithi033.stdout:671: done (3 left) 2021-07-26T15:58:49.019 INFO:tasks.rados.rados.0.smithi033.stdout:672: done (2 left) 2021-07-26T15:58:49.019 INFO:tasks.rados.rados.0.smithi033.stdout:675: delete oid 43 current snap is 60 2021-07-26T15:58:49.023 INFO:tasks.rados.rados.0.smithi033.stdout:673: finishing write tid 1 to smithi03339061-22 2021-07-26T15:58:49.026 INFO:tasks.rados.rados.0.smithi033.stdout:673: finishing write tid 2 to smithi03339061-22 2021-07-26T15:58:49.027 INFO:tasks.rados.rados.0.smithi033.stdout:673: finishing write tid 3 to smithi03339061-22 2021-07-26T15:58:49.027 INFO:tasks.rados.rados.0.smithi033.stdout:673: finishing write tid 4 to smithi03339061-22 2021-07-26T15:58:49.027 INFO:tasks.rados.rados.0.smithi033.stdout:675: done (2 left) 2021-07-26T15:58:49.027 INFO:tasks.rados.rados.0.smithi033.stdout:676: read oid 27 snap -1 2021-07-26T15:58:49.028 INFO:tasks.rados.rados.0.smithi033.stdout:676: expect (ObjNum 133 snap 33 seq_num 133) 2021-07-26T15:58:49.028 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 60 2021-07-26T15:58:49.028 INFO:tasks.rados.rados.0.smithi033.stdout:677: seq_num 217 ranges {0=442368,442368=696320,1138688=106496} 2021-07-26T15:58:49.029 INFO:tasks.rados.rados.0.smithi033.stdout:677: writing smithi03339061-10 from 0 to 442368 tid 1 2021-07-26T15:58:49.032 INFO:tasks.rados.rados.0.smithi033.stdout:677: writing smithi03339061-10 from 442368 to 1138688 tid 2 2021-07-26T15:58:49.033 INFO:tasks.rados.rados.0.smithi033.stdout:677: writing smithi03339061-10 from 1138688 to 1245184 tid 3 2021-07-26T15:58:49.034 INFO:tasks.rados.rados.0.smithi033.stdout:678: read oid 24 snap 59 2021-07-26T15:58:49.034 INFO:tasks.rados.rados.0.smithi033.stdout:678: expect (ObjNum 192 snap 53 seq_num 192) 2021-07-26T15:58:49.034 INFO:tasks.rados.rados.0.smithi033.stdout:679: copy_from oid 46 from oid 17 current snap is 60 2021-07-26T15:58:49.034 INFO:tasks.rados.rados.0.smithi033.stdout:673: finishing write tid 5 to smithi03339061-22 2021-07-26T15:58:49.035 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 410 (ObjNum 215 snap 60 seq_num 215) dirty exists 2021-07-26T15:58:49.035 INFO:tasks.rados.rados.0.smithi033.stdout:673: left oid 22 (ObjNum 215 snap 60 seq_num 215) 2021-07-26T15:58:49.035 INFO:tasks.rados.rados.0.smithi033.stdout:673: done (5 left) 2021-07-26T15:58:49.036 INFO:tasks.rados.rados.0.smithi033.stdout:680: copy_from oid 47 from oid 48 current snap is 60 2021-07-26T15:58:49.036 INFO:tasks.rados.rados.0.smithi033.stdout:681: setattr oid 12 current snap is 60 2021-07-26T15:58:49.039 INFO:tasks.rados.rados.0.smithi033.stdout:682: rollback oid 18 current snap is 60 2021-07-26T15:58:49.039 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 18 to 59 2021-07-26T15:58:49.039 INFO:tasks.rados.rados.0.smithi033.stdout:683: copy_from oid 33 from oid 2 current snap is 60 2021-07-26T15:58:49.040 INFO:tasks.rados.rados.0.smithi033.stdout:684: read oid 34 snap -1 2021-07-26T15:58:49.040 INFO:tasks.rados.rados.0.smithi033.stdout:684: expect (ObjNum 214 snap 57 seq_num 214) 2021-07-26T15:58:49.040 INFO:tasks.rados.rados.0.smithi033.stdout:685: copy_from oid 23 from oid 15 current snap is 60 2021-07-26T15:58:49.040 INFO:tasks.rados.rados.0.smithi033.stdout:686: delete oid 14 current snap is 60 2021-07-26T15:58:49.041 INFO:tasks.rados.rados.0.smithi033.stdout:677: finishing write tid 1 to smithi03339061-10 2021-07-26T15:58:49.041 INFO:tasks.rados.rados.0.smithi033.stdout:674: expect (ObjNum 122 snap 28 seq_num 122) 2021-07-26T15:58:49.161 INFO:tasks.rados.rados.0.smithi033.stdout:674: done (11 left) 2021-07-26T15:58:49.161 INFO:tasks.rados.rados.0.smithi033.stdout:686: done (10 left) 2021-07-26T15:58:49.161 INFO:tasks.rados.rados.0.smithi033.stdout:687: read oid 28 snap -1 2021-07-26T15:58:49.162 INFO:tasks.rados.rados.0.smithi033.stdout:687: expect deleted 2021-07-26T15:58:49.162 INFO:tasks.rados.rados.0.smithi033.stdout:688: read oid 49 snap 59 2021-07-26T15:58:49.162 INFO:tasks.rados.rados.0.smithi033.stdout:688: expect (ObjNum 161 snap 39 seq_num 161) 2021-07-26T15:58:49.162 INFO:tasks.rados.rados.0.smithi033.stdout:689: rollback oid 40 current snap is 60 2021-07-26T15:58:49.163 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 40 to 59 2021-07-26T15:58:49.163 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 176 (ObjNum 137 snap 34 seq_num 137) dirty exists 2021-07-26T15:58:49.163 INFO:tasks.rados.rados.0.smithi033.stdout:684: expect (ObjNum 214 snap 57 seq_num 214) 2021-07-26T15:58:49.193 INFO:tasks.rados.rados.0.smithi033.stdout:679: finishing copy_from to smithi03339061-46 2021-07-26T15:58:49.194 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 174 (ObjNum 167 snap 44 seq_num 167) dirty exists 2021-07-26T15:58:49.194 INFO:tasks.rados.rados.0.smithi033.stdout:679: finishing copy_from racing read to smithi03339061-46 2021-07-26T15:58:49.194 INFO:tasks.rados.rados.0.smithi033.stdout:676: expect (ObjNum 133 snap 33 seq_num 133) 2021-07-26T15:58:49.264 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:49 smithi033 bash[42377]: cephadm 2021-07-26T15:58:47.972400+0000 mgr.y (mgr.34104) 41 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-07-26T15:58:49.265 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:49 smithi033 bash[42377]: cephadm 2021-07-26T15:58:47.973610+0000 mgr.y (mgr.34104) 42 : cephadm [INF] Reconfiguring daemon osd.0 on smithi033 2021-07-26T15:58:49.265 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:49 smithi033 bash[42377]: cluster 2021-07-26T15:58:47.989874+0000 mon.a (mon.0) 103 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-07-26T15:58:49.265 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:49 smithi033 bash[41341]: cephadm 2021-07-26T15:58:47.972400+0000 mgr.y (mgr.34104) 41 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-07-26T15:58:49.265 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:49 smithi033 bash[41341]: cephadm 2021-07-26T15:58:47.973610+0000 mgr.y (mgr.34104) 42 : cephadm [INF] Reconfiguring daemon osd.0 on smithi033 2021-07-26T15:58:49.266 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:49 smithi033 bash[41341]: cluster 2021-07-26T15:58:47.989874+0000 mon.a (mon.0) 103 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-07-26T15:58:49.371 INFO:tasks.rados.rados.0.smithi033.stdout:680: finishing copy_from to smithi03339061-47 2021-07-26T15:58:49.371 INFO:tasks.rados.rados.0.smithi033.stdout:680: got expected ENOENT (src dne) 2021-07-26T15:58:49.372 INFO:tasks.rados.rados.0.smithi033.stdout:683: finishing copy_from to smithi03339061-33 2021-07-26T15:58:49.372 INFO:tasks.rados.rados.0.smithi033.stdout:683: got expected ENOENT (src dne) 2021-07-26T15:58:49.372 INFO:tasks.rados.rados.0.smithi033.stdout:680: finishing copy_from racing read to smithi03339061-47 2021-07-26T15:58:49.372 INFO:tasks.rados.rados.0.smithi033.stdout:683: finishing copy_from racing read to smithi03339061-33 2021-07-26T15:58:49.373 INFO:tasks.rados.rados.0.smithi033.stdout:682: finishing rollback tid 0 to smithi03339061-18 2021-07-26T15:58:49.373 INFO:tasks.rados.rados.0.smithi033.stdout:682: finishing rollback tid 1 to smithi03339061-18 2021-07-26T15:58:49.373 INFO:tasks.rados.rados.0.smithi033.stdout:677: finishing write tid 2 to smithi03339061-10 2021-07-26T15:58:49.373 INFO:tasks.rados.rados.0.smithi033.stdout:682: finishing rollback tid 2 to smithi03339061-18 2021-07-26T15:58:49.374 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 414 (ObjNum 181 snap 47 seq_num 181) dirty exists 2021-07-26T15:58:49.374 INFO:tasks.rados.rados.0.smithi033.stdout:676: done (12 left) 2021-07-26T15:58:49.374 INFO:tasks.rados.rados.0.smithi033.stdout:679: done (11 left) 2021-07-26T15:58:49.374 INFO:tasks.rados.rados.0.smithi033.stdout:680: done (10 left) 2021-07-26T15:58:49.374 INFO:tasks.rados.rados.0.smithi033.stdout:681: done (9 left) 2021-07-26T15:58:49.375 INFO:tasks.rados.rados.0.smithi033.stdout:682: done (8 left) 2021-07-26T15:58:49.375 INFO:tasks.rados.rados.0.smithi033.stdout:683: done (7 left) 2021-07-26T15:58:49.375 INFO:tasks.rados.rados.0.smithi033.stdout:684: done (6 left) 2021-07-26T15:58:49.375 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 60 2021-07-26T15:58:49.375 INFO:tasks.rados.rados.0.smithi033.stdout:677: finishing write tid 3 to smithi03339061-10 2021-07-26T15:58:49.376 INFO:tasks.rados.rados.0.smithi033.stdout:677: finishing write tid 4 to smithi03339061-10 2021-07-26T15:58:49.376 INFO:tasks.rados.rados.0.smithi033.stdout:678: expect (ObjNum 192 snap 53 seq_num 192) 2021-07-26T15:58:49.467 INFO:tasks.rados.rados.0.smithi033.stdout:677: finishing write tid 5 to smithi03339061-10 2021-07-26T15:58:49.468 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 219 (ObjNum 217 snap 60 seq_num 217) dirty exists 2021-07-26T15:58:49.468 INFO:tasks.rados.rados.0.smithi033.stdout:677: left oid 10 (ObjNum 217 snap 60 seq_num 217) 2021-07-26T15:58:49.468 INFO:tasks.rados.rados.0.smithi033.stdout:685: finishing copy_from to smithi03339061-23 2021-07-26T15:58:49.469 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 152 (ObjNum 157 snap 39 seq_num 157) dirty exists 2021-07-26T15:58:49.469 INFO:tasks.rados.rados.0.smithi033.stdout:685: finishing copy_from racing read to smithi03339061-23 2021-07-26T15:58:49.469 INFO:tasks.rados.rados.0.smithi033.stdout:690: seq_num 219 ranges {4513792=475136,4988928=466944,5455872=335872} 2021-07-26T15:58:49.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:49 smithi096 bash[33981]: cephadm 2021-07-26T15:58:47.972400+0000 mgr.y (mgr.34104) 41 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2021-07-26T15:58:49.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:49 smithi096 bash[33981]: cephadm 2021-07-26T15:58:47.973610+0000 mgr.y (mgr.34104) 42 : cephadm [INF] Reconfiguring daemon osd.0 on smithi033 2021-07-26T15:58:49.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:49 smithi096 bash[33981]: cluster 2021-07-26T15:58:47.989874+0000 mon.a (mon.0) 103 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-07-26T15:58:49.496 INFO:tasks.rados.rados.0.smithi033.stdout:690: writing smithi03339061-27 from 4513792 to 4988928 tid 1 2021-07-26T15:58:49.499 INFO:tasks.rados.rados.0.smithi033.stdout:690: writing smithi03339061-27 from 4988928 to 5455872 tid 2 2021-07-26T15:58:49.501 INFO:tasks.rados.rados.0.smithi033.stdout:690: writing smithi03339061-27 from 5455872 to 5791744 tid 3 2021-07-26T15:58:49.501 INFO:tasks.rados.rados.0.smithi033.stdout:677: done (6 left) 2021-07-26T15:58:49.502 INFO:tasks.rados.rados.0.smithi033.stdout:678: done (5 left) 2021-07-26T15:58:49.502 INFO:tasks.rados.rados.0.smithi033.stdout:685: done (4 left) 2021-07-26T15:58:49.502 INFO:tasks.rados.rados.0.smithi033.stdout:691: copy_from oid 33 from oid 45 current snap is 60 2021-07-26T15:58:49.502 INFO:tasks.rados.rados.0.smithi033.stdout:688: expect (ObjNum 161 snap 39 seq_num 161) 2021-07-26T15:58:49.516 INFO:tasks.rados.rados.0.smithi033.stdout:689: finishing rollback tid 0 to smithi03339061-40 2021-07-26T15:58:49.516 INFO:tasks.rados.rados.0.smithi033.stdout:689: finishing rollback tid 1 to smithi03339061-40 2021-07-26T15:58:49.516 INFO:tasks.rados.rados.0.smithi033.stdout:689: finishing rollback tid 2 to smithi03339061-40 2021-07-26T15:58:49.517 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 181 (ObjNum 197 snap 54 seq_num 197) dirty exists 2021-07-26T15:58:49.517 INFO:tasks.rados.rados.0.smithi033.stdout:687: done (4 left) 2021-07-26T15:58:49.517 INFO:tasks.rados.rados.0.smithi033.stdout:688: done (3 left) 2021-07-26T15:58:49.517 INFO:tasks.rados.rados.0.smithi033.stdout:689: done (2 left) 2021-07-26T15:58:49.517 INFO:tasks.rados.rados.0.smithi033.stdout:692: read oid 42 snap -1 2021-07-26T15:58:49.518 INFO:tasks.rados.rados.0.smithi033.stdout:692: expect deleted 2021-07-26T15:58:49.518 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 60 2021-07-26T15:58:49.518 INFO:tasks.rados.rados.0.smithi033.stdout:693: seq_num 220 ranges {0=491520,491520=753664,1245184=49152} 2021-07-26T15:58:49.519 INFO:tasks.rados.rados.0.smithi033.stdout:693: writing smithi03339061-2 from 0 to 491520 tid 1 2021-07-26T15:58:49.522 INFO:tasks.rados.rados.0.smithi033.stdout:693: writing smithi03339061-2 from 491520 to 1245184 tid 2 2021-07-26T15:58:49.525 INFO:tasks.rados.rados.0.smithi033.stdout:693: writing smithi03339061-2 from 1245184 to 1294336 tid 3 2021-07-26T15:58:49.525 INFO:tasks.rados.rados.0.smithi033.stdout:694: setattr oid 11 current snap is 60 2021-07-26T15:58:49.525 INFO:tasks.rados.rados.0.smithi033.stdout:691: finishing copy_from to smithi03339061-33 2021-07-26T15:58:49.526 INFO:tasks.rados.rados.0.smithi033.stdout:691: got expected ENOENT (src dne) 2021-07-26T15:58:49.526 INFO:tasks.rados.rados.0.smithi033.stdout:691: finishing copy_from racing read to smithi03339061-33 2021-07-26T15:58:49.526 INFO:tasks.rados.rados.0.smithi033.stdout:690: finishing write tid 1 to smithi03339061-27 2021-07-26T15:58:49.526 INFO:tasks.rados.rados.0.smithi033.stdout:690: finishing write tid 2 to smithi03339061-27 2021-07-26T15:58:49.527 INFO:tasks.rados.rados.0.smithi033.stdout:690: finishing write tid 3 to smithi03339061-27 2021-07-26T15:58:49.527 INFO:tasks.rados.rados.0.smithi033.stdout:690: finishing write tid 4 to smithi03339061-27 2021-07-26T15:58:49.527 INFO:tasks.rados.rados.0.smithi033.stdout:690: finishing write tid 5 to smithi03339061-27 2021-07-26T15:58:49.527 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 319 (ObjNum 219 snap 60 seq_num 219) dirty exists 2021-07-26T15:58:49.528 INFO:tasks.rados.rados.0.smithi033.stdout:690: left oid 27 (ObjNum 219 snap 60 seq_num 219) 2021-07-26T15:58:49.528 INFO:tasks.rados.rados.0.smithi033.stdout:693: finishing write tid 1 to smithi03339061-2 2021-07-26T15:58:49.528 INFO:tasks.rados.rados.0.smithi033.stdout:690: done (4 left) 2021-07-26T15:58:49.528 INFO:tasks.rados.rados.0.smithi033.stdout:691: done (3 left) 2021-07-26T15:58:49.528 INFO:tasks.rados.rados.0.smithi033.stdout:692: done (2 left) 2021-07-26T15:58:49.529 INFO:tasks.rados.rados.0.smithi033.stdout:695: snap_create 2021-07-26T15:58:49.529 INFO:tasks.rados.rados.0.smithi033.stdout:693: finishing write tid 2 to smithi03339061-2 2021-07-26T15:58:49.530 INFO:tasks.rados.rados.0.smithi033.stdout:693: finishing write tid 3 to smithi03339061-2 2021-07-26T15:58:49.532 INFO:tasks.rados.rados.0.smithi033.stdout:693: finishing write tid 4 to smithi03339061-2 2021-07-26T15:58:49.532 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 94 (ObjNum 194 snap 53 seq_num 194) dirty exists 2021-07-26T15:58:49.535 INFO:tasks.rados.rados.0.smithi033.stdout:693: finishing write tid 5 to smithi03339061-2 2021-07-26T15:58:49.536 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 180 (ObjNum 220 snap 60 seq_num 220) dirty exists 2021-07-26T15:58:49.536 INFO:tasks.rados.rados.0.smithi033.stdout:693: left oid 2 (ObjNum 220 snap 60 seq_num 220) 2021-07-26T15:58:50.021 INFO:tasks.rados.rados.0.smithi033.stdout:693: done (2 left) 2021-07-26T15:58:50.022 INFO:tasks.rados.rados.0.smithi033.stdout:694: done (1 left) 2021-07-26T15:58:50.022 INFO:tasks.rados.rados.0.smithi033.stdout:695: done (0 left) 2021-07-26T15:58:50.023 INFO:tasks.rados.rados.0.smithi033.stdout:696: snap_create 2021-07-26T15:58:50.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:50 smithi033 bash[41341]: cluster 2021-07-26T15:58:48.954497+0000 mgr.y (mgr.34104) 43 : cluster [DBG] pgmap v56: 25 pgs: 25 active+clean; 66 MiB data, 334 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2021-07-26T15:58:50.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:50 smithi033 bash[41341]: cluster 2021-07-26T15:58:49.002231+0000 mon.a (mon.0) 104 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-07-26T15:58:50.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:50 smithi033 bash[42377]: cluster 2021-07-26T15:58:48.954497+0000 mgr.y (mgr.34104) 43 : cluster [DBG] pgmap v56: 25 pgs: 25 active+clean; 66 MiB data, 334 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2021-07-26T15:58:50.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:50 smithi033 bash[42377]: cluster 2021-07-26T15:58:49.002231+0000 mon.a (mon.0) 104 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-07-26T15:58:50.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:50 smithi096 bash[33981]: cluster 2021-07-26T15:58:48.954497+0000 mgr.y (mgr.34104) 43 : cluster [DBG] pgmap v56: 25 pgs: 25 active+clean; 66 MiB data, 334 MiB used, 715 GiB / 715 GiB avail; 3.8 MiB/s rd, 1.7 MiB/s wr, 28 op/s 2021-07-26T15:58:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:50 smithi096 bash[33981]: cluster 2021-07-26T15:58:49.002231+0000 mon.a (mon.0) 104 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-07-26T15:58:50.932 INFO:tasks.rados.rados.0.smithi033.stdout:696: done (0 left) 2021-07-26T15:58:50.933 INFO:tasks.rados.rados.0.smithi033.stdout:697: copy_from oid 22 from oid 47 current snap is 62 2021-07-26T15:58:50.933 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 62 2021-07-26T15:58:50.934 INFO:tasks.rados.rados.0.smithi033.stdout:698: seq_num 221 ranges {5791744=507904,6299648=688128,6987776=114688} 2021-07-26T15:58:50.971 INFO:tasks.rados.rados.0.smithi033.stdout:698: writing smithi03339061-27 from 5791744 to 6299648 tid 1 2021-07-26T15:58:50.975 INFO:tasks.rados.rados.0.smithi033.stdout:698: writing smithi03339061-27 from 6299648 to 6987776 tid 2 2021-07-26T15:58:50.977 INFO:tasks.rados.rados.0.smithi033.stdout:698: writing smithi03339061-27 from 6987776 to 7102464 tid 3 2021-07-26T15:58:50.977 INFO:tasks.rados.rados.0.smithi033.stdout:699: snap_create 2021-07-26T15:58:50.977 INFO:tasks.rados.rados.0.smithi033.stdout:697: finishing copy_from to smithi03339061-22 2021-07-26T15:58:50.978 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 197 (ObjNum 2007483808 snap 22002 seq_num 0) dirty exists 2021-07-26T15:58:50.978 INFO:tasks.rados.rados.0.smithi033.stdout:697: finishing copy_from racing read to smithi03339061-22 2021-07-26T15:58:50.983 INFO:tasks.rados.rados.0.smithi033.stdout:698: finishing write tid 1 to smithi03339061-27 2021-07-26T15:58:50.984 INFO:tasks.rados.rados.0.smithi033.stdout:698: finishing write tid 2 to smithi03339061-27 2021-07-26T15:58:50.985 INFO:tasks.rados.rados.0.smithi033.stdout:698: finishing write tid 3 to smithi03339061-27 2021-07-26T15:58:50.986 INFO:tasks.rados.rados.0.smithi033.stdout:698: finishing write tid 4 to smithi03339061-27 2021-07-26T15:58:50.989 INFO:tasks.rados.rados.0.smithi033.stdout:698: finishing write tid 5 to smithi03339061-27 2021-07-26T15:58:50.989 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 324 (ObjNum 221 snap 62 seq_num 221) dirty exists 2021-07-26T15:58:50.989 INFO:tasks.rados.rados.0.smithi033.stdout:698: left oid 27 (ObjNum 221 snap 62 seq_num 221) 2021-07-26T15:58:51.358 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:51 smithi033 bash[41341]: cluster 2021-07-26T15:58:50.017575+0000 mon.a (mon.0) 105 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-07-26T15:58:51.358 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:51 smithi033 bash[41341]: audit 2021-07-26T15:58:50.198809+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:51.359 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:51 smithi033 bash[41341]: cephadm 2021-07-26T15:58:50.201133+0000 mgr.y (mgr.34104) 44 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-07-26T15:58:51.359 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:51 smithi033 bash[41341]: cephadm 2021-07-26T15:58:50.202610+0000 mgr.y (mgr.34104) 45 : cephadm [INF] Reconfiguring daemon osd.1 on smithi033 2021-07-26T15:58:51.360 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:51 smithi033 bash[41341]: cluster 2021-07-26T15:58:50.927161+0000 mon.a (mon.0) 107 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-07-26T15:58:51.360 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:51 smithi033 bash[42377]: cluster 2021-07-26T15:58:50.017575+0000 mon.a (mon.0) 105 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-07-26T15:58:51.361 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:51 smithi033 bash[42377]: audit 2021-07-26T15:58:50.198809+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:51.361 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:51 smithi033 bash[42377]: cephadm 2021-07-26T15:58:50.201133+0000 mgr.y (mgr.34104) 44 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-07-26T15:58:51.363 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:51 smithi033 bash[42377]: cephadm 2021-07-26T15:58:50.202610+0000 mgr.y (mgr.34104) 45 : cephadm [INF] Reconfiguring daemon osd.1 on smithi033 2021-07-26T15:58:51.363 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:51 smithi033 bash[42377]: cluster 2021-07-26T15:58:50.927161+0000 mon.a (mon.0) 107 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-07-26T15:58:51.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:51 smithi096 bash[33981]: cluster 2021-07-26T15:58:50.017575+0000 mon.a (mon.0) 105 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-07-26T15:58:51.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:51 smithi096 bash[33981]: audit 2021-07-26T15:58:50.198809+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:51.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:51 smithi096 bash[33981]: cephadm 2021-07-26T15:58:50.201133+0000 mgr.y (mgr.34104) 44 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2021-07-26T15:58:51.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:51 smithi096 bash[33981]: cephadm 2021-07-26T15:58:50.202610+0000 mgr.y (mgr.34104) 45 : cephadm [INF] Reconfiguring daemon osd.1 on smithi033 2021-07-26T15:58:51.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:51 smithi096 bash[33981]: cluster 2021-07-26T15:58:50.927161+0000 mon.a (mon.0) 107 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-07-26T15:58:51.952 INFO:tasks.rados.rados.0.smithi033.stdout:697: done (2 left) 2021-07-26T15:58:51.953 INFO:tasks.rados.rados.0.smithi033.stdout:698: done (1 left) 2021-07-26T15:58:51.954 INFO:tasks.rados.rados.0.smithi033.stdout:699: done (0 left) 2021-07-26T15:58:51.954 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 63 2021-07-26T15:58:51.954 INFO:tasks.rados.rados.0.smithi033.stdout:700: seq_num 222 ranges {1105920=524288,1630208=565248,2195456=237568} 2021-07-26T15:58:51.967 INFO:tasks.rados.rados.0.smithi033.stdout:700: writing smithi03339061-35 from 1105920 to 1630208 tid 1 2021-07-26T15:58:51.970 INFO:tasks.rados.rados.0.smithi033.stdout:700: writing smithi03339061-35 from 1630208 to 2195456 tid 2 2021-07-26T15:58:51.971 INFO:tasks.rados.rados.0.smithi033.stdout:700: writing smithi03339061-35 from 2195456 to 2433024 tid 3 2021-07-26T15:58:51.972 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 63 2021-07-26T15:58:51.972 INFO:tasks.rados.rados.0.smithi033.stdout:701: seq_num 223 ranges {6217728=540672,6758400=450560,7208960=352256} 2021-07-26T15:58:52.010 INFO:tasks.rados.rados.0.smithi033.stdout:701: writing smithi03339061-40 from 6217728 to 6758400 tid 1 2021-07-26T15:58:52.012 INFO:tasks.rados.rados.0.smithi033.stdout:701: writing smithi03339061-40 from 6758400 to 7208960 tid 2 2021-07-26T15:58:52.015 INFO:tasks.rados.rados.0.smithi033.stdout:701: writing smithi03339061-40 from 7208960 to 7561216 tid 3 2021-07-26T15:58:52.016 INFO:tasks.rados.rados.0.smithi033.stdout:702: read oid 22 snap -1 2021-07-26T15:58:52.016 INFO:tasks.rados.rados.0.smithi033.stdout:702: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:58:52.016 INFO:tasks.rados.rados.0.smithi033.stdout:703: delete oid 31 current snap is 63 2021-07-26T15:58:52.016 INFO:tasks.rados.rados.0.smithi033.stdout:700: finishing write tid 1 to smithi03339061-35 2021-07-26T15:58:52.016 INFO:tasks.rados.rados.0.smithi033.stdout:700: finishing write tid 2 to smithi03339061-35 2021-07-26T15:58:52.017 INFO:tasks.rados.rados.0.smithi033.stdout:700: finishing write tid 3 to smithi03339061-35 2021-07-26T15:58:52.017 INFO:tasks.rados.rados.0.smithi033.stdout:700: finishing write tid 4 to smithi03339061-35 2021-07-26T15:58:52.017 INFO:tasks.rados.rados.0.smithi033.stdout:700: finishing write tid 5 to smithi03339061-35 2021-07-26T15:58:52.017 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 186 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:58:52.017 INFO:tasks.rados.rados.0.smithi033.stdout:700: left oid 35 (ObjNum 222 snap 63 seq_num 222) 2021-07-26T15:58:52.018 INFO:tasks.rados.rados.0.smithi033.stdout:702: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:58:52.026 INFO:tasks.rados.rados.0.smithi033.stdout:700: done (3 left) 2021-07-26T15:58:52.026 INFO:tasks.rados.rados.0.smithi033.stdout:702: done (2 left) 2021-07-26T15:58:52.026 INFO:tasks.rados.rados.0.smithi033.stdout:703: done (1 left) 2021-07-26T15:58:52.026 INFO:tasks.rados.rados.0.smithi033.stdout:704: read oid 17 snap -1 2021-07-26T15:58:52.026 INFO:tasks.rados.rados.0.smithi033.stdout:704: expect (ObjNum 167 snap 44 seq_num 167) 2021-07-26T15:58:52.027 INFO:tasks.rados.rados.0.smithi033.stdout:705: rollback oid 4 current snap is 63 2021-07-26T15:58:52.027 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 4 to 61 2021-07-26T15:58:52.027 INFO:tasks.rados.rados.0.smithi033.stdout:706: read oid 20 snap -1 2021-07-26T15:58:52.027 INFO:tasks.rados.rados.0.smithi033.stdout:706: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:58:52.028 INFO:tasks.rados.rados.0.smithi033.stdout:707: copy_from oid 21 from oid 47 current snap is 63 2021-07-26T15:58:52.028 INFO:tasks.rados.rados.0.smithi033.stdout:708: snap_remove snap 62 2021-07-26T15:58:52.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:52 smithi033 bash[41341]: cluster 2021-07-26T15:58:50.955039+0000 mgr.y (mgr.34104) 46 : cluster [DBG] pgmap v60: 25 pgs: 25 active+clean; 77 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2021-07-26T15:58:52.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:52 smithi033 bash[41341]: cluster 2021-07-26T15:58:51.947641+0000 mon.a (mon.0) 108 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-07-26T15:58:52.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:52 smithi033 bash[42377]: cluster 2021-07-26T15:58:50.955039+0000 mgr.y (mgr.34104) 46 : cluster [DBG] pgmap v60: 25 pgs: 25 active+clean; 77 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2021-07-26T15:58:52.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:52 smithi033 bash[42377]: cluster 2021-07-26T15:58:51.947641+0000 mon.a (mon.0) 108 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-07-26T15:58:52.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:52 smithi096 bash[33981]: cluster 2021-07-26T15:58:50.955039+0000 mgr.y (mgr.34104) 46 : cluster [DBG] pgmap v60: 25 pgs: 25 active+clean; 77 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2021-07-26T15:58:52.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:52 smithi096 bash[33981]: cluster 2021-07-26T15:58:51.947641+0000 mon.a (mon.0) 108 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-07-26T15:58:53.032 INFO:tasks.rados.rados.0.smithi033.stdout:708: done (5 left) 2021-07-26T15:58:53.032 INFO:tasks.rados.rados.0.smithi033.stdout:709: rmattr oid 11 current snap is 63 2021-07-26T15:58:53.033 INFO:tasks.rados.rados.0.smithi033.stdout:710: read oid 12 snap -1 2021-07-26T15:58:53.033 INFO:tasks.rados.rados.0.smithi033.stdout:710: expect (ObjNum 137 snap 34 seq_num 137) 2021-07-26T15:58:53.033 INFO:tasks.rados.rados.0.smithi033.stdout:711: snap_create 2021-07-26T15:58:53.033 INFO:tasks.rados.rados.0.smithi033.stdout:701: finishing write tid 1 to smithi03339061-40 2021-07-26T15:58:53.034 INFO:tasks.rados.rados.0.smithi033.stdout:701: finishing write tid 2 to smithi03339061-40 2021-07-26T15:58:53.034 INFO:tasks.rados.rados.0.smithi033.stdout:701: finishing write tid 3 to smithi03339061-40 2021-07-26T15:58:53.034 INFO:tasks.rados.rados.0.smithi033.stdout:701: finishing write tid 4 to smithi03339061-40 2021-07-26T15:58:53.035 INFO:tasks.rados.rados.0.smithi033.stdout:707: finishing copy_from to smithi03339061-21 2021-07-26T15:58:53.036 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 197 (ObjNum 1483239261 snap 1348753512 seq_num 1632924751) dirty exists 2021-07-26T15:58:53.036 INFO:tasks.rados.rados.0.smithi033.stdout:707: finishing copy_from racing read to smithi03339061-21 2021-07-26T15:58:53.036 INFO:tasks.rados.rados.0.smithi033.stdout:701: finishing write tid 5 to smithi03339061-40 2021-07-26T15:58:53.036 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 185 (ObjNum 223 snap 63 seq_num 223) dirty exists 2021-07-26T15:58:53.037 INFO:tasks.rados.rados.0.smithi033.stdout:701: left oid 40 (ObjNum 223 snap 63 seq_num 223) 2021-07-26T15:58:53.037 INFO:tasks.rados.rados.0.smithi033.stdout:704: expect (ObjNum 167 snap 44 seq_num 167) 2021-07-26T15:58:53.055 INFO:tasks.rados.rados.0.smithi033.stdout:705: finishing rollback tid 0 to smithi03339061-4 2021-07-26T15:58:53.055 INFO:tasks.rados.rados.0.smithi033.stdout:705: finishing rollback tid 1 to smithi03339061-4 2021-07-26T15:58:53.055 INFO:tasks.rados.rados.0.smithi033.stdout:705: finishing rollback tid 2 to smithi03339061-4 2021-07-26T15:58:53.055 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 230 (ObjNum 212 snap 55 seq_num 212) dirty exists 2021-07-26T15:58:53.056 INFO:tasks.rados.rados.0.smithi033.stdout:706: expect (ObjNum 41 snap 0 seq_num 41) 2021-07-26T15:58:53.075 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 96 (ObjNum 194 snap 53 seq_num 194) dirty exists 2021-07-26T15:58:53.075 INFO:tasks.rados.rados.0.smithi033.stdout:710: expect (ObjNum 137 snap 34 seq_num 137) 2021-07-26T15:58:53.515 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:53 smithi033 bash[41341]: audit 2021-07-26T15:58:52.256078+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:53.515 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:53 smithi033 bash[41341]: cephadm 2021-07-26T15:58:52.258086+0000 mgr.y (mgr.34104) 47 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-07-26T15:58:53.516 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:53 smithi033 bash[41341]: cephadm 2021-07-26T15:58:52.259932+0000 mgr.y (mgr.34104) 48 : cephadm [INF] Reconfiguring daemon osd.2 on smithi033 2021-07-26T15:58:53.516 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:53 smithi033 bash[41341]: cluster 2021-07-26T15:58:53.026090+0000 mon.a (mon.0) 110 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-07-26T15:58:53.516 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:53 smithi033 bash[42377]: audit 2021-07-26T15:58:52.256078+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:53.517 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:53 smithi033 bash[42377]: cephadm 2021-07-26T15:58:52.258086+0000 mgr.y (mgr.34104) 47 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-07-26T15:58:53.517 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:53 smithi033 bash[42377]: cephadm 2021-07-26T15:58:52.259932+0000 mgr.y (mgr.34104) 48 : cephadm [INF] Reconfiguring daemon osd.2 on smithi033 2021-07-26T15:58:53.517 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:53 smithi033 bash[42377]: cluster 2021-07-26T15:58:53.026090+0000 mon.a (mon.0) 110 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-07-26T15:58:53.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:53 smithi096 bash[33981]: audit 2021-07-26T15:58:52.256078+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:53.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:53 smithi096 bash[33981]: cephadm 2021-07-26T15:58:52.258086+0000 mgr.y (mgr.34104) 47 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2021-07-26T15:58:53.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:53 smithi096 bash[33981]: cephadm 2021-07-26T15:58:52.259932+0000 mgr.y (mgr.34104) 48 : cephadm [INF] Reconfiguring daemon osd.2 on smithi033 2021-07-26T15:58:53.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:53 smithi096 bash[33981]: cluster 2021-07-26T15:58:53.026090+0000 mon.a (mon.0) 110 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-07-26T15:58:53.920 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:53.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:53.921 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:53.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:58:53.921 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:58:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:58:53.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T15:58:54.032 INFO:tasks.rados.rados.0.smithi033.stdout:701: done (7 left) 2021-07-26T15:58:54.033 INFO:tasks.rados.rados.0.smithi033.stdout:704: done (6 left) 2021-07-26T15:58:54.033 INFO:tasks.rados.rados.0.smithi033.stdout:705: done (5 left) 2021-07-26T15:58:54.033 INFO:tasks.rados.rados.0.smithi033.stdout:706: done (4 left) 2021-07-26T15:58:54.033 INFO:tasks.rados.rados.0.smithi033.stdout:707: done (3 left) 2021-07-26T15:58:54.034 INFO:tasks.rados.rados.0.smithi033.stdout:709: done (2 left) 2021-07-26T15:58:54.034 INFO:tasks.rados.rados.0.smithi033.stdout:710: done (1 left) 2021-07-26T15:58:54.035 INFO:tasks.rados.rados.0.smithi033.stdout:711: done (0 left) 2021-07-26T15:58:54.035 INFO:tasks.rados.rados.0.smithi033.stdout:712: delete oid 15 current snap is 64 2021-07-26T15:58:54.040 INFO:tasks.rados.rados.0.smithi033.stdout:712: done (0 left) 2021-07-26T15:58:54.041 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 64 2021-07-26T15:58:54.041 INFO:tasks.rados.rados.0.smithi033.stdout:713: seq_num 226 ranges {2744320=589824,3334144=507904,3842048=294912} 2021-07-26T15:58:54.065 INFO:tasks.rados.rados.0.smithi033.stdout:713: writing smithi03339061-6 from 2744320 to 3334144 tid 1 2021-07-26T15:58:54.067 INFO:tasks.rados.rados.0.smithi033.stdout:713: writing smithi03339061-6 from 3334144 to 3842048 tid 2 2021-07-26T15:58:54.069 INFO:tasks.rados.rados.0.smithi033.stdout:713: writing smithi03339061-6 from 3842048 to 4136960 tid 3 2021-07-26T15:58:54.070 INFO:tasks.rados.rados.0.smithi033.stdout:714: snap_remove snap 58 2021-07-26T15:58:54.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:54 smithi033 bash[41341]: cluster 2021-07-26T15:58:52.955726+0000 mgr.y (mgr.34104) 49 : cluster [DBG] pgmap v62: 25 pgs: 25 active+clean; 77 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2021-07-26T15:58:54.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:54 smithi033 bash[41341]: cluster 2021-07-26T15:58:54.029797+0000 mon.a (mon.0) 111 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-07-26T15:58:54.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:54 smithi033 bash[42377]: cluster 2021-07-26T15:58:52.955726+0000 mgr.y (mgr.34104) 49 : cluster [DBG] pgmap v62: 25 pgs: 25 active+clean; 77 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2021-07-26T15:58:54.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:54 smithi033 bash[42377]: cluster 2021-07-26T15:58:54.029797+0000 mon.a (mon.0) 111 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-07-26T15:58:54.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:54 smithi096 bash[33981]: cluster 2021-07-26T15:58:52.955726+0000 mgr.y (mgr.34104) 49 : cluster [DBG] pgmap v62: 25 pgs: 25 active+clean; 77 MiB data, 352 MiB used, 715 GiB / 715 GiB avail; 9.0 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2021-07-26T15:58:54.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:54 smithi096 bash[33981]: cluster 2021-07-26T15:58:54.029797+0000 mon.a (mon.0) 111 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-07-26T15:58:55.038 INFO:tasks.rados.rados.0.smithi033.stdout:714: done (1 left) 2021-07-26T15:58:55.039 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 64 2021-07-26T15:58:55.039 INFO:tasks.rados.rados.0.smithi033.stdout:715: seq_num 227 ranges {1613824=606208,2220032=794624,3014656=8192} 2021-07-26T15:58:55.052 INFO:tasks.rados.rados.0.smithi033.stdout:715: writing smithi03339061-11 from 1613824 to 2220032 tid 1 2021-07-26T15:58:55.058 INFO:tasks.rados.rados.0.smithi033.stdout:715: writing smithi03339061-11 from 2220032 to 3014656 tid 2 2021-07-26T15:58:55.058 INFO:tasks.rados.rados.0.smithi033.stdout:715: writing smithi03339061-11 from 3014656 to 3022848 tid 3 2021-07-26T15:58:55.058 INFO:tasks.rados.rados.0.smithi033.stdout:716: copy_from oid 1 from oid 28 current snap is 64 2021-07-26T15:58:55.058 INFO:tasks.rados.rados.0.smithi033.stdout:713: finishing write tid 1 to smithi03339061-6 2021-07-26T15:58:55.059 INFO:tasks.rados.rados.0.smithi033.stdout:713: finishing write tid 2 to smithi03339061-6 2021-07-26T15:58:55.059 INFO:tasks.rados.rados.0.smithi033.stdout:713: finishing write tid 3 to smithi03339061-6 2021-07-26T15:58:55.059 INFO:tasks.rados.rados.0.smithi033.stdout:713: finishing write tid 4 to smithi03339061-6 2021-07-26T15:58:55.059 INFO:tasks.rados.rados.0.smithi033.stdout:713: finishing write tid 5 to smithi03339061-6 2021-07-26T15:58:55.059 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 421 (ObjNum 226 snap 64 seq_num 226) dirty exists 2021-07-26T15:58:55.060 INFO:tasks.rados.rados.0.smithi033.stdout:713: left oid 6 (ObjNum 226 snap 64 seq_num 226) 2021-07-26T15:58:55.060 INFO:tasks.rados.rados.0.smithi033.stdout:715: finishing write tid 1 to smithi03339061-11 2021-07-26T15:58:55.060 INFO:tasks.rados.rados.0.smithi033.stdout:713: done (2 left) 2021-07-26T15:58:55.060 INFO:tasks.rados.rados.0.smithi033.stdout:717: snap_remove snap 63 2021-07-26T15:58:55.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:55 smithi033 bash[41341]: audit 2021-07-26T15:58:54.537851+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:55.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:55 smithi033 bash[41341]: cephadm 2021-07-26T15:58:54.540165+0000 mgr.y (mgr.34104) 50 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-07-26T15:58:55.882 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:55 smithi033 bash[41341]: cephadm 2021-07-26T15:58:54.541715+0000 mgr.y (mgr.34104) 51 : cephadm [INF] Reconfiguring daemon osd.3 on smithi033 2021-07-26T15:58:55.883 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:55 smithi033 bash[41341]: cluster 2021-07-26T15:58:55.032994+0000 mon.a (mon.0) 113 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-07-26T15:58:55.883 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:55 smithi033 bash[42377]: audit 2021-07-26T15:58:54.537851+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:55.883 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:55 smithi033 bash[42377]: cephadm 2021-07-26T15:58:54.540165+0000 mgr.y (mgr.34104) 50 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-07-26T15:58:55.883 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:55 smithi033 bash[42377]: cephadm 2021-07-26T15:58:54.541715+0000 mgr.y (mgr.34104) 51 : cephadm [INF] Reconfiguring daemon osd.3 on smithi033 2021-07-26T15:58:55.884 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:55 smithi033 bash[42377]: cluster 2021-07-26T15:58:55.032994+0000 mon.a (mon.0) 113 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-07-26T15:58:55.933 INFO:tasks.rados.rados.0.smithi033.stdout:717: done (2 left) 2021-07-26T15:58:55.934 INFO:tasks.rados.rados.0.smithi033.stdout:718: copy_from oid 24 from oid 22 current snap is 64 2021-07-26T15:58:55.934 INFO:tasks.rados.rados.0.smithi033.stdout:716: finishing copy_from to smithi03339061-1 2021-07-26T15:58:55.934 INFO:tasks.rados.rados.0.smithi033.stdout:716: got expected ENOENT (src dne) 2021-07-26T15:58:55.934 INFO:tasks.rados.rados.0.smithi033.stdout:716: finishing copy_from racing read to smithi03339061-1 2021-07-26T15:58:55.935 INFO:tasks.rados.rados.0.smithi033.stdout:715: finishing write tid 2 to smithi03339061-11 2021-07-26T15:58:55.935 INFO:tasks.rados.rados.0.smithi033.stdout:715: finishing write tid 3 to smithi03339061-11 2021-07-26T15:58:55.935 INFO:tasks.rados.rados.0.smithi033.stdout:715: finishing write tid 4 to smithi03339061-11 2021-07-26T15:58:55.935 INFO:tasks.rados.rados.0.smithi033.stdout:715: finishing write tid 5 to smithi03339061-11 2021-07-26T15:58:55.936 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 103 (ObjNum 227 snap 64 seq_num 227) dirty exists 2021-07-26T15:58:55.936 INFO:tasks.rados.rados.0.smithi033.stdout:715: left oid 11 (ObjNum 227 snap 64 seq_num 227) 2021-07-26T15:58:55.936 INFO:tasks.rados.rados.0.smithi033.stdout:715: done (2 left) 2021-07-26T15:58:55.936 INFO:tasks.rados.rados.0.smithi033.stdout:716: done (1 left) 2021-07-26T15:58:55.936 INFO:tasks.rados.rados.0.smithi033.stdout:719: copy_from oid 43 from oid 35 current snap is 64 2021-07-26T15:58:55.937 INFO:tasks.rados.rados.0.smithi033.stdout:720: setattr oid 29 current snap is 64 2021-07-26T15:58:55.939 INFO:tasks.rados.rados.0.smithi033.stdout:721: setattr oid 32 current snap is 64 2021-07-26T15:58:55.943 INFO:tasks.rados.rados.0.smithi033.stdout:722: snap_create 2021-07-26T15:58:55.947 INFO:tasks.rados.rados.0.smithi033.stdout:718: finishing copy_from to smithi03339061-24 2021-07-26T15:58:55.947 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 197 (ObjNum 2007483808 snap 22002 seq_num 0) dirty exists 2021-07-26T15:58:55.947 INFO:tasks.rados.rados.0.smithi033.stdout:718: finishing copy_from racing read to smithi03339061-24 2021-07-26T15:58:55.948 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 175 (ObjNum 158 snap 39 seq_num 158) dirty exists 2021-07-26T15:58:55.949 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 191 (ObjNum 0 snap 0 seq_num 0) dirty exists 2021-07-26T15:58:55.963 INFO:tasks.rados.rados.0.smithi033.stdout:719: finishing copy_from to smithi03339061-43 2021-07-26T15:58:55.963 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 186 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:58:55.964 INFO:tasks.rados.rados.0.smithi033.stdout:719: finishing copy_from racing read to smithi03339061-43 2021-07-26T15:58:55.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:55 smithi096 bash[33981]: audit 2021-07-26T15:58:54.537851+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:55.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:55 smithi096 bash[33981]: cephadm 2021-07-26T15:58:54.540165+0000 mgr.y (mgr.34104) 50 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2021-07-26T15:58:55.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:55 smithi096 bash[33981]: cephadm 2021-07-26T15:58:54.541715+0000 mgr.y (mgr.34104) 51 : cephadm [INF] Reconfiguring daemon osd.3 on smithi033 2021-07-26T15:58:55.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:55 smithi096 bash[33981]: cluster 2021-07-26T15:58:55.032994+0000 mon.a (mon.0) 113 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-07-26T15:58:56.943 INFO:tasks.rados.rados.0.smithi033.stdout:718: done (4 left) 2021-07-26T15:58:56.943 INFO:tasks.rados.rados.0.smithi033.stdout:719: done (3 left) 2021-07-26T15:58:56.944 INFO:tasks.rados.rados.0.smithi033.stdout:720: done (2 left) 2021-07-26T15:58:56.944 INFO:tasks.rados.rados.0.smithi033.stdout:721: done (1 left) 2021-07-26T15:58:56.944 INFO:tasks.rados.rados.0.smithi033.stdout:722: done (0 left) 2021-07-26T15:58:56.944 INFO:tasks.rados.rados.0.smithi033.stdout:723: rollback oid 27 current snap is 65 2021-07-26T15:58:56.945 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 27 to 60 2021-07-26T15:58:56.945 INFO:tasks.rados.rados.0.smithi033.stdout:724: snap_remove snap 64 2021-07-26T15:58:56.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:56 smithi033 bash[42377]: cluster 2021-07-26T15:58:54.956514+0000 mgr.y (mgr.34104) 52 : cluster [DBG] pgmap v65: 25 pgs: 25 active+clean; 81 MiB data, 375 MiB used, 715 GiB / 715 GiB avail; 4.3 MiB/s rd, 980 KiB/s wr, 10 op/s 2021-07-26T15:58:56.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:56 smithi033 bash[42377]: cluster 2021-07-26T15:58:55.928331+0000 mon.a (mon.0) 114 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-07-26T15:58:56.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:56 smithi033 bash[41341]: cluster 2021-07-26T15:58:54.956514+0000 mgr.y (mgr.34104) 52 : cluster [DBG] pgmap v65: 25 pgs: 25 active+clean; 81 MiB data, 375 MiB used, 715 GiB / 715 GiB avail; 4.3 MiB/s rd, 980 KiB/s wr, 10 op/s 2021-07-26T15:58:56.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:56 smithi033 bash[41341]: cluster 2021-07-26T15:58:55.928331+0000 mon.a (mon.0) 114 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-07-26T15:58:56.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:56 smithi096 bash[33981]: cluster 2021-07-26T15:58:54.956514+0000 mgr.y (mgr.34104) 52 : cluster [DBG] pgmap v65: 25 pgs: 25 active+clean; 81 MiB data, 375 MiB used, 715 GiB / 715 GiB avail; 4.3 MiB/s rd, 980 KiB/s wr, 10 op/s 2021-07-26T15:58:56.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:56 smithi096 bash[33981]: cluster 2021-07-26T15:58:55.928331+0000 mon.a (mon.0) 114 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-07-26T15:58:57.957 INFO:tasks.rados.rados.0.smithi033.stdout:724: done (1 left) 2021-07-26T15:58:57.957 INFO:tasks.rados.rados.0.smithi033.stdout:725: copy_from oid 11 from oid 41 current snap is 65 2021-07-26T15:58:57.957 INFO:tasks.rados.rados.0.smithi033.stdout:723: finishing rollback tid 0 to smithi03339061-27 2021-07-26T15:58:57.957 INFO:tasks.rados.rados.0.smithi033.stdout:723: finishing rollback tid 1 to smithi03339061-27 2021-07-26T15:58:57.958 INFO:tasks.rados.rados.0.smithi033.stdout:723: finishing rollback tid 2 to smithi03339061-27 2021-07-26T15:58:57.958 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 338 (ObjNum 219 snap 60 seq_num 219) dirty exists 2021-07-26T15:58:57.958 INFO:tasks.rados.rados.0.smithi033.stdout:723: done (1 left) 2021-07-26T15:58:57.959 INFO:tasks.rados.rados.0.smithi033.stdout:726: copy_from oid 46 from oid 17 current snap is 65 2021-07-26T15:58:57.959 INFO:tasks.rados.rados.0.smithi033.stdout:727: delete oid 29 current snap is 65 2021-07-26T15:58:57.967 INFO:tasks.rados.rados.0.smithi033.stdout:727: done (2 left) 2021-07-26T15:58:57.968 INFO:tasks.rados.rados.0.smithi033.stdout:728: snap_remove snap 61 2021-07-26T15:58:58.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[41341]: audit 2021-07-26T15:58:56.780437+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:58.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[41341]: cephadm 2021-07-26T15:58:56.782946+0000 mgr.y (mgr.34104) 53 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-07-26T15:58:58.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[41341]: audit 2021-07-26T15:58:56.783459+0000 mon.c (mon.1) 21 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:58.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[41341]: audit 2021-07-26T15:58:56.785047+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:58.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[41341]: audit 2021-07-26T15:58:56.786375+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:58.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[41341]: cephadm 2021-07-26T15:58:56.787724+0000 mgr.y (mgr.34104) 54 : cephadm [INF] Reconfiguring daemon mon.b on smithi096 2021-07-26T15:58:58.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[41341]: cluster 2021-07-26T15:58:56.940261+0000 mon.a (mon.0) 116 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-07-26T15:58:58.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[41341]: cluster 2021-07-26T15:58:56.957129+0000 mgr.y (mgr.34104) 55 : cluster [DBG] pgmap v69: 25 pgs: 25 active+clean; 82 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 4.9 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2021-07-26T15:58:58.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[42377]: audit 2021-07-26T15:58:56.780437+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:58.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[42377]: cephadm 2021-07-26T15:58:56.782946+0000 mgr.y (mgr.34104) 53 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-07-26T15:58:58.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[42377]: audit 2021-07-26T15:58:56.783459+0000 mon.c (mon.1) 21 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:58.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[42377]: audit 2021-07-26T15:58:56.785047+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:58.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[42377]: audit 2021-07-26T15:58:56.786375+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:58.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[42377]: cephadm 2021-07-26T15:58:56.787724+0000 mgr.y (mgr.34104) 54 : cephadm [INF] Reconfiguring daemon mon.b on smithi096 2021-07-26T15:58:58.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[42377]: cluster 2021-07-26T15:58:56.940261+0000 mon.a (mon.0) 116 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-07-26T15:58:58.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:57 smithi033 bash[42377]: cluster 2021-07-26T15:58:56.957129+0000 mgr.y (mgr.34104) 55 : cluster [DBG] pgmap v69: 25 pgs: 25 active+clean; 82 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 4.9 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2021-07-26T15:58:58.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:57 smithi096 bash[33981]: audit 2021-07-26T15:58:56.780437+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:58:58.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:57 smithi096 bash[33981]: cephadm 2021-07-26T15:58:56.782946+0000 mgr.y (mgr.34104) 53 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-07-26T15:58:58.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:57 smithi096 bash[33981]: audit 2021-07-26T15:58:56.783459+0000 mon.c (mon.1) 21 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-07-26T15:58:58.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:57 smithi096 bash[33981]: audit 2021-07-26T15:58:56.785047+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2021-07-26T15:58:58.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:57 smithi096 bash[33981]: audit 2021-07-26T15:58:56.786375+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:58:58.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:57 smithi096 bash[33981]: cephadm 2021-07-26T15:58:56.787724+0000 mgr.y (mgr.34104) 54 : cephadm [INF] Reconfiguring daemon mon.b on smithi096 2021-07-26T15:58:58.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:57 smithi096 bash[33981]: cluster 2021-07-26T15:58:56.940261+0000 mon.a (mon.0) 116 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-07-26T15:58:58.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:57 smithi096 bash[33981]: cluster 2021-07-26T15:58:56.957129+0000 mgr.y (mgr.34104) 55 : cluster [DBG] pgmap v69: 25 pgs: 25 active+clean; 82 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 4.9 MiB/s rd, 1.3 MiB/s wr, 13 op/s 2021-07-26T15:58:58.978 INFO:tasks.rados.rados.0.smithi033.stdout:728: done (2 left) 2021-07-26T15:58:58.978 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 65 2021-07-26T15:58:58.978 INFO:tasks.rados.rados.0.smithi033.stdout:729: seq_num 229 ranges {5529600=638976,6168576=606208,6774784=196608} 2021-07-26T15:58:59.008 INFO:tasks.rados.rados.0.smithi033.stdout:729: writing smithi03339061-12 from 5529600 to 6168576 tid 1 2021-07-26T15:58:59.012 INFO:tasks.rados.rados.0.smithi033.stdout:729: writing smithi03339061-12 from 6168576 to 6774784 tid 2 2021-07-26T15:58:59.013 INFO:tasks.rados.rados.0.smithi033.stdout:729: writing smithi03339061-12 from 6774784 to 6971392 tid 3 2021-07-26T15:58:59.014 INFO:tasks.rados.rados.0.smithi033.stdout:730: delete oid 22 current snap is 65 2021-07-26T15:58:59.014 INFO:tasks.rados.rados.0.smithi033.stdout:725: finishing copy_from to smithi03339061-11 2021-07-26T15:58:59.014 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 3 (ObjNum 7 snap 0 seq_num 7) dirty exists 2021-07-26T15:58:59.014 INFO:tasks.rados.rados.0.smithi033.stdout:725: finishing copy_from racing read to smithi03339061-11 2021-07-26T15:58:59.015 INFO:tasks.rados.rados.0.smithi033.stdout:726: finishing copy_from to smithi03339061-46 2021-07-26T15:58:59.015 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 174 (ObjNum 167 snap 44 seq_num 167) dirty exists 2021-07-26T15:58:59.015 INFO:tasks.rados.rados.0.smithi033.stdout:726: finishing copy_from racing read to smithi03339061-46 2021-07-26T15:58:59.016 INFO:tasks.rados.rados.0.smithi033.stdout:729: finishing write tid 1 to smithi03339061-12 2021-07-26T15:58:59.016 INFO:tasks.rados.rados.0.smithi033.stdout:725: done (3 left) 2021-07-26T15:58:59.016 INFO:tasks.rados.rados.0.smithi033.stdout:726: done (2 left) 2021-07-26T15:58:59.016 INFO:tasks.rados.rados.0.smithi033.stdout:730: done (1 left) 2021-07-26T15:58:59.017 INFO:tasks.rados.rados.0.smithi033.stdout:731: snap_remove snap 59 2021-07-26T15:58:59.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:58 smithi033 bash[41341]: cluster 2021-07-26T15:58:57.951226+0000 mon.a (mon.0) 117 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-07-26T15:58:59.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:58 smithi033 bash[42377]: cluster 2021-07-26T15:58:57.951226+0000 mon.a (mon.0) 117 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-07-26T15:58:59.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:58 smithi096 bash[33981]: cluster 2021-07-26T15:58:57.951226+0000 mon.a (mon.0) 117 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-07-26T15:58:59.985 INFO:tasks.rados.rados.0.smithi033.stdout:731: done (1 left) 2021-07-26T15:58:59.985 INFO:tasks.rados.rados.0.smithi033.stdout:729: finishing write tid 2 to smithi03339061-12 2021-07-26T15:58:59.986 INFO:tasks.rados.rados.0.smithi033.stdout:729: finishing write tid 3 to smithi03339061-12 2021-07-26T15:58:59.986 INFO:tasks.rados.rados.0.smithi033.stdout:729: finishing write tid 4 to smithi03339061-12 2021-07-26T15:58:59.986 INFO:tasks.rados.rados.0.smithi033.stdout:729: finishing write tid 5 to smithi03339061-12 2021-07-26T15:58:59.986 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 187 (ObjNum 229 snap 65 seq_num 229) dirty exists 2021-07-26T15:58:59.987 INFO:tasks.rados.rados.0.smithi033.stdout:729: left oid 12 (ObjNum 229 snap 65 seq_num 229) 2021-07-26T15:58:59.987 INFO:tasks.rados.rados.0.smithi033.stdout:732: read oid 9 snap -1 2021-07-26T15:58:59.987 INFO:tasks.rados.rados.0.smithi033.stdout:732: expect (ObjNum 122 snap 28 seq_num 122) 2021-07-26T15:58:59.988 INFO:tasks.rados.rados.0.smithi033.stdout:729: done (1 left) 2021-07-26T15:58:59.988 INFO:tasks.rados.rados.0.smithi033.stdout:733: snap_remove snap 60 2021-07-26T15:59:00.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:59 smithi096 bash[33981]: cluster 2021-07-26T15:58:58.957779+0000 mgr.y (mgr.34104) 56 : cluster [DBG] pgmap v71: 25 pgs: 25 active+clean; 82 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 510 KiB/s rd, 324 KiB/s wr, 2 op/s 2021-07-26T15:59:00.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:59 smithi096 bash[33981]: cluster 2021-07-26T15:58:58.967934+0000 mon.a (mon.0) 118 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-07-26T15:59:00.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:59 smithi096 bash[33981]: audit 2021-07-26T15:58:59.122877+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:00.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:59 smithi096 bash[33981]: cephadm 2021-07-26T15:58:59.125836+0000 mgr.y (mgr.34104) 57 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-07-26T15:59:00.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:59 smithi096 bash[33981]: audit 2021-07-26T15:58:59.126510+0000 mon.c (mon.1) 24 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:59:00.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:59 smithi096 bash[33981]: audit 2021-07-26T15:58:59.127298+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:59:00.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:59 smithi096 bash[33981]: audit 2021-07-26T15:58:59.129557+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:59:00.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:59 smithi096 bash[33981]: audit 2021-07-26T15:58:59.131299+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:59:00.241 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:58:59 smithi096 bash[33981]: cephadm 2021-07-26T15:58:59.132760+0000 mgr.y (mgr.34104) 58 : cephadm [INF] Reconfiguring daemon mgr.x on smithi096 2021-07-26T15:59:00.458 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[24389]: debug 2021-07-26T15:58:59.974+0000 7f93f6800700 -1 osd.1 pg_epoch: 191 pg[3.4s0( v 190'238 (0'0,190'238] local-lis/les=57/58 n=6 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [1,2,6]p1(0) r=0 lpr=57 crt=190'238 lcod 186'236 mlcod 186'236 active+clean+snaptrim trimq=[77~1] ps=[75~1,79~2,7c~1,7f~1]] removing snap head 2021-07-26T15:59:00.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[42377]: cluster 2021-07-26T15:58:58.957779+0000 mgr.y (mgr.34104) 56 : cluster [DBG] pgmap v71: 25 pgs: 25 active+clean; 82 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 510 KiB/s rd, 324 KiB/s wr, 2 op/s 2021-07-26T15:59:00.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[42377]: cluster 2021-07-26T15:58:58.967934+0000 mon.a (mon.0) 118 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-07-26T15:59:00.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[42377]: audit 2021-07-26T15:58:59.122877+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:00.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[42377]: cephadm 2021-07-26T15:58:59.125836+0000 mgr.y (mgr.34104) 57 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-07-26T15:59:00.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[42377]: audit 2021-07-26T15:58:59.126510+0000 mon.c (mon.1) 24 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:59:00.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[42377]: audit 2021-07-26T15:58:59.127298+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:59:00.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[42377]: audit 2021-07-26T15:58:59.129557+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:59:00.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[42377]: audit 2021-07-26T15:58:59.131299+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:59:00.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[42377]: cephadm 2021-07-26T15:58:59.132760+0000 mgr.y (mgr.34104) 58 : cephadm [INF] Reconfiguring daemon mgr.x on smithi096 2021-07-26T15:59:00.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[41341]: cluster 2021-07-26T15:58:58.957779+0000 mgr.y (mgr.34104) 56 : cluster [DBG] pgmap v71: 25 pgs: 25 active+clean; 82 MiB data, 380 MiB used, 715 GiB / 715 GiB avail; 510 KiB/s rd, 324 KiB/s wr, 2 op/s 2021-07-26T15:59:00.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[41341]: cluster 2021-07-26T15:58:58.967934+0000 mon.a (mon.0) 118 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-07-26T15:59:00.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[41341]: audit 2021-07-26T15:58:59.122877+0000 mon.a (mon.0) 119 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:00.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[41341]: cephadm 2021-07-26T15:58:59.125836+0000 mgr.y (mgr.34104) 57 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2021-07-26T15:59:00.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[41341]: audit 2021-07-26T15:58:59.126510+0000 mon.c (mon.1) 24 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:59:00.468 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[41341]: audit 2021-07-26T15:58:59.127298+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-07-26T15:59:00.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[41341]: audit 2021-07-26T15:58:59.129557+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-07-26T15:59:00.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[41341]: audit 2021-07-26T15:58:59.131299+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:59:00.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:58:59 smithi033 bash[41341]: cephadm 2021-07-26T15:58:59.132760+0000 mgr.y (mgr.34104) 58 : cephadm [INF] Reconfiguring daemon mgr.x on smithi096 2021-07-26T15:59:00.992 INFO:tasks.rados.rados.0.smithi033.stdout:733: done (1 left) 2021-07-26T15:59:00.993 INFO:tasks.rados.rados.0.smithi033.stdout:734: read oid 31 snap -1 2021-07-26T15:59:00.993 INFO:tasks.rados.rados.0.smithi033.stdout:734: expect deleted 2021-07-26T15:59:00.993 INFO:tasks.rados.rados.0.smithi033.stdout:735: rollback oid 44 current snap is 65 2021-07-26T15:59:00.996 INFO:tasks.rados.rados.0.smithi033.stdout:732: expect (ObjNum 122 snap 28 seq_num 122) 2021-07-26T15:59:01.114 INFO:tasks.rados.rados.0.smithi033.stdout:732: done (2 left) 2021-07-26T15:59:01.115 INFO:tasks.rados.rados.0.smithi033.stdout:734: done (1 left) 2021-07-26T15:59:01.115 INFO:tasks.rados.rados.0.smithi033.stdout:735: done (0 left) 2021-07-26T15:59:01.115 INFO:tasks.rados.rados.0.smithi033.stdout:736: delete oid 3 current snap is 65 2021-07-26T15:59:01.118 INFO:tasks.rados.rados.0.smithi033.stdout:736: done (0 left) 2021-07-26T15:59:01.118 INFO:tasks.rados.rados.0.smithi033.stdout:737: read oid 2 snap -1 2021-07-26T15:59:01.118 INFO:tasks.rados.rados.0.smithi033.stdout:737: expect (ObjNum 220 snap 60 seq_num 220) 2021-07-26T15:59:01.119 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 65 2021-07-26T15:59:01.119 INFO:tasks.rados.rados.0.smithi033.stdout:738: seq_num 232 ranges {606208=688128,1294336=663552,1957888=139264} 2021-07-26T15:59:01.131 INFO:tasks.rados.rados.0.smithi033.stdout:738: writing smithi03339061-26 from 606208 to 1294336 tid 1 2021-07-26T15:59:01.136 INFO:tasks.rados.rados.0.smithi033.stdout:738: writing smithi03339061-26 from 1294336 to 1957888 tid 2 2021-07-26T15:59:01.137 INFO:tasks.rados.rados.0.smithi033.stdout:738: writing smithi03339061-26 from 1957888 to 2097152 tid 3 2021-07-26T15:59:01.138 INFO:tasks.rados.rados.0.smithi033.stdout:739: rollback oid 27 current snap is 65 2021-07-26T15:59:01.138 INFO:tasks.rados.rados.0.smithi033.stdout:739: done (2 left) 2021-07-26T15:59:01.138 INFO:tasks.rados.rados.0.smithi033.stdout:740: snap_create 2021-07-26T15:59:01.138 INFO:tasks.rados.rados.0.smithi033.stdout:737: expect (ObjNum 220 snap 60 seq_num 220) 2021-07-26T15:59:01.175 INFO:tasks.rados.rados.0.smithi033.stdout:738: finishing write tid 1 to smithi03339061-26 2021-07-26T15:59:01.175 INFO:tasks.rados.rados.0.smithi033.stdout:738: finishing write tid 2 to smithi03339061-26 2021-07-26T15:59:01.176 INFO:tasks.rados.rados.0.smithi033.stdout:738: finishing write tid 3 to smithi03339061-26 2021-07-26T15:59:01.176 INFO:tasks.rados.rados.0.smithi033.stdout:738: finishing write tid 4 to smithi03339061-26 2021-07-26T15:59:01.176 INFO:tasks.rados.rados.0.smithi033.stdout:738: finishing write tid 5 to smithi03339061-26 2021-07-26T15:59:01.176 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 448 (ObjNum 232 snap 65 seq_num 232) dirty exists 2021-07-26T15:59:01.176 INFO:tasks.rados.rados.0.smithi033.stdout:738: left oid 26 (ObjNum 232 snap 65 seq_num 232) 2021-07-26T15:59:01.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:00 smithi096 bash[33981]: cluster 2021-07-26T15:58:59.978064+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-07-26T15:59:01.237 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:59:00 smithi096 bash[17896]: debug 2021-07-26T15:59:00.990+0000 7f4643f94700 -1 osd.4 pg_epoch: 192 pg[3.3s0( v 191'175 (0'0,191'175] local-lis/les=57/58 n=3 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [4,1,0]p4(0) r=0 lpr=57 crt=191'175 lcod 190'173 mlcod 190'173 active+clean+snaptrim trimq=[78~1] ps=[75~1,77~1,79~2,7c~1,7f~1]] removing snap head 2021-07-26T15:59:01.238 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:59:01 smithi096 bash[25729]: debug 2021-07-26T15:59:00.998+0000 7fd5f366c700 -1 osd.7 pg_epoch: 192 pg[3.es0( v 192'75 (0'0,192'75] local-lis/les=57/58 n=3 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [7,4,1]p7(0) r=0 lpr=57 luod=191'73 crt=191'73 lcod 191'71 mlcod 191'71 active+clean+snaptrim trimq=[78~1] ps=[75~1,77~1,79~2,7c~1,7f~1]] removing snap head 2021-07-26T15:59:01.238 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 15:59:01 smithi096 bash[25729]: debug 2021-07-26T15:59:01.002+0000 7fd5f2e6b700 -1 osd.7 pg_epoch: 192 pg[3.fs0( v 191'45 (0'0,191'45] local-lis/les=57/58 n=2 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [7,4,0]p7(0) r=0 lpr=57 crt=191'45 lcod 190'43 mlcod 190'43 active+clean+snaptrim trimq=[78~1] ps=[75~1,77~1,79~2,7c~1,7f~1]] removing snap head 2021-07-26T15:59:01.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:00 smithi033 bash[41341]: cluster 2021-07-26T15:58:59.978064+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-07-26T15:59:01.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:00 smithi033 bash[42377]: cluster 2021-07-26T15:58:59.978064+0000 mon.a (mon.0) 121 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-07-26T15:59:01.459 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:59:00 smithi033 bash[29474]: debug 2021-07-26T15:59:00.985+0000 7f0abf26a700 -1 osd.3 pg_epoch: 192 pg[3.bs0( v 191'440 (0'0,191'440] local-lis/les=57/58 n=6 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [3,0,4]p3(0) r=0 lpr=57 crt=191'440 lcod 191'438 mlcod 191'438 active+clean+snaptrim trimq=[78~1] ps=[75~1,77~1,79~2,7c~1,7f~1]] removing snap head 2021-07-26T15:59:02.004 INFO:tasks.rados.rados.0.smithi033.stdout:737: done (2 left) 2021-07-26T15:59:02.004 INFO:tasks.rados.rados.0.smithi033.stdout:738: done (1 left) 2021-07-26T15:59:02.004 INFO:tasks.rados.rados.0.smithi033.stdout:740: done (0 left) 2021-07-26T15:59:02.004 INFO:tasks.rados.rados.0.smithi033.stdout:741: read oid 5 snap -1 2021-07-26T15:59:02.005 INFO:tasks.rados.rados.0.smithi033.stdout:741: expect deleted 2021-07-26T15:59:02.005 INFO:tasks.rados.rados.0.smithi033.stdout:742: copy_from oid 36 from oid 43 current snap is 66 2021-07-26T15:59:02.005 INFO:tasks.rados.rados.0.smithi033.stdout:743: rmattr oid 27 current snap is 66 2021-07-26T15:59:02.005 INFO:tasks.rados.rados.0.smithi033.stdout:744: rollback oid 8 current snap is 66 2021-07-26T15:59:02.006 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 8 to 65 2021-07-26T15:59:02.006 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 66 2021-07-26T15:59:02.006 INFO:tasks.rados.rados.0.smithi033.stdout:745: seq_num 233 ranges {0=712704,712704=548864,1261568=253952} 2021-07-26T15:59:02.010 INFO:tasks.rados.rados.0.smithi033.stdout:745: writing smithi03339061-22 from 0 to 712704 tid 1 2021-07-26T15:59:02.015 INFO:tasks.rados.rados.0.smithi033.stdout:745: writing smithi03339061-22 from 712704 to 1261568 tid 2 2021-07-26T15:59:02.019 INFO:tasks.rados.rados.0.smithi033.stdout:745: writing smithi03339061-22 from 1261568 to 1515520 tid 3 2021-07-26T15:59:02.019 INFO:tasks.rados.rados.0.smithi033.stdout:746: read oid 38 snap -1 2021-07-26T15:59:02.019 INFO:tasks.rados.rados.0.smithi033.stdout:746: expect (ObjNum 205 snap 55 seq_num 205) 2021-07-26T15:59:02.019 INFO:tasks.rados.rados.0.smithi033.stdout:747: copy_from oid 20 from oid 24 current snap is 66 2021-07-26T15:59:02.020 INFO:tasks.rados.rados.0.smithi033.stdout:744: finishing rollback tid 1 to smithi03339061-8 2021-07-26T15:59:02.020 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 0 (ObjNum 2001415368 snap 22002 seq_num 1) dirty dne 2021-07-26T15:59:02.020 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 356 (ObjNum 219 snap 60 seq_num 219) dirty exists 2021-07-26T15:59:02.020 INFO:tasks.rados.rados.0.smithi033.stdout:745: finishing write tid 1 to smithi03339061-22 2021-07-26T15:59:02.020 INFO:tasks.rados.rados.0.smithi033.stdout:741: done (6 left) 2021-07-26T15:59:02.021 INFO:tasks.rados.rados.0.smithi033.stdout:743: done (5 left) 2021-07-26T15:59:02.021 INFO:tasks.rados.rados.0.smithi033.stdout:744: done (4 left) 2021-07-26T15:59:02.021 INFO:tasks.rados.rados.0.smithi033.stdout:748: rollback oid 35 current snap is 66 2021-07-26T15:59:02.022 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 65 2021-07-26T15:59:02.022 INFO:tasks.rados.rados.0.smithi033.stdout:749: read oid 45 snap -1 2021-07-26T15:59:02.022 INFO:tasks.rados.rados.0.smithi033.stdout:749: expect deleted 2021-07-26T15:59:02.022 INFO:tasks.rados.rados.0.smithi033.stdout:750: read oid 32 snap -1 2021-07-26T15:59:02.022 INFO:tasks.rados.rados.0.smithi033.stdout:750: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:59:02.023 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 66 2021-07-26T15:59:02.023 INFO:tasks.rados.rados.0.smithi033.stdout:751: seq_num 234 ranges {0=729088,729088=434176,1163264=368640} 2021-07-26T15:59:02.025 INFO:tasks.rados.rados.0.smithi033.stdout:751: writing smithi03339061-25 from 0 to 729088 tid 1 2021-07-26T15:59:02.030 INFO:tasks.rados.rados.0.smithi033.stdout:751: writing smithi03339061-25 from 729088 to 1163264 tid 2 2021-07-26T15:59:02.031 INFO:tasks.rados.rados.0.smithi033.stdout:751: writing smithi03339061-25 from 1163264 to 1531904 tid 3 2021-07-26T15:59:02.031 INFO:tasks.rados.rados.0.smithi033.stdout:752: copy_from oid 3 from oid 29 current snap is 66 2021-07-26T15:59:02.031 INFO:tasks.rados.rados.0.smithi033.stdout:750: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:59:02.038 INFO:tasks.rados.rados.0.smithi033.stdout:748: finishing rollback tid 0 to smithi03339061-35 2021-07-26T15:59:02.038 INFO:tasks.rados.rados.0.smithi033.stdout:747: finishing copy_from to smithi03339061-20 2021-07-26T15:59:02.039 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 197 (ObjNum 288 snap 0 seq_num 49) dirty exists 2021-07-26T15:59:02.039 INFO:tasks.rados.rados.0.smithi033.stdout:747: finishing copy_from racing read to smithi03339061-20 2021-07-26T15:59:02.039 INFO:tasks.rados.rados.0.smithi033.stdout:748: finishing rollback tid 1 to smithi03339061-35 2021-07-26T15:59:02.039 INFO:tasks.rados.rados.0.smithi033.stdout:747: done (8 left) 2021-07-26T15:59:02.040 INFO:tasks.rados.rados.0.smithi033.stdout:750: done (7 left) 2021-07-26T15:59:02.040 INFO:tasks.rados.rados.0.smithi033.stdout:753: read oid 11 snap -1 2021-07-26T15:59:02.040 INFO:tasks.rados.rados.0.smithi033.stdout:753: expect (ObjNum 7 snap 0 seq_num 7) 2021-07-26T15:59:02.040 INFO:tasks.rados.rados.0.smithi033.stdout:754: delete oid 49 current snap is 66 2021-07-26T15:59:02.040 INFO:tasks.rados.rados.0.smithi033.stdout:748: finishing rollback tid 2 to smithi03339061-35 2021-07-26T15:59:02.041 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 201 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:02.041 INFO:tasks.rados.rados.0.smithi033.stdout:751: finishing write tid 1 to smithi03339061-25 2021-07-26T15:59:02.041 INFO:tasks.rados.rados.0.smithi033.stdout:742: finishing copy_from to smithi03339061-36 2021-07-26T15:59:02.041 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 186 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:02.042 INFO:tasks.rados.rados.0.smithi033.stdout:745: finishing write tid 2 to smithi03339061-22 2021-07-26T15:59:02.042 INFO:tasks.rados.rados.0.smithi033.stdout:745: finishing write tid 3 to smithi03339061-22 2021-07-26T15:59:02.042 INFO:tasks.rados.rados.0.smithi033.stdout:742: finishing copy_from racing read to smithi03339061-36 2021-07-26T15:59:02.042 INFO:tasks.rados.rados.0.smithi033.stdout:745: finishing write tid 4 to smithi03339061-22 2021-07-26T15:59:02.043 INFO:tasks.rados.rados.0.smithi033.stdout:752: finishing copy_from to smithi03339061-3 2021-07-26T15:59:02.043 INFO:tasks.rados.rados.0.smithi033.stdout:752: got expected ENOENT (src dne) 2021-07-26T15:59:02.043 INFO:tasks.rados.rados.0.smithi033.stdout:752: finishing copy_from racing read to smithi03339061-3 2021-07-26T15:59:02.043 INFO:tasks.rados.rados.0.smithi033.stdout:745: finishing write tid 5 to smithi03339061-22 2021-07-26T15:59:02.044 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 452 (ObjNum 233 snap 66 seq_num 233) dirty exists 2021-07-26T15:59:02.044 INFO:tasks.rados.rados.0.smithi033.stdout:745: left oid 22 (ObjNum 233 snap 66 seq_num 233) 2021-07-26T15:59:02.044 INFO:tasks.rados.rados.0.smithi033.stdout:751: finishing write tid 2 to smithi03339061-25 2021-07-26T15:59:02.045 INFO:tasks.rados.rados.0.smithi033.stdout:751: finishing write tid 3 to smithi03339061-25 2021-07-26T15:59:02.045 INFO:tasks.rados.rados.0.smithi033.stdout:746: expect (ObjNum 205 snap 55 seq_num 205) 2021-07-26T15:59:02.115 INFO:tasks.rados.rados.0.smithi033.stdout:751: finishing write tid 4 to smithi03339061-25 2021-07-26T15:59:02.116 INFO:tasks.rados.rados.0.smithi033.stdout:751: finishing write tid 5 to smithi03339061-25 2021-07-26T15:59:02.116 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 197 (ObjNum 234 snap 66 seq_num 234) dirty exists 2021-07-26T15:59:02.116 INFO:tasks.rados.rados.0.smithi033.stdout:751: left oid 25 (ObjNum 234 snap 66 seq_num 234) 2021-07-26T15:59:02.116 INFO:tasks.rados.rados.0.smithi033.stdout:753: expect (ObjNum 7 snap 0 seq_num 7) 2021-07-26T15:59:02.119 INFO:tasks.rados.rados.0.smithi033.stdout:742: done (8 left) 2021-07-26T15:59:02.119 INFO:tasks.rados.rados.0.smithi033.stdout:745: done (7 left) 2021-07-26T15:59:02.119 INFO:tasks.rados.rados.0.smithi033.stdout:746: done (6 left) 2021-07-26T15:59:02.119 INFO:tasks.rados.rados.0.smithi033.stdout:748: done (5 left) 2021-07-26T15:59:02.119 INFO:tasks.rados.rados.0.smithi033.stdout:749: done (4 left) 2021-07-26T15:59:02.120 INFO:tasks.rados.rados.0.smithi033.stdout:751: done (3 left) 2021-07-26T15:59:02.120 INFO:tasks.rados.rados.0.smithi033.stdout:752: done (2 left) 2021-07-26T15:59:02.120 INFO:tasks.rados.rados.0.smithi033.stdout:753: done (1 left) 2021-07-26T15:59:02.120 INFO:tasks.rados.rados.0.smithi033.stdout:754: done (0 left) 2021-07-26T15:59:02.121 INFO:tasks.rados.rados.0.smithi033.stdout:755: snap_remove snap 65 2021-07-26T15:59:02.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:01 smithi033 bash[41341]: cluster 2021-07-26T15:59:00.958476+0000 mgr.y (mgr.34104) 59 : cluster [DBG] pgmap v74: 25 pgs: 25 active+clean; 85 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 509 B/s rd, 1.4 MiB/s wr, 15 op/s 2021-07-26T15:59:02.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:01 smithi033 bash[41341]: cluster 2021-07-26T15:59:00.988366+0000 mon.a (mon.0) 122 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-07-26T15:59:02.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:01 smithi033 bash[41341]: audit 2021-07-26T15:59:01.204159+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:02.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:01 smithi033 bash[41341]: cephadm 2021-07-26T15:59:01.207253+0000 mgr.y (mgr.34104) 60 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-07-26T15:59:02.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:01 smithi033 bash[41341]: cephadm 2021-07-26T15:59:01.208561+0000 mgr.y (mgr.34104) 61 : cephadm [INF] Reconfiguring daemon osd.4 on smithi096 2021-07-26T15:59:02.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:01 smithi033 bash[42377]: cluster 2021-07-26T15:59:00.958476+0000 mgr.y (mgr.34104) 59 : cluster [DBG] pgmap v74: 25 pgs: 25 active+clean; 85 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 509 B/s rd, 1.4 MiB/s wr, 15 op/s 2021-07-26T15:59:02.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:01 smithi033 bash[42377]: cluster 2021-07-26T15:59:00.988366+0000 mon.a (mon.0) 122 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-07-26T15:59:02.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:01 smithi033 bash[42377]: audit 2021-07-26T15:59:01.204159+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:02.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:01 smithi033 bash[42377]: cephadm 2021-07-26T15:59:01.207253+0000 mgr.y (mgr.34104) 60 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-07-26T15:59:02.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:01 smithi033 bash[42377]: cephadm 2021-07-26T15:59:01.208561+0000 mgr.y (mgr.34104) 61 : cephadm [INF] Reconfiguring daemon osd.4 on smithi096 2021-07-26T15:59:02.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:01 smithi096 bash[33981]: cluster 2021-07-26T15:59:00.958476+0000 mgr.y (mgr.34104) 59 : cluster [DBG] pgmap v74: 25 pgs: 25 active+clean; 85 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 509 B/s rd, 1.4 MiB/s wr, 15 op/s 2021-07-26T15:59:02.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:01 smithi096 bash[33981]: cluster 2021-07-26T15:59:00.988366+0000 mon.a (mon.0) 122 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-07-26T15:59:02.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:01 smithi096 bash[33981]: audit 2021-07-26T15:59:01.204159+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:02.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:01 smithi096 bash[33981]: cephadm 2021-07-26T15:59:01.207253+0000 mgr.y (mgr.34104) 60 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2021-07-26T15:59:02.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:01 smithi096 bash[33981]: cephadm 2021-07-26T15:59:01.208561+0000 mgr.y (mgr.34104) 61 : cephadm [INF] Reconfiguring daemon osd.4 on smithi096 2021-07-26T15:59:03.012 INFO:tasks.rados.rados.0.smithi033.stdout:755: done (0 left) 2021-07-26T15:59:03.013 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 66 2021-07-26T15:59:03.013 INFO:tasks.rados.rados.0.smithi033.stdout:756: seq_num 236 ranges {3424256=761856,4186112=647168,4833280=155648} 2021-07-26T15:59:03.039 INFO:tasks.rados.rados.0.smithi033.stdout:756: writing smithi03339061-9 from 3424256 to 4186112 tid 1 2021-07-26T15:59:03.042 INFO:tasks.rados.rados.0.smithi033.stdout:756: writing smithi03339061-9 from 4186112 to 4833280 tid 2 2021-07-26T15:59:03.044 INFO:tasks.rados.rados.0.smithi033.stdout:756: writing smithi03339061-9 from 4833280 to 4988928 tid 3 2021-07-26T15:59:03.045 INFO:tasks.rados.rados.0.smithi033.stdout:757: delete oid 21 current snap is 66 2021-07-26T15:59:03.048 INFO:tasks.rados.rados.0.smithi033.stdout:757: done (1 left) 2021-07-26T15:59:03.048 INFO:tasks.rados.rados.0.smithi033.stdout:758: copy_from oid 7 from oid 30 current snap is 66 2021-07-26T15:59:03.048 INFO:tasks.rados.rados.0.smithi033.stdout:759: read oid 41 snap -1 2021-07-26T15:59:03.048 INFO:tasks.rados.rados.0.smithi033.stdout:759: expect (ObjNum 7 snap 0 seq_num 7) 2021-07-26T15:59:03.049 INFO:tasks.rados.rados.0.smithi033.stdout:760: rollback oid 25 current snap is 66 2021-07-26T15:59:03.049 INFO:tasks.rados.rados.0.smithi033.stdout:760: done (3 left) 2021-07-26T15:59:03.049 INFO:tasks.rados.rados.0.smithi033.stdout:761: read oid 44 snap -1 2021-07-26T15:59:03.049 INFO:tasks.rados.rados.0.smithi033.stdout:761: expect (ObjNum 181 snap 47 seq_num 181) 2021-07-26T15:59:03.050 INFO:tasks.rados.rados.0.smithi033.stdout:762: snap_create 2021-07-26T15:59:03.053 INFO:tasks.rados.rados.0.smithi033.stdout:759: expect (ObjNum 7 snap 0 seq_num 7) 2021-07-26T15:59:03.059 INFO:tasks.rados.rados.0.smithi033.stdout:756: finishing write tid 1 to smithi03339061-9 2021-07-26T15:59:03.059 INFO:tasks.rados.rados.0.smithi033.stdout:756: finishing write tid 2 to smithi03339061-9 2021-07-26T15:59:03.059 INFO:tasks.rados.rados.0.smithi033.stdout:756: finishing write tid 3 to smithi03339061-9 2021-07-26T15:59:03.059 INFO:tasks.rados.rados.0.smithi033.stdout:756: finishing write tid 4 to smithi03339061-9 2021-07-26T15:59:03.060 INFO:tasks.rados.rados.0.smithi033.stdout:761: expect (ObjNum 181 snap 47 seq_num 181) 2021-07-26T15:59:03.083 INFO:tasks.rados.rados.0.smithi033.stdout:756: finishing write tid 5 to smithi03339061-9 2021-07-26T15:59:03.084 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 207 (ObjNum 236 snap 66 seq_num 236) dirty exists 2021-07-26T15:59:03.084 INFO:tasks.rados.rados.0.smithi033.stdout:756: left oid 9 (ObjNum 236 snap 66 seq_num 236) 2021-07-26T15:59:03.084 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:03 smithi096 bash[33981]: cluster 2021-07-26T15:59:02.001069+0000 mon.a (mon.0) 124 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-07-26T15:59:03.092 INFO:tasks.rados.rados.0.smithi033.stdout:758: finishing copy_from to smithi03339061-7 2021-07-26T15:59:03.092 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 212 (ObjNum 204 snap 55 seq_num 204) dirty exists 2021-07-26T15:59:03.094 INFO:tasks.rados.rados.0.smithi033.stdout:758: finishing copy_from racing read to smithi03339061-7 2021-07-26T15:59:03.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:03 smithi033 bash[41341]: cluster 2021-07-26T15:59:02.001069+0000 mon.a (mon.0) 124 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-07-26T15:59:03.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:03 smithi033 bash[42377]: cluster 2021-07-26T15:59:02.001069+0000 mon.a (mon.0) 124 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-07-26T15:59:03.486 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 15:59:03 smithi096 bash[17896]: debug 2021-07-26T15:59:03.082+0000 7f4643f94700 -1 osd.4 pg_epoch: 194 pg[3.3s0( v 193'179 (0'0,193'179] local-lis/les=57/58 n=2 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [4,1,0]p4(0) r=0 lpr=57 crt=193'179 lcod 192'177 mlcod 192'177 active+clean+snaptrim trimq=[84~1] ps=[75~1,77~4,7c~1,7f~1]] removing snap head 2021-07-26T15:59:03.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:03 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:03.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:03 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:03.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:03 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:03.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T15:59:04.020 INFO:tasks.rados.rados.0.smithi033.stdout:756: done (4 left) 2021-07-26T15:59:04.020 INFO:tasks.rados.rados.0.smithi033.stdout:758: done (3 left) 2021-07-26T15:59:04.021 INFO:tasks.rados.rados.0.smithi033.stdout:759: done (2 left) 2021-07-26T15:59:04.021 INFO:tasks.rados.rados.0.smithi033.stdout:761: done (1 left) 2021-07-26T15:59:04.021 INFO:tasks.rados.rados.0.smithi033.stdout:762: done (0 left) 2021-07-26T15:59:04.021 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 37 current snap is 67 2021-07-26T15:59:04.021 INFO:tasks.rados.rados.0.smithi033.stdout:763: seq_num 238 ranges {606208=794624,1400832=417792,1818624=385024} 2021-07-26T15:59:04.029 INFO:tasks.rados.rados.0.smithi033.stdout:763: writing smithi03339061-37 from 606208 to 1400832 tid 1 2021-07-26T15:59:04.032 INFO:tasks.rados.rados.0.smithi033.stdout:763: writing smithi03339061-37 from 1400832 to 1818624 tid 2 2021-07-26T15:59:04.034 INFO:tasks.rados.rados.0.smithi033.stdout:763: writing smithi03339061-37 from 1818624 to 2203648 tid 3 2021-07-26T15:59:04.035 INFO:tasks.rados.rados.0.smithi033.stdout:764: read oid 32 snap -1 2021-07-26T15:59:04.035 INFO:tasks.rados.rados.0.smithi033.stdout:764: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:59:04.035 INFO:tasks.rados.rados.0.smithi033.stdout:765: snap_create 2021-07-26T15:59:04.036 INFO:tasks.rados.rados.0.smithi033.stdout:764: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T15:59:04.042 INFO:tasks.rados.rados.0.smithi033.stdout:763: finishing write tid 1 to smithi03339061-37 2021-07-26T15:59:04.042 INFO:tasks.rados.rados.0.smithi033.stdout:763: finishing write tid 2 to smithi03339061-37 2021-07-26T15:59:04.043 INFO:tasks.rados.rados.0.smithi033.stdout:763: finishing write tid 3 to smithi03339061-37 2021-07-26T15:59:04.043 INFO:tasks.rados.rados.0.smithi033.stdout:763: finishing write tid 4 to smithi03339061-37 2021-07-26T15:59:04.046 INFO:tasks.rados.rados.0.smithi033.stdout:763: finishing write tid 5 to smithi03339061-37 2021-07-26T15:59:04.046 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 232 (ObjNum 238 snap 67 seq_num 238) dirty exists 2021-07-26T15:59:04.047 INFO:tasks.rados.rados.0.smithi033.stdout:763: left oid 37 (ObjNum 238 snap 67 seq_num 238) 2021-07-26T15:59:04.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:04 smithi033 bash[41341]: cluster 2021-07-26T15:59:02.959236+0000 mgr.y (mgr.34104) 62 : cluster [DBG] pgmap v77: 25 pgs: 25 active+clean; 85 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.4 MiB/s wr, 15 op/s 2021-07-26T15:59:04.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:04 smithi033 bash[41341]: cluster 2021-07-26T15:59:03.009824+0000 mon.a (mon.0) 125 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-07-26T15:59:04.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:04 smithi033 bash[41341]: audit 2021-07-26T15:59:03.352063+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:04.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:04 smithi033 bash[41341]: cephadm 2021-07-26T15:59:03.354942+0000 mgr.y (mgr.34104) 63 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-07-26T15:59:04.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:04 smithi033 bash[41341]: cephadm 2021-07-26T15:59:03.356740+0000 mgr.y (mgr.34104) 64 : cephadm [INF] Reconfiguring daemon osd.5 on smithi096 2021-07-26T15:59:04.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:04 smithi033 bash[42377]: cluster 2021-07-26T15:59:02.959236+0000 mgr.y (mgr.34104) 62 : cluster [DBG] pgmap v77: 25 pgs: 25 active+clean; 85 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.4 MiB/s wr, 15 op/s 2021-07-26T15:59:04.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:04 smithi033 bash[42377]: cluster 2021-07-26T15:59:03.009824+0000 mon.a (mon.0) 125 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-07-26T15:59:04.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:04 smithi033 bash[42377]: audit 2021-07-26T15:59:03.352063+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:04.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:04 smithi033 bash[42377]: cephadm 2021-07-26T15:59:03.354942+0000 mgr.y (mgr.34104) 63 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-07-26T15:59:04.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:04 smithi033 bash[42377]: cephadm 2021-07-26T15:59:03.356740+0000 mgr.y (mgr.34104) 64 : cephadm [INF] Reconfiguring daemon osd.5 on smithi096 2021-07-26T15:59:04.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:04 smithi096 bash[33981]: cluster 2021-07-26T15:59:02.959236+0000 mgr.y (mgr.34104) 62 : cluster [DBG] pgmap v77: 25 pgs: 25 active+clean; 85 MiB data, 411 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.4 MiB/s wr, 15 op/s 2021-07-26T15:59:04.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:04 smithi096 bash[33981]: cluster 2021-07-26T15:59:03.009824+0000 mon.a (mon.0) 125 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-07-26T15:59:04.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:04 smithi096 bash[33981]: audit 2021-07-26T15:59:03.352063+0000 mon.a (mon.0) 126 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:04.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:04 smithi096 bash[33981]: cephadm 2021-07-26T15:59:03.354942+0000 mgr.y (mgr.34104) 63 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2021-07-26T15:59:04.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:04 smithi096 bash[33981]: cephadm 2021-07-26T15:59:03.356740+0000 mgr.y (mgr.34104) 64 : cephadm [INF] Reconfiguring daemon osd.5 on smithi096 2021-07-26T15:59:05.031 INFO:tasks.rados.rados.0.smithi033.stdout:763: done (2 left) 2021-07-26T15:59:05.031 INFO:tasks.rados.rados.0.smithi033.stdout:764: done (1 left) 2021-07-26T15:59:05.032 INFO:tasks.rados.rados.0.smithi033.stdout:765: done (0 left) 2021-07-26T15:59:05.032 INFO:tasks.rados.rados.0.smithi033.stdout:766: rollback oid 34 current snap is 68 2021-07-26T15:59:05.032 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 34 to 67 2021-07-26T15:59:05.032 INFO:tasks.rados.rados.0.smithi033.stdout:767: delete oid 12 current snap is 68 2021-07-26T15:59:05.040 INFO:tasks.rados.rados.0.smithi033.stdout:767: done (1 left) 2021-07-26T15:59:05.040 INFO:tasks.rados.rados.0.smithi033.stdout:768: rmattr oid 37 current snap is 68 2021-07-26T15:59:05.041 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 68 2021-07-26T15:59:05.041 INFO:tasks.rados.rados.0.smithi033.stdout:769: seq_num 240 ranges {0=425984,425984=589824,1015808=483328,1499136=131072} 2021-07-26T15:59:05.046 INFO:tasks.rados.rados.0.smithi033.stdout:769: writing smithi03339061-24 from 0 to 425984 tid 1 2021-07-26T15:59:05.051 INFO:tasks.rados.rados.0.smithi033.stdout:769: writing smithi03339061-24 from 425984 to 1015808 tid 2 2021-07-26T15:59:05.054 INFO:tasks.rados.rados.0.smithi033.stdout:769: writing smithi03339061-24 from 1015808 to 1499136 tid 3 2021-07-26T15:59:05.056 INFO:tasks.rados.rados.0.smithi033.stdout:769: writing smithi03339061-24 from 1499136 to 1630208 tid 4 2021-07-26T15:59:05.056 INFO:tasks.rados.rados.0.smithi033.stdout:770: rollback oid 31 current snap is 68 2021-07-26T15:59:05.056 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 31 to 66 2021-07-26T15:59:05.057 INFO:tasks.rados.rados.0.smithi033.stdout:766: finishing rollback tid 0 to smithi03339061-34 2021-07-26T15:59:05.057 INFO:tasks.rados.rados.0.smithi033.stdout:766: finishing rollback tid 1 to smithi03339061-34 2021-07-26T15:59:05.057 INFO:tasks.rados.rados.0.smithi033.stdout:766: finishing rollback tid 2 to smithi03339061-34 2021-07-26T15:59:05.057 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 189 (ObjNum 214 snap 57 seq_num 214) dirty exists 2021-07-26T15:59:05.057 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 234 (ObjNum 238 snap 67 seq_num 238) dirty exists 2021-07-26T15:59:05.058 INFO:tasks.rados.rados.0.smithi033.stdout:769: finishing write tid 1 to smithi03339061-24 2021-07-26T15:59:05.058 INFO:tasks.rados.rados.0.smithi033.stdout:769: finishing write tid 2 to smithi03339061-24 2021-07-26T15:59:05.058 INFO:tasks.rados.rados.0.smithi033.stdout:766: done (3 left) 2021-07-26T15:59:05.058 INFO:tasks.rados.rados.0.smithi033.stdout:768: done (2 left) 2021-07-26T15:59:05.059 INFO:tasks.rados.rados.0.smithi033.stdout:771: read oid 38 snap -1 2021-07-26T15:59:05.059 INFO:tasks.rados.rados.0.smithi033.stdout:771: expect (ObjNum 205 snap 55 seq_num 205) 2021-07-26T15:59:05.059 INFO:tasks.rados.rados.0.smithi033.stdout:772: snap_create 2021-07-26T15:59:05.059 INFO:tasks.rados.rados.0.smithi033.stdout:770: finishing rollback tid 1 to smithi03339061-31 2021-07-26T15:59:05.059 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 0 (ObjNum 2006389328 snap 22002 seq_num 2007094136) dirty dne 2021-07-26T15:59:05.061 INFO:tasks.rados.rados.0.smithi033.stdout:769: finishing write tid 3 to smithi03339061-24 2021-07-26T15:59:05.063 INFO:tasks.rados.rados.0.smithi033.stdout:769: finishing write tid 4 to smithi03339061-24 2021-07-26T15:59:05.064 INFO:tasks.rados.rados.0.smithi033.stdout:769: finishing write tid 5 to smithi03339061-24 2021-07-26T15:59:05.065 INFO:tasks.rados.rados.0.smithi033.stdout:771: expect (ObjNum 205 snap 55 seq_num 205) 2021-07-26T15:59:05.140 INFO:tasks.rados.rados.0.smithi033.stdout:769: finishing write tid 6 to smithi03339061-24 2021-07-26T15:59:05.141 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 240 (ObjNum 240 snap 68 seq_num 240) dirty exists 2021-07-26T15:59:05.141 INFO:tasks.rados.rados.0.smithi033.stdout:769: left oid 24 (ObjNum 240 snap 68 seq_num 240) 2021-07-26T15:59:05.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:05 smithi033 bash[41341]: cluster 2021-07-26T15:59:04.017736+0000 mon.a (mon.0) 127 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-07-26T15:59:05.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:05 smithi033 bash[42377]: cluster 2021-07-26T15:59:04.017736+0000 mon.a (mon.0) 127 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-07-26T15:59:05.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:05 smithi096 bash[33981]: cluster 2021-07-26T15:59:04.017736+0000 mon.a (mon.0) 127 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-07-26T15:59:05.938 INFO:tasks.rados.rados.0.smithi033.stdout:769: done (3 left) 2021-07-26T15:59:05.938 INFO:tasks.rados.rados.0.smithi033.stdout:770: done (2 left) 2021-07-26T15:59:05.939 INFO:tasks.rados.rados.0.smithi033.stdout:771: done (1 left) 2021-07-26T15:59:05.940 INFO:tasks.rados.rados.0.smithi033.stdout:772: done (0 left) 2021-07-26T15:59:05.940 INFO:tasks.rados.rados.0.smithi033.stdout:773: read oid 10 snap 68 2021-07-26T15:59:05.940 INFO:tasks.rados.rados.0.smithi033.stdout:773: expect (ObjNum 217 snap 60 seq_num 217) 2021-07-26T15:59:05.941 INFO:tasks.rados.rados.0.smithi033.stdout:774: rmattr oid 16 current snap is 69 2021-07-26T15:59:05.941 INFO:tasks.rados.rados.0.smithi033.stdout:774: done (1 left) 2021-07-26T15:59:05.941 INFO:tasks.rados.rados.0.smithi033.stdout:775: snap_remove snap 67 2021-07-26T15:59:06.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:06 smithi096 bash[33981]: cluster 2021-07-26T15:59:04.960271+0000 mgr.y (mgr.34104) 65 : cluster [DBG] pgmap v80: 25 pgs: 25 active+clean; 78 MiB data, 422 MiB used, 715 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 16 op/s 2021-07-26T15:59:06.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:06 smithi096 bash[33981]: cluster 2021-07-26T15:59:05.028833+0000 mon.a (mon.0) 128 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-07-26T15:59:06.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:06 smithi096 bash[33981]: audit 2021-07-26T15:59:05.632094+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:06.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:06 smithi096 bash[33981]: cluster 2021-07-26T15:59:05.933883+0000 mon.a (mon.0) 130 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-07-26T15:59:06.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:06 smithi033 bash[41341]: cluster 2021-07-26T15:59:04.960271+0000 mgr.y (mgr.34104) 65 : cluster [DBG] pgmap v80: 25 pgs: 25 active+clean; 78 MiB data, 422 MiB used, 715 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 16 op/s 2021-07-26T15:59:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:06 smithi033 bash[41341]: cluster 2021-07-26T15:59:05.028833+0000 mon.a (mon.0) 128 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-07-26T15:59:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:06 smithi033 bash[41341]: audit 2021-07-26T15:59:05.632094+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:06 smithi033 bash[41341]: cluster 2021-07-26T15:59:05.933883+0000 mon.a (mon.0) 130 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-07-26T15:59:06.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:06 smithi033 bash[42377]: cluster 2021-07-26T15:59:04.960271+0000 mgr.y (mgr.34104) 65 : cluster [DBG] pgmap v80: 25 pgs: 25 active+clean; 78 MiB data, 422 MiB used, 715 GiB / 715 GiB avail; 2.6 MiB/s rd, 3.7 MiB/s wr, 16 op/s 2021-07-26T15:59:06.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:06 smithi033 bash[42377]: cluster 2021-07-26T15:59:05.028833+0000 mon.a (mon.0) 128 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-07-26T15:59:06.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:06 smithi033 bash[42377]: audit 2021-07-26T15:59:05.632094+0000 mon.a (mon.0) 129 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:06.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:06 smithi033 bash[42377]: cluster 2021-07-26T15:59:05.933883+0000 mon.a (mon.0) 130 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-07-26T15:59:06.952 INFO:tasks.rados.rados.0.smithi033.stdout:775: done (1 left) 2021-07-26T15:59:06.952 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 69 2021-07-26T15:59:06.952 INFO:tasks.rados.rados.0.smithi033.stdout:776: seq_num 241 ranges {4988928=442368,5431296=466944,5898240=688128,6586368=49152} 2021-07-26T15:59:06.986 INFO:tasks.rados.rados.0.smithi033.stdout:776: writing smithi03339061-9 from 4988928 to 5431296 tid 1 2021-07-26T15:59:06.988 INFO:tasks.rados.rados.0.smithi033.stdout:776: writing smithi03339061-9 from 5431296 to 5898240 tid 2 2021-07-26T15:59:06.993 INFO:tasks.rados.rados.0.smithi033.stdout:776: writing smithi03339061-9 from 5898240 to 6586368 tid 3 2021-07-26T15:59:06.994 INFO:tasks.rados.rados.0.smithi033.stdout:776: writing smithi03339061-9 from 6586368 to 6635520 tid 4 2021-07-26T15:59:06.994 INFO:tasks.rados.rados.0.smithi033.stdout:777: rmattr oid 38 current snap is 69 2021-07-26T15:59:06.995 INFO:tasks.rados.rados.0.smithi033.stdout:773: expect (ObjNum 217 snap 60 seq_num 217) 2021-07-26T15:59:07.031 INFO:tasks.rados.rados.0.smithi033.stdout:776: finishing write tid 1 to smithi03339061-9 2021-07-26T15:59:07.032 INFO:tasks.rados.rados.0.smithi033.stdout:776: finishing write tid 2 to smithi03339061-9 2021-07-26T15:59:07.032 INFO:tasks.rados.rados.0.smithi033.stdout:776: finishing write tid 3 to smithi03339061-9 2021-07-26T15:59:07.032 INFO:tasks.rados.rados.0.smithi033.stdout:776: finishing write tid 4 to smithi03339061-9 2021-07-26T15:59:07.032 INFO:tasks.rados.rados.0.smithi033.stdout:773: done (2 left) 2021-07-26T15:59:07.032 INFO:tasks.rados.rados.0.smithi033.stdout:778: snap_remove snap 68 2021-07-26T15:59:07.130 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:07 smithi096 bash[33981]: cephadm 2021-07-26T15:59:05.634906+0000 mgr.y (mgr.34104) 66 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-07-26T15:59:07.130 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:07 smithi096 bash[33981]: cephadm 2021-07-26T15:59:05.636700+0000 mgr.y (mgr.34104) 67 : cephadm [INF] Reconfiguring daemon osd.6 on smithi096 2021-07-26T15:59:07.130 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:07 smithi096 bash[33981]: cluster 2021-07-26T15:59:06.946378+0000 mon.a (mon.0) 131 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-07-26T15:59:07.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:07 smithi033 bash[41341]: cephadm 2021-07-26T15:59:05.634906+0000 mgr.y (mgr.34104) 66 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-07-26T15:59:07.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:07 smithi033 bash[41341]: cephadm 2021-07-26T15:59:05.636700+0000 mgr.y (mgr.34104) 67 : cephadm [INF] Reconfiguring daemon osd.6 on smithi096 2021-07-26T15:59:07.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:07 smithi033 bash[41341]: cluster 2021-07-26T15:59:06.946378+0000 mon.a (mon.0) 131 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-07-26T15:59:07.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:07 smithi033 bash[42377]: cephadm 2021-07-26T15:59:05.634906+0000 mgr.y (mgr.34104) 66 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2021-07-26T15:59:07.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:07 smithi033 bash[42377]: cephadm 2021-07-26T15:59:05.636700+0000 mgr.y (mgr.34104) 67 : cephadm [INF] Reconfiguring daemon osd.6 on smithi096 2021-07-26T15:59:07.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:07 smithi033 bash[42377]: cluster 2021-07-26T15:59:06.946378+0000 mon.a (mon.0) 131 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-07-26T15:59:08.037 INFO:tasks.rados.rados.0.smithi033.stdout:778: done (2 left) 2021-07-26T15:59:08.038 INFO:tasks.rados.rados.0.smithi033.stdout:779: copy_from oid 28 from oid 1 current snap is 69 2021-07-26T15:59:08.038 INFO:tasks.rados.rados.0.smithi033.stdout:780: read oid 7 snap -1 2021-07-26T15:59:08.038 INFO:tasks.rados.rados.0.smithi033.stdout:780: expect (ObjNum 204 snap 55 seq_num 204) 2021-07-26T15:59:08.039 INFO:tasks.rados.rados.0.smithi033.stdout:781: copy_from oid 44 from oid 48 current snap is 69 2021-07-26T15:59:08.039 INFO:tasks.rados.rados.0.smithi033.stdout:776: finishing write tid 5 to smithi03339061-9 2021-07-26T15:59:08.040 INFO:tasks.rados.rados.0.smithi033.stdout:776: finishing write tid 6 to smithi03339061-9 2021-07-26T15:59:08.040 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 213 (ObjNum 241 snap 69 seq_num 241) dirty exists 2021-07-26T15:59:08.040 INFO:tasks.rados.rados.0.smithi033.stdout:776: left oid 9 (ObjNum 241 snap 69 seq_num 241) 2021-07-26T15:59:08.040 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 50 (ObjNum 205 snap 55 seq_num 205) dirty exists 2021-07-26T15:59:08.041 INFO:tasks.rados.rados.0.smithi033.stdout:776: done (4 left) 2021-07-26T15:59:08.041 INFO:tasks.rados.rados.0.smithi033.stdout:777: done (3 left) 2021-07-26T15:59:08.041 INFO:tasks.rados.rados.0.smithi033.stdout:782: delete oid 13 current snap is 69 2021-07-26T15:59:08.043 INFO:tasks.rados.rados.0.smithi033.stdout:781: finishing copy_from to smithi03339061-44 2021-07-26T15:59:08.044 INFO:tasks.rados.rados.0.smithi033.stdout:781: got expected ENOENT (src dne) 2021-07-26T15:59:08.044 INFO:tasks.rados.rados.0.smithi033.stdout:781: finishing copy_from racing read to smithi03339061-44 2021-07-26T15:59:08.045 INFO:tasks.rados.rados.0.smithi033.stdout:781: done (3 left) 2021-07-26T15:59:08.045 INFO:tasks.rados.rados.0.smithi033.stdout:782: done (2 left) 2021-07-26T15:59:08.045 INFO:tasks.rados.rados.0.smithi033.stdout:783: rollback oid 45 current snap is 69 2021-07-26T15:59:08.046 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 45 to 66 2021-07-26T15:59:08.046 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 69 2021-07-26T15:59:08.046 INFO:tasks.rados.rados.0.smithi033.stdout:784: seq_num 243 ranges {4136960=475136,4612096=638976,5251072=565248} 2021-07-26T15:59:08.072 INFO:tasks.rados.rados.0.smithi033.stdout:784: writing smithi03339061-6 from 4136960 to 4612096 tid 1 2021-07-26T15:59:08.078 INFO:tasks.rados.rados.0.smithi033.stdout:784: writing smithi03339061-6 from 4612096 to 5251072 tid 2 2021-07-26T15:59:08.079 INFO:tasks.rados.rados.0.smithi033.stdout:784: writing smithi03339061-6 from 5251072 to 5816320 tid 3 2021-07-26T15:59:08.079 INFO:tasks.rados.rados.0.smithi033.stdout:785: copy_from oid 42 from oid 36 current snap is 69 2021-07-26T15:59:08.079 INFO:tasks.rados.rados.0.smithi033.stdout:783: finishing rollback tid 1 to smithi03339061-45 2021-07-26T15:59:08.080 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 0 (ObjNum 288 snap 0 seq_num 65) dirty dne 2021-07-26T15:59:08.080 INFO:tasks.rados.rados.0.smithi033.stdout:779: finishing copy_from to smithi03339061-28 2021-07-26T15:59:08.080 INFO:tasks.rados.rados.0.smithi033.stdout:779: got expected ENOENT (src dne) 2021-07-26T15:59:08.080 INFO:tasks.rados.rados.0.smithi033.stdout:779: finishing copy_from racing read to smithi03339061-28 2021-07-26T15:59:08.081 INFO:tasks.rados.rados.0.smithi033.stdout:780: expect (ObjNum 204 snap 55 seq_num 204) 2021-07-26T15:59:08.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:08 smithi096 bash[33981]: cluster 2021-07-26T15:59:06.960895+0000 mgr.y (mgr.34104) 68 : cluster [DBG] pgmap v84: 25 pgs: 25 active+clean; 77 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 4.1 MiB/s wr, 20 op/s 2021-07-26T15:59:08.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:08 smithi096 bash[33981]: audit 2021-07-26T15:59:07.706755+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:08.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:08 smithi033 bash[41341]: cluster 2021-07-26T15:59:06.960895+0000 mgr.y (mgr.34104) 68 : cluster [DBG] pgmap v84: 25 pgs: 25 active+clean; 77 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 4.1 MiB/s wr, 20 op/s 2021-07-26T15:59:08.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:08 smithi033 bash[41341]: audit 2021-07-26T15:59:07.706755+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:08.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:08 smithi033 bash[42377]: cluster 2021-07-26T15:59:06.960895+0000 mgr.y (mgr.34104) 68 : cluster [DBG] pgmap v84: 25 pgs: 25 active+clean; 77 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 5.6 MiB/s rd, 4.1 MiB/s wr, 20 op/s 2021-07-26T15:59:08.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:08 smithi033 bash[42377]: audit 2021-07-26T15:59:07.706755+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:08.628 INFO:tasks.rados.rados.0.smithi033.stdout:784: finishing write tid 1 to smithi03339061-6 2021-07-26T15:59:08.629 INFO:tasks.rados.rados.0.smithi033.stdout:784: finishing write tid 2 to smithi03339061-6 2021-07-26T15:59:08.629 INFO:tasks.rados.rados.0.smithi033.stdout:784: finishing write tid 3 to smithi03339061-6 2021-07-26T15:59:08.629 INFO:tasks.rados.rados.0.smithi033.stdout:784: finishing write tid 4 to smithi03339061-6 2021-07-26T15:59:08.630 INFO:tasks.rados.rados.0.smithi033.stdout:784: finishing write tid 5 to smithi03339061-6 2021-07-26T15:59:08.630 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 457 (ObjNum 243 snap 69 seq_num 243) dirty exists 2021-07-26T15:59:08.630 INFO:tasks.rados.rados.0.smithi033.stdout:784: left oid 6 (ObjNum 243 snap 69 seq_num 243) 2021-07-26T15:59:08.630 INFO:tasks.rados.rados.0.smithi033.stdout:785: finishing copy_from to smithi03339061-42 2021-07-26T15:59:08.630 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 186 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:08.631 INFO:tasks.rados.rados.0.smithi033.stdout:785: finishing copy_from racing read to smithi03339061-42 2021-07-26T15:59:08.631 INFO:tasks.rados.rados.0.smithi033.stdout:779: done (4 left) 2021-07-26T15:59:08.631 INFO:tasks.rados.rados.0.smithi033.stdout:780: done (3 left) 2021-07-26T15:59:08.632 INFO:tasks.rados.rados.0.smithi033.stdout:783: done (2 left) 2021-07-26T15:59:08.632 INFO:tasks.rados.rados.0.smithi033.stdout:784: done (1 left) 2021-07-26T15:59:08.632 INFO:tasks.rados.rados.0.smithi033.stdout:785: done (0 left) 2021-07-26T15:59:08.632 INFO:tasks.rados.rados.0.smithi033.stdout:786: snap_remove snap 66 2021-07-26T15:59:09.061 INFO:tasks.rados.rados.0.smithi033.stdout:786: done (0 left) 2021-07-26T15:59:09.061 INFO:tasks.rados.rados.0.smithi033.stdout:787: rollback oid 28 current snap is 69 2021-07-26T15:59:09.061 INFO:tasks.rados.rados.0.smithi033.stdout:787: done (0 left) 2021-07-26T15:59:09.061 INFO:tasks.rados.rados.0.smithi033.stdout:788: snap_create 2021-07-26T15:59:09.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:09 smithi096 bash[33981]: cephadm 2021-07-26T15:59:07.710114+0000 mgr.y (mgr.34104) 69 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-07-26T15:59:09.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:09 smithi096 bash[33981]: cephadm 2021-07-26T15:59:07.711194+0000 mgr.y (mgr.34104) 70 : cephadm [INF] Reconfiguring daemon osd.7 on smithi096 2021-07-26T15:59:09.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:09 smithi096 bash[33981]: cluster 2021-07-26T15:59:08.033589+0000 mon.a (mon.0) 133 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-07-26T15:59:09.237 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 15:59:09 smithi096 bash[20458]: debug 2021-07-26T15:59:09.050+0000 7f2dd3f3e700 -1 osd.5 pg_epoch: 200 pg[3.5s0( v 198'195 (0'0,198'195] local-lis/les=57/58 n=3 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [5,3,2]p5(0) r=0 lpr=57 crt=198'195 lcod 196'193 mlcod 196'193 active+clean+snaptrim trimq=[86~1] ps=[77~2,84~1,87~2]] removing snap head 2021-07-26T15:59:09.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:09 smithi033 bash[41341]: cephadm 2021-07-26T15:59:07.710114+0000 mgr.y (mgr.34104) 69 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-07-26T15:59:09.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:09 smithi033 bash[41341]: cephadm 2021-07-26T15:59:07.711194+0000 mgr.y (mgr.34104) 70 : cephadm [INF] Reconfiguring daemon osd.7 on smithi096 2021-07-26T15:59:09.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:09 smithi033 bash[41341]: cluster 2021-07-26T15:59:08.033589+0000 mon.a (mon.0) 133 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-07-26T15:59:09.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:09 smithi033 bash[42377]: cephadm 2021-07-26T15:59:07.710114+0000 mgr.y (mgr.34104) 69 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2021-07-26T15:59:09.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:09 smithi033 bash[42377]: cephadm 2021-07-26T15:59:07.711194+0000 mgr.y (mgr.34104) 70 : cephadm [INF] Reconfiguring daemon osd.7 on smithi096 2021-07-26T15:59:09.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:09 smithi033 bash[42377]: cluster 2021-07-26T15:59:08.033589+0000 mon.a (mon.0) 133 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-07-26T15:59:10.065 INFO:tasks.rados.rados.0.smithi033.stdout:788: done (0 left) 2021-07-26T15:59:10.065 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 16 current snap is 70 2021-07-26T15:59:10.066 INFO:tasks.rados.rados.0.smithi033.stdout:789: seq_num 244 ranges {3317760=491520,3809280=573440,4382720=458752,4841472=172032} 2021-07-26T15:59:10.086 INFO:tasks.rados.rados.0.smithi033.stdout:789: writing smithi03339061-16 from 3317760 to 3809280 tid 1 2021-07-26T15:59:10.089 INFO:tasks.rados.rados.0.smithi033.stdout:789: writing smithi03339061-16 from 3809280 to 4382720 tid 2 2021-07-26T15:59:10.096 INFO:tasks.rados.rados.0.smithi033.stdout:789: writing smithi03339061-16 from 4382720 to 4841472 tid 3 2021-07-26T15:59:10.096 INFO:tasks.rados.rados.0.smithi033.stdout:789: writing smithi03339061-16 from 4841472 to 5013504 tid 4 2021-07-26T15:59:10.096 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 70 2021-07-26T15:59:10.096 INFO:tasks.rados.rados.0.smithi033.stdout:790: seq_num 245 ranges {7020544=507904,7528448=458752,7987200=671744,8658944=73728} 2021-07-26T15:59:10.136 INFO:tasks.rados.rados.0.smithi033.stdout:790: writing smithi03339061-30 from 7020544 to 7528448 tid 1 2021-07-26T15:59:10.139 INFO:tasks.rados.rados.0.smithi033.stdout:790: writing smithi03339061-30 from 7528448 to 7987200 tid 2 2021-07-26T15:59:10.143 INFO:tasks.rados.rados.0.smithi033.stdout:790: writing smithi03339061-30 from 7987200 to 8658944 tid 3 2021-07-26T15:59:10.144 INFO:tasks.rados.rados.0.smithi033.stdout:790: writing smithi03339061-30 from 8658944 to 8732672 tid 4 2021-07-26T15:59:10.144 INFO:tasks.rados.rados.0.smithi033.stdout:791: snap_create 2021-07-26T15:59:10.144 INFO:tasks.rados.rados.0.smithi033.stdout:789: finishing write tid 1 to smithi03339061-16 2021-07-26T15:59:10.144 INFO:tasks.rados.rados.0.smithi033.stdout:789: finishing write tid 2 to smithi03339061-16 2021-07-26T15:59:10.145 INFO:tasks.rados.rados.0.smithi033.stdout:789: finishing write tid 3 to smithi03339061-16 2021-07-26T15:59:10.145 INFO:tasks.rados.rados.0.smithi033.stdout:789: finishing write tid 4 to smithi03339061-16 2021-07-26T15:59:10.145 INFO:tasks.rados.rados.0.smithi033.stdout:789: finishing write tid 5 to smithi03339061-16 2021-07-26T15:59:10.145 INFO:tasks.rados.rados.0.smithi033.stdout:789: finishing write tid 6 to smithi03339061-16 2021-07-26T15:59:10.146 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 203 (ObjNum 244 snap 70 seq_num 244) dirty exists 2021-07-26T15:59:10.146 INFO:tasks.rados.rados.0.smithi033.stdout:789: left oid 16 (ObjNum 244 snap 70 seq_num 244) 2021-07-26T15:59:10.146 INFO:tasks.rados.rados.0.smithi033.stdout:790: finishing write tid 1 to smithi03339061-30 2021-07-26T15:59:10.146 INFO:tasks.rados.rados.0.smithi033.stdout:790: finishing write tid 2 to smithi03339061-30 2021-07-26T15:59:10.150 INFO:tasks.rados.rados.0.smithi033.stdout:790: finishing write tid 3 to smithi03339061-30 2021-07-26T15:59:10.150 INFO:tasks.rados.rados.0.smithi033.stdout:790: finishing write tid 4 to smithi03339061-30 2021-07-26T15:59:10.151 INFO:tasks.rados.rados.0.smithi033.stdout:790: finishing write tid 5 to smithi03339061-30 2021-07-26T15:59:10.153 INFO:tasks.rados.rados.0.smithi033.stdout:790: finishing write tid 6 to smithi03339061-30 2021-07-26T15:59:10.153 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 254 (ObjNum 245 snap 70 seq_num 245) dirty exists 2021-07-26T15:59:10.153 INFO:tasks.rados.rados.0.smithi033.stdout:790: left oid 30 (ObjNum 245 snap 70 seq_num 245) 2021-07-26T15:59:10.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: cluster 2021-07-26T15:59:08.961556+0000 mgr.y (mgr.34104) 71 : cluster [DBG] pgmap v86: 25 pgs: 25 active+clean; 77 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 2.9 MiB/s rd, 382 KiB/s wr, 4 op/s 2021-07-26T15:59:10.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: cluster 2021-07-26T15:59:09.057791+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-07-26T15:59:10.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.151649+0000 mon.c (mon.1) 27 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:59:10.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.152503+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:59:10.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.184107+0000 mon.c (mon.1) 28 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:59:10.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.184840+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:59:10.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.775100+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:10.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.781998+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:10.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.784831+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:10.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.787333+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:10.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.799474+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:10.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.801558+0000 mon.c (mon.1) 32 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-07-26T15:59:10.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.802330+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-07-26T15:59:10.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.810735+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-07-26T15:59:10.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.812840+0000 mon.c (mon.1) 33 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-07-26T15:59:10.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.813519+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-07-26T15:59:10.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.820882+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-07-26T15:59:10.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.822377+0000 mon.c (mon.1) 34 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-07-26T15:59:10.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: cluster 2021-07-26T15:59:08.961556+0000 mgr.y (mgr.34104) 71 : cluster [DBG] pgmap v86: 25 pgs: 25 active+clean; 77 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 2.9 MiB/s rd, 382 KiB/s wr, 4 op/s 2021-07-26T15:59:10.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: cluster 2021-07-26T15:59:09.057791+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-07-26T15:59:10.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.151649+0000 mon.c (mon.1) 27 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:59:10.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.152503+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:59:10.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.184107+0000 mon.c (mon.1) 28 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:59:10.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.184840+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:59:10.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.775100+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:10.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.781998+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:10.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.784831+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:10.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.787333+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:10.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.799474+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:10.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.801558+0000 mon.c (mon.1) 32 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-07-26T15:59:10.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.802330+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-07-26T15:59:10.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.810735+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-07-26T15:59:10.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.812840+0000 mon.c (mon.1) 33 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-07-26T15:59:10.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.813519+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-07-26T15:59:10.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.820882+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-07-26T15:59:10.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.822377+0000 mon.c (mon.1) 34 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-07-26T15:59:10.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.822894+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-07-26T15:59:10.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.827691+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-07-26T15:59:10.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.830831+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:10.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.841082+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:10.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[41341]: audit 2021-07-26T15:59:09.843637+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-07-26T15:59:10.474 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.822894+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-07-26T15:59:10.474 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.827691+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-07-26T15:59:10.474 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.830831+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:10.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.841082+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:10.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:10 smithi033 bash[42377]: audit 2021-07-26T15:59:09.843637+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-07-26T15:59:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: cluster 2021-07-26T15:59:08.961556+0000 mgr.y (mgr.34104) 71 : cluster [DBG] pgmap v86: 25 pgs: 25 active+clean; 77 MiB data, 419 MiB used, 715 GiB / 715 GiB avail; 2.9 MiB/s rd, 382 KiB/s wr, 4 op/s 2021-07-26T15:59:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: cluster 2021-07-26T15:59:09.057791+0000 mon.a (mon.0) 134 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-07-26T15:59:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.151649+0000 mon.c (mon.1) 27 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:59:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.152503+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T15:59:10.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.184107+0000 mon.c (mon.1) 28 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:59:10.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.184840+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T15:59:10.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.775100+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:10.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.781998+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:10.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.784831+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:10.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.787333+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:10.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.799474+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:10.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.801558+0000 mon.c (mon.1) 32 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-07-26T15:59:10.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.802330+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2021-07-26T15:59:10.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.810735+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2021-07-26T15:59:10.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.812840+0000 mon.c (mon.1) 33 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-07-26T15:59:10.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.813519+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2021-07-26T15:59:10.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.820882+0000 mon.a (mon.0) 142 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2021-07-26T15:59:10.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.822377+0000 mon.c (mon.1) 34 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-07-26T15:59:10.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.822894+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2021-07-26T15:59:10.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.827691+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2021-07-26T15:59:10.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.830831+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:10.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.841082+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:10.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:10 smithi096 bash[33981]: audit 2021-07-26T15:59:09.843637+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-07-26T15:59:11.076 INFO:tasks.rados.rados.0.smithi033.stdout:789: done (2 left) 2021-07-26T15:59:11.077 INFO:tasks.rados.rados.0.smithi033.stdout:790: done (1 left) 2021-07-26T15:59:11.077 INFO:tasks.rados.rados.0.smithi033.stdout:791: done (0 left) 2021-07-26T15:59:11.077 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 71 2021-07-26T15:59:11.077 INFO:tasks.rados.rados.0.smithi033.stdout:792: seq_num 246 ranges {0=524288,524288=745472,1269760=425984,1695744=32768} 2021-07-26T15:59:11.080 INFO:tasks.rados.rados.0.smithi033.stdout:792: writing smithi03339061-45 from 0 to 524288 tid 1 2021-07-26T15:59:11.087 INFO:tasks.rados.rados.0.smithi033.stdout:792: writing smithi03339061-45 from 524288 to 1269760 tid 2 2021-07-26T15:59:11.090 INFO:tasks.rados.rados.0.smithi033.stdout:792: writing smithi03339061-45 from 1269760 to 1695744 tid 3 2021-07-26T15:59:11.091 INFO:tasks.rados.rados.0.smithi033.stdout:792: writing smithi03339061-45 from 1695744 to 1728512 tid 4 2021-07-26T15:59:11.091 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 71 2021-07-26T15:59:11.092 INFO:tasks.rados.rados.0.smithi033.stdout:792: finishing write tid 1 to smithi03339061-45 2021-07-26T15:59:11.092 INFO:tasks.rados.rados.0.smithi033.stdout:793: seq_num 247 ranges {1245184=540672,1785856=622592,2408448=581632} 2021-07-26T15:59:11.101 INFO:tasks.rados.rados.0.smithi033.stdout:793: writing smithi03339061-10 from 1245184 to 1785856 tid 1 2021-07-26T15:59:11.105 INFO:tasks.rados.rados.0.smithi033.stdout:793: writing smithi03339061-10 from 1785856 to 2408448 tid 2 2021-07-26T15:59:11.109 INFO:tasks.rados.rados.0.smithi033.stdout:793: writing smithi03339061-10 from 2408448 to 2990080 tid 3 2021-07-26T15:59:11.109 INFO:tasks.rados.rados.0.smithi033.stdout:794: delete oid 7 current snap is 71 2021-07-26T15:59:11.109 INFO:tasks.rados.rados.0.smithi033.stdout:792: finishing write tid 2 to smithi03339061-45 2021-07-26T15:59:11.109 INFO:tasks.rados.rados.0.smithi033.stdout:792: finishing write tid 3 to smithi03339061-45 2021-07-26T15:59:11.109 INFO:tasks.rados.rados.0.smithi033.stdout:792: finishing write tid 4 to smithi03339061-45 2021-07-26T15:59:11.110 INFO:tasks.rados.rados.0.smithi033.stdout:792: finishing write tid 5 to smithi03339061-45 2021-07-26T15:59:11.110 INFO:tasks.rados.rados.0.smithi033.stdout:792: finishing write tid 6 to smithi03339061-45 2021-07-26T15:59:11.110 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 464 (ObjNum 246 snap 71 seq_num 246) dirty exists 2021-07-26T15:59:11.110 INFO:tasks.rados.rados.0.smithi033.stdout:792: left oid 45 (ObjNum 246 snap 71 seq_num 246) 2021-07-26T15:59:11.111 INFO:tasks.rados.rados.0.smithi033.stdout:793: finishing write tid 1 to smithi03339061-10 2021-07-26T15:59:11.111 INFO:tasks.rados.rados.0.smithi033.stdout:793: finishing write tid 2 to smithi03339061-10 2021-07-26T15:59:11.112 INFO:tasks.rados.rados.0.smithi033.stdout:793: finishing write tid 3 to smithi03339061-10 2021-07-26T15:59:11.112 INFO:tasks.rados.rados.0.smithi033.stdout:793: finishing write tid 4 to smithi03339061-10 2021-07-26T15:59:11.113 INFO:tasks.rados.rados.0.smithi033.stdout:793: finishing write tid 5 to smithi03339061-10 2021-07-26T15:59:11.113 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 259 (ObjNum 247 snap 71 seq_num 247) dirty exists 2021-07-26T15:59:11.113 INFO:tasks.rados.rados.0.smithi033.stdout:793: left oid 10 (ObjNum 247 snap 71 seq_num 247) 2021-07-26T15:59:11.115 INFO:tasks.rados.rados.0.smithi033.stdout:792: done (2 left) 2021-07-26T15:59:11.115 INFO:tasks.rados.rados.0.smithi033.stdout:793: done (1 left) 2021-07-26T15:59:11.116 INFO:tasks.rados.rados.0.smithi033.stdout:794: done (0 left) 2021-07-26T15:59:11.116 INFO:tasks.rados.rados.0.smithi033.stdout:795: rmattr oid 17 current snap is 71 2021-07-26T15:59:11.116 INFO:tasks.rados.rados.0.smithi033.stdout:795: done (0 left) 2021-07-26T15:59:11.116 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 71 2021-07-26T15:59:11.117 INFO:tasks.rados.rados.0.smithi033.stdout:796: seq_num 249 ranges {8732672=573440,9306112=794624,10100736=409600} 2021-07-26T15:59:11.167 INFO:tasks.rados.rados.0.smithi033.stdout:796: writing smithi03339061-30 from 8732672 to 9306112 tid 1 2021-07-26T15:59:11.171 INFO:tasks.rados.rados.0.smithi033.stdout:796: writing smithi03339061-30 from 9306112 to 10100736 tid 2 2021-07-26T15:59:11.175 INFO:tasks.rados.rados.0.smithi033.stdout:796: writing smithi03339061-30 from 10100736 to 10510336 tid 3 2021-07-26T15:59:11.175 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 71 2021-07-26T15:59:11.176 INFO:tasks.rados.rados.0.smithi033.stdout:796: finishing write tid 1 to smithi03339061-30 2021-07-26T15:59:11.176 INFO:tasks.rados.rados.0.smithi033.stdout:797: seq_num 250 ranges {5791744=589824,6381568=679936,7061504=409600,7471104=114688} 2021-07-26T15:59:11.211 INFO:tasks.rados.rados.0.smithi033.stdout:797: writing smithi03339061-27 from 5791744 to 6381568 tid 1 2021-07-26T15:59:11.214 INFO:tasks.rados.rados.0.smithi033.stdout:797: writing smithi03339061-27 from 6381568 to 7061504 tid 2 2021-07-26T15:59:11.216 INFO:tasks.rados.rados.0.smithi033.stdout:797: writing smithi03339061-27 from 7061504 to 7471104 tid 3 2021-07-26T15:59:11.217 INFO:tasks.rados.rados.0.smithi033.stdout:797: writing smithi03339061-27 from 7471104 to 7585792 tid 4 2021-07-26T15:59:11.217 INFO:tasks.rados.rados.0.smithi033.stdout:798: delete oid 20 current snap is 71 2021-07-26T15:59:11.218 INFO:tasks.rados.rados.0.smithi033.stdout:796: finishing write tid 2 to smithi03339061-30 2021-07-26T15:59:11.218 INFO:tasks.rados.rados.0.smithi033.stdout:796: finishing write tid 3 to smithi03339061-30 2021-07-26T15:59:11.218 INFO:tasks.rados.rados.0.smithi033.stdout:796: finishing write tid 4 to smithi03339061-30 2021-07-26T15:59:11.219 INFO:tasks.rados.rados.0.smithi033.stdout:796: finishing write tid 5 to smithi03339061-30 2021-07-26T15:59:11.219 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 264 (ObjNum 249 snap 71 seq_num 249) dirty exists 2021-07-26T15:59:11.219 INFO:tasks.rados.rados.0.smithi033.stdout:796: left oid 30 (ObjNum 249 snap 71 seq_num 249) 2021-07-26T15:59:11.219 INFO:tasks.rados.rados.0.smithi033.stdout:797: finishing write tid 1 to smithi03339061-27 2021-07-26T15:59:11.221 INFO:tasks.rados.rados.0.smithi033.stdout:797: finishing write tid 2 to smithi03339061-27 2021-07-26T15:59:11.222 INFO:tasks.rados.rados.0.smithi033.stdout:796: done (2 left) 2021-07-26T15:59:11.223 INFO:tasks.rados.rados.0.smithi033.stdout:798: done (1 left) 2021-07-26T15:59:11.223 INFO:tasks.rados.rados.0.smithi033.stdout:799: snap_create 2021-07-26T15:59:11.224 INFO:tasks.rados.rados.0.smithi033.stdout:797: finishing write tid 3 to smithi03339061-27 2021-07-26T15:59:11.224 INFO:tasks.rados.rados.0.smithi033.stdout:797: finishing write tid 4 to smithi03339061-27 2021-07-26T15:59:11.225 INFO:tasks.rados.rados.0.smithi033.stdout:797: finishing write tid 5 to smithi03339061-27 2021-07-26T15:59:11.226 INFO:tasks.rados.rados.0.smithi033.stdout:797: finishing write tid 6 to smithi03339061-27 2021-07-26T15:59:11.226 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 368 (ObjNum 250 snap 71 seq_num 250) dirty exists 2021-07-26T15:59:11.226 INFO:tasks.rados.rados.0.smithi033.stdout:797: left oid 27 (ObjNum 250 snap 71 seq_num 250) 2021-07-26T15:59:11.329 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:11 smithi033 bash[41341]: cephadm 2021-07-26T15:59:09.788640+0000 mgr.y (mgr.34104) 72 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-07-26T15:59:11.330 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:11 smithi033 bash[41341]: cephadm 2021-07-26T15:59:09.832217+0000 mgr.y (mgr.34104) 73 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-07-26T15:59:11.330 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:11 smithi033 bash[41341]: audit 2021-07-26T15:59:09.843997+0000 mgr.y (mgr.34104) 74 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-07-26T15:59:11.330 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:11 smithi033 bash[41341]: cephadm 2021-07-26T15:59:09.845698+0000 mgr.y (mgr.34104) 75 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-07-26T15:59:11.331 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:11 smithi033 bash[41341]: cluster 2021-07-26T15:59:10.061963+0000 mon.a (mon.0) 146 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-07-26T15:59:11.331 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:11 smithi033 bash[42377]: cephadm 2021-07-26T15:59:09.788640+0000 mgr.y (mgr.34104) 72 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-07-26T15:59:11.331 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:11 smithi033 bash[42377]: cephadm 2021-07-26T15:59:09.832217+0000 mgr.y (mgr.34104) 73 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-07-26T15:59:11.331 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:11 smithi033 bash[42377]: audit 2021-07-26T15:59:09.843997+0000 mgr.y (mgr.34104) 74 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-07-26T15:59:11.332 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:11 smithi033 bash[42377]: cephadm 2021-07-26T15:59:09.845698+0000 mgr.y (mgr.34104) 75 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-07-26T15:59:11.332 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:11 smithi033 bash[42377]: cluster 2021-07-26T15:59:10.061963+0000 mon.a (mon.0) 146 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-07-26T15:59:11.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:11 smithi096 bash[33981]: cephadm 2021-07-26T15:59:09.788640+0000 mgr.y (mgr.34104) 72 : cephadm [INF] Upgrade: Setting container_image for all mon 2021-07-26T15:59:11.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:11 smithi096 bash[33981]: cephadm 2021-07-26T15:59:09.832217+0000 mgr.y (mgr.34104) 73 : cephadm [INF] Upgrade: Setting container_image for all crash 2021-07-26T15:59:11.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:11 smithi096 bash[33981]: audit 2021-07-26T15:59:09.843997+0000 mgr.y (mgr.34104) 74 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2021-07-26T15:59:11.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:11 smithi096 bash[33981]: cephadm 2021-07-26T15:59:09.845698+0000 mgr.y (mgr.34104) 75 : cephadm [INF] Upgrade: osd.0 is safe to restart 2021-07-26T15:59:11.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:11 smithi096 bash[33981]: cluster 2021-07-26T15:59:10.061963+0000 mon.a (mon.0) 146 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-07-26T15:59:12.094 INFO:tasks.rados.rados.0.smithi033.stdout:797: done (1 left) 2021-07-26T15:59:12.095 INFO:tasks.rados.rados.0.smithi033.stdout:799: done (0 left) 2021-07-26T15:59:12.095 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 72 2021-07-26T15:59:12.095 INFO:tasks.rados.rados.0.smithi033.stdout:800: seq_num 252 ranges {0=630784,630784=499712,1130496=425984,1556480=278528} 2021-07-26T15:59:12.099 INFO:tasks.rados.rados.0.smithi033.stdout:800: writing smithi03339061-13 from 0 to 630784 tid 1 2021-07-26T15:59:12.103 INFO:tasks.rados.rados.0.smithi033.stdout:800: writing smithi03339061-13 from 630784 to 1130496 tid 2 2021-07-26T15:59:12.107 INFO:tasks.rados.rados.0.smithi033.stdout:800: writing smithi03339061-13 from 1130496 to 1556480 tid 3 2021-07-26T15:59:12.111 INFO:tasks.rados.rados.0.smithi033.stdout:800: writing smithi03339061-13 from 1556480 to 1835008 tid 4 2021-07-26T15:59:12.115 INFO:tasks.rados.rados.0.smithi033.stdout:801: delete oid 50 current snap is 72 2021-07-26T15:59:12.115 INFO:tasks.rados.rados.0.smithi033.stdout:800: finishing write tid 1 to smithi03339061-13 2021-07-26T15:59:12.115 INFO:tasks.rados.rados.0.smithi033.stdout:800: finishing write tid 2 to smithi03339061-13 2021-07-26T15:59:12.115 INFO:tasks.rados.rados.0.smithi033.stdout:800: finishing write tid 3 to smithi03339061-13 2021-07-26T15:59:12.116 INFO:tasks.rados.rados.0.smithi033.stdout:801: done (1 left) 2021-07-26T15:59:12.117 INFO:tasks.rados.rados.0.smithi033.stdout:802: rollback oid 21 current snap is 72 2021-07-26T15:59:12.117 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 21 to 69 2021-07-26T15:59:12.117 INFO:tasks.rados.rados.0.smithi033.stdout:803: snap_remove snap 70 2021-07-26T15:59:12.199 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T15:59:12.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:12 smithi033 bash[41341]: cluster 2021-07-26T15:59:10.962352+0000 mgr.y (mgr.34104) 76 : cluster [DBG] pgmap v89: 25 pgs: 25 active+clean; 78 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 7.3 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2021-07-26T15:59:12.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:12 smithi033 bash[41341]: cluster 2021-07-26T15:59:11.071503+0000 mon.a (mon.0) 147 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-07-26T15:59:12.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:12 smithi033 bash[42377]: cluster 2021-07-26T15:59:10.962352+0000 mgr.y (mgr.34104) 76 : cluster [DBG] pgmap v89: 25 pgs: 25 active+clean; 78 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 7.3 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2021-07-26T15:59:12.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:12 smithi033 bash[42377]: cluster 2021-07-26T15:59:11.071503+0000 mon.a (mon.0) 147 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-07-26T15:59:12.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:12 smithi096 bash[33981]: cluster 2021-07-26T15:59:10.962352+0000 mgr.y (mgr.34104) 76 : cluster [DBG] pgmap v89: 25 pgs: 25 active+clean; 78 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 7.3 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2021-07-26T15:59:12.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:12 smithi096 bash[33981]: cluster 2021-07-26T15:59:11.071503+0000 mon.a (mon.0) 147 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-07-26T15:59:12.537 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T15:59:12.537 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (5m) 44s ago 6m 14.5M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T15:59:12.537 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (5m) 31s ago 5m 25.5M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T15:59:12.537 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (84s) 31s ago 10m 372M - 17.0.0-6381-gbccf07c2 6cdb40438e66 909ec99bd712 2021-07-26T15:59:12.538 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (104s) 44s ago 12m 408M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T15:59:12.538 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (72s) 44s ago 13m 40.3M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 7649338580a7 2021-07-26T15:59:12.538 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (38s) 31s ago 10m 21.0M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 5a3d2fea4cb3 2021-07-26T15:59:12.538 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (51s) 44s ago 10m 19.7M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 76ce8786552e 2021-07-26T15:59:12.538 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (6m) 44s ago 6m 10.9M - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T15:59:12.539 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (6m) 31s ago 6m 11.3M - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T15:59:12.539 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (10m) 44s ago 10m 89.6M 3553M 16.2.5 34f74fddb18e a4b4ebc84a97 2021-07-26T15:59:12.539 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (9m) 44s ago 9m 77.5M 3553M 16.2.5 34f74fddb18e 35137704568f 2021-07-26T15:59:12.539 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (9m) 44s ago 9m 65.4M 3553M 16.2.5 34f74fddb18e d351359286fd 2021-07-26T15:59:12.540 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (8m) 44s ago 8m 124M 3553M 16.2.5 34f74fddb18e 6b68e9927be6 2021-07-26T15:59:12.540 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (8m) 31s ago 8m 88.5M 3552M 16.2.5 34f74fddb18e 1aac82d5671e 2021-07-26T15:59:12.540 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (7m) 31s ago 7m 83.8M 3552M 16.2.5 34f74fddb18e 12b89782c2eb 2021-07-26T15:59:12.540 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (7m) 31s ago 7m 74.8M 3552M 16.2.5 34f74fddb18e 4fad5a8407d4 2021-07-26T15:59:12.541 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (7m) 31s ago 7m 70.1M 3552M 16.2.5 34f74fddb18e a988c60ad3d5 2021-07-26T15:59:12.541 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (5m) 31s ago 6m 38.1M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T15:59:12.925 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T15:59:12.925 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T15:59:12.926 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T15:59:12.926 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:59:12.926 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T15:59:12.926 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T15:59:12.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:59:12.927 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T15:59:12.927 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 8 2021-07-26T15:59:12.927 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:59:12.927 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T15:59:12.928 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T15:59:12.928 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 8, 2021-07-26T15:59:12.928 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 5 2021-07-26T15:59:12.928 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T15:59:12.929 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T15:59:13.103 INFO:tasks.rados.rados.0.smithi033.stdout:803: done (2 left) 2021-07-26T15:59:13.103 INFO:tasks.rados.rados.0.smithi033.stdout:804: snap_create 2021-07-26T15:59:13.103 INFO:tasks.rados.rados.0.smithi033.stdout:800: finishing write tid 4 to smithi03339061-13 2021-07-26T15:59:13.104 INFO:tasks.rados.rados.0.smithi033.stdout:800: finishing write tid 5 to smithi03339061-13 2021-07-26T15:59:13.104 INFO:tasks.rados.rados.0.smithi033.stdout:800: finishing write tid 6 to smithi03339061-13 2021-07-26T15:59:13.104 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 256 (ObjNum 252 snap 72 seq_num 252) dirty exists 2021-07-26T15:59:13.104 INFO:tasks.rados.rados.0.smithi033.stdout:800: left oid 13 (ObjNum 252 snap 72 seq_num 252) 2021-07-26T15:59:13.105 INFO:tasks.rados.rados.0.smithi033.stdout:802: finishing rollback tid 1 to smithi03339061-21 2021-07-26T15:59:13.105 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 0 (ObjNum 288 snap 0 seq_num 273) dirty dne 2021-07-26T15:59:13.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[41341]: cluster 2021-07-26T15:59:12.087187+0000 mon.a (mon.0) 148 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-07-26T15:59:13.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[41341]: audit 2021-07-26T15:59:12.180715+0000 mgr.y (mgr.34104) 77 : audit [DBG] from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:13.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[41341]: cephadm 2021-07-26T15:59:12.320085+0000 mgr.y (mgr.34104) 78 : cephadm [INF] Upgrade: Updating osd.0 2021-07-26T15:59:13.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[41341]: audit 2021-07-26T15:59:12.330236+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:13.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[41341]: cephadm 2021-07-26T15:59:12.333227+0000 mgr.y (mgr.34104) 79 : cephadm [INF] Deploying daemon osd.0 on smithi033 2021-07-26T15:59:13.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[41341]: audit 2021-07-26T15:59:12.511330+0000 mgr.y (mgr.34104) 80 : audit [DBG] from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:13.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[41341]: audit 2021-07-26T15:59:12.922621+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.15.33:0/1827973546' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:13.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[42377]: cluster 2021-07-26T15:59:12.087187+0000 mon.a (mon.0) 148 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-07-26T15:59:13.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[42377]: audit 2021-07-26T15:59:12.180715+0000 mgr.y (mgr.34104) 77 : audit [DBG] from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:13.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[42377]: cephadm 2021-07-26T15:59:12.320085+0000 mgr.y (mgr.34104) 78 : cephadm [INF] Upgrade: Updating osd.0 2021-07-26T15:59:13.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[42377]: audit 2021-07-26T15:59:12.330236+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:13.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[42377]: cephadm 2021-07-26T15:59:12.333227+0000 mgr.y (mgr.34104) 79 : cephadm [INF] Deploying daemon osd.0 on smithi033 2021-07-26T15:59:13.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[42377]: audit 2021-07-26T15:59:12.511330+0000 mgr.y (mgr.34104) 80 : audit [DBG] from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:13.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[42377]: audit 2021-07-26T15:59:12.922621+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.15.33:0/1827973546' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:13.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:13 smithi096 bash[33981]: cluster 2021-07-26T15:59:12.087187+0000 mon.a (mon.0) 148 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-07-26T15:59:13.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:13 smithi096 bash[33981]: audit 2021-07-26T15:59:12.180715+0000 mgr.y (mgr.34104) 77 : audit [DBG] from='client.34170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:13.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:13 smithi096 bash[33981]: cephadm 2021-07-26T15:59:12.320085+0000 mgr.y (mgr.34104) 78 : cephadm [INF] Upgrade: Updating osd.0 2021-07-26T15:59:13.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:13 smithi096 bash[33981]: audit 2021-07-26T15:59:12.330236+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:13.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:13 smithi096 bash[33981]: cephadm 2021-07-26T15:59:12.333227+0000 mgr.y (mgr.34104) 79 : cephadm [INF] Deploying daemon osd.0 on smithi033 2021-07-26T15:59:13.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:13 smithi096 bash[33981]: audit 2021-07-26T15:59:12.511330+0000 mgr.y (mgr.34104) 80 : audit [DBG] from='client.34176 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:13.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:13 smithi096 bash[33981]: audit 2021-07-26T15:59:12.922621+0000 mon.c (mon.1) 37 : audit [DBG] from='client.? 172.21.15.33:0/1827973546' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:13.862 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:13.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:13.862 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:13.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:13.863 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:13 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:13.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T15:59:14.121 INFO:tasks.rados.rados.0.smithi033.stdout:800: done (2 left) 2021-07-26T15:59:14.121 INFO:tasks.rados.rados.0.smithi033.stdout:802: done (1 left) 2021-07-26T15:59:14.121 INFO:tasks.rados.rados.0.smithi033.stdout:804: done (0 left) 2021-07-26T15:59:14.121 INFO:tasks.rados.rados.0.smithi033.stdout:805: read oid 46 snap -1 2021-07-26T15:59:14.122 INFO:tasks.rados.rados.0.smithi033.stdout:805: expect (ObjNum 167 snap 44 seq_num 167) 2021-07-26T15:59:14.122 INFO:tasks.rados.rados.0.smithi033.stdout:806: read oid 12 snap -1 2021-07-26T15:59:14.122 INFO:tasks.rados.rados.0.smithi033.stdout:806: expect deleted 2021-07-26T15:59:14.122 INFO:tasks.rados.rados.0.smithi033.stdout:807: read oid 29 snap -1 2021-07-26T15:59:14.123 INFO:tasks.rados.rados.0.smithi033.stdout:807: expect deleted 2021-07-26T15:59:14.123 INFO:tasks.rados.rados.0.smithi033.stdout:808: snap_remove snap 71 2021-07-26T15:59:14.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:14 smithi033 bash[42377]: cluster 2021-07-26T15:59:12.963005+0000 mgr.y (mgr.34104) 81 : cluster [DBG] pgmap v92: 25 pgs: 25 active+clean; 78 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2021-07-26T15:59:14.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:14 smithi033 bash[42377]: cluster 2021-07-26T15:59:13.099431+0000 mon.a (mon.0) 150 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-07-26T15:59:14.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:14 smithi033 bash[41341]: cluster 2021-07-26T15:59:12.963005+0000 mgr.y (mgr.34104) 81 : cluster [DBG] pgmap v92: 25 pgs: 25 active+clean; 78 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2021-07-26T15:59:14.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:14 smithi033 bash[41341]: cluster 2021-07-26T15:59:13.099431+0000 mon.a (mon.0) 150 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-07-26T15:59:14.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:14 smithi096 bash[33981]: cluster 2021-07-26T15:59:12.963005+0000 mgr.y (mgr.34104) 81 : cluster [DBG] pgmap v92: 25 pgs: 25 active+clean; 78 MiB data, 434 MiB used, 715 GiB / 715 GiB avail; 7.4 MiB/s rd, 1.8 MiB/s wr, 13 op/s 2021-07-26T15:59:14.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:14 smithi096 bash[33981]: cluster 2021-07-26T15:59:13.099431+0000 mon.a (mon.0) 150 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-07-26T15:59:14.870 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:14 smithi033 systemd[1]: Stopping Ceph osd.0 for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T15:59:15.125 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:14 smithi033 docker[43762]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:59:15.126 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:14 smithi033 bash[21582]: debug 2021-07-26T15:59:14.929+0000 7f601bf07700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-07-26T15:59:15.126 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:14 smithi033 bash[21582]: debug 2021-07-26T15:59:14.929+0000 7f601bf07700 -1 osd.0 204 *** Got signal Terminated *** 2021-07-26T15:59:15.126 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:14 smithi033 bash[21582]: debug 2021-07-26T15:59:14.929+0000 7f601bf07700 -1 osd.0 204 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T15:59:15.133 INFO:tasks.rados.rados.0.smithi033.stdout:808: done (3 left) 2021-07-26T15:59:15.133 INFO:tasks.rados.rados.0.smithi033.stdout:809: setattr oid 42 current snap is 73 2021-07-26T15:59:15.136 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 73 2021-07-26T15:59:15.136 INFO:tasks.rados.rados.0.smithi033.stdout:810: seq_num 254 ranges {720896=663552,1384448=663552,2048000=540672} 2021-07-26T15:59:15.145 INFO:tasks.rados.rados.0.smithi033.stdout:810: writing smithi03339061-39 from 720896 to 1384448 tid 1 2021-07-26T15:59:15.149 INFO:tasks.rados.rados.0.smithi033.stdout:810: writing smithi03339061-39 from 1384448 to 2048000 tid 2 2021-07-26T15:59:15.153 INFO:tasks.rados.rados.0.smithi033.stdout:810: writing smithi03339061-39 from 2048000 to 2588672 tid 3 2021-07-26T15:59:15.153 INFO:tasks.rados.rados.0.smithi033.stdout:811: read oid 33 snap 69 2021-07-26T15:59:15.153 INFO:tasks.rados.rados.0.smithi033.stdout:811: expect deleted 2021-07-26T15:59:15.153 INFO:tasks.rados.rados.0.smithi033.stdout:812: read oid 50 snap 72 2021-07-26T15:59:15.154 INFO:tasks.rados.rados.0.smithi033.stdout:812: expect deleted 2021-07-26T15:59:15.154 INFO:tasks.rados.rados.0.smithi033.stdout:813: snap_create 2021-07-26T15:59:15.154 INFO:tasks.rados.rados.0.smithi033.stdout:805: expect (ObjNum 167 snap 44 seq_num 167) 2021-07-26T15:59:15.170 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 187 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:15.171 INFO:tasks.rados.rados.0.smithi033.stdout:810: finishing write tid 1 to smithi03339061-39 2021-07-26T15:59:15.171 INFO:tasks.rados.rados.0.smithi033.stdout:810: finishing write tid 2 to smithi03339061-39 2021-07-26T15:59:15.171 INFO:tasks.rados.rados.0.smithi033.stdout:810: finishing write tid 3 to smithi03339061-39 2021-07-26T15:59:15.172 INFO:tasks.rados.rados.0.smithi033.stdout:810: finishing write tid 4 to smithi03339061-39 2021-07-26T15:59:15.172 INFO:tasks.rados.rados.0.smithi033.stdout:810: finishing write tid 5 to smithi03339061-39 2021-07-26T15:59:15.172 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 378 (ObjNum 254 snap 73 seq_num 254) dirty exists 2021-07-26T15:59:15.172 INFO:tasks.rados.rados.0.smithi033.stdout:810: left oid 39 (ObjNum 254 snap 73 seq_num 254) 2021-07-26T15:59:15.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:15 smithi033 bash[41341]: cluster 2021-07-26T15:59:14.117928+0000 mon.a (mon.0) 151 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-07-26T15:59:15.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:15 smithi033 bash[42377]: cluster 2021-07-26T15:59:14.117928+0000 mon.a (mon.0) 151 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-07-26T15:59:15.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:15 smithi096 bash[33981]: cluster 2021-07-26T15:59:14.117928+0000 mon.a (mon.0) 151 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-07-26T15:59:15.944 INFO:tasks.rados.rados.0.smithi033.stdout:805: done (7 left) 2021-07-26T15:59:15.945 INFO:tasks.rados.rados.0.smithi033.stdout:806: done (6 left) 2021-07-26T15:59:15.945 INFO:tasks.rados.rados.0.smithi033.stdout:807: done (5 left) 2021-07-26T15:59:15.945 INFO:tasks.rados.rados.0.smithi033.stdout:809: done (4 left) 2021-07-26T15:59:15.945 INFO:tasks.rados.rados.0.smithi033.stdout:810: done (3 left) 2021-07-26T15:59:15.946 INFO:tasks.rados.rados.0.smithi033.stdout:811: done (2 left) 2021-07-26T15:59:15.946 INFO:tasks.rados.rados.0.smithi033.stdout:813: done (1 left) 2021-07-26T15:59:15.946 INFO:tasks.rados.rados.0.smithi033.stdout:814: rollback oid 41 current snap is 74 2021-07-26T15:59:15.946 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 41 to 73 2021-07-26T15:59:15.947 INFO:tasks.rados.rados.0.smithi033.stdout:815: rollback oid 35 current snap is 74 2021-07-26T15:59:15.947 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 72 2021-07-26T15:59:15.947 INFO:tasks.rados.rados.0.smithi033.stdout:816: rollback oid 43 current snap is 74 2021-07-26T15:59:15.947 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 43 to 69 2021-07-26T15:59:15.948 INFO:tasks.rados.rados.0.smithi033.stdout:817: read oid 45 snap -1 2021-07-26T15:59:15.948 INFO:tasks.rados.rados.0.smithi033.stdout:817: expect (ObjNum 246 snap 71 seq_num 246) 2021-07-26T15:59:15.948 INFO:tasks.rados.rados.0.smithi033.stdout:818: snap_create 2021-07-26T15:59:15.952 INFO:tasks.rados.rados.0.smithi033.stdout:815: finishing rollback tid 0 to smithi03339061-35 2021-07-26T15:59:15.953 INFO:tasks.rados.rados.0.smithi033.stdout:815: finishing rollback tid 1 to smithi03339061-35 2021-07-26T15:59:15.953 INFO:tasks.rados.rados.0.smithi033.stdout:815: finishing rollback tid 2 to smithi03339061-35 2021-07-26T15:59:15.954 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 221 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:15.958 INFO:tasks.rados.rados.0.smithi033.stdout:814: finishing rollback tid 0 to smithi03339061-41 2021-07-26T15:59:15.959 INFO:tasks.rados.rados.0.smithi033.stdout:814: finishing rollback tid 1 to smithi03339061-41 2021-07-26T15:59:15.959 INFO:tasks.rados.rados.0.smithi033.stdout:814: finishing rollback tid 2 to smithi03339061-41 2021-07-26T15:59:15.959 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 233 (ObjNum 7 snap 0 seq_num 7) dirty exists 2021-07-26T15:59:15.959 INFO:tasks.rados.rados.0.smithi033.stdout:816: finishing rollback tid 0 to smithi03339061-43 2021-07-26T15:59:15.960 INFO:tasks.rados.rados.0.smithi033.stdout:816: finishing rollback tid 1 to smithi03339061-43 2021-07-26T15:59:15.960 INFO:tasks.rados.rados.0.smithi033.stdout:816: finishing rollback tid 2 to smithi03339061-43 2021-07-26T15:59:15.960 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 237 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:16.127 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:15 smithi033 docker[43762]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-osd.0 2021-07-26T15:59:16.127 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:15 smithi033 bash[43802]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:59:16.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:14.963885+0000 mgr.y (mgr.34104) 82 : cluster [DBG] pgmap v95: 25 pgs: 25 active+clean; 88 MiB data, 448 MiB used, 715 GiB / 715 GiB avail; 386 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2021-07-26T15:59:16.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.130718+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-07-26T15:59:16.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.131027+0000 mon.a (mon.0) 153 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.131073+0000 mon.a (mon.0) 154 : cluster [INF] osd.0 failed (root=default,host=smithi033) (connection refused reported by osd.4) 2021-07-26T15:59:16.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.131658+0000 mon.a (mon.0) 155 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.131919+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.189429+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.189862+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.190071+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.190581+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.190923+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.191289+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.191672+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.192041+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.192447+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.192697+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.193033+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.193233+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.193575+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.193758+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.332736+0000 mon.a (mon.0) 171 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.333113+0000 mon.a (mon.0) 172 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.333332+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.593496+0000 mon.a (mon.0) 174 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.593780+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:14.963885+0000 mgr.y (mgr.34104) 82 : cluster [DBG] pgmap v95: 25 pgs: 25 active+clean; 88 MiB data, 448 MiB used, 715 GiB / 715 GiB avail; 386 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2021-07-26T15:59:16.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.130718+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-07-26T15:59:16.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.131027+0000 mon.a (mon.0) 153 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.131073+0000 mon.a (mon.0) 154 : cluster [INF] osd.0 failed (root=default,host=smithi033) (connection refused reported by osd.4) 2021-07-26T15:59:16.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.131658+0000 mon.a (mon.0) 155 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.131919+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.189429+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.189862+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.190071+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.190581+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.190923+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.191289+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.191672+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.192041+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.192447+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.192697+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.193033+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.193233+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.193575+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.193758+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.332736+0000 mon.a (mon.0) 171 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.333113+0000 mon.a (mon.0) 172 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.473 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.333332+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.473 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.593496+0000 mon.a (mon.0) 174 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.473 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.593780+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.594120+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.474 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.594560+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.474 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.595009+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.474 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.595445+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.474 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.596109+0000 mon.a (mon.0) 180 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.475 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.596617+0000 mon.a (mon.0) 181 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.475 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.597058+0000 mon.a (mon.0) 182 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.475 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.597636+0000 mon.a (mon.0) 183 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.476 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.598031+0000 mon.a (mon.0) 184 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.476 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.598396+0000 mon.a (mon.0) 185 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.476 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.599080+0000 mon.a (mon.0) 186 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.476 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.599396+0000 mon.a (mon.0) 187 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.477 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.736690+0000 mon.a (mon.0) 188 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.478 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.737256+0000 mon.a (mon.0) 189 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.478 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.737515+0000 mon.a (mon.0) 190 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.478 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.930168+0000 mon.a (mon.0) 191 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T15:59:16.479 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[41341]: cluster 2021-07-26T15:59:15.938906+0000 mon.a (mon.0) 192 : cluster [DBG] osdmap e207: 8 total, 7 up, 8 in 2021-07-26T15:59:16.479 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.594120+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.479 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.594560+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.480 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.595009+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.480 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.595445+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.480 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.596109+0000 mon.a (mon.0) 180 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.480 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.596617+0000 mon.a (mon.0) 181 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.480 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.597058+0000 mon.a (mon.0) 182 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.481 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.597636+0000 mon.a (mon.0) 183 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.481 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.598031+0000 mon.a (mon.0) 184 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.481 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.598396+0000 mon.a (mon.0) 185 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.481 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.599080+0000 mon.a (mon.0) 186 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.482 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.599396+0000 mon.a (mon.0) 187 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.482 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.736690+0000 mon.a (mon.0) 188 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.482 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.737256+0000 mon.a (mon.0) 189 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.482 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.737515+0000 mon.a (mon.0) 190 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.482 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.930168+0000 mon.a (mon.0) 191 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T15:59:16.483 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:16 smithi033 bash[42377]: cluster 2021-07-26T15:59:15.938906+0000 mon.a (mon.0) 192 : cluster [DBG] osdmap e207: 8 total, 7 up, 8 in 2021-07-26T15:59:16.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:14.963885+0000 mgr.y (mgr.34104) 82 : cluster [DBG] pgmap v95: 25 pgs: 25 active+clean; 88 MiB data, 448 MiB used, 715 GiB / 715 GiB avail; 386 KiB/s rd, 2.5 MiB/s wr, 10 op/s 2021-07-26T15:59:16.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.130718+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-07-26T15:59:16.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.131027+0000 mon.a (mon.0) 153 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.131073+0000 mon.a (mon.0) 154 : cluster [INF] osd.0 failed (root=default,host=smithi033) (connection refused reported by osd.4) 2021-07-26T15:59:16.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.131658+0000 mon.a (mon.0) 155 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.131919+0000 mon.a (mon.0) 156 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.189429+0000 mon.a (mon.0) 157 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.189862+0000 mon.a (mon.0) 158 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.190071+0000 mon.a (mon.0) 159 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.190581+0000 mon.a (mon.0) 160 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.190923+0000 mon.a (mon.0) 161 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.191289+0000 mon.a (mon.0) 162 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.191672+0000 mon.a (mon.0) 163 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.192041+0000 mon.a (mon.0) 164 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.192447+0000 mon.a (mon.0) 165 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.192697+0000 mon.a (mon.0) 166 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.193033+0000 mon.a (mon.0) 167 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.193233+0000 mon.a (mon.0) 168 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.193575+0000 mon.a (mon.0) 169 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.193758+0000 mon.a (mon.0) 170 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.332736+0000 mon.a (mon.0) 171 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.333113+0000 mon.a (mon.0) 172 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.333332+0000 mon.a (mon.0) 173 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.593496+0000 mon.a (mon.0) 174 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.593780+0000 mon.a (mon.0) 175 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.594120+0000 mon.a (mon.0) 176 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.594560+0000 mon.a (mon.0) 177 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.595009+0000 mon.a (mon.0) 178 : cluster [DBG] osd.0 reported immediately failed by osd.5 2021-07-26T15:59:16.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.595445+0000 mon.a (mon.0) 179 : cluster [DBG] osd.0 reported immediately failed by osd.6 2021-07-26T15:59:16.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.596109+0000 mon.a (mon.0) 180 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.596617+0000 mon.a (mon.0) 181 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.597058+0000 mon.a (mon.0) 182 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.597636+0000 mon.a (mon.0) 183 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.598031+0000 mon.a (mon.0) 184 : cluster [DBG] osd.0 reported immediately failed by osd.2 2021-07-26T15:59:16.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.598396+0000 mon.a (mon.0) 185 : cluster [DBG] osd.0 reported immediately failed by osd.1 2021-07-26T15:59:16.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.599080+0000 mon.a (mon.0) 186 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.599396+0000 mon.a (mon.0) 187 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.736690+0000 mon.a (mon.0) 188 : cluster [DBG] osd.0 reported immediately failed by osd.3 2021-07-26T15:59:16.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.737256+0000 mon.a (mon.0) 189 : cluster [DBG] osd.0 reported immediately failed by osd.4 2021-07-26T15:59:16.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.737515+0000 mon.a (mon.0) 190 : cluster [DBG] osd.0 reported immediately failed by osd.7 2021-07-26T15:59:16.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.930168+0000 mon.a (mon.0) 191 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T15:59:16.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:16 smithi096 bash[33981]: cluster 2021-07-26T15:59:15.938906+0000 mon.a (mon.0) 192 : cluster [DBG] osdmap e207: 8 total, 7 up, 8 in 2021-07-26T15:59:16.947 INFO:tasks.rados.rados.0.smithi033.stdout:814: done (5 left) 2021-07-26T15:59:16.947 INFO:tasks.rados.rados.0.smithi033.stdout:815: done (4 left) 2021-07-26T15:59:16.948 INFO:tasks.rados.rados.0.smithi033.stdout:816: done (3 left) 2021-07-26T15:59:16.948 INFO:tasks.rados.rados.0.smithi033.stdout:818: done (2 left) 2021-07-26T15:59:16.948 INFO:tasks.rados.rados.0.smithi033.stdout:819: snap_create 2021-07-26T15:59:16.969 INFO:tasks.rados.rados.0.smithi033.stdout:817: expect (ObjNum 246 snap 71 seq_num 246) 2021-07-26T15:59:17.953 INFO:tasks.rados.rados.0.smithi033.stdout:812: done (2 left) 2021-07-26T15:59:17.954 INFO:tasks.rados.rados.0.smithi033.stdout:817: done (1 left) 2021-07-26T15:59:17.954 INFO:tasks.rados.rados.0.smithi033.stdout:819: done (0 left) 2021-07-26T15:59:17.955 INFO:tasks.rados.rados.0.smithi033.stdout:820: delete oid 17 current snap is 76 2021-07-26T15:59:17.960 INFO:tasks.rados.rados.0.smithi033.stdout:820: done (0 left) 2021-07-26T15:59:17.960 INFO:tasks.rados.rados.0.smithi033.stdout:821: snap_create 2021-07-26T15:59:18.194 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:17 smithi033 bash[41341]: cluster 2021-07-26T15:59:16.944790+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e208: 8 total, 7 up, 8 in 2021-07-26T15:59:18.194 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:17 smithi033 bash[41341]: cluster 2021-07-26T15:59:16.964519+0000 mgr.y (mgr.34104) 83 : cluster [DBG] pgmap v99: 25 pgs: 2 stale+active+clean, 23 active+clean; 88 MiB data, 448 MiB used, 715 GiB / 715 GiB avail; 399 KiB/s rd, 2.6 MiB/s wr, 10 op/s 2021-07-26T15:59:18.195 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:17 smithi033 bash[42377]: cluster 2021-07-26T15:59:16.944790+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e208: 8 total, 7 up, 8 in 2021-07-26T15:59:18.195 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:17 smithi033 bash[42377]: cluster 2021-07-26T15:59:16.964519+0000 mgr.y (mgr.34104) 83 : cluster [DBG] pgmap v99: 25 pgs: 2 stale+active+clean, 23 active+clean; 88 MiB data, 448 MiB used, 715 GiB / 715 GiB avail; 399 KiB/s rd, 2.6 MiB/s wr, 10 op/s 2021-07-26T15:59:18.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:17 smithi096 bash[33981]: cluster 2021-07-26T15:59:16.944790+0000 mon.a (mon.0) 193 : cluster [DBG] osdmap e208: 8 total, 7 up, 8 in 2021-07-26T15:59:18.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:17 smithi096 bash[33981]: cluster 2021-07-26T15:59:16.964519+0000 mgr.y (mgr.34104) 83 : cluster [DBG] pgmap v99: 25 pgs: 2 stale+active+clean, 23 active+clean; 88 MiB data, 448 MiB used, 715 GiB / 715 GiB avail; 399 KiB/s rd, 2.6 MiB/s wr, 10 op/s 2021-07-26T15:59:18.444 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:18 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.0.service: Succeeded. 2021-07-26T15:59:18.445 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:18 smithi033 systemd[1]: Stopped Ceph osd.0 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:59:18.445 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:18 smithi033 systemd[1]: Started Ceph osd.0 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:59:18.949 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:18 smithi033 bash[43930]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:59:18.951 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:18 smithi033 bash[42377]: cluster 2021-07-26T15:59:17.949011+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e209: 8 total, 7 up, 8 in 2021-07-26T15:59:18.952 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:18 smithi033 bash[42377]: audit 2021-07-26T15:59:18.485241+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:18.952 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:18 smithi033 bash[42377]: audit 2021-07-26T15:59:18.487635+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:18.962 INFO:tasks.rados.rados.0.smithi033.stdout:821: done (0 left) 2021-07-26T15:59:18.962 INFO:tasks.rados.rados.0.smithi033.stdout:822: setattr oid 42 current snap is 77 2021-07-26T15:59:18.965 INFO:tasks.rados.rados.0.smithi033.stdout:823: delete oid 12 current snap is 77 2021-07-26T15:59:18.971 INFO:tasks.rados.rados.0.smithi033.stdout:823: done (1 left) 2021-07-26T15:59:18.972 INFO:tasks.rados.rados.0.smithi033.stdout:824: read oid 16 snap 75 2021-07-26T15:59:18.972 INFO:tasks.rados.rados.0.smithi033.stdout:824: expect (ObjNum 244 snap 70 seq_num 244) 2021-07-26T15:59:18.972 INFO:tasks.rados.rados.0.smithi033.stdout:825: rollback oid 44 current snap is 77 2021-07-26T15:59:18.972 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 69 2021-07-26T15:59:18.972 INFO:tasks.rados.rados.0.smithi033.stdout:826: rollback oid 1 current snap is 77 2021-07-26T15:59:18.973 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 1 to 69 2021-07-26T15:59:18.973 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 77 2021-07-26T15:59:18.973 INFO:tasks.rados.rados.0.smithi033.stdout:827: seq_num 257 ranges {0=712704,712704=720896,1433600=483328} 2021-07-26T15:59:18.978 INFO:tasks.rados.rados.0.smithi033.stdout:827: writing smithi03339061-12 from 0 to 712704 tid 1 2021-07-26T15:59:18.983 INFO:tasks.rados.rados.0.smithi033.stdout:827: writing smithi03339061-12 from 712704 to 1433600 tid 2 2021-07-26T15:59:18.987 INFO:tasks.rados.rados.0.smithi033.stdout:827: writing smithi03339061-12 from 1433600 to 1916928 tid 3 2021-07-26T15:59:18.987 INFO:tasks.rados.rados.0.smithi033.stdout:828: rollback oid 35 current snap is 77 2021-07-26T15:59:18.987 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 69 2021-07-26T15:59:18.988 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 188 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:18.988 INFO:tasks.rados.rados.0.smithi033.stdout:826: finishing rollback tid 1 to smithi03339061-1 2021-07-26T15:59:18.988 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 0 (ObjNum 2005002048 snap 22002 seq_num 2007473632) dirty dne 2021-07-26T15:59:18.988 INFO:tasks.rados.rados.0.smithi033.stdout:825: finishing rollback tid 0 to smithi03339061-44 2021-07-26T15:59:18.988 INFO:tasks.rados.rados.0.smithi033.stdout:825: finishing rollback tid 1 to smithi03339061-44 2021-07-26T15:59:18.989 INFO:tasks.rados.rados.0.smithi033.stdout:825: finishing rollback tid 2 to smithi03339061-44 2021-07-26T15:59:18.989 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 262 (ObjNum 181 snap 47 seq_num 181) dirty exists 2021-07-26T15:59:18.989 INFO:tasks.rados.rados.0.smithi033.stdout:822: done (5 left) 2021-07-26T15:59:18.989 INFO:tasks.rados.rados.0.smithi033.stdout:825: done (4 left) 2021-07-26T15:59:18.989 INFO:tasks.rados.rados.0.smithi033.stdout:826: done (3 left) 2021-07-26T15:59:18.990 INFO:tasks.rados.rados.0.smithi033.stdout:829: read oid 7 snap -1 2021-07-26T15:59:18.990 INFO:tasks.rados.rados.0.smithi033.stdout:829: expect deleted 2021-07-26T15:59:18.990 INFO:tasks.rados.rados.0.smithi033.stdout:830: snap_create 2021-07-26T15:59:18.991 INFO:tasks.rados.rados.0.smithi033.stdout:827: finishing write tid 1 to smithi03339061-12 2021-07-26T15:59:18.991 INFO:tasks.rados.rados.0.smithi033.stdout:827: finishing write tid 2 to smithi03339061-12 2021-07-26T15:59:18.992 INFO:tasks.rados.rados.0.smithi033.stdout:828: finishing rollback tid 0 to smithi03339061-35 2021-07-26T15:59:18.994 INFO:tasks.rados.rados.0.smithi033.stdout:827: finishing write tid 3 to smithi03339061-12 2021-07-26T15:59:18.995 INFO:tasks.rados.rados.0.smithi033.stdout:828: finishing rollback tid 1 to smithi03339061-35 2021-07-26T15:59:18.995 INFO:tasks.rados.rados.0.smithi033.stdout:827: finishing write tid 4 to smithi03339061-12 2021-07-26T15:59:18.995 INFO:tasks.rados.rados.0.smithi033.stdout:828: finishing rollback tid 2 to smithi03339061-35 2021-07-26T15:59:18.995 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 225 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:18.996 INFO:tasks.rados.rados.0.smithi033.stdout:827: finishing write tid 5 to smithi03339061-12 2021-07-26T15:59:18.996 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 202 (ObjNum 257 snap 77 seq_num 257) dirty exists 2021-07-26T15:59:18.996 INFO:tasks.rados.rados.0.smithi033.stdout:827: left oid 12 (ObjNum 257 snap 77 seq_num 257) 2021-07-26T15:59:19.007 INFO:tasks.rados.rados.0.smithi033.stdout:824: expect (ObjNum 244 snap 70 seq_num 244) 2021-07-26T15:59:19.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:18 smithi033 bash[42377]: audit 2021-07-26T15:59:18.489575+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:59:19.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:18 smithi033 bash[42377]: audit 2021-07-26T15:59:18.490921+0000 mon.c (mon.1) 40 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:59:19.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:18 smithi033 bash[41341]: cluster 2021-07-26T15:59:17.949011+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e209: 8 total, 7 up, 8 in 2021-07-26T15:59:19.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:18 smithi033 bash[41341]: audit 2021-07-26T15:59:18.485241+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:19.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:18 smithi033 bash[41341]: audit 2021-07-26T15:59:18.487635+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:19.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:18 smithi033 bash[41341]: audit 2021-07-26T15:59:18.489575+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:59:19.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:18 smithi033 bash[41341]: audit 2021-07-26T15:59:18.490921+0000 mon.c (mon.1) 40 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:59:19.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:18 smithi096 bash[33981]: cluster 2021-07-26T15:59:17.949011+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e209: 8 total, 7 up, 8 in 2021-07-26T15:59:19.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:18 smithi096 bash[33981]: audit 2021-07-26T15:59:18.485241+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:19.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:18 smithi096 bash[33981]: audit 2021-07-26T15:59:18.487635+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:19.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:18 smithi096 bash[33981]: audit 2021-07-26T15:59:18.489575+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:59:19.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:18 smithi096 bash[33981]: audit 2021-07-26T15:59:18.490921+0000 mon.c (mon.1) 40 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:59:19.972 INFO:tasks.rados.rados.0.smithi033.stdout:824: done (4 left) 2021-07-26T15:59:19.972 INFO:tasks.rados.rados.0.smithi033.stdout:827: done (3 left) 2021-07-26T15:59:19.972 INFO:tasks.rados.rados.0.smithi033.stdout:828: done (2 left) 2021-07-26T15:59:19.973 INFO:tasks.rados.rados.0.smithi033.stdout:829: done (1 left) 2021-07-26T15:59:19.973 INFO:tasks.rados.rados.0.smithi033.stdout:830: done (0 left) 2021-07-26T15:59:19.973 INFO:tasks.rados.rados.0.smithi033.stdout:831: snap_remove snap 75 2021-07-26T15:59:20.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:19 smithi033 bash[41341]: cluster 2021-07-26T15:59:18.959743+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e210: 8 total, 7 up, 8 in 2021-07-26T15:59:20.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:19 smithi033 bash[41341]: cluster 2021-07-26T15:59:18.965018+0000 mgr.y (mgr.34104) 84 : cluster [DBG] pgmap v102: 25 pgs: 2 stale+active+clean, 23 active+clean; 88 MiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:59:20.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:19 smithi033 bash[42377]: cluster 2021-07-26T15:59:18.959743+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e210: 8 total, 7 up, 8 in 2021-07-26T15:59:20.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:19 smithi033 bash[42377]: cluster 2021-07-26T15:59:18.965018+0000 mgr.y (mgr.34104) 84 : cluster [DBG] pgmap v102: 25 pgs: 2 stale+active+clean, 23 active+clean; 88 MiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:59:20.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:19 smithi096 bash[33981]: cluster 2021-07-26T15:59:18.959743+0000 mon.a (mon.0) 196 : cluster [DBG] osdmap e210: 8 total, 7 up, 8 in 2021-07-26T15:59:20.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:19 smithi096 bash[33981]: cluster 2021-07-26T15:59:18.965018+0000 mgr.y (mgr.34104) 84 : cluster [DBG] pgmap v102: 25 pgs: 2 stale+active+clean, 23 active+clean; 88 MiB data, 448 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:59:20.724 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:20 smithi033 bash[43930]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-07-26T15:59:20.725 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:20 smithi033 bash[43930]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-07-26T15:59:20.725 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:20 smithi033 bash[43930]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-07-26T15:59:20.725 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:20 smithi033 bash[43930]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-07-26T15:59:20.726 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:20 smithi033 bash[43930]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-07-26T15:59:20.726 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:20 smithi033 bash[43930]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-07-26T15:59:20.726 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:20 smithi033 bash[43930]: --> ceph-volume lvm activate successful for osd ID: 0 2021-07-26T15:59:20.975 INFO:tasks.rados.rados.0.smithi033.stdout:831: done (0 left) 2021-07-26T15:59:20.976 INFO:tasks.rados.rados.0.smithi033.stdout:832: rmattr oid 41 current snap is 78 2021-07-26T15:59:20.976 INFO:tasks.rados.rados.0.smithi033.stdout:832: done (0 left) 2021-07-26T15:59:20.976 INFO:tasks.rados.rados.0.smithi033.stdout:833: snap_remove snap 77 2021-07-26T15:59:21.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:20 smithi096 bash[33981]: cluster 2021-07-26T15:59:19.969868+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e211: 8 total, 7 up, 8 in 2021-07-26T15:59:21.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:20 smithi033 bash[41341]: cluster 2021-07-26T15:59:19.969868+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e211: 8 total, 7 up, 8 in 2021-07-26T15:59:21.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:20 smithi033 bash[42377]: cluster 2021-07-26T15:59:19.969868+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e211: 8 total, 7 up, 8 in 2021-07-26T15:59:21.459 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:21 smithi033 bash[44048]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:59:21.976 INFO:tasks.rados.rados.0.smithi033.stdout:833: done (0 left) 2021-07-26T15:59:21.977 INFO:tasks.rados.rados.0.smithi033.stdout:834: setattr oid 11 current snap is 78 2021-07-26T15:59:21.979 INFO:tasks.rados.rados.0.smithi033.stdout:835: rmattr oid 31 current snap is 78 2021-07-26T15:59:21.980 INFO:tasks.rados.rados.0.smithi033.stdout:835: done (1 left) 2021-07-26T15:59:21.980 INFO:tasks.rados.rados.0.smithi033.stdout:836: rollback oid 42 current snap is 78 2021-07-26T15:59:21.980 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 42 to 69 2021-07-26T15:59:21.981 INFO:tasks.rados.rados.0.smithi033.stdout:837: rollback oid 38 current snap is 78 2021-07-26T15:59:21.981 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 38 to 72 2021-07-26T15:59:21.981 INFO:tasks.rados.rados.0.smithi033.stdout:838: snap_create 2021-07-26T15:59:21.993 INFO:tasks.rados.rados.0.smithi033.stdout:837: finishing rollback tid 0 to smithi03339061-38 2021-07-26T15:59:21.993 INFO:tasks.rados.rados.0.smithi033.stdout:837: finishing rollback tid 1 to smithi03339061-38 2021-07-26T15:59:21.994 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 190 (ObjNum 7 snap 0 seq_num 7) dirty exists 2021-07-26T15:59:21.995 INFO:tasks.rados.rados.0.smithi033.stdout:837: finishing rollback tid 2 to smithi03339061-38 2021-07-26T15:59:21.995 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 58 (ObjNum 205 snap 55 seq_num 205) dirty exists 2021-07-26T15:59:21.996 INFO:tasks.rados.rados.0.smithi033.stdout:836: finishing rollback tid 0 to smithi03339061-42 2021-07-26T15:59:21.997 INFO:tasks.rados.rados.0.smithi033.stdout:836: finishing rollback tid 1 to smithi03339061-42 2021-07-26T15:59:21.997 INFO:tasks.rados.rados.0.smithi033.stdout:836: finishing rollback tid 2 to smithi03339061-42 2021-07-26T15:59:21.997 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 191 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:22.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:21 smithi033 bash[41341]: cluster 2021-07-26T15:59:20.965673+0000 mgr.y (mgr.34104) 85 : cluster [DBG] pgmap v104: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.3 MiB/s wr, 19 op/s; 20/165 objects degraded (12.121%) 2021-07-26T15:59:22.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:21 smithi033 bash[41341]: cluster 2021-07-26T15:59:20.971050+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e212: 8 total, 7 up, 8 in 2021-07-26T15:59:22.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:21 smithi033 bash[41341]: cluster 2021-07-26T15:59:21.967311+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: Degraded data redundancy: 20/165 objects degraded (12.121%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T15:59:22.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:21 smithi033 bash[41341]: cluster 2021-07-26T15:59:21.973772+0000 mon.a (mon.0) 200 : cluster [DBG] osdmap e213: 8 total, 7 up, 8 in 2021-07-26T15:59:22.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:21 smithi033 bash[42377]: cluster 2021-07-26T15:59:20.965673+0000 mgr.y (mgr.34104) 85 : cluster [DBG] pgmap v104: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.3 MiB/s wr, 19 op/s; 20/165 objects degraded (12.121%) 2021-07-26T15:59:22.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:21 smithi033 bash[42377]: cluster 2021-07-26T15:59:20.971050+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e212: 8 total, 7 up, 8 in 2021-07-26T15:59:22.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:21 smithi033 bash[42377]: cluster 2021-07-26T15:59:21.967311+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: Degraded data redundancy: 20/165 objects degraded (12.121%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T15:59:22.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:21 smithi033 bash[42377]: cluster 2021-07-26T15:59:21.973772+0000 mon.a (mon.0) 200 : cluster [DBG] osdmap e213: 8 total, 7 up, 8 in 2021-07-26T15:59:22.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:21 smithi096 bash[33981]: cluster 2021-07-26T15:59:20.965673+0000 mgr.y (mgr.34104) 85 : cluster [DBG] pgmap v104: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.3 MiB/s wr, 19 op/s; 20/165 objects degraded (12.121%) 2021-07-26T15:59:22.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:21 smithi096 bash[33981]: cluster 2021-07-26T15:59:20.971050+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e212: 8 total, 7 up, 8 in 2021-07-26T15:59:22.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:21 smithi096 bash[33981]: cluster 2021-07-26T15:59:21.967311+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: Degraded data redundancy: 20/165 objects degraded (12.121%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T15:59:22.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:21 smithi096 bash[33981]: cluster 2021-07-26T15:59:21.973772+0000 mon.a (mon.0) 200 : cluster [DBG] osdmap e213: 8 total, 7 up, 8 in 2021-07-26T15:59:22.708 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:22 smithi033 bash[44048]: debug 2021-07-26T15:59:22.369+0000 7f145b1d7700 1 -- 172.21.15.33:0/1670564069 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561a9283e340 con 0x561a92898800 2021-07-26T15:59:22.987 INFO:tasks.rados.rados.0.smithi033.stdout:834: done (3 left) 2021-07-26T15:59:22.988 INFO:tasks.rados.rados.0.smithi033.stdout:836: done (2 left) 2021-07-26T15:59:22.988 INFO:tasks.rados.rados.0.smithi033.stdout:837: done (1 left) 2021-07-26T15:59:22.988 INFO:tasks.rados.rados.0.smithi033.stdout:838: done (0 left) 2021-07-26T15:59:22.989 INFO:tasks.rados.rados.0.smithi033.stdout:839: rollback oid 43 current snap is 79 2021-07-26T15:59:22.989 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 43 to 76 2021-07-26T15:59:22.989 INFO:tasks.rados.rados.0.smithi033.stdout:840: snap_create 2021-07-26T15:59:22.999 INFO:tasks.rados.rados.0.smithi033.stdout:839: finishing rollback tid 0 to smithi03339061-43 2021-07-26T15:59:22.999 INFO:tasks.rados.rados.0.smithi033.stdout:839: finishing rollback tid 1 to smithi03339061-43 2021-07-26T15:59:23.000 INFO:tasks.rados.rados.0.smithi033.stdout:839: finishing rollback tid 2 to smithi03339061-43 2021-07-26T15:59:23.000 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 241 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:23.208 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:22 smithi033 bash[44048]: debug 2021-07-26T15:59:22.929+0000 7f1462a2b0c0 -1 Falling back to public interface 2021-07-26T15:59:23.959 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[39943]: debug 2021-07-26T15:59:23.669+0000 7fa4db1f3700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2021-07-26T15:59:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:23.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:23.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:23.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:23.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T15:59:24.006 INFO:tasks.rados.rados.0.smithi033.stdout:839: done (1 left) 2021-07-26T15:59:24.006 INFO:tasks.rados.rados.0.smithi033.stdout:840: done (0 left) 2021-07-26T15:59:24.008 INFO:tasks.rados.rados.0.smithi033.stdout:841: rmattr oid 29 current snap is 80 2021-07-26T15:59:24.008 INFO:tasks.rados.rados.0.smithi033.stdout:841: done (0 left) 2021-07-26T15:59:24.008 INFO:tasks.rados.rados.0.smithi033.stdout:842: snap_create 2021-07-26T15:59:24.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:23 smithi096 bash[33981]: cluster 2021-07-26T15:59:22.966305+0000 mgr.y (mgr.34104) 86 : cluster [DBG] pgmap v107: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.3 MiB/s wr, 19 op/s; 20/165 objects degraded (12.121%) 2021-07-26T15:59:24.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:23 smithi096 bash[33981]: cluster 2021-07-26T15:59:22.985091+0000 mon.a (mon.0) 201 : cluster [DBG] osdmap e214: 8 total, 7 up, 8 in 2021-07-26T15:59:24.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:23 smithi096 bash[33981]: audit 2021-07-26T15:59:23.404377+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:24.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:23 smithi096 bash[33981]: audit 2021-07-26T15:59:23.653922+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:24.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:23 smithi096 bash[33981]: audit 2021-07-26T15:59:23.663526+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:24.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:23 smithi096 bash[33981]: audit 2021-07-26T15:59:23.665982+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:24.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:23 smithi096 bash[33981]: audit 2021-07-26T15:59:23.668328+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:24.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:23 smithi096 bash[33981]: audit 2021-07-26T15:59:23.670136+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:24.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:23 smithi096 bash[33981]: audit 2021-07-26T15:59:23.672002+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:24.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[41341]: cluster 2021-07-26T15:59:22.966305+0000 mgr.y (mgr.34104) 86 : cluster [DBG] pgmap v107: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.3 MiB/s wr, 19 op/s; 20/165 objects degraded (12.121%) 2021-07-26T15:59:24.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[41341]: cluster 2021-07-26T15:59:22.985091+0000 mon.a (mon.0) 201 : cluster [DBG] osdmap e214: 8 total, 7 up, 8 in 2021-07-26T15:59:24.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[41341]: audit 2021-07-26T15:59:23.404377+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:24.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[41341]: audit 2021-07-26T15:59:23.653922+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:24.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[41341]: audit 2021-07-26T15:59:23.663526+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:24.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[41341]: audit 2021-07-26T15:59:23.665982+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:24.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[41341]: audit 2021-07-26T15:59:23.668328+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:24.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[41341]: audit 2021-07-26T15:59:23.670136+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:24.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[41341]: audit 2021-07-26T15:59:23.672002+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:24.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[42377]: cluster 2021-07-26T15:59:22.966305+0000 mgr.y (mgr.34104) 86 : cluster [DBG] pgmap v107: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 462 MiB used, 715 GiB / 715 GiB avail; 4.8 MiB/s rd, 1.3 MiB/s wr, 19 op/s; 20/165 objects degraded (12.121%) 2021-07-26T15:59:24.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[42377]: cluster 2021-07-26T15:59:22.985091+0000 mon.a (mon.0) 201 : cluster [DBG] osdmap e214: 8 total, 7 up, 8 in 2021-07-26T15:59:24.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[42377]: audit 2021-07-26T15:59:23.404377+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:24.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[42377]: audit 2021-07-26T15:59:23.653922+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:24.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[42377]: audit 2021-07-26T15:59:23.663526+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:24.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[42377]: audit 2021-07-26T15:59:23.665982+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:24.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[42377]: audit 2021-07-26T15:59:23.668328+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:24.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[42377]: audit 2021-07-26T15:59:23.670136+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:24.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:23 smithi033 bash[42377]: audit 2021-07-26T15:59:23.672002+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:25.012 INFO:tasks.rados.rados.0.smithi033.stdout:842: done (0 left) 2021-07-26T15:59:25.013 INFO:tasks.rados.rados.0.smithi033.stdout:843: delete oid 33 current snap is 81 2021-07-26T15:59:25.015 INFO:tasks.rados.rados.0.smithi033.stdout:843: done (0 left) 2021-07-26T15:59:25.016 INFO:tasks.rados.rados.0.smithi033.stdout:844: setattr oid 48 current snap is 81 2021-07-26T15:59:25.016 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 81 2021-07-26T15:59:25.016 INFO:tasks.rados.rados.0.smithi033.stdout:845: seq_num 259 ranges {1294336=745472,2039808=540672,2580480=581632,3162112=81920} 2021-07-26T15:59:25.030 INFO:tasks.rados.rados.0.smithi033.stdout:845: writing smithi03339061-2 from 1294336 to 2039808 tid 1 2021-07-26T15:59:25.034 INFO:tasks.rados.rados.0.smithi033.stdout:845: writing smithi03339061-2 from 2039808 to 2580480 tid 2 2021-07-26T15:59:25.037 INFO:tasks.rados.rados.0.smithi033.stdout:845: writing smithi03339061-2 from 2580480 to 3162112 tid 3 2021-07-26T15:59:25.038 INFO:tasks.rados.rados.0.smithi033.stdout:845: writing smithi03339061-2 from 3162112 to 3244032 tid 4 2021-07-26T15:59:25.038 INFO:tasks.rados.rados.0.smithi033.stdout:846: read oid 37 snap -1 2021-07-26T15:59:25.038 INFO:tasks.rados.rados.0.smithi033.stdout:846: expect (ObjNum 238 snap 67 seq_num 238) 2021-07-26T15:59:25.039 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 81 2021-07-26T15:59:25.039 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 242 (ObjNum 1 snap 32561 seq_num 2006276560) dirty exists 2021-07-26T15:59:25.039 INFO:tasks.rados.rados.0.smithi033.stdout:847: seq_num 260 ranges {0=761856,761856=417792,1179648=786432} 2021-07-26T15:59:25.044 INFO:tasks.rados.rados.0.smithi033.stdout:847: writing smithi03339061-32 from 0 to 761856 tid 1 2021-07-26T15:59:25.045 INFO:tasks.rados.rados.0.smithi033.stdout:847: writing smithi03339061-32 from 761856 to 1179648 tid 2 2021-07-26T15:59:25.052 INFO:tasks.rados.rados.0.smithi033.stdout:847: writing smithi03339061-32 from 1179648 to 1966080 tid 3 2021-07-26T15:59:25.052 INFO:tasks.rados.rados.0.smithi033.stdout:844: done (3 left) 2021-07-26T15:59:25.052 INFO:tasks.rados.rados.0.smithi033.stdout:848: copy_from oid 44 from oid 26 current snap is 81 2021-07-26T15:59:25.052 INFO:tasks.rados.rados.0.smithi033.stdout:845: finishing write tid 1 to smithi03339061-2 2021-07-26T15:59:25.053 INFO:tasks.rados.rados.0.smithi033.stdout:845: finishing write tid 2 to smithi03339061-2 2021-07-26T15:59:25.053 INFO:tasks.rados.rados.0.smithi033.stdout:845: finishing write tid 3 to smithi03339061-2 2021-07-26T15:59:25.054 INFO:tasks.rados.rados.0.smithi033.stdout:845: finishing write tid 4 to smithi03339061-2 2021-07-26T15:59:25.054 INFO:tasks.rados.rados.0.smithi033.stdout:845: finishing write tid 5 to smithi03339061-2 2021-07-26T15:59:25.054 INFO:tasks.rados.rados.0.smithi033.stdout:845: finishing write tid 6 to smithi03339061-2 2021-07-26T15:59:25.055 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 208 (ObjNum 259 snap 81 seq_num 259) dirty exists 2021-07-26T15:59:25.055 INFO:tasks.rados.rados.0.smithi033.stdout:845: left oid 2 (ObjNum 259 snap 81 seq_num 259) 2021-07-26T15:59:25.055 INFO:tasks.rados.rados.0.smithi033.stdout:845: done (3 left) 2021-07-26T15:59:25.055 INFO:tasks.rados.rados.0.smithi033.stdout:849: copy_from oid 10 from oid 12 current snap is 81 2021-07-26T15:59:25.056 INFO:tasks.rados.rados.0.smithi033.stdout:850: read oid 21 snap -1 2021-07-26T15:59:25.056 INFO:tasks.rados.rados.0.smithi033.stdout:850: expect deleted 2021-07-26T15:59:25.056 INFO:tasks.rados.rados.0.smithi033.stdout:851: read oid 42 snap -1 2021-07-26T15:59:25.056 INFO:tasks.rados.rados.0.smithi033.stdout:851: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T15:59:25.057 INFO:tasks.rados.rados.0.smithi033.stdout:852: delete oid 3 current snap is 81 2021-07-26T15:59:25.058 INFO:tasks.rados.rados.0.smithi033.stdout:847: finishing write tid 1 to smithi03339061-32 2021-07-26T15:59:25.058 INFO:tasks.rados.rados.0.smithi033.stdout:847: finishing write tid 2 to smithi03339061-32 2021-07-26T15:59:25.059 INFO:tasks.rados.rados.0.smithi033.stdout:846: expect (ObjNum 238 snap 67 seq_num 238) 2021-07-26T15:59:25.132 INFO:tasks.rados.rados.0.smithi033.stdout:847: finishing write tid 3 to smithi03339061-32 2021-07-26T15:59:25.133 INFO:tasks.rados.rados.0.smithi033.stdout:847: finishing write tid 4 to smithi03339061-32 2021-07-26T15:59:25.133 INFO:tasks.rados.rados.0.smithi033.stdout:847: finishing write tid 5 to smithi03339061-32 2021-07-26T15:59:25.133 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 212 (ObjNum 260 snap 81 seq_num 260) dirty exists 2021-07-26T15:59:25.134 INFO:tasks.rados.rados.0.smithi033.stdout:847: left oid 32 (ObjNum 260 snap 81 seq_num 260) 2021-07-26T15:59:25.134 INFO:tasks.rados.rados.0.smithi033.stdout:849: finishing copy_from to smithi03339061-10 2021-07-26T15:59:25.134 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 202 (ObjNum 257 snap 77 seq_num 257) dirty exists 2021-07-26T15:59:25.134 INFO:tasks.rados.rados.0.smithi033.stdout:846: done (6 left) 2021-07-26T15:59:25.135 INFO:tasks.rados.rados.0.smithi033.stdout:847: done (5 left) 2021-07-26T15:59:25.135 INFO:tasks.rados.rados.0.smithi033.stdout:850: done (4 left) 2021-07-26T15:59:25.136 INFO:tasks.rados.rados.0.smithi033.stdout:852: done (3 left) 2021-07-26T15:59:25.136 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 81 2021-07-26T15:59:25.136 INFO:tasks.rados.rados.0.smithi033.stdout:849: finishing copy_from racing read to smithi03339061-10 2021-07-26T15:59:25.136 INFO:tasks.rados.rados.0.smithi033.stdout:851: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T15:59:25.219 INFO:tasks.rados.rados.0.smithi033.stdout:848: finishing copy_from to smithi03339061-44 2021-07-26T15:59:25.219 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 448 (ObjNum 232 snap 65 seq_num 232) dirty exists 2021-07-26T15:59:25.219 INFO:tasks.rados.rados.0.smithi033.stdout:848: finishing copy_from racing read to smithi03339061-44 2021-07-26T15:59:25.219 INFO:tasks.rados.rados.0.smithi033.stdout:853: seq_num 262 ranges {0=794624,794624=589824,1384448=614400} 2021-07-26T15:59:25.230 INFO:tasks.rados.rados.0.smithi033.stdout:853: writing smithi03339061-20 from 0 to 794624 tid 1 2021-07-26T15:59:25.233 INFO:tasks.rados.rados.0.smithi033.stdout:853: writing smithi03339061-20 from 794624 to 1384448 tid 2 2021-07-26T15:59:25.239 INFO:tasks.rados.rados.0.smithi033.stdout:853: writing smithi03339061-20 from 1384448 to 1998848 tid 3 2021-07-26T15:59:25.239 INFO:tasks.rados.rados.0.smithi033.stdout:848: done (3 left) 2021-07-26T15:59:25.239 INFO:tasks.rados.rados.0.smithi033.stdout:849: done (2 left) 2021-07-26T15:59:25.239 INFO:tasks.rados.rados.0.smithi033.stdout:851: done (1 left) 2021-07-26T15:59:25.240 INFO:tasks.rados.rados.0.smithi033.stdout:854: copy_from oid 45 from oid 48 current snap is 81 2021-07-26T15:59:25.240 INFO:tasks.rados.rados.0.smithi033.stdout:853: finishing write tid 1 to smithi03339061-20 2021-07-26T15:59:25.240 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 81 2021-07-26T15:59:25.240 INFO:tasks.rados.rados.0.smithi033.stdout:855: seq_num 263 ranges {0=409600,409600=475136,884736=557056,1441792=573440} 2021-07-26T15:59:25.241 INFO:tasks.rados.rados.0.smithi033.stdout:855: writing smithi03339061-50 from 0 to 409600 tid 1 2021-07-26T15:59:25.242 INFO:tasks.rados.rados.0.smithi033.stdout:855: writing smithi03339061-50 from 409600 to 884736 tid 2 2021-07-26T15:59:25.246 INFO:tasks.rados.rados.0.smithi033.stdout:855: writing smithi03339061-50 from 884736 to 1441792 tid 3 2021-07-26T15:59:25.250 INFO:tasks.rados.rados.0.smithi033.stdout:855: writing smithi03339061-50 from 1441792 to 2015232 tid 4 2021-07-26T15:59:25.250 INFO:tasks.rados.rados.0.smithi033.stdout:856: delete oid 18 current snap is 81 2021-07-26T15:59:25.251 INFO:tasks.rados.rados.0.smithi033.stdout:853: finishing write tid 2 to smithi03339061-20 2021-07-26T15:59:25.251 INFO:tasks.rados.rados.0.smithi033.stdout:853: finishing write tid 3 to smithi03339061-20 2021-07-26T15:59:25.251 INFO:tasks.rados.rados.0.smithi033.stdout:853: finishing write tid 4 to smithi03339061-20 2021-07-26T15:59:25.251 INFO:tasks.rados.rados.0.smithi033.stdout:854: finishing copy_from to smithi03339061-45 2021-07-26T15:59:25.251 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 242 (ObjNum 1851486554 snap 1683713879 seq_num 1683186540) dirty exists 2021-07-26T15:59:25.252 INFO:tasks.rados.rados.0.smithi033.stdout:853: finishing write tid 5 to smithi03339061-20 2021-07-26T15:59:25.252 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 452 (ObjNum 262 snap 81 seq_num 262) dirty exists 2021-07-26T15:59:25.252 INFO:tasks.rados.rados.0.smithi033.stdout:853: left oid 20 (ObjNum 262 snap 81 seq_num 262) 2021-07-26T15:59:25.252 INFO:tasks.rados.rados.0.smithi033.stdout:854: finishing copy_from racing read to smithi03339061-45 2021-07-26T15:59:25.253 INFO:tasks.rados.rados.0.smithi033.stdout:855: finishing write tid 1 to smithi03339061-50 2021-07-26T15:59:25.253 INFO:tasks.rados.rados.0.smithi033.stdout:855: finishing write tid 2 to smithi03339061-50 2021-07-26T15:59:25.254 INFO:tasks.rados.rados.0.smithi033.stdout:855: finishing write tid 3 to smithi03339061-50 2021-07-26T15:59:25.254 INFO:tasks.rados.rados.0.smithi033.stdout:853: done (3 left) 2021-07-26T15:59:25.254 INFO:tasks.rados.rados.0.smithi033.stdout:854: done (2 left) 2021-07-26T15:59:25.254 INFO:tasks.rados.rados.0.smithi033.stdout:856: done (1 left) 2021-07-26T15:59:25.255 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 81 2021-07-26T15:59:25.255 INFO:tasks.rados.rados.0.smithi033.stdout:857: seq_num 265 ranges {0=442368,442368=647168,1089536=573440,1662976=385024} 2021-07-26T15:59:25.255 INFO:tasks.rados.rados.0.smithi033.stdout:857: writing smithi03339061-47 from 0 to 442368 tid 1 2021-07-26T15:59:25.258 INFO:tasks.rados.rados.0.smithi033.stdout:857: writing smithi03339061-47 from 442368 to 1089536 tid 2 2021-07-26T15:59:25.261 INFO:tasks.rados.rados.0.smithi033.stdout:857: writing smithi03339061-47 from 1089536 to 1662976 tid 3 2021-07-26T15:59:25.264 INFO:tasks.rados.rados.0.smithi033.stdout:857: writing smithi03339061-47 from 1662976 to 2048000 tid 4 2021-07-26T15:59:25.264 INFO:tasks.rados.rados.0.smithi033.stdout:858: snap_create 2021-07-26T15:59:25.265 INFO:tasks.rados.rados.0.smithi033.stdout:855: finishing write tid 4 to smithi03339061-50 2021-07-26T15:59:25.265 INFO:tasks.rados.rados.0.smithi033.stdout:855: finishing write tid 5 to smithi03339061-50 2021-07-26T15:59:25.265 INFO:tasks.rados.rados.0.smithi033.stdout:855: finishing write tid 6 to smithi03339061-50 2021-07-26T15:59:25.265 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 217 (ObjNum 263 snap 81 seq_num 263) dirty exists 2021-07-26T15:59:25.265 INFO:tasks.rados.rados.0.smithi033.stdout:855: left oid 50 (ObjNum 263 snap 81 seq_num 263) 2021-07-26T15:59:25.266 INFO:tasks.rados.rados.0.smithi033.stdout:857: finishing write tid 1 to smithi03339061-47 2021-07-26T15:59:25.266 INFO:tasks.rados.rados.0.smithi033.stdout:857: finishing write tid 2 to smithi03339061-47 2021-07-26T15:59:25.267 INFO:tasks.rados.rados.0.smithi033.stdout:857: finishing write tid 3 to smithi03339061-47 2021-07-26T15:59:25.267 INFO:tasks.rados.rados.0.smithi033.stdout:857: finishing write tid 4 to smithi03339061-47 2021-07-26T15:59:25.267 INFO:tasks.rados.rados.0.smithi033.stdout:857: finishing write tid 5 to smithi03339061-47 2021-07-26T15:59:25.268 INFO:tasks.rados.rados.0.smithi033.stdout:857: finishing write tid 6 to smithi03339061-47 2021-07-26T15:59:25.268 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 276 (ObjNum 265 snap 81 seq_num 265) dirty exists 2021-07-26T15:59:25.268 INFO:tasks.rados.rados.0.smithi033.stdout:857: left oid 47 (ObjNum 265 snap 81 seq_num 265) 2021-07-26T15:59:25.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:24 smithi033 bash[41341]: audit 2021-07-26T15:59:23.672259+0000 mgr.y (mgr.34104) 87 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:25.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:24 smithi033 bash[41341]: cephadm 2021-07-26T15:59:23.673666+0000 mgr.y (mgr.34104) 88 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2021-07-26T15:59:25.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:24 smithi033 bash[41341]: cluster 2021-07-26T15:59:23.996206+0000 mon.a (mon.0) 204 : cluster [DBG] osdmap e215: 8 total, 7 up, 8 in 2021-07-26T15:59:25.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:24 smithi033 bash[42377]: audit 2021-07-26T15:59:23.672259+0000 mgr.y (mgr.34104) 87 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:25.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:24 smithi033 bash[42377]: cephadm 2021-07-26T15:59:23.673666+0000 mgr.y (mgr.34104) 88 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2021-07-26T15:59:25.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:24 smithi033 bash[42377]: cluster 2021-07-26T15:59:23.996206+0000 mon.a (mon.0) 204 : cluster [DBG] osdmap e215: 8 total, 7 up, 8 in 2021-07-26T15:59:25.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:24 smithi096 bash[33981]: audit 2021-07-26T15:59:23.672259+0000 mgr.y (mgr.34104) 87 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:25.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:24 smithi096 bash[33981]: cephadm 2021-07-26T15:59:23.673666+0000 mgr.y (mgr.34104) 88 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2021-07-26T15:59:25.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:25 smithi096 bash[33981]: cluster 2021-07-26T15:59:23.996206+0000 mon.a (mon.0) 204 : cluster [DBG] osdmap e215: 8 total, 7 up, 8 in 2021-07-26T15:59:25.947 INFO:tasks.rados.rados.0.smithi033.stdout:855: done (2 left) 2021-07-26T15:59:25.948 INFO:tasks.rados.rados.0.smithi033.stdout:857: done (1 left) 2021-07-26T15:59:25.948 INFO:tasks.rados.rados.0.smithi033.stdout:858: done (0 left) 2021-07-26T15:59:25.948 INFO:tasks.rados.rados.0.smithi033.stdout:859: snap_remove snap 74 2021-07-26T15:59:26.458 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:26 smithi033 bash[44048]: debug 2021-07-26T15:59:26.005+0000 7f1462a2b0c0 -1 osd.0 204 log_to_monitors {default=true} 2021-07-26T15:59:26.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:26 smithi033 bash[41341]: cluster 2021-07-26T15:59:24.967248+0000 mgr.y (mgr.34104) 89 : cluster [DBG] pgmap v110: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 6 op/s; 20/174 objects degraded (11.494%) 2021-07-26T15:59:26.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:26 smithi033 bash[41341]: cluster 2021-07-26T15:59:25.006836+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e216: 8 total, 7 up, 8 in 2021-07-26T15:59:26.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:26 smithi033 bash[41341]: cluster 2021-07-26T15:59:25.945136+0000 mon.a (mon.0) 206 : cluster [DBG] osdmap e217: 8 total, 7 up, 8 in 2021-07-26T15:59:26.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:26 smithi033 bash[42377]: cluster 2021-07-26T15:59:24.967248+0000 mgr.y (mgr.34104) 89 : cluster [DBG] pgmap v110: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 6 op/s; 20/174 objects degraded (11.494%) 2021-07-26T15:59:26.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:26 smithi033 bash[42377]: cluster 2021-07-26T15:59:25.006836+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e216: 8 total, 7 up, 8 in 2021-07-26T15:59:26.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:26 smithi033 bash[42377]: cluster 2021-07-26T15:59:25.945136+0000 mon.a (mon.0) 206 : cluster [DBG] osdmap e217: 8 total, 7 up, 8 in 2021-07-26T15:59:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:26 smithi096 bash[33981]: cluster 2021-07-26T15:59:24.967248+0000 mgr.y (mgr.34104) 89 : cluster [DBG] pgmap v110: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 6 op/s; 20/174 objects degraded (11.494%) 2021-07-26T15:59:26.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:26 smithi096 bash[33981]: cluster 2021-07-26T15:59:25.006836+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e216: 8 total, 7 up, 8 in 2021-07-26T15:59:26.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:26 smithi096 bash[33981]: cluster 2021-07-26T15:59:25.945136+0000 mon.a (mon.0) 206 : cluster [DBG] osdmap e217: 8 total, 7 up, 8 in 2021-07-26T15:59:26.962 INFO:tasks.rados.rados.0.smithi033.stdout:859: done (0 left) 2021-07-26T15:59:26.962 INFO:tasks.rados.rados.0.smithi033.stdout:860: rmattr oid 46 current snap is 82 2021-07-26T15:59:26.962 INFO:tasks.rados.rados.0.smithi033.stdout:860: done (0 left) 2021-07-26T15:59:26.963 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 82 2021-07-26T15:59:26.963 INFO:tasks.rados.rados.0.smithi033.stdout:861: seq_num 266 ranges {0=458752,458752=524288,983040=729088,1712128=352256} 2021-07-26T15:59:26.966 INFO:tasks.rados.rados.0.smithi033.stdout:861: writing smithi03339061-21 from 0 to 458752 tid 1 2021-07-26T15:59:26.970 INFO:tasks.rados.rados.0.smithi033.stdout:861: writing smithi03339061-21 from 458752 to 983040 tid 2 2021-07-26T15:59:26.974 INFO:tasks.rados.rados.0.smithi033.stdout:861: writing smithi03339061-21 from 983040 to 1712128 tid 3 2021-07-26T15:59:26.977 INFO:tasks.rados.rados.0.smithi033.stdout:861: writing smithi03339061-21 from 1712128 to 2064384 tid 4 2021-07-26T15:59:26.977 INFO:tasks.rados.rados.0.smithi033.stdout:862: delete oid 39 current snap is 82 2021-07-26T15:59:26.977 INFO:tasks.rados.rados.0.smithi033.stdout:861: finishing write tid 1 to smithi03339061-21 2021-07-26T15:59:26.978 INFO:tasks.rados.rados.0.smithi033.stdout:861: finishing write tid 2 to smithi03339061-21 2021-07-26T15:59:26.982 INFO:tasks.rados.rados.0.smithi033.stdout:861: finishing write tid 3 to smithi03339061-21 2021-07-26T15:59:26.982 INFO:tasks.rados.rados.0.smithi033.stdout:861: finishing write tid 4 to smithi03339061-21 2021-07-26T15:59:26.984 INFO:tasks.rados.rados.0.smithi033.stdout:861: finishing write tid 5 to smithi03339061-21 2021-07-26T15:59:26.985 INFO:tasks.rados.rados.0.smithi033.stdout:862: done (1 left) 2021-07-26T15:59:26.986 INFO:tasks.rados.rados.0.smithi033.stdout:863: read oid 49 snap -1 2021-07-26T15:59:26.986 INFO:tasks.rados.rados.0.smithi033.stdout:863: expect deleted 2021-07-26T15:59:26.986 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 82 2021-07-26T15:59:26.987 INFO:tasks.rados.rados.0.smithi033.stdout:864: seq_num 268 ranges {0=491520,491520=745472,1236992=745472,1982464=114688} 2021-07-26T15:59:26.990 INFO:tasks.rados.rados.0.smithi033.stdout:864: writing smithi03339061-28 from 0 to 491520 tid 1 2021-07-26T15:59:26.994 INFO:tasks.rados.rados.0.smithi033.stdout:864: writing smithi03339061-28 from 491520 to 1236992 tid 2 2021-07-26T15:59:26.998 INFO:tasks.rados.rados.0.smithi033.stdout:864: writing smithi03339061-28 from 1236992 to 1982464 tid 3 2021-07-26T15:59:27.000 INFO:tasks.rados.rados.0.smithi033.stdout:864: writing smithi03339061-28 from 1982464 to 2097152 tid 4 2021-07-26T15:59:27.000 INFO:tasks.rados.rados.0.smithi033.stdout:865: read oid 39 snap -1 2021-07-26T15:59:27.000 INFO:tasks.rados.rados.0.smithi033.stdout:865: expect deleted 2021-07-26T15:59:27.000 INFO:tasks.rados.rados.0.smithi033.stdout:866: rmattr oid 12 current snap is 82 2021-07-26T15:59:27.001 INFO:tasks.rados.rados.0.smithi033.stdout:866: done (4 left) 2021-07-26T15:59:27.001 INFO:tasks.rados.rados.0.smithi033.stdout:867: delete oid 3 current snap is 82 2021-07-26T15:59:27.001 INFO:tasks.rados.rados.0.smithi033.stdout:861: finishing write tid 6 to smithi03339061-21 2021-07-26T15:59:27.002 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 383 (ObjNum 266 snap 82 seq_num 266) dirty exists 2021-07-26T15:59:27.002 INFO:tasks.rados.rados.0.smithi033.stdout:861: left oid 21 (ObjNum 266 snap 82 seq_num 266) 2021-07-26T15:59:27.002 INFO:tasks.rados.rados.0.smithi033.stdout:864: finishing write tid 1 to smithi03339061-28 2021-07-26T15:59:27.002 INFO:tasks.rados.rados.0.smithi033.stdout:864: finishing write tid 2 to smithi03339061-28 2021-07-26T15:59:27.003 INFO:tasks.rados.rados.0.smithi033.stdout:861: done (4 left) 2021-07-26T15:59:27.004 INFO:tasks.rados.rados.0.smithi033.stdout:863: done (3 left) 2021-07-26T15:59:27.004 INFO:tasks.rados.rados.0.smithi033.stdout:865: done (2 left) 2021-07-26T15:59:27.004 INFO:tasks.rados.rados.0.smithi033.stdout:867: done (1 left) 2021-07-26T15:59:27.004 INFO:tasks.rados.rados.0.smithi033.stdout:868: copy_from oid 32 from oid 19 current snap is 82 2021-07-26T15:59:27.005 INFO:tasks.rados.rados.0.smithi033.stdout:869: snap_remove snap 80 2021-07-26T15:59:27.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[41341]: audit 2021-07-26T15:59:26.014698+0000 mon.c (mon.1) 46 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/580058714,v1:172.21.15.33:6803/580058714]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-07-26T15:59:27.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[41341]: audit 2021-07-26T15:59:26.015217+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-07-26T15:59:27.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[41341]: audit 2021-07-26T15:59:26.956461+0000 mon.a (mon.0) 208 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-07-26T15:59:27.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[41341]: cluster 2021-07-26T15:59:26.956734+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e218: 8 total, 7 up, 8 in 2021-07-26T15:59:27.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[41341]: audit 2021-07-26T15:59:26.958913+0000 mon.c (mon.1) 47 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/580058714,v1:172.21.15.33:6803/580058714]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:59:27.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[41341]: audit 2021-07-26T15:59:26.959695+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:59:27.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[42377]: audit 2021-07-26T15:59:26.014698+0000 mon.c (mon.1) 46 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/580058714,v1:172.21.15.33:6803/580058714]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-07-26T15:59:27.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[42377]: audit 2021-07-26T15:59:26.015217+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-07-26T15:59:27.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[42377]: audit 2021-07-26T15:59:26.956461+0000 mon.a (mon.0) 208 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-07-26T15:59:27.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[42377]: cluster 2021-07-26T15:59:26.956734+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e218: 8 total, 7 up, 8 in 2021-07-26T15:59:27.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[42377]: audit 2021-07-26T15:59:26.958913+0000 mon.c (mon.1) 47 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/580058714,v1:172.21.15.33:6803/580058714]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:59:27.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:27 smithi033 bash[42377]: audit 2021-07-26T15:59:26.959695+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:59:27.463 INFO:journalctl@ceph.osd.0.smithi033.stdout:Jul 26 15:59:26 smithi033 bash[44048]: debug 2021-07-26T15:59:26.977+0000 7f145337e700 -1 osd.0 204 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-07-26T15:59:27.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:27 smithi096 bash[33981]: audit 2021-07-26T15:59:26.014698+0000 mon.c (mon.1) 46 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/580058714,v1:172.21.15.33:6803/580058714]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-07-26T15:59:27.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:27 smithi096 bash[33981]: audit 2021-07-26T15:59:26.015217+0000 mon.a (mon.0) 207 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-07-26T15:59:27.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:27 smithi096 bash[33981]: audit 2021-07-26T15:59:26.956461+0000 mon.a (mon.0) 208 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-07-26T15:59:27.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:27 smithi096 bash[33981]: cluster 2021-07-26T15:59:26.956734+0000 mon.a (mon.0) 209 : cluster [DBG] osdmap e218: 8 total, 7 up, 8 in 2021-07-26T15:59:27.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:27 smithi096 bash[33981]: audit 2021-07-26T15:59:26.958913+0000 mon.c (mon.1) 47 : audit [INF] from='osd.0 [v2:172.21.15.33:6802/580058714,v1:172.21.15.33:6803/580058714]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:59:27.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:27 smithi096 bash[33981]: audit 2021-07-26T15:59:26.959695+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:59:27.969 INFO:tasks.rados.rados.0.smithi033.stdout:869: done (2 left) 2021-07-26T15:59:27.969 INFO:tasks.rados.rados.0.smithi033.stdout:870: snap_create 2021-07-26T15:59:27.970 INFO:tasks.rados.rados.0.smithi033.stdout:864: finishing write tid 3 to smithi03339061-28 2021-07-26T15:59:27.970 INFO:tasks.rados.rados.0.smithi033.stdout:864: finishing write tid 4 to smithi03339061-28 2021-07-26T15:59:27.970 INFO:tasks.rados.rados.0.smithi033.stdout:864: finishing write tid 5 to smithi03339061-28 2021-07-26T15:59:27.971 INFO:tasks.rados.rados.0.smithi033.stdout:864: finishing write tid 6 to smithi03339061-28 2021-07-26T15:59:27.971 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 215 (ObjNum 268 snap 82 seq_num 268) dirty exists 2021-07-26T15:59:27.971 INFO:tasks.rados.rados.0.smithi033.stdout:864: left oid 28 (ObjNum 268 snap 82 seq_num 268) 2021-07-26T15:59:27.971 INFO:tasks.rados.rados.0.smithi033.stdout:868: finishing copy_from to smithi03339061-32 2021-07-26T15:59:27.972 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 176 (ObjNum 200 snap 54 seq_num 200) dirty exists 2021-07-26T15:59:27.972 INFO:tasks.rados.rados.0.smithi033.stdout:868: finishing copy_from racing read to smithi03339061-32 2021-07-26T15:59:28.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:28 smithi033 bash[41341]: cluster 2021-07-26T15:59:26.968322+0000 mgr.y (mgr.34104) 90 : cluster [DBG] pgmap v114: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 6 op/s; 20/174 objects degraded (11.494%) 2021-07-26T15:59:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:28 smithi033 bash[41341]: cluster 2021-07-26T15:59:27.951829+0000 mon.a (mon.0) 211 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T15:59:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:28 smithi033 bash[41341]: cluster 2021-07-26T15:59:27.964764+0000 mon.a (mon.0) 212 : cluster [INF] osd.0 [v2:172.21.15.33:6802/580058714,v1:172.21.15.33:6803/580058714] boot 2021-07-26T15:59:28.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:28 smithi033 bash[41341]: cluster 2021-07-26T15:59:27.964884+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-07-26T15:59:28.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:28 smithi033 bash[41341]: audit 2021-07-26T15:59:27.966972+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:59:28.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:28 smithi033 bash[42377]: cluster 2021-07-26T15:59:26.968322+0000 mgr.y (mgr.34104) 90 : cluster [DBG] pgmap v114: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 6 op/s; 20/174 objects degraded (11.494%) 2021-07-26T15:59:28.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:28 smithi033 bash[42377]: cluster 2021-07-26T15:59:27.951829+0000 mon.a (mon.0) 211 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T15:59:28.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:28 smithi033 bash[42377]: cluster 2021-07-26T15:59:27.964764+0000 mon.a (mon.0) 212 : cluster [INF] osd.0 [v2:172.21.15.33:6802/580058714,v1:172.21.15.33:6803/580058714] boot 2021-07-26T15:59:28.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:28 smithi033 bash[42377]: cluster 2021-07-26T15:59:27.964884+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-07-26T15:59:28.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:28 smithi033 bash[42377]: audit 2021-07-26T15:59:27.966972+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:59:28.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:28 smithi096 bash[33981]: cluster 2021-07-26T15:59:26.968322+0000 mgr.y (mgr.34104) 90 : cluster [DBG] pgmap v114: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 469 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 6 op/s; 20/174 objects degraded (11.494%) 2021-07-26T15:59:28.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:28 smithi096 bash[33981]: cluster 2021-07-26T15:59:27.951829+0000 mon.a (mon.0) 211 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T15:59:28.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:28 smithi096 bash[33981]: cluster 2021-07-26T15:59:27.964764+0000 mon.a (mon.0) 212 : cluster [INF] osd.0 [v2:172.21.15.33:6802/580058714,v1:172.21.15.33:6803/580058714] boot 2021-07-26T15:59:28.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:28 smithi096 bash[33981]: cluster 2021-07-26T15:59:27.964884+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-07-26T15:59:28.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:28 smithi096 bash[33981]: audit 2021-07-26T15:59:27.966972+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-07-26T15:59:28.978 INFO:tasks.rados.rados.0.smithi033.stdout:864: done (2 left) 2021-07-26T15:59:28.979 INFO:tasks.rados.rados.0.smithi033.stdout:868: done (1 left) 2021-07-26T15:59:28.979 INFO:tasks.rados.rados.0.smithi033.stdout:870: done (0 left) 2021-07-26T15:59:28.979 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 83 2021-07-26T15:59:28.979 INFO:tasks.rados.rados.0.smithi033.stdout:871: seq_num 270 ranges {2064384=524288,2588672=516096,3104768=761856,3866624=327680} 2021-07-26T15:59:28.994 INFO:tasks.rados.rados.0.smithi033.stdout:871: writing smithi03339061-21 from 2064384 to 2588672 tid 1 2021-07-26T15:59:28.997 INFO:tasks.rados.rados.0.smithi033.stdout:871: writing smithi03339061-21 from 2588672 to 3104768 tid 2 2021-07-26T15:59:29.001 INFO:tasks.rados.rados.0.smithi033.stdout:871: writing smithi03339061-21 from 3104768 to 3866624 tid 3 2021-07-26T15:59:29.004 INFO:tasks.rados.rados.0.smithi033.stdout:871: writing smithi03339061-21 from 3866624 to 4194304 tid 4 2021-07-26T15:59:29.004 INFO:tasks.rados.rados.0.smithi033.stdout:872: rollback oid 42 current snap is 83 2021-07-26T15:59:29.005 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 42 to 76 2021-07-26T15:59:29.005 INFO:tasks.rados.rados.0.smithi033.stdout:871: finishing write tid 1 to smithi03339061-21 2021-07-26T15:59:29.005 INFO:tasks.rados.rados.0.smithi033.stdout:871: finishing write tid 2 to smithi03339061-21 2021-07-26T15:59:29.005 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 83 2021-07-26T15:59:29.006 INFO:tasks.rados.rados.0.smithi033.stdout:873: seq_num 271 ranges {2048000=540672,2588672=802816,3391488=516096,3907584=286720} 2021-07-26T15:59:29.020 INFO:tasks.rados.rados.0.smithi033.stdout:873: writing smithi03339061-47 from 2048000 to 2588672 tid 1 2021-07-26T15:59:29.024 INFO:tasks.rados.rados.0.smithi033.stdout:873: writing smithi03339061-47 from 2588672 to 3391488 tid 2 2021-07-26T15:59:29.028 INFO:tasks.rados.rados.0.smithi033.stdout:873: writing smithi03339061-47 from 3391488 to 3907584 tid 3 2021-07-26T15:59:29.031 INFO:tasks.rados.rados.0.smithi033.stdout:873: writing smithi03339061-47 from 3907584 to 4194304 tid 4 2021-07-26T15:59:29.031 INFO:tasks.rados.rados.0.smithi033.stdout:874: copy_from oid 13 from oid 7 current snap is 83 2021-07-26T15:59:29.031 INFO:tasks.rados.rados.0.smithi033.stdout:872: finishing rollback tid 0 to smithi03339061-42 2021-07-26T15:59:29.031 INFO:tasks.rados.rados.0.smithi033.stdout:871: finishing write tid 3 to smithi03339061-21 2021-07-26T15:59:29.032 INFO:tasks.rados.rados.0.smithi033.stdout:871: finishing write tid 4 to smithi03339061-21 2021-07-26T15:59:29.032 INFO:tasks.rados.rados.0.smithi033.stdout:871: finishing write tid 5 to smithi03339061-21 2021-07-26T15:59:29.032 INFO:tasks.rados.rados.0.smithi033.stdout:872: finishing rollback tid 1 to smithi03339061-42 2021-07-26T15:59:29.032 INFO:tasks.rados.rados.0.smithi033.stdout:872: finishing rollback tid 2 to smithi03339061-42 2021-07-26T15:59:29.033 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 194 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:29.033 INFO:tasks.rados.rados.0.smithi033.stdout:871: finishing write tid 6 to smithi03339061-21 2021-07-26T15:59:29.033 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 393 (ObjNum 270 snap 83 seq_num 270) dirty exists 2021-07-26T15:59:29.033 INFO:tasks.rados.rados.0.smithi033.stdout:871: left oid 21 (ObjNum 270 snap 83 seq_num 270) 2021-07-26T15:59:29.033 INFO:tasks.rados.rados.0.smithi033.stdout:871: done (3 left) 2021-07-26T15:59:29.034 INFO:tasks.rados.rados.0.smithi033.stdout:872: done (2 left) 2021-07-26T15:59:29.034 INFO:tasks.rados.rados.0.smithi033.stdout:875: snap_create 2021-07-26T15:59:29.035 INFO:tasks.rados.rados.0.smithi033.stdout:874: finishing copy_from to smithi03339061-13 2021-07-26T15:59:29.035 INFO:tasks.rados.rados.0.smithi033.stdout:874: got expected ENOENT (src dne) 2021-07-26T15:59:29.035 INFO:tasks.rados.rados.0.smithi033.stdout:874: finishing copy_from racing read to smithi03339061-13 2021-07-26T15:59:29.134 INFO:tasks.rados.rados.0.smithi033.stdout:873: finishing write tid 1 to smithi03339061-47 2021-07-26T15:59:29.135 INFO:tasks.rados.rados.0.smithi033.stdout:873: finishing write tid 2 to smithi03339061-47 2021-07-26T15:59:29.136 INFO:tasks.rados.rados.0.smithi033.stdout:873: finishing write tid 3 to smithi03339061-47 2021-07-26T15:59:29.136 INFO:tasks.rados.rados.0.smithi033.stdout:873: finishing write tid 4 to smithi03339061-47 2021-07-26T15:59:29.137 INFO:tasks.rados.rados.0.smithi033.stdout:873: finishing write tid 5 to smithi03339061-47 2021-07-26T15:59:29.139 INFO:tasks.rados.rados.0.smithi033.stdout:873: finishing write tid 6 to smithi03339061-47 2021-07-26T15:59:29.139 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 282 (ObjNum 271 snap 83 seq_num 271) dirty exists 2021-07-26T15:59:29.140 INFO:tasks.rados.rados.0.smithi033.stdout:873: left oid 47 (ObjNum 271 snap 83 seq_num 271) 2021-07-26T15:59:29.981 INFO:tasks.rados.rados.0.smithi033.stdout:873: done (2 left) 2021-07-26T15:59:29.982 INFO:tasks.rados.rados.0.smithi033.stdout:874: done (1 left) 2021-07-26T15:59:29.982 INFO:tasks.rados.rados.0.smithi033.stdout:875: done (0 left) 2021-07-26T15:59:29.982 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 84 2021-07-26T15:59:29.983 INFO:tasks.rados.rados.0.smithi033.stdout:876: seq_num 272 ranges {0=565248,565248=688128,1253376=729088,1982464=188416} 2021-07-26T15:59:29.989 INFO:tasks.rados.rados.0.smithi033.stdout:876: writing smithi03339061-15 from 0 to 565248 tid 1 2021-07-26T15:59:29.993 INFO:tasks.rados.rados.0.smithi033.stdout:876: writing smithi03339061-15 from 565248 to 1253376 tid 2 2021-07-26T15:59:29.997 INFO:tasks.rados.rados.0.smithi033.stdout:876: writing smithi03339061-15 from 1253376 to 1982464 tid 3 2021-07-26T15:59:29.999 INFO:tasks.rados.rados.0.smithi033.stdout:876: writing smithi03339061-15 from 1982464 to 2170880 tid 4 2021-07-26T15:59:30.000 INFO:tasks.rados.rados.0.smithi033.stdout:877: delete oid 31 current snap is 84 2021-07-26T15:59:30.000 INFO:tasks.rados.rados.0.smithi033.stdout:876: finishing write tid 1 to smithi03339061-15 2021-07-26T15:59:30.000 INFO:tasks.rados.rados.0.smithi033.stdout:876: finishing write tid 2 to smithi03339061-15 2021-07-26T15:59:30.006 INFO:tasks.rados.rados.0.smithi033.stdout:876: finishing write tid 3 to smithi03339061-15 2021-07-26T15:59:30.006 INFO:tasks.rados.rados.0.smithi033.stdout:877: done (1 left) 2021-07-26T15:59:30.007 INFO:tasks.rados.rados.0.smithi033.stdout:878: snap_create 2021-07-26T15:59:30.007 INFO:tasks.rados.rados.0.smithi033.stdout:876: finishing write tid 4 to smithi03339061-15 2021-07-26T15:59:30.007 INFO:tasks.rados.rados.0.smithi033.stdout:876: finishing write tid 5 to smithi03339061-15 2021-07-26T15:59:30.009 INFO:tasks.rados.rados.0.smithi033.stdout:876: finishing write tid 6 to smithi03339061-15 2021-07-26T15:59:30.009 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 186 (ObjNum 272 snap 84 seq_num 272) dirty exists 2021-07-26T15:59:30.009 INFO:tasks.rados.rados.0.smithi033.stdout:876: left oid 15 (ObjNum 272 snap 84 seq_num 272) 2021-07-26T15:59:30.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:29 smithi096 bash[33981]: cluster 2021-07-26T15:59:28.969076+0000 mgr.y (mgr.34104) 91 : cluster [DBG] pgmap v117: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 20/174 objects degraded (11.494%) 2021-07-26T15:59:30.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:29 smithi096 bash[33981]: cluster 2021-07-26T15:59:28.972891+0000 mon.a (mon.0) 214 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-07-26T15:59:30.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:29 smithi033 bash[41341]: cluster 2021-07-26T15:59:28.969076+0000 mgr.y (mgr.34104) 91 : cluster [DBG] pgmap v117: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 20/174 objects degraded (11.494%) 2021-07-26T15:59:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:29 smithi033 bash[41341]: cluster 2021-07-26T15:59:28.972891+0000 mon.a (mon.0) 214 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-07-26T15:59:30.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:29 smithi033 bash[42377]: cluster 2021-07-26T15:59:28.969076+0000 mgr.y (mgr.34104) 91 : cluster [DBG] pgmap v117: 25 pgs: 4 active+undersized+degraded, 7 active+undersized, 14 active+clean; 93 MiB data, 446 MiB used, 715 GiB / 715 GiB avail; 20/174 objects degraded (11.494%) 2021-07-26T15:59:30.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:29 smithi033 bash[42377]: cluster 2021-07-26T15:59:28.972891+0000 mon.a (mon.0) 214 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-07-26T15:59:30.996 INFO:tasks.rados.rados.0.smithi033.stdout:876: done (1 left) 2021-07-26T15:59:30.997 INFO:tasks.rados.rados.0.smithi033.stdout:878: done (0 left) 2021-07-26T15:59:30.997 INFO:tasks.rados.rados.0.smithi033.stdout:879: copy_from oid 33 from oid 44 current snap is 85 2021-07-26T15:59:30.997 INFO:tasks.rados.rados.0.smithi033.stdout:880: delete oid 3 current snap is 85 2021-07-26T15:59:30.999 INFO:tasks.rados.rados.0.smithi033.stdout:880: done (1 left) 2021-07-26T15:59:30.999 INFO:tasks.rados.rados.0.smithi033.stdout:881: snap_remove snap 79 2021-07-26T15:59:31.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:30 smithi096 bash[33981]: cluster 2021-07-26T15:59:29.979224+0000 mon.a (mon.0) 215 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-07-26T15:59:31.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:30 smithi096 bash[33981]: cluster 2021-07-26T15:59:30.935777+0000 mon.a (mon.0) 216 : cluster [WRN] Health check update: Degraded data redundancy: 20/174 objects degraded (11.494%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T15:59:31.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:30 smithi033 bash[41341]: cluster 2021-07-26T15:59:29.979224+0000 mon.a (mon.0) 215 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-07-26T15:59:31.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:30 smithi033 bash[41341]: cluster 2021-07-26T15:59:30.935777+0000 mon.a (mon.0) 216 : cluster [WRN] Health check update: Degraded data redundancy: 20/174 objects degraded (11.494%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T15:59:31.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:30 smithi033 bash[42377]: cluster 2021-07-26T15:59:29.979224+0000 mon.a (mon.0) 215 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-07-26T15:59:31.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:30 smithi033 bash[42377]: cluster 2021-07-26T15:59:30.935777+0000 mon.a (mon.0) 216 : cluster [WRN] Health check update: Degraded data redundancy: 20/174 objects degraded (11.494%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T15:59:32.005 INFO:tasks.rados.rados.0.smithi033.stdout:881: done (1 left) 2021-07-26T15:59:32.005 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 85 2021-07-26T15:59:32.005 INFO:tasks.rados.rados.0.smithi033.stdout:879: finishing copy_from to smithi03339061-33 2021-07-26T15:59:32.006 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 448 (ObjNum 232 snap 65 seq_num 232) dirty exists 2021-07-26T15:59:32.006 INFO:tasks.rados.rados.0.smithi033.stdout:882: seq_num 275 ranges {4194304=614400,4808704=786432,5595136=499712,6094848=319488} 2021-07-26T15:59:32.033 INFO:tasks.rados.rados.0.smithi033.stdout:882: writing smithi03339061-21 from 4194304 to 4808704 tid 1 2021-07-26T15:59:32.037 INFO:tasks.rados.rados.0.smithi033.stdout:882: writing smithi03339061-21 from 4808704 to 5595136 tid 2 2021-07-26T15:59:32.040 INFO:tasks.rados.rados.0.smithi033.stdout:882: writing smithi03339061-21 from 5595136 to 6094848 tid 3 2021-07-26T15:59:32.043 INFO:tasks.rados.rados.0.smithi033.stdout:882: writing smithi03339061-21 from 6094848 to 6414336 tid 4 2021-07-26T15:59:32.044 INFO:tasks.rados.rados.0.smithi033.stdout:883: read oid 3 snap -1 2021-07-26T15:59:32.044 INFO:tasks.rados.rados.0.smithi033.stdout:883: expect deleted 2021-07-26T15:59:32.044 INFO:tasks.rados.rados.0.smithi033.stdout:884: read oid 23 snap -1 2021-07-26T15:59:32.045 INFO:tasks.rados.rados.0.smithi033.stdout:884: expect (ObjNum 157 snap 39 seq_num 157) 2021-07-26T15:59:32.045 INFO:tasks.rados.rados.0.smithi033.stdout:885: delete oid 19 current snap is 85 2021-07-26T15:59:32.045 INFO:tasks.rados.rados.0.smithi033.stdout:879: finishing copy_from racing read to smithi03339061-33 2021-07-26T15:59:32.047 INFO:tasks.rados.rados.0.smithi033.stdout:882: finishing write tid 1 to smithi03339061-21 2021-07-26T15:59:32.050 INFO:tasks.rados.rados.0.smithi033.stdout:879: done (4 left) 2021-07-26T15:59:32.051 INFO:tasks.rados.rados.0.smithi033.stdout:883: done (3 left) 2021-07-26T15:59:32.051 INFO:tasks.rados.rados.0.smithi033.stdout:885: done (2 left) 2021-07-26T15:59:32.051 INFO:tasks.rados.rados.0.smithi033.stdout:886: rollback oid 41 current snap is 85 2021-07-26T15:59:32.052 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 41 to 84 2021-07-26T15:59:32.052 INFO:tasks.rados.rados.0.smithi033.stdout:887: rollback oid 22 current snap is 85 2021-07-26T15:59:32.052 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 22 to 72 2021-07-26T15:59:32.052 INFO:tasks.rados.rados.0.smithi033.stdout:888: rmattr oid 32 current snap is 85 2021-07-26T15:59:32.053 INFO:tasks.rados.rados.0.smithi033.stdout:889: read oid 17 snap -1 2021-07-26T15:59:32.053 INFO:tasks.rados.rados.0.smithi033.stdout:889: expect deleted 2021-07-26T15:59:32.053 INFO:tasks.rados.rados.0.smithi033.stdout:890: snap_create 2021-07-26T15:59:32.054 INFO:tasks.rados.rados.0.smithi033.stdout:882: finishing write tid 2 to smithi03339061-21 2021-07-26T15:59:32.054 INFO:tasks.rados.rados.0.smithi033.stdout:882: finishing write tid 3 to smithi03339061-21 2021-07-26T15:59:32.054 INFO:tasks.rados.rados.0.smithi033.stdout:882: finishing write tid 4 to smithi03339061-21 2021-07-26T15:59:32.055 INFO:tasks.rados.rados.0.smithi033.stdout:886: finishing rollback tid 0 to smithi03339061-41 2021-07-26T15:59:32.056 INFO:tasks.rados.rados.0.smithi033.stdout:886: finishing rollback tid 1 to smithi03339061-41 2021-07-26T15:59:32.056 INFO:tasks.rados.rados.0.smithi033.stdout:886: finishing rollback tid 2 to smithi03339061-41 2021-07-26T15:59:32.056 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 248 (ObjNum 7 snap 0 seq_num 7) dirty exists 2021-07-26T15:59:32.057 INFO:tasks.rados.rados.0.smithi033.stdout:887: finishing rollback tid 0 to smithi03339061-22 2021-07-26T15:59:32.057 INFO:tasks.rados.rados.0.smithi033.stdout:887: finishing rollback tid 1 to smithi03339061-22 2021-07-26T15:59:32.058 INFO:tasks.rados.rados.0.smithi033.stdout:887: finishing rollback tid 2 to smithi03339061-22 2021-07-26T15:59:32.058 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 482 (ObjNum 233 snap 66 seq_num 233) dirty exists 2021-07-26T15:59:32.068 INFO:tasks.rados.rados.0.smithi033.stdout:882: finishing write tid 5 to smithi03339061-21 2021-07-26T15:59:32.076 INFO:tasks.rados.rados.0.smithi033.stdout:884: expect (ObjNum 157 snap 39 seq_num 157) 2021-07-26T15:59:32.328 INFO:tasks.rados.rados.0.smithi033.stdout:882: finishing write tid 6 to smithi03339061-21 2021-07-26T15:59:32.328 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 401 (ObjNum 275 snap 85 seq_num 275) dirty exists 2021-07-26T15:59:32.328 INFO:tasks.rados.rados.0.smithi033.stdout:882: left oid 21 (ObjNum 275 snap 85 seq_num 275) 2021-07-26T15:59:32.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:31 smithi033 bash[41341]: cluster 2021-07-26T15:59:30.969879+0000 mgr.y (mgr.34104) 92 : cluster [DBG] pgmap v119: 25 pgs: 1 active+undersized+degraded, 1 active+undersized, 23 active+clean; 111 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 19 op/s; 6/213 objects degraded (2.817%); 2.2 MiB/s, 1 objects/s recovering 2021-07-26T15:59:32.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:31 smithi033 bash[41341]: cluster 2021-07-26T15:59:30.989977+0000 mon.a (mon.0) 217 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-07-26T15:59:32.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:31 smithi033 bash[42377]: cluster 2021-07-26T15:59:30.969879+0000 mgr.y (mgr.34104) 92 : cluster [DBG] pgmap v119: 25 pgs: 1 active+undersized+degraded, 1 active+undersized, 23 active+clean; 111 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 19 op/s; 6/213 objects degraded (2.817%); 2.2 MiB/s, 1 objects/s recovering 2021-07-26T15:59:32.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:31 smithi033 bash[42377]: cluster 2021-07-26T15:59:30.989977+0000 mon.a (mon.0) 217 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-07-26T15:59:32.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:31 smithi096 bash[33981]: cluster 2021-07-26T15:59:30.969879+0000 mgr.y (mgr.34104) 92 : cluster [DBG] pgmap v119: 25 pgs: 1 active+undersized+degraded, 1 active+undersized, 23 active+clean; 111 MiB data, 486 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 4.4 MiB/s wr, 19 op/s; 6/213 objects degraded (2.817%); 2.2 MiB/s, 1 objects/s recovering 2021-07-26T15:59:32.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:31 smithi096 bash[33981]: cluster 2021-07-26T15:59:30.989977+0000 mon.a (mon.0) 217 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-07-26T15:59:33.019 INFO:tasks.rados.rados.0.smithi033.stdout:882: done (6 left) 2021-07-26T15:59:33.019 INFO:tasks.rados.rados.0.smithi033.stdout:884: done (5 left) 2021-07-26T15:59:33.019 INFO:tasks.rados.rados.0.smithi033.stdout:886: done (4 left) 2021-07-26T15:59:33.019 INFO:tasks.rados.rados.0.smithi033.stdout:887: done (3 left) 2021-07-26T15:59:33.020 INFO:tasks.rados.rados.0.smithi033.stdout:889: done (2 left) 2021-07-26T15:59:33.020 INFO:tasks.rados.rados.0.smithi033.stdout:890: done (1 left) 2021-07-26T15:59:33.020 INFO:tasks.rados.rados.0.smithi033.stdout:891: snap_remove snap 69 2021-07-26T15:59:33.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:32 smithi033 bash[41341]: cluster 2021-07-26T15:59:32.001227+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-07-26T15:59:33.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:32 smithi033 bash[42377]: cluster 2021-07-26T15:59:32.001227+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-07-26T15:59:33.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:33 smithi096 bash[33981]: cluster 2021-07-26T15:59:32.001227+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-07-26T15:59:33.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:33 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:33.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:33 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:33.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:33 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:33.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T15:59:34.025 INFO:tasks.rados.rados.0.smithi033.stdout:891: done (1 left) 2021-07-26T15:59:34.026 INFO:tasks.rados.rados.0.smithi033.stdout:892: read oid 16 snap -1 2021-07-26T15:59:34.026 INFO:tasks.rados.rados.0.smithi033.stdout:892: expect (ObjNum 244 snap 70 seq_num 244) 2021-07-26T15:59:34.026 INFO:tasks.rados.rados.0.smithi033.stdout:893: read oid 18 snap -1 2021-07-26T15:59:34.026 INFO:tasks.rados.rados.0.smithi033.stdout:893: expect deleted 2021-07-26T15:59:34.027 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 86 2021-07-26T15:59:34.027 INFO:tasks.rados.rados.0.smithi033.stdout:894: seq_num 277 ranges {0=647168,647168=557056,1204224=516096,1720320=532480} 2021-07-26T15:59:34.031 INFO:tasks.rados.rados.0.smithi033.stdout:894: writing smithi03339061-19 from 0 to 647168 tid 1 2021-07-26T15:59:34.036 INFO:tasks.rados.rados.0.smithi033.stdout:894: writing smithi03339061-19 from 647168 to 1204224 tid 2 2021-07-26T15:59:34.039 INFO:tasks.rados.rados.0.smithi033.stdout:894: writing smithi03339061-19 from 1204224 to 1720320 tid 3 2021-07-26T15:59:34.043 INFO:tasks.rados.rados.0.smithi033.stdout:894: writing smithi03339061-19 from 1720320 to 2252800 tid 4 2021-07-26T15:59:34.044 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 17 current snap is 86 2021-07-26T15:59:34.044 INFO:tasks.rados.rados.0.smithi033.stdout:894: finishing write tid 1 to smithi03339061-19 2021-07-26T15:59:34.044 INFO:tasks.rados.rados.0.smithi033.stdout:894: finishing write tid 2 to smithi03339061-19 2021-07-26T15:59:34.044 INFO:tasks.rados.rados.0.smithi033.stdout:895: seq_num 278 ranges {0=663552,663552=442368,1105920=720896,1826816=442368} 2021-07-26T15:59:34.048 INFO:tasks.rados.rados.0.smithi033.stdout:895: writing smithi03339061-17 from 0 to 663552 tid 1 2021-07-26T15:59:34.050 INFO:tasks.rados.rados.0.smithi033.stdout:895: writing smithi03339061-17 from 663552 to 1105920 tid 2 2021-07-26T15:59:34.055 INFO:tasks.rados.rados.0.smithi033.stdout:895: writing smithi03339061-17 from 1105920 to 1826816 tid 3 2021-07-26T15:59:34.058 INFO:tasks.rados.rados.0.smithi033.stdout:895: writing smithi03339061-17 from 1826816 to 2269184 tid 4 2021-07-26T15:59:34.058 INFO:tasks.rados.rados.0.smithi033.stdout:893: done (4 left) 2021-07-26T15:59:34.058 INFO:tasks.rados.rados.0.smithi033.stdout:896: copy_from oid 8 from oid 3 current snap is 86 2021-07-26T15:59:34.059 INFO:tasks.rados.rados.0.smithi033.stdout:894: finishing write tid 3 to smithi03339061-19 2021-07-26T15:59:34.059 INFO:tasks.rados.rados.0.smithi033.stdout:894: finishing write tid 4 to smithi03339061-19 2021-07-26T15:59:34.059 INFO:tasks.rados.rados.0.smithi033.stdout:894: finishing write tid 5 to smithi03339061-19 2021-07-26T15:59:34.059 INFO:tasks.rados.rados.0.smithi033.stdout:894: finishing write tid 6 to smithi03339061-19 2021-07-26T15:59:34.059 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 240 (ObjNum 277 snap 86 seq_num 277) dirty exists 2021-07-26T15:59:34.060 INFO:tasks.rados.rados.0.smithi033.stdout:894: left oid 19 (ObjNum 277 snap 86 seq_num 277) 2021-07-26T15:59:34.060 INFO:tasks.rados.rados.0.smithi033.stdout:895: finishing write tid 1 to smithi03339061-17 2021-07-26T15:59:34.060 INFO:tasks.rados.rados.0.smithi033.stdout:895: finishing write tid 2 to smithi03339061-17 2021-07-26T15:59:34.060 INFO:tasks.rados.rados.0.smithi033.stdout:894: done (4 left) 2021-07-26T15:59:34.061 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 37 current snap is 86 2021-07-26T15:59:34.061 INFO:tasks.rados.rados.0.smithi033.stdout:897: seq_num 279 ranges {2203648=679936,2883584=720896,3604480=483328,4087808=401408} 2021-07-26T15:59:34.074 INFO:tasks.rados.rados.0.smithi033.stdout:897: writing smithi03339061-37 from 2203648 to 2883584 tid 1 2021-07-26T15:59:34.078 INFO:tasks.rados.rados.0.smithi033.stdout:897: writing smithi03339061-37 from 2883584 to 3604480 tid 2 2021-07-26T15:59:34.081 INFO:tasks.rados.rados.0.smithi033.stdout:897: writing smithi03339061-37 from 3604480 to 4087808 tid 3 2021-07-26T15:59:34.084 INFO:tasks.rados.rados.0.smithi033.stdout:897: writing smithi03339061-37 from 4087808 to 4489216 tid 4 2021-07-26T15:59:34.084 INFO:tasks.rados.rados.0.smithi033.stdout:898: rollback oid 20 current snap is 86 2021-07-26T15:59:34.085 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 20 to 76 2021-07-26T15:59:34.085 INFO:tasks.rados.rados.0.smithi033.stdout:896: finishing copy_from to smithi03339061-8 2021-07-26T15:59:34.085 INFO:tasks.rados.rados.0.smithi033.stdout:896: got expected ENOENT (src dne) 2021-07-26T15:59:34.085 INFO:tasks.rados.rados.0.smithi033.stdout:896: finishing copy_from racing read to smithi03339061-8 2021-07-26T15:59:34.086 INFO:tasks.rados.rados.0.smithi033.stdout:895: finishing write tid 3 to smithi03339061-17 2021-07-26T15:59:34.086 INFO:tasks.rados.rados.0.smithi033.stdout:895: finishing write tid 4 to smithi03339061-17 2021-07-26T15:59:34.086 INFO:tasks.rados.rados.0.smithi033.stdout:895: finishing write tid 5 to smithi03339061-17 2021-07-26T15:59:34.086 INFO:tasks.rados.rados.0.smithi033.stdout:895: finishing write tid 6 to smithi03339061-17 2021-07-26T15:59:34.086 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 191 (ObjNum 278 snap 86 seq_num 278) dirty exists 2021-07-26T15:59:34.087 INFO:tasks.rados.rados.0.smithi033.stdout:895: left oid 17 (ObjNum 278 snap 86 seq_num 278) 2021-07-26T15:59:34.087 INFO:tasks.rados.rados.0.smithi033.stdout:897: finishing write tid 1 to smithi03339061-37 2021-07-26T15:59:34.087 INFO:tasks.rados.rados.0.smithi033.stdout:895: done (5 left) 2021-07-26T15:59:34.087 INFO:tasks.rados.rados.0.smithi033.stdout:896: done (4 left) 2021-07-26T15:59:34.088 INFO:tasks.rados.rados.0.smithi033.stdout:899: delete oid 48 current snap is 86 2021-07-26T15:59:34.088 INFO:tasks.rados.rados.0.smithi033.stdout:897: finishing write tid 2 to smithi03339061-37 2021-07-26T15:59:34.090 INFO:tasks.rados.rados.0.smithi033.stdout:898: finishing rollback tid 0 to smithi03339061-20 2021-07-26T15:59:34.090 INFO:tasks.rados.rados.0.smithi033.stdout:899: done (4 left) 2021-07-26T15:59:34.091 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 86 2021-07-26T15:59:34.091 INFO:tasks.rados.rados.0.smithi033.stdout:900: seq_num 281 ranges {0=712704,712704=491520,1204224=491520,1695744=622592} 2021-07-26T15:59:34.092 INFO:tasks.rados.rados.0.smithi033.stdout:900: writing smithi03339061-45 from 0 to 712704 tid 1 2021-07-26T15:59:34.097 INFO:tasks.rados.rados.0.smithi033.stdout:900: writing smithi03339061-45 from 712704 to 1204224 tid 2 2021-07-26T15:59:34.099 INFO:tasks.rados.rados.0.smithi033.stdout:900: writing smithi03339061-45 from 1204224 to 1695744 tid 3 2021-07-26T15:59:34.103 INFO:tasks.rados.rados.0.smithi033.stdout:900: writing smithi03339061-45 from 1695744 to 2318336 tid 4 2021-07-26T15:59:34.103 INFO:tasks.rados.rados.0.smithi033.stdout:901: read oid 3 snap -1 2021-07-26T15:59:34.103 INFO:tasks.rados.rados.0.smithi033.stdout:901: expect deleted 2021-07-26T15:59:34.103 INFO:tasks.rados.rados.0.smithi033.stdout:902: snap_remove snap 84 2021-07-26T15:59:34.458 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 15:59:34 smithi033 bash[29474]: debug 2021-07-26T15:59:34.033+0000 7f0abfa6b700 -1 osd.3 pg_epoch: 225 pg[3.2s0( v 223'401 (0'0,223'401] local-lis/les=57/58 n=11 ec=57/57 lis/c=57/57 les/c/f=58/58/0 sis=57) [3,5,6]p3(0) r=0 lpr=57 crt=223'401 lcod 223'400 mlcod 223'400 active+clean+snaptrim trimq=[8c~1] ps=[8e~1,93~2,96~1,9a~2]] removing snap head 2021-07-26T15:59:34.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:34 smithi033 bash[41341]: cluster 2021-07-26T15:59:32.970556+0000 mgr.y (mgr.34104) 93 : cluster [DBG] pgmap v122: 25 pgs: 2 active+clean+wait, 23 active+clean; 116 MiB data, 496 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 22 op/s; 3.5 MiB/s, 2 objects/s recovering 2021-07-26T15:59:34.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:34 smithi033 bash[41341]: cluster 2021-07-26T15:59:32.996421+0000 mon.a (mon.0) 219 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/213 objects degraded (2.817%), 1 pg degraded) 2021-07-26T15:59:34.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:34 smithi033 bash[41341]: cluster 2021-07-26T15:59:32.996523+0000 mon.a (mon.0) 220 : cluster [INF] Cluster is now healthy 2021-07-26T15:59:34.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:34 smithi033 bash[41341]: cluster 2021-07-26T15:59:33.014281+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-07-26T15:59:34.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:34 smithi033 bash[42377]: cluster 2021-07-26T15:59:32.970556+0000 mgr.y (mgr.34104) 93 : cluster [DBG] pgmap v122: 25 pgs: 2 active+clean+wait, 23 active+clean; 116 MiB data, 496 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 22 op/s; 3.5 MiB/s, 2 objects/s recovering 2021-07-26T15:59:34.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:34 smithi033 bash[42377]: cluster 2021-07-26T15:59:32.996421+0000 mon.a (mon.0) 219 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/213 objects degraded (2.817%), 1 pg degraded) 2021-07-26T15:59:34.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:34 smithi033 bash[42377]: cluster 2021-07-26T15:59:32.996523+0000 mon.a (mon.0) 220 : cluster [INF] Cluster is now healthy 2021-07-26T15:59:34.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:34 smithi033 bash[42377]: cluster 2021-07-26T15:59:33.014281+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-07-26T15:59:34.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:34 smithi096 bash[33981]: cluster 2021-07-26T15:59:32.970556+0000 mgr.y (mgr.34104) 93 : cluster [DBG] pgmap v122: 25 pgs: 2 active+clean+wait, 23 active+clean; 116 MiB data, 496 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 5.7 MiB/s wr, 22 op/s; 3.5 MiB/s, 2 objects/s recovering 2021-07-26T15:59:34.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:34 smithi096 bash[33981]: cluster 2021-07-26T15:59:32.996421+0000 mon.a (mon.0) 219 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/213 objects degraded (2.817%), 1 pg degraded) 2021-07-26T15:59:34.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:34 smithi096 bash[33981]: cluster 2021-07-26T15:59:32.996523+0000 mon.a (mon.0) 220 : cluster [INF] Cluster is now healthy 2021-07-26T15:59:34.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:34 smithi096 bash[33981]: cluster 2021-07-26T15:59:33.014281+0000 mon.a (mon.0) 221 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-07-26T15:59:35.036 INFO:tasks.rados.rados.0.smithi033.stdout:902: done (6 left) 2021-07-26T15:59:35.036 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 86 2021-07-26T15:59:35.036 INFO:tasks.rados.rados.0.smithi033.stdout:897: finishing write tid 3 to smithi03339061-37 2021-07-26T15:59:35.037 INFO:tasks.rados.rados.0.smithi033.stdout:903: seq_num 282 ranges {7561216=729088,8290304=425984,8716288=704512,9420800=475136} 2021-07-26T15:59:35.086 INFO:tasks.rados.rados.0.smithi033.stdout:903: writing smithi03339061-40 from 7561216 to 8290304 tid 1 2021-07-26T15:59:35.088 INFO:tasks.rados.rados.0.smithi033.stdout:903: writing smithi03339061-40 from 8290304 to 8716288 tid 2 2021-07-26T15:59:35.092 INFO:tasks.rados.rados.0.smithi033.stdout:903: writing smithi03339061-40 from 8716288 to 9420800 tid 3 2021-07-26T15:59:35.096 INFO:tasks.rados.rados.0.smithi033.stdout:903: writing smithi03339061-40 from 9420800 to 9895936 tid 4 2021-07-26T15:59:35.096 INFO:tasks.rados.rados.0.smithi033.stdout:904: snap_create 2021-07-26T15:59:35.096 INFO:tasks.rados.rados.0.smithi033.stdout:898: finishing rollback tid 1 to smithi03339061-20 2021-07-26T15:59:35.096 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 454 (ObjNum 1210726728 snap 32561 seq_num 1257810992) dirty dne 2021-07-26T15:59:35.097 INFO:tasks.rados.rados.0.smithi033.stdout:897: finishing write tid 4 to smithi03339061-37 2021-07-26T15:59:35.097 INFO:tasks.rados.rados.0.smithi033.stdout:897: finishing write tid 5 to smithi03339061-37 2021-07-26T15:59:35.097 INFO:tasks.rados.rados.0.smithi033.stdout:897: finishing write tid 6 to smithi03339061-37 2021-07-26T15:59:35.097 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 302 (ObjNum 279 snap 86 seq_num 279) dirty exists 2021-07-26T15:59:35.098 INFO:tasks.rados.rados.0.smithi033.stdout:897: left oid 37 (ObjNum 279 snap 86 seq_num 279) 2021-07-26T15:59:35.098 INFO:tasks.rados.rados.0.smithi033.stdout:900: finishing write tid 1 to smithi03339061-45 2021-07-26T15:59:35.098 INFO:tasks.rados.rados.0.smithi033.stdout:900: finishing write tid 2 to smithi03339061-45 2021-07-26T15:59:35.098 INFO:tasks.rados.rados.0.smithi033.stdout:900: finishing write tid 3 to smithi03339061-45 2021-07-26T15:59:35.099 INFO:tasks.rados.rados.0.smithi033.stdout:900: finishing write tid 4 to smithi03339061-45 2021-07-26T15:59:35.099 INFO:tasks.rados.rados.0.smithi033.stdout:900: finishing write tid 5 to smithi03339061-45 2021-07-26T15:59:35.099 INFO:tasks.rados.rados.0.smithi033.stdout:900: finishing write tid 6 to smithi03339061-45 2021-07-26T15:59:35.100 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 492 (ObjNum 281 snap 86 seq_num 281) dirty exists 2021-07-26T15:59:35.100 INFO:tasks.rados.rados.0.smithi033.stdout:900: left oid 45 (ObjNum 281 snap 86 seq_num 281) 2021-07-26T15:59:35.103 INFO:tasks.rados.rados.0.smithi033.stdout:903: finishing write tid 1 to smithi03339061-40 2021-07-26T15:59:35.104 INFO:tasks.rados.rados.0.smithi033.stdout:903: finishing write tid 2 to smithi03339061-40 2021-07-26T15:59:35.106 INFO:tasks.rados.rados.0.smithi033.stdout:903: finishing write tid 3 to smithi03339061-40 2021-07-26T15:59:35.107 INFO:tasks.rados.rados.0.smithi033.stdout:903: finishing write tid 4 to smithi03339061-40 2021-07-26T15:59:35.108 INFO:tasks.rados.rados.0.smithi033.stdout:903: finishing write tid 5 to smithi03339061-40 2021-07-26T15:59:35.109 INFO:tasks.rados.rados.0.smithi033.stdout:903: finishing write tid 6 to smithi03339061-40 2021-07-26T15:59:35.109 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 196 (ObjNum 282 snap 86 seq_num 282) dirty exists 2021-07-26T15:59:35.109 INFO:tasks.rados.rados.0.smithi033.stdout:903: left oid 40 (ObjNum 282 snap 86 seq_num 282) 2021-07-26T15:59:35.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:35 smithi033 bash[41341]: cluster 2021-07-26T15:59:34.020281+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-07-26T15:59:35.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:35 smithi033 bash[42377]: cluster 2021-07-26T15:59:34.020281+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-07-26T15:59:35.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:35 smithi096 bash[33981]: cluster 2021-07-26T15:59:34.020281+0000 mon.a (mon.0) 222 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-07-26T15:59:35.954 INFO:tasks.rados.rados.0.smithi033.stdout:897: done (7 left) 2021-07-26T15:59:35.954 INFO:tasks.rados.rados.0.smithi033.stdout:898: done (6 left) 2021-07-26T15:59:35.954 INFO:tasks.rados.rados.0.smithi033.stdout:900: done (5 left) 2021-07-26T15:59:35.954 INFO:tasks.rados.rados.0.smithi033.stdout:901: done (4 left) 2021-07-26T15:59:35.955 INFO:tasks.rados.rados.0.smithi033.stdout:903: done (3 left) 2021-07-26T15:59:35.955 INFO:tasks.rados.rados.0.smithi033.stdout:904: done (2 left) 2021-07-26T15:59:35.955 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 87 2021-07-26T15:59:35.955 INFO:tasks.rados.rados.0.smithi033.stdout:905: seq_num 283 ranges {0=745472,745472=712704,1458176=458752,1916928=434176} 2021-07-26T15:59:35.958 INFO:tasks.rados.rados.0.smithi033.stdout:905: writing smithi03339061-48 from 0 to 745472 tid 1 2021-07-26T15:59:35.963 INFO:tasks.rados.rados.0.smithi033.stdout:905: writing smithi03339061-48 from 745472 to 1458176 tid 2 2021-07-26T15:59:35.966 INFO:tasks.rados.rados.0.smithi033.stdout:905: writing smithi03339061-48 from 1458176 to 1916928 tid 3 2021-07-26T15:59:35.968 INFO:tasks.rados.rados.0.smithi033.stdout:905: writing smithi03339061-48 from 1916928 to 2351104 tid 4 2021-07-26T15:59:35.969 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 87 2021-07-26T15:59:35.969 INFO:tasks.rados.rados.0.smithi033.stdout:905: finishing write tid 1 to smithi03339061-48 2021-07-26T15:59:35.969 INFO:tasks.rados.rados.0.smithi033.stdout:906: seq_num 284 ranges {0=761856,761856=598016,1359872=671744,2031616=335872} 2021-07-26T15:59:35.973 INFO:tasks.rados.rados.0.smithi033.stdout:906: writing smithi03339061-39 from 0 to 761856 tid 1 2021-07-26T15:59:35.977 INFO:tasks.rados.rados.0.smithi033.stdout:906: writing smithi03339061-39 from 761856 to 1359872 tid 2 2021-07-26T15:59:35.981 INFO:tasks.rados.rados.0.smithi033.stdout:906: writing smithi03339061-39 from 1359872 to 2031616 tid 3 2021-07-26T15:59:35.984 INFO:tasks.rados.rados.0.smithi033.stdout:906: writing smithi03339061-39 from 2031616 to 2367488 tid 4 2021-07-26T15:59:35.984 INFO:tasks.rados.rados.0.smithi033.stdout:907: rmattr oid 30 current snap is 87 2021-07-26T15:59:35.985 INFO:tasks.rados.rados.0.smithi033.stdout:905: finishing write tid 2 to smithi03339061-48 2021-07-26T15:59:35.985 INFO:tasks.rados.rados.0.smithi033.stdout:905: finishing write tid 3 to smithi03339061-48 2021-07-26T15:59:35.985 INFO:tasks.rados.rados.0.smithi033.stdout:905: finishing write tid 4 to smithi03339061-48 2021-07-26T15:59:35.985 INFO:tasks.rados.rados.0.smithi033.stdout:905: finishing write tid 5 to smithi03339061-48 2021-07-26T15:59:35.985 INFO:tasks.rados.rados.0.smithi033.stdout:905: finishing write tid 6 to smithi03339061-48 2021-07-26T15:59:35.986 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 263 (ObjNum 283 snap 87 seq_num 283) dirty exists 2021-07-26T15:59:35.986 INFO:tasks.rados.rados.0.smithi033.stdout:905: left oid 48 (ObjNum 283 snap 87 seq_num 283) 2021-07-26T15:59:35.986 INFO:tasks.rados.rados.0.smithi033.stdout:906: finishing write tid 1 to smithi03339061-39 2021-07-26T15:59:35.986 INFO:tasks.rados.rados.0.smithi033.stdout:906: finishing write tid 2 to smithi03339061-39 2021-07-26T15:59:35.987 INFO:tasks.rados.rados.0.smithi033.stdout:905: done (4 left) 2021-07-26T15:59:35.987 INFO:tasks.rados.rados.0.smithi033.stdout:908: delete oid 7 current snap is 87 2021-07-26T15:59:35.987 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 0 (ObjNum 249 snap 71 seq_num 249) dirty exists 2021-07-26T15:59:35.988 INFO:tasks.rados.rados.0.smithi033.stdout:906: finishing write tid 3 to smithi03339061-39 2021-07-26T15:59:35.988 INFO:tasks.rados.rados.0.smithi033.stdout:906: finishing write tid 4 to smithi03339061-39 2021-07-26T15:59:35.988 INFO:tasks.rados.rados.0.smithi033.stdout:906: finishing write tid 5 to smithi03339061-39 2021-07-26T15:59:35.989 INFO:tasks.rados.rados.0.smithi033.stdout:906: finishing write tid 6 to smithi03339061-39 2021-07-26T15:59:35.989 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 414 (ObjNum 284 snap 87 seq_num 284) dirty exists 2021-07-26T15:59:35.990 INFO:tasks.rados.rados.0.smithi033.stdout:906: left oid 39 (ObjNum 284 snap 87 seq_num 284) 2021-07-26T15:59:35.990 INFO:tasks.rados.rados.0.smithi033.stdout:906: done (4 left) 2021-07-26T15:59:35.990 INFO:tasks.rados.rados.0.smithi033.stdout:907: done (3 left) 2021-07-26T15:59:35.990 INFO:tasks.rados.rados.0.smithi033.stdout:908: done (2 left) 2021-07-26T15:59:35.991 INFO:tasks.rados.rados.0.smithi033.stdout:909: copy_from oid 22 from oid 41 current snap is 87 2021-07-26T15:59:35.991 INFO:tasks.rados.rados.0.smithi033.stdout:910: snap_create 2021-07-26T15:59:35.996 INFO:tasks.rados.rados.0.smithi033.stdout:909: finishing copy_from to smithi03339061-22 2021-07-26T15:59:35.996 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 248 (ObjNum 7 snap 0 seq_num 7) dirty exists 2021-07-26T15:59:35.997 INFO:tasks.rados.rados.0.smithi033.stdout:909: finishing copy_from racing read to smithi03339061-22 2021-07-26T15:59:36.028 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:36 smithi096 bash[33981]: cluster 2021-07-26T15:59:34.971427+0000 mgr.y (mgr.34104) 94 : cluster [DBG] pgmap v125: 25 pgs: 2 active+clean+wait, 23 active+clean; 124 MiB data, 518 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 5.0 MiB/s wr, 15 op/s; 1.3 MiB/s, 0 objects/s recovering 2021-07-26T15:59:36.028 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:36 smithi096 bash[33981]: cluster 2021-07-26T15:59:35.033310+0000 mon.a (mon.0) 223 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-07-26T15:59:36.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:36 smithi033 bash[41341]: cluster 2021-07-26T15:59:34.971427+0000 mgr.y (mgr.34104) 94 : cluster [DBG] pgmap v125: 25 pgs: 2 active+clean+wait, 23 active+clean; 124 MiB data, 518 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 5.0 MiB/s wr, 15 op/s; 1.3 MiB/s, 0 objects/s recovering 2021-07-26T15:59:36.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:36 smithi033 bash[41341]: cluster 2021-07-26T15:59:35.033310+0000 mon.a (mon.0) 223 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-07-26T15:59:36.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:36 smithi033 bash[41341]: cluster 2021-07-26T15:59:35.947126+0000 mon.a (mon.0) 224 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-07-26T15:59:36.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:36 smithi033 bash[42377]: cluster 2021-07-26T15:59:34.971427+0000 mgr.y (mgr.34104) 94 : cluster [DBG] pgmap v125: 25 pgs: 2 active+clean+wait, 23 active+clean; 124 MiB data, 518 MiB used, 715 GiB / 715 GiB avail; 3.3 MiB/s rd, 5.0 MiB/s wr, 15 op/s; 1.3 MiB/s, 0 objects/s recovering 2021-07-26T15:59:36.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:36 smithi033 bash[42377]: cluster 2021-07-26T15:59:35.033310+0000 mon.a (mon.0) 223 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-07-26T15:59:36.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:36 smithi033 bash[42377]: cluster 2021-07-26T15:59:35.947126+0000 mon.a (mon.0) 224 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-07-26T15:59:36.965 INFO:tasks.rados.rados.0.smithi033.stdout:909: done (3 left) 2021-07-26T15:59:36.965 INFO:tasks.rados.rados.0.smithi033.stdout:910: done (2 left) 2021-07-26T15:59:36.965 INFO:tasks.rados.rados.0.smithi033.stdout:911: rollback oid 25 current snap is 88 2021-07-26T15:59:36.966 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 25 to 72 2021-07-26T15:59:36.966 INFO:tasks.rados.rados.0.smithi033.stdout:912: copy_from oid 9 from oid 43 current snap is 88 2021-07-26T15:59:36.966 INFO:tasks.rados.rados.0.smithi033.stdout:913: rollback oid 5 current snap is 88 2021-07-26T15:59:36.966 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 5 to 82 2021-07-26T15:59:36.967 INFO:tasks.rados.rados.0.smithi033.stdout:914: snap_create 2021-07-26T15:59:36.973 INFO:tasks.rados.rados.0.smithi033.stdout:913: finishing rollback tid 1 to smithi03339061-5 2021-07-26T15:59:36.973 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 0 (ObjNum 2007247824 snap 22002 seq_num 1058724848) dirty dne 2021-07-26T15:59:36.992 INFO:tasks.rados.rados.0.smithi033.stdout:912: finishing copy_from to smithi03339061-9 2021-07-26T15:59:36.992 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 241 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:36.993 INFO:tasks.rados.rados.0.smithi033.stdout:912: finishing copy_from racing read to smithi03339061-9 2021-07-26T15:59:37.975 INFO:tasks.rados.rados.0.smithi033.stdout:912: done (5 left) 2021-07-26T15:59:37.976 INFO:tasks.rados.rados.0.smithi033.stdout:913: done (4 left) 2021-07-26T15:59:37.976 INFO:tasks.rados.rados.0.smithi033.stdout:914: done (3 left) 2021-07-26T15:59:37.976 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 89 2021-07-26T15:59:37.976 INFO:tasks.rados.rados.0.smithi033.stdout:915: seq_num 286 ranges {0=794624,794624=761856,1556480=679936,2236416=163840} 2021-07-26T15:59:37.985 INFO:tasks.rados.rados.0.smithi033.stdout:915: writing smithi03339061-8 from 0 to 794624 tid 1 2021-07-26T15:59:37.990 INFO:tasks.rados.rados.0.smithi033.stdout:915: writing smithi03339061-8 from 794624 to 1556480 tid 2 2021-07-26T15:59:37.994 INFO:tasks.rados.rados.0.smithi033.stdout:915: writing smithi03339061-8 from 1556480 to 2236416 tid 3 2021-07-26T15:59:37.995 INFO:tasks.rados.rados.0.smithi033.stdout:915: writing smithi03339061-8 from 2236416 to 2400256 tid 4 2021-07-26T15:59:37.996 INFO:tasks.rados.rados.0.smithi033.stdout:916: read oid 20 snap -1 2021-07-26T15:59:37.996 INFO:tasks.rados.rados.0.smithi033.stdout:916: expect deleted 2021-07-26T15:59:37.996 INFO:tasks.rados.rados.0.smithi033.stdout:917: snap_create 2021-07-26T15:59:37.997 INFO:tasks.rados.rados.0.smithi033.stdout:915: finishing write tid 1 to smithi03339061-8 2021-07-26T15:59:37.997 INFO:tasks.rados.rados.0.smithi033.stdout:915: finishing write tid 2 to smithi03339061-8 2021-07-26T15:59:38.001 INFO:tasks.rados.rados.0.smithi033.stdout:915: finishing write tid 3 to smithi03339061-8 2021-07-26T15:59:38.003 INFO:tasks.rados.rados.0.smithi033.stdout:915: finishing write tid 4 to smithi03339061-8 2021-07-26T15:59:38.003 INFO:tasks.rados.rados.0.smithi033.stdout:915: finishing write tid 5 to smithi03339061-8 2021-07-26T15:59:38.005 INFO:tasks.rados.rados.0.smithi033.stdout:915: finishing write tid 6 to smithi03339061-8 2021-07-26T15:59:38.005 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 249 (ObjNum 286 snap 89 seq_num 286) dirty exists 2021-07-26T15:59:38.005 INFO:tasks.rados.rados.0.smithi033.stdout:915: left oid 8 (ObjNum 286 snap 89 seq_num 286) 2021-07-26T15:59:38.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:36 smithi096 bash[33981]: cluster 2021-07-26T15:59:35.947126+0000 mon.a (mon.0) 224 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-07-26T15:59:38.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:37 smithi096 bash[33981]: cluster 2021-07-26T15:59:36.960940+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-07-26T15:59:38.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:37 smithi096 bash[33981]: cluster 2021-07-26T15:59:36.971949+0000 mgr.y (mgr.34104) 95 : cluster [DBG] pgmap v129: 25 pgs: 2 active+clean+wait, 23 active+clean; 124 MiB data, 518 MiB used, 715 GiB / 715 GiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 12 op/s 2021-07-26T15:59:38.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:37 smithi033 bash[41341]: cluster 2021-07-26T15:59:36.960940+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-07-26T15:59:38.499 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:37 smithi033 bash[41341]: cluster 2021-07-26T15:59:36.971949+0000 mgr.y (mgr.34104) 95 : cluster [DBG] pgmap v129: 25 pgs: 2 active+clean+wait, 23 active+clean; 124 MiB data, 518 MiB used, 715 GiB / 715 GiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 12 op/s 2021-07-26T15:59:38.500 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:37 smithi033 bash[42377]: cluster 2021-07-26T15:59:36.960940+0000 mon.a (mon.0) 225 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-07-26T15:59:38.500 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:37 smithi033 bash[42377]: cluster 2021-07-26T15:59:36.971949+0000 mgr.y (mgr.34104) 95 : cluster [DBG] pgmap v129: 25 pgs: 2 active+clean+wait, 23 active+clean; 124 MiB data, 518 MiB used, 715 GiB / 715 GiB avail; 3.4 MiB/s rd, 3.8 MiB/s wr, 12 op/s 2021-07-26T15:59:38.981 INFO:tasks.rados.rados.0.smithi033.stdout:915: done (5 left) 2021-07-26T15:59:38.982 INFO:tasks.rados.rados.0.smithi033.stdout:916: done (4 left) 2021-07-26T15:59:38.982 INFO:tasks.rados.rados.0.smithi033.stdout:917: done (3 left) 2021-07-26T15:59:38.982 INFO:tasks.rados.rados.0.smithi033.stdout:918: rollback oid 37 current snap is 90 2021-07-26T15:59:38.983 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 37 to 87 2021-07-26T15:59:38.983 INFO:tasks.rados.rados.0.smithi033.stdout:919: delete oid 24 current snap is 90 2021-07-26T15:59:38.991 INFO:tasks.rados.rados.0.smithi033.stdout:918: finishing rollback tid 0 to smithi03339061-37 2021-07-26T15:59:38.991 INFO:tasks.rados.rados.0.smithi033.stdout:918: finishing rollback tid 1 to smithi03339061-37 2021-07-26T15:59:38.992 INFO:tasks.rados.rados.0.smithi033.stdout:918: finishing rollback tid 2 to smithi03339061-37 2021-07-26T15:59:38.992 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 308 (ObjNum 279 snap 86 seq_num 279) dirty exists 2021-07-26T15:59:38.993 INFO:tasks.rados.rados.0.smithi033.stdout:918: done (4 left) 2021-07-26T15:59:38.993 INFO:tasks.rados.rados.0.smithi033.stdout:919: done (3 left) 2021-07-26T15:59:38.993 INFO:tasks.rados.rados.0.smithi033.stdout:920: copy_from oid 19 from oid 48 current snap is 90 2021-07-26T15:59:38.994 INFO:tasks.rados.rados.0.smithi033.stdout:921: read oid 12 snap 86 2021-07-26T15:59:38.994 INFO:tasks.rados.rados.0.smithi033.stdout:921: expect (ObjNum 257 snap 77 seq_num 257) 2021-07-26T15:59:38.994 INFO:tasks.rados.rados.0.smithi033.stdout:922: rollback oid 18 current snap is 90 2021-07-26T15:59:38.994 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 18 to 82 2021-07-26T15:59:38.995 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 90 2021-07-26T15:59:38.995 INFO:tasks.rados.rados.0.smithi033.stdout:923: seq_num 288 ranges {2433024=24576} 2021-07-26T15:59:39.012 INFO:tasks.rados.rados.0.smithi033.stdout:923: writing smithi03339061-42 from 2433024 to 2457600 tid 1 2021-07-26T15:59:39.012 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 90 2021-07-26T15:59:39.012 INFO:tasks.rados.rados.0.smithi033.stdout:924: seq_num 289 ranges {2433024=40960} 2021-07-26T15:59:39.026 INFO:tasks.rados.rados.0.smithi033.stdout:924: writing smithi03339061-43 from 2433024 to 2473984 tid 1 2021-07-26T15:59:39.028 INFO:tasks.rados.rados.0.smithi033.stdout:925: snap_remove snap 78 2021-07-26T15:59:39.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:38 smithi033 bash[41341]: cluster 2021-07-26T15:59:37.971672+0000 mon.a (mon.0) 226 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-07-26T15:59:39.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:38 smithi033 bash[41341]: audit 2021-07-26T15:59:38.678211+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:39.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:38 smithi033 bash[42377]: cluster 2021-07-26T15:59:37.971672+0000 mon.a (mon.0) 226 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-07-26T15:59:39.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:38 smithi033 bash[42377]: audit 2021-07-26T15:59:38.678211+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:39.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:38 smithi096 bash[33981]: cluster 2021-07-26T15:59:37.971672+0000 mon.a (mon.0) 226 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-07-26T15:59:39.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:38 smithi096 bash[33981]: audit 2021-07-26T15:59:38.678211+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:39.997 INFO:tasks.rados.rados.0.smithi033.stdout:925: done (8 left) 2021-07-26T15:59:39.998 INFO:tasks.rados.rados.0.smithi033.stdout:926: rmattr oid 36 current snap is 90 2021-07-26T15:59:39.998 INFO:tasks.rados.rados.0.smithi033.stdout:922: finishing rollback tid 1 to smithi03339061-18 2021-07-26T15:59:39.998 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 469 (ObjNum 2001410032 snap 22002 seq_num 1) dirty dne 2021-07-26T15:59:39.999 INFO:tasks.rados.rados.0.smithi033.stdout:921: expect (ObjNum 257 snap 77 seq_num 257) 2021-07-26T15:59:40.057 INFO:tasks.rados.rados.0.smithi033.stdout:920: finishing copy_from to smithi03339061-19 2021-07-26T15:59:40.058 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 263 (ObjNum 283 snap 87 seq_num 283) dirty exists 2021-07-26T15:59:40.058 INFO:tasks.rados.rados.0.smithi033.stdout:923: finishing write tid 1 to smithi03339061-42 2021-07-26T15:59:40.058 INFO:tasks.rados.rados.0.smithi033.stdout:920: finishing copy_from racing read to smithi03339061-19 2021-07-26T15:59:40.058 INFO:tasks.rados.rados.0.smithi033.stdout:923: finishing write tid 2 to smithi03339061-42 2021-07-26T15:59:40.059 INFO:tasks.rados.rados.0.smithi033.stdout:923: finishing write tid 3 to smithi03339061-42 2021-07-26T15:59:40.059 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 196 (ObjNum 288 snap 90 seq_num 288) dirty exists 2021-07-26T15:59:40.059 INFO:tasks.rados.rados.0.smithi033.stdout:923: left oid 42 (ObjNum 288 snap 90 seq_num 288) 2021-07-26T15:59:40.059 INFO:tasks.rados.rados.0.smithi033.stdout:924: finishing write tid 1 to smithi03339061-43 2021-07-26T15:59:40.060 INFO:tasks.rados.rados.0.smithi033.stdout:924: finishing write tid 2 to smithi03339061-43 2021-07-26T15:59:40.060 INFO:tasks.rados.rados.0.smithi033.stdout:924: finishing write tid 3 to smithi03339061-43 2021-07-26T15:59:40.060 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 267 (ObjNum 289 snap 90 seq_num 289) dirty exists 2021-07-26T15:59:40.060 INFO:tasks.rados.rados.0.smithi033.stdout:924: left oid 43 (ObjNum 289 snap 90 seq_num 289) 2021-07-26T15:59:40.060 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 191 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T15:59:40.061 INFO:tasks.rados.rados.0.smithi033.stdout:920: done (8 left) 2021-07-26T15:59:40.061 INFO:tasks.rados.rados.0.smithi033.stdout:921: done (7 left) 2021-07-26T15:59:40.061 INFO:tasks.rados.rados.0.smithi033.stdout:922: done (6 left) 2021-07-26T15:59:40.061 INFO:tasks.rados.rados.0.smithi033.stdout:923: done (5 left) 2021-07-26T15:59:40.061 INFO:tasks.rados.rados.0.smithi033.stdout:924: done (4 left) 2021-07-26T15:59:40.062 INFO:tasks.rados.rados.0.smithi033.stdout:926: done (3 left) 2021-07-26T15:59:40.062 INFO:tasks.rados.rados.0.smithi033.stdout:927: setattr oid 39 current snap is 90 2021-07-26T15:59:40.063 INFO:tasks.rados.rados.0.smithi033.stdout:928: snap_remove snap 85 2021-07-26T15:59:40.273 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:39 smithi033 bash[41341]: audit 2021-07-26T15:59:38.678689+0000 mgr.y (mgr.34104) 96 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:40.273 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:39 smithi033 bash[41341]: cephadm 2021-07-26T15:59:38.681071+0000 mgr.y (mgr.34104) 97 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-07-26T15:59:40.273 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:39 smithi033 bash[41341]: cluster 2021-07-26T15:59:38.972567+0000 mgr.y (mgr.34104) 98 : cluster [DBG] pgmap v131: 25 pgs: 2 active+clean+wait, 23 active+clean; 123 MiB data, 522 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:59:40.273 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:39 smithi033 bash[41341]: cluster 2021-07-26T15:59:38.978476+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-07-26T15:59:40.274 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:39 smithi033 bash[41341]: audit 2021-07-26T15:59:39.275103+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:40.274 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:39 smithi033 bash[42377]: audit 2021-07-26T15:59:38.678689+0000 mgr.y (mgr.34104) 96 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:40.274 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:39 smithi033 bash[42377]: cephadm 2021-07-26T15:59:38.681071+0000 mgr.y (mgr.34104) 97 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-07-26T15:59:40.274 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:39 smithi033 bash[42377]: cluster 2021-07-26T15:59:38.972567+0000 mgr.y (mgr.34104) 98 : cluster [DBG] pgmap v131: 25 pgs: 2 active+clean+wait, 23 active+clean; 123 MiB data, 522 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:59:40.275 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:39 smithi033 bash[42377]: cluster 2021-07-26T15:59:38.978476+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-07-26T15:59:40.275 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:39 smithi033 bash[42377]: audit 2021-07-26T15:59:39.275103+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:40.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:39 smithi096 bash[33981]: audit 2021-07-26T15:59:38.678689+0000 mgr.y (mgr.34104) 96 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2021-07-26T15:59:40.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:39 smithi096 bash[33981]: cephadm 2021-07-26T15:59:38.681071+0000 mgr.y (mgr.34104) 97 : cephadm [INF] Upgrade: osd.1 is safe to restart 2021-07-26T15:59:40.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:39 smithi096 bash[33981]: cluster 2021-07-26T15:59:38.972567+0000 mgr.y (mgr.34104) 98 : cluster [DBG] pgmap v131: 25 pgs: 2 active+clean+wait, 23 active+clean; 123 MiB data, 522 MiB used, 715 GiB / 715 GiB avail 2021-07-26T15:59:40.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:39 smithi096 bash[33981]: cluster 2021-07-26T15:59:38.978476+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-07-26T15:59:40.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:39 smithi096 bash[33981]: audit 2021-07-26T15:59:39.275103+0000 mon.a (mon.0) 228 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:40.954 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 419 (ObjNum 284 snap 87 seq_num 284) dirty exists 2021-07-26T15:59:40.955 INFO:tasks.rados.rados.0.smithi033.stdout:927: done (4 left) 2021-07-26T15:59:40.955 INFO:tasks.rados.rados.0.smithi033.stdout:928: done (3 left) 2021-07-26T15:59:40.955 INFO:tasks.rados.rados.0.smithi033.stdout:929: rollback oid 15 current snap is 90 2021-07-26T15:59:40.955 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 15 to 82 2021-07-26T15:59:40.955 INFO:tasks.rados.rados.0.smithi033.stdout:930: snap_remove snap 87 2021-07-26T15:59:41.427 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:40 smithi033 bash[42377]: cluster 2021-07-26T15:59:39.994726+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-07-26T15:59:41.427 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:40 smithi033 bash[42377]: cluster 2021-07-26T15:59:40.949818+0000 mon.a (mon.0) 230 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-07-26T15:59:41.428 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:40 smithi033 bash[41341]: cluster 2021-07-26T15:59:39.994726+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-07-26T15:59:41.428 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:40 smithi033 bash[41341]: cluster 2021-07-26T15:59:40.949818+0000 mon.a (mon.0) 230 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-07-26T15:59:41.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:40 smithi096 bash[33981]: cluster 2021-07-26T15:59:39.994726+0000 mon.a (mon.0) 229 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-07-26T15:59:41.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:40 smithi096 bash[33981]: cluster 2021-07-26T15:59:40.949818+0000 mon.a (mon.0) 230 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-07-26T15:59:41.974 INFO:tasks.rados.rados.0.smithi033.stdout:930: done (4 left) 2021-07-26T15:59:41.974 INFO:tasks.rados.rados.0.smithi033.stdout:931: read oid 39 snap -1 2021-07-26T15:59:41.975 INFO:tasks.rados.rados.0.smithi033.stdout:931: expect (ObjNum 284 snap 87 seq_num 284) 2021-07-26T15:59:41.975 INFO:tasks.rados.rados.0.smithi033.stdout:932: copy_from oid 26 from oid 18 current snap is 90 2021-07-26T15:59:41.975 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 90 2021-07-26T15:59:41.975 INFO:tasks.rados.rados.0.smithi033.stdout:933: seq_num 290 ranges {0=57344} 2021-07-26T15:59:41.976 INFO:tasks.rados.rados.0.smithi033.stdout:933: writing smithi03339061-14 from 0 to 57344 tid 1 2021-07-26T15:59:41.976 INFO:tasks.rados.rados.0.smithi033.stdout:934: read oid 12 snap 76 2021-07-26T15:59:41.976 INFO:tasks.rados.rados.0.smithi033.stdout:934: expect deleted 2021-07-26T15:59:41.976 INFO:tasks.rados.rados.0.smithi033.stdout:935: read oid 35 snap -1 2021-07-26T15:59:41.976 INFO:tasks.rados.rados.0.smithi033.stdout:935: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T15:59:41.977 INFO:tasks.rados.rados.0.smithi033.stdout:936: snap_create 2021-07-26T15:59:41.977 INFO:tasks.rados.rados.0.smithi033.stdout:929: finishing rollback tid 0 to smithi03339061-15 2021-07-26T15:59:41.977 INFO:tasks.rados.rados.0.smithi033.stdout:929: finishing rollback tid 1 to smithi03339061-15 2021-07-26T15:59:41.977 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 189 (ObjNum 1 snap 22002 seq_num 2006225728) dirty dne 2021-07-26T15:59:41.978 INFO:tasks.rados.rados.0.smithi033.stdout:892: expect (ObjNum 244 snap 70 seq_num 244) 2021-07-26T15:59:42.222 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 235 (ObjNum 200 snap 54 seq_num 200) dirty exists 2021-07-26T15:59:42.222 INFO:tasks.rados.rados.0.smithi033.stdout:911: finishing rollback tid 0 to smithi03339061-25 2021-07-26T15:59:42.222 INFO:tasks.rados.rados.0.smithi033.stdout:911: finishing rollback tid 1 to smithi03339061-25 2021-07-26T15:59:42.223 INFO:tasks.rados.rados.0.smithi033.stdout:911: finishing rollback tid 2 to smithi03339061-25 2021-07-26T15:59:42.223 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 239 (ObjNum 234 snap 66 seq_num 234) dirty exists 2021-07-26T15:59:42.223 INFO:tasks.rados.rados.0.smithi033.stdout:932: finishing copy_from to smithi03339061-26 2021-07-26T15:59:42.223 INFO:tasks.rados.rados.0.smithi033.stdout:932: got expected ENOENT (src dne) 2021-07-26T15:59:42.224 INFO:tasks.rados.rados.0.smithi033.stdout:932: finishing copy_from racing read to smithi03339061-26 2021-07-26T15:59:42.224 INFO:tasks.rados.rados.0.smithi033.stdout:933: finishing write tid 1 to smithi03339061-14 2021-07-26T15:59:42.224 INFO:tasks.rados.rados.0.smithi033.stdout:933: finishing write tid 2 to smithi03339061-14 2021-07-26T15:59:42.224 INFO:tasks.rados.rados.0.smithi033.stdout:933: finishing write tid 3 to smithi03339061-14 2021-07-26T15:59:42.224 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 456 (ObjNum 290 snap 90 seq_num 290) dirty exists 2021-07-26T15:59:42.225 INFO:tasks.rados.rados.0.smithi033.stdout:933: left oid 14 (ObjNum 290 snap 90 seq_num 290) 2021-07-26T15:59:42.225 INFO:tasks.rados.rados.0.smithi033.stdout:935: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T15:59:42.309 INFO:tasks.rados.rados.0.smithi033.stdout:931: expect (ObjNum 284 snap 87 seq_num 284) 2021-07-26T15:59:42.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:42 smithi033 bash[41341]: cluster 2021-07-26T15:59:40.973022+0000 mgr.y (mgr.34104) 99 : cluster [DBG] pgmap v135: 25 pgs: 2 active+clean+wait, 23 active+clean; 137 MiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 10 op/s 2021-07-26T15:59:42.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:42 smithi033 bash[41341]: cephadm 2021-07-26T15:59:41.189268+0000 mgr.y (mgr.34104) 100 : cephadm [INF] Upgrade: Updating osd.1 2021-07-26T15:59:42.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:42 smithi033 bash[41341]: audit 2021-07-26T15:59:41.198896+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:42.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:42 smithi033 bash[41341]: cephadm 2021-07-26T15:59:41.201555+0000 mgr.y (mgr.34104) 101 : cephadm [INF] Deploying daemon osd.1 on smithi033 2021-07-26T15:59:42.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:42 smithi033 bash[41341]: cluster 2021-07-26T15:59:41.969455+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-07-26T15:59:42.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:42 smithi033 bash[42377]: cluster 2021-07-26T15:59:40.973022+0000 mgr.y (mgr.34104) 99 : cluster [DBG] pgmap v135: 25 pgs: 2 active+clean+wait, 23 active+clean; 137 MiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 10 op/s 2021-07-26T15:59:42.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:42 smithi033 bash[42377]: cephadm 2021-07-26T15:59:41.189268+0000 mgr.y (mgr.34104) 100 : cephadm [INF] Upgrade: Updating osd.1 2021-07-26T15:59:42.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:42 smithi033 bash[42377]: audit 2021-07-26T15:59:41.198896+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:42.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:42 smithi033 bash[42377]: cephadm 2021-07-26T15:59:41.201555+0000 mgr.y (mgr.34104) 101 : cephadm [INF] Deploying daemon osd.1 on smithi033 2021-07-26T15:59:42.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:42 smithi033 bash[42377]: cluster 2021-07-26T15:59:41.969455+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-07-26T15:59:42.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:42 smithi096 bash[33981]: cluster 2021-07-26T15:59:40.973022+0000 mgr.y (mgr.34104) 99 : cluster [DBG] pgmap v135: 25 pgs: 2 active+clean+wait, 23 active+clean; 137 MiB data, 549 MiB used, 715 GiB / 715 GiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 10 op/s 2021-07-26T15:59:42.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:42 smithi096 bash[33981]: cephadm 2021-07-26T15:59:41.189268+0000 mgr.y (mgr.34104) 100 : cephadm [INF] Upgrade: Updating osd.1 2021-07-26T15:59:42.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:42 smithi096 bash[33981]: audit 2021-07-26T15:59:41.198896+0000 mon.a (mon.0) 231 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:42.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:42 smithi096 bash[33981]: cephadm 2021-07-26T15:59:41.201555+0000 mgr.y (mgr.34104) 101 : cephadm [INF] Deploying daemon osd.1 on smithi033 2021-07-26T15:59:42.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:42 smithi096 bash[33981]: cluster 2021-07-26T15:59:41.969455+0000 mon.a (mon.0) 232 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-07-26T15:59:42.980 INFO:tasks.rados.rados.0.smithi033.stdout:888: done (9 left) 2021-07-26T15:59:42.980 INFO:tasks.rados.rados.0.smithi033.stdout:892: done (8 left) 2021-07-26T15:59:42.981 INFO:tasks.rados.rados.0.smithi033.stdout:911: done (7 left) 2021-07-26T15:59:42.981 INFO:tasks.rados.rados.0.smithi033.stdout:929: done (6 left) 2021-07-26T15:59:42.981 INFO:tasks.rados.rados.0.smithi033.stdout:931: done (5 left) 2021-07-26T15:59:42.981 INFO:tasks.rados.rados.0.smithi033.stdout:932: done (4 left) 2021-07-26T15:59:42.982 INFO:tasks.rados.rados.0.smithi033.stdout:933: done (3 left) 2021-07-26T15:59:42.982 INFO:tasks.rados.rados.0.smithi033.stdout:934: done (2 left) 2021-07-26T15:59:42.982 INFO:tasks.rados.rados.0.smithi033.stdout:935: done (1 left) 2021-07-26T15:59:42.982 INFO:tasks.rados.rados.0.smithi033.stdout:936: done (0 left) 2021-07-26T15:59:42.982 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 91 2021-07-26T15:59:42.983 INFO:tasks.rados.rados.0.smithi033.stdout:937: seq_num 291 ranges {0=81920} 2021-07-26T15:59:42.983 INFO:tasks.rados.rados.0.smithi033.stdout:937: writing smithi03339061-49 from 0 to 81920 tid 1 2021-07-26T15:59:42.984 INFO:tasks.rados.rados.0.smithi033.stdout:938: rmattr oid 3 current snap is 91 2021-07-26T15:59:42.984 INFO:tasks.rados.rados.0.smithi033.stdout:938: done (1 left) 2021-07-26T15:59:42.984 INFO:tasks.rados.rados.0.smithi033.stdout:939: setattr oid 14 current snap is 91 2021-07-26T15:59:42.985 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 91 2021-07-26T15:59:42.985 INFO:tasks.rados.rados.0.smithi033.stdout:940: seq_num 292 ranges {2097152=98304} 2021-07-26T15:59:43.000 INFO:tasks.rados.rados.0.smithi033.stdout:940: writing smithi03339061-26 from 2097152 to 2195456 tid 1 2021-07-26T15:59:43.000 INFO:tasks.rados.rados.0.smithi033.stdout:941: delete oid 30 current snap is 91 2021-07-26T15:59:43.000 INFO:tasks.rados.rados.0.smithi033.stdout:937: finishing write tid 1 to smithi03339061-49 2021-07-26T15:59:43.000 INFO:tasks.rados.rados.0.smithi033.stdout:937: finishing write tid 2 to smithi03339061-49 2021-07-26T15:59:43.001 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 457 (ObjNum 290 snap 90 seq_num 290) dirty exists 2021-07-26T15:59:43.001 INFO:tasks.rados.rados.0.smithi033.stdout:937: finishing write tid 3 to smithi03339061-49 2021-07-26T15:59:43.001 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 193 (ObjNum 291 snap 91 seq_num 291) dirty exists 2021-07-26T15:59:43.001 INFO:tasks.rados.rados.0.smithi033.stdout:937: left oid 49 (ObjNum 291 snap 91 seq_num 291) 2021-07-26T15:59:43.004 INFO:tasks.rados.rados.0.smithi033.stdout:937: done (3 left) 2021-07-26T15:59:43.004 INFO:tasks.rados.rados.0.smithi033.stdout:939: done (2 left) 2021-07-26T15:59:43.004 INFO:tasks.rados.rados.0.smithi033.stdout:941: done (1 left) 2021-07-26T15:59:43.005 INFO:tasks.rados.rados.0.smithi033.stdout:942: read oid 5 snap -1 2021-07-26T15:59:43.005 INFO:tasks.rados.rados.0.smithi033.stdout:942: expect deleted 2021-07-26T15:59:43.005 INFO:tasks.rados.rados.0.smithi033.stdout:943: rmattr oid 32 current snap is 91 2021-07-26T15:59:43.005 INFO:tasks.rados.rados.0.smithi033.stdout:944: rmattr oid 50 current snap is 91 2021-07-26T15:59:43.005 INFO:tasks.rados.rados.0.smithi033.stdout:944: done (3 left) 2021-07-26T15:59:43.006 INFO:tasks.rados.rados.0.smithi033.stdout:945: setattr oid 20 current snap is 91 2021-07-26T15:59:43.007 INFO:tasks.rados.rados.0.smithi033.stdout:940: finishing write tid 1 to smithi03339061-26 2021-07-26T15:59:43.007 INFO:tasks.rados.rados.0.smithi033.stdout:946: read oid 24 snap 83 2021-07-26T15:59:43.007 INFO:tasks.rados.rados.0.smithi033.stdout:946: expect (ObjNum 240 snap 68 seq_num 240) 2021-07-26T15:59:43.007 INFO:tasks.rados.rados.0.smithi033.stdout:947: delete oid 14 current snap is 91 2021-07-26T15:59:43.008 INFO:tasks.rados.rados.0.smithi033.stdout:940: finishing write tid 2 to smithi03339061-26 2021-07-26T15:59:43.011 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 243 (ObjNum 200 snap 54 seq_num 200) dirty exists 2021-07-26T15:59:43.011 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 458 (ObjNum 2006645264 snap 22002 seq_num 2007139392) dirty exists 2021-07-26T15:59:43.012 INFO:tasks.rados.rados.0.smithi033.stdout:940: finishing write tid 3 to smithi03339061-26 2021-07-26T15:59:43.013 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 512 (ObjNum 292 snap 91 seq_num 292) dirty exists 2021-07-26T15:59:43.013 INFO:tasks.rados.rados.0.smithi033.stdout:940: left oid 26 (ObjNum 292 snap 91 seq_num 292) 2021-07-26T15:59:43.013 INFO:tasks.rados.rados.0.smithi033.stdout:940: done (5 left) 2021-07-26T15:59:43.013 INFO:tasks.rados.rados.0.smithi033.stdout:942: done (4 left) 2021-07-26T15:59:43.014 INFO:tasks.rados.rados.0.smithi033.stdout:943: done (3 left) 2021-07-26T15:59:43.014 INFO:tasks.rados.rados.0.smithi033.stdout:945: done (2 left) 2021-07-26T15:59:43.014 INFO:tasks.rados.rados.0.smithi033.stdout:947: done (1 left) 2021-07-26T15:59:43.014 INFO:tasks.rados.rados.0.smithi033.stdout:948: copy_from oid 11 from oid 21 current snap is 91 2021-07-26T15:59:43.015 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 17 current snap is 91 2021-07-26T15:59:43.015 INFO:tasks.rados.rados.0.smithi033.stdout:949: seq_num 295 ranges {2269184=147456} 2021-07-26T15:59:43.028 INFO:tasks.rados.rados.0.smithi033.stdout:949: writing smithi03339061-17 from 2269184 to 2416640 tid 1 2021-07-26T15:59:43.028 INFO:tasks.rados.rados.0.smithi033.stdout:950: setattr oid 29 current snap is 91 2021-07-26T15:59:43.028 INFO:tasks.rados.rados.0.smithi033.stdout:946: expect (ObjNum 240 snap 68 seq_num 240) 2021-07-26T15:59:43.080 INFO:tasks.rados.rados.0.smithi033.stdout:949: finishing write tid 1 to smithi03339061-17 2021-07-26T15:59:43.080 INFO:tasks.rados.rados.0.smithi033.stdout:949: finishing write tid 2 to smithi03339061-17 2021-07-26T15:59:43.080 INFO:tasks.rados.rados.0.smithi033.stdout:949: finishing write tid 3 to smithi03339061-17 2021-07-26T15:59:43.080 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 198 (ObjNum 295 snap 91 seq_num 295) dirty exists 2021-07-26T15:59:43.081 INFO:tasks.rados.rados.0.smithi033.stdout:949: left oid 17 (ObjNum 295 snap 91 seq_num 295) 2021-07-26T15:59:43.081 INFO:tasks.rados.rados.0.smithi033.stdout:948: finishing copy_from to smithi03339061-11 2021-07-26T15:59:43.081 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 401 (ObjNum 275 snap 85 seq_num 275) dirty exists 2021-07-26T15:59:43.082 INFO:tasks.rados.rados.0.smithi033.stdout:948: finishing copy_from racing read to smithi03339061-11 2021-07-26T15:59:43.082 INFO:tasks.rados.rados.0.smithi033.stdout:946: done (3 left) 2021-07-26T15:59:43.082 INFO:tasks.rados.rados.0.smithi033.stdout:948: done (2 left) 2021-07-26T15:59:43.082 INFO:tasks.rados.rados.0.smithi033.stdout:949: done (1 left) 2021-07-26T15:59:43.083 INFO:tasks.rados.rados.0.smithi033.stdout:951: snap_create 2021-07-26T15:59:43.083 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 177 (ObjNum 2006527376 snap 22002 seq_num 2007462400) dirty exists 2021-07-26T15:59:43.288 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T15:59:43.616 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T15:59:43.617 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (6m) 20s ago 6m 14.8M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T15:59:43.617 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (6m) 62s ago 6m 25.5M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T15:59:43.617 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (115s) 62s ago 11m 372M - 17.0.0-6381-gbccf07c2 6cdb40438e66 909ec99bd712 2021-07-26T15:59:43.617 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (2m) 20s ago 13m 414M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T15:59:43.618 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (103s) 20s ago 13m 44.9M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 7649338580a7 2021-07-26T15:59:43.618 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (69s) 62s ago 11m 21.0M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 5a3d2fea4cb3 2021-07-26T15:59:43.618 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (82s) 20s ago 11m 36.1M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 76ce8786552e 2021-07-26T15:59:43.618 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (6m) 20s ago 7m 11.0M - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T15:59:43.619 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (6m) 62s ago 7m 11.3M - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T15:59:43.619 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (22s) 20s ago 10m - 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 7275343c45f7 2021-07-26T15:59:43.619 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (10m) 20s ago 10m 95.1M 3553M 16.2.5 34f74fddb18e 35137704568f 2021-07-26T15:59:43.619 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (9m) 20s ago 9m 86.1M 3553M 16.2.5 34f74fddb18e d351359286fd 2021-07-26T15:59:43.619 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (9m) 20s ago 9m 148M 3553M 16.2.5 34f74fddb18e 6b68e9927be6 2021-07-26T15:59:43.620 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (8m) 62s ago 8m 88.5M 3552M 16.2.5 34f74fddb18e 1aac82d5671e 2021-07-26T15:59:43.620 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (8m) 62s ago 8m 83.8M 3552M 16.2.5 34f74fddb18e 12b89782c2eb 2021-07-26T15:59:43.620 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (7m) 62s ago 8m 74.8M 3552M 16.2.5 34f74fddb18e 4fad5a8407d4 2021-07-26T15:59:43.621 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (7m) 62s ago 7m 70.1M 3552M 16.2.5 34f74fddb18e a988c60ad3d5 2021-07-26T15:59:43.621 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (6m) 62s ago 7m 38.1M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T15:59:43.779 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:43.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:43.779 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:43.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:43.779 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:43 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:43.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T15:59:43.984 INFO:tasks.rados.rados.0.smithi033.stdout:950: done (1 left) 2021-07-26T15:59:43.984 INFO:tasks.rados.rados.0.smithi033.stdout:951: done (0 left) 2021-07-26T15:59:43.985 INFO:tasks.rados.rados.0.smithi033.stdout:952: snap_create 2021-07-26T15:59:44.017 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T15:59:44.017 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T15:59:44.017 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T15:59:44.017 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:59:44.018 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T15:59:44.018 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T15:59:44.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:59:44.018 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T15:59:44.019 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 7, 2021-07-26T15:59:44.019 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 1 2021-07-26T15:59:44.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T15:59:44.019 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T15:59:44.020 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T15:59:44.020 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 7, 2021-07-26T15:59:44.020 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 6 2021-07-26T15:59:44.020 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T15:59:44.021 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T15:59:44.056 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:43 smithi033 bash[42377]: cluster 2021-07-26T15:59:42.973609+0000 mgr.y (mgr.34104) 102 : cluster [DBG] pgmap v138: 25 pgs: 2 active+clean+snaptrim_wait, 23 active+clean; 137 MiB data, 550 MiB used, 715 GiB / 715 GiB avail; 5.0 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2021-07-26T15:59:44.056 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:43 smithi033 bash[42377]: cluster 2021-07-26T15:59:42.974510+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-07-26T15:59:44.057 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:43 smithi033 bash[42377]: audit 2021-07-26T15:59:43.272039+0000 mgr.y (mgr.34104) 103 : audit [DBG] from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:44.057 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:43 smithi033 bash[42377]: audit 2021-07-26T15:59:43.593761+0000 mgr.y (mgr.34104) 104 : audit [DBG] from='client.44149 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:44.057 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:43 smithi033 bash[41341]: cluster 2021-07-26T15:59:42.973609+0000 mgr.y (mgr.34104) 102 : cluster [DBG] pgmap v138: 25 pgs: 2 active+clean+snaptrim_wait, 23 active+clean; 137 MiB data, 550 MiB used, 715 GiB / 715 GiB avail; 5.0 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2021-07-26T15:59:44.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:43 smithi033 bash[41341]: cluster 2021-07-26T15:59:42.974510+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-07-26T15:59:44.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:43 smithi033 bash[41341]: audit 2021-07-26T15:59:43.272039+0000 mgr.y (mgr.34104) 103 : audit [DBG] from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:44.058 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:43 smithi033 bash[41341]: audit 2021-07-26T15:59:43.593761+0000 mgr.y (mgr.34104) 104 : audit [DBG] from='client.44149 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:44.058 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:43 smithi033 systemd[1]: Stopping Ceph osd.1 for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T15:59:44.059 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:43 smithi033 docker[45222]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:59:44.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:43 smithi096 bash[33981]: cluster 2021-07-26T15:59:42.973609+0000 mgr.y (mgr.34104) 102 : cluster [DBG] pgmap v138: 25 pgs: 2 active+clean+snaptrim_wait, 23 active+clean; 137 MiB data, 550 MiB used, 715 GiB / 715 GiB avail; 5.0 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2021-07-26T15:59:44.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:43 smithi096 bash[33981]: cluster 2021-07-26T15:59:42.974510+0000 mon.a (mon.0) 233 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-07-26T15:59:44.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:43 smithi096 bash[33981]: audit 2021-07-26T15:59:43.272039+0000 mgr.y (mgr.34104) 103 : audit [DBG] from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:44.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:43 smithi096 bash[33981]: audit 2021-07-26T15:59:43.593761+0000 mgr.y (mgr.34104) 104 : audit [DBG] from='client.44149 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T15:59:44.458 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[24389]: debug 2021-07-26T15:59:44.049+0000 7f9415a81700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-07-26T15:59:44.459 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[24389]: debug 2021-07-26T15:59:44.049+0000 7f9415a81700 -1 osd.1 235 *** Got signal Terminated *** 2021-07-26T15:59:44.459 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[24389]: debug 2021-07-26T15:59:44.049+0000 7f9415a81700 -1 osd.1 235 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T15:59:44.989 INFO:tasks.rados.rados.0.smithi033.stdout:952: done (0 left) 2021-07-26T15:59:44.990 INFO:tasks.rados.rados.0.smithi033.stdout:953: copy_from oid 10 from oid 16 current snap is 93 2021-07-26T15:59:44.990 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 93 2021-07-26T15:59:44.990 INFO:tasks.rados.rados.0.smithi033.stdout:954: seq_num 296 ranges {0=163840} 2021-07-26T15:59:44.990 INFO:tasks.rados.rados.0.smithi033.stdout:954: writing smithi03339061-5 from 0 to 163840 tid 1 2021-07-26T15:59:44.991 INFO:tasks.rados.rados.0.smithi033.stdout:955: read oid 23 snap 89 2021-07-26T15:59:44.991 INFO:tasks.rados.rados.0.smithi033.stdout:955: expect (ObjNum 157 snap 39 seq_num 157) 2021-07-26T15:59:44.991 INFO:tasks.rados.rados.0.smithi033.stdout:956: read oid 35 snap 83 2021-07-26T15:59:44.991 INFO:tasks.rados.rados.0.smithi033.stdout:956: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T15:59:44.992 INFO:tasks.rados.rados.0.smithi033.stdout:957: delete oid 13 current snap is 93 2021-07-26T15:59:45.008 INFO:tasks.rados.rados.0.smithi033.stdout:954: finishing write tid 1 to smithi03339061-5 2021-07-26T15:59:45.008 INFO:tasks.rados.rados.0.smithi033.stdout:954: finishing write tid 2 to smithi03339061-5 2021-07-26T15:59:45.015 INFO:tasks.rados.rados.0.smithi033.stdout:955: expect (ObjNum 157 snap 39 seq_num 157) 2021-07-26T15:59:45.270 INFO:tasks.rados.rados.0.smithi033.stdout:954: finishing write tid 3 to smithi03339061-5 2021-07-26T15:59:45.270 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 279 (ObjNum 296 snap 93 seq_num 296) dirty exists 2021-07-26T15:59:45.271 INFO:tasks.rados.rados.0.smithi033.stdout:954: left oid 5 (ObjNum 296 snap 93 seq_num 296) 2021-07-26T15:59:45.271 INFO:tasks.rados.rados.0.smithi033.stdout:953: finishing copy_from to smithi03339061-10 2021-07-26T15:59:45.271 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 203 (ObjNum 244 snap 70 seq_num 244) dirty exists 2021-07-26T15:59:45.271 INFO:tasks.rados.rados.0.smithi033.stdout:953: finishing copy_from racing read to smithi03339061-10 2021-07-26T15:59:45.458 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:44 smithi033 docker[45222]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-osd.1 2021-07-26T15:59:45.459 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:45 smithi033 bash[45266]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:59:45.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:43.980401+0000 mon.a (mon.0) 234 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-07-26T15:59:45.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: audit 2021-07-26T15:59:44.014534+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.15.33:0/3221630510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:45.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.336463+0000 mon.a (mon.0) 235 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.336586+0000 mon.a (mon.0) 236 : cluster [INF] osd.1 failed (root=default,host=smithi033) (connection refused reported by osd.2) 2021-07-26T15:59:45.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.337129+0000 mon.a (mon.0) 237 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.337374+0000 mon.a (mon.0) 238 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.337592+0000 mon.a (mon.0) 239 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.337807+0000 mon.a (mon.0) 240 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.338033+0000 mon.a (mon.0) 241 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.338361+0000 mon.a (mon.0) 242 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.338613+0000 mon.a (mon.0) 243 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.338829+0000 mon.a (mon.0) 244 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.339038+0000 mon.a (mon.0) 245 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.339248+0000 mon.a (mon.0) 246 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.339583+0000 mon.a (mon.0) 247 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.339888+0000 mon.a (mon.0) 248 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.340185+0000 mon.a (mon.0) 249 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.740519+0000 mon.a (mon.0) 250 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.741070+0000 mon.a (mon.0) 251 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.741327+0000 mon.a (mon.0) 252 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.741450+0000 mon.a (mon.0) 253 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.741725+0000 mon.a (mon.0) 254 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.741841+0000 mon.a (mon.0) 255 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.742206+0000 mon.a (mon.0) 256 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.742341+0000 mon.a (mon.0) 257 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:43.980401+0000 mon.a (mon.0) 234 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-07-26T15:59:45.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: audit 2021-07-26T15:59:44.014534+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.15.33:0/3221630510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:45.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.336463+0000 mon.a (mon.0) 235 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.336586+0000 mon.a (mon.0) 236 : cluster [INF] osd.1 failed (root=default,host=smithi033) (connection refused reported by osd.2) 2021-07-26T15:59:45.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.337129+0000 mon.a (mon.0) 237 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.337374+0000 mon.a (mon.0) 238 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.337592+0000 mon.a (mon.0) 239 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.337807+0000 mon.a (mon.0) 240 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.338033+0000 mon.a (mon.0) 241 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.338361+0000 mon.a (mon.0) 242 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.338613+0000 mon.a (mon.0) 243 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.338829+0000 mon.a (mon.0) 244 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.339038+0000 mon.a (mon.0) 245 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.339248+0000 mon.a (mon.0) 246 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.339583+0000 mon.a (mon.0) 247 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.339888+0000 mon.a (mon.0) 248 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.340185+0000 mon.a (mon.0) 249 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.740519+0000 mon.a (mon.0) 250 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.741070+0000 mon.a (mon.0) 251 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.741327+0000 mon.a (mon.0) 252 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.741450+0000 mon.a (mon.0) 253 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.741725+0000 mon.a (mon.0) 254 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.741841+0000 mon.a (mon.0) 255 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.742206+0000 mon.a (mon.0) 256 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.742341+0000 mon.a (mon.0) 257 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.742711+0000 mon.a (mon.0) 258 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.742843+0000 mon.a (mon.0) 259 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.743113+0000 mon.a (mon.0) 260 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.743305+0000 mon.a (mon.0) 261 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.743775+0000 mon.a (mon.0) 262 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.744076+0000 mon.a (mon.0) 263 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.742711+0000 mon.a (mon.0) 258 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.742843+0000 mon.a (mon.0) 259 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.473 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.743113+0000 mon.a (mon.0) 260 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.473 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.743305+0000 mon.a (mon.0) 261 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.473 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.743775+0000 mon.a (mon.0) 262 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.473 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:44 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.744076+0000 mon.a (mon.0) 263 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:43.980401+0000 mon.a (mon.0) 234 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-07-26T15:59:45.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: audit 2021-07-26T15:59:44.014534+0000 mon.c (mon.1) 50 : audit [DBG] from='client.? 172.21.15.33:0/3221630510' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:45.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.336463+0000 mon.a (mon.0) 235 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.336586+0000 mon.a (mon.0) 236 : cluster [INF] osd.1 failed (root=default,host=smithi033) (connection refused reported by osd.2) 2021-07-26T15:59:45.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.337129+0000 mon.a (mon.0) 237 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.337374+0000 mon.a (mon.0) 238 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.337592+0000 mon.a (mon.0) 239 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.337807+0000 mon.a (mon.0) 240 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.338033+0000 mon.a (mon.0) 241 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.338361+0000 mon.a (mon.0) 242 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.338613+0000 mon.a (mon.0) 243 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.338829+0000 mon.a (mon.0) 244 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.339038+0000 mon.a (mon.0) 245 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.339248+0000 mon.a (mon.0) 246 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.339583+0000 mon.a (mon.0) 247 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.339888+0000 mon.a (mon.0) 248 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.340185+0000 mon.a (mon.0) 249 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.740519+0000 mon.a (mon.0) 250 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.741070+0000 mon.a (mon.0) 251 : cluster [DBG] osd.1 reported immediately failed by osd.2 2021-07-26T15:59:45.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.741327+0000 mon.a (mon.0) 252 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.741450+0000 mon.a (mon.0) 253 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.741725+0000 mon.a (mon.0) 254 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.741841+0000 mon.a (mon.0) 255 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.742206+0000 mon.a (mon.0) 256 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.742341+0000 mon.a (mon.0) 257 : cluster [DBG] osd.1 reported immediately failed by osd.6 2021-07-26T15:59:45.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.742711+0000 mon.a (mon.0) 258 : cluster [DBG] osd.1 reported immediately failed by osd.7 2021-07-26T15:59:45.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.742843+0000 mon.a (mon.0) 259 : cluster [DBG] osd.1 reported immediately failed by osd.4 2021-07-26T15:59:45.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.743113+0000 mon.a (mon.0) 260 : cluster [DBG] osd.1 reported immediately failed by osd.5 2021-07-26T15:59:45.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.743305+0000 mon.a (mon.0) 261 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.743775+0000 mon.a (mon.0) 262 : cluster [DBG] osd.1 reported immediately failed by osd.0 2021-07-26T15:59:45.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:44 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.744076+0000 mon.a (mon.0) 263 : cluster [DBG] osd.1 reported immediately failed by osd.3 2021-07-26T15:59:45.963 INFO:tasks.rados.rados.0.smithi033.stdout:953: done (4 left) 2021-07-26T15:59:45.963 INFO:tasks.rados.rados.0.smithi033.stdout:954: done (3 left) 2021-07-26T15:59:45.964 INFO:tasks.rados.rados.0.smithi033.stdout:955: done (2 left) 2021-07-26T15:59:45.964 INFO:tasks.rados.rados.0.smithi033.stdout:957: done (1 left) 2021-07-26T15:59:45.964 INFO:tasks.rados.rados.0.smithi033.stdout:958: snap_create 2021-07-26T15:59:45.976 INFO:tasks.rados.rados.0.smithi033.stdout:956: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T15:59:46.311 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:45 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.974391+0000 mgr.y (mgr.34104) 105 : cluster [DBG] pgmap v140: 25 pgs: 2 active+clean+snaptrim_wait, 23 active+clean; 143 MiB data, 578 MiB used, 715 GiB / 715 GiB avail; 6.4 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2021-07-26T15:59:46.311 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:45 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.975599+0000 mon.a (mon.0) 264 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T15:59:46.312 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:45 smithi033 bash[41341]: cluster 2021-07-26T15:59:44.985601+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e236: 8 total, 7 up, 8 in 2021-07-26T15:59:46.312 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:45 smithi033 bash[41341]: cluster 2021-07-26T15:59:45.949770+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e237: 8 total, 7 up, 8 in 2021-07-26T15:59:46.312 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:45 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.974391+0000 mgr.y (mgr.34104) 105 : cluster [DBG] pgmap v140: 25 pgs: 2 active+clean+snaptrim_wait, 23 active+clean; 143 MiB data, 578 MiB used, 715 GiB / 715 GiB avail; 6.4 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2021-07-26T15:59:46.312 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:45 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.975599+0000 mon.a (mon.0) 264 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T15:59:46.313 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:45 smithi033 bash[42377]: cluster 2021-07-26T15:59:44.985601+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e236: 8 total, 7 up, 8 in 2021-07-26T15:59:46.313 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:45 smithi033 bash[42377]: cluster 2021-07-26T15:59:45.949770+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e237: 8 total, 7 up, 8 in 2021-07-26T15:59:46.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:45 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.974391+0000 mgr.y (mgr.34104) 105 : cluster [DBG] pgmap v140: 25 pgs: 2 active+clean+snaptrim_wait, 23 active+clean; 143 MiB data, 578 MiB used, 715 GiB / 715 GiB avail; 6.4 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2021-07-26T15:59:46.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:45 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.975599+0000 mon.a (mon.0) 264 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T15:59:46.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:45 smithi096 bash[33981]: cluster 2021-07-26T15:59:44.985601+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e236: 8 total, 7 up, 8 in 2021-07-26T15:59:46.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:45 smithi096 bash[33981]: cluster 2021-07-26T15:59:45.949770+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e237: 8 total, 7 up, 8 in 2021-07-26T15:59:46.967 INFO:tasks.rados.rados.0.smithi033.stdout:956: done (1 left) 2021-07-26T15:59:46.967 INFO:tasks.rados.rados.0.smithi033.stdout:958: done (0 left) 2021-07-26T15:59:46.967 INFO:tasks.rados.rados.0.smithi033.stdout:959: read oid 36 snap -1 2021-07-26T15:59:46.967 INFO:tasks.rados.rados.0.smithi033.stdout:959: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T15:59:46.968 INFO:tasks.rados.rados.0.smithi033.stdout:960: snap_remove snap 82 2021-07-26T15:59:47.680 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:47 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.1.service: Succeeded. 2021-07-26T15:59:47.680 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:47 smithi033 systemd[1]: Stopped Ceph osd.1 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:59:47.681 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:47 smithi033 systemd[1]: Started Ceph osd.1 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T15:59:47.958 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[45390]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:59:47.978 INFO:tasks.rados.rados.0.smithi033.stdout:960: done (1 left) 2021-07-26T15:59:47.978 INFO:tasks.rados.rados.0.smithi033.stdout:961: snap_create 2021-07-26T15:59:47.978 INFO:tasks.rados.rados.0.smithi033.stdout:959: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T15:59:48.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:47 smithi096 bash[33981]: cluster 2021-07-26T15:59:46.962446+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e238: 8 total, 7 up, 8 in 2021-07-26T15:59:48.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:47 smithi096 bash[33981]: cluster 2021-07-26T15:59:46.975083+0000 mgr.y (mgr.34104) 106 : cluster [DBG] pgmap v144: 25 pgs: 4 stale+active+clean, 2 active+clean+snaptrim_wait, 19 active+clean; 143 MiB data, 578 MiB used, 715 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2021-07-26T15:59:48.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:47 smithi096 bash[33981]: audit 2021-07-26T15:59:47.635216+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:48.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:47 smithi096 bash[33981]: audit 2021-07-26T15:59:47.637222+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:48.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:47 smithi096 bash[33981]: audit 2021-07-26T15:59:47.638701+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:59:48.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:47 smithi096 bash[33981]: audit 2021-07-26T15:59:47.640194+0000 mon.c (mon.1) 53 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:59:48.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[41341]: cluster 2021-07-26T15:59:46.962446+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e238: 8 total, 7 up, 8 in 2021-07-26T15:59:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[41341]: cluster 2021-07-26T15:59:46.975083+0000 mgr.y (mgr.34104) 106 : cluster [DBG] pgmap v144: 25 pgs: 4 stale+active+clean, 2 active+clean+snaptrim_wait, 19 active+clean; 143 MiB data, 578 MiB used, 715 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2021-07-26T15:59:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[41341]: audit 2021-07-26T15:59:47.635216+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[41341]: audit 2021-07-26T15:59:47.637222+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[41341]: audit 2021-07-26T15:59:47.638701+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:59:48.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[41341]: audit 2021-07-26T15:59:47.640194+0000 mon.c (mon.1) 53 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:59:48.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[42377]: cluster 2021-07-26T15:59:46.962446+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e238: 8 total, 7 up, 8 in 2021-07-26T15:59:48.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[42377]: cluster 2021-07-26T15:59:46.975083+0000 mgr.y (mgr.34104) 106 : cluster [DBG] pgmap v144: 25 pgs: 4 stale+active+clean, 2 active+clean+snaptrim_wait, 19 active+clean; 143 MiB data, 578 MiB used, 715 GiB / 715 GiB avail; 2.9 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2021-07-26T15:59:48.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[42377]: audit 2021-07-26T15:59:47.635216+0000 mon.a (mon.0) 268 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:48.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[42377]: audit 2021-07-26T15:59:47.637222+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:48.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[42377]: audit 2021-07-26T15:59:47.638701+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T15:59:48.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:47 smithi033 bash[42377]: audit 2021-07-26T15:59:47.640194+0000 mon.c (mon.1) 53 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T15:59:48.981 INFO:tasks.rados.rados.0.smithi033.stdout:959: done (1 left) 2021-07-26T15:59:48.982 INFO:tasks.rados.rados.0.smithi033.stdout:961: done (0 left) 2021-07-26T15:59:48.982 INFO:tasks.rados.rados.0.smithi033.stdout:962: rollback oid 30 current snap is 95 2021-07-26T15:59:48.982 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 30 to 83 2021-07-26T15:59:48.985 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 95 2021-07-26T15:59:48.985 INFO:tasks.rados.rados.0.smithi033.stdout:963: seq_num 298 ranges {2195456=196608} 2021-07-26T15:59:48.995 INFO:tasks.rados.rados.0.smithi033.stdout:963: writing smithi03339061-26 from 2195456 to 2392064 tid 1 2021-07-26T15:59:48.996 INFO:tasks.rados.rados.0.smithi033.stdout:964: snap_remove snap 73 2021-07-26T15:59:49.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:48 smithi033 bash[41341]: cluster 2021-07-26T15:59:47.973785+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e239: 8 total, 7 up, 8 in 2021-07-26T15:59:49.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:48 smithi033 bash[42377]: cluster 2021-07-26T15:59:47.973785+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e239: 8 total, 7 up, 8 in 2021-07-26T15:59:49.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:48 smithi096 bash[33981]: cluster 2021-07-26T15:59:47.973785+0000 mon.a (mon.0) 269 : cluster [DBG] osdmap e239: 8 total, 7 up, 8 in 2021-07-26T15:59:49.708 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:49 smithi033 bash[45390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-07-26T15:59:49.709 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:49 smithi033 bash[45390]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-07-26T15:59:49.709 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:49 smithi033 bash[45390]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-07-26T15:59:49.709 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:49 smithi033 bash[45390]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-07-26T15:59:49.709 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:49 smithi033 bash[45390]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-07-26T15:59:49.710 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:49 smithi033 bash[45390]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-07-26T15:59:49.710 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:49 smithi033 bash[45390]: --> ceph-volume lvm activate successful for osd ID: 1 2021-07-26T15:59:49.999 INFO:tasks.rados.rados.0.smithi033.stdout:964: done (2 left) 2021-07-26T15:59:49.999 INFO:tasks.rados.rados.0.smithi033.stdout:965: read oid 42 snap -1 2021-07-26T15:59:50.000 INFO:tasks.rados.rados.0.smithi033.stdout:965: expect (ObjNum 288 snap 90 seq_num 288) 2021-07-26T15:59:50.000 INFO:tasks.rados.rados.0.smithi033.stdout:966: copy_from oid 49 from oid 43 current snap is 95 2021-07-26T15:59:50.000 INFO:tasks.rados.rados.0.smithi033.stdout:967: snap_create 2021-07-26T15:59:50.000 INFO:tasks.rados.rados.0.smithi033.stdout:962: finishing rollback tid 1 to smithi03339061-30 2021-07-26T15:59:50.000 INFO:tasks.rados.rados.0.smithi033.stdout:962: finishing rollback tid 2 to smithi03339061-30 2021-07-26T15:59:50.001 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 342 (ObjNum 249 snap 71 seq_num 249) dirty exists 2021-07-26T15:59:50.001 INFO:tasks.rados.rados.0.smithi033.stdout:963: finishing write tid 1 to smithi03339061-26 2021-07-26T15:59:50.001 INFO:tasks.rados.rados.0.smithi033.stdout:963: finishing write tid 2 to smithi03339061-26 2021-07-26T15:59:50.001 INFO:tasks.rados.rados.0.smithi033.stdout:963: finishing write tid 3 to smithi03339061-26 2021-07-26T15:59:50.002 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 521 (ObjNum 298 snap 95 seq_num 298) dirty exists 2021-07-26T15:59:50.002 INFO:tasks.rados.rados.0.smithi033.stdout:963: left oid 26 (ObjNum 298 snap 95 seq_num 298) 2021-07-26T15:59:50.028 INFO:tasks.rados.rados.0.smithi033.stdout:966: finishing copy_from to smithi03339061-49 2021-07-26T15:59:50.029 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 267 (ObjNum 289 snap 90 seq_num 289) dirty exists 2021-07-26T15:59:50.029 INFO:tasks.rados.rados.0.smithi033.stdout:965: expect (ObjNum 288 snap 90 seq_num 288) 2021-07-26T15:59:50.177 INFO:tasks.rados.rados.0.smithi033.stdout:966: finishing copy_from racing read to smithi03339061-49 2021-07-26T15:59:50.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:49 smithi033 bash[42377]: cluster 2021-07-26T15:59:48.975612+0000 mgr.y (mgr.34104) 107 : cluster [DBG] pgmap v147: 25 pgs: 3 stale+active+clean, 2 active+undersized, 20 active+clean; 143 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 2 op/s 2021-07-26T15:59:50.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:49 smithi033 bash[42377]: cluster 2021-07-26T15:59:48.976585+0000 mon.a (mon.0) 270 : cluster [DBG] osdmap e240: 8 total, 7 up, 8 in 2021-07-26T15:59:50.460 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:50 smithi033 bash[45509]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T15:59:50.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:49 smithi033 bash[41341]: cluster 2021-07-26T15:59:48.975612+0000 mgr.y (mgr.34104) 107 : cluster [DBG] pgmap v147: 25 pgs: 3 stale+active+clean, 2 active+undersized, 20 active+clean; 143 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 2 op/s 2021-07-26T15:59:50.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:49 smithi033 bash[41341]: cluster 2021-07-26T15:59:48.976585+0000 mon.a (mon.0) 270 : cluster [DBG] osdmap e240: 8 total, 7 up, 8 in 2021-07-26T15:59:50.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:49 smithi096 bash[33981]: cluster 2021-07-26T15:59:48.975612+0000 mgr.y (mgr.34104) 107 : cluster [DBG] pgmap v147: 25 pgs: 3 stale+active+clean, 2 active+undersized, 20 active+clean; 143 MiB data, 581 MiB used, 715 GiB / 715 GiB avail; 0 B/s wr, 2 op/s 2021-07-26T15:59:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:49 smithi096 bash[33981]: cluster 2021-07-26T15:59:48.976585+0000 mon.a (mon.0) 270 : cluster [DBG] osdmap e240: 8 total, 7 up, 8 in 2021-07-26T15:59:51.012 INFO:tasks.rados.rados.0.smithi033.stdout:962: done (4 left) 2021-07-26T15:59:51.013 INFO:tasks.rados.rados.0.smithi033.stdout:963: done (3 left) 2021-07-26T15:59:51.013 INFO:tasks.rados.rados.0.smithi033.stdout:965: done (2 left) 2021-07-26T15:59:51.013 INFO:tasks.rados.rados.0.smithi033.stdout:966: done (1 left) 2021-07-26T15:59:51.013 INFO:tasks.rados.rados.0.smithi033.stdout:967: done (0 left) 2021-07-26T15:59:51.014 INFO:tasks.rados.rados.0.smithi033.stdout:968: read oid 18 snap -1 2021-07-26T15:59:51.014 INFO:tasks.rados.rados.0.smithi033.stdout:968: expect deleted 2021-07-26T15:59:51.014 INFO:tasks.rados.rados.0.smithi033.stdout:969: delete oid 33 current snap is 96 2021-07-26T15:59:51.017 INFO:tasks.rados.rados.0.smithi033.stdout:968: done (1 left) 2021-07-26T15:59:51.017 INFO:tasks.rados.rados.0.smithi033.stdout:969: done (0 left) 2021-07-26T15:59:51.017 INFO:tasks.rados.rados.0.smithi033.stdout:970: snap_remove snap 89 2021-07-26T15:59:51.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:50 smithi033 bash[41341]: cluster 2021-07-26T15:59:49.995047+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e241: 8 total, 7 up, 8 in 2021-07-26T15:59:51.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:50 smithi033 bash[42377]: cluster 2021-07-26T15:59:49.995047+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e241: 8 total, 7 up, 8 in 2021-07-26T15:59:51.461 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:51 smithi033 bash[45509]: debug 2021-07-26T15:59:51.221+0000 7f9ba044d700 1 -- 172.21.15.33:0/1112983214 <== mon.1 v2:172.21.15.33:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55733bd4c340 con 0x55733bda6c00 2021-07-26T15:59:51.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:50 smithi096 bash[33981]: cluster 2021-07-26T15:59:49.995047+0000 mon.a (mon.0) 271 : cluster [DBG] osdmap e241: 8 total, 7 up, 8 in 2021-07-26T15:59:52.024 INFO:tasks.rados.rados.0.smithi033.stdout:970: done (0 left) 2021-07-26T15:59:52.024 INFO:tasks.rados.rados.0.smithi033.stdout:971: rollback oid 15 current snap is 96 2021-07-26T15:59:52.024 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 15 to 92 2021-07-26T15:59:52.025 INFO:tasks.rados.rados.0.smithi033.stdout:972: delete oid 6 current snap is 96 2021-07-26T15:59:52.033 INFO:tasks.rados.rados.0.smithi033.stdout:972: done (1 left) 2021-07-26T15:59:52.034 INFO:tasks.rados.rados.0.smithi033.stdout:973: snap_create 2021-07-26T15:59:52.034 INFO:tasks.rados.rados.0.smithi033.stdout:971: finishing rollback tid 1 to smithi03339061-15 2021-07-26T15:59:52.034 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 189 (ObjNum 1851615074 snap 1700752209 seq_num 1735416930) dirty dne 2021-07-26T15:59:52.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:52 smithi033 bash[42377]: cluster 2021-07-26T15:59:50.976494+0000 mgr.y (mgr.34104) 108 : cluster [DBG] pgmap v149: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 158 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.3 MiB/s wr, 18 op/s; 30/300 objects degraded (10.000%) 2021-07-26T15:59:52.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:52 smithi033 bash[42377]: cluster 2021-07-26T15:59:51.009274+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e242: 8 total, 7 up, 8 in 2021-07-26T15:59:52.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:52 smithi033 bash[42377]: cluster 2021-07-26T15:59:51.946898+0000 mon.a (mon.0) 273 : cluster [WRN] Health check failed: Degraded data redundancy: 30/300 objects degraded (10.000%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T15:59:52.209 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:51 smithi033 bash[45509]: debug 2021-07-26T15:59:51.780+0000 7f9ba7ca10c0 -1 Falling back to public interface 2021-07-26T15:59:52.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:52 smithi033 bash[41341]: cluster 2021-07-26T15:59:50.976494+0000 mgr.y (mgr.34104) 108 : cluster [DBG] pgmap v149: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 158 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.3 MiB/s wr, 18 op/s; 30/300 objects degraded (10.000%) 2021-07-26T15:59:52.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:52 smithi033 bash[41341]: cluster 2021-07-26T15:59:51.009274+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e242: 8 total, 7 up, 8 in 2021-07-26T15:59:52.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:52 smithi033 bash[41341]: cluster 2021-07-26T15:59:51.946898+0000 mon.a (mon.0) 273 : cluster [WRN] Health check failed: Degraded data redundancy: 30/300 objects degraded (10.000%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T15:59:52.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:52 smithi096 bash[33981]: cluster 2021-07-26T15:59:50.976494+0000 mgr.y (mgr.34104) 108 : cluster [DBG] pgmap v149: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 158 MiB data, 591 MiB used, 715 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.3 MiB/s wr, 18 op/s; 30/300 objects degraded (10.000%) 2021-07-26T15:59:52.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:52 smithi096 bash[33981]: cluster 2021-07-26T15:59:51.009274+0000 mon.a (mon.0) 272 : cluster [DBG] osdmap e242: 8 total, 7 up, 8 in 2021-07-26T15:59:52.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:52 smithi096 bash[33981]: cluster 2021-07-26T15:59:51.946898+0000 mon.a (mon.0) 273 : cluster [WRN] Health check failed: Degraded data redundancy: 30/300 objects degraded (10.000%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T15:59:52.708 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 15:59:52 smithi033 bash[39943]: debug 2021-07-26T15:59:52.232+0000 7fa4db1f3700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T15:59:53.043 INFO:tasks.rados.rados.0.smithi033.stdout:971: done (1 left) 2021-07-26T15:59:53.044 INFO:tasks.rados.rados.0.smithi033.stdout:973: done (0 left) 2021-07-26T15:59:53.044 INFO:tasks.rados.rados.0.smithi033.stdout:974: read oid 35 snap -1 2021-07-26T15:59:53.045 INFO:tasks.rados.rados.0.smithi033.stdout:974: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T15:59:53.045 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 97 2021-07-26T15:59:53.045 INFO:tasks.rados.rados.0.smithi033.stdout:975: seq_num 301 ranges {2400256=245760} 2021-07-26T15:59:53.060 INFO:tasks.rados.rados.0.smithi033.stdout:975: writing smithi03339061-8 from 2400256 to 2646016 tid 1 2021-07-26T15:59:53.061 INFO:tasks.rados.rados.0.smithi033.stdout:976: delete oid 41 current snap is 97 2021-07-26T15:59:53.061 INFO:tasks.rados.rados.0.smithi033.stdout:974: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T15:59:53.156 INFO:tasks.rados.rados.0.smithi033.stdout:975: finishing write tid 1 to smithi03339061-8 2021-07-26T15:59:53.157 INFO:tasks.rados.rados.0.smithi033.stdout:975: finishing write tid 2 to smithi03339061-8 2021-07-26T15:59:53.157 INFO:tasks.rados.rados.0.smithi033.stdout:975: finishing write tid 3 to smithi03339061-8 2021-07-26T15:59:53.157 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 265 (ObjNum 301 snap 97 seq_num 301) dirty exists 2021-07-26T15:59:53.157 INFO:tasks.rados.rados.0.smithi033.stdout:975: left oid 8 (ObjNum 301 snap 97 seq_num 301) 2021-07-26T15:59:53.157 INFO:tasks.rados.rados.0.smithi033.stdout:974: done (2 left) 2021-07-26T15:59:53.158 INFO:tasks.rados.rados.0.smithi033.stdout:975: done (1 left) 2021-07-26T15:59:53.158 INFO:tasks.rados.rados.0.smithi033.stdout:976: done (0 left) 2021-07-26T15:59:53.158 INFO:tasks.rados.rados.0.smithi033.stdout:977: rmattr oid 42 current snap is 97 2021-07-26T15:59:53.159 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 97 2021-07-26T15:59:53.159 INFO:tasks.rados.rados.0.smithi033.stdout:978: seq_num 303 ranges {9895936=278528} 2021-07-26T15:59:53.221 INFO:tasks.rados.rados.0.smithi033.stdout:978: writing smithi03339061-40 from 9895936 to 10174464 tid 1 2021-07-26T15:59:53.222 INFO:tasks.rados.rados.0.smithi033.stdout:979: snap_create 2021-07-26T15:59:53.222 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 197 (ObjNum 288 snap 90 seq_num 288) dirty exists 2021-07-26T15:59:53.229 INFO:tasks.rados.rados.0.smithi033.stdout:978: finishing write tid 1 to smithi03339061-40 2021-07-26T15:59:53.229 INFO:tasks.rados.rados.0.smithi033.stdout:978: finishing write tid 2 to smithi03339061-40 2021-07-26T15:59:53.232 INFO:tasks.rados.rados.0.smithi033.stdout:978: finishing write tid 3 to smithi03339061-40 2021-07-26T15:59:53.233 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 200 (ObjNum 303 snap 97 seq_num 303) dirty exists 2021-07-26T15:59:53.233 INFO:tasks.rados.rados.0.smithi033.stdout:978: left oid 40 (ObjNum 303 snap 97 seq_num 303) 2021-07-26T15:59:53.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[41341]: cluster 2021-07-26T15:59:52.020144+0000 mon.a (mon.0) 274 : cluster [DBG] osdmap e243: 8 total, 7 up, 8 in 2021-07-26T15:59:53.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[41341]: audit 2021-07-26T15:59:52.199378+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:53.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[41341]: audit 2021-07-26T15:59:52.214379+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:53.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[41341]: audit 2021-07-26T15:59:52.225614+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:53.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[41341]: audit 2021-07-26T15:59:52.228800+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:53.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[41341]: audit 2021-07-26T15:59:52.231398+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:53.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[41341]: audit 2021-07-26T15:59:52.233441+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:53.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[41341]: audit 2021-07-26T15:59:52.235468+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T15:59:53.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[41341]: audit 2021-07-26T15:59:52.235755+0000 mgr.y (mgr.34104) 109 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T15:59:53.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[41341]: cephadm 2021-07-26T15:59:52.237441+0000 mgr.y (mgr.34104) 110 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T15:59:53.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[42377]: cluster 2021-07-26T15:59:52.020144+0000 mon.a (mon.0) 274 : cluster [DBG] osdmap e243: 8 total, 7 up, 8 in 2021-07-26T15:59:53.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[42377]: audit 2021-07-26T15:59:52.199378+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:53.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[42377]: audit 2021-07-26T15:59:52.214379+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:53.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[42377]: audit 2021-07-26T15:59:52.225614+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:53.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[42377]: audit 2021-07-26T15:59:52.228800+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:53.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[42377]: audit 2021-07-26T15:59:52.231398+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:53.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[42377]: audit 2021-07-26T15:59:52.233441+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:53.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[42377]: audit 2021-07-26T15:59:52.235468+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T15:59:53.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[42377]: audit 2021-07-26T15:59:52.235755+0000 mgr.y (mgr.34104) 109 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T15:59:53.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[42377]: cephadm 2021-07-26T15:59:52.237441+0000 mgr.y (mgr.34104) 110 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T15:59:53.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:53 smithi096 bash[33981]: cluster 2021-07-26T15:59:52.020144+0000 mon.a (mon.0) 274 : cluster [DBG] osdmap e243: 8 total, 7 up, 8 in 2021-07-26T15:59:53.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:53 smithi096 bash[33981]: audit 2021-07-26T15:59:52.199378+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:53.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:53 smithi096 bash[33981]: audit 2021-07-26T15:59:52.214379+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T15:59:53.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:53 smithi096 bash[33981]: audit 2021-07-26T15:59:52.225614+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T15:59:53.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:53 smithi096 bash[33981]: audit 2021-07-26T15:59:52.228800+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:53.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:53 smithi096 bash[33981]: audit 2021-07-26T15:59:52.231398+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:53.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:53 smithi096 bash[33981]: audit 2021-07-26T15:59:52.233441+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T15:59:53.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:53 smithi096 bash[33981]: audit 2021-07-26T15:59:52.235468+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T15:59:53.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:53 smithi096 bash[33981]: audit 2021-07-26T15:59:52.235755+0000 mgr.y (mgr.34104) 109 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T15:59:53.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:53 smithi096 bash[33981]: cephadm 2021-07-26T15:59:52.237441+0000 mgr.y (mgr.34104) 110 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T15:59:53.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:53.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:53.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:53.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T15:59:53.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 15:59:53 smithi033 bash[32681]: level=error ts=2021-07-26T15:59:53.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T15:59:54.227 INFO:tasks.rados.rados.0.smithi033.stdout:977: done (2 left) 2021-07-26T15:59:54.228 INFO:tasks.rados.rados.0.smithi033.stdout:978: done (1 left) 2021-07-26T15:59:54.228 INFO:tasks.rados.rados.0.smithi033.stdout:979: done (0 left) 2021-07-26T15:59:54.228 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 98 2021-07-26T15:59:54.228 INFO:tasks.rados.rados.0.smithi033.stdout:980: seq_num 304 ranges {2367488=294912} 2021-07-26T15:59:54.248 INFO:tasks.rados.rados.0.smithi033.stdout:980: writing smithi03339061-39 from 2367488 to 2662400 tid 1 2021-07-26T15:59:54.249 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 98 2021-07-26T15:59:54.249 INFO:tasks.rados.rados.0.smithi033.stdout:981: seq_num 305 ranges {2473984=311296} 2021-07-26T15:59:54.264 INFO:tasks.rados.rados.0.smithi033.stdout:981: writing smithi03339061-43 from 2473984 to 2785280 tid 1 2021-07-26T15:59:54.265 INFO:tasks.rados.rados.0.smithi033.stdout:982: read oid 2 snap -1 2021-07-26T15:59:54.265 INFO:tasks.rados.rados.0.smithi033.stdout:982: expect (ObjNum 259 snap 81 seq_num 259) 2021-07-26T15:59:54.265 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 98 2021-07-26T15:59:54.265 INFO:tasks.rados.rados.0.smithi033.stdout:980: finishing write tid 1 to smithi03339061-39 2021-07-26T15:59:54.266 INFO:tasks.rados.rados.0.smithi033.stdout:983: seq_num 306 ranges {6414336=327680} 2021-07-26T15:59:54.304 INFO:tasks.rados.rados.0.smithi033.stdout:983: writing smithi03339061-11 from 6414336 to 6742016 tid 1 2021-07-26T15:59:54.304 INFO:tasks.rados.rados.0.smithi033.stdout:984: rmattr oid 14 current snap is 98 2021-07-26T15:59:54.305 INFO:tasks.rados.rados.0.smithi033.stdout:984: done (4 left) 2021-07-26T15:59:54.305 INFO:tasks.rados.rados.0.smithi033.stdout:985: rmattr oid 24 current snap is 98 2021-07-26T15:59:54.305 INFO:tasks.rados.rados.0.smithi033.stdout:980: finishing write tid 2 to smithi03339061-39 2021-07-26T15:59:54.305 INFO:tasks.rados.rados.0.smithi033.stdout:986: snap_remove snap 86 2021-07-26T15:59:54.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:54 smithi033 bash[41341]: cluster 2021-07-26T15:59:52.977298+0000 mgr.y (mgr.34104) 111 : cluster [DBG] pgmap v152: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 158 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 6.9 MiB/s rd, 1.3 MiB/s wr, 16 op/s; 30/300 objects degraded (10.000%) 2021-07-26T15:59:54.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:54 smithi033 bash[41341]: cluster 2021-07-26T15:59:53.038327+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e244: 8 total, 7 up, 8 in 2021-07-26T15:59:54.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:54 smithi033 bash[42377]: cluster 2021-07-26T15:59:52.977298+0000 mgr.y (mgr.34104) 111 : cluster [DBG] pgmap v152: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 158 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 6.9 MiB/s rd, 1.3 MiB/s wr, 16 op/s; 30/300 objects degraded (10.000%) 2021-07-26T15:59:54.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:54 smithi033 bash[42377]: cluster 2021-07-26T15:59:53.038327+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e244: 8 total, 7 up, 8 in 2021-07-26T15:59:54.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:54 smithi096 bash[33981]: cluster 2021-07-26T15:59:52.977298+0000 mgr.y (mgr.34104) 111 : cluster [DBG] pgmap v152: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 158 MiB data, 595 MiB used, 715 GiB / 715 GiB avail; 6.9 MiB/s rd, 1.3 MiB/s wr, 16 op/s; 30/300 objects degraded (10.000%) 2021-07-26T15:59:54.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:54 smithi096 bash[33981]: cluster 2021-07-26T15:59:53.038327+0000 mon.a (mon.0) 277 : cluster [DBG] osdmap e244: 8 total, 7 up, 8 in 2021-07-26T15:59:55.208 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:54 smithi033 bash[45509]: debug 2021-07-26T15:59:54.880+0000 7f9ba7ca10c0 -1 osd.1 235 log_to_monitors {default=true} 2021-07-26T15:59:55.241 INFO:tasks.rados.rados.0.smithi033.stdout:986: done (5 left) 2021-07-26T15:59:55.241 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 98 2021-07-26T15:59:55.241 INFO:tasks.rados.rados.0.smithi033.stdout:980: finishing write tid 3 to smithi03339061-39 2021-07-26T15:59:55.242 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 430 (ObjNum 304 snap 98 seq_num 304) dirty exists 2021-07-26T15:59:55.242 INFO:tasks.rados.rados.0.smithi033.stdout:980: left oid 39 (ObjNum 304 snap 98 seq_num 304) 2021-07-26T15:59:55.242 INFO:tasks.rados.rados.0.smithi033.stdout:987: seq_num 307 ranges {0=344064} 2021-07-26T15:59:55.244 INFO:tasks.rados.rados.0.smithi033.stdout:987: writing smithi03339061-13 from 0 to 344064 tid 1 2021-07-26T15:59:55.244 INFO:tasks.rados.rados.0.smithi033.stdout:980: done (5 left) 2021-07-26T15:59:55.244 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 98 2021-07-26T15:59:55.244 INFO:tasks.rados.rados.0.smithi033.stdout:981: finishing write tid 1 to smithi03339061-43 2021-07-26T15:59:55.245 INFO:tasks.rados.rados.0.smithi033.stdout:981: finishing write tid 2 to smithi03339061-43 2021-07-26T15:59:55.245 INFO:tasks.rados.rados.0.smithi033.stdout:981: finishing write tid 3 to smithi03339061-43 2021-07-26T15:59:55.245 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 296 (ObjNum 305 snap 98 seq_num 305) dirty exists 2021-07-26T15:59:55.245 INFO:tasks.rados.rados.0.smithi033.stdout:981: left oid 43 (ObjNum 305 snap 98 seq_num 305) 2021-07-26T15:59:55.245 INFO:tasks.rados.rados.0.smithi033.stdout:982: expect (ObjNum 259 snap 81 seq_num 259) 2021-07-26T15:59:55.355 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 0 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T15:59:55.355 INFO:tasks.rados.rados.0.smithi033.stdout:983: finishing write tid 1 to smithi03339061-11 2021-07-26T15:59:55.355 INFO:tasks.rados.rados.0.smithi033.stdout:983: finishing write tid 2 to smithi03339061-11 2021-07-26T15:59:55.356 INFO:tasks.rados.rados.0.smithi033.stdout:983: finishing write tid 3 to smithi03339061-11 2021-07-26T15:59:55.356 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 403 (ObjNum 306 snap 98 seq_num 306) dirty exists 2021-07-26T15:59:55.356 INFO:tasks.rados.rados.0.smithi033.stdout:983: left oid 11 (ObjNum 306 snap 98 seq_num 306) 2021-07-26T15:59:55.356 INFO:tasks.rados.rados.0.smithi033.stdout:987: finishing write tid 1 to smithi03339061-13 2021-07-26T15:59:55.356 INFO:tasks.rados.rados.0.smithi033.stdout:987: finishing write tid 2 to smithi03339061-13 2021-07-26T15:59:55.357 INFO:tasks.rados.rados.0.smithi033.stdout:987: finishing write tid 3 to smithi03339061-13 2021-07-26T15:59:55.357 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 462 (ObjNum 307 snap 98 seq_num 307) dirty exists 2021-07-26T15:59:55.357 INFO:tasks.rados.rados.0.smithi033.stdout:987: left oid 13 (ObjNum 307 snap 98 seq_num 307) 2021-07-26T15:59:55.357 INFO:tasks.rados.rados.0.smithi033.stdout:988: seq_num 308 ranges {524288=360448} 2021-07-26T15:59:55.365 INFO:tasks.rados.rados.0.smithi033.stdout:988: writing smithi03339061-46 from 524288 to 884736 tid 1 2021-07-26T15:59:55.365 INFO:tasks.rados.rados.0.smithi033.stdout:981: done (5 left) 2021-07-26T15:59:55.365 INFO:tasks.rados.rados.0.smithi033.stdout:982: done (4 left) 2021-07-26T15:59:55.366 INFO:tasks.rados.rados.0.smithi033.stdout:983: done (3 left) 2021-07-26T15:59:55.366 INFO:tasks.rados.rados.0.smithi033.stdout:985: done (2 left) 2021-07-26T15:59:55.367 INFO:tasks.rados.rados.0.smithi033.stdout:987: done (1 left) 2021-07-26T15:59:55.367 INFO:tasks.rados.rados.0.smithi033.stdout:989: snap_create 2021-07-26T15:59:55.371 INFO:tasks.rados.rados.0.smithi033.stdout:988: finishing write tid 1 to smithi03339061-46 2021-07-26T15:59:55.372 INFO:tasks.rados.rados.0.smithi033.stdout:988: finishing write tid 2 to smithi03339061-46 2021-07-26T15:59:55.375 INFO:tasks.rados.rados.0.smithi033.stdout:988: finishing write tid 3 to smithi03339061-46 2021-07-26T15:59:55.375 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 179 (ObjNum 308 snap 98 seq_num 308) dirty exists 2021-07-26T15:59:55.375 INFO:tasks.rados.rados.0.smithi033.stdout:988: left oid 46 (ObjNum 308 snap 98 seq_num 308) 2021-07-26T15:59:55.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:55 smithi096 bash[33981]: cluster 2021-07-26T15:59:54.223421+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e245: 8 total, 7 up, 8 in 2021-07-26T15:59:55.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:55 smithi096 bash[33981]: audit 2021-07-26T15:59:54.890237+0000 mon.a (mon.0) 279 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-07-26T15:59:55.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:55 smithi033 bash[41341]: cluster 2021-07-26T15:59:54.223421+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e245: 8 total, 7 up, 8 in 2021-07-26T15:59:55.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:55 smithi033 bash[41341]: audit 2021-07-26T15:59:54.890237+0000 mon.a (mon.0) 279 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-07-26T15:59:55.709 INFO:journalctl@ceph.osd.1.smithi033.stdout:Jul 26 15:59:55 smithi033 bash[45509]: debug 2021-07-26T15:59:55.248+0000 7f9b98df5700 -1 osd.1 235 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-07-26T15:59:55.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:55 smithi033 bash[42377]: cluster 2021-07-26T15:59:54.223421+0000 mon.a (mon.0) 278 : cluster [DBG] osdmap e245: 8 total, 7 up, 8 in 2021-07-26T15:59:55.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:55 smithi033 bash[42377]: audit 2021-07-26T15:59:54.890237+0000 mon.a (mon.0) 279 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-07-26T15:59:55.962 INFO:tasks.rados.rados.0.smithi033.stdout:988: done (1 left) 2021-07-26T15:59:55.962 INFO:tasks.rados.rados.0.smithi033.stdout:989: done (0 left) 2021-07-26T15:59:55.963 INFO:tasks.rados.rados.0.smithi033.stdout:990: read oid 5 snap 91 2021-07-26T15:59:55.963 INFO:tasks.rados.rados.0.smithi033.stdout:990: expect deleted 2021-07-26T15:59:55.963 INFO:tasks.rados.rados.0.smithi033.stdout:991: read oid 47 snap 96 2021-07-26T15:59:55.963 INFO:tasks.rados.rados.0.smithi033.stdout:991: expect (ObjNum 271 snap 83 seq_num 271) 2021-07-26T15:59:55.963 INFO:tasks.rados.rados.0.smithi033.stdout:992: snap_remove snap 83 2021-07-26T15:59:56.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:56 smithi096 bash[33981]: cluster 2021-07-26T15:59:54.978258+0000 mgr.y (mgr.34104) 112 : cluster [DBG] pgmap v155: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 162 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 5.9 MiB/s rd, 960 KiB/s wr, 13 op/s; 33/330 objects degraded (10.000%) 2021-07-26T15:59:56.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:56 smithi096 bash[33981]: audit 2021-07-26T15:59:55.234067+0000 mon.a (mon.0) 280 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-07-26T15:59:56.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:56 smithi096 bash[33981]: cluster 2021-07-26T15:59:55.234218+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e246: 8 total, 7 up, 8 in 2021-07-26T15:59:56.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:56 smithi096 bash[33981]: audit 2021-07-26T15:59:55.239103+0000 mon.a (mon.0) 282 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:59:56.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:56 smithi096 bash[33981]: cluster 2021-07-26T15:59:55.947236+0000 mon.a (mon.0) 283 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T15:59:56.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:56 smithi096 bash[33981]: cluster 2021-07-26T15:59:55.956101+0000 mon.a (mon.0) 284 : cluster [INF] osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418] boot 2021-07-26T15:59:56.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:56 smithi096 bash[33981]: cluster 2021-07-26T15:59:55.956250+0000 mon.a (mon.0) 285 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-07-26T15:59:56.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:56 smithi096 bash[33981]: audit 2021-07-26T15:59:55.959285+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:59:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[41341]: cluster 2021-07-26T15:59:54.978258+0000 mgr.y (mgr.34104) 112 : cluster [DBG] pgmap v155: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 162 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 5.9 MiB/s rd, 960 KiB/s wr, 13 op/s; 33/330 objects degraded (10.000%) 2021-07-26T15:59:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[41341]: audit 2021-07-26T15:59:55.234067+0000 mon.a (mon.0) 280 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-07-26T15:59:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[41341]: cluster 2021-07-26T15:59:55.234218+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e246: 8 total, 7 up, 8 in 2021-07-26T15:59:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[41341]: audit 2021-07-26T15:59:55.239103+0000 mon.a (mon.0) 282 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:59:56.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[41341]: cluster 2021-07-26T15:59:55.947236+0000 mon.a (mon.0) 283 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T15:59:56.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[41341]: cluster 2021-07-26T15:59:55.956101+0000 mon.a (mon.0) 284 : cluster [INF] osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418] boot 2021-07-26T15:59:56.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[41341]: cluster 2021-07-26T15:59:55.956250+0000 mon.a (mon.0) 285 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-07-26T15:59:56.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[41341]: audit 2021-07-26T15:59:55.959285+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:59:56.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[42377]: cluster 2021-07-26T15:59:54.978258+0000 mgr.y (mgr.34104) 112 : cluster [DBG] pgmap v155: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 162 MiB data, 609 MiB used, 715 GiB / 715 GiB avail; 5.9 MiB/s rd, 960 KiB/s wr, 13 op/s; 33/330 objects degraded (10.000%) 2021-07-26T15:59:56.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[42377]: audit 2021-07-26T15:59:55.234067+0000 mon.a (mon.0) 280 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-07-26T15:59:56.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[42377]: cluster 2021-07-26T15:59:55.234218+0000 mon.a (mon.0) 281 : cluster [DBG] osdmap e246: 8 total, 7 up, 8 in 2021-07-26T15:59:56.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[42377]: audit 2021-07-26T15:59:55.239103+0000 mon.a (mon.0) 282 : audit [INF] from='osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T15:59:56.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[42377]: cluster 2021-07-26T15:59:55.947236+0000 mon.a (mon.0) 283 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T15:59:56.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[42377]: cluster 2021-07-26T15:59:55.956101+0000 mon.a (mon.0) 284 : cluster [INF] osd.1 [v2:172.21.15.33:6810/1456109418,v1:172.21.15.33:6811/1456109418] boot 2021-07-26T15:59:56.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[42377]: cluster 2021-07-26T15:59:55.956250+0000 mon.a (mon.0) 285 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-07-26T15:59:56.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:56 smithi033 bash[42377]: audit 2021-07-26T15:59:55.959285+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-07-26T15:59:56.975 INFO:tasks.rados.rados.0.smithi033.stdout:991: expect (ObjNum 271 snap 83 seq_num 271) 2021-07-26T15:59:57.136 INFO:tasks.rados.rados.0.smithi033.stdout:990: done (2 left) 2021-07-26T15:59:57.136 INFO:tasks.rados.rados.0.smithi033.stdout:991: done (1 left) 2021-07-26T15:59:57.136 INFO:tasks.rados.rados.0.smithi033.stdout:992: done (0 left) 2021-07-26T15:59:57.136 INFO:tasks.rados.rados.0.smithi033.stdout:993: snap_create 2021-07-26T15:59:57.980 INFO:tasks.rados.rados.0.smithi033.stdout:993: done (0 left) 2021-07-26T15:59:57.981 INFO:tasks.rados.rados.0.smithi033.stdout:994: rollback oid 2 current snap is 100 2021-07-26T15:59:57.981 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 2 to 88 2021-07-26T15:59:57.981 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 100 2021-07-26T15:59:57.981 INFO:tasks.rados.rados.0.smithi033.stdout:995: seq_num 309 ranges {2031616=376832} 2021-07-26T15:59:58.000 INFO:tasks.rados.rados.0.smithi033.stdout:995: writing smithi03339061-38 from 2031616 to 2408448 tid 1 2021-07-26T15:59:58.002 INFO:tasks.rados.rados.0.smithi033.stdout:994: finishing rollback tid 0 to smithi03339061-2 2021-07-26T15:59:58.002 INFO:tasks.rados.rados.0.smithi033.stdout:996: read oid 40 snap -1 2021-07-26T15:59:58.002 INFO:tasks.rados.rados.0.smithi033.stdout:996: expect (ObjNum 303 snap 97 seq_num 303) 2021-07-26T15:59:58.002 INFO:tasks.rados.rados.0.smithi033.stdout:997: read oid 49 snap 76 2021-07-26T15:59:58.003 INFO:tasks.rados.rados.0.smithi033.stdout:997: expect deleted 2021-07-26T15:59:58.003 INFO:tasks.rados.rados.0.smithi033.stdout:998: delete oid 19 current snap is 100 2021-07-26T15:59:58.003 INFO:tasks.rados.rados.0.smithi033.stdout:994: finishing rollback tid 1 to smithi03339061-2 2021-07-26T15:59:58.004 INFO:tasks.rados.rados.0.smithi033.stdout:994: finishing rollback tid 2 to smithi03339061-2 2021-07-26T15:59:58.004 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 229 (ObjNum 259 snap 81 seq_num 259) dirty exists 2021-07-26T15:59:58.005 INFO:tasks.rados.rados.0.smithi033.stdout:995: finishing write tid 1 to smithi03339061-38 2021-07-26T15:59:58.005 INFO:tasks.rados.rados.0.smithi033.stdout:995: finishing write tid 2 to smithi03339061-38 2021-07-26T15:59:58.007 INFO:tasks.rados.rados.0.smithi033.stdout:995: finishing write tid 3 to smithi03339061-38 2021-07-26T15:59:58.007 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 67 (ObjNum 309 snap 100 seq_num 309) dirty exists 2021-07-26T15:59:58.008 INFO:tasks.rados.rados.0.smithi033.stdout:995: left oid 38 (ObjNum 309 snap 100 seq_num 309) 2021-07-26T15:59:58.057 INFO:tasks.rados.rados.0.smithi033.stdout:996: expect (ObjNum 303 snap 97 seq_num 303) 2021-07-26T15:59:58.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:57 smithi096 bash[33981]: cluster 2021-07-26T15:59:56.968835+0000 mon.a (mon.0) 286 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-07-26T15:59:58.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:57 smithi096 bash[33981]: cluster 2021-07-26T15:59:56.978959+0000 mgr.y (mgr.34104) 113 : cluster [DBG] pgmap v159: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 162 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 974 KiB/s wr, 13 op/s; 33/330 objects degraded (10.000%) 2021-07-26T15:59:58.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:57 smithi033 bash[42377]: cluster 2021-07-26T15:59:56.968835+0000 mon.a (mon.0) 286 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-07-26T15:59:58.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:57 smithi033 bash[42377]: cluster 2021-07-26T15:59:56.978959+0000 mgr.y (mgr.34104) 113 : cluster [DBG] pgmap v159: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 162 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 974 KiB/s wr, 13 op/s; 33/330 objects degraded (10.000%) 2021-07-26T15:59:58.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:57 smithi033 bash[41341]: cluster 2021-07-26T15:59:56.968835+0000 mon.a (mon.0) 286 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-07-26T15:59:58.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:57 smithi033 bash[41341]: cluster 2021-07-26T15:59:56.978959+0000 mgr.y (mgr.34104) 113 : cluster [DBG] pgmap v159: 25 pgs: 6 active+undersized+degraded, 5 active+undersized, 14 active+clean; 162 MiB data, 580 MiB used, 715 GiB / 715 GiB avail; 6.0 MiB/s rd, 974 KiB/s wr, 13 op/s; 33/330 objects degraded (10.000%) 2021-07-26T15:59:59.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:58 smithi096 bash[33981]: cluster 2021-07-26T15:59:57.975720+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-07-26T15:59:59.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:58 smithi033 bash[42377]: cluster 2021-07-26T15:59:57.975720+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-07-26T15:59:59.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:58 smithi033 bash[41341]: cluster 2021-07-26T15:59:57.975720+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-07-26T16:00:00.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 15:59:59 smithi096 bash[33981]: cluster 2021-07-26T15:59:58.979734+0000 mgr.y (mgr.34104) 114 : cluster [DBG] pgmap v161: 25 pgs: 1 active+clean+snaptrim, 1 activating, 6 active+undersized+degraded, 4 active+undersized, 13 active+clean; 162 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 33/330 objects degraded (10.000%) 2021-07-26T16:00:00.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 15:59:59 smithi033 bash[42377]: cluster 2021-07-26T15:59:58.979734+0000 mgr.y (mgr.34104) 114 : cluster [DBG] pgmap v161: 25 pgs: 1 active+clean+snaptrim, 1 activating, 6 active+undersized+degraded, 4 active+undersized, 13 active+clean; 162 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 33/330 objects degraded (10.000%) 2021-07-26T16:00:00.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 15:59:59 smithi033 bash[41341]: cluster 2021-07-26T15:59:58.979734+0000 mgr.y (mgr.34104) 114 : cluster [DBG] pgmap v161: 25 pgs: 1 active+clean+snaptrim, 1 activating, 6 active+undersized+degraded, 4 active+undersized, 13 active+clean; 162 MiB data, 582 MiB used, 715 GiB / 715 GiB avail; 33/330 objects degraded (10.000%) 2021-07-26T16:00:01.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[42377]: cluster 2021-07-26T16:00:00.000159+0000 mon.a (mon.0) 288 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded 2021-07-26T16:00:01.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[42377]: cluster 2021-07-26T16:00:00.000233+0000 mon.a (mon.0) 289 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded 2021-07-26T16:00:01.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[42377]: cluster 2021-07-26T16:00:00.000280+0000 mon.a (mon.0) 290 : cluster [WRN] pg 3.0 is active+undersized+degraded, acting [NONE,2,6] 2021-07-26T16:00:01.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[42377]: cluster 2021-07-26T16:00:00.000332+0000 mon.a (mon.0) 291 : cluster [WRN] pg 3.3 is active+undersized+degraded, acting [4,NONE,0] 2021-07-26T16:00:01.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[42377]: cluster 2021-07-26T16:00:00.000378+0000 mon.a (mon.0) 292 : cluster [WRN] pg 3.4 is active+undersized+degraded, acting [NONE,2,6] 2021-07-26T16:00:01.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[42377]: cluster 2021-07-26T16:00:00.000426+0000 mon.a (mon.0) 293 : cluster [WRN] pg 3.8 is active+undersized+degraded, acting [3,NONE,7] 2021-07-26T16:00:01.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[42377]: cluster 2021-07-26T16:00:00.000475+0000 mon.a (mon.0) 294 : cluster [WRN] pg 3.a is active+undersized+degraded, acting [6,4,NONE] 2021-07-26T16:00:01.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[42377]: cluster 2021-07-26T16:00:00.000524+0000 mon.a (mon.0) 295 : cluster [WRN] pg 3.e is active+undersized+degraded, acting [7,4,NONE] 2021-07-26T16:00:01.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[42377]: cluster 2021-07-26T16:00:00.948737+0000 mon.a (mon.0) 296 : cluster [WRN] Health check update: Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:01.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[41341]: cluster 2021-07-26T16:00:00.000159+0000 mon.a (mon.0) 288 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded 2021-07-26T16:00:01.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[41341]: cluster 2021-07-26T16:00:00.000233+0000 mon.a (mon.0) 289 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded 2021-07-26T16:00:01.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[41341]: cluster 2021-07-26T16:00:00.000280+0000 mon.a (mon.0) 290 : cluster [WRN] pg 3.0 is active+undersized+degraded, acting [NONE,2,6] 2021-07-26T16:00:01.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[41341]: cluster 2021-07-26T16:00:00.000332+0000 mon.a (mon.0) 291 : cluster [WRN] pg 3.3 is active+undersized+degraded, acting [4,NONE,0] 2021-07-26T16:00:01.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[41341]: cluster 2021-07-26T16:00:00.000378+0000 mon.a (mon.0) 292 : cluster [WRN] pg 3.4 is active+undersized+degraded, acting [NONE,2,6] 2021-07-26T16:00:01.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[41341]: cluster 2021-07-26T16:00:00.000426+0000 mon.a (mon.0) 293 : cluster [WRN] pg 3.8 is active+undersized+degraded, acting [3,NONE,7] 2021-07-26T16:00:01.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[41341]: cluster 2021-07-26T16:00:00.000475+0000 mon.a (mon.0) 294 : cluster [WRN] pg 3.a is active+undersized+degraded, acting [6,4,NONE] 2021-07-26T16:00:01.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[41341]: cluster 2021-07-26T16:00:00.000524+0000 mon.a (mon.0) 295 : cluster [WRN] pg 3.e is active+undersized+degraded, acting [7,4,NONE] 2021-07-26T16:00:01.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:00 smithi033 bash[41341]: cluster 2021-07-26T16:00:00.948737+0000 mon.a (mon.0) 296 : cluster [WRN] Health check update: Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:01.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:00 smithi096 bash[33981]: cluster 2021-07-26T16:00:00.000159+0000 mon.a (mon.0) 288 : cluster [WRN] Health detail: HEALTH_WARN Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded 2021-07-26T16:00:01.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:00 smithi096 bash[33981]: cluster 2021-07-26T16:00:00.000233+0000 mon.a (mon.0) 289 : cluster [WRN] [WRN] PG_DEGRADED: Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded 2021-07-26T16:00:01.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:00 smithi096 bash[33981]: cluster 2021-07-26T16:00:00.000280+0000 mon.a (mon.0) 290 : cluster [WRN] pg 3.0 is active+undersized+degraded, acting [NONE,2,6] 2021-07-26T16:00:01.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:00 smithi096 bash[33981]: cluster 2021-07-26T16:00:00.000332+0000 mon.a (mon.0) 291 : cluster [WRN] pg 3.3 is active+undersized+degraded, acting [4,NONE,0] 2021-07-26T16:00:01.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:00 smithi096 bash[33981]: cluster 2021-07-26T16:00:00.000378+0000 mon.a (mon.0) 292 : cluster [WRN] pg 3.4 is active+undersized+degraded, acting [NONE,2,6] 2021-07-26T16:00:01.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:00 smithi096 bash[33981]: cluster 2021-07-26T16:00:00.000426+0000 mon.a (mon.0) 293 : cluster [WRN] pg 3.8 is active+undersized+degraded, acting [3,NONE,7] 2021-07-26T16:00:01.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:00 smithi096 bash[33981]: cluster 2021-07-26T16:00:00.000475+0000 mon.a (mon.0) 294 : cluster [WRN] pg 3.a is active+undersized+degraded, acting [6,4,NONE] 2021-07-26T16:00:01.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:00 smithi096 bash[33981]: cluster 2021-07-26T16:00:00.000524+0000 mon.a (mon.0) 295 : cluster [WRN] pg 3.e is active+undersized+degraded, acting [7,4,NONE] 2021-07-26T16:00:01.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:00 smithi096 bash[33981]: cluster 2021-07-26T16:00:00.948737+0000 mon.a (mon.0) 296 : cluster [WRN] Health check update: Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:02.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:01 smithi033 bash[41341]: cluster 2021-07-26T16:00:00.980741+0000 mgr.y (mgr.34104) 115 : cluster [DBG] pgmap v162: 25 pgs: 1 active+clean+snaptrim, 4 active+clean+wait, 1 activating, 19 active+clean; 163 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 7.2 MiB/s rd, 184 KiB/s wr, 2 op/s; 2.7 MiB/s, 1 objects/s recovering 2021-07-26T16:00:02.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:01 smithi033 bash[41341]: cluster 2021-07-26T16:00:01.951982+0000 mon.a (mon.0) 297 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded) 2021-07-26T16:00:02.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:01 smithi033 bash[41341]: cluster 2021-07-26T16:00:01.952057+0000 mon.a (mon.0) 298 : cluster [INF] Cluster is now healthy 2021-07-26T16:00:02.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:01 smithi033 bash[42377]: cluster 2021-07-26T16:00:00.980741+0000 mgr.y (mgr.34104) 115 : cluster [DBG] pgmap v162: 25 pgs: 1 active+clean+snaptrim, 4 active+clean+wait, 1 activating, 19 active+clean; 163 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 7.2 MiB/s rd, 184 KiB/s wr, 2 op/s; 2.7 MiB/s, 1 objects/s recovering 2021-07-26T16:00:02.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:01 smithi033 bash[42377]: cluster 2021-07-26T16:00:01.951982+0000 mon.a (mon.0) 297 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded) 2021-07-26T16:00:02.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:01 smithi033 bash[42377]: cluster 2021-07-26T16:00:01.952057+0000 mon.a (mon.0) 298 : cluster [INF] Cluster is now healthy 2021-07-26T16:00:02.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:01 smithi096 bash[33981]: cluster 2021-07-26T16:00:00.980741+0000 mgr.y (mgr.34104) 115 : cluster [DBG] pgmap v162: 25 pgs: 1 active+clean+snaptrim, 4 active+clean+wait, 1 activating, 19 active+clean; 163 MiB data, 604 MiB used, 715 GiB / 715 GiB avail; 7.2 MiB/s rd, 184 KiB/s wr, 2 op/s; 2.7 MiB/s, 1 objects/s recovering 2021-07-26T16:00:02.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:01 smithi096 bash[33981]: cluster 2021-07-26T16:00:01.951982+0000 mon.a (mon.0) 297 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/330 objects degraded (10.000%), 6 pgs degraded) 2021-07-26T16:00:02.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:01 smithi096 bash[33981]: cluster 2021-07-26T16:00:01.952057+0000 mon.a (mon.0) 298 : cluster [INF] Cluster is now healthy 2021-07-26T16:00:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:03 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:03.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:03 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:03.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:03 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:03.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:00:04.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:03 smithi033 bash[41341]: cluster 2021-07-26T16:00:02.981568+0000 mgr.y (mgr.34104) 116 : cluster [DBG] pgmap v163: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 5.9 MiB/s rd, 150 KiB/s wr, 2 op/s; 2.2 MiB/s, 1 objects/s recovering 2021-07-26T16:00:04.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:03 smithi033 bash[42377]: cluster 2021-07-26T16:00:02.981568+0000 mgr.y (mgr.34104) 116 : cluster [DBG] pgmap v163: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 5.9 MiB/s rd, 150 KiB/s wr, 2 op/s; 2.2 MiB/s, 1 objects/s recovering 2021-07-26T16:00:04.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:03 smithi096 bash[33981]: cluster 2021-07-26T16:00:02.981568+0000 mgr.y (mgr.34104) 116 : cluster [DBG] pgmap v163: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 5.9 MiB/s rd, 150 KiB/s wr, 2 op/s; 2.2 MiB/s, 1 objects/s recovering 2021-07-26T16:00:06.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:05 smithi033 bash[42377]: cluster 2021-07-26T16:00:04.982451+0000 mgr.y (mgr.34104) 117 : cluster [DBG] pgmap v164: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 5.1 MiB/s rd, 132 KiB/s wr, 2 op/s; 1.9 MiB/s, 1 objects/s recovering 2021-07-26T16:00:06.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:05 smithi033 bash[42377]: cluster 2021-07-26T16:00:05.959334+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-07-26T16:00:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:05 smithi033 bash[41341]: cluster 2021-07-26T16:00:04.982451+0000 mgr.y (mgr.34104) 117 : cluster [DBG] pgmap v164: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 5.1 MiB/s rd, 132 KiB/s wr, 2 op/s; 1.9 MiB/s, 1 objects/s recovering 2021-07-26T16:00:06.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:05 smithi033 bash[41341]: cluster 2021-07-26T16:00:05.959334+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-07-26T16:00:06.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:05 smithi096 bash[33981]: cluster 2021-07-26T16:00:04.982451+0000 mgr.y (mgr.34104) 117 : cluster [DBG] pgmap v164: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 5.1 MiB/s rd, 132 KiB/s wr, 2 op/s; 1.9 MiB/s, 1 objects/s recovering 2021-07-26T16:00:06.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:05 smithi096 bash[33981]: cluster 2021-07-26T16:00:05.959334+0000 mon.a (mon.0) 299 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-07-26T16:00:08.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:07 smithi033 bash[41341]: cluster 2021-07-26T16:00:06.983150+0000 mgr.y (mgr.34104) 118 : cluster [DBG] pgmap v166: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 117 KiB/s wr, 1 op/s; 1.7 MiB/s, 1 objects/s recovering 2021-07-26T16:00:08.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:08 smithi033 bash[41341]: audit 2021-07-26T16:00:07.252274+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T16:00:08.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:08 smithi033 bash[41341]: audit 2021-07-26T16:00:07.252732+0000 mgr.y (mgr.34104) 119 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T16:00:08.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:08 smithi033 bash[41341]: cephadm 2021-07-26T16:00:07.254930+0000 mgr.y (mgr.34104) 120 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-07-26T16:00:08.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:08 smithi033 bash[42377]: cluster 2021-07-26T16:00:06.983150+0000 mgr.y (mgr.34104) 118 : cluster [DBG] pgmap v166: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 117 KiB/s wr, 1 op/s; 1.7 MiB/s, 1 objects/s recovering 2021-07-26T16:00:08.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:08 smithi033 bash[42377]: audit 2021-07-26T16:00:07.252274+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T16:00:08.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:08 smithi033 bash[42377]: audit 2021-07-26T16:00:07.252732+0000 mgr.y (mgr.34104) 119 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T16:00:08.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:08 smithi033 bash[42377]: cephadm 2021-07-26T16:00:07.254930+0000 mgr.y (mgr.34104) 120 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-07-26T16:00:08.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:08 smithi096 bash[33981]: cluster 2021-07-26T16:00:06.983150+0000 mgr.y (mgr.34104) 118 : cluster [DBG] pgmap v166: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 4.6 MiB/s rd, 117 KiB/s wr, 1 op/s; 1.7 MiB/s, 1 objects/s recovering 2021-07-26T16:00:08.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:08 smithi096 bash[33981]: audit 2021-07-26T16:00:07.252274+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T16:00:08.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:08 smithi096 bash[33981]: audit 2021-07-26T16:00:07.252732+0000 mgr.y (mgr.34104) 119 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2021-07-26T16:00:08.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:08 smithi096 bash[33981]: cephadm 2021-07-26T16:00:07.254930+0000 mgr.y (mgr.34104) 120 : cephadm [INF] Upgrade: osd.2 is safe to restart 2021-07-26T16:00:09.964 INFO:tasks.rados.rados.0.smithi033.stdout:994: done (4 left) 2021-07-26T16:00:09.965 INFO:tasks.rados.rados.0.smithi033.stdout:995: done (3 left) 2021-07-26T16:00:09.965 INFO:tasks.rados.rados.0.smithi033.stdout:996: done (2 left) 2021-07-26T16:00:09.967 INFO:tasks.rados.rados.0.smithi033.stdout:997: done (1 left) 2021-07-26T16:00:09.967 INFO:tasks.rados.rados.0.smithi033.stdout:998: done (0 left) 2021-07-26T16:00:09.967 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 100 2021-07-26T16:00:09.968 INFO:tasks.rados.rados.0.smithi033.stdout:999: seq_num 311 ranges {0=417792} 2021-07-26T16:00:09.972 INFO:tasks.rados.rados.0.smithi033.stdout:999: writing smithi03339061-19 from 0 to 417792 tid 1 2021-07-26T16:00:09.972 INFO:tasks.rados.rados.0.smithi033.stdout:1000: read oid 15 snap -1 2021-07-26T16:00:09.973 INFO:tasks.rados.rados.0.smithi033.stdout:1000: expect deleted 2021-07-26T16:00:09.973 INFO:tasks.rados.rados.0.smithi033.stdout:1001: read oid 27 snap 94 2021-07-26T16:00:09.973 INFO:tasks.rados.rados.0.smithi033.stdout:1001: expect (ObjNum 250 snap 71 seq_num 250) 2021-07-26T16:00:09.973 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 100 2021-07-26T16:00:09.974 INFO:tasks.rados.rados.0.smithi033.stdout:1002: seq_num 312 ranges {6742016=434176} 2021-07-26T16:00:10.013 INFO:tasks.rados.rados.0.smithi033.stdout:1002: writing smithi03339061-11 from 6742016 to 7176192 tid 1 2021-07-26T16:00:10.014 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 100 2021-07-26T16:00:10.014 INFO:tasks.rados.rados.0.smithi033.stdout:1003: seq_num 313 ranges {0=450560} 2021-07-26T16:00:10.017 INFO:tasks.rados.rados.0.smithi033.stdout:1003: writing smithi03339061-41 from 0 to 450560 tid 1 2021-07-26T16:00:10.017 INFO:tasks.rados.rados.0.smithi033.stdout:1004: copy_from oid 21 from oid 1 current snap is 100 2021-07-26T16:00:10.017 INFO:tasks.rados.rados.0.smithi033.stdout:999: finishing write tid 1 to smithi03339061-19 2021-07-26T16:00:10.017 INFO:tasks.rados.rados.0.smithi033.stdout:999: finishing write tid 2 to smithi03339061-19 2021-07-26T16:00:10.018 INFO:tasks.rados.rados.0.smithi033.stdout:999: finishing write tid 3 to smithi03339061-19 2021-07-26T16:00:10.018 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 276 (ObjNum 311 snap 100 seq_num 311) dirty exists 2021-07-26T16:00:10.018 INFO:tasks.rados.rados.0.smithi033.stdout:999: left oid 19 (ObjNum 311 snap 100 seq_num 311) 2021-07-26T16:00:10.019 INFO:tasks.rados.rados.0.smithi033.stdout:1001: expect (ObjNum 250 snap 71 seq_num 250) 2021-07-26T16:00:10.445 INFO:tasks.rados.rados.0.smithi033.stdout:1004: finishing copy_from to smithi03339061-21 2021-07-26T16:00:10.445 INFO:tasks.rados.rados.0.smithi033.stdout:1004: got expected ENOENT (src dne) 2021-07-26T16:00:10.446 INFO:tasks.rados.rados.0.smithi033.stdout:1004: finishing copy_from racing read to smithi03339061-21 2021-07-26T16:00:10.446 INFO:tasks.rados.rados.0.smithi033.stdout:1002: finishing write tid 1 to smithi03339061-11 2021-07-26T16:00:10.446 INFO:tasks.rados.rados.0.smithi033.stdout:1002: finishing write tid 2 to smithi03339061-11 2021-07-26T16:00:10.446 INFO:tasks.rados.rados.0.smithi033.stdout:1003: finishing write tid 1 to smithi03339061-41 2021-07-26T16:00:10.447 INFO:tasks.rados.rados.0.smithi033.stdout:1003: finishing write tid 2 to smithi03339061-41 2021-07-26T16:00:10.447 INFO:tasks.rados.rados.0.smithi033.stdout:1003: finishing write tid 3 to smithi03339061-41 2021-07-26T16:00:10.447 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 308 (ObjNum 313 snap 100 seq_num 313) dirty exists 2021-07-26T16:00:10.447 INFO:tasks.rados.rados.0.smithi033.stdout:1003: left oid 41 (ObjNum 313 snap 100 seq_num 313) 2021-07-26T16:00:10.448 INFO:tasks.rados.rados.0.smithi033.stdout:1002: finishing write tid 3 to smithi03339061-11 2021-07-26T16:00:10.448 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 405 (ObjNum 312 snap 100 seq_num 312) dirty exists 2021-07-26T16:00:10.448 INFO:tasks.rados.rados.0.smithi033.stdout:1002: left oid 11 (ObjNum 312 snap 100 seq_num 312) 2021-07-26T16:00:10.448 INFO:tasks.rados.rados.0.smithi033.stdout:999: done (5 left) 2021-07-26T16:00:10.448 INFO:tasks.rados.rados.0.smithi033.stdout:1000: done (4 left) 2021-07-26T16:00:10.449 INFO:tasks.rados.rados.0.smithi033.stdout:1001: done (3 left) 2021-07-26T16:00:10.449 INFO:tasks.rados.rados.0.smithi033.stdout:1002: done (2 left) 2021-07-26T16:00:10.449 INFO:tasks.rados.rados.0.smithi033.stdout:1003: done (1 left) 2021-07-26T16:00:10.449 INFO:tasks.rados.rados.0.smithi033.stdout:1004: done (0 left) 2021-07-26T16:00:10.450 INFO:tasks.rados.rados.0.smithi033.stdout:1005: rollback oid 33 current snap is 100 2021-07-26T16:00:10.450 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 90 2021-07-26T16:00:10.450 INFO:tasks.rados.rados.0.smithi033.stdout:1006: copy_from oid 22 from oid 6 current snap is 100 2021-07-26T16:00:10.450 INFO:tasks.rados.rados.0.smithi033.stdout:1007: setattr oid 36 current snap is 100 2021-07-26T16:00:10.451 INFO:tasks.rados.rados.0.smithi033.stdout:1006: finishing copy_from to smithi03339061-22 2021-07-26T16:00:10.452 INFO:tasks.rados.rados.0.smithi033.stdout:1006: got expected ENOENT (src dne) 2021-07-26T16:00:10.452 INFO:tasks.rados.rados.0.smithi033.stdout:1006: finishing copy_from racing read to smithi03339061-22 2021-07-26T16:00:10.452 INFO:tasks.rados.rados.0.smithi033.stdout:1006: done (2 left) 2021-07-26T16:00:10.452 INFO:tasks.rados.rados.0.smithi033.stdout:1008: delete oid 7 current snap is 100 2021-07-26T16:00:10.453 INFO:tasks.rados.rados.0.smithi033.stdout:1005: finishing rollback tid 1 to smithi03339061-33 2021-07-26T16:00:10.453 INFO:tasks.rados.rados.0.smithi033.stdout:1005: finishing rollback tid 2 to smithi03339061-33 2021-07-26T16:00:10.453 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 555 (ObjNum 232 snap 65 seq_num 232) dirty exists 2021-07-26T16:00:10.454 INFO:tasks.rados.rados.0.smithi033.stdout:1005: done (2 left) 2021-07-26T16:00:10.454 INFO:tasks.rados.rados.0.smithi033.stdout:1008: done (1 left) 2021-07-26T16:00:10.454 INFO:tasks.rados.rados.0.smithi033.stdout:1009: read oid 12 snap -1 2021-07-26T16:00:10.455 INFO:tasks.rados.rados.0.smithi033.stdout:1009: expect (ObjNum 257 snap 77 seq_num 257) 2021-07-26T16:00:10.455 INFO:tasks.rados.rados.0.smithi033.stdout:1010: delete oid 38 current snap is 100 2021-07-26T16:00:10.456 INFO:tasks.rados.rados.0.smithi033.stdout:1010: done (2 left) 2021-07-26T16:00:10.456 INFO:tasks.rados.rados.0.smithi033.stdout:1011: snap_remove snap 94 2021-07-26T16:00:10.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[42377]: cluster 2021-07-26T16:00:08.983730+0000 mgr.y (mgr.34104) 121 : cluster [DBG] pgmap v167: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 106 KiB/s wr, 1 op/s; 1.5 MiB/s, 0 objects/s recovering 2021-07-26T16:00:10.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[42377]: audit 2021-07-26T16:00:09.157626+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:00:10.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[42377]: audit 2021-07-26T16:00:09.158359+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:00:10.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[42377]: audit 2021-07-26T16:00:09.192311+0000 mon.c (mon.1) 62 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:00:10.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[42377]: audit 2021-07-26T16:00:09.192981+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:00:10.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[42377]: audit 2021-07-26T16:00:09.328124+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[42377]: audit 2021-07-26T16:00:09.953058+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:10.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[41341]: cluster 2021-07-26T16:00:08.983730+0000 mgr.y (mgr.34104) 121 : cluster [DBG] pgmap v167: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 106 KiB/s wr, 1 op/s; 1.5 MiB/s, 0 objects/s recovering 2021-07-26T16:00:10.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[41341]: audit 2021-07-26T16:00:09.157626+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:00:10.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[41341]: audit 2021-07-26T16:00:09.158359+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:00:10.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[41341]: audit 2021-07-26T16:00:09.192311+0000 mon.c (mon.1) 62 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:00:10.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[41341]: audit 2021-07-26T16:00:09.192981+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:00:10.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[41341]: audit 2021-07-26T16:00:09.328124+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:10.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:10 smithi033 bash[41341]: audit 2021-07-26T16:00:09.953058+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:10.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:10 smithi096 bash[33981]: cluster 2021-07-26T16:00:08.983730+0000 mgr.y (mgr.34104) 121 : cluster [DBG] pgmap v167: 25 pgs: 4 active+clean+wait, 21 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 4.1 MiB/s rd, 106 KiB/s wr, 1 op/s; 1.5 MiB/s, 0 objects/s recovering 2021-07-26T16:00:10.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:10 smithi096 bash[33981]: audit 2021-07-26T16:00:09.157626+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:00:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:10 smithi096 bash[33981]: audit 2021-07-26T16:00:09.158359+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:00:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:10 smithi096 bash[33981]: audit 2021-07-26T16:00:09.192311+0000 mon.c (mon.1) 62 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:00:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:10 smithi096 bash[33981]: audit 2021-07-26T16:00:09.192981+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:00:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:10 smithi096 bash[33981]: audit 2021-07-26T16:00:09.328124+0000 mon.a (mon.0) 302 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:10 smithi096 bash[33981]: audit 2021-07-26T16:00:09.953058+0000 mon.a (mon.0) 303 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:11.027 INFO:tasks.rados.rados.0.smithi033.stdout:1011: done (2 left) 2021-07-26T16:00:11.027 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 100 2021-07-26T16:00:11.027 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 406 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T16:00:11.028 INFO:tasks.rados.rados.0.smithi033.stdout:1009: expect (ObjNum 257 snap 77 seq_num 257) 2021-07-26T16:00:11.086 INFO:tasks.rados.rados.0.smithi033.stdout:1012: seq_num 316 ranges {344064=499712} 2021-07-26T16:00:11.096 INFO:tasks.rados.rados.0.smithi033.stdout:1012: writing smithi03339061-13 from 344064 to 843776 tid 1 2021-07-26T16:00:11.097 INFO:tasks.rados.rados.0.smithi033.stdout:1007: done (2 left) 2021-07-26T16:00:11.097 INFO:tasks.rados.rados.0.smithi033.stdout:1009: done (1 left) 2021-07-26T16:00:11.097 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 100 2021-07-26T16:00:11.097 INFO:tasks.rados.rados.0.smithi033.stdout:1013: seq_num 317 ranges {10510336=516096} 2021-07-26T16:00:11.161 INFO:tasks.rados.rados.0.smithi033.stdout:1013: writing smithi03339061-30 from 10510336 to 11026432 tid 1 2021-07-26T16:00:11.161 INFO:tasks.rados.rados.0.smithi033.stdout:1014: copy_from oid 22 from oid 1 current snap is 100 2021-07-26T16:00:11.162 INFO:tasks.rados.rados.0.smithi033.stdout:1012: finishing write tid 1 to smithi03339061-13 2021-07-26T16:00:11.162 INFO:tasks.rados.rados.0.smithi033.stdout:1015: snap_remove snap 98 2021-07-26T16:00:11.296 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:11 smithi033 bash[41341]: cephadm 2021-07-26T16:00:09.942094+0000 mgr.y (mgr.34104) 122 : cephadm [INF] Upgrade: Updating osd.2 2021-07-26T16:00:11.296 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:11 smithi033 bash[41341]: cephadm 2021-07-26T16:00:09.955609+0000 mgr.y (mgr.34104) 123 : cephadm [INF] Deploying daemon osd.2 on smithi033 2021-07-26T16:00:11.297 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:11 smithi033 bash[42377]: cephadm 2021-07-26T16:00:09.942094+0000 mgr.y (mgr.34104) 122 : cephadm [INF] Upgrade: Updating osd.2 2021-07-26T16:00:11.297 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:11 smithi033 bash[42377]: cephadm 2021-07-26T16:00:09.955609+0000 mgr.y (mgr.34104) 123 : cephadm [INF] Deploying daemon osd.2 on smithi033 2021-07-26T16:00:11.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:11 smithi096 bash[33981]: cephadm 2021-07-26T16:00:09.942094+0000 mgr.y (mgr.34104) 122 : cephadm [INF] Upgrade: Updating osd.2 2021-07-26T16:00:11.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:11 smithi096 bash[33981]: cephadm 2021-07-26T16:00:09.955609+0000 mgr.y (mgr.34104) 123 : cephadm [INF] Deploying daemon osd.2 on smithi033 2021-07-26T16:00:12.040 INFO:tasks.rados.rados.0.smithi033.stdout:1015: done (3 left) 2021-07-26T16:00:12.040 INFO:tasks.rados.rados.0.smithi033.stdout:1016: read oid 48 snap 76 2021-07-26T16:00:12.041 INFO:tasks.rados.rados.0.smithi033.stdout:1016: expect deleted 2021-07-26T16:00:12.041 INFO:tasks.rados.rados.0.smithi033.stdout:1017: snap_remove snap 96 2021-07-26T16:00:12.331 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:12 smithi033 bash[41341]: cluster 2021-07-26T16:00:10.984526+0000 mgr.y (mgr.34104) 124 : cluster [DBG] pgmap v168: 25 pgs: 25 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 41 KiB/s wr, 0 op/s 2021-07-26T16:00:12.331 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:12 smithi033 bash[41341]: cluster 2021-07-26T16:00:11.024166+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-07-26T16:00:12.332 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:12 smithi033 bash[42377]: cluster 2021-07-26T16:00:10.984526+0000 mgr.y (mgr.34104) 124 : cluster [DBG] pgmap v168: 25 pgs: 25 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 41 KiB/s wr, 0 op/s 2021-07-26T16:00:12.332 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:12 smithi033 bash[42377]: cluster 2021-07-26T16:00:11.024166+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-07-26T16:00:12.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:12 smithi096 bash[33981]: cluster 2021-07-26T16:00:10.984526+0000 mgr.y (mgr.34104) 124 : cluster [DBG] pgmap v168: 25 pgs: 25 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 41 KiB/s wr, 0 op/s 2021-07-26T16:00:12.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:12 smithi096 bash[33981]: cluster 2021-07-26T16:00:11.024166+0000 mon.a (mon.0) 304 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-07-26T16:00:12.656 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:12 smithi033 systemd[1]: Stopping Ceph osd.2 for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T16:00:12.657 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:12 smithi033 docker[46602]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:00:12.657 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:12 smithi033 bash[27012]: debug 2021-07-26T16:00:12.568+0000 7f167145e700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-07-26T16:00:12.657 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:12 smithi033 bash[27012]: debug 2021-07-26T16:00:12.568+0000 7f167145e700 -1 osd.2 252 *** Got signal Terminated *** 2021-07-26T16:00:12.657 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:12 smithi033 bash[27012]: debug 2021-07-26T16:00:12.568+0000 7f167145e700 -1 osd.2 252 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:00:13.052 INFO:tasks.rados.rados.0.smithi033.stdout:1017: done (4 left) 2021-07-26T16:00:13.053 INFO:tasks.rados.rados.0.smithi033.stdout:1018: copy_from oid 33 from oid 17 current snap is 100 2021-07-26T16:00:13.053 INFO:tasks.rados.rados.0.smithi033.stdout:1012: finishing write tid 2 to smithi03339061-13 2021-07-26T16:00:13.053 INFO:tasks.rados.rados.0.smithi033.stdout:1012: finishing write tid 3 to smithi03339061-13 2021-07-26T16:00:13.053 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 464 (ObjNum 316 snap 100 seq_num 316) dirty exists 2021-07-26T16:00:13.054 INFO:tasks.rados.rados.0.smithi033.stdout:1012: left oid 13 (ObjNum 316 snap 100 seq_num 316) 2021-07-26T16:00:13.054 INFO:tasks.rados.rados.0.smithi033.stdout:1014: finishing copy_from to smithi03339061-22 2021-07-26T16:00:13.055 INFO:tasks.rados.rados.0.smithi033.stdout:1014: got expected ENOENT (src dne) 2021-07-26T16:00:13.055 INFO:tasks.rados.rados.0.smithi033.stdout:1014: finishing copy_from racing read to smithi03339061-22 2021-07-26T16:00:13.056 INFO:tasks.rados.rados.0.smithi033.stdout:1013: finishing write tid 1 to smithi03339061-30 2021-07-26T16:00:13.056 INFO:tasks.rados.rados.0.smithi033.stdout:1013: finishing write tid 2 to smithi03339061-30 2021-07-26T16:00:13.056 INFO:tasks.rados.rados.0.smithi033.stdout:1013: finishing write tid 3 to smithi03339061-30 2021-07-26T16:00:13.056 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 379 (ObjNum 317 snap 100 seq_num 317) dirty exists 2021-07-26T16:00:13.057 INFO:tasks.rados.rados.0.smithi033.stdout:1013: left oid 30 (ObjNum 317 snap 100 seq_num 317) 2021-07-26T16:00:13.057 INFO:tasks.rados.rados.0.smithi033.stdout:1012: done (4 left) 2021-07-26T16:00:13.057 INFO:tasks.rados.rados.0.smithi033.stdout:1013: done (3 left) 2021-07-26T16:00:13.057 INFO:tasks.rados.rados.0.smithi033.stdout:1014: done (2 left) 2021-07-26T16:00:13.057 INFO:tasks.rados.rados.0.smithi033.stdout:1016: done (1 left) 2021-07-26T16:00:13.058 INFO:tasks.rados.rados.0.smithi033.stdout:1019: read oid 25 snap -1 2021-07-26T16:00:13.058 INFO:tasks.rados.rados.0.smithi033.stdout:1019: expect (ObjNum 234 snap 66 seq_num 234) 2021-07-26T16:00:13.058 INFO:tasks.rados.rados.0.smithi033.stdout:1020: delete oid 49 current snap is 100 2021-07-26T16:00:13.059 INFO:tasks.rados.rados.0.smithi033.stdout:1020: done (2 left) 2021-07-26T16:00:13.059 INFO:tasks.rados.rados.0.smithi033.stdout:1021: delete oid 23 current snap is 100 2021-07-26T16:00:13.065 INFO:tasks.rados.rados.0.smithi033.stdout:1019: expect (ObjNum 234 snap 66 seq_num 234) 2021-07-26T16:00:13.106 INFO:tasks.rados.rados.0.smithi033.stdout:1019: done (2 left) 2021-07-26T16:00:13.106 INFO:tasks.rados.rados.0.smithi033.stdout:1021: done (1 left) 2021-07-26T16:00:13.106 INFO:tasks.rados.rados.0.smithi033.stdout:1022: snap_create 2021-07-26T16:00:13.391 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.034814+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-07-26T16:00:13.391 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.840615+0000 mon.a (mon.0) 306 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-07-26T16:00:13.391 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.840752+0000 mon.a (mon.0) 307 : cluster [INF] osd.2 failed (root=default,host=smithi033) (connection refused reported by osd.1) 2021-07-26T16:00:13.392 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.841147+0000 mon.a (mon.0) 308 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-07-26T16:00:13.392 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.841476+0000 mon.a (mon.0) 309 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-07-26T16:00:13.392 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.841704+0000 mon.a (mon.0) 310 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-07-26T16:00:13.392 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.841969+0000 mon.a (mon.0) 311 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-07-26T16:00:13.392 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.842191+0000 mon.a (mon.0) 312 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-07-26T16:00:13.393 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.842430+0000 mon.a (mon.0) 313 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-07-26T16:00:13.393 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.842735+0000 mon.a (mon.0) 314 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-07-26T16:00:13.393 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.842960+0000 mon.a (mon.0) 315 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-07-26T16:00:13.393 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.843209+0000 mon.a (mon.0) 316 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-07-26T16:00:13.393 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.843423+0000 mon.a (mon.0) 317 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-07-26T16:00:13.394 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.843675+0000 mon.a (mon.0) 318 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-07-26T16:00:13.394 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.843976+0000 mon.a (mon.0) 319 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-07-26T16:00:13.394 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.844262+0000 mon.a (mon.0) 320 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-07-26T16:00:13.395 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.981265+0000 mon.a (mon.0) 321 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-07-26T16:00:13.395 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.034814+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-07-26T16:00:13.395 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.840615+0000 mon.a (mon.0) 306 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-07-26T16:00:13.396 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.840752+0000 mon.a (mon.0) 307 : cluster [INF] osd.2 failed (root=default,host=smithi033) (connection refused reported by osd.1) 2021-07-26T16:00:13.396 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.841147+0000 mon.a (mon.0) 308 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-07-26T16:00:13.396 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.841476+0000 mon.a (mon.0) 309 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-07-26T16:00:13.396 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.841704+0000 mon.a (mon.0) 310 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-07-26T16:00:13.396 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.841969+0000 mon.a (mon.0) 311 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-07-26T16:00:13.397 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.842191+0000 mon.a (mon.0) 312 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-07-26T16:00:13.397 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.842430+0000 mon.a (mon.0) 313 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-07-26T16:00:13.397 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.842735+0000 mon.a (mon.0) 314 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-07-26T16:00:13.397 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.842960+0000 mon.a (mon.0) 315 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-07-26T16:00:13.397 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.843209+0000 mon.a (mon.0) 316 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-07-26T16:00:13.398 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.843423+0000 mon.a (mon.0) 317 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-07-26T16:00:13.398 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.843675+0000 mon.a (mon.0) 318 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-07-26T16:00:13.398 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.843976+0000 mon.a (mon.0) 319 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-07-26T16:00:13.398 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.844262+0000 mon.a (mon.0) 320 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-07-26T16:00:13.399 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.981265+0000 mon.a (mon.0) 321 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-07-26T16:00:13.399 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:13 smithi033 docker[46602]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-osd.2 2021-07-26T16:00:13.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.034814+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-07-26T16:00:13.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.840615+0000 mon.a (mon.0) 306 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-07-26T16:00:13.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.840752+0000 mon.a (mon.0) 307 : cluster [INF] osd.2 failed (root=default,host=smithi033) (connection refused reported by osd.1) 2021-07-26T16:00:13.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.841147+0000 mon.a (mon.0) 308 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-07-26T16:00:13.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.841476+0000 mon.a (mon.0) 309 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-07-26T16:00:13.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.841704+0000 mon.a (mon.0) 310 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-07-26T16:00:13.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.841969+0000 mon.a (mon.0) 311 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-07-26T16:00:13.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.842191+0000 mon.a (mon.0) 312 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-07-26T16:00:13.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.842430+0000 mon.a (mon.0) 313 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-07-26T16:00:13.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.842735+0000 mon.a (mon.0) 314 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-07-26T16:00:13.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.842960+0000 mon.a (mon.0) 315 : cluster [DBG] osd.2 reported immediately failed by osd.6 2021-07-26T16:00:13.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.843209+0000 mon.a (mon.0) 316 : cluster [DBG] osd.2 reported immediately failed by osd.7 2021-07-26T16:00:13.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.843423+0000 mon.a (mon.0) 317 : cluster [DBG] osd.2 reported immediately failed by osd.4 2021-07-26T16:00:13.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.843675+0000 mon.a (mon.0) 318 : cluster [DBG] osd.2 reported immediately failed by osd.5 2021-07-26T16:00:13.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.843976+0000 mon.a (mon.0) 319 : cluster [DBG] osd.2 reported immediately failed by osd.3 2021-07-26T16:00:13.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.844262+0000 mon.a (mon.0) 320 : cluster [DBG] osd.2 reported immediately failed by osd.0 2021-07-26T16:00:13.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:13 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.981265+0000 mon.a (mon.0) 321 : cluster [DBG] osd.2 reported immediately failed by osd.1 2021-07-26T16:00:13.708 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[46642]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:00:13.709 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:13.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:13.709 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:13.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:13.710 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:13 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:13.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:00:14.063 INFO:tasks.rados.rados.0.smithi033.stdout:1022: done (1 left) 2021-07-26T16:00:14.064 INFO:tasks.rados.rados.0.smithi033.stdout:1023: rmattr oid 28 current snap is 101 2021-07-26T16:00:14.064 INFO:tasks.rados.rados.0.smithi033.stdout:1023: done (1 left) 2021-07-26T16:00:14.064 INFO:tasks.rados.rados.0.smithi033.stdout:1024: rollback oid 30 current snap is 101 2021-07-26T16:00:14.064 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 30 to 81 2021-07-26T16:00:14.065 INFO:tasks.rados.rados.0.smithi033.stdout:1025: snap_remove snap 92 2021-07-26T16:00:14.393 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T16:00:14.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:14 smithi033 bash[42377]: cluster 2021-07-26T16:00:12.985310+0000 mgr.y (mgr.34104) 125 : cluster [DBG] pgmap v171: 25 pgs: 25 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 145 B/s rd, 58 KiB/s wr, 0 op/s 2021-07-26T16:00:14.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:14 smithi033 bash[42377]: cluster 2021-07-26T16:00:13.032519+0000 mon.a (mon.0) 322 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:00:14.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:14 smithi033 bash[42377]: cluster 2021-07-26T16:00:13.049363+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e253: 8 total, 7 up, 8 in 2021-07-26T16:00:14.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:14 smithi033 bash[41341]: cluster 2021-07-26T16:00:12.985310+0000 mgr.y (mgr.34104) 125 : cluster [DBG] pgmap v171: 25 pgs: 25 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 145 B/s rd, 58 KiB/s wr, 0 op/s 2021-07-26T16:00:14.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:14 smithi033 bash[41341]: cluster 2021-07-26T16:00:13.032519+0000 mon.a (mon.0) 322 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:00:14.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:14 smithi033 bash[41341]: cluster 2021-07-26T16:00:13.049363+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e253: 8 total, 7 up, 8 in 2021-07-26T16:00:14.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:14 smithi096 bash[33981]: cluster 2021-07-26T16:00:12.985310+0000 mgr.y (mgr.34104) 125 : cluster [DBG] pgmap v171: 25 pgs: 25 active+clean; 163 MiB data, 605 MiB used, 715 GiB / 715 GiB avail; 145 B/s rd, 58 KiB/s wr, 0 op/s 2021-07-26T16:00:14.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:14 smithi096 bash[33981]: cluster 2021-07-26T16:00:13.032519+0000 mon.a (mon.0) 322 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:00:14.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:14 smithi096 bash[33981]: cluster 2021-07-26T16:00:13.049363+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e253: 8 total, 7 up, 8 in 2021-07-26T16:00:14.729 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T16:00:14.729 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (6m) 22s ago 7m 15.0M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T16:00:14.730 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (6m) 93s ago 6m 25.5M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T16:00:14.730 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (2m) 93s ago 11m 372M - 17.0.0-6381-gbccf07c2 6cdb40438e66 909ec99bd712 2021-07-26T16:00:14.731 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (2m) 22s ago 13m 415M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T16:00:14.732 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (2m) 22s ago 14m 47.1M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 7649338580a7 2021-07-26T16:00:14.732 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (100s) 93s ago 11m 21.0M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 5a3d2fea4cb3 2021-07-26T16:00:14.732 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (113s) 22s ago 11m 38.4M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 76ce8786552e 2021-07-26T16:00:14.733 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (7m) 22s ago 7m 11.0M - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T16:00:14.733 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (7m) 93s ago 7m 11.3M - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T16:00:14.734 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (53s) 22s ago 11m 94.2M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 7275343c45f7 2021-07-26T16:00:14.734 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (24s) 22s ago 10m - 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 778afc05022e 2021-07-26T16:00:14.735 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (10m) 22s ago 10m 94.8M 3553M 16.2.5 34f74fddb18e d351359286fd 2021-07-26T16:00:14.735 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (9m) 22s ago 9m 180M 3553M 16.2.5 34f74fddb18e 6b68e9927be6 2021-07-26T16:00:14.735 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (9m) 93s ago 9m 88.5M 3552M 16.2.5 34f74fddb18e 1aac82d5671e 2021-07-26T16:00:14.736 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (8m) 93s ago 8m 83.8M 3552M 16.2.5 34f74fddb18e 12b89782c2eb 2021-07-26T16:00:14.736 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (8m) 93s ago 8m 74.8M 3552M 16.2.5 34f74fddb18e 4fad5a8407d4 2021-07-26T16:00:14.737 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (8m) 93s ago 8m 70.1M 3552M 16.2.5 34f74fddb18e a988c60ad3d5 2021-07-26T16:00:14.737 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (6m) 93s ago 7m 38.1M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T16:00:15.072 INFO:tasks.rados.rados.0.smithi033.stdout:1025: done (2 left) 2021-07-26T16:00:15.072 INFO:tasks.rados.rados.0.smithi033.stdout:1026: snap_create 2021-07-26T16:00:15.072 INFO:tasks.rados.rados.0.smithi033.stdout:1024: finishing rollback tid 0 to smithi03339061-30 2021-07-26T16:00:15.072 INFO:tasks.rados.rados.0.smithi033.stdout:1024: finishing rollback tid 1 to smithi03339061-30 2021-07-26T16:00:15.073 INFO:tasks.rados.rados.0.smithi033.stdout:1024: finishing rollback tid 2 to smithi03339061-30 2021-07-26T16:00:15.073 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 387 (ObjNum 249 snap 71 seq_num 249) dirty exists 2021-07-26T16:00:15.073 INFO:tasks.rados.rados.0.smithi033.stdout:1018: finishing copy_from to smithi03339061-33 2021-07-26T16:00:15.073 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 198 (ObjNum 295 snap 91 seq_num 295) dirty exists 2021-07-26T16:00:15.074 INFO:tasks.rados.rados.0.smithi033.stdout:1018: finishing copy_from racing read to smithi03339061-33 2021-07-26T16:00:15.136 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T16:00:15.137 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T16:00:15.137 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T16:00:15.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:00:15.137 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T16:00:15.138 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T16:00:15.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:00:15.138 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T16:00:15.138 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 5, 2021-07-26T16:00:15.138 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T16:00:15.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:00:15.139 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T16:00:15.139 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T16:00:15.139 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 5, 2021-07-26T16:00:15.140 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 7 2021-07-26T16:00:15.140 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T16:00:15.140 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T16:00:15.422 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:15 smithi033 bash[41341]: cluster 2021-07-26T16:00:14.058548+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e254: 8 total, 7 up, 8 in 2021-07-26T16:00:15.422 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:15 smithi033 bash[41341]: audit 2021-07-26T16:00:14.375464+0000 mgr.y (mgr.34104) 126 : audit [DBG] from='client.44167 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:15.423 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:15 smithi033 bash[42377]: cluster 2021-07-26T16:00:14.058548+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e254: 8 total, 7 up, 8 in 2021-07-26T16:00:15.423 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:15 smithi033 bash[42377]: audit 2021-07-26T16:00:14.375464+0000 mgr.y (mgr.34104) 126 : audit [DBG] from='client.44167 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:15.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:15 smithi096 bash[33981]: cluster 2021-07-26T16:00:14.058548+0000 mon.a (mon.0) 324 : cluster [DBG] osdmap e254: 8 total, 7 up, 8 in 2021-07-26T16:00:15.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:15 smithi096 bash[33981]: audit 2021-07-26T16:00:14.375464+0000 mgr.y (mgr.34104) 126 : audit [DBG] from='client.44167 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:16.082 INFO:tasks.rados.rados.0.smithi033.stdout:1018: done (2 left) 2021-07-26T16:00:16.083 INFO:tasks.rados.rados.0.smithi033.stdout:1024: done (1 left) 2021-07-26T16:00:16.083 INFO:tasks.rados.rados.0.smithi033.stdout:1026: done (0 left) 2021-07-26T16:00:16.083 INFO:tasks.rados.rados.0.smithi033.stdout:1027: copy_from oid 23 from oid 38 current snap is 102 2021-07-26T16:00:16.083 INFO:tasks.rados.rados.0.smithi033.stdout:1028: snap_remove snap 90 2021-07-26T16:00:16.290 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:16 smithi033 bash[41341]: audit 2021-07-26T16:00:14.704819+0000 mgr.y (mgr.34104) 127 : audit [DBG] from='client.44173 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:16.291 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:16 smithi033 bash[41341]: cluster 2021-07-26T16:00:14.986185+0000 mgr.y (mgr.34104) 128 : cluster [DBG] pgmap v174: 25 pgs: 2 active+undersized+degraded, 3 active+undersized, 20 active+clean; 177 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 6.8 MiB/s rd, 932 KiB/s wr, 11 op/s; 11/351 objects degraded (3.134%) 2021-07-26T16:00:16.291 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:16 smithi033 bash[41341]: cluster 2021-07-26T16:00:15.054202+0000 mon.a (mon.0) 325 : cluster [WRN] Health check failed: Degraded data redundancy: 11/351 objects degraded (3.134%), 2 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:16.291 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:16 smithi033 bash[41341]: cluster 2021-07-26T16:00:15.066534+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e255: 8 total, 7 up, 8 in 2021-07-26T16:00:16.292 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:16 smithi033 bash[41341]: audit 2021-07-26T16:00:15.133825+0000 mon.a (mon.0) 327 : audit [DBG] from='client.? 172.21.15.33:0/827970025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:16.292 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:16 smithi033 bash[42377]: audit 2021-07-26T16:00:14.704819+0000 mgr.y (mgr.34104) 127 : audit [DBG] from='client.44173 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:16.292 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:16 smithi033 bash[42377]: cluster 2021-07-26T16:00:14.986185+0000 mgr.y (mgr.34104) 128 : cluster [DBG] pgmap v174: 25 pgs: 2 active+undersized+degraded, 3 active+undersized, 20 active+clean; 177 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 6.8 MiB/s rd, 932 KiB/s wr, 11 op/s; 11/351 objects degraded (3.134%) 2021-07-26T16:00:16.293 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:16 smithi033 bash[42377]: cluster 2021-07-26T16:00:15.054202+0000 mon.a (mon.0) 325 : cluster [WRN] Health check failed: Degraded data redundancy: 11/351 objects degraded (3.134%), 2 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:16.293 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:16 smithi033 bash[42377]: cluster 2021-07-26T16:00:15.066534+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e255: 8 total, 7 up, 8 in 2021-07-26T16:00:16.294 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:16 smithi033 bash[42377]: audit 2021-07-26T16:00:15.133825+0000 mon.a (mon.0) 327 : audit [DBG] from='client.? 172.21.15.33:0/827970025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:16.294 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:15 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.2.service: Succeeded. 2021-07-26T16:00:16.295 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:15 smithi033 systemd[1]: Stopped Ceph osd.2 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:00:16.295 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:16 smithi033 systemd[1]: Started Ceph osd.2 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:00:16.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:16 smithi096 bash[33981]: audit 2021-07-26T16:00:14.704819+0000 mgr.y (mgr.34104) 127 : audit [DBG] from='client.44173 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:16.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:16 smithi096 bash[33981]: cluster 2021-07-26T16:00:14.986185+0000 mgr.y (mgr.34104) 128 : cluster [DBG] pgmap v174: 25 pgs: 2 active+undersized+degraded, 3 active+undersized, 20 active+clean; 177 MiB data, 624 MiB used, 715 GiB / 715 GiB avail; 6.8 MiB/s rd, 932 KiB/s wr, 11 op/s; 11/351 objects degraded (3.134%) 2021-07-26T16:00:16.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:16 smithi096 bash[33981]: cluster 2021-07-26T16:00:15.054202+0000 mon.a (mon.0) 325 : cluster [WRN] Health check failed: Degraded data redundancy: 11/351 objects degraded (3.134%), 2 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:16.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:16 smithi096 bash[33981]: cluster 2021-07-26T16:00:15.066534+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e255: 8 total, 7 up, 8 in 2021-07-26T16:00:16.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:16 smithi096 bash[33981]: audit 2021-07-26T16:00:15.133825+0000 mon.a (mon.0) 327 : audit [DBG] from='client.? 172.21.15.33:0/827970025' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:16.708 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:16 smithi033 bash[46837]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:00:17.089 INFO:tasks.rados.rados.0.smithi033.stdout:1028: done (1 left) 2021-07-26T16:00:17.089 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 102 2021-07-26T16:00:17.090 INFO:tasks.rados.rados.0.smithi033.stdout:1027: finishing copy_from to smithi03339061-23 2021-07-26T16:00:17.090 INFO:tasks.rados.rados.0.smithi033.stdout:1027: got expected ENOENT (src dne) 2021-07-26T16:00:17.090 INFO:tasks.rados.rados.0.smithi033.stdout:1027: finishing copy_from racing read to smithi03339061-23 2021-07-26T16:00:17.090 INFO:tasks.rados.rados.0.smithi033.stdout:1029: seq_num 320 ranges {1916928=565248} 2021-07-26T16:00:17.107 INFO:tasks.rados.rados.0.smithi033.stdout:1029: writing smithi03339061-12 from 1916928 to 2482176 tid 1 2021-07-26T16:00:17.107 INFO:tasks.rados.rados.0.smithi033.stdout:1027: done (1 left) 2021-07-26T16:00:17.107 INFO:tasks.rados.rados.0.smithi033.stdout:1030: copy_from oid 2 from oid 28 current snap is 102 2021-07-26T16:00:17.107 INFO:tasks.rados.rados.0.smithi033.stdout:1031: rmattr oid 15 current snap is 102 2021-07-26T16:00:17.108 INFO:tasks.rados.rados.0.smithi033.stdout:1031: done (2 left) 2021-07-26T16:00:17.108 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 102 2021-07-26T16:00:17.108 INFO:tasks.rados.rados.0.smithi033.stdout:1032: seq_num 321 ranges {7585792=581632} 2021-07-26T16:00:17.154 INFO:tasks.rados.rados.0.smithi033.stdout:1032: writing smithi03339061-27 from 7585792 to 8167424 tid 1 2021-07-26T16:00:17.155 INFO:tasks.rados.rados.0.smithi033.stdout:1033: snap_create 2021-07-26T16:00:17.155 INFO:tasks.rados.rados.0.smithi033.stdout:1029: finishing write tid 1 to smithi03339061-12 2021-07-26T16:00:17.155 INFO:tasks.rados.rados.0.smithi033.stdout:1029: finishing write tid 2 to smithi03339061-12 2021-07-26T16:00:17.155 INFO:tasks.rados.rados.0.smithi033.stdout:1029: finishing write tid 3 to smithi03339061-12 2021-07-26T16:00:17.156 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 236 (ObjNum 320 snap 102 seq_num 320) dirty exists 2021-07-26T16:00:17.156 INFO:tasks.rados.rados.0.smithi033.stdout:1029: left oid 12 (ObjNum 320 snap 102 seq_num 320) 2021-07-26T16:00:17.156 INFO:tasks.rados.rados.0.smithi033.stdout:1030: finishing copy_from to smithi03339061-2 2021-07-26T16:00:17.156 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 215 (ObjNum 268 snap 82 seq_num 268) dirty exists 2021-07-26T16:00:17.157 INFO:tasks.rados.rados.0.smithi033.stdout:1030: finishing copy_from racing read to smithi03339061-2 2021-07-26T16:00:17.161 INFO:tasks.rados.rados.0.smithi033.stdout:1032: finishing write tid 1 to smithi03339061-27 2021-07-26T16:00:17.162 INFO:tasks.rados.rados.0.smithi033.stdout:1032: finishing write tid 2 to smithi03339061-27 2021-07-26T16:00:17.164 INFO:tasks.rados.rados.0.smithi033.stdout:1032: finishing write tid 3 to smithi03339061-27 2021-07-26T16:00:17.164 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 450 (ObjNum 321 snap 102 seq_num 321) dirty exists 2021-07-26T16:00:17.164 INFO:tasks.rados.rados.0.smithi033.stdout:1032: left oid 27 (ObjNum 321 snap 102 seq_num 321) 2021-07-26T16:00:17.403 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[42377]: cluster 2021-07-26T16:00:16.079252+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e256: 8 total, 7 up, 8 in 2021-07-26T16:00:17.403 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[42377]: audit 2021-07-26T16:00:16.240689+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:17.403 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[42377]: audit 2021-07-26T16:00:16.242764+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:17.404 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[42377]: audit 2021-07-26T16:00:16.245227+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:00:17.404 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[42377]: audit 2021-07-26T16:00:16.246971+0000 mon.c (mon.1) 65 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:00:17.404 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[41341]: cluster 2021-07-26T16:00:16.079252+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e256: 8 total, 7 up, 8 in 2021-07-26T16:00:17.405 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[41341]: audit 2021-07-26T16:00:16.240689+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:17.405 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[41341]: audit 2021-07-26T16:00:16.242764+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:17.405 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[41341]: audit 2021-07-26T16:00:16.245227+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:00:17.405 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[41341]: audit 2021-07-26T16:00:16.246971+0000 mon.c (mon.1) 65 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:00:17.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:17 smithi096 bash[33981]: cluster 2021-07-26T16:00:16.079252+0000 mon.a (mon.0) 328 : cluster [DBG] osdmap e256: 8 total, 7 up, 8 in 2021-07-26T16:00:17.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:17 smithi096 bash[33981]: audit 2021-07-26T16:00:16.240689+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:17.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:17 smithi096 bash[33981]: audit 2021-07-26T16:00:16.242764+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:17.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:17 smithi096 bash[33981]: audit 2021-07-26T16:00:16.245227+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:00:17.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:17 smithi096 bash[33981]: audit 2021-07-26T16:00:16.246971+0000 mon.c (mon.1) 65 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:00:18.093 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[46837]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-07-26T16:00:18.093 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[46837]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-07-26T16:00:18.093 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[46837]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-07-26T16:00:18.093 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[46837]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-07-26T16:00:18.094 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[46837]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-07-26T16:00:18.094 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[46837]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-07-26T16:00:18.094 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:17 smithi033 bash[46837]: --> ceph-volume lvm activate successful for osd ID: 2 2021-07-26T16:00:18.113 INFO:tasks.rados.rados.0.smithi033.stdout:1029: done (3 left) 2021-07-26T16:00:18.114 INFO:tasks.rados.rados.0.smithi033.stdout:1030: done (2 left) 2021-07-26T16:00:18.115 INFO:tasks.rados.rados.0.smithi033.stdout:1032: done (1 left) 2021-07-26T16:00:18.115 INFO:tasks.rados.rados.0.smithi033.stdout:1033: done (0 left) 2021-07-26T16:00:18.115 INFO:tasks.rados.rados.0.smithi033.stdout:1034: rollback oid 26 current snap is 103 2021-07-26T16:00:18.116 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 26 to 88 2021-07-26T16:00:18.116 INFO:tasks.rados.rados.0.smithi033.stdout:1035: copy_from oid 48 from oid 14 current snap is 103 2021-07-26T16:00:18.116 INFO:tasks.rados.rados.0.smithi033.stdout:1036: snap_create 2021-07-26T16:00:18.121 INFO:tasks.rados.rados.0.smithi033.stdout:1035: finishing copy_from to smithi03339061-48 2021-07-26T16:00:18.121 INFO:tasks.rados.rados.0.smithi033.stdout:1035: got expected ENOENT (src dne) 2021-07-26T16:00:18.122 INFO:tasks.rados.rados.0.smithi033.stdout:1035: finishing copy_from racing read to smithi03339061-48 2021-07-26T16:00:18.122 INFO:tasks.rados.rados.0.smithi033.stdout:1034: finishing rollback tid 0 to smithi03339061-26 2021-07-26T16:00:18.123 INFO:tasks.rados.rados.0.smithi033.stdout:1034: finishing rollback tid 1 to smithi03339061-26 2021-07-26T16:00:18.123 INFO:tasks.rados.rados.0.smithi033.stdout:1034: finishing rollback tid 2 to smithi03339061-26 2021-07-26T16:00:18.123 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 578 (ObjNum 232 snap 65 seq_num 232) dirty exists 2021-07-26T16:00:18.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:18 smithi033 bash[41341]: cluster 2021-07-26T16:00:16.987020+0000 mgr.y (mgr.34104) 129 : cluster [DBG] pgmap v177: 25 pgs: 4 active+undersized+degraded, 3 active+undersized, 18 active+clean; 177 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.0 MiB/s wr, 12 op/s; 32/354 objects degraded (9.040%) 2021-07-26T16:00:18.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:18 smithi033 bash[41341]: cluster 2021-07-26T16:00:17.082014+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e257: 8 total, 7 up, 8 in 2021-07-26T16:00:18.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:18 smithi033 bash[42377]: cluster 2021-07-26T16:00:16.987020+0000 mgr.y (mgr.34104) 129 : cluster [DBG] pgmap v177: 25 pgs: 4 active+undersized+degraded, 3 active+undersized, 18 active+clean; 177 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.0 MiB/s wr, 12 op/s; 32/354 objects degraded (9.040%) 2021-07-26T16:00:18.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:18 smithi033 bash[42377]: cluster 2021-07-26T16:00:17.082014+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e257: 8 total, 7 up, 8 in 2021-07-26T16:00:18.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:18 smithi096 bash[33981]: cluster 2021-07-26T16:00:16.987020+0000 mgr.y (mgr.34104) 129 : cluster [DBG] pgmap v177: 25 pgs: 4 active+undersized+degraded, 3 active+undersized, 18 active+clean; 177 MiB data, 625 MiB used, 715 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.0 MiB/s wr, 12 op/s; 32/354 objects degraded (9.040%) 2021-07-26T16:00:18.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:18 smithi096 bash[33981]: cluster 2021-07-26T16:00:17.082014+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e257: 8 total, 7 up, 8 in 2021-07-26T16:00:19.111 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:18 smithi033 bash[46956]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:00:19.116 INFO:tasks.rados.rados.0.smithi033.stdout:1034: done (2 left) 2021-07-26T16:00:19.117 INFO:tasks.rados.rados.0.smithi033.stdout:1035: done (1 left) 2021-07-26T16:00:19.117 INFO:tasks.rados.rados.0.smithi033.stdout:1036: done (0 left) 2021-07-26T16:00:19.117 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 104 2021-07-26T16:00:19.117 INFO:tasks.rados.rados.0.smithi033.stdout:1037: seq_num 322 ranges {0=598016} 2021-07-26T16:00:19.121 INFO:tasks.rados.rados.0.smithi033.stdout:1037: writing smithi03339061-23 from 0 to 598016 tid 1 2021-07-26T16:00:19.121 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 104 2021-07-26T16:00:19.121 INFO:tasks.rados.rados.0.smithi033.stdout:1038: seq_num 323 ranges {2433024=614400} 2021-07-26T16:00:19.141 INFO:tasks.rados.rados.0.smithi033.stdout:1038: writing smithi03339061-36 from 2433024 to 3047424 tid 1 2021-07-26T16:00:19.141 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 104 2021-07-26T16:00:19.141 INFO:tasks.rados.rados.0.smithi033.stdout:1037: finishing write tid 1 to smithi03339061-23 2021-07-26T16:00:19.142 INFO:tasks.rados.rados.0.smithi033.stdout:1039: seq_num 324 ranges {2482176=630784} 2021-07-26T16:00:19.159 INFO:tasks.rados.rados.0.smithi033.stdout:1039: writing smithi03339061-12 from 2482176 to 3112960 tid 1 2021-07-26T16:00:19.159 INFO:tasks.rados.rados.0.smithi033.stdout:1040: snap_create 2021-07-26T16:00:19.160 INFO:tasks.rados.rados.0.smithi033.stdout:1037: finishing write tid 2 to smithi03339061-23 2021-07-26T16:00:19.160 INFO:tasks.rados.rados.0.smithi033.stdout:1037: finishing write tid 3 to smithi03339061-23 2021-07-26T16:00:19.160 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 452 (ObjNum 322 snap 104 seq_num 322) dirty exists 2021-07-26T16:00:19.161 INFO:tasks.rados.rados.0.smithi033.stdout:1037: left oid 23 (ObjNum 322 snap 104 seq_num 322) 2021-07-26T16:00:19.161 INFO:tasks.rados.rados.0.smithi033.stdout:1038: finishing write tid 1 to smithi03339061-36 2021-07-26T16:00:19.162 INFO:tasks.rados.rados.0.smithi033.stdout:1038: finishing write tid 2 to smithi03339061-36 2021-07-26T16:00:19.162 INFO:tasks.rados.rados.0.smithi033.stdout:1038: finishing write tid 3 to smithi03339061-36 2021-07-26T16:00:19.162 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 408 (ObjNum 323 snap 104 seq_num 323) dirty exists 2021-07-26T16:00:19.163 INFO:tasks.rados.rados.0.smithi033.stdout:1038: left oid 36 (ObjNum 323 snap 104 seq_num 323) 2021-07-26T16:00:19.163 INFO:tasks.rados.rados.0.smithi033.stdout:1039: finishing write tid 1 to smithi03339061-12 2021-07-26T16:00:19.164 INFO:tasks.rados.rados.0.smithi033.stdout:1039: finishing write tid 2 to smithi03339061-12 2021-07-26T16:00:19.167 INFO:tasks.rados.rados.0.smithi033.stdout:1039: finishing write tid 3 to smithi03339061-12 2021-07-26T16:00:19.167 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 241 (ObjNum 324 snap 104 seq_num 324) dirty exists 2021-07-26T16:00:19.168 INFO:tasks.rados.rados.0.smithi033.stdout:1039: left oid 12 (ObjNum 324 snap 104 seq_num 324) 2021-07-26T16:00:19.414 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:19 smithi033 bash[42377]: cluster 2021-07-26T16:00:18.109689+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e258: 8 total, 7 up, 8 in 2021-07-26T16:00:19.415 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:19 smithi033 bash[41341]: cluster 2021-07-26T16:00:18.109689+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e258: 8 total, 7 up, 8 in 2021-07-26T16:00:19.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:19 smithi096 bash[33981]: cluster 2021-07-26T16:00:18.109689+0000 mon.a (mon.0) 331 : cluster [DBG] osdmap e258: 8 total, 7 up, 8 in 2021-07-26T16:00:20.121 INFO:tasks.rados.rados.0.smithi033.stdout:1037: done (3 left) 2021-07-26T16:00:20.121 INFO:tasks.rados.rados.0.smithi033.stdout:1038: done (2 left) 2021-07-26T16:00:20.121 INFO:tasks.rados.rados.0.smithi033.stdout:1039: done (1 left) 2021-07-26T16:00:20.121 INFO:tasks.rados.rados.0.smithi033.stdout:1040: done (0 left) 2021-07-26T16:00:20.122 INFO:tasks.rados.rados.0.smithi033.stdout:1041: read oid 16 snap -1 2021-07-26T16:00:20.122 INFO:tasks.rados.rados.0.smithi033.stdout:1041: expect (ObjNum 244 snap 70 seq_num 244) 2021-07-26T16:00:20.122 INFO:tasks.rados.rados.0.smithi033.stdout:1042: read oid 47 snap -1 2021-07-26T16:00:20.122 INFO:tasks.rados.rados.0.smithi033.stdout:1042: expect (ObjNum 271 snap 83 seq_num 271) 2021-07-26T16:00:20.122 INFO:tasks.rados.rados.0.smithi033.stdout:1043: delete oid 7 current snap is 105 2021-07-26T16:00:20.136 INFO:tasks.rados.rados.0.smithi033.stdout:1043: done (2 left) 2021-07-26T16:00:20.136 INFO:tasks.rados.rados.0.smithi033.stdout:1044: snap_create 2021-07-26T16:00:20.149 INFO:tasks.rados.rados.0.smithi033.stdout:1042: expect (ObjNum 271 snap 83 seq_num 271) 2021-07-26T16:00:20.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:20 smithi033 bash[42377]: cluster 2021-07-26T16:00:18.987888+0000 mgr.y (mgr.34104) 130 : cluster [DBG] pgmap v180: 25 pgs: 4 active+undersized+degraded, 3 active+undersized, 18 active+clean; 177 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.1 MiB/s rd, 122 KiB/s wr, 1 op/s; 32/354 objects degraded (9.040%) 2021-07-26T16:00:20.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:20 smithi033 bash[42377]: cluster 2021-07-26T16:00:19.114002+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e259: 8 total, 7 up, 8 in 2021-07-26T16:00:20.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:20 smithi033 bash[41341]: cluster 2021-07-26T16:00:18.987888+0000 mgr.y (mgr.34104) 130 : cluster [DBG] pgmap v180: 25 pgs: 4 active+undersized+degraded, 3 active+undersized, 18 active+clean; 177 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.1 MiB/s rd, 122 KiB/s wr, 1 op/s; 32/354 objects degraded (9.040%) 2021-07-26T16:00:20.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:20 smithi033 bash[41341]: cluster 2021-07-26T16:00:19.114002+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e259: 8 total, 7 up, 8 in 2021-07-26T16:00:20.210 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:20 smithi033 bash[46956]: debug 2021-07-26T16:00:20.012+0000 7f13a8e79700 1 -- 172.21.15.33:0/3088501365 <== mon.1 v2:172.21.15.33:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557bdf0b0340 con 0x557bdf10a800 2021-07-26T16:00:20.303 INFO:tasks.rados.rados.0.smithi033.stdout:1041: expect (ObjNum 244 snap 70 seq_num 244) 2021-07-26T16:00:20.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:20 smithi096 bash[33981]: cluster 2021-07-26T16:00:18.987888+0000 mgr.y (mgr.34104) 130 : cluster [DBG] pgmap v180: 25 pgs: 4 active+undersized+degraded, 3 active+undersized, 18 active+clean; 177 MiB data, 628 MiB used, 715 GiB / 715 GiB avail; 1.1 MiB/s rd, 122 KiB/s wr, 1 op/s; 32/354 objects degraded (9.040%) 2021-07-26T16:00:20.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:20 smithi096 bash[33981]: cluster 2021-07-26T16:00:19.114002+0000 mon.a (mon.0) 332 : cluster [DBG] osdmap e259: 8 total, 7 up, 8 in 2021-07-26T16:00:20.568 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:20 smithi033 bash[46956]: debug 2021-07-26T16:00:20.560+0000 7f13b06cd0c0 -1 Falling back to public interface 2021-07-26T16:00:20.896 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 16:00:20 smithi033 bash[39943]: debug 2021-07-26T16:00:20.888+0000 7fa4db1f3700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:00:20.969 INFO:tasks.rados.rados.0.smithi033.stdout:1041: done (2 left) 2021-07-26T16:00:20.969 INFO:tasks.rados.rados.0.smithi033.stdout:1042: done (1 left) 2021-07-26T16:00:20.970 INFO:tasks.rados.rados.0.smithi033.stdout:1044: done (0 left) 2021-07-26T16:00:20.970 INFO:tasks.rados.rados.0.smithi033.stdout:1045: snap_remove snap 72 2021-07-26T16:00:21.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[41341]: cluster 2021-07-26T16:00:20.116234+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e260: 8 total, 7 up, 8 in 2021-07-26T16:00:21.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[41341]: audit 2021-07-26T16:00:20.865856+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:21.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[41341]: audit 2021-07-26T16:00:20.874122+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:21.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[41341]: audit 2021-07-26T16:00:20.884510+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:21.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[41341]: audit 2021-07-26T16:00:20.886222+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:21.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[41341]: audit 2021-07-26T16:00:20.888484+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:21.211 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[41341]: audit 2021-07-26T16:00:20.890293+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:21.211 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[41341]: audit 2021-07-26T16:00:20.892735+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:21.212 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[41341]: cluster 2021-07-26T16:00:20.956494+0000 mon.a (mon.0) 336 : cluster [WRN] Health check update: Degraded data redundancy: 32/354 objects degraded (9.040%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:21.212 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[41341]: cluster 2021-07-26T16:00:20.965803+0000 mon.a (mon.0) 337 : cluster [DBG] osdmap e261: 8 total, 7 up, 8 in 2021-07-26T16:00:21.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[42377]: cluster 2021-07-26T16:00:20.116234+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e260: 8 total, 7 up, 8 in 2021-07-26T16:00:21.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[42377]: audit 2021-07-26T16:00:20.865856+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:21.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[42377]: audit 2021-07-26T16:00:20.874122+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:21.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[42377]: audit 2021-07-26T16:00:20.884510+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:21.214 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[42377]: audit 2021-07-26T16:00:20.886222+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:21.214 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[42377]: audit 2021-07-26T16:00:20.888484+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:21.214 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[42377]: audit 2021-07-26T16:00:20.890293+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:21.214 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[42377]: audit 2021-07-26T16:00:20.892735+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:21.215 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[42377]: cluster 2021-07-26T16:00:20.956494+0000 mon.a (mon.0) 336 : cluster [WRN] Health check update: Degraded data redundancy: 32/354 objects degraded (9.040%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:21.215 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:21 smithi033 bash[42377]: cluster 2021-07-26T16:00:20.965803+0000 mon.a (mon.0) 337 : cluster [DBG] osdmap e261: 8 total, 7 up, 8 in 2021-07-26T16:00:21.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:21 smithi096 bash[33981]: cluster 2021-07-26T16:00:20.116234+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e260: 8 total, 7 up, 8 in 2021-07-26T16:00:21.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:21 smithi096 bash[33981]: audit 2021-07-26T16:00:20.865856+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:21.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:21 smithi096 bash[33981]: audit 2021-07-26T16:00:20.874122+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:21.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:21 smithi096 bash[33981]: audit 2021-07-26T16:00:20.884510+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:21.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:21 smithi096 bash[33981]: audit 2021-07-26T16:00:20.886222+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:21.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:21 smithi096 bash[33981]: audit 2021-07-26T16:00:20.888484+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:21.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:21 smithi096 bash[33981]: audit 2021-07-26T16:00:20.890293+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:21.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:21 smithi096 bash[33981]: audit 2021-07-26T16:00:20.892735+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:21.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:21 smithi096 bash[33981]: cluster 2021-07-26T16:00:20.956494+0000 mon.a (mon.0) 336 : cluster [WRN] Health check update: Degraded data redundancy: 32/354 objects degraded (9.040%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:21.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:21 smithi096 bash[33981]: cluster 2021-07-26T16:00:20.965803+0000 mon.a (mon.0) 337 : cluster [DBG] osdmap e261: 8 total, 7 up, 8 in 2021-07-26T16:00:21.988 INFO:tasks.rados.rados.0.smithi033.stdout:1045: done (0 left) 2021-07-26T16:00:21.988 INFO:tasks.rados.rados.0.smithi033.stdout:1046: copy_from oid 33 from oid 1 current snap is 106 2021-07-26T16:00:21.988 INFO:tasks.rados.rados.0.smithi033.stdout:1047: read oid 46 snap -1 2021-07-26T16:00:21.988 INFO:tasks.rados.rados.0.smithi033.stdout:1047: expect (ObjNum 308 snap 98 seq_num 308) 2021-07-26T16:00:21.989 INFO:tasks.rados.rados.0.smithi033.stdout:1048: snap_remove snap 99 2021-07-26T16:00:22.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:22 smithi033 bash[42377]: audit 2021-07-26T16:00:20.893041+0000 mgr.y (mgr.34104) 131 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:22.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:22 smithi033 bash[42377]: cephadm 2021-07-26T16:00:20.895253+0000 mgr.y (mgr.34104) 132 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:00:22.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:22 smithi033 bash[42377]: cluster 2021-07-26T16:00:20.988510+0000 mgr.y (mgr.34104) 133 : cluster [DBG] pgmap v184: 25 pgs: 4 active+undersized+degraded, 3 active+undersized, 18 active+clean; 182 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.2 MiB/s wr, 5 op/s; 35/372 objects degraded (9.409%) 2021-07-26T16:00:22.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:22 smithi033 bash[42377]: cluster 2021-07-26T16:00:21.981539+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e262: 8 total, 7 up, 8 in 2021-07-26T16:00:22.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:22 smithi033 bash[41341]: audit 2021-07-26T16:00:20.893041+0000 mgr.y (mgr.34104) 131 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:22.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:22 smithi033 bash[41341]: cephadm 2021-07-26T16:00:20.895253+0000 mgr.y (mgr.34104) 132 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:00:22.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:22 smithi033 bash[41341]: cluster 2021-07-26T16:00:20.988510+0000 mgr.y (mgr.34104) 133 : cluster [DBG] pgmap v184: 25 pgs: 4 active+undersized+degraded, 3 active+undersized, 18 active+clean; 182 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.2 MiB/s wr, 5 op/s; 35/372 objects degraded (9.409%) 2021-07-26T16:00:22.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:22 smithi033 bash[41341]: cluster 2021-07-26T16:00:21.981539+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e262: 8 total, 7 up, 8 in 2021-07-26T16:00:22.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:22 smithi096 bash[33981]: audit 2021-07-26T16:00:20.893041+0000 mgr.y (mgr.34104) 131 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:22.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:22 smithi096 bash[33981]: cephadm 2021-07-26T16:00:20.895253+0000 mgr.y (mgr.34104) 132 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:00:22.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:22 smithi096 bash[33981]: cluster 2021-07-26T16:00:20.988510+0000 mgr.y (mgr.34104) 133 : cluster [DBG] pgmap v184: 25 pgs: 4 active+undersized+degraded, 3 active+undersized, 18 active+clean; 182 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.2 MiB/s wr, 5 op/s; 35/372 objects degraded (9.409%) 2021-07-26T16:00:22.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:22 smithi096 bash[33981]: cluster 2021-07-26T16:00:21.981539+0000 mon.a (mon.0) 338 : cluster [DBG] osdmap e262: 8 total, 7 up, 8 in 2021-07-26T16:00:22.991 INFO:tasks.rados.rados.0.smithi033.stdout:1048: done (2 left) 2021-07-26T16:00:22.991 INFO:tasks.rados.rados.0.smithi033.stdout:1049: snap_remove snap 91 2021-07-26T16:00:23.958 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:23 smithi033 bash[46956]: debug 2021-07-26T16:00:23.600+0000 7f13b06cd0c0 -1 osd.2 252 log_to_monitors {default=true} 2021-07-26T16:00:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:23 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:23.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:23 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:23.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:23.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:23 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:23.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:00:24.009 INFO:tasks.rados.rados.0.smithi033.stdout:1049: done (2 left) 2021-07-26T16:00:24.009 INFO:tasks.rados.rados.0.smithi033.stdout:1050: snap_create 2021-07-26T16:00:24.009 INFO:tasks.rados.rados.0.smithi033.stdout:1046: finishing copy_from to smithi03339061-33 2021-07-26T16:00:24.010 INFO:tasks.rados.rados.0.smithi033.stdout:1046: got expected ENOENT (src dne) 2021-07-26T16:00:24.010 INFO:tasks.rados.rados.0.smithi033.stdout:1046: finishing copy_from racing read to smithi03339061-33 2021-07-26T16:00:24.010 INFO:tasks.rados.rados.0.smithi033.stdout:1047: expect (ObjNum 308 snap 98 seq_num 308) 2021-07-26T16:00:24.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:23 smithi033 bash[42377]: cluster 2021-07-26T16:00:22.987639+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e263: 8 total, 7 up, 8 in 2021-07-26T16:00:24.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:23 smithi033 bash[42377]: cluster 2021-07-26T16:00:22.989452+0000 mgr.y (mgr.34104) 134 : cluster [DBG] pgmap v187: 25 pgs: 1 active+clean+snaptrim, 4 active+undersized+degraded, 3 active+undersized, 17 active+clean; 182 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 3.7 MiB/s rd, 1.3 MiB/s wr, 6 op/s; 35/372 objects degraded (9.409%) 2021-07-26T16:00:24.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:23 smithi033 bash[42377]: audit 2021-07-26T16:00:23.611326+0000 mon.a (mon.0) 340 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-07-26T16:00:24.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:23 smithi033 bash[41341]: cluster 2021-07-26T16:00:22.987639+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e263: 8 total, 7 up, 8 in 2021-07-26T16:00:24.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:23 smithi033 bash[41341]: cluster 2021-07-26T16:00:22.989452+0000 mgr.y (mgr.34104) 134 : cluster [DBG] pgmap v187: 25 pgs: 1 active+clean+snaptrim, 4 active+undersized+degraded, 3 active+undersized, 17 active+clean; 182 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 3.7 MiB/s rd, 1.3 MiB/s wr, 6 op/s; 35/372 objects degraded (9.409%) 2021-07-26T16:00:24.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:23 smithi033 bash[41341]: audit 2021-07-26T16:00:23.611326+0000 mon.a (mon.0) 340 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-07-26T16:00:24.461 INFO:journalctl@ceph.osd.2.smithi033.stdout:Jul 26 16:00:24 smithi033 bash[46956]: debug 2021-07-26T16:00:24.016+0000 7f139f81d700 -1 osd.2 252 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-07-26T16:00:24.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:23 smithi096 bash[33981]: cluster 2021-07-26T16:00:22.987639+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e263: 8 total, 7 up, 8 in 2021-07-26T16:00:24.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:23 smithi096 bash[33981]: cluster 2021-07-26T16:00:22.989452+0000 mgr.y (mgr.34104) 134 : cluster [DBG] pgmap v187: 25 pgs: 1 active+clean+snaptrim, 4 active+undersized+degraded, 3 active+undersized, 17 active+clean; 182 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 3.7 MiB/s rd, 1.3 MiB/s wr, 6 op/s; 35/372 objects degraded (9.409%) 2021-07-26T16:00:24.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:23 smithi096 bash[33981]: audit 2021-07-26T16:00:23.611326+0000 mon.a (mon.0) 340 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-07-26T16:00:25.010 INFO:tasks.rados.rados.0.smithi033.stdout:1046: done (2 left) 2021-07-26T16:00:25.011 INFO:tasks.rados.rados.0.smithi033.stdout:1047: done (1 left) 2021-07-26T16:00:25.012 INFO:tasks.rados.rados.0.smithi033.stdout:1050: done (0 left) 2021-07-26T16:00:25.012 INFO:tasks.rados.rados.0.smithi033.stdout:1051: rmattr oid 26 current snap is 107 2021-07-26T16:00:25.012 INFO:tasks.rados.rados.0.smithi033.stdout:1052: rmattr oid 42 current snap is 107 2021-07-26T16:00:25.013 INFO:tasks.rados.rados.0.smithi033.stdout:1053: rmattr oid 24 current snap is 107 2021-07-26T16:00:25.013 INFO:tasks.rados.rados.0.smithi033.stdout:1053: done (2 left) 2021-07-26T16:00:25.014 INFO:tasks.rados.rados.0.smithi033.stdout:1054: snap_remove snap 101 2021-07-26T16:00:25.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:24 smithi033 bash[42377]: audit 2021-07-26T16:00:24.000501+0000 mon.a (mon.0) 341 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-07-26T16:00:25.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:24 smithi033 bash[42377]: cluster 2021-07-26T16:00:24.000764+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e264: 8 total, 7 up, 8 in 2021-07-26T16:00:25.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:24 smithi033 bash[42377]: audit 2021-07-26T16:00:24.002311+0000 mon.a (mon.0) 343 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T16:00:25.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:24 smithi033 bash[41341]: audit 2021-07-26T16:00:24.000501+0000 mon.a (mon.0) 341 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-07-26T16:00:25.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:24 smithi033 bash[41341]: cluster 2021-07-26T16:00:24.000764+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e264: 8 total, 7 up, 8 in 2021-07-26T16:00:25.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:24 smithi033 bash[41341]: audit 2021-07-26T16:00:24.002311+0000 mon.a (mon.0) 343 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T16:00:25.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:24 smithi096 bash[33981]: audit 2021-07-26T16:00:24.000501+0000 mon.a (mon.0) 341 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-07-26T16:00:25.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:24 smithi096 bash[33981]: cluster 2021-07-26T16:00:24.000764+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e264: 8 total, 7 up, 8 in 2021-07-26T16:00:25.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:24 smithi096 bash[33981]: audit 2021-07-26T16:00:24.002311+0000 mon.a (mon.0) 343 : audit [INF] from='osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T16:00:26.022 INFO:tasks.rados.rados.0.smithi033.stdout:1054: done (2 left) 2021-07-26T16:00:26.023 INFO:tasks.rados.rados.0.smithi033.stdout:1055: delete oid 10 current snap is 107 2021-07-26T16:00:26.023 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 198 (ObjNum 288 snap 90 seq_num 288) dirty exists 2021-07-26T16:00:26.023 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 598 (ObjNum 232 snap 65 seq_num 232) dirty exists 2021-07-26T16:00:26.029 INFO:tasks.rados.rados.0.smithi033.stdout:1051: done (2 left) 2021-07-26T16:00:26.029 INFO:tasks.rados.rados.0.smithi033.stdout:1052: done (1 left) 2021-07-26T16:00:26.029 INFO:tasks.rados.rados.0.smithi033.stdout:1055: done (0 left) 2021-07-26T16:00:26.029 INFO:tasks.rados.rados.0.smithi033.stdout:1056: rollback oid 3 current snap is 107 2021-07-26T16:00:26.029 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 3 to 104 2021-07-26T16:00:26.030 INFO:tasks.rados.rados.0.smithi033.stdout:1057: setattr oid 37 current snap is 107 2021-07-26T16:00:26.031 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 107 2021-07-26T16:00:26.031 INFO:tasks.rados.rados.0.smithi033.stdout:1058: seq_num 327 ranges {0=679936} 2021-07-26T16:00:26.036 INFO:tasks.rados.rados.0.smithi033.stdout:1058: writing smithi03339061-18 from 0 to 679936 tid 1 2021-07-26T16:00:26.036 INFO:tasks.rados.rados.0.smithi033.stdout:1059: snap_create 2021-07-26T16:00:26.040 INFO:tasks.rados.rados.0.smithi033.stdout:1056: finishing rollback tid 1 to smithi03339061-3 2021-07-26T16:00:26.040 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 0 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T16:00:26.041 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 411 (ObjNum 279 snap 86 seq_num 279) dirty exists 2021-07-26T16:00:26.043 INFO:tasks.rados.rados.0.smithi033.stdout:1058: finishing write tid 1 to smithi03339061-18 2021-07-26T16:00:26.043 INFO:tasks.rados.rados.0.smithi033.stdout:1058: finishing write tid 2 to smithi03339061-18 2021-07-26T16:00:26.045 INFO:tasks.rados.rados.0.smithi033.stdout:1058: finishing write tid 3 to smithi03339061-18 2021-07-26T16:00:26.046 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 602 (ObjNum 327 snap 107 seq_num 327) dirty exists 2021-07-26T16:00:26.046 INFO:tasks.rados.rados.0.smithi033.stdout:1058: left oid 18 (ObjNum 327 snap 107 seq_num 327) 2021-07-26T16:00:26.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[41341]: cluster 2021-07-26T16:00:24.990372+0000 mgr.y (mgr.34104) 135 : cluster [DBG] pgmap v189: 25 pgs: 1 active+clean+snaptrim, 4 active+undersized+degraded, 3 active+undersized, 17 active+clean; 182 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 7.2 MiB/s rd, 3 op/s; 35/357 objects degraded (9.804%) 2021-07-26T16:00:26.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[41341]: cluster 2021-07-26T16:00:24.991140+0000 mon.a (mon.0) 344 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:00:26.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[41341]: cluster 2021-07-26T16:00:25.005339+0000 mon.a (mon.0) 345 : cluster [INF] osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750] boot 2021-07-26T16:00:26.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[41341]: cluster 2021-07-26T16:00:25.005418+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-07-26T16:00:26.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[41341]: audit 2021-07-26T16:00:25.007247+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T16:00:26.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[41341]: cluster 2021-07-26T16:00:25.958877+0000 mon.a (mon.0) 347 : cluster [WRN] Health check update: Degraded data redundancy: 35/372 objects degraded (9.409%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:26.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[42377]: cluster 2021-07-26T16:00:24.990372+0000 mgr.y (mgr.34104) 135 : cluster [DBG] pgmap v189: 25 pgs: 1 active+clean+snaptrim, 4 active+undersized+degraded, 3 active+undersized, 17 active+clean; 182 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 7.2 MiB/s rd, 3 op/s; 35/357 objects degraded (9.804%) 2021-07-26T16:00:26.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[42377]: cluster 2021-07-26T16:00:24.991140+0000 mon.a (mon.0) 344 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:00:26.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[42377]: cluster 2021-07-26T16:00:25.005339+0000 mon.a (mon.0) 345 : cluster [INF] osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750] boot 2021-07-26T16:00:26.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[42377]: cluster 2021-07-26T16:00:25.005418+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-07-26T16:00:26.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[42377]: audit 2021-07-26T16:00:25.007247+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T16:00:26.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:26 smithi033 bash[42377]: cluster 2021-07-26T16:00:25.958877+0000 mon.a (mon.0) 347 : cluster [WRN] Health check update: Degraded data redundancy: 35/372 objects degraded (9.409%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:26.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:26 smithi096 bash[33981]: cluster 2021-07-26T16:00:24.990372+0000 mgr.y (mgr.34104) 135 : cluster [DBG] pgmap v189: 25 pgs: 1 active+clean+snaptrim, 4 active+undersized+degraded, 3 active+undersized, 17 active+clean; 182 MiB data, 631 MiB used, 715 GiB / 715 GiB avail; 7.2 MiB/s rd, 3 op/s; 35/357 objects degraded (9.804%) 2021-07-26T16:00:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:26 smithi096 bash[33981]: cluster 2021-07-26T16:00:24.991140+0000 mon.a (mon.0) 344 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:00:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:26 smithi096 bash[33981]: cluster 2021-07-26T16:00:25.005339+0000 mon.a (mon.0) 345 : cluster [INF] osd.2 [v2:172.21.15.33:6818/3054044750,v1:172.21.15.33:6819/3054044750] boot 2021-07-26T16:00:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:26 smithi096 bash[33981]: cluster 2021-07-26T16:00:25.005418+0000 mon.a (mon.0) 346 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-07-26T16:00:26.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:26 smithi096 bash[33981]: audit 2021-07-26T16:00:25.007247+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-07-26T16:00:26.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:26 smithi096 bash[33981]: cluster 2021-07-26T16:00:25.958877+0000 mon.a (mon.0) 347 : cluster [WRN] Health check update: Degraded data redundancy: 35/372 objects degraded (9.409%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:27.030 INFO:tasks.rados.rados.0.smithi033.stdout:1056: done (3 left) 2021-07-26T16:00:27.030 INFO:tasks.rados.rados.0.smithi033.stdout:1057: done (2 left) 2021-07-26T16:00:27.031 INFO:tasks.rados.rados.0.smithi033.stdout:1058: done (1 left) 2021-07-26T16:00:27.031 INFO:tasks.rados.rados.0.smithi033.stdout:1059: done (0 left) 2021-07-26T16:00:27.031 INFO:tasks.rados.rados.0.smithi033.stdout:1060: read oid 7 snap 76 2021-07-26T16:00:27.032 INFO:tasks.rados.rados.0.smithi033.stdout:1060: expect deleted 2021-07-26T16:00:27.032 INFO:tasks.rados.rados.0.smithi033.stdout:1061: rmattr oid 2 current snap is 108 2021-07-26T16:00:27.032 INFO:tasks.rados.rados.0.smithi033.stdout:1061: done (1 left) 2021-07-26T16:00:27.032 INFO:tasks.rados.rados.0.smithi033.stdout:1062: copy_from oid 47 from oid 9 current snap is 108 2021-07-26T16:00:27.033 INFO:tasks.rados.rados.0.smithi033.stdout:1063: copy_from oid 42 from oid 35 current snap is 108 2021-07-26T16:00:27.033 INFO:tasks.rados.rados.0.smithi033.stdout:1064: copy_from oid 15 from oid 1 current snap is 108 2021-07-26T16:00:27.033 INFO:tasks.rados.rados.0.smithi033.stdout:1065: delete oid 28 current snap is 108 2021-07-26T16:00:27.035 INFO:tasks.rados.rados.0.smithi033.stdout:1060: done (4 left) 2021-07-26T16:00:27.035 INFO:tasks.rados.rados.0.smithi033.stdout:1065: done (3 left) 2021-07-26T16:00:27.035 INFO:tasks.rados.rados.0.smithi033.stdout:1066: rollback oid 40 current snap is 108 2021-07-26T16:00:27.035 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 40 to 88 2021-07-26T16:00:27.036 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 108 2021-07-26T16:00:27.036 INFO:tasks.rados.rados.0.smithi033.stdout:1067: seq_num 329 ranges {2351104=712704} 2021-07-26T16:00:27.056 INFO:tasks.rados.rados.0.smithi033.stdout:1067: writing smithi03339061-48 from 2351104 to 3063808 tid 1 2021-07-26T16:00:27.056 INFO:tasks.rados.rados.0.smithi033.stdout:1068: snap_remove snap 95 2021-07-26T16:00:27.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:27 smithi033 bash[41341]: cluster 2021-07-26T16:00:26.015818+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-07-26T16:00:27.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:27 smithi033 bash[42377]: cluster 2021-07-26T16:00:26.015818+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-07-26T16:00:27.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:27 smithi096 bash[33981]: cluster 2021-07-26T16:00:26.015818+0000 mon.a (mon.0) 348 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-07-26T16:00:28.040 INFO:tasks.rados.rados.0.smithi033.stdout:1068: done (5 left) 2021-07-26T16:00:28.041 INFO:tasks.rados.rados.0.smithi033.stdout:1069: snap_remove snap 81 2021-07-26T16:00:28.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:28 smithi033 bash[42377]: cluster 2021-07-26T16:00:26.991229+0000 mgr.y (mgr.34104) 136 : cluster [DBG] pgmap v192: 25 pgs: 2 peering, 2 active+undersized+degraded, 3 active+undersized, 18 active+clean; 182 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 2 op/s; 14/357 objects degraded (3.922%) 2021-07-26T16:00:28.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:28 smithi033 bash[42377]: cluster 2021-07-26T16:00:27.025451+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-07-26T16:00:28.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:28 smithi033 bash[41341]: cluster 2021-07-26T16:00:26.991229+0000 mgr.y (mgr.34104) 136 : cluster [DBG] pgmap v192: 25 pgs: 2 peering, 2 active+undersized+degraded, 3 active+undersized, 18 active+clean; 182 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 2 op/s; 14/357 objects degraded (3.922%) 2021-07-26T16:00:28.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:28 smithi033 bash[41341]: cluster 2021-07-26T16:00:27.025451+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-07-26T16:00:28.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:28 smithi096 bash[33981]: cluster 2021-07-26T16:00:26.991229+0000 mgr.y (mgr.34104) 136 : cluster [DBG] pgmap v192: 25 pgs: 2 peering, 2 active+undersized+degraded, 3 active+undersized, 18 active+clean; 182 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 2 op/s; 14/357 objects degraded (3.922%) 2021-07-26T16:00:28.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:28 smithi096 bash[33981]: cluster 2021-07-26T16:00:27.025451+0000 mon.a (mon.0) 349 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-07-26T16:00:29.050 INFO:tasks.rados.rados.0.smithi033.stdout:1069: done (5 left) 2021-07-26T16:00:29.051 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 108 2021-07-26T16:00:29.051 INFO:tasks.rados.rados.0.smithi033.stdout:1064: finishing copy_from to smithi03339061-15 2021-07-26T16:00:29.051 INFO:tasks.rados.rados.0.smithi033.stdout:1064: got expected ENOENT (src dne) 2021-07-26T16:00:29.051 INFO:tasks.rados.rados.0.smithi033.stdout:1064: finishing copy_from racing read to smithi03339061-15 2021-07-26T16:00:29.052 INFO:tasks.rados.rados.0.smithi033.stdout:1066: finishing rollback tid 0 to smithi03339061-40 2021-07-26T16:00:29.052 INFO:tasks.rados.rados.0.smithi033.stdout:1066: finishing rollback tid 1 to smithi03339061-40 2021-07-26T16:00:29.052 INFO:tasks.rados.rados.0.smithi033.stdout:1070: seq_num 330 ranges {417792=737280} 2021-07-26T16:00:29.059 INFO:tasks.rados.rados.0.smithi033.stdout:1070: writing smithi03339061-19 from 417792 to 1155072 tid 1 2021-07-26T16:00:29.060 INFO:tasks.rados.rados.0.smithi033.stdout:1064: done (5 left) 2021-07-26T16:00:29.060 INFO:tasks.rados.rados.0.smithi033.stdout:1071: read oid 12 snap -1 2021-07-26T16:00:29.060 INFO:tasks.rados.rados.0.smithi033.stdout:1071: expect (ObjNum 324 snap 104 seq_num 324) 2021-07-26T16:00:29.060 INFO:tasks.rados.rados.0.smithi033.stdout:1072: delete oid 6 current snap is 108 2021-07-26T16:00:29.061 INFO:tasks.rados.rados.0.smithi033.stdout:1066: finishing rollback tid 2 to smithi03339061-40 2021-07-26T16:00:29.061 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 203 (ObjNum 282 snap 86 seq_num 282) dirty exists 2021-07-26T16:00:29.061 INFO:tasks.rados.rados.0.smithi033.stdout:1062: finishing copy_from to smithi03339061-47 2021-07-26T16:00:29.061 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 241 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T16:00:29.062 INFO:tasks.rados.rados.0.smithi033.stdout:1063: finishing copy_from to smithi03339061-42 2021-07-26T16:00:29.062 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 225 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T16:00:29.062 INFO:tasks.rados.rados.0.smithi033.stdout:1062: finishing copy_from racing read to smithi03339061-47 2021-07-26T16:00:29.062 INFO:tasks.rados.rados.0.smithi033.stdout:1067: finishing write tid 1 to smithi03339061-48 2021-07-26T16:00:29.063 INFO:tasks.rados.rados.0.smithi033.stdout:1063: finishing copy_from racing read to smithi03339061-42 2021-07-26T16:00:29.063 INFO:tasks.rados.rados.0.smithi033.stdout:1067: finishing write tid 2 to smithi03339061-48 2021-07-26T16:00:29.063 INFO:tasks.rados.rados.0.smithi033.stdout:1067: finishing write tid 3 to smithi03339061-48 2021-07-26T16:00:29.063 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 335 (ObjNum 329 snap 108 seq_num 329) dirty exists 2021-07-26T16:00:29.064 INFO:tasks.rados.rados.0.smithi033.stdout:1067: left oid 48 (ObjNum 329 snap 108 seq_num 329) 2021-07-26T16:00:29.066 INFO:tasks.rados.rados.0.smithi033.stdout:1070: finishing write tid 1 to smithi03339061-19 2021-07-26T16:00:29.067 INFO:tasks.rados.rados.0.smithi033.stdout:1070: finishing write tid 2 to smithi03339061-19 2021-07-26T16:00:29.069 INFO:tasks.rados.rados.0.smithi033.stdout:1070: finishing write tid 3 to smithi03339061-19 2021-07-26T16:00:29.070 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 303 (ObjNum 330 snap 108 seq_num 330) dirty exists 2021-07-26T16:00:29.070 INFO:tasks.rados.rados.0.smithi033.stdout:1070: left oid 19 (ObjNum 330 snap 108 seq_num 330) 2021-07-26T16:00:29.073 INFO:tasks.rados.rados.0.smithi033.stdout:1062: done (6 left) 2021-07-26T16:00:29.073 INFO:tasks.rados.rados.0.smithi033.stdout:1063: done (5 left) 2021-07-26T16:00:29.073 INFO:tasks.rados.rados.0.smithi033.stdout:1066: done (4 left) 2021-07-26T16:00:29.073 INFO:tasks.rados.rados.0.smithi033.stdout:1067: done (3 left) 2021-07-26T16:00:29.074 INFO:tasks.rados.rados.0.smithi033.stdout:1070: done (2 left) 2021-07-26T16:00:29.074 INFO:tasks.rados.rados.0.smithi033.stdout:1072: done (1 left) 2021-07-26T16:00:29.074 INFO:tasks.rados.rados.0.smithi033.stdout:1073: rollback oid 27 current snap is 108 2021-07-26T16:00:29.075 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 27 to 107 2021-07-26T16:00:29.075 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 108 2021-07-26T16:00:29.075 INFO:tasks.rados.rados.0.smithi033.stdout:1074: seq_num 332 ranges {0=770048} 2021-07-26T16:00:29.079 INFO:tasks.rados.rados.0.smithi033.stdout:1074: writing smithi03339061-49 from 0 to 770048 tid 1 2021-07-26T16:00:29.080 INFO:tasks.rados.rados.0.smithi033.stdout:1075: rollback oid 30 current snap is 108 2021-07-26T16:00:29.080 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 30 to 104 2021-07-26T16:00:29.081 INFO:tasks.rados.rados.0.smithi033.stdout:1076: delete oid 35 current snap is 108 2021-07-26T16:00:29.083 INFO:tasks.rados.rados.0.smithi033.stdout:1073: finishing rollback tid 0 to smithi03339061-27 2021-07-26T16:00:29.084 INFO:tasks.rados.rados.0.smithi033.stdout:1071: expect (ObjNum 324 snap 104 seq_num 324) 2021-07-26T16:00:29.242 INFO:tasks.rados.rados.0.smithi033.stdout:1073: finishing rollback tid 1 to smithi03339061-27 2021-07-26T16:00:29.243 INFO:tasks.rados.rados.0.smithi033.stdout:1073: finishing rollback tid 2 to smithi03339061-27 2021-07-26T16:00:29.243 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 487 (ObjNum 321 snap 102 seq_num 321) dirty exists 2021-07-26T16:00:29.243 INFO:tasks.rados.rados.0.smithi033.stdout:1074: finishing write tid 1 to smithi03339061-49 2021-07-26T16:00:29.243 INFO:tasks.rados.rados.0.smithi033.stdout:1074: finishing write tid 2 to smithi03339061-49 2021-07-26T16:00:29.244 INFO:tasks.rados.rados.0.smithi033.stdout:1075: finishing rollback tid 0 to smithi03339061-30 2021-07-26T16:00:29.244 INFO:tasks.rados.rados.0.smithi033.stdout:1075: finishing rollback tid 1 to smithi03339061-30 2021-07-26T16:00:29.244 INFO:tasks.rados.rados.0.smithi033.stdout:1075: finishing rollback tid 2 to smithi03339061-30 2021-07-26T16:00:29.244 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 433 (ObjNum 249 snap 71 seq_num 249) dirty exists 2021-07-26T16:00:29.244 INFO:tasks.rados.rados.0.smithi033.stdout:1074: finishing write tid 3 to smithi03339061-49 2021-07-26T16:00:29.245 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 270 (ObjNum 332 snap 108 seq_num 332) dirty exists 2021-07-26T16:00:29.245 INFO:tasks.rados.rados.0.smithi033.stdout:1074: left oid 49 (ObjNum 332 snap 108 seq_num 332) 2021-07-26T16:00:29.245 INFO:tasks.rados.rados.0.smithi033.stdout:1071: done (4 left) 2021-07-26T16:00:29.245 INFO:tasks.rados.rados.0.smithi033.stdout:1073: done (3 left) 2021-07-26T16:00:29.246 INFO:tasks.rados.rados.0.smithi033.stdout:1074: done (2 left) 2021-07-26T16:00:29.246 INFO:tasks.rados.rados.0.smithi033.stdout:1075: done (1 left) 2021-07-26T16:00:29.246 INFO:tasks.rados.rados.0.smithi033.stdout:1076: done (0 left) 2021-07-26T16:00:29.246 INFO:tasks.rados.rados.0.smithi033.stdout:1077: delete oid 13 current snap is 108 2021-07-26T16:00:29.247 INFO:tasks.rados.rados.0.smithi033.stdout:1077: done (0 left) 2021-07-26T16:00:29.247 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 108 2021-07-26T16:00:29.248 INFO:tasks.rados.rados.0.smithi033.stdout:1078: seq_num 335 ranges {0=417792,417792=401408} 2021-07-26T16:00:29.251 INFO:tasks.rados.rados.0.smithi033.stdout:1078: writing smithi03339061-10 from 0 to 417792 tid 1 2021-07-26T16:00:29.258 INFO:tasks.rados.rados.0.smithi033.stdout:1078: writing smithi03339061-10 from 417792 to 819200 tid 2 2021-07-26T16:00:29.258 INFO:tasks.rados.rados.0.smithi033.stdout:1079: rmattr oid 1 current snap is 108 2021-07-26T16:00:29.258 INFO:tasks.rados.rados.0.smithi033.stdout:1079: done (1 left) 2021-07-26T16:00:29.259 INFO:tasks.rados.rados.0.smithi033.stdout:1080: read oid 7 snap 105 2021-07-26T16:00:29.260 INFO:tasks.rados.rados.0.smithi033.stdout:1080: expect deleted 2021-07-26T16:00:29.260 INFO:tasks.rados.rados.0.smithi033.stdout:1081: snap_remove snap 103 2021-07-26T16:00:29.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:29 smithi033 bash[41341]: cluster 2021-07-26T16:00:28.037032+0000 mon.a (mon.0) 350 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-07-26T16:00:29.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:29 smithi033 bash[42377]: cluster 2021-07-26T16:00:28.037032+0000 mon.a (mon.0) 350 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-07-26T16:00:29.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:29 smithi096 bash[33981]: cluster 2021-07-26T16:00:28.037032+0000 mon.a (mon.0) 350 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-07-26T16:00:30.057 INFO:tasks.rados.rados.0.smithi033.stdout:1081: done (2 left) 2021-07-26T16:00:30.057 INFO:tasks.rados.rados.0.smithi033.stdout:1082: read oid 13 snap -1 2021-07-26T16:00:30.058 INFO:tasks.rados.rados.0.smithi033.stdout:1082: expect deleted 2021-07-26T16:00:30.058 INFO:tasks.rados.rados.0.smithi033.stdout:1083: snap_remove snap 93 2021-07-26T16:00:30.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:30 smithi033 bash[42377]: cluster 2021-07-26T16:00:28.992016+0000 mgr.y (mgr.34104) 137 : cluster [DBG] pgmap v195: 25 pgs: 2 peering, 2 active+undersized+degraded, 3 active+undersized, 18 active+clean; 182 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 14/357 objects degraded (3.922%) 2021-07-26T16:00:30.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:30 smithi033 bash[42377]: cluster 2021-07-26T16:00:29.045217+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-07-26T16:00:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:30 smithi033 bash[41341]: cluster 2021-07-26T16:00:28.992016+0000 mgr.y (mgr.34104) 137 : cluster [DBG] pgmap v195: 25 pgs: 2 peering, 2 active+undersized+degraded, 3 active+undersized, 18 active+clean; 182 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 14/357 objects degraded (3.922%) 2021-07-26T16:00:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:30 smithi033 bash[41341]: cluster 2021-07-26T16:00:29.045217+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-07-26T16:00:30.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:30 smithi096 bash[33981]: cluster 2021-07-26T16:00:28.992016+0000 mgr.y (mgr.34104) 137 : cluster [DBG] pgmap v195: 25 pgs: 2 peering, 2 active+undersized+degraded, 3 active+undersized, 18 active+clean; 182 MiB data, 635 MiB used, 715 GiB / 715 GiB avail; 14/357 objects degraded (3.922%) 2021-07-26T16:00:30.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:30 smithi096 bash[33981]: cluster 2021-07-26T16:00:29.045217+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-07-26T16:00:31.073 INFO:tasks.rados.rados.0.smithi033.stdout:1083: done (3 left) 2021-07-26T16:00:31.074 INFO:tasks.rados.rados.0.smithi033.stdout:1084: rollback oid 3 current snap is 108 2021-07-26T16:00:31.074 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 3 to 97 2021-07-26T16:00:31.074 INFO:tasks.rados.rados.0.smithi033.stdout:1078: finishing write tid 1 to smithi03339061-10 2021-07-26T16:00:31.074 INFO:tasks.rados.rados.0.smithi033.stdout:1078: finishing write tid 2 to smithi03339061-10 2021-07-26T16:00:31.075 INFO:tasks.rados.rados.0.smithi033.stdout:1078: finishing write tid 3 to smithi03339061-10 2021-07-26T16:00:31.075 INFO:tasks.rados.rados.0.smithi033.stdout:1078: finishing write tid 4 to smithi03339061-10 2021-07-26T16:00:31.075 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 438 (ObjNum 335 snap 108 seq_num 335) dirty exists 2021-07-26T16:00:31.075 INFO:tasks.rados.rados.0.smithi033.stdout:1078: left oid 10 (ObjNum 335 snap 108 seq_num 335) 2021-07-26T16:00:31.076 INFO:tasks.rados.rados.0.smithi033.stdout:1078: done (3 left) 2021-07-26T16:00:31.076 INFO:tasks.rados.rados.0.smithi033.stdout:1080: done (2 left) 2021-07-26T16:00:31.076 INFO:tasks.rados.rados.0.smithi033.stdout:1082: done (1 left) 2021-07-26T16:00:31.076 INFO:tasks.rados.rados.0.smithi033.stdout:1085: snap_create 2021-07-26T16:00:31.078 INFO:tasks.rados.rados.0.smithi033.stdout:1084: finishing rollback tid 1 to smithi03339061-3 2021-07-26T16:00:31.078 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 0 (ObjNum 2007126736 snap 22002 seq_num 1058725264) dirty dne 2021-07-26T16:00:31.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:31 smithi033 bash[42377]: cluster 2021-07-26T16:00:30.054405+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-07-26T16:00:31.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:31 smithi033 bash[42377]: cluster 2021-07-26T16:00:30.960557+0000 mon.a (mon.0) 353 : cluster [WRN] Health check update: Degraded data redundancy: 14/357 objects degraded (3.922%), 2 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:31.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:31 smithi033 bash[41341]: cluster 2021-07-26T16:00:30.054405+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-07-26T16:00:31.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:31 smithi033 bash[41341]: cluster 2021-07-26T16:00:30.960557+0000 mon.a (mon.0) 353 : cluster [WRN] Health check update: Degraded data redundancy: 14/357 objects degraded (3.922%), 2 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:31.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:31 smithi096 bash[33981]: cluster 2021-07-26T16:00:30.054405+0000 mon.a (mon.0) 352 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-07-26T16:00:31.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:31 smithi096 bash[33981]: cluster 2021-07-26T16:00:30.960557+0000 mon.a (mon.0) 353 : cluster [WRN] Health check update: Degraded data redundancy: 14/357 objects degraded (3.922%), 2 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:32.083 INFO:tasks.rados.rados.0.smithi033.stdout:1084: done (1 left) 2021-07-26T16:00:32.084 INFO:tasks.rados.rados.0.smithi033.stdout:1085: done (0 left) 2021-07-26T16:00:32.084 INFO:tasks.rados.rados.0.smithi033.stdout:1086: snap_create 2021-07-26T16:00:32.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:32 smithi033 bash[41341]: cluster 2021-07-26T16:00:30.992783+0000 mgr.y (mgr.34104) 138 : cluster [DBG] pgmap v198: 25 pgs: 1 active+clean+wait, 24 active+clean; 188 MiB data, 673 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 18 op/s; 3.1 MiB/s, 1 objects/s recovering 2021-07-26T16:00:32.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:32 smithi033 bash[41341]: cluster 2021-07-26T16:00:31.060202+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-07-26T16:00:32.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:32 smithi033 bash[41341]: cluster 2021-07-26T16:00:31.963731+0000 mon.a (mon.0) 355 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/357 objects degraded (3.922%), 2 pgs degraded) 2021-07-26T16:00:32.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:32 smithi033 bash[41341]: cluster 2021-07-26T16:00:31.963812+0000 mon.a (mon.0) 356 : cluster [INF] Cluster is now healthy 2021-07-26T16:00:32.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:32 smithi033 bash[42377]: cluster 2021-07-26T16:00:30.992783+0000 mgr.y (mgr.34104) 138 : cluster [DBG] pgmap v198: 25 pgs: 1 active+clean+wait, 24 active+clean; 188 MiB data, 673 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 18 op/s; 3.1 MiB/s, 1 objects/s recovering 2021-07-26T16:00:32.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:32 smithi033 bash[42377]: cluster 2021-07-26T16:00:31.060202+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-07-26T16:00:32.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:32 smithi033 bash[42377]: cluster 2021-07-26T16:00:31.963731+0000 mon.a (mon.0) 355 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/357 objects degraded (3.922%), 2 pgs degraded) 2021-07-26T16:00:32.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:32 smithi033 bash[42377]: cluster 2021-07-26T16:00:31.963812+0000 mon.a (mon.0) 356 : cluster [INF] Cluster is now healthy 2021-07-26T16:00:32.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:32 smithi096 bash[33981]: cluster 2021-07-26T16:00:30.992783+0000 mgr.y (mgr.34104) 138 : cluster [DBG] pgmap v198: 25 pgs: 1 active+clean+wait, 24 active+clean; 188 MiB data, 673 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 18 op/s; 3.1 MiB/s, 1 objects/s recovering 2021-07-26T16:00:32.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:32 smithi096 bash[33981]: cluster 2021-07-26T16:00:31.060202+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-07-26T16:00:32.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:32 smithi096 bash[33981]: cluster 2021-07-26T16:00:31.963731+0000 mon.a (mon.0) 355 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/357 objects degraded (3.922%), 2 pgs degraded) 2021-07-26T16:00:32.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:32 smithi096 bash[33981]: cluster 2021-07-26T16:00:31.963812+0000 mon.a (mon.0) 356 : cluster [INF] Cluster is now healthy 2021-07-26T16:00:33.095 INFO:tasks.rados.rados.0.smithi033.stdout:1086: done (0 left) 2021-07-26T16:00:33.096 INFO:tasks.rados.rados.0.smithi033.stdout:1087: delete oid 39 current snap is 110 2021-07-26T16:00:33.100 INFO:tasks.rados.rados.0.smithi033.stdout:1087: done (0 left) 2021-07-26T16:00:33.101 INFO:tasks.rados.rados.0.smithi033.stdout:1088: rollback oid 33 current snap is 110 2021-07-26T16:00:33.101 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 107 2021-07-26T16:00:33.101 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 110 2021-07-26T16:00:33.101 INFO:tasks.rados.rados.0.smithi033.stdout:1089: seq_num 337 ranges {3112960=450560,3563520=401408} 2021-07-26T16:00:33.124 INFO:tasks.rados.rados.0.smithi033.stdout:1089: writing smithi03339061-12 from 3112960 to 3563520 tid 1 2021-07-26T16:00:33.127 INFO:tasks.rados.rados.0.smithi033.stdout:1089: writing smithi03339061-12 from 3563520 to 3964928 tid 2 2021-07-26T16:00:33.127 INFO:tasks.rados.rados.0.smithi033.stdout:1090: rollback oid 42 current snap is 110 2021-07-26T16:00:33.127 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 42 to 88 2021-07-26T16:00:33.128 INFO:tasks.rados.rados.0.smithi033.stdout:1088: finishing rollback tid 0 to smithi03339061-33 2021-07-26T16:00:33.128 INFO:tasks.rados.rados.0.smithi033.stdout:1088: finishing rollback tid 1 to smithi03339061-33 2021-07-26T16:00:33.128 INFO:tasks.rados.rados.0.smithi033.stdout:1088: finishing rollback tid 2 to smithi03339061-33 2021-07-26T16:00:33.128 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 629 (ObjNum 295 snap 91 seq_num 295) dirty exists 2021-07-26T16:00:33.129 INFO:tasks.rados.rados.0.smithi033.stdout:1088: done (2 left) 2021-07-26T16:00:33.129 INFO:tasks.rados.rados.0.smithi033.stdout:1091: snap_remove snap 105 2021-07-26T16:00:33.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:33 smithi033 bash[41341]: cluster 2021-07-26T16:00:32.080722+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-07-26T16:00:33.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:33 smithi033 bash[42377]: cluster 2021-07-26T16:00:32.080722+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-07-26T16:00:33.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:33 smithi096 bash[33981]: cluster 2021-07-26T16:00:32.080722+0000 mon.a (mon.0) 357 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-07-26T16:00:33.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:33 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:33.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:33 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:33.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:33 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:33.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:00:34.111 INFO:tasks.rados.rados.0.smithi033.stdout:1091: done (2 left) 2021-07-26T16:00:34.111 INFO:tasks.rados.rados.0.smithi033.stdout:1092: read oid 8 snap -1 2021-07-26T16:00:34.112 INFO:tasks.rados.rados.0.smithi033.stdout:1092: expect (ObjNum 301 snap 97 seq_num 301) 2021-07-26T16:00:34.112 INFO:tasks.rados.rados.0.smithi033.stdout:1093: setattr oid 25 current snap is 110 2021-07-26T16:00:34.112 INFO:tasks.rados.rados.0.smithi033.stdout:1094: delete oid 41 current snap is 110 2021-07-26T16:00:34.112 INFO:tasks.rados.rados.0.smithi033.stdout:1089: finishing write tid 1 to smithi03339061-12 2021-07-26T16:00:34.112 INFO:tasks.rados.rados.0.smithi033.stdout:1089: finishing write tid 2 to smithi03339061-12 2021-07-26T16:00:34.113 INFO:tasks.rados.rados.0.smithi033.stdout:1089: finishing write tid 3 to smithi03339061-12 2021-07-26T16:00:34.113 INFO:tasks.rados.rados.0.smithi033.stdout:1090: finishing rollback tid 0 to smithi03339061-42 2021-07-26T16:00:34.114 INFO:tasks.rados.rados.0.smithi033.stdout:1090: finishing rollback tid 1 to smithi03339061-42 2021-07-26T16:00:34.114 INFO:tasks.rados.rados.0.smithi033.stdout:1090: finishing rollback tid 2 to smithi03339061-42 2021-07-26T16:00:34.114 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 228 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T16:00:34.114 INFO:tasks.rados.rados.0.smithi033.stdout:1089: finishing write tid 4 to smithi03339061-12 2021-07-26T16:00:34.115 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 275 (ObjNum 337 snap 110 seq_num 337) dirty exists 2021-07-26T16:00:34.115 INFO:tasks.rados.rados.0.smithi033.stdout:1089: left oid 12 (ObjNum 337 snap 110 seq_num 337) 2021-07-26T16:00:34.120 INFO:tasks.rados.rados.0.smithi033.stdout:1089: done (4 left) 2021-07-26T16:00:34.121 INFO:tasks.rados.rados.0.smithi033.stdout:1090: done (3 left) 2021-07-26T16:00:34.121 INFO:tasks.rados.rados.0.smithi033.stdout:1094: done (2 left) 2021-07-26T16:00:34.121 INFO:tasks.rados.rados.0.smithi033.stdout:1095: snap_create 2021-07-26T16:00:34.124 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 273 (ObjNum 234 snap 66 seq_num 234) dirty exists 2021-07-26T16:00:34.126 INFO:tasks.rados.rados.0.smithi033.stdout:1092: expect (ObjNum 301 snap 97 seq_num 301) 2021-07-26T16:00:34.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:34 smithi033 bash[41341]: cluster 2021-07-26T16:00:32.993566+0000 mgr.y (mgr.34104) 139 : cluster [DBG] pgmap v201: 25 pgs: 1 active+clean+wait, 24 active+clean; 186 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 18 op/s; 3.1 MiB/s, 1 objects/s recovering 2021-07-26T16:00:34.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:34 smithi033 bash[41341]: cluster 2021-07-26T16:00:33.092818+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-07-26T16:00:34.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:34 smithi033 bash[42377]: cluster 2021-07-26T16:00:32.993566+0000 mgr.y (mgr.34104) 139 : cluster [DBG] pgmap v201: 25 pgs: 1 active+clean+wait, 24 active+clean; 186 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 18 op/s; 3.1 MiB/s, 1 objects/s recovering 2021-07-26T16:00:34.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:34 smithi033 bash[42377]: cluster 2021-07-26T16:00:33.092818+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-07-26T16:00:34.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:34 smithi096 bash[33981]: cluster 2021-07-26T16:00:32.993566+0000 mgr.y (mgr.34104) 139 : cluster [DBG] pgmap v201: 25 pgs: 1 active+clean+wait, 24 active+clean; 186 MiB data, 677 MiB used, 715 GiB / 715 GiB avail; 2.2 MiB/s rd, 2.0 MiB/s wr, 18 op/s; 3.1 MiB/s, 1 objects/s recovering 2021-07-26T16:00:34.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:34 smithi096 bash[33981]: cluster 2021-07-26T16:00:33.092818+0000 mon.a (mon.0) 358 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-07-26T16:00:35.117 INFO:tasks.rados.rados.0.smithi033.stdout:1092: done (2 left) 2021-07-26T16:00:35.118 INFO:tasks.rados.rados.0.smithi033.stdout:1093: done (1 left) 2021-07-26T16:00:35.119 INFO:tasks.rados.rados.0.smithi033.stdout:1095: done (0 left) 2021-07-26T16:00:35.119 INFO:tasks.rados.rados.0.smithi033.stdout:1096: rollback oid 41 current snap is 111 2021-07-26T16:00:35.119 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 41 to 102 2021-07-26T16:00:35.119 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 111 2021-07-26T16:00:35.120 INFO:tasks.rados.rados.0.smithi033.stdout:1097: seq_num 339 ranges {2400256=483328,2883584=401408} 2021-07-26T16:00:35.136 INFO:tasks.rados.rados.0.smithi033.stdout:1097: writing smithi03339061-4 from 2400256 to 2883584 tid 1 2021-07-26T16:00:35.140 INFO:tasks.rados.rados.0.smithi033.stdout:1097: writing smithi03339061-4 from 2883584 to 3284992 tid 2 2021-07-26T16:00:35.140 INFO:tasks.rados.rados.0.smithi033.stdout:1098: delete oid 19 current snap is 111 2021-07-26T16:00:35.140 INFO:tasks.rados.rados.0.smithi033.stdout:1096: finishing rollback tid 1 to smithi03339061-41 2021-07-26T16:00:35.141 INFO:tasks.rados.rados.0.smithi033.stdout:1096: finishing rollback tid 2 to smithi03339061-41 2021-07-26T16:00:35.141 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 361 (ObjNum 313 snap 100 seq_num 313) dirty exists 2021-07-26T16:00:35.148 INFO:tasks.rados.rados.0.smithi033.stdout:1097: finishing write tid 1 to smithi03339061-4 2021-07-26T16:00:35.149 INFO:tasks.rados.rados.0.smithi033.stdout:1097: finishing write tid 2 to smithi03339061-4 2021-07-26T16:00:35.149 INFO:tasks.rados.rados.0.smithi033.stdout:1096: done (2 left) 2021-07-26T16:00:35.149 INFO:tasks.rados.rados.0.smithi033.stdout:1098: done (1 left) 2021-07-26T16:00:35.150 INFO:tasks.rados.rados.0.smithi033.stdout:1099: rollback oid 6 current snap is 111 2021-07-26T16:00:35.150 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 102 2021-07-26T16:00:35.150 INFO:tasks.rados.rados.0.smithi033.stdout:1100: snap_remove snap 110 2021-07-26T16:00:35.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:35 smithi033 bash[41341]: cluster 2021-07-26T16:00:34.102739+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-07-26T16:00:35.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:35 smithi033 bash[42377]: cluster 2021-07-26T16:00:34.102739+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-07-26T16:00:35.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:35 smithi096 bash[33981]: cluster 2021-07-26T16:00:34.102739+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-07-26T16:00:35.977 INFO:tasks.rados.rados.0.smithi033.stdout:1100: done (2 left) 2021-07-26T16:00:35.978 INFO:tasks.rados.rados.0.smithi033.stdout:1101: read oid 7 snap -1 2021-07-26T16:00:35.978 INFO:tasks.rados.rados.0.smithi033.stdout:1101: expect deleted 2021-07-26T16:00:35.978 INFO:tasks.rados.rados.0.smithi033.stdout:1102: delete oid 35 current snap is 111 2021-07-26T16:00:35.978 INFO:tasks.rados.rados.0.smithi033.stdout:1097: finishing write tid 3 to smithi03339061-4 2021-07-26T16:00:35.979 INFO:tasks.rados.rados.0.smithi033.stdout:1097: finishing write tid 4 to smithi03339061-4 2021-07-26T16:00:35.979 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 468 (ObjNum 339 snap 111 seq_num 339) dirty exists 2021-07-26T16:00:35.979 INFO:tasks.rados.rados.0.smithi033.stdout:1097: left oid 4 (ObjNum 339 snap 111 seq_num 339) 2021-07-26T16:00:35.980 INFO:tasks.rados.rados.0.smithi033.stdout:1099: finishing rollback tid 1 to smithi03339061-6 2021-07-26T16:00:35.980 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 537 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T16:00:35.982 INFO:tasks.rados.rados.0.smithi033.stdout:1097: done (3 left) 2021-07-26T16:00:35.983 INFO:tasks.rados.rados.0.smithi033.stdout:1099: done (2 left) 2021-07-26T16:00:35.983 INFO:tasks.rados.rados.0.smithi033.stdout:1101: done (1 left) 2021-07-26T16:00:35.983 INFO:tasks.rados.rados.0.smithi033.stdout:1102: done (0 left) 2021-07-26T16:00:35.983 INFO:tasks.rados.rados.0.smithi033.stdout:1103: rollback oid 8 current snap is 111 2021-07-26T16:00:35.984 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 8 to 107 2021-07-26T16:00:35.984 INFO:tasks.rados.rados.0.smithi033.stdout:1104: rmattr oid 2 current snap is 111 2021-07-26T16:00:35.984 INFO:tasks.rados.rados.0.smithi033.stdout:1104: done (1 left) 2021-07-26T16:00:35.984 INFO:tasks.rados.rados.0.smithi033.stdout:1105: delete oid 9 current snap is 111 2021-07-26T16:00:35.985 INFO:tasks.rados.rados.0.smithi033.stdout:1103: finishing rollback tid 0 to smithi03339061-8 2021-07-26T16:00:35.987 INFO:tasks.rados.rados.0.smithi033.stdout:1103: finishing rollback tid 1 to smithi03339061-8 2021-07-26T16:00:35.987 INFO:tasks.rados.rados.0.smithi033.stdout:1103: finishing rollback tid 2 to smithi03339061-8 2021-07-26T16:00:35.988 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 328 (ObjNum 301 snap 97 seq_num 301) dirty exists 2021-07-26T16:00:35.989 INFO:tasks.rados.rados.0.smithi033.stdout:1103: done (1 left) 2021-07-26T16:00:35.989 INFO:tasks.rados.rados.0.smithi033.stdout:1105: done (0 left) 2021-07-26T16:00:35.989 INFO:tasks.rados.rados.0.smithi033.stdout:1106: read oid 26 snap -1 2021-07-26T16:00:35.989 INFO:tasks.rados.rados.0.smithi033.stdout:1106: expect (ObjNum 232 snap 65 seq_num 232) 2021-07-26T16:00:35.990 INFO:tasks.rados.rados.0.smithi033.stdout:1107: rollback oid 9 current snap is 111 2021-07-26T16:00:35.990 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 9 to 109 2021-07-26T16:00:35.990 INFO:tasks.rados.rados.0.smithi033.stdout:1108: snap_remove snap 100 2021-07-26T16:00:36.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:36 smithi033 bash[41341]: cluster 2021-07-26T16:00:34.994461+0000 mgr.y (mgr.34104) 140 : cluster [DBG] pgmap v204: 25 pgs: 1 active+clean+wait, 24 active+clean; 189 MiB data, 698 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 208 KiB/s wr, 2 op/s 2021-07-26T16:00:36.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:36 smithi033 bash[41341]: cluster 2021-07-26T16:00:35.113646+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-07-26T16:00:36.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:36 smithi033 bash[41341]: audit 2021-07-26T16:00:35.906091+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:36.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:36 smithi033 bash[41341]: cluster 2021-07-26T16:00:35.972610+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-07-26T16:00:36.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:36 smithi033 bash[42377]: cluster 2021-07-26T16:00:34.994461+0000 mgr.y (mgr.34104) 140 : cluster [DBG] pgmap v204: 25 pgs: 1 active+clean+wait, 24 active+clean; 189 MiB data, 698 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 208 KiB/s wr, 2 op/s 2021-07-26T16:00:36.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:36 smithi033 bash[42377]: cluster 2021-07-26T16:00:35.113646+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-07-26T16:00:36.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:36 smithi033 bash[42377]: audit 2021-07-26T16:00:35.906091+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:36.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:36 smithi033 bash[42377]: cluster 2021-07-26T16:00:35.972610+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-07-26T16:00:36.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:36 smithi096 bash[33981]: cluster 2021-07-26T16:00:34.994461+0000 mgr.y (mgr.34104) 140 : cluster [DBG] pgmap v204: 25 pgs: 1 active+clean+wait, 24 active+clean; 189 MiB data, 698 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 208 KiB/s wr, 2 op/s 2021-07-26T16:00:36.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:36 smithi096 bash[33981]: cluster 2021-07-26T16:00:35.113646+0000 mon.a (mon.0) 360 : cluster [DBG] osdmap e275: 8 total, 8 up, 8 in 2021-07-26T16:00:36.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:36 smithi096 bash[33981]: audit 2021-07-26T16:00:35.906091+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:36.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:36 smithi096 bash[33981]: cluster 2021-07-26T16:00:35.972610+0000 mon.a (mon.0) 361 : cluster [DBG] osdmap e276: 8 total, 8 up, 8 in 2021-07-26T16:00:36.990 INFO:tasks.rados.rados.0.smithi033.stdout:1108: done (2 left) 2021-07-26T16:00:36.990 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 111 2021-07-26T16:00:36.990 INFO:tasks.rados.rados.0.smithi033.stdout:1109: seq_num 343 ranges {0=548864,548864=401408} 2021-07-26T16:00:36.995 INFO:tasks.rados.rados.0.smithi033.stdout:1109: writing smithi03339061-29 from 0 to 548864 tid 1 2021-07-26T16:00:37.000 INFO:tasks.rados.rados.0.smithi033.stdout:1109: writing smithi03339061-29 from 548864 to 950272 tid 2 2021-07-26T16:00:37.000 INFO:tasks.rados.rados.0.smithi033.stdout:1107: finishing rollback tid 1 to smithi03339061-9 2021-07-26T16:00:37.000 INFO:tasks.rados.rados.0.smithi033.stdout:1107: finishing rollback tid 2 to smithi03339061-9 2021-07-26T16:00:37.000 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 332 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T16:00:37.001 INFO:tasks.rados.rados.0.smithi033.stdout:1106: expect (ObjNum 232 snap 65 seq_num 232) 2021-07-26T16:00:37.074 INFO:tasks.rados.rados.0.smithi033.stdout:1109: finishing write tid 1 to smithi03339061-29 2021-07-26T16:00:37.074 INFO:tasks.rados.rados.0.smithi033.stdout:1109: finishing write tid 2 to smithi03339061-29 2021-07-26T16:00:37.075 INFO:tasks.rados.rados.0.smithi033.stdout:1109: finishing write tid 3 to smithi03339061-29 2021-07-26T16:00:37.075 INFO:tasks.rados.rados.0.smithi033.stdout:1109: finishing write tid 4 to smithi03339061-29 2021-07-26T16:00:37.075 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 182 (ObjNum 343 snap 111 seq_num 343) dirty exists 2021-07-26T16:00:37.075 INFO:tasks.rados.rados.0.smithi033.stdout:1109: left oid 29 (ObjNum 343 snap 111 seq_num 343) 2021-07-26T16:00:37.076 INFO:tasks.rados.rados.0.smithi033.stdout:1106: done (2 left) 2021-07-26T16:00:37.076 INFO:tasks.rados.rados.0.smithi033.stdout:1107: done (1 left) 2021-07-26T16:00:37.076 INFO:tasks.rados.rados.0.smithi033.stdout:1109: done (0 left) 2021-07-26T16:00:37.076 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 111 2021-07-26T16:00:37.077 INFO:tasks.rados.rados.0.smithi033.stdout:1110: seq_num 344 ranges {819200=565248,1384448=401408} 2021-07-26T16:00:37.088 INFO:tasks.rados.rados.0.smithi033.stdout:1110: writing smithi03339061-10 from 819200 to 1384448 tid 1 2021-07-26T16:00:37.092 INFO:tasks.rados.rados.0.smithi033.stdout:1110: writing smithi03339061-10 from 1384448 to 1785856 tid 2 2021-07-26T16:00:37.092 INFO:tasks.rados.rados.0.smithi033.stdout:1111: read oid 18 snap -1 2021-07-26T16:00:37.092 INFO:tasks.rados.rados.0.smithi033.stdout:1111: expect (ObjNum 327 snap 107 seq_num 327) 2021-07-26T16:00:37.093 INFO:tasks.rados.rados.0.smithi033.stdout:1112: copy_from oid 12 from oid 17 current snap is 111 2021-07-26T16:00:37.093 INFO:tasks.rados.rados.0.smithi033.stdout:1113: read oid 44 snap -1 2021-07-26T16:00:37.093 INFO:tasks.rados.rados.0.smithi033.stdout:1113: expect (ObjNum 232 snap 65 seq_num 232) 2021-07-26T16:00:37.093 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 111 2021-07-26T16:00:37.094 INFO:tasks.rados.rados.0.smithi033.stdout:1114: seq_num 345 ranges {10510336=581632,11091968=401408} 2021-07-26T16:00:37.155 INFO:tasks.rados.rados.0.smithi033.stdout:1114: writing smithi03339061-30 from 10510336 to 11091968 tid 1 2021-07-26T16:00:37.157 INFO:tasks.rados.rados.0.smithi033.stdout:1114: writing smithi03339061-30 from 11091968 to 11493376 tid 2 2021-07-26T16:00:37.157 INFO:tasks.rados.rados.0.smithi033.stdout:1115: snap_remove snap 76 2021-07-26T16:00:37.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:37 smithi033 bash[42377]: audit 2021-07-26T16:00:35.906477+0000 mgr.y (mgr.34104) 141 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:37.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:37 smithi033 bash[42377]: cephadm 2021-07-26T16:00:35.908706+0000 mgr.y (mgr.34104) 142 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-07-26T16:00:37.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:37 smithi033 bash[42377]: cluster 2021-07-26T16:00:36.986608+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-07-26T16:00:37.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:37 smithi033 bash[41341]: audit 2021-07-26T16:00:35.906477+0000 mgr.y (mgr.34104) 141 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:37.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:37 smithi033 bash[41341]: cephadm 2021-07-26T16:00:35.908706+0000 mgr.y (mgr.34104) 142 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-07-26T16:00:37.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:37 smithi033 bash[41341]: cluster 2021-07-26T16:00:36.986608+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-07-26T16:00:37.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:37 smithi096 bash[33981]: audit 2021-07-26T16:00:35.906477+0000 mgr.y (mgr.34104) 141 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2021-07-26T16:00:37.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:37 smithi096 bash[33981]: cephadm 2021-07-26T16:00:35.908706+0000 mgr.y (mgr.34104) 142 : cephadm [INF] Upgrade: osd.3 is safe to restart 2021-07-26T16:00:37.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:37 smithi096 bash[33981]: cluster 2021-07-26T16:00:36.986608+0000 mon.a (mon.0) 362 : cluster [DBG] osdmap e277: 8 total, 8 up, 8 in 2021-07-26T16:00:38.124 INFO:tasks.rados.rados.0.smithi033.stdout:1115: done (5 left) 2021-07-26T16:00:38.124 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 111 2021-07-26T16:00:38.125 INFO:tasks.rados.rados.0.smithi033.stdout:1116: seq_num 346 ranges {0=598016,598016=401408} 2021-07-26T16:00:38.129 INFO:tasks.rados.rados.0.smithi033.stdout:1116: writing smithi03339061-6 from 0 to 598016 tid 1 2021-07-26T16:00:38.133 INFO:tasks.rados.rados.0.smithi033.stdout:1116: writing smithi03339061-6 from 598016 to 999424 tid 2 2021-07-26T16:00:38.133 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 111 2021-07-26T16:00:38.133 INFO:tasks.rados.rados.0.smithi033.stdout:1117: seq_num 347 ranges {0=614400,614400=401408} 2021-07-26T16:00:38.139 INFO:tasks.rados.rados.0.smithi033.stdout:1117: writing smithi03339061-7 from 0 to 614400 tid 1 2021-07-26T16:00:38.143 INFO:tasks.rados.rados.0.smithi033.stdout:1117: writing smithi03339061-7 from 614400 to 1015808 tid 2 2021-07-26T16:00:38.143 INFO:tasks.rados.rados.0.smithi033.stdout:1118: snap_remove snap 106 2021-07-26T16:00:38.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:38 smithi033 bash[41341]: cluster 2021-07-26T16:00:36.995094+0000 mgr.y (mgr.34104) 143 : cluster [DBG] pgmap v208: 25 pgs: 1 active+clean+wait, 24 active+clean; 190 MiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 434 KiB/s wr, 4 op/s 2021-07-26T16:00:38.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:38 smithi033 bash[42377]: cluster 2021-07-26T16:00:36.995094+0000 mgr.y (mgr.34104) 143 : cluster [DBG] pgmap v208: 25 pgs: 1 active+clean+wait, 24 active+clean; 190 MiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 434 KiB/s wr, 4 op/s 2021-07-26T16:00:38.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:38 smithi096 bash[33981]: cluster 2021-07-26T16:00:36.995094+0000 mgr.y (mgr.34104) 143 : cluster [DBG] pgmap v208: 25 pgs: 1 active+clean+wait, 24 active+clean; 190 MiB data, 698 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 434 KiB/s wr, 4 op/s 2021-07-26T16:00:39.153 INFO:tasks.rados.rados.0.smithi033.stdout:1118: done (7 left) 2021-07-26T16:00:39.153 INFO:tasks.rados.rados.0.smithi033.stdout:1119: rollback oid 27 current snap is 111 2021-07-26T16:00:39.154 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 27 to 102 2021-07-26T16:00:39.154 INFO:tasks.rados.rados.0.smithi033.stdout:1120: read oid 35 snap -1 2021-07-26T16:00:39.154 INFO:tasks.rados.rados.0.smithi033.stdout:1120: expect deleted 2021-07-26T16:00:39.155 INFO:tasks.rados.rados.0.smithi033.stdout:1121: read oid 41 snap -1 2021-07-26T16:00:39.155 INFO:tasks.rados.rados.0.smithi033.stdout:1121: expect (ObjNum 313 snap 100 seq_num 313) 2021-07-26T16:00:39.156 INFO:tasks.rados.rados.0.smithi033.stdout:1122: rollback oid 5 current snap is 111 2021-07-26T16:00:39.156 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 5 to 102 2021-07-26T16:00:39.156 INFO:tasks.rados.rados.0.smithi033.stdout:1123: read oid 34 snap 107 2021-07-26T16:00:39.157 INFO:tasks.rados.rados.0.smithi033.stdout:1123: expect (ObjNum 214 snap 57 seq_num 214) 2021-07-26T16:00:39.157 INFO:tasks.rados.rados.0.smithi033.stdout:1124: setattr oid 21 current snap is 111 2021-07-26T16:00:39.157 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 111 2021-07-26T16:00:39.157 INFO:tasks.rados.rados.0.smithi033.stdout:1125: seq_num 348 ranges {3063808=630784,3694592=401408} 2021-07-26T16:00:39.172 INFO:tasks.rados.rados.0.smithi033.stdout:1125: writing smithi03339061-48 from 3063808 to 3694592 tid 1 2021-07-26T16:00:39.176 INFO:tasks.rados.rados.0.smithi033.stdout:1125: writing smithi03339061-48 from 3694592 to 4096000 tid 2 2021-07-26T16:00:39.176 INFO:tasks.rados.rados.0.smithi033.stdout:1126: read oid 2 snap -1 2021-07-26T16:00:39.176 INFO:tasks.rados.rados.0.smithi033.stdout:1126: expect (ObjNum 268 snap 82 seq_num 268) 2021-07-26T16:00:39.177 INFO:tasks.rados.rados.0.smithi033.stdout:1127: delete oid 1 current snap is 111 2021-07-26T16:00:39.177 INFO:tasks.rados.rados.0.smithi033.stdout:1110: finishing write tid 1 to smithi03339061-10 2021-07-26T16:00:39.178 INFO:tasks.rados.rados.0.smithi033.stdout:1110: finishing write tid 2 to smithi03339061-10 2021-07-26T16:00:39.178 INFO:tasks.rados.rados.0.smithi033.stdout:1110: finishing write tid 3 to smithi03339061-10 2021-07-26T16:00:39.179 INFO:tasks.rados.rados.0.smithi033.stdout:1111: expect (ObjNum 327 snap 107 seq_num 327) 2021-07-26T16:00:39.194 INFO:tasks.rados.rados.0.smithi033.stdout:1110: finishing write tid 4 to smithi03339061-10 2021-07-26T16:00:39.194 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 472 (ObjNum 344 snap 111 seq_num 344) dirty exists 2021-07-26T16:00:39.195 INFO:tasks.rados.rados.0.smithi033.stdout:1110: left oid 10 (ObjNum 344 snap 111 seq_num 344) 2021-07-26T16:00:39.195 INFO:tasks.rados.rados.0.smithi033.stdout:1113: expect (ObjNum 232 snap 65 seq_num 232) 2021-07-26T16:00:39.266 INFO:tasks.rados.rados.0.smithi033.stdout:1112: finishing copy_from to smithi03339061-12 2021-07-26T16:00:39.267 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 198 (ObjNum 295 snap 91 seq_num 295) dirty exists 2021-07-26T16:00:39.267 INFO:tasks.rados.rados.0.smithi033.stdout:1110: done (15 left) 2021-07-26T16:00:39.267 INFO:tasks.rados.rados.0.smithi033.stdout:1111: done (14 left) 2021-07-26T16:00:39.267 INFO:tasks.rados.rados.0.smithi033.stdout:1113: done (13 left) 2021-07-26T16:00:39.268 INFO:tasks.rados.rados.0.smithi033.stdout:1127: done (12 left) 2021-07-26T16:00:39.268 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 111 2021-07-26T16:00:39.268 INFO:tasks.rados.rados.0.smithi033.stdout:1112: finishing copy_from racing read to smithi03339061-12 2021-07-26T16:00:39.269 INFO:tasks.rados.rados.0.smithi033.stdout:1114: finishing write tid 1 to smithi03339061-30 2021-07-26T16:00:39.269 INFO:tasks.rados.rados.0.smithi033.stdout:1114: finishing write tid 2 to smithi03339061-30 2021-07-26T16:00:39.269 INFO:tasks.rados.rados.0.smithi033.stdout:1114: finishing write tid 3 to smithi03339061-30 2021-07-26T16:00:39.269 INFO:tasks.rados.rados.0.smithi033.stdout:1114: finishing write tid 4 to smithi03339061-30 2021-07-26T16:00:39.270 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 476 (ObjNum 345 snap 111 seq_num 345) dirty exists 2021-07-26T16:00:39.270 INFO:tasks.rados.rados.0.smithi033.stdout:1114: left oid 30 (ObjNum 345 snap 111 seq_num 345) 2021-07-26T16:00:39.270 INFO:tasks.rados.rados.0.smithi033.stdout:1128: seq_num 350 ranges {770048=671744,1441792=401408} 2021-07-26T16:00:39.274 INFO:tasks.rados.rados.0.smithi033.stdout:1128: writing smithi03339061-49 from 770048 to 1441792 tid 1 2021-07-26T16:00:39.277 INFO:tasks.rados.rados.0.smithi033.stdout:1128: writing smithi03339061-49 from 1441792 to 1843200 tid 2 2021-07-26T16:00:39.277 INFO:tasks.rados.rados.0.smithi033.stdout:1112: done (12 left) 2021-07-26T16:00:39.277 INFO:tasks.rados.rados.0.smithi033.stdout:1114: done (11 left) 2021-07-26T16:00:39.277 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 111 2021-07-26T16:00:39.278 INFO:tasks.rados.rados.0.smithi033.stdout:1116: finishing write tid 1 to smithi03339061-6 2021-07-26T16:00:39.278 INFO:tasks.rados.rados.0.smithi033.stdout:1129: seq_num 351 ranges {2416640=688128,3104768=401408} 2021-07-26T16:00:39.294 INFO:tasks.rados.rados.0.smithi033.stdout:1129: writing smithi03339061-12 from 2416640 to 3104768 tid 1 2021-07-26T16:00:39.296 INFO:tasks.rados.rados.0.smithi033.stdout:1129: writing smithi03339061-12 from 3104768 to 3506176 tid 2 2021-07-26T16:00:39.297 INFO:tasks.rados.rados.0.smithi033.stdout:1130: read oid 11 snap -1 2021-07-26T16:00:39.297 INFO:tasks.rados.rados.0.smithi033.stdout:1130: expect (ObjNum 312 snap 100 seq_num 312) 2021-07-26T16:00:39.297 INFO:tasks.rados.rados.0.smithi033.stdout:1131: read oid 30 snap -1 2021-07-26T16:00:39.297 INFO:tasks.rados.rados.0.smithi033.stdout:1131: expect (ObjNum 345 snap 111 seq_num 345) 2021-07-26T16:00:39.298 INFO:tasks.rados.rados.0.smithi033.stdout:1132: snap_remove snap 104 2021-07-26T16:00:39.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:39 smithi033 bash[41341]: cluster 2021-07-26T16:00:38.119397+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-07-26T16:00:39.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:39 smithi033 bash[41341]: cephadm 2021-07-26T16:00:38.542237+0000 mgr.y (mgr.34104) 144 : cephadm [INF] Upgrade: Updating osd.3 2021-07-26T16:00:39.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:39 smithi033 bash[41341]: audit 2021-07-26T16:00:38.552807+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:39.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:39 smithi033 bash[41341]: cephadm 2021-07-26T16:00:38.555309+0000 mgr.y (mgr.34104) 145 : cephadm [INF] Deploying daemon osd.3 on smithi033 2021-07-26T16:00:39.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:39 smithi033 bash[42377]: cluster 2021-07-26T16:00:38.119397+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-07-26T16:00:39.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:39 smithi033 bash[42377]: cephadm 2021-07-26T16:00:38.542237+0000 mgr.y (mgr.34104) 144 : cephadm [INF] Upgrade: Updating osd.3 2021-07-26T16:00:39.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:39 smithi033 bash[42377]: audit 2021-07-26T16:00:38.552807+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:39.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:39 smithi033 bash[42377]: cephadm 2021-07-26T16:00:38.555309+0000 mgr.y (mgr.34104) 145 : cephadm [INF] Deploying daemon osd.3 on smithi033 2021-07-26T16:00:39.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:39 smithi096 bash[33981]: cluster 2021-07-26T16:00:38.119397+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e278: 8 total, 8 up, 8 in 2021-07-26T16:00:39.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:39 smithi096 bash[33981]: cephadm 2021-07-26T16:00:38.542237+0000 mgr.y (mgr.34104) 144 : cephadm [INF] Upgrade: Updating osd.3 2021-07-26T16:00:39.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:39 smithi096 bash[33981]: audit 2021-07-26T16:00:38.552807+0000 mon.a (mon.0) 364 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:39.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:39 smithi096 bash[33981]: cephadm 2021-07-26T16:00:38.555309+0000 mgr.y (mgr.34104) 145 : cephadm [INF] Deploying daemon osd.3 on smithi033 2021-07-26T16:00:40.153 INFO:tasks.rados.rados.0.smithi033.stdout:1132: done (14 left) 2021-07-26T16:00:40.153 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 111 2021-07-26T16:00:40.154 INFO:tasks.rados.rados.0.smithi033.stdout:1117: finishing write tid 1 to smithi03339061-7 2021-07-26T16:00:40.154 INFO:tasks.rados.rados.0.smithi033.stdout:1117: finishing write tid 2 to smithi03339061-7 2021-07-26T16:00:40.154 INFO:tasks.rados.rados.0.smithi033.stdout:1116: finishing write tid 2 to smithi03339061-6 2021-07-26T16:00:40.155 INFO:tasks.rados.rados.0.smithi033.stdout:1133: seq_num 352 ranges {679936=704512,1384448=401408} 2021-07-26T16:00:40.162 INFO:tasks.rados.rados.0.smithi033.stdout:1133: writing smithi03339061-18 from 679936 to 1384448 tid 1 2021-07-26T16:00:40.165 INFO:tasks.rados.rados.0.smithi033.stdout:1133: writing smithi03339061-18 from 1384448 to 1785856 tid 2 2021-07-26T16:00:40.165 INFO:tasks.rados.rados.0.smithi033.stdout:1134: snap_create 2021-07-26T16:00:40.166 INFO:tasks.rados.rados.0.smithi033.stdout:1116: finishing write tid 3 to smithi03339061-6 2021-07-26T16:00:40.166 INFO:tasks.rados.rados.0.smithi033.stdout:1117: finishing write tid 3 to smithi03339061-7 2021-07-26T16:00:40.166 INFO:tasks.rados.rados.0.smithi033.stdout:1117: finishing write tid 4 to smithi03339061-7 2021-07-26T16:00:40.166 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 508 (ObjNum 347 snap 111 seq_num 347) dirty exists 2021-07-26T16:00:40.167 INFO:tasks.rados.rados.0.smithi033.stdout:1117: left oid 7 (ObjNum 347 snap 111 seq_num 347) 2021-07-26T16:00:40.167 INFO:tasks.rados.rados.0.smithi033.stdout:1116: finishing write tid 4 to smithi03339061-6 2021-07-26T16:00:40.167 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 641 (ObjNum 346 snap 111 seq_num 346) dirty exists 2021-07-26T16:00:40.167 INFO:tasks.rados.rados.0.smithi033.stdout:1116: left oid 6 (ObjNum 346 snap 111 seq_num 346) 2021-07-26T16:00:40.168 INFO:tasks.rados.rados.0.smithi033.stdout:1123: expect (ObjNum 214 snap 57 seq_num 214) 2021-07-26T16:00:40.204 INFO:tasks.rados.rados.0.smithi033.stdout:1119: finishing rollback tid 0 to smithi03339061-27 2021-07-26T16:00:40.204 INFO:tasks.rados.rados.0.smithi033.stdout:1121: expect (ObjNum 313 snap 100 seq_num 313) 2021-07-26T16:00:40.216 INFO:tasks.rados.rados.0.smithi033.stdout:1122: finishing rollback tid 0 to smithi03339061-5 2021-07-26T16:00:40.216 INFO:tasks.rados.rados.0.smithi033.stdout:1122: finishing rollback tid 1 to smithi03339061-5 2021-07-26T16:00:40.216 INFO:tasks.rados.rados.0.smithi033.stdout:1122: finishing rollback tid 2 to smithi03339061-5 2021-07-26T16:00:40.216 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 373 (ObjNum 296 snap 93 seq_num 296) dirty exists 2021-07-26T16:00:40.217 INFO:tasks.rados.rados.0.smithi033.stdout:1119: finishing rollback tid 1 to smithi03339061-27 2021-07-26T16:00:40.217 INFO:tasks.rados.rados.0.smithi033.stdout:1119: finishing rollback tid 2 to smithi03339061-27 2021-07-26T16:00:40.217 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 518 (ObjNum 321 snap 102 seq_num 321) dirty exists 2021-07-26T16:00:40.217 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 520 (ObjNum 275 snap 85 seq_num 275) dirty exists 2021-07-26T16:00:40.218 INFO:tasks.rados.rados.0.smithi033.stdout:1125: finishing write tid 1 to smithi03339061-48 2021-07-26T16:00:40.218 INFO:tasks.rados.rados.0.smithi033.stdout:1125: finishing write tid 2 to smithi03339061-48 2021-07-26T16:00:40.218 INFO:tasks.rados.rados.0.smithi033.stdout:1125: finishing write tid 3 to smithi03339061-48 2021-07-26T16:00:40.218 INFO:tasks.rados.rados.0.smithi033.stdout:1126: expect (ObjNum 268 snap 82 seq_num 268) 2021-07-26T16:00:40.272 INFO:tasks.rados.rados.0.smithi033.stdout:1125: finishing write tid 4 to smithi03339061-48 2021-07-26T16:00:40.273 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 381 (ObjNum 348 snap 111 seq_num 348) dirty exists 2021-07-26T16:00:40.273 INFO:tasks.rados.rados.0.smithi033.stdout:1125: left oid 48 (ObjNum 348 snap 111 seq_num 348) 2021-07-26T16:00:40.273 INFO:tasks.rados.rados.0.smithi033.stdout:1128: finishing write tid 1 to smithi03339061-49 2021-07-26T16:00:40.273 INFO:tasks.rados.rados.0.smithi033.stdout:1128: finishing write tid 2 to smithi03339061-49 2021-07-26T16:00:40.274 INFO:tasks.rados.rados.0.smithi033.stdout:1128: finishing write tid 3 to smithi03339061-49 2021-07-26T16:00:40.274 INFO:tasks.rados.rados.0.smithi033.stdout:1128: finishing write tid 4 to smithi03339061-49 2021-07-26T16:00:40.274 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 273 (ObjNum 350 snap 111 seq_num 350) dirty exists 2021-07-26T16:00:40.274 INFO:tasks.rados.rados.0.smithi033.stdout:1128: left oid 49 (ObjNum 350 snap 111 seq_num 350) 2021-07-26T16:00:40.274 INFO:tasks.rados.rados.0.smithi033.stdout:1129: finishing write tid 1 to smithi03339061-12 2021-07-26T16:00:40.275 INFO:tasks.rados.rados.0.smithi033.stdout:1129: finishing write tid 2 to smithi03339061-12 2021-07-26T16:00:40.275 INFO:tasks.rados.rados.0.smithi033.stdout:1129: finishing write tid 3 to smithi03339061-12 2021-07-26T16:00:40.275 INFO:tasks.rados.rados.0.smithi033.stdout:1129: finishing write tid 4 to smithi03339061-12 2021-07-26T16:00:40.275 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 295 (ObjNum 351 snap 111 seq_num 351) dirty exists 2021-07-26T16:00:40.275 INFO:tasks.rados.rados.0.smithi033.stdout:1129: left oid 12 (ObjNum 351 snap 111 seq_num 351) 2021-07-26T16:00:40.276 INFO:tasks.rados.rados.0.smithi033.stdout:1130: expect (ObjNum 312 snap 100 seq_num 312) 2021-07-26T16:00:40.400 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:40 smithi033 bash[42377]: cluster 2021-07-26T16:00:38.995870+0000 mgr.y (mgr.34104) 146 : cluster [DBG] pgmap v210: 25 pgs: 2 active+clean+snaptrim, 1 active+clean+wait, 22 active+clean; 190 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 216 KiB/s wr, 7 op/s 2021-07-26T16:00:40.401 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:40 smithi033 bash[42377]: cluster 2021-07-26T16:00:39.138317+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-07-26T16:00:40.401 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:40 smithi033 bash[42377]: audit 2021-07-26T16:00:39.388109+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:40.401 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:40 smithi033 bash[41341]: cluster 2021-07-26T16:00:38.995870+0000 mgr.y (mgr.34104) 146 : cluster [DBG] pgmap v210: 25 pgs: 2 active+clean+snaptrim, 1 active+clean+wait, 22 active+clean; 190 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 216 KiB/s wr, 7 op/s 2021-07-26T16:00:40.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:40 smithi033 bash[41341]: cluster 2021-07-26T16:00:39.138317+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-07-26T16:00:40.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:40 smithi033 bash[41341]: audit 2021-07-26T16:00:39.388109+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:40.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:40 smithi096 bash[33981]: cluster 2021-07-26T16:00:38.995870+0000 mgr.y (mgr.34104) 146 : cluster [DBG] pgmap v210: 25 pgs: 2 active+clean+snaptrim, 1 active+clean+wait, 22 active+clean; 190 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 1.9 MiB/s rd, 216 KiB/s wr, 7 op/s 2021-07-26T16:00:40.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:40 smithi096 bash[33981]: cluster 2021-07-26T16:00:39.138317+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e279: 8 total, 8 up, 8 in 2021-07-26T16:00:40.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:40 smithi096 bash[33981]: audit 2021-07-26T16:00:39.388109+0000 mon.a (mon.0) 366 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:40.791 INFO:tasks.rados.rados.0.smithi033.stdout:1131: expect (ObjNum 345 snap 111 seq_num 345) 2021-07-26T16:00:41.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:41 smithi033 bash[41341]: cluster 2021-07-26T16:00:40.150169+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-07-26T16:00:41.232 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:41 smithi033 bash[41341]: cluster 2021-07-26T16:00:40.972428+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-07-26T16:00:41.232 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:41 smithi033 bash[42377]: cluster 2021-07-26T16:00:40.150169+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-07-26T16:00:41.233 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:41 smithi033 bash[42377]: cluster 2021-07-26T16:00:40.972428+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-07-26T16:00:41.233 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:41 smithi033 systemd[1]: Stopping Ceph osd.3 for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T16:00:41.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:41 smithi096 bash[33981]: cluster 2021-07-26T16:00:40.150169+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e280: 8 total, 8 up, 8 in 2021-07-26T16:00:41.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:41 smithi096 bash[33981]: cluster 2021-07-26T16:00:40.972428+0000 mon.a (mon.0) 368 : cluster [DBG] osdmap e281: 8 total, 8 up, 8 in 2021-07-26T16:00:41.533 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:41 smithi033 docker[48051]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:00:41.534 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:41 smithi033 bash[29474]: debug 2021-07-26T16:00:41.296+0000 7f0add4e9700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-07-26T16:00:41.534 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:41 smithi033 bash[29474]: debug 2021-07-26T16:00:41.296+0000 7f0add4e9700 -1 osd.3 280 *** Got signal Terminated *** 2021-07-26T16:00:41.535 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:41 smithi033 bash[29474]: debug 2021-07-26T16:00:41.296+0000 7f0add4e9700 -1 osd.3 280 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:00:41.888 INFO:tasks.rados.rados.0.smithi033.stdout:1133: finishing write tid 1 to smithi03339061-18 2021-07-26T16:00:41.888 INFO:tasks.rados.rados.0.smithi033.stdout:1133: finishing write tid 2 to smithi03339061-18 2021-07-26T16:00:41.888 INFO:tasks.rados.rados.0.smithi033.stdout:1133: finishing write tid 3 to smithi03339061-18 2021-07-26T16:00:41.889 INFO:tasks.rados.rados.0.smithi033.stdout:1133: finishing write tid 4 to smithi03339061-18 2021-07-26T16:00:41.889 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 663 (ObjNum 352 snap 111 seq_num 352) dirty exists 2021-07-26T16:00:41.889 INFO:tasks.rados.rados.0.smithi033.stdout:1133: left oid 18 (ObjNum 352 snap 111 seq_num 352) 2021-07-26T16:00:41.890 INFO:tasks.rados.rados.0.smithi033.stdout:1116: done (15 left) 2021-07-26T16:00:41.890 INFO:tasks.rados.rados.0.smithi033.stdout:1117: done (14 left) 2021-07-26T16:00:41.890 INFO:tasks.rados.rados.0.smithi033.stdout:1119: done (13 left) 2021-07-26T16:00:41.890 INFO:tasks.rados.rados.0.smithi033.stdout:1120: done (12 left) 2021-07-26T16:00:41.891 INFO:tasks.rados.rados.0.smithi033.stdout:1121: done (11 left) 2021-07-26T16:00:41.891 INFO:tasks.rados.rados.0.smithi033.stdout:1122: done (10 left) 2021-07-26T16:00:41.891 INFO:tasks.rados.rados.0.smithi033.stdout:1123: done (9 left) 2021-07-26T16:00:41.891 INFO:tasks.rados.rados.0.smithi033.stdout:1124: done (8 left) 2021-07-26T16:00:41.892 INFO:tasks.rados.rados.0.smithi033.stdout:1125: done (7 left) 2021-07-26T16:00:41.892 INFO:tasks.rados.rados.0.smithi033.stdout:1126: done (6 left) 2021-07-26T16:00:41.892 INFO:tasks.rados.rados.0.smithi033.stdout:1128: done (5 left) 2021-07-26T16:00:41.893 INFO:tasks.rados.rados.0.smithi033.stdout:1129: done (4 left) 2021-07-26T16:00:41.893 INFO:tasks.rados.rados.0.smithi033.stdout:1130: done (3 left) 2021-07-26T16:00:41.893 INFO:tasks.rados.rados.0.smithi033.stdout:1131: done (2 left) 2021-07-26T16:00:41.894 INFO:tasks.rados.rados.0.smithi033.stdout:1133: done (1 left) 2021-07-26T16:00:41.894 INFO:tasks.rados.rados.0.smithi033.stdout:1134: done (0 left) 2021-07-26T16:00:41.894 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 34 current snap is 112 2021-07-26T16:00:41.894 INFO:tasks.rados.rados.0.smithi033.stdout:1135: seq_num 353 ranges {1196032=720896,1916928=401408} 2021-07-26T16:00:41.908 INFO:tasks.rados.rados.0.smithi033.stdout:1135: writing smithi03339061-34 from 1196032 to 1916928 tid 1 2021-07-26T16:00:41.910 INFO:tasks.rados.rados.0.smithi033.stdout:1135: writing smithi03339061-34 from 1916928 to 2318336 tid 2 2021-07-26T16:00:41.911 INFO:tasks.rados.rados.0.smithi033.stdout:1136: read oid 37 snap -1 2021-07-26T16:00:41.911 INFO:tasks.rados.rados.0.smithi033.stdout:1136: expect (ObjNum 279 snap 86 seq_num 279) 2021-07-26T16:00:41.911 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 112 2021-07-26T16:00:41.911 INFO:tasks.rados.rados.0.smithi033.stdout:1137: seq_num 354 ranges {2097152=737280,2834432=401408} 2021-07-26T16:00:41.926 INFO:tasks.rados.rados.0.smithi033.stdout:1137: writing smithi03339061-2 from 2097152 to 2834432 tid 1 2021-07-26T16:00:41.928 INFO:tasks.rados.rados.0.smithi033.stdout:1137: writing smithi03339061-2 from 2834432 to 3235840 tid 2 2021-07-26T16:00:41.929 INFO:tasks.rados.rados.0.smithi033.stdout:1138: snap_remove snap 97 2021-07-26T16:00:42.170 INFO:tasks.rados.rados.0.smithi033.stdout:1138: done (3 left) 2021-07-26T16:00:42.171 INFO:tasks.rados.rados.0.smithi033.stdout:1139: copy_from oid 43 from oid 23 current snap is 112 2021-07-26T16:00:42.171 INFO:tasks.rados.rados.0.smithi033.stdout:1140: snap_create 2021-07-26T16:00:42.458 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:42 smithi033 docker[48051]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-osd.3 2021-07-26T16:00:42.459 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[48091]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:00:42.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:40.996385+0000 mgr.y (mgr.34104) 147 : cluster [DBG] pgmap v214: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 184 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 20 MiB/s rd, 2.5 MiB/s wr, 28 op/s 2021-07-26T16:00:42.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.584363+0000 mon.a (mon.0) 369 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.584520+0000 mon.a (mon.0) 370 : cluster [INF] osd.3 failed (root=default,host=smithi033) (connection refused reported by osd.1) 2021-07-26T16:00:42.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.584913+0000 mon.a (mon.0) 371 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.585148+0000 mon.a (mon.0) 372 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.585450+0000 mon.a (mon.0) 373 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.585723+0000 mon.a (mon.0) 374 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.585940+0000 mon.a (mon.0) 375 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.586153+0000 mon.a (mon.0) 376 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.586359+0000 mon.a (mon.0) 377 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.586558+0000 mon.a (mon.0) 378 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.586831+0000 mon.a (mon.0) 379 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.587095+0000 mon.a (mon.0) 380 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.587323+0000 mon.a (mon.0) 381 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.587610+0000 mon.a (mon.0) 382 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.587825+0000 mon.a (mon.0) 383 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.911725+0000 mon.a (mon.0) 384 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.929726+0000 mon.a (mon.0) 385 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.988130+0000 mon.a (mon.0) 386 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.988525+0000 mon.a (mon.0) 387 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.988933+0000 mon.a (mon.0) 388 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.989257+0000 mon.a (mon.0) 389 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.989504+0000 mon.a (mon.0) 390 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.989735+0000 mon.a (mon.0) 391 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.989973+0000 mon.a (mon.0) 392 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:40.996385+0000 mgr.y (mgr.34104) 147 : cluster [DBG] pgmap v214: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 184 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 20 MiB/s rd, 2.5 MiB/s wr, 28 op/s 2021-07-26T16:00:42.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.584363+0000 mon.a (mon.0) 369 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.584520+0000 mon.a (mon.0) 370 : cluster [INF] osd.3 failed (root=default,host=smithi033) (connection refused reported by osd.1) 2021-07-26T16:00:42.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.584913+0000 mon.a (mon.0) 371 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.585148+0000 mon.a (mon.0) 372 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.585450+0000 mon.a (mon.0) 373 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.585723+0000 mon.a (mon.0) 374 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.585940+0000 mon.a (mon.0) 375 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.586153+0000 mon.a (mon.0) 376 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.586359+0000 mon.a (mon.0) 377 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.586558+0000 mon.a (mon.0) 378 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.586831+0000 mon.a (mon.0) 379 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.587095+0000 mon.a (mon.0) 380 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.587323+0000 mon.a (mon.0) 381 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.587610+0000 mon.a (mon.0) 382 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.587825+0000 mon.a (mon.0) 383 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.911725+0000 mon.a (mon.0) 384 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.929726+0000 mon.a (mon.0) 385 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.470 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.988130+0000 mon.a (mon.0) 386 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.988525+0000 mon.a (mon.0) 387 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.988933+0000 mon.a (mon.0) 388 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.989257+0000 mon.a (mon.0) 389 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.471 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.989504+0000 mon.a (mon.0) 390 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.989735+0000 mon.a (mon.0) 391 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.472 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.989973+0000 mon.a (mon.0) 392 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.990216+0000 mon.a (mon.0) 393 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.990446+0000 mon.a (mon.0) 394 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.990764+0000 mon.a (mon.0) 395 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.991097+0000 mon.a (mon.0) 396 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.991332+0000 mon.a (mon.0) 397 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.991610+0000 mon.a (mon.0) 398 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.474 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:41.991869+0000 mon.a (mon.0) 399 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.474 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:42.027519+0000 mon.a (mon.0) 400 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.474 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:42.112435+0000 mon.a (mon.0) 401 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.474 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[41341]: cluster 2021-07-26T16:00:42.132509+0000 mon.a (mon.0) 402 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.990216+0000 mon.a (mon.0) 393 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.990446+0000 mon.a (mon.0) 394 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.990764+0000 mon.a (mon.0) 395 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.991097+0000 mon.a (mon.0) 396 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.991332+0000 mon.a (mon.0) 397 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.991610+0000 mon.a (mon.0) 398 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:41.991869+0000 mon.a (mon.0) 399 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:42.027519+0000 mon.a (mon.0) 400 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:42.112435+0000 mon.a (mon.0) 401 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:42 smithi033 bash[42377]: cluster 2021-07-26T16:00:42.132509+0000 mon.a (mon.0) 402 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:40.996385+0000 mgr.y (mgr.34104) 147 : cluster [DBG] pgmap v214: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 184 MiB data, 695 MiB used, 715 GiB / 715 GiB avail; 20 MiB/s rd, 2.5 MiB/s wr, 28 op/s 2021-07-26T16:00:42.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.584363+0000 mon.a (mon.0) 369 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.584520+0000 mon.a (mon.0) 370 : cluster [INF] osd.3 failed (root=default,host=smithi033) (connection refused reported by osd.1) 2021-07-26T16:00:42.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.584913+0000 mon.a (mon.0) 371 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.585148+0000 mon.a (mon.0) 372 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.585450+0000 mon.a (mon.0) 373 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.585723+0000 mon.a (mon.0) 374 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.585940+0000 mon.a (mon.0) 375 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.586153+0000 mon.a (mon.0) 376 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.586359+0000 mon.a (mon.0) 377 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.586558+0000 mon.a (mon.0) 378 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.586831+0000 mon.a (mon.0) 379 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.587095+0000 mon.a (mon.0) 380 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.587323+0000 mon.a (mon.0) 381 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.587610+0000 mon.a (mon.0) 382 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.587825+0000 mon.a (mon.0) 383 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.911725+0000 mon.a (mon.0) 384 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.929726+0000 mon.a (mon.0) 385 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.988130+0000 mon.a (mon.0) 386 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.988525+0000 mon.a (mon.0) 387 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.988933+0000 mon.a (mon.0) 388 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.989257+0000 mon.a (mon.0) 389 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.989504+0000 mon.a (mon.0) 390 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.989735+0000 mon.a (mon.0) 391 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.989973+0000 mon.a (mon.0) 392 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.990216+0000 mon.a (mon.0) 393 : cluster [DBG] osd.3 reported immediately failed by osd.1 2021-07-26T16:00:42.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.990446+0000 mon.a (mon.0) 394 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.990764+0000 mon.a (mon.0) 395 : cluster [DBG] osd.3 reported immediately failed by osd.0 2021-07-26T16:00:42.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.991097+0000 mon.a (mon.0) 396 : cluster [DBG] osd.3 reported immediately failed by osd.6 2021-07-26T16:00:42.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.991332+0000 mon.a (mon.0) 397 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.991610+0000 mon.a (mon.0) 398 : cluster [DBG] osd.3 reported immediately failed by osd.4 2021-07-26T16:00:42.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:41.991869+0000 mon.a (mon.0) 399 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:42.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:42.027519+0000 mon.a (mon.0) 400 : cluster [DBG] osd.3 reported immediately failed by osd.2 2021-07-26T16:00:42.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:42.112435+0000 mon.a (mon.0) 401 : cluster [DBG] osd.3 reported immediately failed by osd.7 2021-07-26T16:00:42.494 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:42 smithi096 bash[33981]: cluster 2021-07-26T16:00:42.132509+0000 mon.a (mon.0) 402 : cluster [DBG] osd.3 reported immediately failed by osd.5 2021-07-26T16:00:43.183 INFO:tasks.rados.rados.0.smithi033.stdout:1140: done (4 left) 2021-07-26T16:00:43.184 INFO:tasks.rados.rados.0.smithi033.stdout:1141: copy_from oid 49 from oid 13 current snap is 113 2021-07-26T16:00:43.184 INFO:tasks.rados.rados.0.smithi033.stdout:1142: rollback oid 36 current snap is 113 2021-07-26T16:00:43.184 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 36 to 111 2021-07-26T16:00:43.185 INFO:tasks.rados.rados.0.smithi033.stdout:1143: delete oid 25 current snap is 113 2021-07-26T16:00:43.186 INFO:tasks.rados.rados.0.smithi033.stdout:1137: finishing write tid 1 to smithi03339061-2 2021-07-26T16:00:43.187 INFO:tasks.rados.rados.0.smithi033.stdout:1137: finishing write tid 2 to smithi03339061-2 2021-07-26T16:00:43.188 INFO:tasks.rados.rados.0.smithi033.stdout:1137: finishing write tid 3 to smithi03339061-2 2021-07-26T16:00:43.188 INFO:tasks.rados.rados.0.smithi033.stdout:1135: finishing write tid 1 to smithi03339061-34 2021-07-26T16:00:43.188 INFO:tasks.rados.rados.0.smithi033.stdout:1135: finishing write tid 2 to smithi03339061-34 2021-07-26T16:00:43.188 INFO:tasks.rados.rados.0.smithi033.stdout:1135: finishing write tid 3 to smithi03339061-34 2021-07-26T16:00:43.190 INFO:tasks.rados.rados.0.smithi033.stdout:1141: finishing copy_from to smithi03339061-49 2021-07-26T16:00:43.190 INFO:tasks.rados.rados.0.smithi033.stdout:1141: got expected ENOENT (src dne) 2021-07-26T16:00:43.191 INFO:tasks.rados.rados.0.smithi033.stdout:1141: finishing copy_from racing read to smithi03339061-49 2021-07-26T16:00:43.192 INFO:tasks.rados.rados.0.smithi033.stdout:1141: done (6 left) 2021-07-26T16:00:43.192 INFO:tasks.rados.rados.0.smithi033.stdout:1143: done (5 left) 2021-07-26T16:00:43.193 INFO:tasks.rados.rados.0.smithi033.stdout:1144: rollback oid 24 current snap is 113 2021-07-26T16:00:43.193 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 24 to 102 2021-07-26T16:00:43.193 INFO:tasks.rados.rados.0.smithi033.stdout:1145: delete oid 6 current snap is 113 2021-07-26T16:00:43.193 INFO:tasks.rados.rados.0.smithi033.stdout:1137: finishing write tid 4 to smithi03339061-2 2021-07-26T16:00:43.194 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 303 (ObjNum 354 snap 112 seq_num 354) dirty exists 2021-07-26T16:00:43.194 INFO:tasks.rados.rados.0.smithi033.stdout:1137: left oid 2 (ObjNum 354 snap 112 seq_num 354) 2021-07-26T16:00:43.195 INFO:tasks.rados.rados.0.smithi033.stdout:1142: finishing rollback tid 0 to smithi03339061-36 2021-07-26T16:00:43.195 INFO:tasks.rados.rados.0.smithi033.stdout:1135: finishing write tid 4 to smithi03339061-34 2021-07-26T16:00:43.196 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 411 (ObjNum 353 snap 112 seq_num 353) dirty exists 2021-07-26T16:00:43.196 INFO:tasks.rados.rados.0.smithi033.stdout:1135: left oid 34 (ObjNum 353 snap 112 seq_num 353) 2021-07-26T16:00:43.196 INFO:tasks.rados.rados.0.smithi033.stdout:1142: finishing rollback tid 1 to smithi03339061-36 2021-07-26T16:00:43.197 INFO:tasks.rados.rados.0.smithi033.stdout:1142: finishing rollback tid 2 to smithi03339061-36 2021-07-26T16:00:43.198 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 414 (ObjNum 323 snap 104 seq_num 323) dirty exists 2021-07-26T16:00:43.198 INFO:tasks.rados.rados.0.smithi033.stdout:1135: done (6 left) 2021-07-26T16:00:43.198 INFO:tasks.rados.rados.0.smithi033.stdout:1137: done (5 left) 2021-07-26T16:00:43.198 INFO:tasks.rados.rados.0.smithi033.stdout:1142: done (4 left) 2021-07-26T16:00:43.199 INFO:tasks.rados.rados.0.smithi033.stdout:1145: done (3 left) 2021-07-26T16:00:43.199 INFO:tasks.rados.rados.0.smithi033.stdout:1146: copy_from oid 1 from oid 39 current snap is 113 2021-07-26T16:00:43.200 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 113 2021-07-26T16:00:43.201 INFO:tasks.rados.rados.0.smithi033.stdout:1147: seq_num 357 ranges {0=786432,786432=401408} 2021-07-26T16:00:43.201 INFO:tasks.rados.rados.0.smithi033.stdout:1147: writing smithi03339061-20 from 0 to 786432 tid 1 2021-07-26T16:00:43.204 INFO:tasks.rados.rados.0.smithi033.stdout:1147: writing smithi03339061-20 from 786432 to 1187840 tid 2 2021-07-26T16:00:43.205 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 113 2021-07-26T16:00:43.205 INFO:tasks.rados.rados.0.smithi033.stdout:1146: finishing copy_from to smithi03339061-1 2021-07-26T16:00:43.206 INFO:tasks.rados.rados.0.smithi033.stdout:1146: got expected ENOENT (src dne) 2021-07-26T16:00:43.206 INFO:tasks.rados.rados.0.smithi033.stdout:1148: seq_num 358 ranges {11493376=802816,12296192=401408} 2021-07-26T16:00:43.274 INFO:tasks.rados.rados.0.smithi033.stdout:1148: writing smithi03339061-30 from 11493376 to 12296192 tid 1 2021-07-26T16:00:43.277 INFO:tasks.rados.rados.0.smithi033.stdout:1148: writing smithi03339061-30 from 12296192 to 12697600 tid 2 2021-07-26T16:00:43.277 INFO:tasks.rados.rados.0.smithi033.stdout:1149: rollback oid 10 current snap is 113 2021-07-26T16:00:43.278 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 10 to 88 2021-07-26T16:00:43.278 INFO:tasks.rados.rados.0.smithi033.stdout:1146: finishing copy_from racing read to smithi03339061-1 2021-07-26T16:00:43.278 INFO:tasks.rados.rados.0.smithi033.stdout:1146: done (6 left) 2021-07-26T16:00:43.278 INFO:tasks.rados.rados.0.smithi033.stdout:1150: read oid 41 snap -1 2021-07-26T16:00:43.279 INFO:tasks.rados.rados.0.smithi033.stdout:1150: expect (ObjNum 313 snap 100 seq_num 313) 2021-07-26T16:00:43.279 INFO:tasks.rados.rados.0.smithi033.stdout:1151: snap_remove snap 108 2021-07-26T16:00:43.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:43 smithi033 bash[41341]: cluster 2021-07-26T16:00:42.148617+0000 mon.a (mon.0) 403 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:00:43.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:43 smithi033 bash[41341]: cluster 2021-07-26T16:00:42.165172+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e282: 8 total, 7 up, 8 in 2021-07-26T16:00:43.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:43 smithi033 bash[42377]: cluster 2021-07-26T16:00:42.148617+0000 mon.a (mon.0) 403 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:00:43.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:43 smithi033 bash[42377]: cluster 2021-07-26T16:00:42.165172+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e282: 8 total, 7 up, 8 in 2021-07-26T16:00:43.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:43 smithi096 bash[33981]: cluster 2021-07-26T16:00:42.148617+0000 mon.a (mon.0) 403 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:00:43.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:43 smithi096 bash[33981]: cluster 2021-07-26T16:00:42.165172+0000 mon.a (mon.0) 404 : cluster [DBG] osdmap e282: 8 total, 7 up, 8 in 2021-07-26T16:00:43.858 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:43 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:43.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:43.859 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:43 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:43.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:43.859 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:43 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:43.517Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:00:44.191 INFO:tasks.rados.rados.0.smithi033.stdout:1151: done (7 left) 2021-07-26T16:00:44.191 INFO:tasks.rados.rados.0.smithi033.stdout:1152: delete oid 16 current snap is 113 2021-07-26T16:00:44.192 INFO:tasks.rados.rados.0.smithi033.stdout:1139: finishing copy_from to smithi03339061-43 2021-07-26T16:00:44.192 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 452 (ObjNum 322 snap 104 seq_num 322) dirty exists 2021-07-26T16:00:44.192 INFO:tasks.rados.rados.0.smithi033.stdout:1139: finishing copy_from racing read to smithi03339061-43 2021-07-26T16:00:44.192 INFO:tasks.rados.rados.0.smithi033.stdout:1147: finishing write tid 1 to smithi03339061-20 2021-07-26T16:00:44.193 INFO:tasks.rados.rados.0.smithi033.stdout:1147: finishing write tid 2 to smithi03339061-20 2021-07-26T16:00:44.193 INFO:tasks.rados.rados.0.smithi033.stdout:1147: finishing write tid 3 to smithi03339061-20 2021-07-26T16:00:44.193 INFO:tasks.rados.rados.0.smithi033.stdout:1147: finishing write tid 4 to smithi03339061-20 2021-07-26T16:00:44.193 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 471 (ObjNum 357 snap 113 seq_num 357) dirty exists 2021-07-26T16:00:44.193 INFO:tasks.rados.rados.0.smithi033.stdout:1147: left oid 20 (ObjNum 357 snap 113 seq_num 357) 2021-07-26T16:00:44.194 INFO:tasks.rados.rados.0.smithi033.stdout:1136: expect (ObjNum 279 snap 86 seq_num 279) 2021-07-26T16:00:44.365 INFO:tasks.rados.rados.0.smithi033.stdout:1144: finishing rollback tid 1 to smithi03339061-24 2021-07-26T16:00:44.365 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 310 (ObjNum 1 snap 22002 seq_num 2006299408) dirty dne 2021-07-26T16:00:44.365 INFO:tasks.rados.rados.0.smithi033.stdout:1150: expect (ObjNum 313 snap 100 seq_num 313) 2021-07-26T16:00:44.376 INFO:tasks.rados.rados.0.smithi033.stdout:1148: finishing write tid 1 to smithi03339061-30 2021-07-26T16:00:44.377 INFO:tasks.rados.rados.0.smithi033.stdout:1148: finishing write tid 2 to smithi03339061-30 2021-07-26T16:00:44.377 INFO:tasks.rados.rados.0.smithi033.stdout:1148: finishing write tid 3 to smithi03339061-30 2021-07-26T16:00:44.377 INFO:tasks.rados.rados.0.smithi033.stdout:1149: finishing rollback tid 0 to smithi03339061-10 2021-07-26T16:00:44.377 INFO:tasks.rados.rados.0.smithi033.stdout:1149: finishing rollback tid 1 to smithi03339061-10 2021-07-26T16:00:44.378 INFO:tasks.rados.rados.0.smithi033.stdout:1148: finishing write tid 4 to smithi03339061-30 2021-07-26T16:00:44.378 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 507 (ObjNum 358 snap 113 seq_num 358) dirty exists 2021-07-26T16:00:44.378 INFO:tasks.rados.rados.0.smithi033.stdout:1148: left oid 30 (ObjNum 358 snap 113 seq_num 358) 2021-07-26T16:00:44.379 INFO:tasks.rados.rados.0.smithi033.stdout:1149: finishing rollback tid 2 to smithi03339061-10 2021-07-26T16:00:44.379 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 511 (ObjNum 257 snap 77 seq_num 257) dirty exists 2021-07-26T16:00:44.379 INFO:tasks.rados.rados.0.smithi033.stdout:1136: done (7 left) 2021-07-26T16:00:44.379 INFO:tasks.rados.rados.0.smithi033.stdout:1139: done (6 left) 2021-07-26T16:00:44.380 INFO:tasks.rados.rados.0.smithi033.stdout:1144: done (5 left) 2021-07-26T16:00:44.380 INFO:tasks.rados.rados.0.smithi033.stdout:1147: done (4 left) 2021-07-26T16:00:44.380 INFO:tasks.rados.rados.0.smithi033.stdout:1148: done (3 left) 2021-07-26T16:00:44.380 INFO:tasks.rados.rados.0.smithi033.stdout:1149: done (2 left) 2021-07-26T16:00:44.381 INFO:tasks.rados.rados.0.smithi033.stdout:1150: done (1 left) 2021-07-26T16:00:44.381 INFO:tasks.rados.rados.0.smithi033.stdout:1152: done (0 left) 2021-07-26T16:00:44.381 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 113 2021-07-26T16:00:44.381 INFO:tasks.rados.rados.0.smithi033.stdout:1153: seq_num 360 ranges {0=434176,434176=704512,1138688=98304} 2021-07-26T16:00:44.383 INFO:tasks.rados.rados.0.smithi033.stdout:1153: writing smithi03339061-19 from 0 to 434176 tid 1 2021-07-26T16:00:44.391 INFO:tasks.rados.rados.0.smithi033.stdout:1153: writing smithi03339061-19 from 434176 to 1138688 tid 2 2021-07-26T16:00:44.393 INFO:tasks.rados.rados.0.smithi033.stdout:1153: writing smithi03339061-19 from 1138688 to 1236992 tid 3 2021-07-26T16:00:44.393 INFO:tasks.rados.rados.0.smithi033.stdout:1154: snap_create 2021-07-26T16:00:44.394 INFO:tasks.rados.rados.0.smithi033.stdout:1153: finishing write tid 1 to smithi03339061-19 2021-07-26T16:00:44.397 INFO:tasks.rados.rados.0.smithi033.stdout:1153: finishing write tid 2 to smithi03339061-19 2021-07-26T16:00:44.398 INFO:tasks.rados.rados.0.smithi033.stdout:1153: finishing write tid 3 to smithi03339061-19 2021-07-26T16:00:44.398 INFO:tasks.rados.rados.0.smithi033.stdout:1153: finishing write tid 4 to smithi03339061-19 2021-07-26T16:00:44.400 INFO:tasks.rados.rados.0.smithi033.stdout:1153: finishing write tid 5 to smithi03339061-19 2021-07-26T16:00:44.400 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 380 (ObjNum 360 snap 113 seq_num 360) dirty exists 2021-07-26T16:00:44.401 INFO:tasks.rados.rados.0.smithi033.stdout:1153: left oid 19 (ObjNum 360 snap 113 seq_num 360) 2021-07-26T16:00:44.427 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:44 smithi033 bash[42377]: cluster 2021-07-26T16:00:42.997011+0000 mgr.y (mgr.34104) 148 : cluster [DBG] pgmap v216: 25 pgs: 4 stale+active+clean, 21 active+clean; 184 MiB data, 697 MiB used, 715 GiB / 715 GiB avail; 20 MiB/s rd, 2.5 MiB/s wr, 23 op/s 2021-07-26T16:00:44.428 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:44 smithi033 bash[42377]: cluster 2021-07-26T16:00:43.175384+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e283: 8 total, 7 up, 8 in 2021-07-26T16:00:44.428 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:44 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.3.service: Succeeded. 2021-07-26T16:00:44.429 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:44 smithi033 systemd[1]: Stopped Ceph osd.3 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:00:44.429 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:44 smithi033 bash[41341]: cluster 2021-07-26T16:00:42.997011+0000 mgr.y (mgr.34104) 148 : cluster [DBG] pgmap v216: 25 pgs: 4 stale+active+clean, 21 active+clean; 184 MiB data, 697 MiB used, 715 GiB / 715 GiB avail; 20 MiB/s rd, 2.5 MiB/s wr, 23 op/s 2021-07-26T16:00:44.429 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:44 smithi033 bash[41341]: cluster 2021-07-26T16:00:43.175384+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e283: 8 total, 7 up, 8 in 2021-07-26T16:00:44.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:44 smithi096 bash[33981]: cluster 2021-07-26T16:00:42.997011+0000 mgr.y (mgr.34104) 148 : cluster [DBG] pgmap v216: 25 pgs: 4 stale+active+clean, 21 active+clean; 184 MiB data, 697 MiB used, 715 GiB / 715 GiB avail; 20 MiB/s rd, 2.5 MiB/s wr, 23 op/s 2021-07-26T16:00:44.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:44 smithi096 bash[33981]: cluster 2021-07-26T16:00:43.175384+0000 mon.a (mon.0) 405 : cluster [DBG] osdmap e283: 8 total, 7 up, 8 in 2021-07-26T16:00:44.708 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:44 smithi033 systemd[1]: Started Ceph osd.3 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:00:45.200 INFO:tasks.rados.rados.0.smithi033.stdout:1153: done (1 left) 2021-07-26T16:00:45.201 INFO:tasks.rados.rados.0.smithi033.stdout:1154: done (0 left) 2021-07-26T16:00:45.201 INFO:tasks.rados.rados.0.smithi033.stdout:1155: snap_create 2021-07-26T16:00:45.202 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:44 smithi033 bash[48211]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:00:45.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:45 smithi033 bash[41341]: cluster 2021-07-26T16:00:44.187842+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e284: 8 total, 7 up, 8 in 2021-07-26T16:00:45.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:45 smithi033 bash[41341]: audit 2021-07-26T16:00:44.684545+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:45.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:45 smithi033 bash[41341]: audit 2021-07-26T16:00:44.686583+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:45.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:45 smithi033 bash[41341]: audit 2021-07-26T16:00:44.688248+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:00:45.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:45 smithi033 bash[41341]: audit 2021-07-26T16:00:44.689501+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:00:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:45 smithi033 bash[42377]: cluster 2021-07-26T16:00:44.187842+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e284: 8 total, 7 up, 8 in 2021-07-26T16:00:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:45 smithi033 bash[42377]: audit 2021-07-26T16:00:44.684545+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:45 smithi033 bash[42377]: audit 2021-07-26T16:00:44.686583+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:45.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:45 smithi033 bash[42377]: audit 2021-07-26T16:00:44.688248+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:00:45.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:45 smithi033 bash[42377]: audit 2021-07-26T16:00:44.689501+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:00:45.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:45 smithi096 bash[33981]: cluster 2021-07-26T16:00:44.187842+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e284: 8 total, 7 up, 8 in 2021-07-26T16:00:45.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:45 smithi096 bash[33981]: audit 2021-07-26T16:00:44.684545+0000 mon.a (mon.0) 407 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:45.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:45 smithi096 bash[33981]: audit 2021-07-26T16:00:44.686583+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:45.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:45 smithi096 bash[33981]: audit 2021-07-26T16:00:44.688248+0000 mon.c (mon.1) 74 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:00:45.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:45 smithi096 bash[33981]: audit 2021-07-26T16:00:44.689501+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:00:45.512 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T16:00:45.849 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T16:00:45.849 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (7m) 24s ago 7m 15.1M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T16:00:45.849 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (7m) 2m ago 7m 25.5M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T16:00:45.849 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (2m) 2m ago 12m 372M - 17.0.0-6381-gbccf07c2 6cdb40438e66 909ec99bd712 2021-07-26T16:00:45.850 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (3m) 24s ago 14m 415M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T16:00:45.850 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (2m) 24s ago 14m 48.6M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 7649338580a7 2021-07-26T16:00:45.850 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (2m) 2m ago 12m 21.0M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 5a3d2fea4cb3 2021-07-26T16:00:45.850 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (2m) 24s ago 12m 40.2M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 76ce8786552e 2021-07-26T16:00:45.851 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (8m) 24s ago 8m 11.1M - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T16:00:45.851 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (7m) 2m ago 8m 11.3M - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T16:00:45.852 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (84s) 24s ago 11m 107M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 7275343c45f7 2021-07-26T16:00:45.852 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (55s) 24s ago 11m 93.7M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 778afc05022e 2021-07-26T16:00:45.852 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (27s) 24s ago 10m - 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 e78ad82b00b5 2021-07-26T16:00:45.852 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 starting - - - 3553M 2021-07-26T16:00:45.852 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (9m) 2m ago 9m 88.5M 3552M 16.2.5 34f74fddb18e 1aac82d5671e 2021-07-26T16:00:45.853 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (9m) 2m ago 9m 83.8M 3552M 16.2.5 34f74fddb18e 12b89782c2eb 2021-07-26T16:00:45.853 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (9m) 2m ago 9m 74.8M 3552M 16.2.5 34f74fddb18e 4fad5a8407d4 2021-07-26T16:00:45.853 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (8m) 2m ago 8m 70.1M 3552M 16.2.5 34f74fddb18e a988c60ad3d5 2021-07-26T16:00:45.854 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (7m) 2m ago 8m 38.1M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T16:00:45.980 INFO:tasks.rados.rados.0.smithi033.stdout:1155: done (0 left) 2021-07-26T16:00:45.981 INFO:tasks.rados.rados.0.smithi033.stdout:1156: rollback oid 44 current snap is 115 2021-07-26T16:00:45.981 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 102 2021-07-26T16:00:45.981 INFO:tasks.rados.rados.0.smithi033.stdout:1157: read oid 36 snap -1 2021-07-26T16:00:45.981 INFO:tasks.rados.rados.0.smithi033.stdout:1157: expect (ObjNum 323 snap 104 seq_num 323) 2021-07-26T16:00:45.982 INFO:tasks.rados.rados.0.smithi033.stdout:1158: read oid 24 snap -1 2021-07-26T16:00:45.982 INFO:tasks.rados.rados.0.smithi033.stdout:1158: expect deleted 2021-07-26T16:00:45.982 INFO:tasks.rados.rados.0.smithi033.stdout:1159: delete oid 8 current snap is 115 2021-07-26T16:00:45.997 INFO:tasks.rados.rados.0.smithi033.stdout:1158: done (3 left) 2021-07-26T16:00:45.997 INFO:tasks.rados.rados.0.smithi033.stdout:1159: done (2 left) 2021-07-26T16:00:45.998 INFO:tasks.rados.rados.0.smithi033.stdout:1160: rollback oid 47 current snap is 115 2021-07-26T16:00:45.998 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 47 to 102 2021-07-26T16:00:45.999 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 115 2021-07-26T16:00:45.999 INFO:tasks.rados.rados.0.smithi033.stdout:1161: seq_num 362 ranges {0=466944,466944=466944,933888=335872} 2021-07-26T16:00:45.999 INFO:tasks.rados.rados.0.smithi033.stdout:1161: writing smithi03339061-28 from 0 to 466944 tid 1 2021-07-26T16:00:46.000 INFO:tasks.rados.rados.0.smithi033.stdout:1161: writing smithi03339061-28 from 466944 to 933888 tid 2 2021-07-26T16:00:46.002 INFO:tasks.rados.rados.0.smithi033.stdout:1161: writing smithi03339061-28 from 933888 to 1269760 tid 3 2021-07-26T16:00:46.002 INFO:tasks.rados.rados.0.smithi033.stdout:1162: read oid 30 snap -1 2021-07-26T16:00:46.003 INFO:tasks.rados.rados.0.smithi033.stdout:1162: expect (ObjNum 358 snap 113 seq_num 358) 2021-07-26T16:00:46.003 INFO:tasks.rados.rados.0.smithi033.stdout:1163: read oid 15 snap 114 2021-07-26T16:00:46.003 INFO:tasks.rados.rados.0.smithi033.stdout:1163: expect deleted 2021-07-26T16:00:46.004 INFO:tasks.rados.rados.0.smithi033.stdout:1164: snap_remove snap 111 2021-07-26T16:00:46.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[41341]: cluster 2021-07-26T16:00:44.997976+0000 mgr.y (mgr.34104) 149 : cluster [DBG] pgmap v219: 25 pgs: 4 active+undersized+degraded, 3 stale+active+clean, 1 active+undersized, 17 active+clean; 184 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 329 KiB/s rd, 693 KiB/s wr, 4 op/s; 44/354 objects degraded (12.429%) 2021-07-26T16:00:46.203 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[41341]: cluster 2021-07-26T16:00:45.195367+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e285: 8 total, 7 up, 8 in 2021-07-26T16:00:46.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[41341]: audit 2021-07-26T16:00:45.489657+0000 mgr.y (mgr.34104) 150 : audit [DBG] from='client.44191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:46.204 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[41341]: cluster 2021-07-26T16:00:45.680680+0000 mon.a (mon.0) 409 : cluster [WRN] Health check failed: Degraded data redundancy: 44/354 objects degraded (12.429%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:46.205 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[41341]: cluster 2021-07-26T16:00:45.975361+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e286: 8 total, 7 up, 8 in 2021-07-26T16:00:46.268 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T16:00:46.268 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T16:00:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T16:00:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:00:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T16:00:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T16:00:46.269 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:00:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T16:00:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 4, 2021-07-26T16:00:46.270 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T16:00:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:00:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T16:00:46.271 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T16:00:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 4, 2021-07-26T16:00:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 8 2021-07-26T16:00:46.272 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T16:00:46.272 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T16:00:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[42377]: cluster 2021-07-26T16:00:44.997976+0000 mgr.y (mgr.34104) 149 : cluster [DBG] pgmap v219: 25 pgs: 4 active+undersized+degraded, 3 stale+active+clean, 1 active+undersized, 17 active+clean; 184 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 329 KiB/s rd, 693 KiB/s wr, 4 op/s; 44/354 objects degraded (12.429%) 2021-07-26T16:00:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[42377]: cluster 2021-07-26T16:00:45.195367+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e285: 8 total, 7 up, 8 in 2021-07-26T16:00:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[42377]: audit 2021-07-26T16:00:45.489657+0000 mgr.y (mgr.34104) 150 : audit [DBG] from='client.44191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[42377]: cluster 2021-07-26T16:00:45.680680+0000 mon.a (mon.0) 409 : cluster [WRN] Health check failed: Degraded data redundancy: 44/354 objects degraded (12.429%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:46.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[42377]: cluster 2021-07-26T16:00:45.975361+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e286: 8 total, 7 up, 8 in 2021-07-26T16:00:46.460 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[48211]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-07-26T16:00:46.460 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[48211]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-07-26T16:00:46.461 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[48211]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-07-26T16:00:46.461 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[48211]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-07-26T16:00:46.461 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[48211]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-07-26T16:00:46.461 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[48211]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-07-26T16:00:46.462 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:46 smithi033 bash[48211]: --> ceph-volume lvm activate successful for osd ID: 3 2021-07-26T16:00:46.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:46 smithi096 bash[33981]: cluster 2021-07-26T16:00:44.997976+0000 mgr.y (mgr.34104) 149 : cluster [DBG] pgmap v219: 25 pgs: 4 active+undersized+degraded, 3 stale+active+clean, 1 active+undersized, 17 active+clean; 184 MiB data, 717 MiB used, 715 GiB / 715 GiB avail; 329 KiB/s rd, 693 KiB/s wr, 4 op/s; 44/354 objects degraded (12.429%) 2021-07-26T16:00:46.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:46 smithi096 bash[33981]: cluster 2021-07-26T16:00:45.195367+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e285: 8 total, 7 up, 8 in 2021-07-26T16:00:46.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:46 smithi096 bash[33981]: audit 2021-07-26T16:00:45.489657+0000 mgr.y (mgr.34104) 150 : audit [DBG] from='client.44191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:46.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:46 smithi096 bash[33981]: cluster 2021-07-26T16:00:45.680680+0000 mon.a (mon.0) 409 : cluster [WRN] Health check failed: Degraded data redundancy: 44/354 objects degraded (12.429%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:46.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:46 smithi096 bash[33981]: cluster 2021-07-26T16:00:45.975361+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e286: 8 total, 7 up, 8 in 2021-07-26T16:00:46.992 INFO:tasks.rados.rados.0.smithi033.stdout:1164: done (6 left) 2021-07-26T16:00:46.993 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 115 2021-07-26T16:00:46.993 INFO:tasks.rados.rados.0.smithi033.stdout:1156: finishing rollback tid 0 to smithi03339061-44 2021-07-26T16:00:46.993 INFO:tasks.rados.rados.0.smithi033.stdout:1156: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:00:46.993 INFO:tasks.rados.rados.0.smithi033.stdout:1156: finishing rollback tid 2 to smithi03339061-44 2021-07-26T16:00:46.994 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 474 (ObjNum 232 snap 65 seq_num 232) dirty exists 2021-07-26T16:00:46.994 INFO:tasks.rados.rados.0.smithi033.stdout:1161: finishing write tid 1 to smithi03339061-28 2021-07-26T16:00:46.994 INFO:tasks.rados.rados.0.smithi033.stdout:1161: finishing write tid 2 to smithi03339061-28 2021-07-26T16:00:46.994 INFO:tasks.rados.rados.0.smithi033.stdout:1161: finishing write tid 3 to smithi03339061-28 2021-07-26T16:00:46.994 INFO:tasks.rados.rados.0.smithi033.stdout:1161: finishing write tid 4 to smithi03339061-28 2021-07-26T16:00:46.995 INFO:tasks.rados.rados.0.smithi033.stdout:1161: finishing write tid 5 to smithi03339061-28 2021-07-26T16:00:46.995 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 307 (ObjNum 362 snap 115 seq_num 362) dirty exists 2021-07-26T16:00:46.995 INFO:tasks.rados.rados.0.smithi033.stdout:1161: left oid 28 (ObjNum 362 snap 115 seq_num 362) 2021-07-26T16:00:46.995 INFO:tasks.rados.rados.0.smithi033.stdout:1160: finishing rollback tid 0 to smithi03339061-47 2021-07-26T16:00:46.995 INFO:tasks.rados.rados.0.smithi033.stdout:1160: finishing rollback tid 1 to smithi03339061-47 2021-07-26T16:00:46.996 INFO:tasks.rados.rados.0.smithi033.stdout:1157: expect (ObjNum 323 snap 104 seq_num 323) 2021-07-26T16:00:47.142 INFO:tasks.rados.rados.0.smithi033.stdout:1160: finishing rollback tid 2 to smithi03339061-47 2021-07-26T16:00:47.142 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 515 (ObjNum 271 snap 83 seq_num 271) dirty exists 2021-07-26T16:00:47.143 INFO:tasks.rados.rados.0.smithi033.stdout:1162: expect (ObjNum 358 snap 113 seq_num 358) 2021-07-26T16:00:47.458 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:47 smithi033 bash[48402]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:00:47.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:47 smithi033 bash[42377]: audit 2021-07-26T16:00:45.828048+0000 mgr.y (mgr.34104) 151 : audit [DBG] from='client.34245 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:47.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:47 smithi033 bash[42377]: audit 2021-07-26T16:00:46.264937+0000 mon.a (mon.0) 411 : audit [DBG] from='client.? 172.21.15.33:0/11031864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:47.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:47 smithi033 bash[42377]: cluster 2021-07-26T16:00:46.987886+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e287: 8 total, 7 up, 8 in 2021-07-26T16:00:47.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:47 smithi033 bash[41341]: audit 2021-07-26T16:00:45.828048+0000 mgr.y (mgr.34104) 151 : audit [DBG] from='client.34245 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:47.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:47 smithi033 bash[41341]: audit 2021-07-26T16:00:46.264937+0000 mon.a (mon.0) 411 : audit [DBG] from='client.? 172.21.15.33:0/11031864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:47.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:47 smithi033 bash[41341]: cluster 2021-07-26T16:00:46.987886+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e287: 8 total, 7 up, 8 in 2021-07-26T16:00:47.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:47 smithi096 bash[33981]: audit 2021-07-26T16:00:45.828048+0000 mgr.y (mgr.34104) 151 : audit [DBG] from='client.34245 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:00:47.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:47 smithi096 bash[33981]: audit 2021-07-26T16:00:46.264937+0000 mon.a (mon.0) 411 : audit [DBG] from='client.? 172.21.15.33:0/11031864' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:47.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:47 smithi096 bash[33981]: cluster 2021-07-26T16:00:46.987886+0000 mon.a (mon.0) 412 : cluster [DBG] osdmap e287: 8 total, 7 up, 8 in 2021-07-26T16:00:48.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:48 smithi033 bash[42377]: cluster 2021-07-26T16:00:46.998684+0000 mgr.y (mgr.34104) 152 : cluster [DBG] pgmap v223: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 192 MiB data, 724 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 13 op/s; 86/372 objects degraded (23.118%) 2021-07-26T16:00:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:48 smithi033 bash[41341]: cluster 2021-07-26T16:00:46.998684+0000 mgr.y (mgr.34104) 152 : cluster [DBG] pgmap v223: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 192 MiB data, 724 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 13 op/s; 86/372 objects degraded (23.118%) 2021-07-26T16:00:48.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:48 smithi096 bash[33981]: cluster 2021-07-26T16:00:46.998684+0000 mgr.y (mgr.34104) 152 : cluster [DBG] pgmap v223: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 192 MiB data, 724 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 1.9 MiB/s wr, 13 op/s; 86/372 objects degraded (23.118%) 2021-07-26T16:00:48.518 INFO:tasks.rados.rados.0.smithi033.stdout:1165: seq_num 363 ranges {0=483328,483328=753664,1236992=49152} 2021-07-26T16:00:48.525 INFO:tasks.rados.rados.0.smithi033.stdout:1165: writing smithi03339061-38 from 0 to 483328 tid 1 2021-07-26T16:00:48.533 INFO:tasks.rados.rados.0.smithi033.stdout:1165: writing smithi03339061-38 from 483328 to 1236992 tid 2 2021-07-26T16:00:48.534 INFO:tasks.rados.rados.0.smithi033.stdout:1165: writing smithi03339061-38 from 1236992 to 1286144 tid 3 2021-07-26T16:00:48.534 INFO:tasks.rados.rados.0.smithi033.stdout:1156: done (6 left) 2021-07-26T16:00:48.535 INFO:tasks.rados.rados.0.smithi033.stdout:1157: done (5 left) 2021-07-26T16:00:48.535 INFO:tasks.rados.rados.0.smithi033.stdout:1160: done (4 left) 2021-07-26T16:00:48.535 INFO:tasks.rados.rados.0.smithi033.stdout:1161: done (3 left) 2021-07-26T16:00:48.535 INFO:tasks.rados.rados.0.smithi033.stdout:1162: done (2 left) 2021-07-26T16:00:48.537 INFO:tasks.rados.rados.0.smithi033.stdout:1163: done (1 left) 2021-07-26T16:00:48.537 INFO:tasks.rados.rados.0.smithi033.stdout:1166: snap_create 2021-07-26T16:00:48.537 INFO:tasks.rados.rados.0.smithi033.stdout:1165: finishing write tid 1 to smithi03339061-38 2021-07-26T16:00:48.540 INFO:tasks.rados.rados.0.smithi033.stdout:1165: finishing write tid 2 to smithi03339061-38 2021-07-26T16:00:48.541 INFO:tasks.rados.rados.0.smithi033.stdout:1165: finishing write tid 3 to smithi03339061-38 2021-07-26T16:00:48.541 INFO:tasks.rados.rados.0.smithi033.stdout:1165: finishing write tid 4 to smithi03339061-38 2021-07-26T16:00:48.543 INFO:tasks.rados.rados.0.smithi033.stdout:1165: finishing write tid 5 to smithi03339061-38 2021-07-26T16:00:48.543 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 96 (ObjNum 363 snap 115 seq_num 363) dirty exists 2021-07-26T16:00:48.544 INFO:tasks.rados.rados.0.smithi033.stdout:1165: left oid 38 (ObjNum 363 snap 115 seq_num 363) 2021-07-26T16:00:48.958 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:48 smithi033 bash[48402]: debug 2021-07-26T16:00:48.467+0000 7ffb9cdab700 1 -- 172.21.15.33:0/2956463055 <== mon.0 v2:172.21.15.33:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5592c9e12340 con 0x5592c9e6d000 2021-07-26T16:00:49.220 INFO:tasks.rados.rados.0.smithi033.stdout:1165: done (1 left) 2021-07-26T16:00:49.221 INFO:tasks.rados.rados.0.smithi033.stdout:1166: done (0 left) 2021-07-26T16:00:49.221 INFO:tasks.rados.rados.0.smithi033.stdout:1167: snap_create 2021-07-26T16:00:49.281 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:49 smithi033 bash[48402]: debug 2021-07-26T16:00:49.019+0000 7ffba45ff0c0 -1 Falling back to public interface 2021-07-26T16:00:49.708 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 16:00:49 smithi033 bash[39943]: debug 2021-07-26T16:00:49.271+0000 7fa4db1f3700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:00:50.225 INFO:tasks.rados.rados.0.smithi033.stdout:1167: done (0 left) 2021-07-26T16:00:50.226 INFO:tasks.rados.rados.0.smithi033.stdout:1168: read oid 17 snap 112 2021-07-26T16:00:50.226 INFO:tasks.rados.rados.0.smithi033.stdout:1168: expect (ObjNum 295 snap 91 seq_num 295) 2021-07-26T16:00:50.227 INFO:tasks.rados.rados.0.smithi033.stdout:1169: delete oid 15 current snap is 117 2021-07-26T16:00:50.237 INFO:tasks.rados.rados.0.smithi033.stdout:1169: done (1 left) 2021-07-26T16:00:50.237 INFO:tasks.rados.rados.0.smithi033.stdout:1170: read oid 2 snap 88 2021-07-26T16:00:50.237 INFO:tasks.rados.rados.0.smithi033.stdout:1170: expect (ObjNum 259 snap 81 seq_num 259) 2021-07-26T16:00:50.238 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 117 2021-07-26T16:00:50.238 INFO:tasks.rados.rados.0.smithi033.stdout:1171: seq_num 365 ranges {0=516096,516096=573440,1089536=229376} 2021-07-26T16:00:50.243 INFO:tasks.rados.rados.0.smithi033.stdout:1171: writing smithi03339061-8 from 0 to 516096 tid 1 2021-07-26T16:00:50.249 INFO:tasks.rados.rados.0.smithi033.stdout:1171: writing smithi03339061-8 from 516096 to 1089536 tid 2 2021-07-26T16:00:50.251 INFO:tasks.rados.rados.0.smithi033.stdout:1171: writing smithi03339061-8 from 1089536 to 1318912 tid 3 2021-07-26T16:00:50.252 INFO:tasks.rados.rados.0.smithi033.stdout:1172: rollback oid 35 current snap is 117 2021-07-26T16:00:50.252 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 88 2021-07-26T16:00:50.253 INFO:tasks.rados.rados.0.smithi033.stdout:1168: expect (ObjNum 295 snap 91 seq_num 295) 2021-07-26T16:00:50.357 INFO:tasks.rados.rados.0.smithi033.stdout:1171: finishing write tid 1 to smithi03339061-8 2021-07-26T16:00:50.358 INFO:tasks.rados.rados.0.smithi033.stdout:1171: finishing write tid 2 to smithi03339061-8 2021-07-26T16:00:50.358 INFO:tasks.rados.rados.0.smithi033.stdout:1171: finishing write tid 3 to smithi03339061-8 2021-07-26T16:00:50.358 INFO:tasks.rados.rados.0.smithi033.stdout:1171: finishing write tid 4 to smithi03339061-8 2021-07-26T16:00:50.359 INFO:tasks.rados.rados.0.smithi033.stdout:1172: finishing rollback tid 1 to smithi03339061-35 2021-07-26T16:00:50.359 INFO:tasks.rados.rados.0.smithi033.stdout:1172: finishing rollback tid 2 to smithi03339061-35 2021-07-26T16:00:50.359 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 390 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T16:00:50.360 INFO:tasks.rados.rados.0.smithi033.stdout:1171: finishing write tid 5 to smithi03339061-8 2021-07-26T16:00:50.360 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 388 (ObjNum 365 snap 117 seq_num 365) dirty exists 2021-07-26T16:00:50.361 INFO:tasks.rados.rados.0.smithi033.stdout:1171: left oid 8 (ObjNum 365 snap 117 seq_num 365) 2021-07-26T16:00:50.361 INFO:tasks.rados.rados.0.smithi033.stdout:1170: expect (ObjNum 259 snap 81 seq_num 259) 2021-07-26T16:00:50.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[42377]: cluster 2021-07-26T16:00:48.999244+0000 mgr.y (mgr.34104) 153 : cluster [DBG] pgmap v224: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 192 MiB data, 724 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 10 op/s; 86/372 objects degraded (23.118%) 2021-07-26T16:00:50.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[42377]: audit 2021-07-26T16:00:49.004776+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:50.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[42377]: cluster 2021-07-26T16:00:49.217841+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e288: 8 total, 7 up, 8 in 2021-07-26T16:00:50.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[42377]: audit 2021-07-26T16:00:49.260062+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:50.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[42377]: audit 2021-07-26T16:00:49.269773+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:50.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[42377]: audit 2021-07-26T16:00:49.272020+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:50.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[42377]: audit 2021-07-26T16:00:49.273899+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:50.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[42377]: audit 2021-07-26T16:00:49.275447+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:50.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[42377]: audit 2021-07-26T16:00:49.278025+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:00:50.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[42377]: audit 2021-07-26T16:00:49.278309+0000 mgr.y (mgr.34104) 154 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:00:50.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[42377]: cephadm 2021-07-26T16:00:49.279744+0000 mgr.y (mgr.34104) 155 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:00:50.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[41341]: cluster 2021-07-26T16:00:48.999244+0000 mgr.y (mgr.34104) 153 : cluster [DBG] pgmap v224: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 192 MiB data, 724 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 10 op/s; 86/372 objects degraded (23.118%) 2021-07-26T16:00:50.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[41341]: audit 2021-07-26T16:00:49.004776+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:50.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[41341]: cluster 2021-07-26T16:00:49.217841+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e288: 8 total, 7 up, 8 in 2021-07-26T16:00:50.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[41341]: audit 2021-07-26T16:00:49.260062+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:50.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[41341]: audit 2021-07-26T16:00:49.269773+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:50.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[41341]: audit 2021-07-26T16:00:49.272020+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:50.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[41341]: audit 2021-07-26T16:00:49.273899+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:50.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[41341]: audit 2021-07-26T16:00:49.275447+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:50.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[41341]: audit 2021-07-26T16:00:49.278025+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:00:50.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[41341]: audit 2021-07-26T16:00:49.278309+0000 mgr.y (mgr.34104) 154 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:00:50.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:50 smithi033 bash[41341]: cephadm 2021-07-26T16:00:49.279744+0000 mgr.y (mgr.34104) 155 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:00:50.466 INFO:tasks.rados.rados.0.smithi033.stdout:1168: done (3 left) 2021-07-26T16:00:50.467 INFO:tasks.rados.rados.0.smithi033.stdout:1170: done (2 left) 2021-07-26T16:00:50.467 INFO:tasks.rados.rados.0.smithi033.stdout:1171: done (1 left) 2021-07-26T16:00:50.467 INFO:tasks.rados.rados.0.smithi033.stdout:1172: done (0 left) 2021-07-26T16:00:50.467 INFO:tasks.rados.rados.0.smithi033.stdout:1173: rmattr oid 35 current snap is 117 2021-07-26T16:00:50.468 INFO:tasks.rados.rados.0.smithi033.stdout:1174: setattr oid 26 current snap is 117 2021-07-26T16:00:50.468 INFO:tasks.rados.rados.0.smithi033.stdout:1175: snap_remove snap 102 2021-07-26T16:00:50.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:50 smithi096 bash[33981]: cluster 2021-07-26T16:00:48.999244+0000 mgr.y (mgr.34104) 153 : cluster [DBG] pgmap v224: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 192 MiB data, 724 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 1.5 MiB/s wr, 10 op/s; 86/372 objects degraded (23.118%) 2021-07-26T16:00:50.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:50 smithi096 bash[33981]: audit 2021-07-26T16:00:49.004776+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:50.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:50 smithi096 bash[33981]: cluster 2021-07-26T16:00:49.217841+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e288: 8 total, 7 up, 8 in 2021-07-26T16:00:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:50 smithi096 bash[33981]: audit 2021-07-26T16:00:49.260062+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:00:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:50 smithi096 bash[33981]: audit 2021-07-26T16:00:49.269773+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:00:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:50 smithi096 bash[33981]: audit 2021-07-26T16:00:49.272020+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:50 smithi096 bash[33981]: audit 2021-07-26T16:00:49.273899+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:50.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:50 smithi096 bash[33981]: audit 2021-07-26T16:00:49.275447+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:00:50.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:50 smithi096 bash[33981]: audit 2021-07-26T16:00:49.278025+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:00:50.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:50 smithi096 bash[33981]: audit 2021-07-26T16:00:49.278309+0000 mgr.y (mgr.34104) 154 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:00:50.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:50 smithi096 bash[33981]: cephadm 2021-07-26T16:00:49.279744+0000 mgr.y (mgr.34104) 155 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:00:50.983 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 391 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T16:00:50.984 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 667 (ObjNum 232 snap 65 seq_num 232) dirty exists 2021-07-26T16:00:50.984 INFO:tasks.rados.rados.0.smithi033.stdout:1173: done (2 left) 2021-07-26T16:00:50.985 INFO:tasks.rados.rados.0.smithi033.stdout:1174: done (1 left) 2021-07-26T16:00:50.985 INFO:tasks.rados.rados.0.smithi033.stdout:1175: done (0 left) 2021-07-26T16:00:50.985 INFO:tasks.rados.rados.0.smithi033.stdout:1176: rmattr oid 30 current snap is 117 2021-07-26T16:00:50.986 INFO:tasks.rados.rados.0.smithi033.stdout:1176: done (0 left) 2021-07-26T16:00:50.986 INFO:tasks.rados.rados.0.smithi033.stdout:1177: snap_remove snap 112 2021-07-26T16:00:51.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:51 smithi096 bash[33981]: cluster 2021-07-26T16:00:50.221959+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e289: 8 total, 7 up, 8 in 2021-07-26T16:00:51.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:51 smithi096 bash[33981]: cluster 2021-07-26T16:00:50.969317+0000 mon.a (mon.0) 417 : cluster [WRN] Health check update: Degraded data redundancy: 86/372 objects degraded (23.118%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:51.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:51 smithi096 bash[33981]: cluster 2021-07-26T16:00:50.979741+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e290: 8 total, 7 up, 8 in 2021-07-26T16:00:51.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:51 smithi033 bash[42377]: cluster 2021-07-26T16:00:50.221959+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e289: 8 total, 7 up, 8 in 2021-07-26T16:00:51.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:51 smithi033 bash[42377]: cluster 2021-07-26T16:00:50.969317+0000 mon.a (mon.0) 417 : cluster [WRN] Health check update: Degraded data redundancy: 86/372 objects degraded (23.118%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:51.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:51 smithi033 bash[42377]: cluster 2021-07-26T16:00:50.979741+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e290: 8 total, 7 up, 8 in 2021-07-26T16:00:51.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:51 smithi033 bash[41341]: cluster 2021-07-26T16:00:50.221959+0000 mon.a (mon.0) 416 : cluster [DBG] osdmap e289: 8 total, 7 up, 8 in 2021-07-26T16:00:51.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:51 smithi033 bash[41341]: cluster 2021-07-26T16:00:50.969317+0000 mon.a (mon.0) 417 : cluster [WRN] Health check update: Degraded data redundancy: 86/372 objects degraded (23.118%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:51.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:51 smithi033 bash[41341]: cluster 2021-07-26T16:00:50.979741+0000 mon.a (mon.0) 418 : cluster [DBG] osdmap e290: 8 total, 7 up, 8 in 2021-07-26T16:00:52.006 INFO:tasks.rados.rados.0.smithi033.stdout:1177: done (0 left) 2021-07-26T16:00:52.006 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 117 2021-07-26T16:00:52.006 INFO:tasks.rados.rados.0.smithi033.stdout:1178: seq_num 366 ranges {7176192=532480,7708672=458752,8167424=344064} 2021-07-26T16:00:52.050 INFO:tasks.rados.rados.0.smithi033.stdout:1178: writing smithi03339061-11 from 7176192 to 7708672 tid 1 2021-07-26T16:00:52.052 INFO:tasks.rados.rados.0.smithi033.stdout:1178: writing smithi03339061-11 from 7708672 to 8167424 tid 2 2021-07-26T16:00:52.055 INFO:tasks.rados.rados.0.smithi033.stdout:1178: writing smithi03339061-11 from 8167424 to 8511488 tid 3 2021-07-26T16:00:52.055 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 3 current snap is 117 2021-07-26T16:00:52.055 INFO:tasks.rados.rados.0.smithi033.stdout:1179: seq_num 367 ranges {0=548864,548864=737280,1286144=65536} 2021-07-26T16:00:52.057 INFO:tasks.rados.rados.0.smithi033.stdout:1179: writing smithi03339061-3 from 0 to 548864 tid 1 2021-07-26T16:00:52.062 INFO:tasks.rados.rados.0.smithi033.stdout:1179: writing smithi03339061-3 from 548864 to 1286144 tid 2 2021-07-26T16:00:52.062 INFO:tasks.rados.rados.0.smithi033.stdout:1179: writing smithi03339061-3 from 1286144 to 1351680 tid 3 2021-07-26T16:00:52.063 INFO:tasks.rados.rados.0.smithi033.stdout:1180: rollback oid 13 current snap is 117 2021-07-26T16:00:52.063 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 13 to 115 2021-07-26T16:00:52.063 INFO:tasks.rados.rados.0.smithi033.stdout:1181: rollback oid 8 current snap is 117 2021-07-26T16:00:52.063 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 8 to 109 2021-07-26T16:00:52.064 INFO:tasks.rados.rados.0.smithi033.stdout:1182: rmattr oid 35 current snap is 117 2021-07-26T16:00:52.064 INFO:tasks.rados.rados.0.smithi033.stdout:1183: rmattr oid 14 current snap is 117 2021-07-26T16:00:52.064 INFO:tasks.rados.rados.0.smithi033.stdout:1183: done (5 left) 2021-07-26T16:00:52.064 INFO:tasks.rados.rados.0.smithi033.stdout:1184: delete oid 6 current snap is 117 2021-07-26T16:00:52.066 INFO:tasks.rados.rados.0.smithi033.stdout:1178: finishing write tid 1 to smithi03339061-11 2021-07-26T16:00:52.067 INFO:tasks.rados.rados.0.smithi033.stdout:1178: finishing write tid 2 to smithi03339061-11 2021-07-26T16:00:52.067 INFO:tasks.rados.rados.0.smithi033.stdout:1178: finishing write tid 3 to smithi03339061-11 2021-07-26T16:00:52.068 INFO:tasks.rados.rados.0.smithi033.stdout:1184: done (5 left) 2021-07-26T16:00:52.068 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 117 2021-07-26T16:00:52.068 INFO:tasks.rados.rados.0.smithi033.stdout:1185: seq_num 369 ranges {0=589824,589824=507904,1097728=294912} 2021-07-26T16:00:52.074 INFO:tasks.rados.rados.0.smithi033.stdout:1185: writing smithi03339061-1 from 0 to 589824 tid 1 2021-07-26T16:00:52.078 INFO:tasks.rados.rados.0.smithi033.stdout:1185: writing smithi03339061-1 from 589824 to 1097728 tid 2 2021-07-26T16:00:52.080 INFO:tasks.rados.rados.0.smithi033.stdout:1185: writing smithi03339061-1 from 1097728 to 1392640 tid 3 2021-07-26T16:00:52.080 INFO:tasks.rados.rados.0.smithi033.stdout:1186: snap_remove snap 114 2021-07-26T16:00:52.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:52 smithi096 bash[33981]: cluster 2021-07-26T16:00:50.999696+0000 mgr.y (mgr.34104) 156 : cluster [DBG] pgmap v228: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 198 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 14 MiB/s rd, 1.5 MiB/s wr, 11 op/s; 86/378 objects degraded (22.751%) 2021-07-26T16:00:52.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:52 smithi096 bash[33981]: cluster 2021-07-26T16:00:51.999239+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e291: 8 total, 7 up, 8 in 2021-07-26T16:00:52.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:52 smithi033 bash[42377]: cluster 2021-07-26T16:00:50.999696+0000 mgr.y (mgr.34104) 156 : cluster [DBG] pgmap v228: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 198 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 14 MiB/s rd, 1.5 MiB/s wr, 11 op/s; 86/378 objects degraded (22.751%) 2021-07-26T16:00:52.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:52 smithi033 bash[42377]: cluster 2021-07-26T16:00:51.999239+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e291: 8 total, 7 up, 8 in 2021-07-26T16:00:52.709 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:52 smithi033 bash[48402]: debug 2021-07-26T16:00:52.439+0000 7ffba45ff0c0 -1 osd.3 280 log_to_monitors {default=true} 2021-07-26T16:00:52.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:52 smithi033 bash[41341]: cluster 2021-07-26T16:00:50.999696+0000 mgr.y (mgr.34104) 156 : cluster [DBG] pgmap v228: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 198 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 14 MiB/s rd, 1.5 MiB/s wr, 11 op/s; 86/378 objects degraded (22.751%) 2021-07-26T16:00:52.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:52 smithi033 bash[41341]: cluster 2021-07-26T16:00:51.999239+0000 mon.a (mon.0) 419 : cluster [DBG] osdmap e291: 8 total, 7 up, 8 in 2021-07-26T16:00:53.010 INFO:tasks.rados.rados.0.smithi033.stdout:1186: done (6 left) 2021-07-26T16:00:53.010 INFO:tasks.rados.rados.0.smithi033.stdout:1187: read oid 34 snap -1 2021-07-26T16:00:53.011 INFO:tasks.rados.rados.0.smithi033.stdout:1187: expect (ObjNum 353 snap 112 seq_num 353) 2021-07-26T16:00:53.011 INFO:tasks.rados.rados.0.smithi033.stdout:1188: copy_from oid 32 from oid 40 current snap is 117 2021-07-26T16:00:53.011 INFO:tasks.rados.rados.0.smithi033.stdout:1180: finishing rollback tid 1 to smithi03339061-13 2021-07-26T16:00:53.011 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 465 (ObjNum 288 snap 0 seq_num 113) dirty dne 2021-07-26T16:00:53.012 INFO:tasks.rados.rados.0.smithi033.stdout:1178: finishing write tid 4 to smithi03339061-11 2021-07-26T16:00:53.012 INFO:tasks.rados.rados.0.smithi033.stdout:1179: finishing write tid 1 to smithi03339061-3 2021-07-26T16:00:53.014 INFO:tasks.rados.rados.0.smithi033.stdout:1181: finishing rollback tid 0 to smithi03339061-8 2021-07-26T16:00:53.015 INFO:tasks.rados.rados.0.smithi033.stdout:1181: finishing rollback tid 1 to smithi03339061-8 2021-07-26T16:00:53.015 INFO:tasks.rados.rados.0.smithi033.stdout:1181: finishing rollback tid 2 to smithi03339061-8 2021-07-26T16:00:53.015 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 404 (ObjNum 301 snap 97 seq_num 301) dirty exists 2021-07-26T16:00:53.016 INFO:tasks.rados.rados.0.smithi033.stdout:1178: finishing write tid 5 to smithi03339061-11 2021-07-26T16:00:53.016 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 418 (ObjNum 366 snap 117 seq_num 366) dirty exists 2021-07-26T16:00:53.016 INFO:tasks.rados.rados.0.smithi033.stdout:1178: left oid 11 (ObjNum 366 snap 117 seq_num 366) 2021-07-26T16:00:53.017 INFO:tasks.rados.rados.0.smithi033.stdout:1179: finishing write tid 2 to smithi03339061-3 2021-07-26T16:00:53.017 INFO:tasks.rados.rados.0.smithi033.stdout:1179: finishing write tid 3 to smithi03339061-3 2021-07-26T16:00:53.018 INFO:tasks.rados.rados.0.smithi033.stdout:1179: finishing write tid 4 to smithi03339061-3 2021-07-26T16:00:53.018 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 405 (ObjNum 222 snap 63 seq_num 222) dirty exists 2021-07-26T16:00:53.019 INFO:tasks.rados.rados.0.smithi033.stdout:1179: finishing write tid 5 to smithi03339061-3 2021-07-26T16:00:53.019 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 232 (ObjNum 367 snap 117 seq_num 367) dirty exists 2021-07-26T16:00:53.020 INFO:tasks.rados.rados.0.smithi033.stdout:1179: left oid 3 (ObjNum 367 snap 117 seq_num 367) 2021-07-26T16:00:53.020 INFO:tasks.rados.rados.0.smithi033.stdout:1185: finishing write tid 1 to smithi03339061-1 2021-07-26T16:00:53.020 INFO:tasks.rados.rados.0.smithi033.stdout:1185: finishing write tid 2 to smithi03339061-1 2021-07-26T16:00:53.021 INFO:tasks.rados.rados.0.smithi033.stdout:1185: finishing write tid 3 to smithi03339061-1 2021-07-26T16:00:53.022 INFO:tasks.rados.rados.0.smithi033.stdout:1185: finishing write tid 4 to smithi03339061-1 2021-07-26T16:00:53.022 INFO:tasks.rados.rados.0.smithi033.stdout:1185: finishing write tid 5 to smithi03339061-1 2021-07-26T16:00:53.023 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 37 (ObjNum 369 snap 117 seq_num 369) dirty exists 2021-07-26T16:00:53.023 INFO:tasks.rados.rados.0.smithi033.stdout:1185: left oid 1 (ObjNum 369 snap 117 seq_num 369) 2021-07-26T16:00:53.023 INFO:tasks.rados.rados.0.smithi033.stdout:1178: done (7 left) 2021-07-26T16:00:53.024 INFO:tasks.rados.rados.0.smithi033.stdout:1179: done (6 left) 2021-07-26T16:00:53.024 INFO:tasks.rados.rados.0.smithi033.stdout:1180: done (5 left) 2021-07-26T16:00:53.025 INFO:tasks.rados.rados.0.smithi033.stdout:1181: done (4 left) 2021-07-26T16:00:53.025 INFO:tasks.rados.rados.0.smithi033.stdout:1182: done (3 left) 2021-07-26T16:00:53.025 INFO:tasks.rados.rados.0.smithi033.stdout:1185: done (2 left) 2021-07-26T16:00:53.026 INFO:tasks.rados.rados.0.smithi033.stdout:1189: delete oid 46 current snap is 117 2021-07-26T16:00:53.027 INFO:tasks.rados.rados.0.smithi033.stdout:1189: done (2 left) 2021-07-26T16:00:53.027 INFO:tasks.rados.rados.0.smithi033.stdout:1190: copy_from oid 23 from oid 25 current snap is 117 2021-07-26T16:00:53.027 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 117 2021-07-26T16:00:53.028 INFO:tasks.rados.rados.0.smithi033.stdout:1191: seq_num 371 ranges {450560=622592,1073152=679936,1753088=122880} 2021-07-26T16:00:53.028 INFO:tasks.rados.rados.0.smithi033.stdout:1191: writing smithi03339061-41 from 450560 to 1073152 tid 1 2021-07-26T16:00:53.029 INFO:tasks.rados.rados.0.smithi033.stdout:1191: writing smithi03339061-41 from 1073152 to 1753088 tid 2 2021-07-26T16:00:53.030 INFO:tasks.rados.rados.0.smithi033.stdout:1191: writing smithi03339061-41 from 1753088 to 1875968 tid 3 2021-07-26T16:00:53.030 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 37 current snap is 117 2021-07-26T16:00:53.031 INFO:tasks.rados.rados.0.smithi033.stdout:1190: finishing copy_from to smithi03339061-23 2021-07-26T16:00:53.031 INFO:tasks.rados.rados.0.smithi033.stdout:1190: got expected ENOENT (src dne) 2021-07-26T16:00:53.031 INFO:tasks.rados.rados.0.smithi033.stdout:1192: seq_num 372 ranges {4489216=638976,5128192=565248,5693440=237568} 2021-07-26T16:00:53.060 INFO:tasks.rados.rados.0.smithi033.stdout:1192: writing smithi03339061-37 from 4489216 to 5128192 tid 1 2021-07-26T16:00:53.063 INFO:tasks.rados.rados.0.smithi033.stdout:1192: writing smithi03339061-37 from 5128192 to 5693440 tid 2 2021-07-26T16:00:53.065 INFO:tasks.rados.rados.0.smithi033.stdout:1192: writing smithi03339061-37 from 5693440 to 5931008 tid 3 2021-07-26T16:00:53.066 INFO:tasks.rados.rados.0.smithi033.stdout:1193: read oid 18 snap -1 2021-07-26T16:00:53.066 INFO:tasks.rados.rados.0.smithi033.stdout:1193: expect (ObjNum 352 snap 111 seq_num 352) 2021-07-26T16:00:53.067 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 117 2021-07-26T16:00:53.067 INFO:tasks.rados.rados.0.smithi033.stdout:1190: finishing copy_from racing read to smithi03339061-23 2021-07-26T16:00:53.067 INFO:tasks.rados.rados.0.smithi033.stdout:1191: finishing write tid 1 to smithi03339061-41 2021-07-26T16:00:53.067 INFO:tasks.rados.rados.0.smithi033.stdout:1187: expect (ObjNum 353 snap 112 seq_num 353) 2021-07-26T16:00:53.150 INFO:tasks.rados.rados.0.smithi033.stdout:1191: finishing write tid 2 to smithi03339061-41 2021-07-26T16:00:53.150 INFO:tasks.rados.rados.0.smithi033.stdout:1191: finishing write tid 3 to smithi03339061-41 2021-07-26T16:00:53.151 INFO:tasks.rados.rados.0.smithi033.stdout:1191: finishing write tid 4 to smithi03339061-41 2021-07-26T16:00:53.151 INFO:tasks.rados.rados.0.smithi033.stdout:1191: finishing write tid 5 to smithi03339061-41 2021-07-26T16:00:53.151 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 456 (ObjNum 371 snap 117 seq_num 371) dirty exists 2021-07-26T16:00:53.151 INFO:tasks.rados.rados.0.smithi033.stdout:1191: left oid 41 (ObjNum 371 snap 117 seq_num 371) 2021-07-26T16:00:53.151 INFO:tasks.rados.rados.0.smithi033.stdout:1192: finishing write tid 1 to smithi03339061-37 2021-07-26T16:00:53.152 INFO:tasks.rados.rados.0.smithi033.stdout:1192: finishing write tid 2 to smithi03339061-37 2021-07-26T16:00:53.152 INFO:tasks.rados.rados.0.smithi033.stdout:1192: finishing write tid 3 to smithi03339061-37 2021-07-26T16:00:53.152 INFO:tasks.rados.rados.0.smithi033.stdout:1192: finishing write tid 4 to smithi03339061-37 2021-07-26T16:00:53.152 INFO:tasks.rados.rados.0.smithi033.stdout:1192: finishing write tid 5 to smithi03339061-37 2021-07-26T16:00:53.153 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 520 (ObjNum 372 snap 117 seq_num 372) dirty exists 2021-07-26T16:00:53.153 INFO:tasks.rados.rados.0.smithi033.stdout:1192: left oid 37 (ObjNum 372 snap 117 seq_num 372) 2021-07-26T16:00:53.153 INFO:tasks.rados.rados.0.smithi033.stdout:1193: expect (ObjNum 352 snap 111 seq_num 352) 2021-07-26T16:00:53.208 INFO:tasks.rados.rados.0.smithi033.stdout:1188: finishing copy_from to smithi03339061-32 2021-07-26T16:00:53.209 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 203 (ObjNum 282 snap 86 seq_num 282) dirty exists 2021-07-26T16:00:53.209 INFO:tasks.rados.rados.0.smithi033.stdout:1188: finishing copy_from racing read to smithi03339061-32 2021-07-26T16:00:53.209 INFO:tasks.rados.rados.0.smithi033.stdout:1194: seq_num 373 ranges {0=655360,655360=499712,1155072=303104} 2021-07-26T16:00:53.219 INFO:tasks.rados.rados.0.smithi033.stdout:1194: writing smithi03339061-31 from 0 to 655360 tid 1 2021-07-26T16:00:53.223 INFO:tasks.rados.rados.0.smithi033.stdout:1194: writing smithi03339061-31 from 655360 to 1155072 tid 2 2021-07-26T16:00:53.226 INFO:tasks.rados.rados.0.smithi033.stdout:1194: writing smithi03339061-31 from 1155072 to 1458176 tid 3 2021-07-26T16:00:53.227 INFO:tasks.rados.rados.0.smithi033.stdout:1187: done (6 left) 2021-07-26T16:00:53.227 INFO:tasks.rados.rados.0.smithi033.stdout:1188: done (5 left) 2021-07-26T16:00:53.227 INFO:tasks.rados.rados.0.smithi033.stdout:1190: done (4 left) 2021-07-26T16:00:53.227 INFO:tasks.rados.rados.0.smithi033.stdout:1191: done (3 left) 2021-07-26T16:00:53.228 INFO:tasks.rados.rados.0.smithi033.stdout:1192: done (2 left) 2021-07-26T16:00:53.228 INFO:tasks.rados.rados.0.smithi033.stdout:1193: done (1 left) 2021-07-26T16:00:53.228 INFO:tasks.rados.rados.0.smithi033.stdout:1195: rollback oid 10 current snap is 117 2021-07-26T16:00:53.229 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 10 to 115 2021-07-26T16:00:53.229 INFO:tasks.rados.rados.0.smithi033.stdout:1196: copy_from oid 44 from oid 15 current snap is 117 2021-07-26T16:00:53.229 INFO:tasks.rados.rados.0.smithi033.stdout:1197: snap_remove snap 109 2021-07-26T16:00:53.459 INFO:journalctl@ceph.osd.3.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[48402]: debug 2021-07-26T16:00:53.007+0000 7ffb95f54700 -1 osd.3 280 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-07-26T16:00:53.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[41341]: audit 2021-07-26T16:00:52.450441+0000 mon.c (mon.1) 81 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/1497559126,v1:172.21.15.33:6827/1497559126]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-07-26T16:00:53.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[41341]: audit 2021-07-26T16:00:52.450986+0000 mon.a (mon.0) 420 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-07-26T16:00:53.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[41341]: audit 2021-07-26T16:00:53.003721+0000 mon.a (mon.0) 421 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-07-26T16:00:53.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[41341]: cluster 2021-07-26T16:00:53.003938+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e292: 8 total, 7 up, 8 in 2021-07-26T16:00:53.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[41341]: audit 2021-07-26T16:00:53.007121+0000 mon.c (mon.1) 82 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/1497559126,v1:172.21.15.33:6827/1497559126]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T16:00:53.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[41341]: audit 2021-07-26T16:00:53.008060+0000 mon.a (mon.0) 423 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T16:00:53.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[42377]: audit 2021-07-26T16:00:52.450441+0000 mon.c (mon.1) 81 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/1497559126,v1:172.21.15.33:6827/1497559126]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-07-26T16:00:53.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[42377]: audit 2021-07-26T16:00:52.450986+0000 mon.a (mon.0) 420 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-07-26T16:00:53.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[42377]: audit 2021-07-26T16:00:53.003721+0000 mon.a (mon.0) 421 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-07-26T16:00:53.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[42377]: cluster 2021-07-26T16:00:53.003938+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e292: 8 total, 7 up, 8 in 2021-07-26T16:00:53.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[42377]: audit 2021-07-26T16:00:53.007121+0000 mon.c (mon.1) 82 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/1497559126,v1:172.21.15.33:6827/1497559126]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T16:00:53.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[42377]: audit 2021-07-26T16:00:53.008060+0000 mon.a (mon.0) 423 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T16:00:53.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:53 smithi096 bash[33981]: audit 2021-07-26T16:00:52.450441+0000 mon.c (mon.1) 81 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/1497559126,v1:172.21.15.33:6827/1497559126]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-07-26T16:00:53.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:53 smithi096 bash[33981]: audit 2021-07-26T16:00:52.450986+0000 mon.a (mon.0) 420 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-07-26T16:00:53.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:53 smithi096 bash[33981]: audit 2021-07-26T16:00:53.003721+0000 mon.a (mon.0) 421 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-07-26T16:00:53.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:53 smithi096 bash[33981]: cluster 2021-07-26T16:00:53.003938+0000 mon.a (mon.0) 422 : cluster [DBG] osdmap e292: 8 total, 7 up, 8 in 2021-07-26T16:00:53.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:53 smithi096 bash[33981]: audit 2021-07-26T16:00:53.007121+0000 mon.c (mon.1) 82 : audit [INF] from='osd.3 [v2:172.21.15.33:6826/1497559126,v1:172.21.15.33:6827/1497559126]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T16:00:53.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:53 smithi096 bash[33981]: audit 2021-07-26T16:00:53.008060+0000 mon.a (mon.0) 423 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi033", "root=default"]}]: dispatch 2021-07-26T16:00:53.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:53.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:53.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:53.517Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:00:53.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:00:53 smithi033 bash[32681]: level=error ts=2021-07-26T16:00:53.517Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:00:54.011 INFO:tasks.rados.rados.0.smithi033.stdout:1197: done (3 left) 2021-07-26T16:00:54.011 INFO:tasks.rados.rados.0.smithi033.stdout:1198: copy_from oid 24 from oid 34 current snap is 117 2021-07-26T16:00:54.012 INFO:tasks.rados.rados.0.smithi033.stdout:1194: finishing write tid 1 to smithi03339061-31 2021-07-26T16:00:54.012 INFO:tasks.rados.rados.0.smithi033.stdout:1196: finishing copy_from to smithi03339061-44 2021-07-26T16:00:54.012 INFO:tasks.rados.rados.0.smithi033.stdout:1196: got expected ENOENT (src dne) 2021-07-26T16:00:54.012 INFO:tasks.rados.rados.0.smithi033.stdout:1196: finishing copy_from racing read to smithi03339061-44 2021-07-26T16:00:54.013 INFO:tasks.rados.rados.0.smithi033.stdout:1194: finishing write tid 2 to smithi03339061-31 2021-07-26T16:00:54.013 INFO:tasks.rados.rados.0.smithi033.stdout:1195: finishing rollback tid 0 to smithi03339061-10 2021-07-26T16:00:54.013 INFO:tasks.rados.rados.0.smithi033.stdout:1195: finishing rollback tid 1 to smithi03339061-10 2021-07-26T16:00:54.014 INFO:tasks.rados.rados.0.smithi033.stdout:1194: finishing write tid 3 to smithi03339061-31 2021-07-26T16:00:54.014 INFO:tasks.rados.rados.0.smithi033.stdout:1195: finishing rollback tid 2 to smithi03339061-10 2021-07-26T16:00:54.014 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 524 (ObjNum 257 snap 77 seq_num 257) dirty exists 2021-07-26T16:00:54.014 INFO:tasks.rados.rados.0.smithi033.stdout:1194: finishing write tid 4 to smithi03339061-31 2021-07-26T16:00:54.014 INFO:tasks.rados.rados.0.smithi033.stdout:1194: finishing write tid 5 to smithi03339061-31 2021-07-26T16:00:54.015 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 52 (ObjNum 373 snap 117 seq_num 373) dirty exists 2021-07-26T16:00:54.015 INFO:tasks.rados.rados.0.smithi033.stdout:1194: left oid 31 (ObjNum 373 snap 117 seq_num 373) 2021-07-26T16:00:54.015 INFO:tasks.rados.rados.0.smithi033.stdout:1194: done (3 left) 2021-07-26T16:00:54.015 INFO:tasks.rados.rados.0.smithi033.stdout:1195: done (2 left) 2021-07-26T16:00:54.016 INFO:tasks.rados.rados.0.smithi033.stdout:1196: done (1 left) 2021-07-26T16:00:54.016 INFO:tasks.rados.rados.0.smithi033.stdout:1199: snap_create 2021-07-26T16:00:54.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:54 smithi096 bash[33981]: cluster 2021-07-26T16:00:53.001569+0000 mgr.y (mgr.34104) 157 : cluster [DBG] pgmap v231: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 198 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 999 KiB/s wr, 11 op/s; 87/381 objects degraded (22.835%) 2021-07-26T16:00:54.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:54 smithi096 bash[33981]: cluster 2021-07-26T16:00:53.997644+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:00:54.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:54 smithi096 bash[33981]: cluster 2021-07-26T16:00:54.006815+0000 mon.a (mon.0) 425 : cluster [INF] osd.3 [v2:172.21.15.33:6826/1497559126,v1:172.21.15.33:6827/1497559126] boot 2021-07-26T16:00:54.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:54 smithi096 bash[33981]: cluster 2021-07-26T16:00:54.006915+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2021-07-26T16:00:54.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:54 smithi096 bash[33981]: audit 2021-07-26T16:00:54.008459+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T16:00:54.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:54 smithi033 bash[41341]: cluster 2021-07-26T16:00:53.001569+0000 mgr.y (mgr.34104) 157 : cluster [DBG] pgmap v231: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 198 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 999 KiB/s wr, 11 op/s; 87/381 objects degraded (22.835%) 2021-07-26T16:00:54.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:54 smithi033 bash[41341]: cluster 2021-07-26T16:00:53.997644+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:00:54.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:54 smithi033 bash[41341]: cluster 2021-07-26T16:00:54.006815+0000 mon.a (mon.0) 425 : cluster [INF] osd.3 [v2:172.21.15.33:6826/1497559126,v1:172.21.15.33:6827/1497559126] boot 2021-07-26T16:00:54.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:54 smithi033 bash[41341]: cluster 2021-07-26T16:00:54.006915+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2021-07-26T16:00:54.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:54 smithi033 bash[41341]: audit 2021-07-26T16:00:54.008459+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T16:00:54.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:54 smithi033 bash[42377]: cluster 2021-07-26T16:00:53.001569+0000 mgr.y (mgr.34104) 157 : cluster [DBG] pgmap v231: 25 pgs: 8 active+undersized+degraded, 1 active+undersized, 16 active+clean; 198 MiB data, 732 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 999 KiB/s wr, 11 op/s; 87/381 objects degraded (22.835%) 2021-07-26T16:00:54.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:54 smithi033 bash[42377]: cluster 2021-07-26T16:00:53.997644+0000 mon.a (mon.0) 424 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:00:54.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:54 smithi033 bash[42377]: cluster 2021-07-26T16:00:54.006815+0000 mon.a (mon.0) 425 : cluster [INF] osd.3 [v2:172.21.15.33:6826/1497559126,v1:172.21.15.33:6827/1497559126] boot 2021-07-26T16:00:54.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:54 smithi033 bash[42377]: cluster 2021-07-26T16:00:54.006915+0000 mon.a (mon.0) 426 : cluster [DBG] osdmap e293: 8 total, 8 up, 8 in 2021-07-26T16:00:54.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:54 smithi033 bash[42377]: audit 2021-07-26T16:00:54.008459+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-07-26T16:00:55.013 INFO:tasks.rados.rados.0.smithi033.stdout:1199: done (1 left) 2021-07-26T16:00:55.013 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 118 2021-07-26T16:00:55.013 INFO:tasks.rados.rados.0.smithi033.stdout:1200: seq_num 374 ranges {2646016=671744,3317760=778240,4096000=24576} 2021-07-26T16:00:55.034 INFO:tasks.rados.rados.0.smithi033.stdout:1200: writing smithi03339061-8 from 2646016 to 3317760 tid 1 2021-07-26T16:00:55.040 INFO:tasks.rados.rados.0.smithi033.stdout:1200: writing smithi03339061-8 from 3317760 to 4096000 tid 2 2021-07-26T16:00:55.040 INFO:tasks.rados.rados.0.smithi033.stdout:1200: writing smithi03339061-8 from 4096000 to 4120576 tid 3 2021-07-26T16:00:55.040 INFO:tasks.rados.rados.0.smithi033.stdout:1201: rmattr oid 28 current snap is 118 2021-07-26T16:00:55.041 INFO:tasks.rados.rados.0.smithi033.stdout:1201: done (2 left) 2021-07-26T16:00:55.041 INFO:tasks.rados.rados.0.smithi033.stdout:1202: delete oid 37 current snap is 118 2021-07-26T16:00:55.041 INFO:tasks.rados.rados.0.smithi033.stdout:1200: finishing write tid 1 to smithi03339061-8 2021-07-26T16:00:55.045 INFO:tasks.rados.rados.0.smithi033.stdout:1200: finishing write tid 2 to smithi03339061-8 2021-07-26T16:00:55.046 INFO:tasks.rados.rados.0.smithi033.stdout:1200: finishing write tid 3 to smithi03339061-8 2021-07-26T16:00:55.046 INFO:tasks.rados.rados.0.smithi033.stdout:1200: finishing write tid 4 to smithi03339061-8 2021-07-26T16:00:55.047 INFO:tasks.rados.rados.0.smithi033.stdout:1200: finishing write tid 5 to smithi03339061-8 2021-07-26T16:00:55.047 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 418 (ObjNum 374 snap 118 seq_num 374) dirty exists 2021-07-26T16:00:55.048 INFO:tasks.rados.rados.0.smithi033.stdout:1200: left oid 8 (ObjNum 374 snap 118 seq_num 374) 2021-07-26T16:00:56.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:56 smithi033 bash[41341]: cluster 2021-07-26T16:00:55.002518+0000 mgr.y (mgr.34104) 158 : cluster [DBG] pgmap v233: 25 pgs: 4 peering, 5 active+undersized+degraded, 16 active+clean; 201 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.3 MiB/s wr, 12 op/s; 56/387 objects degraded (14.470%) 2021-07-26T16:00:56.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:56 smithi033 bash[41341]: cluster 2021-07-26T16:00:55.008878+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2021-07-26T16:00:56.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:56 smithi033 bash[41341]: cluster 2021-07-26T16:00:55.971858+0000 mon.a (mon.0) 428 : cluster [WRN] Health check update: Degraded data redundancy: 87/381 objects degraded (22.835%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:56.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:56 smithi033 bash[42377]: cluster 2021-07-26T16:00:55.002518+0000 mgr.y (mgr.34104) 158 : cluster [DBG] pgmap v233: 25 pgs: 4 peering, 5 active+undersized+degraded, 16 active+clean; 201 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.3 MiB/s wr, 12 op/s; 56/387 objects degraded (14.470%) 2021-07-26T16:00:56.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:56 smithi033 bash[42377]: cluster 2021-07-26T16:00:55.008878+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2021-07-26T16:00:56.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:56 smithi033 bash[42377]: cluster 2021-07-26T16:00:55.971858+0000 mon.a (mon.0) 428 : cluster [WRN] Health check update: Degraded data redundancy: 87/381 objects degraded (22.835%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:56.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:56 smithi096 bash[33981]: cluster 2021-07-26T16:00:55.002518+0000 mgr.y (mgr.34104) 158 : cluster [DBG] pgmap v233: 25 pgs: 4 peering, 5 active+undersized+degraded, 16 active+clean; 201 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.3 MiB/s wr, 12 op/s; 56/387 objects degraded (14.470%) 2021-07-26T16:00:56.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:56 smithi096 bash[33981]: cluster 2021-07-26T16:00:55.008878+0000 mon.a (mon.0) 427 : cluster [DBG] osdmap e294: 8 total, 8 up, 8 in 2021-07-26T16:00:56.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:56 smithi096 bash[33981]: cluster 2021-07-26T16:00:55.971858+0000 mon.a (mon.0) 428 : cluster [WRN] Health check update: Degraded data redundancy: 87/381 objects degraded (22.835%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:00:58.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:58 smithi033 bash[42377]: cluster 2021-07-26T16:00:57.003388+0000 mgr.y (mgr.34104) 159 : cluster [DBG] pgmap v235: 25 pgs: 4 peering, 4 active+undersized+degraded, 17 active+clean; 214 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 16 op/s; 48/390 objects degraded (12.308%); 3.4 MiB/s, 1 objects/s recovering 2021-07-26T16:00:58.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:58 smithi033 bash[41341]: cluster 2021-07-26T16:00:57.003388+0000 mgr.y (mgr.34104) 159 : cluster [DBG] pgmap v235: 25 pgs: 4 peering, 4 active+undersized+degraded, 17 active+clean; 214 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 16 op/s; 48/390 objects degraded (12.308%); 3.4 MiB/s, 1 objects/s recovering 2021-07-26T16:00:58.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:58 smithi096 bash[33981]: cluster 2021-07-26T16:00:57.003388+0000 mgr.y (mgr.34104) 159 : cluster [DBG] pgmap v235: 25 pgs: 4 peering, 4 active+undersized+degraded, 17 active+clean; 214 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 3.5 MiB/s wr, 16 op/s; 48/390 objects degraded (12.308%); 3.4 MiB/s, 1 objects/s recovering 2021-07-26T16:00:59.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:59 smithi033 bash[42377]: cluster 2021-07-26T16:00:59.013824+0000 mon.a (mon.0) 429 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/390 objects degraded (12.308%), 4 pgs degraded) 2021-07-26T16:00:59.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:00:59 smithi033 bash[42377]: cluster 2021-07-26T16:00:59.013895+0000 mon.a (mon.0) 430 : cluster [INF] Cluster is now healthy 2021-07-26T16:00:59.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:59 smithi033 bash[41341]: cluster 2021-07-26T16:00:59.013824+0000 mon.a (mon.0) 429 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/390 objects degraded (12.308%), 4 pgs degraded) 2021-07-26T16:00:59.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:00:59 smithi033 bash[41341]: cluster 2021-07-26T16:00:59.013895+0000 mon.a (mon.0) 430 : cluster [INF] Cluster is now healthy 2021-07-26T16:00:59.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:59 smithi096 bash[33981]: cluster 2021-07-26T16:00:59.013824+0000 mon.a (mon.0) 429 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/390 objects degraded (12.308%), 4 pgs degraded) 2021-07-26T16:00:59.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:00:59 smithi096 bash[33981]: cluster 2021-07-26T16:00:59.013895+0000 mon.a (mon.0) 430 : cluster [INF] Cluster is now healthy 2021-07-26T16:01:00.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:00 smithi033 bash[42377]: cluster 2021-07-26T16:00:59.004137+0000 mgr.y (mgr.34104) 160 : cluster [DBG] pgmap v236: 25 pgs: 4 active+clean+wait, 4 peering, 17 active+clean; 198 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 15 op/s; 11 MiB/s, 3 objects/s recovering 2021-07-26T16:01:00.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:00 smithi033 bash[41341]: cluster 2021-07-26T16:00:59.004137+0000 mgr.y (mgr.34104) 160 : cluster [DBG] pgmap v236: 25 pgs: 4 active+clean+wait, 4 peering, 17 active+clean; 198 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 15 op/s; 11 MiB/s, 3 objects/s recovering 2021-07-26T16:01:00.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:00 smithi096 bash[33981]: cluster 2021-07-26T16:00:59.004137+0000 mgr.y (mgr.34104) 160 : cluster [DBG] pgmap v236: 25 pgs: 4 active+clean+wait, 4 peering, 17 active+clean; 198 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 15 op/s; 11 MiB/s, 3 objects/s recovering 2021-07-26T16:01:02.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:01 smithi033 bash[41341]: cluster 2021-07-26T16:01:01.005007+0000 mgr.y (mgr.34104) 161 : cluster [DBG] pgmap v237: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 725 MiB used, 715 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 11 op/s; 13 MiB/s, 4 objects/s recovering 2021-07-26T16:01:02.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:01 smithi033 bash[42377]: cluster 2021-07-26T16:01:01.005007+0000 mgr.y (mgr.34104) 161 : cluster [DBG] pgmap v237: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 725 MiB used, 715 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 11 op/s; 13 MiB/s, 4 objects/s recovering 2021-07-26T16:01:02.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:01 smithi096 bash[33981]: cluster 2021-07-26T16:01:01.005007+0000 mgr.y (mgr.34104) 161 : cluster [DBG] pgmap v237: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 725 MiB used, 715 GiB / 715 GiB avail; 2.0 MiB/s rd, 2.4 MiB/s wr, 11 op/s; 13 MiB/s, 4 objects/s recovering 2021-07-26T16:01:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:03 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:03.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:03 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:03.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:03 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:03.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:01:04.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:04 smithi033 bash[41341]: cluster 2021-07-26T16:01:03.005772+0000 mgr.y (mgr.34104) 162 : cluster [DBG] pgmap v238: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 10 op/s; 12 MiB/s, 3 objects/s recovering 2021-07-26T16:01:04.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:04 smithi033 bash[42377]: cluster 2021-07-26T16:01:03.005772+0000 mgr.y (mgr.34104) 162 : cluster [DBG] pgmap v238: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 10 op/s; 12 MiB/s, 3 objects/s recovering 2021-07-26T16:01:04.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:04 smithi096 bash[33981]: cluster 2021-07-26T16:01:03.005772+0000 mgr.y (mgr.34104) 162 : cluster [DBG] pgmap v238: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 10 op/s; 12 MiB/s, 3 objects/s recovering 2021-07-26T16:01:05.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:05 smithi033 bash[42377]: audit 2021-07-26T16:01:04.292310+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:01:05.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:05 smithi033 bash[42377]: audit 2021-07-26T16:01:04.292735+0000 mgr.y (mgr.34104) 163 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:01:05.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:05 smithi033 bash[42377]: cephadm 2021-07-26T16:01:04.294904+0000 mgr.y (mgr.34104) 164 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-07-26T16:01:05.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:05 smithi033 bash[42377]: cephadm 2021-07-26T16:01:04.295626+0000 mgr.y (mgr.34104) 165 : cephadm [INF] Upgrade: osd.5 is also safe to restart 2021-07-26T16:01:05.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:05 smithi033 bash[41341]: audit 2021-07-26T16:01:04.292310+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:01:05.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:05 smithi033 bash[41341]: audit 2021-07-26T16:01:04.292735+0000 mgr.y (mgr.34104) 163 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:01:05.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:05 smithi033 bash[41341]: cephadm 2021-07-26T16:01:04.294904+0000 mgr.y (mgr.34104) 164 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-07-26T16:01:05.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:05 smithi033 bash[41341]: cephadm 2021-07-26T16:01:04.295626+0000 mgr.y (mgr.34104) 165 : cephadm [INF] Upgrade: osd.5 is also safe to restart 2021-07-26T16:01:05.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:05 smithi096 bash[33981]: audit 2021-07-26T16:01:04.292310+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:01:05.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:05 smithi096 bash[33981]: audit 2021-07-26T16:01:04.292735+0000 mgr.y (mgr.34104) 163 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2021-07-26T16:01:05.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:05 smithi096 bash[33981]: cephadm 2021-07-26T16:01:04.294904+0000 mgr.y (mgr.34104) 164 : cephadm [INF] Upgrade: osd.4 is safe to restart 2021-07-26T16:01:05.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:05 smithi096 bash[33981]: cephadm 2021-07-26T16:01:04.295626+0000 mgr.y (mgr.34104) 165 : cephadm [INF] Upgrade: osd.5 is also safe to restart 2021-07-26T16:01:06.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:06 smithi033 bash[42377]: cluster 2021-07-26T16:01:05.006614+0000 mgr.y (mgr.34104) 166 : cluster [DBG] pgmap v239: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 409 B/s rd, 1.4 MiB/s wr, 6 op/s; 10 MiB/s, 3 objects/s recovering 2021-07-26T16:01:06.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:06 smithi033 bash[42377]: cluster 2021-07-26T16:01:05.984493+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2021-07-26T16:01:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:06 smithi033 bash[41341]: cluster 2021-07-26T16:01:05.006614+0000 mgr.y (mgr.34104) 166 : cluster [DBG] pgmap v239: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 409 B/s rd, 1.4 MiB/s wr, 6 op/s; 10 MiB/s, 3 objects/s recovering 2021-07-26T16:01:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:06 smithi033 bash[41341]: cluster 2021-07-26T16:01:05.984493+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2021-07-26T16:01:06.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:06 smithi096 bash[33981]: cluster 2021-07-26T16:01:05.006614+0000 mgr.y (mgr.34104) 166 : cluster [DBG] pgmap v239: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 409 B/s rd, 1.4 MiB/s wr, 6 op/s; 10 MiB/s, 3 objects/s recovering 2021-07-26T16:01:06.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:06 smithi096 bash[33981]: cluster 2021-07-26T16:01:05.984493+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e295: 8 total, 8 up, 8 in 2021-07-26T16:01:07.197 INFO:tasks.rados.rados.0.smithi033.stdout:1200: done (2 left) 2021-07-26T16:01:07.198 INFO:tasks.rados.rados.0.smithi033.stdout:1202: done (1 left) 2021-07-26T16:01:07.198 INFO:tasks.rados.rados.0.smithi033.stdout:1203: rollback oid 12 current snap is 118 2021-07-26T16:01:07.198 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 12 to 116 2021-07-26T16:01:07.198 INFO:tasks.rados.rados.0.smithi033.stdout:1204: copy_from oid 37 from oid 19 current snap is 118 2021-07-26T16:01:07.199 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 118 2021-07-26T16:01:07.199 INFO:tasks.rados.rados.0.smithi033.stdout:1205: seq_num 376 ranges {2433024=704512,3137536=548864,3686400=253952} 2021-07-26T16:01:07.221 INFO:tasks.rados.rados.0.smithi033.stdout:1205: writing smithi03339061-42 from 2433024 to 3137536 tid 1 2021-07-26T16:01:07.224 INFO:tasks.rados.rados.0.smithi033.stdout:1205: writing smithi03339061-42 from 3137536 to 3686400 tid 2 2021-07-26T16:01:07.226 INFO:tasks.rados.rados.0.smithi033.stdout:1205: writing smithi03339061-42 from 3686400 to 3940352 tid 3 2021-07-26T16:01:07.226 INFO:tasks.rados.rados.0.smithi033.stdout:1206: read oid 47 snap 117 2021-07-26T16:01:07.227 INFO:tasks.rados.rados.0.smithi033.stdout:1206: expect (ObjNum 271 snap 83 seq_num 271) 2021-07-26T16:01:07.227 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 118 2021-07-26T16:01:07.227 INFO:tasks.rados.rados.0.smithi033.stdout:1203: finishing rollback tid 0 to smithi03339061-12 2021-07-26T16:01:07.227 INFO:tasks.rados.rados.0.smithi033.stdout:1207: seq_num 377 ranges {4096000=720896,4816896=434176,5251072=368640} 2021-07-26T16:01:07.253 INFO:tasks.rados.rados.0.smithi033.stdout:1207: writing smithi03339061-48 from 4096000 to 4816896 tid 1 2021-07-26T16:01:07.256 INFO:tasks.rados.rados.0.smithi033.stdout:1207: writing smithi03339061-48 from 4816896 to 5251072 tid 2 2021-07-26T16:01:07.258 INFO:tasks.rados.rados.0.smithi033.stdout:1207: writing smithi03339061-48 from 5251072 to 5619712 tid 3 2021-07-26T16:01:07.258 INFO:tasks.rados.rados.0.smithi033.stdout:1208: snap_remove snap 113 2021-07-26T16:01:07.494 INFO:tasks.rados.rados.0.smithi033.stdout:1203: finishing rollback tid 1 to smithi03339061-12 2021-07-26T16:01:07.494 INFO:tasks.rados.rados.0.smithi033.stdout:1203: finishing rollback tid 2 to smithi03339061-12 2021-07-26T16:01:07.495 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 323 (ObjNum 351 snap 111 seq_num 351) dirty exists 2021-07-26T16:01:07.495 INFO:tasks.rados.rados.0.smithi033.stdout:1198: finishing copy_from to smithi03339061-24 2021-07-26T16:01:07.496 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 411 (ObjNum 353 snap 112 seq_num 353) dirty exists 2021-07-26T16:01:07.497 INFO:tasks.rados.rados.0.smithi033.stdout:1198: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:01:07.497 INFO:tasks.rados.rados.0.smithi033.stdout:1204: finishing copy_from to smithi03339061-37 2021-07-26T16:01:07.498 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 380 (ObjNum 360 snap 113 seq_num 360) dirty exists 2021-07-26T16:01:07.498 INFO:tasks.rados.rados.0.smithi033.stdout:1204: finishing copy_from racing read to smithi03339061-37 2021-07-26T16:01:07.499 INFO:tasks.rados.rados.0.smithi033.stdout:1205: finishing write tid 1 to smithi03339061-42 2021-07-26T16:01:07.499 INFO:tasks.rados.rados.0.smithi033.stdout:1205: finishing write tid 2 to smithi03339061-42 2021-07-26T16:01:07.500 INFO:tasks.rados.rados.0.smithi033.stdout:1205: finishing write tid 3 to smithi03339061-42 2021-07-26T16:01:07.500 INFO:tasks.rados.rados.0.smithi033.stdout:1205: finishing write tid 4 to smithi03339061-42 2021-07-26T16:01:07.500 INFO:tasks.rados.rados.0.smithi033.stdout:1205: finishing write tid 5 to smithi03339061-42 2021-07-26T16:01:07.501 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 236 (ObjNum 376 snap 118 seq_num 376) dirty exists 2021-07-26T16:01:07.501 INFO:tasks.rados.rados.0.smithi033.stdout:1205: left oid 42 (ObjNum 376 snap 118 seq_num 376) 2021-07-26T16:01:07.501 INFO:tasks.rados.rados.0.smithi033.stdout:1206: expect (ObjNum 271 snap 83 seq_num 271) 2021-07-26T16:01:07.649 INFO:tasks.rados.rados.0.smithi033.stdout:1207: finishing write tid 1 to smithi03339061-48 2021-07-26T16:01:07.649 INFO:tasks.rados.rados.0.smithi033.stdout:1207: finishing write tid 2 to smithi03339061-48 2021-07-26T16:01:07.650 INFO:tasks.rados.rados.0.smithi033.stdout:1207: finishing write tid 3 to smithi03339061-48 2021-07-26T16:01:07.650 INFO:tasks.rados.rados.0.smithi033.stdout:1207: finishing write tid 4 to smithi03339061-48 2021-07-26T16:01:07.650 INFO:tasks.rados.rados.0.smithi033.stdout:1207: finishing write tid 5 to smithi03339061-48 2021-07-26T16:01:07.651 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 460 (ObjNum 377 snap 118 seq_num 377) dirty exists 2021-07-26T16:01:07.651 INFO:tasks.rados.rados.0.smithi033.stdout:1207: left oid 48 (ObjNum 377 snap 118 seq_num 377) 2021-07-26T16:01:07.652 INFO:tasks.rados.rados.0.smithi033.stdout:1198: done (6 left) 2021-07-26T16:01:07.652 INFO:tasks.rados.rados.0.smithi033.stdout:1203: done (5 left) 2021-07-26T16:01:07.653 INFO:tasks.rados.rados.0.smithi033.stdout:1204: done (4 left) 2021-07-26T16:01:07.653 INFO:tasks.rados.rados.0.smithi033.stdout:1205: done (3 left) 2021-07-26T16:01:07.653 INFO:tasks.rados.rados.0.smithi033.stdout:1206: done (2 left) 2021-07-26T16:01:07.654 INFO:tasks.rados.rados.0.smithi033.stdout:1207: done (1 left) 2021-07-26T16:01:07.654 INFO:tasks.rados.rados.0.smithi033.stdout:1208: done (0 left) 2021-07-26T16:01:07.655 INFO:tasks.rados.rados.0.smithi033.stdout:1209: rollback oid 44 current snap is 118 2021-07-26T16:01:07.655 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 117 2021-07-26T16:01:07.655 INFO:tasks.rados.rados.0.smithi033.stdout:1210: delete oid 14 current snap is 118 2021-07-26T16:01:07.658 INFO:tasks.rados.rados.0.smithi033.stdout:1209: finishing rollback tid 0 to smithi03339061-44 2021-07-26T16:01:07.658 INFO:tasks.rados.rados.0.smithi033.stdout:1209: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:01:07.659 INFO:tasks.rados.rados.0.smithi033.stdout:1209: finishing rollback tid 2 to smithi03339061-44 2021-07-26T16:01:07.659 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 477 (ObjNum 232 snap 65 seq_num 232) dirty exists 2021-07-26T16:01:07.659 INFO:tasks.rados.rados.0.smithi033.stdout:1209: done (1 left) 2021-07-26T16:01:07.659 INFO:tasks.rados.rados.0.smithi033.stdout:1210: done (0 left) 2021-07-26T16:01:07.660 INFO:tasks.rados.rados.0.smithi033.stdout:1211: read oid 12 snap 116 2021-07-26T16:01:07.660 INFO:tasks.rados.rados.0.smithi033.stdout:1211: expect (ObjNum 351 snap 111 seq_num 351) 2021-07-26T16:01:07.660 INFO:tasks.rados.rados.0.smithi033.stdout:1212: read oid 26 snap -1 2021-07-26T16:01:07.660 INFO:tasks.rados.rados.0.smithi033.stdout:1212: expect (ObjNum 232 snap 65 seq_num 232) 2021-07-26T16:01:07.661 INFO:tasks.rados.rados.0.smithi033.stdout:1213: copy_from oid 49 from oid 21 current snap is 118 2021-07-26T16:01:07.661 INFO:tasks.rados.rados.0.smithi033.stdout:1214: read oid 33 snap -1 2021-07-26T16:01:07.661 INFO:tasks.rados.rados.0.smithi033.stdout:1214: expect (ObjNum 295 snap 91 seq_num 295) 2021-07-26T16:01:07.661 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 118 2021-07-26T16:01:07.661 INFO:tasks.rados.rados.0.smithi033.stdout:1215: seq_num 379 ranges {3940352=753664,4694016=606208,5300224=196608} 2021-07-26T16:01:07.685 INFO:tasks.rados.rados.0.smithi033.stdout:1215: writing smithi03339061-42 from 3940352 to 4694016 tid 1 2021-07-26T16:01:07.688 INFO:tasks.rados.rados.0.smithi033.stdout:1215: writing smithi03339061-42 from 4694016 to 5300224 tid 2 2021-07-26T16:01:07.689 INFO:tasks.rados.rados.0.smithi033.stdout:1215: writing smithi03339061-42 from 5300224 to 5496832 tid 3 2021-07-26T16:01:07.690 INFO:tasks.rados.rados.0.smithi033.stdout:1216: rollback oid 29 current snap is 118 2021-07-26T16:01:07.690 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 116 2021-07-26T16:01:07.690 INFO:tasks.rados.rados.0.smithi033.stdout:1212: expect (ObjNum 232 snap 65 seq_num 232) 2021-07-26T16:01:07.765 INFO:tasks.rados.rados.0.smithi033.stdout:1214: expect (ObjNum 295 snap 91 seq_num 295) 2021-07-26T16:01:07.787 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:07 smithi096 bash[33981]: cephadm 2021-07-26T16:01:06.471356+0000 mgr.y (mgr.34104) 167 : cephadm [INF] Upgrade: Updating osd.4 (1/2) 2021-07-26T16:01:07.787 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:07 smithi096 bash[33981]: audit 2021-07-26T16:01:06.481604+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:07.787 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:07 smithi096 bash[33981]: cephadm 2021-07-26T16:01:06.484691+0000 mgr.y (mgr.34104) 168 : cephadm [INF] Deploying daemon osd.4 on smithi096 2021-07-26T16:01:07.867 INFO:tasks.rados.rados.0.smithi033.stdout:1211: expect (ObjNum 351 snap 111 seq_num 351) 2021-07-26T16:01:07.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:07 smithi033 bash[41341]: cephadm 2021-07-26T16:01:06.471356+0000 mgr.y (mgr.34104) 167 : cephadm [INF] Upgrade: Updating osd.4 (1/2) 2021-07-26T16:01:07.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:07 smithi033 bash[41341]: audit 2021-07-26T16:01:06.481604+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:07.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:07 smithi033 bash[41341]: cephadm 2021-07-26T16:01:06.484691+0000 mgr.y (mgr.34104) 168 : cephadm [INF] Deploying daemon osd.4 on smithi096 2021-07-26T16:01:07.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:07 smithi033 bash[42377]: cephadm 2021-07-26T16:01:06.471356+0000 mgr.y (mgr.34104) 167 : cephadm [INF] Upgrade: Updating osd.4 (1/2) 2021-07-26T16:01:07.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:07 smithi033 bash[42377]: audit 2021-07-26T16:01:06.481604+0000 mon.a (mon.0) 432 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:07.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:07 smithi033 bash[42377]: cephadm 2021-07-26T16:01:06.484691+0000 mgr.y (mgr.34104) 168 : cephadm [INF] Deploying daemon osd.4 on smithi096 2021-07-26T16:01:08.039 INFO:tasks.rados.rados.0.smithi033.stdout:1216: finishing rollback tid 0 to smithi03339061-29 2021-07-26T16:01:08.039 INFO:tasks.rados.rados.0.smithi033.stdout:1215: finishing write tid 1 to smithi03339061-42 2021-07-26T16:01:08.039 INFO:tasks.rados.rados.0.smithi033.stdout:1215: finishing write tid 2 to smithi03339061-42 2021-07-26T16:01:08.039 INFO:tasks.rados.rados.0.smithi033.stdout:1215: finishing write tid 3 to smithi03339061-42 2021-07-26T16:01:08.040 INFO:tasks.rados.rados.0.smithi033.stdout:1215: finishing write tid 4 to smithi03339061-42 2021-07-26T16:01:08.040 INFO:tasks.rados.rados.0.smithi033.stdout:1211: done (5 left) 2021-07-26T16:01:08.040 INFO:tasks.rados.rados.0.smithi033.stdout:1212: done (4 left) 2021-07-26T16:01:08.040 INFO:tasks.rados.rados.0.smithi033.stdout:1214: done (3 left) 2021-07-26T16:01:08.040 INFO:tasks.rados.rados.0.smithi033.stdout:1217: read oid 44 snap -1 2021-07-26T16:01:08.041 INFO:tasks.rados.rados.0.smithi033.stdout:1217: expect (ObjNum 232 snap 65 seq_num 232) 2021-07-26T16:01:08.041 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 118 2021-07-26T16:01:08.041 INFO:tasks.rados.rados.0.smithi033.stdout:1216: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:01:08.041 INFO:tasks.rados.rados.0.smithi033.stdout:1216: finishing rollback tid 2 to smithi03339061-29 2021-07-26T16:01:08.042 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 186 (ObjNum 343 snap 111 seq_num 343) dirty exists 2021-07-26T16:01:08.042 INFO:tasks.rados.rados.0.smithi033.stdout:1215: finishing write tid 5 to smithi03339061-42 2021-07-26T16:01:08.042 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 240 (ObjNum 379 snap 118 seq_num 379) dirty exists 2021-07-26T16:01:08.042 INFO:tasks.rados.rados.0.smithi033.stdout:1215: left oid 42 (ObjNum 379 snap 118 seq_num 379) 2021-07-26T16:01:08.043 INFO:tasks.rados.rados.0.smithi033.stdout:1213: finishing copy_from to smithi03339061-49 2021-07-26T16:01:08.043 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 520 (ObjNum 275 snap 85 seq_num 275) dirty exists 2021-07-26T16:01:08.043 INFO:tasks.rados.rados.0.smithi033.stdout:1213: finishing copy_from racing read to smithi03339061-49 2021-07-26T16:01:08.043 INFO:tasks.rados.rados.0.smithi033.stdout:1218: seq_num 380 ranges {2097152=770048,2867200=483328,3350528=319488} 2021-07-26T16:01:08.062 INFO:tasks.rados.rados.0.smithi033.stdout:1218: writing smithi03339061-26 from 2097152 to 2867200 tid 1 2021-07-26T16:01:08.065 INFO:tasks.rados.rados.0.smithi033.stdout:1218: writing smithi03339061-26 from 2867200 to 3350528 tid 2 2021-07-26T16:01:08.067 INFO:tasks.rados.rados.0.smithi033.stdout:1218: writing smithi03339061-26 from 3350528 to 3670016 tid 3 2021-07-26T16:01:08.067 INFO:tasks.rados.rados.0.smithi033.stdout:1213: done (4 left) 2021-07-26T16:01:08.067 INFO:tasks.rados.rados.0.smithi033.stdout:1215: done (3 left) 2021-07-26T16:01:08.068 INFO:tasks.rados.rados.0.smithi033.stdout:1216: done (2 left) 2021-07-26T16:01:08.068 INFO:tasks.rados.rados.0.smithi033.stdout:1219: snap_create 2021-07-26T16:01:08.068 INFO:tasks.rados.rados.0.smithi033.stdout:1217: expect (ObjNum 232 snap 65 seq_num 232) 2021-07-26T16:01:08.141 INFO:tasks.rados.rados.0.smithi033.stdout:1218: finishing write tid 1 to smithi03339061-26 2021-07-26T16:01:08.142 INFO:tasks.rados.rados.0.smithi033.stdout:1218: finishing write tid 2 to smithi03339061-26 2021-07-26T16:01:08.142 INFO:tasks.rados.rados.0.smithi033.stdout:1218: finishing write tid 3 to smithi03339061-26 2021-07-26T16:01:08.142 INFO:tasks.rados.rados.0.smithi033.stdout:1218: finishing write tid 4 to smithi03339061-26 2021-07-26T16:01:08.142 INFO:tasks.rados.rados.0.smithi033.stdout:1218: finishing write tid 5 to smithi03339061-26 2021-07-26T16:01:08.142 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 685 (ObjNum 380 snap 118 seq_num 380) dirty exists 2021-07-26T16:01:08.143 INFO:tasks.rados.rados.0.smithi033.stdout:1218: left oid 26 (ObjNum 380 snap 118 seq_num 380) 2021-07-26T16:01:08.503 INFO:tasks.rados.rados.0.smithi033.stdout:1217: done (2 left) 2021-07-26T16:01:08.503 INFO:tasks.rados.rados.0.smithi033.stdout:1218: done (1 left) 2021-07-26T16:01:08.503 INFO:tasks.rados.rados.0.smithi033.stdout:1219: done (0 left) 2021-07-26T16:01:08.504 INFO:tasks.rados.rados.0.smithi033.stdout:1220: rollback oid 1 current snap is 119 2021-07-26T16:01:08.504 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 1 to 118 2021-07-26T16:01:08.504 INFO:tasks.rados.rados.0.smithi033.stdout:1221: rollback oid 36 current snap is 119 2021-07-26T16:01:08.504 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 36 to 115 2021-07-26T16:01:08.504 INFO:tasks.rados.rados.0.smithi033.stdout:1222: snap_remove snap 88 2021-07-26T16:01:08.787 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:08 smithi096 systemd[1]: Stopping Ceph osd.4 for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T16:01:08.787 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:08 smithi096 bash[33981]: cluster 2021-07-26T16:01:07.007365+0000 mgr.y (mgr.34104) 169 : cluster [DBG] pgmap v241: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 141 KiB/s wr, 0 op/s; 8.7 MiB/s, 2 objects/s recovering 2021-07-26T16:01:08.788 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:08 smithi096 bash[33981]: cluster 2021-07-26T16:01:07.490802+0000 mon.a (mon.0) 433 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2021-07-26T16:01:08.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:08 smithi033 bash[42377]: cluster 2021-07-26T16:01:07.007365+0000 mgr.y (mgr.34104) 169 : cluster [DBG] pgmap v241: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 141 KiB/s wr, 0 op/s; 8.7 MiB/s, 2 objects/s recovering 2021-07-26T16:01:08.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:08 smithi033 bash[42377]: cluster 2021-07-26T16:01:07.490802+0000 mon.a (mon.0) 433 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2021-07-26T16:01:08.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:08 smithi033 bash[41341]: cluster 2021-07-26T16:01:07.007365+0000 mgr.y (mgr.34104) 169 : cluster [DBG] pgmap v241: 25 pgs: 4 active+clean+wait, 21 active+clean; 198 MiB data, 726 MiB used, 715 GiB / 715 GiB avail; 102 B/s rd, 141 KiB/s wr, 0 op/s; 8.7 MiB/s, 2 objects/s recovering 2021-07-26T16:01:08.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:08 smithi033 bash[41341]: cluster 2021-07-26T16:01:07.490802+0000 mon.a (mon.0) 433 : cluster [DBG] osdmap e296: 8 total, 8 up, 8 in 2021-07-26T16:01:09.111 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:08 smithi096 docker[35219]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:09.112 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:08 smithi096 bash[17896]: debug 2021-07-26T16:01:08.884+0000 7f4664217700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-07-26T16:01:09.112 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:08 smithi096 bash[17896]: debug 2021-07-26T16:01:08.884+0000 7f4664217700 -1 osd.4 297 *** Got signal Terminated *** 2021-07-26T16:01:09.112 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:08 smithi096 bash[17896]: debug 2021-07-26T16:01:08.884+0000 7f4664217700 -1 osd.4 297 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:01:09.526 INFO:tasks.rados.rados.0.smithi033.stdout:1222: done (2 left) 2021-07-26T16:01:09.526 INFO:tasks.rados.rados.0.smithi033.stdout:1223: snap_remove snap 117 2021-07-26T16:01:09.815 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:09 smithi096 docker[35219]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-osd.4 2021-07-26T16:01:09.816 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:08.499069+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2021-07-26T16:01:09.816 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:08.981066+0000 mon.a (mon.0) 435 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.817 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:08.981174+0000 mon.a (mon.0) 436 : cluster [INF] osd.4 failed (root=default,host=smithi096) (connection refused reported by osd.6) 2021-07-26T16:01:09.817 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:08.982027+0000 mon.a (mon.0) 437 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.817 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:08.984449+0000 mon.a (mon.0) 438 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.817 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:08.991986+0000 mon.a (mon.0) 439 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.818 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: audit 2021-07-26T16:01:09.165794+0000 mon.c (mon.1) 85 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:01:09.818 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: audit 2021-07-26T16:01:09.166599+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:01:09.818 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.168316+0000 mon.a (mon.0) 441 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.818 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.168451+0000 mon.a (mon.0) 442 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.818 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.168737+0000 mon.a (mon.0) 443 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.819 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.168858+0000 mon.a (mon.0) 444 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-07-26T16:01:09.819 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.169344+0000 mon.a (mon.0) 445 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.819 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.169454+0000 mon.a (mon.0) 446 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-07-26T16:01:09.819 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.172157+0000 mon.a (mon.0) 447 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.820 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.172492+0000 mon.a (mon.0) 448 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.820 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.173010+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-07-26T16:01:09.820 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.173359+0000 mon.a (mon.0) 450 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.820 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.173831+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-07-26T16:01:09.820 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.174151+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.821 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.174538+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-07-26T16:01:09.821 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.174943+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-07-26T16:01:09.821 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.184126+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.821 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.184413+0000 mon.a (mon.0) 456 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.822 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.184632+0000 mon.a (mon.0) 457 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.822 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.192545+0000 mon.a (mon.0) 458 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.822 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: audit 2021-07-26T16:01:09.198657+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:01:09.822 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: audit 2021-07-26T16:01:09.199351+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:01:09.822 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[33981]: audit 2021-07-26T16:01:09.445862+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:09.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:08.499069+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2021-07-26T16:01:09.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:08.981066+0000 mon.a (mon.0) 435 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:08.981174+0000 mon.a (mon.0) 436 : cluster [INF] osd.4 failed (root=default,host=smithi096) (connection refused reported by osd.6) 2021-07-26T16:01:09.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:08.982027+0000 mon.a (mon.0) 437 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:08.984449+0000 mon.a (mon.0) 438 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:08.991986+0000 mon.a (mon.0) 439 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: audit 2021-07-26T16:01:09.165794+0000 mon.c (mon.1) 85 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:01:09.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: audit 2021-07-26T16:01:09.166599+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:01:09.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.168316+0000 mon.a (mon.0) 441 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.168451+0000 mon.a (mon.0) 442 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.168737+0000 mon.a (mon.0) 443 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.168858+0000 mon.a (mon.0) 444 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-07-26T16:01:09.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.169344+0000 mon.a (mon.0) 445 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.169454+0000 mon.a (mon.0) 446 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-07-26T16:01:09.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.172157+0000 mon.a (mon.0) 447 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.172492+0000 mon.a (mon.0) 448 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.173010+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-07-26T16:01:09.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.173359+0000 mon.a (mon.0) 450 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.173831+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-07-26T16:01:09.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.174151+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.174538+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-07-26T16:01:09.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.174943+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-07-26T16:01:09.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.184126+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.184413+0000 mon.a (mon.0) 456 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:08.499069+0000 mon.a (mon.0) 434 : cluster [DBG] osdmap e297: 8 total, 8 up, 8 in 2021-07-26T16:01:09.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:08.981066+0000 mon.a (mon.0) 435 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:08.981174+0000 mon.a (mon.0) 436 : cluster [INF] osd.4 failed (root=default,host=smithi096) (connection refused reported by osd.6) 2021-07-26T16:01:09.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:08.982027+0000 mon.a (mon.0) 437 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:08.984449+0000 mon.a (mon.0) 438 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:08.991986+0000 mon.a (mon.0) 439 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: audit 2021-07-26T16:01:09.165794+0000 mon.c (mon.1) 85 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:01:09.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: audit 2021-07-26T16:01:09.166599+0000 mon.a (mon.0) 440 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:01:09.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.168316+0000 mon.a (mon.0) 441 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.168451+0000 mon.a (mon.0) 442 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.168737+0000 mon.a (mon.0) 443 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.168858+0000 mon.a (mon.0) 444 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-07-26T16:01:09.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.169344+0000 mon.a (mon.0) 445 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.169454+0000 mon.a (mon.0) 446 : cluster [DBG] osd.4 reported immediately failed by osd.5 2021-07-26T16:01:09.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.172157+0000 mon.a (mon.0) 447 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.172492+0000 mon.a (mon.0) 448 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.970 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.173010+0000 mon.a (mon.0) 449 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-07-26T16:01:09.970 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.173359+0000 mon.a (mon.0) 450 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.970 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.173831+0000 mon.a (mon.0) 451 : cluster [DBG] osd.4 reported immediately failed by osd.2 2021-07-26T16:01:09.970 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.174151+0000 mon.a (mon.0) 452 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.971 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.174538+0000 mon.a (mon.0) 453 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-07-26T16:01:09.971 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.174943+0000 mon.a (mon.0) 454 : cluster [DBG] osd.4 reported immediately failed by osd.3 2021-07-26T16:01:09.971 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.184126+0000 mon.a (mon.0) 455 : cluster [DBG] osd.4 reported immediately failed by osd.7 2021-07-26T16:01:09.971 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.184413+0000 mon.a (mon.0) 456 : cluster [DBG] osd.4 reported immediately failed by osd.6 2021-07-26T16:01:09.972 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.184632+0000 mon.a (mon.0) 457 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.972 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.192545+0000 mon.a (mon.0) 458 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.972 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: audit 2021-07-26T16:01:09.198657+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:01:09.973 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: audit 2021-07-26T16:01:09.199351+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:01:09.973 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[41341]: audit 2021-07-26T16:01:09.445862+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:09.973 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.184632+0000 mon.a (mon.0) 457 : cluster [DBG] osd.4 reported immediately failed by osd.1 2021-07-26T16:01:09.973 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.192545+0000 mon.a (mon.0) 458 : cluster [DBG] osd.4 reported immediately failed by osd.0 2021-07-26T16:01:09.974 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: audit 2021-07-26T16:01:09.198657+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:01:09.974 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: audit 2021-07-26T16:01:09.199351+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:01:09.974 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:09 smithi033 bash[42377]: audit 2021-07-26T16:01:09.445862+0000 mon.a (mon.0) 460 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:10.236 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:09 smithi096 bash[35267]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:10.520 INFO:tasks.rados.rados.0.smithi033.stdout:1223: done (2 left) 2021-07-26T16:01:10.521 INFO:tasks.rados.rados.0.smithi033.stdout:1224: snap_remove snap 107 2021-07-26T16:01:10.883 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:10 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.008085+0000 mgr.y (mgr.34104) 170 : cluster [DBG] pgmap v244: 25 pgs: 25 active+clean; 199 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 578 KiB/s wr, 2 op/s 2021-07-26T16:01:10.884 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:10 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.495761+0000 mon.a (mon.0) 461 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:01:10.884 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:10 smithi096 bash[33981]: cluster 2021-07-26T16:01:09.521880+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e298: 8 total, 7 up, 8 in 2021-07-26T16:01:10.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:10 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.008085+0000 mgr.y (mgr.34104) 170 : cluster [DBG] pgmap v244: 25 pgs: 25 active+clean; 199 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 578 KiB/s wr, 2 op/s 2021-07-26T16:01:10.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:10 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.495761+0000 mon.a (mon.0) 461 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:01:10.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:10 smithi033 bash[41341]: cluster 2021-07-26T16:01:09.521880+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e298: 8 total, 7 up, 8 in 2021-07-26T16:01:10.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:10 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.008085+0000 mgr.y (mgr.34104) 170 : cluster [DBG] pgmap v244: 25 pgs: 25 active+clean; 199 MiB data, 728 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 578 KiB/s wr, 2 op/s 2021-07-26T16:01:10.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:10 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.495761+0000 mon.a (mon.0) 461 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:01:10.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:10 smithi033 bash[42377]: cluster 2021-07-26T16:01:09.521880+0000 mon.a (mon.0) 462 : cluster [DBG] osdmap e298: 8 total, 7 up, 8 in 2021-07-26T16:01:11.534 INFO:tasks.rados.rados.0.smithi033.stdout:1224: done (2 left) 2021-07-26T16:01:11.535 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 119 2021-07-26T16:01:11.535 INFO:tasks.rados.rados.0.smithi033.stdout:1225: seq_num 381 ranges {950272=786432,1736704=417792,2154496=385024} 2021-07-26T16:01:11.546 INFO:tasks.rados.rados.0.smithi033.stdout:1225: writing smithi03339061-29 from 950272 to 1736704 tid 1 2021-07-26T16:01:11.549 INFO:tasks.rados.rados.0.smithi033.stdout:1225: writing smithi03339061-29 from 1736704 to 2154496 tid 2 2021-07-26T16:01:11.552 INFO:tasks.rados.rados.0.smithi033.stdout:1225: writing smithi03339061-29 from 2154496 to 2539520 tid 3 2021-07-26T16:01:11.552 INFO:tasks.rados.rados.0.smithi033.stdout:1226: snap_remove snap 116 2021-07-26T16:01:11.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:11 smithi096 bash[33981]: cluster 2021-07-26T16:01:10.516218+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e299: 8 total, 7 up, 8 in 2021-07-26T16:01:11.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:11 smithi033 bash[41341]: cluster 2021-07-26T16:01:10.516218+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e299: 8 total, 7 up, 8 in 2021-07-26T16:01:11.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:11 smithi033 bash[42377]: cluster 2021-07-26T16:01:10.516218+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e299: 8 total, 7 up, 8 in 2021-07-26T16:01:12.176 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:11 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.4.service: Succeeded. 2021-07-26T16:01:12.176 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:11 smithi096 systemd[1]: Stopped Ceph osd.4 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:01:12.176 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:12 smithi096 systemd[1]: Started Ceph osd.4 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:01:12.542 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:12 smithi096 bash[35407]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:12.561 INFO:tasks.rados.rados.0.smithi033.stdout:1226: done (3 left) 2021-07-26T16:01:12.562 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 119 2021-07-26T16:01:12.562 INFO:tasks.rados.rados.0.smithi033.stdout:1227: seq_num 382 ranges {0=802816,802816=704512,1507328=98304} 2021-07-26T16:01:12.563 INFO:tasks.rados.rados.0.smithi033.stdout:1227: writing smithi03339061-25 from 0 to 802816 tid 1 2021-07-26T16:01:12.565 INFO:tasks.rados.rados.0.smithi033.stdout:1227: writing smithi03339061-25 from 802816 to 1507328 tid 2 2021-07-26T16:01:12.566 INFO:tasks.rados.rados.0.smithi033.stdout:1227: writing smithi03339061-25 from 1507328 to 1605632 tid 3 2021-07-26T16:01:12.566 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 119 2021-07-26T16:01:12.567 INFO:tasks.rados.rados.0.smithi033.stdout:1220: finishing rollback tid 0 to smithi03339061-1 2021-07-26T16:01:12.567 INFO:tasks.rados.rados.0.smithi033.stdout:1228: seq_num 383 ranges {0=417792,417792=589824,1007616=417792,1425408=196608} 2021-07-26T16:01:12.569 INFO:tasks.rados.rados.0.smithi033.stdout:1228: writing smithi03339061-39 from 0 to 417792 tid 1 2021-07-26T16:01:12.572 INFO:tasks.rados.rados.0.smithi033.stdout:1228: writing smithi03339061-39 from 417792 to 1007616 tid 2 2021-07-26T16:01:12.575 INFO:tasks.rados.rados.0.smithi033.stdout:1228: writing smithi03339061-39 from 1007616 to 1425408 tid 3 2021-07-26T16:01:12.577 INFO:tasks.rados.rados.0.smithi033.stdout:1228: writing smithi03339061-39 from 1425408 to 1622016 tid 4 2021-07-26T16:01:12.577 INFO:tasks.rados.rados.0.smithi033.stdout:1229: read oid 31 snap -1 2021-07-26T16:01:12.578 INFO:tasks.rados.rados.0.smithi033.stdout:1229: expect (ObjNum 373 snap 117 seq_num 373) 2021-07-26T16:01:12.578 INFO:tasks.rados.rados.0.smithi033.stdout:1230: read oid 26 snap -1 2021-07-26T16:01:12.578 INFO:tasks.rados.rados.0.smithi033.stdout:1230: expect (ObjNum 380 snap 118 seq_num 380) 2021-07-26T16:01:12.579 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 119 2021-07-26T16:01:12.579 INFO:tasks.rados.rados.0.smithi033.stdout:1220: finishing rollback tid 1 to smithi03339061-1 2021-07-26T16:01:12.579 INFO:tasks.rados.rados.0.smithi033.stdout:1220: finishing rollback tid 2 to smithi03339061-1 2021-07-26T16:01:12.580 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 41 (ObjNum 369 snap 117 seq_num 369) dirty exists 2021-07-26T16:01:12.580 INFO:tasks.rados.rados.0.smithi033.stdout:1221: finishing rollback tid 0 to smithi03339061-36 2021-07-26T16:01:12.580 INFO:tasks.rados.rados.0.smithi033.stdout:1221: finishing rollback tid 1 to smithi03339061-36 2021-07-26T16:01:12.580 INFO:tasks.rados.rados.0.smithi033.stdout:1221: finishing rollback tid 2 to smithi03339061-36 2021-07-26T16:01:12.581 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 421 (ObjNum 323 snap 104 seq_num 323) dirty exists 2021-07-26T16:01:12.581 INFO:tasks.rados.rados.0.smithi033.stdout:1225: finishing write tid 1 to smithi03339061-29 2021-07-26T16:01:12.581 INFO:tasks.rados.rados.0.smithi033.stdout:1225: finishing write tid 2 to smithi03339061-29 2021-07-26T16:01:12.582 INFO:tasks.rados.rados.0.smithi033.stdout:1225: finishing write tid 3 to smithi03339061-29 2021-07-26T16:01:12.582 INFO:tasks.rados.rados.0.smithi033.stdout:1225: finishing write tid 4 to smithi03339061-29 2021-07-26T16:01:12.582 INFO:tasks.rados.rados.0.smithi033.stdout:1231: seq_num 384 ranges {4194304=434176,4628480=475136,5103616=630784,5734400=98304} 2021-07-26T16:01:12.604 INFO:tasks.rados.rados.0.smithi033.stdout:1231: writing smithi03339061-47 from 4194304 to 4628480 tid 1 2021-07-26T16:01:12.607 INFO:tasks.rados.rados.0.smithi033.stdout:1231: writing smithi03339061-47 from 4628480 to 5103616 tid 2 2021-07-26T16:01:12.610 INFO:tasks.rados.rados.0.smithi033.stdout:1231: writing smithi03339061-47 from 5103616 to 5734400 tid 3 2021-07-26T16:01:12.611 INFO:tasks.rados.rados.0.smithi033.stdout:1231: writing smithi03339061-47 from 5734400 to 5832704 tid 4 2021-07-26T16:01:12.612 INFO:tasks.rados.rados.0.smithi033.stdout:1220: done (7 left) 2021-07-26T16:01:12.612 INFO:tasks.rados.rados.0.smithi033.stdout:1221: done (6 left) 2021-07-26T16:01:12.612 INFO:tasks.rados.rados.0.smithi033.stdout:1232: rmattr oid 28 current snap is 119 2021-07-26T16:01:12.612 INFO:tasks.rados.rados.0.smithi033.stdout:1232: done (6 left) 2021-07-26T16:01:12.613 INFO:tasks.rados.rados.0.smithi033.stdout:1233: delete oid 20 current snap is 119 2021-07-26T16:01:12.613 INFO:tasks.rados.rados.0.smithi033.stdout:1225: finishing write tid 5 to smithi03339061-29 2021-07-26T16:01:12.613 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 190 (ObjNum 381 snap 119 seq_num 381) dirty exists 2021-07-26T16:01:12.613 INFO:tasks.rados.rados.0.smithi033.stdout:1225: left oid 29 (ObjNum 381 snap 119 seq_num 381) 2021-07-26T16:01:12.614 INFO:tasks.rados.rados.0.smithi033.stdout:1227: finishing write tid 1 to smithi03339061-25 2021-07-26T16:01:12.614 INFO:tasks.rados.rados.0.smithi033.stdout:1227: finishing write tid 2 to smithi03339061-25 2021-07-26T16:01:12.614 INFO:tasks.rados.rados.0.smithi033.stdout:1227: finishing write tid 3 to smithi03339061-25 2021-07-26T16:01:12.614 INFO:tasks.rados.rados.0.smithi033.stdout:1227: finishing write tid 4 to smithi03339061-25 2021-07-26T16:01:12.614 INFO:tasks.rados.rados.0.smithi033.stdout:1228: finishing write tid 1 to smithi03339061-39 2021-07-26T16:01:12.615 INFO:tasks.rados.rados.0.smithi033.stdout:1227: finishing write tid 5 to smithi03339061-25 2021-07-26T16:01:12.615 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 303 (ObjNum 382 snap 119 seq_num 382) dirty exists 2021-07-26T16:01:12.615 INFO:tasks.rados.rados.0.smithi033.stdout:1227: left oid 25 (ObjNum 382 snap 119 seq_num 382) 2021-07-26T16:01:12.616 INFO:tasks.rados.rados.0.smithi033.stdout:1228: finishing write tid 2 to smithi03339061-39 2021-07-26T16:01:12.621 INFO:tasks.rados.rados.0.smithi033.stdout:1228: finishing write tid 3 to smithi03339061-39 2021-07-26T16:01:12.621 INFO:tasks.rados.rados.0.smithi033.stdout:1228: finishing write tid 4 to smithi03339061-39 2021-07-26T16:01:12.621 INFO:tasks.rados.rados.0.smithi033.stdout:1228: finishing write tid 5 to smithi03339061-39 2021-07-26T16:01:12.621 INFO:tasks.rados.rados.0.smithi033.stdout:1229: expect (ObjNum 373 snap 117 seq_num 373) 2021-07-26T16:01:12.653 INFO:tasks.rados.rados.0.smithi033.stdout:1228: finishing write tid 6 to smithi03339061-39 2021-07-26T16:01:12.653 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 563 (ObjNum 383 snap 119 seq_num 383) dirty exists 2021-07-26T16:01:12.654 INFO:tasks.rados.rados.0.smithi033.stdout:1228: left oid 39 (ObjNum 383 snap 119 seq_num 383) 2021-07-26T16:01:12.654 INFO:tasks.rados.rados.0.smithi033.stdout:1230: expect (ObjNum 380 snap 118 seq_num 380) 2021-07-26T16:01:12.799 INFO:tasks.rados.rados.0.smithi033.stdout:1231: finishing write tid 1 to smithi03339061-47 2021-07-26T16:01:12.799 INFO:tasks.rados.rados.0.smithi033.stdout:1231: finishing write tid 2 to smithi03339061-47 2021-07-26T16:01:12.799 INFO:tasks.rados.rados.0.smithi033.stdout:1225: done (6 left) 2021-07-26T16:01:12.800 INFO:tasks.rados.rados.0.smithi033.stdout:1227: done (5 left) 2021-07-26T16:01:12.800 INFO:tasks.rados.rados.0.smithi033.stdout:1228: done (4 left) 2021-07-26T16:01:12.800 INFO:tasks.rados.rados.0.smithi033.stdout:1229: done (3 left) 2021-07-26T16:01:12.800 INFO:tasks.rados.rados.0.smithi033.stdout:1230: done (2 left) 2021-07-26T16:01:12.801 INFO:tasks.rados.rados.0.smithi033.stdout:1233: done (1 left) 2021-07-26T16:01:12.801 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 119 2021-07-26T16:01:12.801 INFO:tasks.rados.rados.0.smithi033.stdout:1231: finishing write tid 3 to smithi03339061-47 2021-07-26T16:01:12.801 INFO:tasks.rados.rados.0.smithi033.stdout:1231: finishing write tid 4 to smithi03339061-47 2021-07-26T16:01:12.802 INFO:tasks.rados.rados.0.smithi033.stdout:1234: seq_num 386 ranges {163840=466944,630784=638976,1269760=565248} 2021-07-26T16:01:12.802 INFO:tasks.rados.rados.0.smithi033.stdout:1234: writing smithi03339061-5 from 163840 to 630784 tid 1 2021-07-26T16:01:12.805 INFO:tasks.rados.rados.0.smithi033.stdout:1234: writing smithi03339061-5 from 630784 to 1269760 tid 2 2021-07-26T16:01:12.809 INFO:tasks.rados.rados.0.smithi033.stdout:1234: writing smithi03339061-5 from 1269760 to 1835008 tid 3 2021-07-26T16:01:12.809 INFO:tasks.rados.rados.0.smithi033.stdout:1235: delete oid 37 current snap is 119 2021-07-26T16:01:12.809 INFO:tasks.rados.rados.0.smithi033.stdout:1231: finishing write tid 5 to smithi03339061-47 2021-07-26T16:01:12.810 INFO:tasks.rados.rados.0.smithi033.stdout:1231: finishing write tid 6 to smithi03339061-47 2021-07-26T16:01:12.810 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 584 (ObjNum 384 snap 119 seq_num 384) dirty exists 2021-07-26T16:01:12.811 INFO:tasks.rados.rados.0.smithi033.stdout:1231: left oid 47 (ObjNum 384 snap 119 seq_num 384) 2021-07-26T16:01:12.812 INFO:tasks.rados.rados.0.smithi033.stdout:1234: finishing write tid 1 to smithi03339061-5 2021-07-26T16:01:12.814 INFO:tasks.rados.rados.0.smithi033.stdout:1231: done (2 left) 2021-07-26T16:01:12.814 INFO:tasks.rados.rados.0.smithi033.stdout:1235: done (1 left) 2021-07-26T16:01:12.815 INFO:tasks.rados.rados.0.smithi033.stdout:1236: setattr oid 17 current snap is 119 2021-07-26T16:01:12.815 INFO:tasks.rados.rados.0.smithi033.stdout:1237: read oid 21 snap -1 2021-07-26T16:01:12.816 INFO:tasks.rados.rados.0.smithi033.stdout:1237: expect (ObjNum 275 snap 85 seq_num 275) 2021-07-26T16:01:12.816 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 119 2021-07-26T16:01:12.816 INFO:tasks.rados.rados.0.smithi033.stdout:1238: seq_num 388 ranges {3670016=507904,4177920=458752,4636672=606208,5242880=139264} 2021-07-26T16:01:12.839 INFO:tasks.rados.rados.0.smithi033.stdout:1238: writing smithi03339061-26 from 3670016 to 4177920 tid 1 2021-07-26T16:01:12.841 INFO:tasks.rados.rados.0.smithi033.stdout:1238: writing smithi03339061-26 from 4177920 to 4636672 tid 2 2021-07-26T16:01:12.845 INFO:tasks.rados.rados.0.smithi033.stdout:1238: writing smithi03339061-26 from 4636672 to 5242880 tid 3 2021-07-26T16:01:12.846 INFO:tasks.rados.rados.0.smithi033.stdout:1238: writing smithi03339061-26 from 5242880 to 5382144 tid 4 2021-07-26T16:01:12.847 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 119 2021-07-26T16:01:12.847 INFO:tasks.rados.rados.0.smithi033.stdout:1234: finishing write tid 2 to smithi03339061-5 2021-07-26T16:01:12.847 INFO:tasks.rados.rados.0.smithi033.stdout:1239: seq_num 389 ranges {1015808=524288,1540096=745472,2285568=458752} 2021-07-26T16:01:12.858 INFO:tasks.rados.rados.0.smithi033.stdout:1239: writing smithi03339061-7 from 1015808 to 1540096 tid 1 2021-07-26T16:01:12.859 INFO:tasks.rados.rados.0.smithi033.stdout:1239: writing smithi03339061-7 from 1540096 to 2285568 tid 2 2021-07-26T16:01:12.863 INFO:tasks.rados.rados.0.smithi033.stdout:1239: writing smithi03339061-7 from 2285568 to 2744320 tid 3 2021-07-26T16:01:12.863 INFO:tasks.rados.rados.0.smithi033.stdout:1240: rollback oid 34 current snap is 119 2021-07-26T16:01:12.864 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 34 to 118 2021-07-26T16:01:12.864 INFO:tasks.rados.rados.0.smithi033.stdout:1234: finishing write tid 3 to smithi03339061-5 2021-07-26T16:01:12.864 INFO:tasks.rados.rados.0.smithi033.stdout:1234: finishing write tid 4 to smithi03339061-5 2021-07-26T16:01:12.864 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 204 (ObjNum 295 snap 91 seq_num 295) dirty exists 2021-07-26T16:01:12.865 INFO:tasks.rados.rados.0.smithi033.stdout:1234: finishing write tid 5 to smithi03339061-5 2021-07-26T16:01:12.865 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 464 (ObjNum 386 snap 119 seq_num 386) dirty exists 2021-07-26T16:01:12.865 INFO:tasks.rados.rados.0.smithi033.stdout:1234: left oid 5 (ObjNum 386 snap 119 seq_num 386) 2021-07-26T16:01:12.866 INFO:tasks.rados.rados.0.smithi033.stdout:1237: expect (ObjNum 275 snap 85 seq_num 275) 2021-07-26T16:01:12.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:12 smithi033 bash[42377]: cluster 2021-07-26T16:01:11.008825+0000 mgr.y (mgr.34104) 171 : cluster [DBG] pgmap v247: 25 pgs: 6 peering, 1 stale+active+clean, 18 active+clean; 202 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 12 op/s 2021-07-26T16:01:12.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:12 smithi033 bash[42377]: cluster 2021-07-26T16:01:11.530436+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e300: 8 total, 7 up, 8 in 2021-07-26T16:01:12.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:12 smithi033 bash[42377]: audit 2021-07-26T16:01:12.198276+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:12 smithi033 bash[41341]: cluster 2021-07-26T16:01:11.008825+0000 mgr.y (mgr.34104) 171 : cluster [DBG] pgmap v247: 25 pgs: 6 peering, 1 stale+active+clean, 18 active+clean; 202 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 12 op/s 2021-07-26T16:01:12.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:12 smithi033 bash[41341]: cluster 2021-07-26T16:01:11.530436+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e300: 8 total, 7 up, 8 in 2021-07-26T16:01:12.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:12 smithi033 bash[41341]: audit 2021-07-26T16:01:12.198276+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:12.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:12 smithi096 bash[33981]: cluster 2021-07-26T16:01:11.008825+0000 mgr.y (mgr.34104) 171 : cluster [DBG] pgmap v247: 25 pgs: 6 peering, 1 stale+active+clean, 18 active+clean; 202 MiB data, 742 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.5 MiB/s wr, 12 op/s 2021-07-26T16:01:12.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:12 smithi096 bash[33981]: cluster 2021-07-26T16:01:11.530436+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e300: 8 total, 7 up, 8 in 2021-07-26T16:01:12.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:12 smithi096 bash[33981]: audit 2021-07-26T16:01:12.198276+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:13.147 INFO:tasks.rados.rados.0.smithi033.stdout:1238: finishing write tid 1 to smithi03339061-26 2021-07-26T16:01:13.147 INFO:tasks.rados.rados.0.smithi033.stdout:1238: finishing write tid 2 to smithi03339061-26 2021-07-26T16:01:13.148 INFO:tasks.rados.rados.0.smithi033.stdout:1238: finishing write tid 3 to smithi03339061-26 2021-07-26T16:01:13.149 INFO:tasks.rados.rados.0.smithi033.stdout:1238: finishing write tid 4 to smithi03339061-26 2021-07-26T16:01:13.149 INFO:tasks.rados.rados.0.smithi033.stdout:1238: finishing write tid 5 to smithi03339061-26 2021-07-26T16:01:13.149 INFO:tasks.rados.rados.0.smithi033.stdout:1238: finishing write tid 6 to smithi03339061-26 2021-07-26T16:01:13.149 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 691 (ObjNum 388 snap 119 seq_num 388) dirty exists 2021-07-26T16:01:13.150 INFO:tasks.rados.rados.0.smithi033.stdout:1238: left oid 26 (ObjNum 388 snap 119 seq_num 388) 2021-07-26T16:01:13.150 INFO:tasks.rados.rados.0.smithi033.stdout:1239: finishing write tid 1 to smithi03339061-7 2021-07-26T16:01:13.150 INFO:tasks.rados.rados.0.smithi033.stdout:1239: finishing write tid 2 to smithi03339061-7 2021-07-26T16:01:13.150 INFO:tasks.rados.rados.0.smithi033.stdout:1239: finishing write tid 3 to smithi03339061-7 2021-07-26T16:01:13.151 INFO:tasks.rados.rados.0.smithi033.stdout:1239: finishing write tid 4 to smithi03339061-7 2021-07-26T16:01:13.151 INFO:tasks.rados.rados.0.smithi033.stdout:1240: finishing rollback tid 0 to smithi03339061-34 2021-07-26T16:01:13.151 INFO:tasks.rados.rados.0.smithi033.stdout:1240: finishing rollback tid 1 to smithi03339061-34 2021-07-26T16:01:13.151 INFO:tasks.rados.rados.0.smithi033.stdout:1240: finishing rollback tid 2 to smithi03339061-34 2021-07-26T16:01:13.152 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 424 (ObjNum 353 snap 112 seq_num 353) dirty exists 2021-07-26T16:01:13.152 INFO:tasks.rados.rados.0.smithi033.stdout:1239: finishing write tid 5 to smithi03339061-7 2021-07-26T16:01:13.152 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 568 (ObjNum 389 snap 119 seq_num 389) dirty exists 2021-07-26T16:01:13.152 INFO:tasks.rados.rados.0.smithi033.stdout:1239: left oid 7 (ObjNum 389 snap 119 seq_num 389) 2021-07-26T16:01:13.152 INFO:tasks.rados.rados.0.smithi033.stdout:1234: done (5 left) 2021-07-26T16:01:13.153 INFO:tasks.rados.rados.0.smithi033.stdout:1236: done (4 left) 2021-07-26T16:01:13.153 INFO:tasks.rados.rados.0.smithi033.stdout:1237: done (3 left) 2021-07-26T16:01:13.153 INFO:tasks.rados.rados.0.smithi033.stdout:1238: done (2 left) 2021-07-26T16:01:13.153 INFO:tasks.rados.rados.0.smithi033.stdout:1239: done (1 left) 2021-07-26T16:01:13.153 INFO:tasks.rados.rados.0.smithi033.stdout:1240: done (0 left) 2021-07-26T16:01:13.154 INFO:tasks.rados.rados.0.smithi033.stdout:1241: rollback oid 5 current snap is 119 2021-07-26T16:01:13.154 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 5 to 115 2021-07-26T16:01:13.154 INFO:tasks.rados.rados.0.smithi033.stdout:1242: snap_create 2021-07-26T16:01:13.155 INFO:tasks.rados.rados.0.smithi033.stdout:1241: finishing rollback tid 0 to smithi03339061-5 2021-07-26T16:01:13.155 INFO:tasks.rados.rados.0.smithi033.stdout:1241: finishing rollback tid 1 to smithi03339061-5 2021-07-26T16:01:13.156 INFO:tasks.rados.rados.0.smithi033.stdout:1241: finishing rollback tid 2 to smithi03339061-5 2021-07-26T16:01:13.156 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 467 (ObjNum 296 snap 93 seq_num 296) dirty exists 2021-07-26T16:01:13.571 INFO:tasks.rados.rados.0.smithi033.stdout:1241: done (1 left) 2021-07-26T16:01:13.571 INFO:tasks.rados.rados.0.smithi033.stdout:1242: done (0 left) 2021-07-26T16:01:13.572 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 120 2021-07-26T16:01:13.572 INFO:tasks.rados.rados.0.smithi033.stdout:1243: seq_num 390 ranges {163840=540672,704512=630784,1335296=573440} 2021-07-26T16:01:13.578 INFO:tasks.rados.rados.0.smithi033.stdout:1243: writing smithi03339061-5 from 163840 to 704512 tid 1 2021-07-26T16:01:13.583 INFO:tasks.rados.rados.0.smithi033.stdout:1243: writing smithi03339061-5 from 704512 to 1335296 tid 2 2021-07-26T16:01:13.586 INFO:tasks.rados.rados.0.smithi033.stdout:1243: writing smithi03339061-5 from 1335296 to 1908736 tid 3 2021-07-26T16:01:13.587 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 120 2021-07-26T16:01:13.587 INFO:tasks.rados.rados.0.smithi033.stdout:1243: finishing write tid 1 to smithi03339061-5 2021-07-26T16:01:13.587 INFO:tasks.rados.rados.0.smithi033.stdout:1244: seq_num 391 ranges {1916928=557056,2473984=516096,2990080=688128} 2021-07-26T16:01:13.600 INFO:tasks.rados.rados.0.smithi033.stdout:1244: writing smithi03339061-10 from 1916928 to 2473984 tid 1 2021-07-26T16:01:13.603 INFO:tasks.rados.rados.0.smithi033.stdout:1244: writing smithi03339061-10 from 2473984 to 2990080 tid 2 2021-07-26T16:01:13.609 INFO:tasks.rados.rados.0.smithi033.stdout:1244: writing smithi03339061-10 from 2990080 to 3678208 tid 3 2021-07-26T16:01:13.609 INFO:tasks.rados.rados.0.smithi033.stdout:1245: rmattr oid 30 current snap is 120 2021-07-26T16:01:13.609 INFO:tasks.rados.rados.0.smithi033.stdout:1245: done (2 left) 2021-07-26T16:01:13.609 INFO:tasks.rados.rados.0.smithi033.stdout:1246: copy_from oid 33 from oid 50 current snap is 120 2021-07-26T16:01:13.610 INFO:tasks.rados.rados.0.smithi033.stdout:1243: finishing write tid 2 to smithi03339061-5 2021-07-26T16:01:13.610 INFO:tasks.rados.rados.0.smithi033.stdout:1243: finishing write tid 3 to smithi03339061-5 2021-07-26T16:01:13.610 INFO:tasks.rados.rados.0.smithi033.stdout:1243: finishing write tid 4 to smithi03339061-5 2021-07-26T16:01:13.610 INFO:tasks.rados.rados.0.smithi033.stdout:1243: finishing write tid 5 to smithi03339061-5 2021-07-26T16:01:13.611 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 471 (ObjNum 390 snap 120 seq_num 390) dirty exists 2021-07-26T16:01:13.611 INFO:tasks.rados.rados.0.smithi033.stdout:1243: left oid 5 (ObjNum 390 snap 120 seq_num 390) 2021-07-26T16:01:13.611 INFO:tasks.rados.rados.0.smithi033.stdout:1243: done (2 left) 2021-07-26T16:01:13.611 INFO:tasks.rados.rados.0.smithi033.stdout:1247: read oid 28 snap -1 2021-07-26T16:01:13.611 INFO:tasks.rados.rados.0.smithi033.stdout:1247: expect (ObjNum 362 snap 115 seq_num 362) 2021-07-26T16:01:13.612 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 120 2021-07-26T16:01:13.612 INFO:tasks.rados.rados.0.smithi033.stdout:1248: seq_num 392 ranges {0=573440,573440=802816,1376256=401408} 2021-07-26T16:01:13.620 INFO:tasks.rados.rados.0.smithi033.stdout:1248: writing smithi03339061-20 from 0 to 573440 tid 1 2021-07-26T16:01:13.620 INFO:tasks.rados.rados.0.smithi033.stdout:1248: writing smithi03339061-20 from 573440 to 1376256 tid 2 2021-07-26T16:01:13.620 INFO:tasks.rados.rados.0.smithi033.stdout:1248: writing smithi03339061-20 from 1376256 to 1777664 tid 3 2021-07-26T16:01:13.620 INFO:tasks.rados.rados.0.smithi033.stdout:1249: copy_from oid 36 from oid 38 current snap is 120 2021-07-26T16:01:13.621 INFO:tasks.rados.rados.0.smithi033.stdout:1244: finishing write tid 1 to smithi03339061-10 2021-07-26T16:01:13.621 INFO:tasks.rados.rados.0.smithi033.stdout:1244: finishing write tid 2 to smithi03339061-10 2021-07-26T16:01:13.621 INFO:tasks.rados.rados.0.smithi033.stdout:1244: finishing write tid 3 to smithi03339061-10 2021-07-26T16:01:13.621 INFO:tasks.rados.rados.0.smithi033.stdout:1244: finishing write tid 4 to smithi03339061-10 2021-07-26T16:01:13.622 INFO:tasks.rados.rados.0.smithi033.stdout:1247: expect (ObjNum 362 snap 115 seq_num 362) 2021-07-26T16:01:13.656 INFO:tasks.rados.rados.0.smithi033.stdout:1244: finishing write tid 5 to smithi03339061-10 2021-07-26T16:01:13.657 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 591 (ObjNum 391 snap 120 seq_num 391) dirty exists 2021-07-26T16:01:13.657 INFO:tasks.rados.rados.0.smithi033.stdout:1244: left oid 10 (ObjNum 391 snap 120 seq_num 391) 2021-07-26T16:01:13.657 INFO:tasks.rados.rados.0.smithi033.stdout:1248: finishing write tid 1 to smithi03339061-20 2021-07-26T16:01:13.657 INFO:tasks.rados.rados.0.smithi033.stdout:1248: finishing write tid 2 to smithi03339061-20 2021-07-26T16:01:13.658 INFO:tasks.rados.rados.0.smithi033.stdout:1248: finishing write tid 3 to smithi03339061-20 2021-07-26T16:01:13.658 INFO:tasks.rados.rados.0.smithi033.stdout:1248: finishing write tid 4 to smithi03339061-20 2021-07-26T16:01:13.658 INFO:tasks.rados.rados.0.smithi033.stdout:1248: finishing write tid 5 to smithi03339061-20 2021-07-26T16:01:13.658 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 482 (ObjNum 392 snap 120 seq_num 392) dirty exists 2021-07-26T16:01:13.659 INFO:tasks.rados.rados.0.smithi033.stdout:1248: left oid 20 (ObjNum 392 snap 120 seq_num 392) 2021-07-26T16:01:13.659 INFO:tasks.rados.rados.0.smithi033.stdout:1246: finishing copy_from to smithi03339061-33 2021-07-26T16:01:13.659 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 217 (ObjNum 263 snap 81 seq_num 263) dirty exists 2021-07-26T16:01:13.659 INFO:tasks.rados.rados.0.smithi033.stdout:1246: finishing copy_from racing read to smithi03339061-33 2021-07-26T16:01:13.659 INFO:tasks.rados.rados.0.smithi033.stdout:1249: finishing copy_from to smithi03339061-36 2021-07-26T16:01:13.660 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 96 (ObjNum 363 snap 115 seq_num 363) dirty exists 2021-07-26T16:01:13.660 INFO:tasks.rados.rados.0.smithi033.stdout:1249: finishing copy_from racing read to smithi03339061-36 2021-07-26T16:01:13.660 INFO:tasks.rados.rados.0.smithi033.stdout:1244: done (4 left) 2021-07-26T16:01:13.660 INFO:tasks.rados.rados.0.smithi033.stdout:1246: done (3 left) 2021-07-26T16:01:13.660 INFO:tasks.rados.rados.0.smithi033.stdout:1247: done (2 left) 2021-07-26T16:01:13.661 INFO:tasks.rados.rados.0.smithi033.stdout:1248: done (1 left) 2021-07-26T16:01:13.661 INFO:tasks.rados.rados.0.smithi033.stdout:1249: done (0 left) 2021-07-26T16:01:13.661 INFO:tasks.rados.rados.0.smithi033.stdout:1250: snap_remove snap 119 2021-07-26T16:01:13.829 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:13 smithi096 bash[33981]: cluster 2021-07-26T16:01:12.553524+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e301: 8 total, 7 up, 8 in 2021-07-26T16:01:13.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:13 smithi033 bash[41341]: cluster 2021-07-26T16:01:12.553524+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e301: 8 total, 7 up, 8 in 2021-07-26T16:01:13.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:13 smithi033 bash[42377]: cluster 2021-07-26T16:01:12.553524+0000 mon.a (mon.0) 466 : cluster [DBG] osdmap e301: 8 total, 7 up, 8 in 2021-07-26T16:01:13.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:13 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:13.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:13.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:13 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:13.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:13.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:13 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:13.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:01:14.486 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:14 smithi096 bash[35407]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-07-26T16:01:14.486 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:14 smithi096 bash[35407]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-07-26T16:01:14.486 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:14 smithi096 bash[35407]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-07-26T16:01:14.486 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:14 smithi096 bash[35407]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-07-26T16:01:14.487 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:14 smithi096 bash[35407]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-07-26T16:01:14.487 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:14 smithi096 bash[35407]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-07-26T16:01:14.487 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:14 smithi096 bash[35407]: --> ceph-volume lvm activate successful for osd ID: 4 2021-07-26T16:01:14.584 INFO:tasks.rados.rados.0.smithi033.stdout:1250: done (0 left) 2021-07-26T16:01:14.585 INFO:tasks.rados.rados.0.smithi033.stdout:1251: snap_remove snap 118 2021-07-26T16:01:14.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:14 smithi033 bash[41341]: cluster 2021-07-26T16:01:13.009533+0000 mgr.y (mgr.34104) 172 : cluster [DBG] pgmap v250: 25 pgs: 2 active+undersized+degraded, 6 peering, 1 stale+active+clean, 16 active+clean; 202 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 2.6 MiB/s wr, 8 op/s; 10/342 objects degraded (2.924%) 2021-07-26T16:01:14.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:14 smithi033 bash[41341]: cluster 2021-07-26T16:01:13.548791+0000 mon.a (mon.0) 467 : cluster [WRN] Health check failed: Degraded data redundancy: 10/342 objects degraded (2.924%), 2 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:14.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:14 smithi033 bash[41341]: cluster 2021-07-26T16:01:13.568492+0000 mon.a (mon.0) 468 : cluster [DBG] osdmap e302: 8 total, 7 up, 8 in 2021-07-26T16:01:14.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:14 smithi033 bash[42377]: cluster 2021-07-26T16:01:13.009533+0000 mgr.y (mgr.34104) 172 : cluster [DBG] pgmap v250: 25 pgs: 2 active+undersized+degraded, 6 peering, 1 stale+active+clean, 16 active+clean; 202 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 2.6 MiB/s wr, 8 op/s; 10/342 objects degraded (2.924%) 2021-07-26T16:01:14.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:14 smithi033 bash[42377]: cluster 2021-07-26T16:01:13.548791+0000 mon.a (mon.0) 467 : cluster [WRN] Health check failed: Degraded data redundancy: 10/342 objects degraded (2.924%), 2 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:14.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:14 smithi033 bash[42377]: cluster 2021-07-26T16:01:13.568492+0000 mon.a (mon.0) 468 : cluster [DBG] osdmap e302: 8 total, 7 up, 8 in 2021-07-26T16:01:14.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:14 smithi096 bash[33981]: cluster 2021-07-26T16:01:13.009533+0000 mgr.y (mgr.34104) 172 : cluster [DBG] pgmap v250: 25 pgs: 2 active+undersized+degraded, 6 peering, 1 stale+active+clean, 16 active+clean; 202 MiB data, 747 MiB used, 714 GiB / 715 GiB avail; 4.0 MiB/s rd, 2.6 MiB/s wr, 8 op/s; 10/342 objects degraded (2.924%) 2021-07-26T16:01:14.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:14 smithi096 bash[33981]: cluster 2021-07-26T16:01:13.548791+0000 mon.a (mon.0) 467 : cluster [WRN] Health check failed: Degraded data redundancy: 10/342 objects degraded (2.924%), 2 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:14.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:14 smithi096 bash[33981]: cluster 2021-07-26T16:01:13.568492+0000 mon.a (mon.0) 468 : cluster [DBG] osdmap e302: 8 total, 7 up, 8 in 2021-07-26T16:01:15.485 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:15 smithi096 bash[35637]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:15.601 INFO:tasks.rados.rados.0.smithi033.stdout:1251: done (0 left) 2021-07-26T16:01:15.601 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 120 2021-07-26T16:01:15.601 INFO:tasks.rados.rados.0.smithi033.stdout:1252: seq_num 393 ranges {3506176=589824,4096000=679936,4775936=524288} 2021-07-26T16:01:15.626 INFO:tasks.rados.rados.0.smithi033.stdout:1252: writing smithi03339061-12 from 3506176 to 4096000 tid 1 2021-07-26T16:01:15.630 INFO:tasks.rados.rados.0.smithi033.stdout:1252: writing smithi03339061-12 from 4096000 to 4775936 tid 2 2021-07-26T16:01:15.633 INFO:tasks.rados.rados.0.smithi033.stdout:1252: writing smithi03339061-12 from 4775936 to 5300224 tid 3 2021-07-26T16:01:15.634 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 120 2021-07-26T16:01:15.634 INFO:tasks.rados.rados.0.smithi033.stdout:1253: seq_num 394 ranges {12697600=606208,13303808=565248,13869056=557056,14426112=81920} 2021-07-26T16:01:15.708 INFO:tasks.rados.rados.0.smithi033.stdout:1253: writing smithi03339061-30 from 12697600 to 13303808 tid 1 2021-07-26T16:01:15.711 INFO:tasks.rados.rados.0.smithi033.stdout:1253: writing smithi03339061-30 from 13303808 to 13869056 tid 2 2021-07-26T16:01:15.714 INFO:tasks.rados.rados.0.smithi033.stdout:1253: writing smithi03339061-30 from 13869056 to 14426112 tid 3 2021-07-26T16:01:15.715 INFO:tasks.rados.rados.0.smithi033.stdout:1253: writing smithi03339061-30 from 14426112 to 14508032 tid 4 2021-07-26T16:01:15.715 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 120 2021-07-26T16:01:15.716 INFO:tasks.rados.rados.0.smithi033.stdout:1252: finishing write tid 1 to smithi03339061-12 2021-07-26T16:01:15.716 INFO:tasks.rados.rados.0.smithi033.stdout:1254: seq_num 395 ranges {5619712=622592,6242304=450560,6692864=753664} 2021-07-26T16:01:15.750 INFO:tasks.rados.rados.0.smithi033.stdout:1254: writing smithi03339061-48 from 5619712 to 6242304 tid 1 2021-07-26T16:01:15.821 INFO:tasks.rados.rados.0.smithi033.stdout:1254: writing smithi03339061-48 from 6242304 to 6692864 tid 2 2021-07-26T16:01:15.821 INFO:tasks.rados.rados.0.smithi033.stdout:1254: writing smithi03339061-48 from 6692864 to 7446528 tid 3 2021-07-26T16:01:15.821 INFO:tasks.rados.rados.0.smithi033.stdout:1255: copy_from oid 38 from oid 8 current snap is 120 2021-07-26T16:01:15.822 INFO:tasks.rados.rados.0.smithi033.stdout:1252: finishing write tid 2 to smithi03339061-12 2021-07-26T16:01:15.822 INFO:tasks.rados.rados.0.smithi033.stdout:1252: finishing write tid 3 to smithi03339061-12 2021-07-26T16:01:15.822 INFO:tasks.rados.rados.0.smithi033.stdout:1252: finishing write tid 4 to smithi03339061-12 2021-07-26T16:01:15.823 INFO:tasks.rados.rados.0.smithi033.stdout:1252: finishing write tid 5 to smithi03339061-12 2021-07-26T16:01:15.823 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 345 (ObjNum 393 snap 120 seq_num 393) dirty exists 2021-07-26T16:01:15.824 INFO:tasks.rados.rados.0.smithi033.stdout:1252: left oid 12 (ObjNum 393 snap 120 seq_num 393) 2021-07-26T16:01:15.824 INFO:tasks.rados.rados.0.smithi033.stdout:1252: done (3 left) 2021-07-26T16:01:15.824 INFO:tasks.rados.rados.0.smithi033.stdout:1256: copy_from oid 2 from oid 14 current snap is 120 2021-07-26T16:01:15.824 INFO:tasks.rados.rados.0.smithi033.stdout:1253: finishing write tid 1 to smithi03339061-30 2021-07-26T16:01:15.824 INFO:tasks.rados.rados.0.smithi033.stdout:1253: finishing write tid 2 to smithi03339061-30 2021-07-26T16:01:15.825 INFO:tasks.rados.rados.0.smithi033.stdout:1253: finishing write tid 3 to smithi03339061-30 2021-07-26T16:01:15.825 INFO:tasks.rados.rados.0.smithi033.stdout:1253: finishing write tid 4 to smithi03339061-30 2021-07-26T16:01:15.825 INFO:tasks.rados.rados.0.smithi033.stdout:1257: rollback oid 5 current snap is 120 2021-07-26T16:01:15.825 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 5 to 115 2021-07-26T16:01:15.826 INFO:tasks.rados.rados.0.smithi033.stdout:1253: finishing write tid 5 to smithi03339061-30 2021-07-26T16:01:15.826 INFO:tasks.rados.rados.0.smithi033.stdout:1253: finishing write tid 6 to smithi03339061-30 2021-07-26T16:01:15.826 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 605 (ObjNum 394 snap 120 seq_num 394) dirty exists 2021-07-26T16:01:15.826 INFO:tasks.rados.rados.0.smithi033.stdout:1253: left oid 30 (ObjNum 394 snap 120 seq_num 394) 2021-07-26T16:01:15.826 INFO:tasks.rados.rados.0.smithi033.stdout:1253: done (4 left) 2021-07-26T16:01:15.827 INFO:tasks.rados.rados.0.smithi033.stdout:1258: read oid 40 snap -1 2021-07-26T16:01:15.827 INFO:tasks.rados.rados.0.smithi033.stdout:1258: expect (ObjNum 282 snap 86 seq_num 282) 2021-07-26T16:01:15.827 INFO:tasks.rados.rados.0.smithi033.stdout:1259: read oid 45 snap -1 2021-07-26T16:01:15.827 INFO:tasks.rados.rados.0.smithi033.stdout:1259: expect (ObjNum 281 snap 86 seq_num 281) 2021-07-26T16:01:15.827 INFO:tasks.rados.rados.0.smithi033.stdout:1260: read oid 22 snap 115 2021-07-26T16:01:15.828 INFO:tasks.rados.rados.0.smithi033.stdout:1260: expect (ObjNum 7 snap 0 seq_num 7) 2021-07-26T16:01:15.828 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 120 2021-07-26T16:01:15.828 INFO:tasks.rados.rados.0.smithi033.stdout:1261: seq_num 396 ranges {2015232=638976,2654208=786432,3440640=417792} 2021-07-26T16:01:15.828 INFO:tasks.rados.rados.0.smithi033.stdout:1261: writing smithi03339061-33 from 2015232 to 2654208 tid 1 2021-07-26T16:01:15.828 INFO:tasks.rados.rados.0.smithi033.stdout:1261: writing smithi03339061-33 from 2654208 to 3440640 tid 2 2021-07-26T16:01:15.829 INFO:tasks.rados.rados.0.smithi033.stdout:1261: writing smithi03339061-33 from 3440640 to 3858432 tid 3 2021-07-26T16:01:15.829 INFO:tasks.rados.rados.0.smithi033.stdout:1262: copy_from oid 18 from oid 6 current snap is 120 2021-07-26T16:01:15.829 INFO:tasks.rados.rados.0.smithi033.stdout:1263: snap_create 2021-07-26T16:01:15.829 INFO:tasks.rados.rados.0.smithi033.stdout:1254: finishing write tid 1 to smithi03339061-48 2021-07-26T16:01:15.829 INFO:tasks.rados.rados.0.smithi033.stdout:1256: finishing copy_from to smithi03339061-2 2021-07-26T16:01:15.830 INFO:tasks.rados.rados.0.smithi033.stdout:1256: got expected ENOENT (src dne) 2021-07-26T16:01:15.830 INFO:tasks.rados.rados.0.smithi033.stdout:1256: finishing copy_from racing read to smithi03339061-2 2021-07-26T16:01:15.830 INFO:tasks.rados.rados.0.smithi033.stdout:1254: finishing write tid 2 to smithi03339061-48 2021-07-26T16:01:15.830 INFO:tasks.rados.rados.0.smithi033.stdout:1254: finishing write tid 3 to smithi03339061-48 2021-07-26T16:01:15.831 INFO:tasks.rados.rados.0.smithi033.stdout:1254: finishing write tid 4 to smithi03339061-48 2021-07-26T16:01:15.831 INFO:tasks.rados.rados.0.smithi033.stdout:1257: finishing rollback tid 0 to smithi03339061-5 2021-07-26T16:01:15.831 INFO:tasks.rados.rados.0.smithi033.stdout:1257: finishing rollback tid 1 to smithi03339061-5 2021-07-26T16:01:15.831 INFO:tasks.rados.rados.0.smithi033.stdout:1257: finishing rollback tid 2 to smithi03339061-5 2021-07-26T16:01:15.831 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 478 (ObjNum 296 snap 93 seq_num 296) dirty exists 2021-07-26T16:01:15.832 INFO:tasks.rados.rados.0.smithi033.stdout:1254: finishing write tid 5 to smithi03339061-48 2021-07-26T16:01:15.832 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 475 (ObjNum 395 snap 120 seq_num 395) dirty exists 2021-07-26T16:01:15.832 INFO:tasks.rados.rados.0.smithi033.stdout:1254: left oid 48 (ObjNum 395 snap 120 seq_num 395) 2021-07-26T16:01:15.832 INFO:tasks.rados.rados.0.smithi033.stdout:1259: expect (ObjNum 281 snap 86 seq_num 281) 2021-07-26T16:01:15.854 INFO:tasks.rados.rados.0.smithi033.stdout:1261: finishing write tid 1 to smithi03339061-33 2021-07-26T16:01:15.855 INFO:tasks.rados.rados.0.smithi033.stdout:1260: expect (ObjNum 7 snap 0 seq_num 7) 2021-07-26T16:01:15.858 INFO:tasks.rados.rados.0.smithi033.stdout:1255: finishing copy_from to smithi03339061-38 2021-07-26T16:01:15.858 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 418 (ObjNum 374 snap 118 seq_num 374) dirty exists 2021-07-26T16:01:15.858 INFO:tasks.rados.rados.0.smithi033.stdout:1255: finishing copy_from racing read to smithi03339061-38 2021-07-26T16:01:15.858 INFO:tasks.rados.rados.0.smithi033.stdout:1261: finishing write tid 2 to smithi03339061-33 2021-07-26T16:01:15.858 INFO:tasks.rados.rados.0.smithi033.stdout:1262: finishing copy_from to smithi03339061-18 2021-07-26T16:01:15.859 INFO:tasks.rados.rados.0.smithi033.stdout:1262: got expected ENOENT (src dne) 2021-07-26T16:01:15.859 INFO:tasks.rados.rados.0.smithi033.stdout:1262: finishing copy_from racing read to smithi03339061-18 2021-07-26T16:01:15.859 INFO:tasks.rados.rados.0.smithi033.stdout:1261: finishing write tid 3 to smithi03339061-33 2021-07-26T16:01:15.859 INFO:tasks.rados.rados.0.smithi033.stdout:1261: finishing write tid 4 to smithi03339061-33 2021-07-26T16:01:15.860 INFO:tasks.rados.rados.0.smithi033.stdout:1261: finishing write tid 5 to smithi03339061-33 2021-07-26T16:01:15.860 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 697 (ObjNum 396 snap 120 seq_num 396) dirty exists 2021-07-26T16:01:15.860 INFO:tasks.rados.rados.0.smithi033.stdout:1261: left oid 33 (ObjNum 396 snap 120 seq_num 396) 2021-07-26T16:01:15.862 INFO:tasks.rados.rados.0.smithi033.stdout:1258: expect (ObjNum 282 snap 86 seq_num 282) 2021-07-26T16:01:15.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:15 smithi033 bash[41341]: cluster 2021-07-26T16:01:14.581070+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e303: 8 total, 7 up, 8 in 2021-07-26T16:01:15.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:15 smithi033 bash[41341]: audit 2021-07-26T16:01:14.929298+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:15.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:15 smithi033 bash[42377]: cluster 2021-07-26T16:01:14.581070+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e303: 8 total, 7 up, 8 in 2021-07-26T16:01:15.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:15 smithi033 bash[42377]: audit 2021-07-26T16:01:14.929298+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:15.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:15 smithi096 bash[33981]: cluster 2021-07-26T16:01:14.581070+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e303: 8 total, 7 up, 8 in 2021-07-26T16:01:15.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:15 smithi096 bash[33981]: audit 2021-07-26T16:01:14.929298+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:16.532 INFO:tasks.rados.rados.0.smithi033.stdout:1254: done (9 left) 2021-07-26T16:01:16.532 INFO:tasks.rados.rados.0.smithi033.stdout:1255: done (8 left) 2021-07-26T16:01:16.532 INFO:tasks.rados.rados.0.smithi033.stdout:1256: done (7 left) 2021-07-26T16:01:16.533 INFO:tasks.rados.rados.0.smithi033.stdout:1257: done (6 left) 2021-07-26T16:01:16.533 INFO:tasks.rados.rados.0.smithi033.stdout:1258: done (5 left) 2021-07-26T16:01:16.533 INFO:tasks.rados.rados.0.smithi033.stdout:1259: done (4 left) 2021-07-26T16:01:16.533 INFO:tasks.rados.rados.0.smithi033.stdout:1260: done (3 left) 2021-07-26T16:01:16.534 INFO:tasks.rados.rados.0.smithi033.stdout:1261: done (2 left) 2021-07-26T16:01:16.534 INFO:tasks.rados.rados.0.smithi033.stdout:1262: done (1 left) 2021-07-26T16:01:16.534 INFO:tasks.rados.rados.0.smithi033.stdout:1263: done (0 left) 2021-07-26T16:01:16.535 INFO:tasks.rados.rados.0.smithi033.stdout:1264: snap_create 2021-07-26T16:01:16.629 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T16:01:16.905 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:16 smithi096 bash[33981]: cephadm 2021-07-26T16:01:14.918550+0000 mgr.y (mgr.34104) 173 : cephadm [INF] Upgrade: Updating osd.5 (2/2) 2021-07-26T16:01:16.905 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:16 smithi096 bash[33981]: cephadm 2021-07-26T16:01:14.934118+0000 mgr.y (mgr.34104) 174 : cephadm [INF] Deploying daemon osd.5 on smithi096 2021-07-26T16:01:16.905 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:16 smithi096 bash[33981]: cluster 2021-07-26T16:01:15.010393+0000 mgr.y (mgr.34104) 175 : cluster [DBG] pgmap v253: 25 pgs: 7 active+undersized+degraded, 2 peering, 1 active+undersized, 15 active+clean; 179 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 9.2 MiB/s rd, 3.5 MiB/s wr, 21 op/s; 43/300 objects degraded (14.333%) 2021-07-26T16:01:16.905 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:16 smithi096 bash[33981]: cluster 2021-07-26T16:01:15.591915+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e304: 8 total, 7 up, 8 in 2021-07-26T16:01:16.906 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:16 smithi096 bash[33981]: cluster 2021-07-26T16:01:15.989023+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e305: 8 total, 7 up, 8 in 2021-07-26T16:01:16.951 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T16:01:16.952 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (7m) 27s ago 8m 15.1M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T16:01:16.952 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (8m) 2m ago 8m 25.5M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T16:01:16.952 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (3m) 2m ago 12m 372M - 17.0.0-6381-gbccf07c2 6cdb40438e66 909ec99bd712 2021-07-26T16:01:16.953 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (3m) 27s ago 14m 416M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T16:01:16.953 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (3m) 27s ago 15m 50.6M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 7649338580a7 2021-07-26T16:01:16.953 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (2m) 2m ago 12m 21.0M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 5a3d2fea4cb3 2021-07-26T16:01:16.953 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (2m) 27s ago 12m 42.9M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 76ce8786552e 2021-07-26T16:01:16.954 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (8m) 27s ago 8m 11.2M - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T16:01:16.954 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (8m) 2m ago 8m 11.3M - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T16:01:16.954 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (115s) 27s ago 12m 123M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 7275343c45f7 2021-07-26T16:01:16.955 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (86s) 27s ago 11m 116M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 778afc05022e 2021-07-26T16:01:16.955 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (58s) 27s ago 11m 99.6M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 e78ad82b00b5 2021-07-26T16:01:16.955 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (29s) 27s ago 10m - 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 315a7c006da7 2021-07-26T16:01:16.955 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 starting - - - 3552M 2021-07-26T16:01:16.955 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (9m) 2m ago 10m 83.8M 3552M 16.2.5 34f74fddb18e 12b89782c2eb 2021-07-26T16:01:16.956 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (9m) 2m ago 9m 74.8M 3552M 16.2.5 34f74fddb18e 4fad5a8407d4 2021-07-26T16:01:16.956 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (9m) 2m ago 9m 70.1M 3552M 16.2.5 34f74fddb18e a988c60ad3d5 2021-07-26T16:01:16.956 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (7m) 2m ago 8m 38.1M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T16:01:16.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:16 smithi033 bash[41341]: cephadm 2021-07-26T16:01:14.918550+0000 mgr.y (mgr.34104) 173 : cephadm [INF] Upgrade: Updating osd.5 (2/2) 2021-07-26T16:01:16.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:16 smithi033 bash[41341]: cephadm 2021-07-26T16:01:14.934118+0000 mgr.y (mgr.34104) 174 : cephadm [INF] Deploying daemon osd.5 on smithi096 2021-07-26T16:01:16.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:16 smithi033 bash[41341]: cluster 2021-07-26T16:01:15.010393+0000 mgr.y (mgr.34104) 175 : cluster [DBG] pgmap v253: 25 pgs: 7 active+undersized+degraded, 2 peering, 1 active+undersized, 15 active+clean; 179 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 9.2 MiB/s rd, 3.5 MiB/s wr, 21 op/s; 43/300 objects degraded (14.333%) 2021-07-26T16:01:16.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:16 smithi033 bash[41341]: cluster 2021-07-26T16:01:15.591915+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e304: 8 total, 7 up, 8 in 2021-07-26T16:01:16.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:16 smithi033 bash[41341]: cluster 2021-07-26T16:01:15.989023+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e305: 8 total, 7 up, 8 in 2021-07-26T16:01:16.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:16 smithi033 bash[42377]: cephadm 2021-07-26T16:01:14.918550+0000 mgr.y (mgr.34104) 173 : cephadm [INF] Upgrade: Updating osd.5 (2/2) 2021-07-26T16:01:16.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:16 smithi033 bash[42377]: cephadm 2021-07-26T16:01:14.934118+0000 mgr.y (mgr.34104) 174 : cephadm [INF] Deploying daemon osd.5 on smithi096 2021-07-26T16:01:16.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:16 smithi033 bash[42377]: cluster 2021-07-26T16:01:15.010393+0000 mgr.y (mgr.34104) 175 : cluster [DBG] pgmap v253: 25 pgs: 7 active+undersized+degraded, 2 peering, 1 active+undersized, 15 active+clean; 179 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 9.2 MiB/s rd, 3.5 MiB/s wr, 21 op/s; 43/300 objects degraded (14.333%) 2021-07-26T16:01:16.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:16 smithi033 bash[42377]: cluster 2021-07-26T16:01:15.591915+0000 mon.a (mon.0) 471 : cluster [DBG] osdmap e304: 8 total, 7 up, 8 in 2021-07-26T16:01:16.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:16 smithi033 bash[42377]: cluster 2021-07-26T16:01:15.989023+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e305: 8 total, 7 up, 8 in 2021-07-26T16:01:17.001 INFO:tasks.rados.rados.0.smithi033.stdout:1264: done (0 left) 2021-07-26T16:01:17.001 INFO:tasks.rados.rados.0.smithi033.stdout:1265: snap_remove snap 115 2021-07-26T16:01:17.226 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:17 smithi096 bash[35637]: debug 2021-07-26T16:01:17.008+0000 7f8addc8b700 1 -- 172.21.15.96:0/1827735583 <== mon.2 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55da74c4c340 con 0x55da74ca6800 2021-07-26T16:01:17.339 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T16:01:17.340 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T16:01:17.340 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T16:01:17.340 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:01:17.341 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T16:01:17.341 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T16:01:17.341 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:01:17.341 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T16:01:17.341 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 3, 2021-07-26T16:01:17.342 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 4 2021-07-26T16:01:17.342 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:01:17.342 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T16:01:17.342 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T16:01:17.343 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 3, 2021-07-26T16:01:17.343 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 9 2021-07-26T16:01:17.343 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T16:01:17.343 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T16:01:17.828 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:17 smithi096 bash[33981]: audit 2021-07-26T16:01:16.609813+0000 mgr.y (mgr.34104) 176 : audit [DBG] from='client.44206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:17.829 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:17 smithi096 bash[33981]: cluster 2021-07-26T16:01:16.998310+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e306: 8 total, 7 up, 8 in 2021-07-26T16:01:17.829 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:17 smithi096 bash[33981]: audit 2021-07-26T16:01:17.336844+0000 mon.a (mon.0) 474 : audit [DBG] from='client.? 172.21.15.33:0/3870110300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:17.829 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:17 smithi096 bash[35637]: debug 2021-07-26T16:01:17.564+0000 7f8ae54df0c0 -1 Falling back to public interface 2021-07-26T16:01:17.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:17 smithi033 bash[41341]: audit 2021-07-26T16:01:16.609813+0000 mgr.y (mgr.34104) 176 : audit [DBG] from='client.44206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:17.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:17 smithi033 bash[41341]: cluster 2021-07-26T16:01:16.998310+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e306: 8 total, 7 up, 8 in 2021-07-26T16:01:17.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:17 smithi033 bash[41341]: audit 2021-07-26T16:01:17.336844+0000 mon.a (mon.0) 474 : audit [DBG] from='client.? 172.21.15.33:0/3870110300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:17.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:17 smithi033 bash[42377]: audit 2021-07-26T16:01:16.609813+0000 mgr.y (mgr.34104) 176 : audit [DBG] from='client.44206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:17.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:17 smithi033 bash[42377]: cluster 2021-07-26T16:01:16.998310+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e306: 8 total, 7 up, 8 in 2021-07-26T16:01:17.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:17 smithi033 bash[42377]: audit 2021-07-26T16:01:17.336844+0000 mon.a (mon.0) 474 : audit [DBG] from='client.? 172.21.15.33:0/3870110300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:18.011 INFO:tasks.rados.rados.0.smithi033.stdout:1265: done (0 left) 2021-07-26T16:01:18.011 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 122 2021-07-26T16:01:18.011 INFO:tasks.rados.rados.0.smithi033.stdout:1266: seq_num 397 ranges {3858432=655360,4513792=671744,5185536=532480} 2021-07-26T16:01:18.038 INFO:tasks.rados.rados.0.smithi033.stdout:1266: writing smithi03339061-33 from 3858432 to 4513792 tid 1 2021-07-26T16:01:18.043 INFO:tasks.rados.rados.0.smithi033.stdout:1266: writing smithi03339061-33 from 4513792 to 5185536 tid 2 2021-07-26T16:01:18.045 INFO:tasks.rados.rados.0.smithi033.stdout:1266: writing smithi03339061-33 from 5185536 to 5718016 tid 3 2021-07-26T16:01:18.045 INFO:tasks.rados.rados.0.smithi033.stdout:1267: copy_from oid 22 from oid 50 current snap is 122 2021-07-26T16:01:18.046 INFO:tasks.rados.rados.0.smithi033.stdout:1266: finishing write tid 1 to smithi03339061-33 2021-07-26T16:01:18.046 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 122 2021-07-26T16:01:18.046 INFO:tasks.rados.rados.0.smithi033.stdout:1268: seq_num 398 ranges {4120576=671744,4792320=557056,5349376=532480,5881856=114688} 2021-07-26T16:01:18.072 INFO:tasks.rados.rados.0.smithi033.stdout:1268: writing smithi03339061-38 from 4120576 to 4792320 tid 1 2021-07-26T16:01:18.075 INFO:tasks.rados.rados.0.smithi033.stdout:1268: writing smithi03339061-38 from 4792320 to 5349376 tid 2 2021-07-26T16:01:18.079 INFO:tasks.rados.rados.0.smithi033.stdout:1268: writing smithi03339061-38 from 5349376 to 5881856 tid 3 2021-07-26T16:01:18.080 INFO:tasks.rados.rados.0.smithi033.stdout:1268: writing smithi03339061-38 from 5881856 to 5996544 tid 4 2021-07-26T16:01:18.080 INFO:tasks.rados.rados.0.smithi033.stdout:1269: read oid 17 snap -1 2021-07-26T16:01:18.080 INFO:tasks.rados.rados.0.smithi033.stdout:1269: expect (ObjNum 295 snap 91 seq_num 295) 2021-07-26T16:01:18.081 INFO:tasks.rados.rados.0.smithi033.stdout:1270: read oid 27 snap 120 2021-07-26T16:01:18.081 INFO:tasks.rados.rados.0.smithi033.stdout:1270: expect (ObjNum 321 snap 102 seq_num 321) 2021-07-26T16:01:18.081 INFO:tasks.rados.rados.0.smithi033.stdout:1271: snap_create 2021-07-26T16:01:18.081 INFO:tasks.rados.rados.0.smithi033.stdout:1266: finishing write tid 2 to smithi03339061-33 2021-07-26T16:01:18.081 INFO:tasks.rados.rados.0.smithi033.stdout:1266: finishing write tid 3 to smithi03339061-33 2021-07-26T16:01:18.082 INFO:tasks.rados.rados.0.smithi033.stdout:1266: finishing write tid 4 to smithi03339061-33 2021-07-26T16:01:18.083 INFO:tasks.rados.rados.0.smithi033.stdout:1266: finishing write tid 5 to smithi03339061-33 2021-07-26T16:01:18.083 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 702 (ObjNum 397 snap 122 seq_num 397) dirty exists 2021-07-26T16:01:18.083 INFO:tasks.rados.rados.0.smithi033.stdout:1266: left oid 33 (ObjNum 397 snap 122 seq_num 397) 2021-07-26T16:01:18.084 INFO:tasks.rados.rados.0.smithi033.stdout:1267: finishing copy_from to smithi03339061-22 2021-07-26T16:01:18.084 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 217 (ObjNum 263 snap 81 seq_num 263) dirty exists 2021-07-26T16:01:18.084 INFO:tasks.rados.rados.0.smithi033.stdout:1267: finishing copy_from racing read to smithi03339061-22 2021-07-26T16:01:18.084 INFO:tasks.rados.rados.0.smithi033.stdout:1268: finishing write tid 1 to smithi03339061-38 2021-07-26T16:01:18.085 INFO:tasks.rados.rados.0.smithi033.stdout:1268: finishing write tid 2 to smithi03339061-38 2021-07-26T16:01:18.085 INFO:tasks.rados.rados.0.smithi033.stdout:1268: finishing write tid 3 to smithi03339061-38 2021-07-26T16:01:18.087 INFO:tasks.rados.rados.0.smithi033.stdout:1268: finishing write tid 4 to smithi03339061-38 2021-07-26T16:01:18.087 INFO:tasks.rados.rados.0.smithi033.stdout:1268: finishing write tid 5 to smithi03339061-38 2021-07-26T16:01:18.090 INFO:tasks.rados.rados.0.smithi033.stdout:1268: finishing write tid 6 to smithi03339061-38 2021-07-26T16:01:18.091 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 423 (ObjNum 398 snap 122 seq_num 398) dirty exists 2021-07-26T16:01:18.091 INFO:tasks.rados.rados.0.smithi033.stdout:1268: left oid 38 (ObjNum 398 snap 122 seq_num 398) 2021-07-26T16:01:18.093 INFO:tasks.rados.rados.0.smithi033.stdout:1269: expect (ObjNum 295 snap 91 seq_num 295) 2021-07-26T16:01:18.120 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:18 smithi096 systemd[1]: Stopping Ceph osd.5 for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T16:01:18.120 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:18 smithi096 docker[35829]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:18.201 INFO:tasks.rados.rados.0.smithi033.stdout:1270: expect (ObjNum 321 snap 102 seq_num 321) 2021-07-26T16:01:18.485 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[20458]: debug 2021-07-26T16:01:18.116+0000 7f2df51c3700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-07-26T16:01:18.486 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[20458]: debug 2021-07-26T16:01:18.116+0000 7f2df51c3700 -1 osd.5 307 *** Got signal Terminated *** 2021-07-26T16:01:18.486 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[20458]: debug 2021-07-26T16:01:18.116+0000 7f2df51c3700 -1 osd.5 307 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:01:18.937 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: audit 2021-07-26T16:01:16.936086+0000 mgr.y (mgr.34104) 177 : audit [DBG] from='client.34269 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:18.938 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:17.010970+0000 mgr.y (mgr.34104) 178 : cluster [DBG] pgmap v257: 25 pgs: 8 active+undersized+degraded, 2 active+undersized, 15 active+clean; 173 MiB data, 730 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 17 op/s; 47/273 objects degraded (17.216%) 2021-07-26T16:01:18.938 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.006790+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e307: 8 total, 7 up, 8 in 2021-07-26T16:01:18.938 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.404368+0000 mon.a (mon.0) 476 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:18.938 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.404409+0000 mon.a (mon.0) 477 : cluster [INF] osd.5 failed (root=default,host=smithi096) (connection refused reported by osd.1) 2021-07-26T16:01:18.939 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.404490+0000 mon.a (mon.0) 478 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:18.939 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.404762+0000 mon.a (mon.0) 479 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:18.939 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.404839+0000 mon.a (mon.0) 480 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:18.939 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.405050+0000 mon.a (mon.0) 481 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:18.940 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.405134+0000 mon.a (mon.0) 482 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:18.940 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.405317+0000 mon.a (mon.0) 483 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:18.940 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.405507+0000 mon.a (mon.0) 484 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:18.940 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.405636+0000 mon.a (mon.0) 485 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:18.941 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.405759+0000 mon.a (mon.0) 486 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:18.941 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.406006+0000 mon.a (mon.0) 487 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:18.941 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:18 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.406181+0000 mon.a (mon.0) 488 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:18.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: audit 2021-07-26T16:01:16.936086+0000 mgr.y (mgr.34104) 177 : audit [DBG] from='client.34269 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:18.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:17.010970+0000 mgr.y (mgr.34104) 178 : cluster [DBG] pgmap v257: 25 pgs: 8 active+undersized+degraded, 2 active+undersized, 15 active+clean; 173 MiB data, 730 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 17 op/s; 47/273 objects degraded (17.216%) 2021-07-26T16:01:18.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.006790+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e307: 8 total, 7 up, 8 in 2021-07-26T16:01:18.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.404368+0000 mon.a (mon.0) 476 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:18.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.404409+0000 mon.a (mon.0) 477 : cluster [INF] osd.5 failed (root=default,host=smithi096) (connection refused reported by osd.1) 2021-07-26T16:01:18.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.404490+0000 mon.a (mon.0) 478 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:18.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.404762+0000 mon.a (mon.0) 479 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:18.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.404839+0000 mon.a (mon.0) 480 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:18.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.405050+0000 mon.a (mon.0) 481 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:18.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.405134+0000 mon.a (mon.0) 482 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:18.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.405317+0000 mon.a (mon.0) 483 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:18.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.405507+0000 mon.a (mon.0) 484 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:18.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.405636+0000 mon.a (mon.0) 485 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:18.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.405759+0000 mon.a (mon.0) 486 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:18.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.406006+0000 mon.a (mon.0) 487 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:18.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.406181+0000 mon.a (mon.0) 488 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:18.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: audit 2021-07-26T16:01:16.936086+0000 mgr.y (mgr.34104) 177 : audit [DBG] from='client.34269 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:18.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:17.010970+0000 mgr.y (mgr.34104) 178 : cluster [DBG] pgmap v257: 25 pgs: 8 active+undersized+degraded, 2 active+undersized, 15 active+clean; 173 MiB data, 730 MiB used, 715 GiB / 715 GiB avail; 2.3 MiB/s rd, 2.7 MiB/s wr, 17 op/s; 47/273 objects degraded (17.216%) 2021-07-26T16:01:18.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.006790+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e307: 8 total, 7 up, 8 in 2021-07-26T16:01:18.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.404368+0000 mon.a (mon.0) 476 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:18.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.404409+0000 mon.a (mon.0) 477 : cluster [INF] osd.5 failed (root=default,host=smithi096) (connection refused reported by osd.1) 2021-07-26T16:01:18.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.404490+0000 mon.a (mon.0) 478 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:18.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.404762+0000 mon.a (mon.0) 479 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:18.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.404839+0000 mon.a (mon.0) 480 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:18.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.405050+0000 mon.a (mon.0) 481 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:18.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.405134+0000 mon.a (mon.0) 482 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:18.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.405317+0000 mon.a (mon.0) 483 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:18.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.405507+0000 mon.a (mon.0) 484 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:18.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.405636+0000 mon.a (mon.0) 485 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:18.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.405759+0000 mon.a (mon.0) 486 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:18.967 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.406006+0000 mon.a (mon.0) 487 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:18.967 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:18 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.406181+0000 mon.a (mon.0) 488 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:19.021 INFO:tasks.rados.rados.0.smithi033.stdout:1266: done (5 left) 2021-07-26T16:01:19.021 INFO:tasks.rados.rados.0.smithi033.stdout:1267: done (4 left) 2021-07-26T16:01:19.022 INFO:tasks.rados.rados.0.smithi033.stdout:1268: done (3 left) 2021-07-26T16:01:19.022 INFO:tasks.rados.rados.0.smithi033.stdout:1269: done (2 left) 2021-07-26T16:01:19.022 INFO:tasks.rados.rados.0.smithi033.stdout:1270: done (1 left) 2021-07-26T16:01:19.022 INFO:tasks.rados.rados.0.smithi033.stdout:1271: done (0 left) 2021-07-26T16:01:19.023 INFO:tasks.rados.rados.0.smithi033.stdout:1272: rollback oid 19 current snap is 123 2021-07-26T16:01:19.023 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 19 to 120 2021-07-26T16:01:19.023 INFO:tasks.rados.rados.0.smithi033.stdout:1273: read oid 31 snap 122 2021-07-26T16:01:19.023 INFO:tasks.rados.rados.0.smithi033.stdout:1273: expect (ObjNum 373 snap 117 seq_num 373) 2021-07-26T16:01:19.023 INFO:tasks.rados.rados.0.smithi033.stdout:1274: rmattr oid 25 current snap is 123 2021-07-26T16:01:19.024 INFO:tasks.rados.rados.0.smithi033.stdout:1274: done (2 left) 2021-07-26T16:01:19.024 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 123 2021-07-26T16:01:19.024 INFO:tasks.rados.rados.0.smithi033.stdout:1275: seq_num 399 ranges {7446528=688128,8134656=434176,8568832=745472,9314304=24576} 2021-07-26T16:01:19.067 INFO:tasks.rados.rados.0.smithi033.stdout:1275: writing smithi03339061-48 from 7446528 to 8134656 tid 1 2021-07-26T16:01:19.069 INFO:tasks.rados.rados.0.smithi033.stdout:1275: writing smithi03339061-48 from 8134656 to 8568832 tid 2 2021-07-26T16:01:19.073 INFO:tasks.rados.rados.0.smithi033.stdout:1275: writing smithi03339061-48 from 8568832 to 9314304 tid 3 2021-07-26T16:01:19.074 INFO:tasks.rados.rados.0.smithi033.stdout:1275: writing smithi03339061-48 from 9314304 to 9338880 tid 4 2021-07-26T16:01:19.074 INFO:tasks.rados.rados.0.smithi033.stdout:1276: snap_remove snap 121 2021-07-26T16:01:19.235 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:18 smithi096 docker[35829]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-osd.5 2021-07-26T16:01:19.236 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[35890]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:19.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.808257+0000 mon.a (mon.0) 489 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:19.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.808386+0000 mon.a (mon.0) 490 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:19.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.808618+0000 mon.a (mon.0) 491 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:19.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.808763+0000 mon.a (mon.0) 492 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:19.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.809072+0000 mon.a (mon.0) 493 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:19.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.809163+0000 mon.a (mon.0) 494 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:19.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.809347+0000 mon.a (mon.0) 495 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:19.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.809408+0000 mon.a (mon.0) 496 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:19.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.809588+0000 mon.a (mon.0) 497 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:19.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.809748+0000 mon.a (mon.0) 498 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:19.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.809854+0000 mon.a (mon.0) 499 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:19.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:18.810083+0000 mon.a (mon.0) 500 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:19.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:19.002420+0000 mon.a (mon.0) 501 : cluster [WRN] Health check update: 2 osds down (OSD_DOWN) 2021-07-26T16:01:19.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[41341]: cluster 2021-07-26T16:01:19.010385+0000 mon.a (mon.0) 502 : cluster [DBG] osdmap e308: 8 total, 6 up, 8 in 2021-07-26T16:01:19.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.808257+0000 mon.a (mon.0) 489 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:19.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.808386+0000 mon.a (mon.0) 490 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:19.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.808618+0000 mon.a (mon.0) 491 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:19.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.808763+0000 mon.a (mon.0) 492 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:19.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.809072+0000 mon.a (mon.0) 493 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:19.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.809163+0000 mon.a (mon.0) 494 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:19.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.809347+0000 mon.a (mon.0) 495 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:19.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.809408+0000 mon.a (mon.0) 496 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:19.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.809588+0000 mon.a (mon.0) 497 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:19.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.809748+0000 mon.a (mon.0) 498 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:19.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.809854+0000 mon.a (mon.0) 499 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:19.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:18.810083+0000 mon.a (mon.0) 500 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:19.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:19.002420+0000 mon.a (mon.0) 501 : cluster [WRN] Health check update: 2 osds down (OSD_DOWN) 2021-07-26T16:01:19.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:19 smithi033 bash[42377]: cluster 2021-07-26T16:01:19.010385+0000 mon.a (mon.0) 502 : cluster [DBG] osdmap e308: 8 total, 6 up, 8 in 2021-07-26T16:01:19.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.808257+0000 mon.a (mon.0) 489 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:19.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.808386+0000 mon.a (mon.0) 490 : cluster [DBG] osd.5 reported immediately failed by osd.7 2021-07-26T16:01:19.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.808618+0000 mon.a (mon.0) 491 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:19.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.808763+0000 mon.a (mon.0) 492 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:19.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.809072+0000 mon.a (mon.0) 493 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:19.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.809163+0000 mon.a (mon.0) 494 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:19.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.809347+0000 mon.a (mon.0) 495 : cluster [DBG] osd.5 reported immediately failed by osd.1 2021-07-26T16:01:19.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.809408+0000 mon.a (mon.0) 496 : cluster [DBG] osd.5 reported immediately failed by osd.2 2021-07-26T16:01:19.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.809588+0000 mon.a (mon.0) 497 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:19.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.809748+0000 mon.a (mon.0) 498 : cluster [DBG] osd.5 reported immediately failed by osd.6 2021-07-26T16:01:19.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.809854+0000 mon.a (mon.0) 499 : cluster [DBG] osd.5 reported immediately failed by osd.0 2021-07-26T16:01:19.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:18.810083+0000 mon.a (mon.0) 500 : cluster [DBG] osd.5 reported immediately failed by osd.3 2021-07-26T16:01:19.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:19.002420+0000 mon.a (mon.0) 501 : cluster [WRN] Health check update: 2 osds down (OSD_DOWN) 2021-07-26T16:01:19.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:19 smithi096 bash[33981]: cluster 2021-07-26T16:01:19.010385+0000 mon.a (mon.0) 502 : cluster [DBG] osdmap e308: 8 total, 6 up, 8 in 2021-07-26T16:01:20.025 INFO:tasks.rados.rados.0.smithi033.stdout:1276: done (3 left) 2021-07-26T16:01:20.025 INFO:tasks.rados.rados.0.smithi033.stdout:1277: read oid 37 snap -1 2021-07-26T16:01:20.025 INFO:tasks.rados.rados.0.smithi033.stdout:1277: expect deleted 2021-07-26T16:01:20.026 INFO:tasks.rados.rados.0.smithi033.stdout:1278: snap_create 2021-07-26T16:01:20.029 INFO:tasks.rados.rados.0.smithi033.stdout:1272: finishing rollback tid 0 to smithi03339061-19 2021-07-26T16:01:20.029 INFO:tasks.rados.rados.0.smithi033.stdout:1272: finishing rollback tid 1 to smithi03339061-19 2021-07-26T16:01:20.029 INFO:tasks.rados.rados.0.smithi033.stdout:1272: finishing rollback tid 2 to smithi03339061-19 2021-07-26T16:01:20.030 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 440 (ObjNum 360 snap 113 seq_num 360) dirty exists 2021-07-26T16:01:20.030 INFO:tasks.rados.rados.0.smithi033.stdout:1273: expect (ObjNum 373 snap 117 seq_num 373) 2021-07-26T16:01:20.067 INFO:tasks.rados.rados.0.smithi033.stdout:1275: finishing write tid 1 to smithi03339061-48 2021-07-26T16:01:20.067 INFO:tasks.rados.rados.0.smithi033.stdout:1275: finishing write tid 2 to smithi03339061-48 2021-07-26T16:01:20.068 INFO:tasks.rados.rados.0.smithi033.stdout:1275: finishing write tid 3 to smithi03339061-48 2021-07-26T16:01:20.068 INFO:tasks.rados.rados.0.smithi033.stdout:1275: finishing write tid 4 to smithi03339061-48 2021-07-26T16:01:20.068 INFO:tasks.rados.rados.0.smithi033.stdout:1275: finishing write tid 5 to smithi03339061-48 2021-07-26T16:01:20.068 INFO:tasks.rados.rados.0.smithi033.stdout:1275: finishing write tid 6 to smithi03339061-48 2021-07-26T16:01:20.069 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 483 (ObjNum 399 snap 123 seq_num 399) dirty exists 2021-07-26T16:01:20.069 INFO:tasks.rados.rados.0.smithi033.stdout:1275: left oid 48 (ObjNum 399 snap 123 seq_num 399) 2021-07-26T16:01:20.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:20 smithi096 bash[33981]: cluster 2021-07-26T16:01:19.015558+0000 mgr.y (mgr.34104) 179 : cluster [DBG] pgmap v260: 25 pgs: 1 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 4 stale+active+clean, 8 active+undersized+degraded, 2 active+undersized, 8 active+clean; 179 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 9 op/s; 48/264 objects degraded (18.182%) 2021-07-26T16:01:20.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:20 smithi096 bash[33981]: cluster 2021-07-26T16:01:20.005776+0000 mon.a (mon.0) 503 : cluster [WRN] Health check update: Degraded data redundancy: 48/264 objects degraded (18.182%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:20.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:20 smithi096 bash[33981]: cluster 2021-07-26T16:01:20.021179+0000 mon.a (mon.0) 504 : cluster [DBG] osdmap e309: 8 total, 6 up, 8 in 2021-07-26T16:01:20.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:20 smithi033 bash[42377]: cluster 2021-07-26T16:01:19.015558+0000 mgr.y (mgr.34104) 179 : cluster [DBG] pgmap v260: 25 pgs: 1 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 4 stale+active+clean, 8 active+undersized+degraded, 2 active+undersized, 8 active+clean; 179 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 9 op/s; 48/264 objects degraded (18.182%) 2021-07-26T16:01:20.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:20 smithi033 bash[42377]: cluster 2021-07-26T16:01:20.005776+0000 mon.a (mon.0) 503 : cluster [WRN] Health check update: Degraded data redundancy: 48/264 objects degraded (18.182%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:20.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:20 smithi033 bash[42377]: cluster 2021-07-26T16:01:20.021179+0000 mon.a (mon.0) 504 : cluster [DBG] osdmap e309: 8 total, 6 up, 8 in 2021-07-26T16:01:20.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:20 smithi033 bash[41341]: cluster 2021-07-26T16:01:19.015558+0000 mgr.y (mgr.34104) 179 : cluster [DBG] pgmap v260: 25 pgs: 1 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 4 stale+active+clean, 8 active+undersized+degraded, 2 active+undersized, 8 active+clean; 179 MiB data, 741 MiB used, 714 GiB / 715 GiB avail; 2.1 MiB/s rd, 3.7 MiB/s wr, 9 op/s; 48/264 objects degraded (18.182%) 2021-07-26T16:01:20.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:20 smithi033 bash[41341]: cluster 2021-07-26T16:01:20.005776+0000 mon.a (mon.0) 503 : cluster [WRN] Health check update: Degraded data redundancy: 48/264 objects degraded (18.182%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:20.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:20 smithi033 bash[41341]: cluster 2021-07-26T16:01:20.021179+0000 mon.a (mon.0) 504 : cluster [DBG] osdmap e309: 8 total, 6 up, 8 in 2021-07-26T16:01:21.041 INFO:tasks.rados.rados.0.smithi033.stdout:1272: done (4 left) 2021-07-26T16:01:21.041 INFO:tasks.rados.rados.0.smithi033.stdout:1273: done (3 left) 2021-07-26T16:01:21.042 INFO:tasks.rados.rados.0.smithi033.stdout:1275: done (2 left) 2021-07-26T16:01:21.042 INFO:tasks.rados.rados.0.smithi033.stdout:1277: done (1 left) 2021-07-26T16:01:21.042 INFO:tasks.rados.rados.0.smithi033.stdout:1278: done (0 left) 2021-07-26T16:01:21.042 INFO:tasks.rados.rados.0.smithi033.stdout:1279: rollback oid 42 current snap is 124 2021-07-26T16:01:21.042 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 42 to 120 2021-07-26T16:01:21.043 INFO:tasks.rados.rados.0.smithi033.stdout:1280: read oid 22 snap -1 2021-07-26T16:01:21.043 INFO:tasks.rados.rados.0.smithi033.stdout:1280: expect (ObjNum 263 snap 81 seq_num 263) 2021-07-26T16:01:21.043 INFO:tasks.rados.rados.0.smithi033.stdout:1281: snap_remove snap 123 2021-07-26T16:01:21.236 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:20 smithi096 bash[35637]: debug 2021-07-26T16:01:20.952+0000 7f8ae54df0c0 -1 osd.4 297 log_to_monitors {default=true} 2021-07-26T16:01:21.236 INFO:journalctl@ceph.osd.4.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[35637]: debug 2021-07-26T16:01:21.056+0000 7f8ad4e30700 -1 osd.4 297 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-07-26T16:01:21.237 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:21 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.5.service: Succeeded. 2021-07-26T16:01:21.237 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:21 smithi096 systemd[1]: Stopped Ceph osd.5 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:01:21.604 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:21 smithi096 systemd[1]: Started Ceph osd.5 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:01:21.604 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[36451]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:21.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[42377]: audit 2021-07-26T16:01:20.957146+0000 mon.a (mon.0) 505 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T16:01:21.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[42377]: audit 2021-07-26T16:01:20.960181+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/3369039463,v1:172.21.15.96:6801/3369039463]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T16:01:21.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[42377]: audit 2021-07-26T16:01:21.037658+0000 mon.a (mon.0) 506 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-07-26T16:01:21.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[42377]: cluster 2021-07-26T16:01:21.037944+0000 mon.a (mon.0) 507 : cluster [DBG] osdmap e310: 8 total, 6 up, 8 in 2021-07-26T16:01:21.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[42377]: audit 2021-07-26T16:01:21.041149+0000 mon.a (mon.0) 508 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:21.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[42377]: audit 2021-07-26T16:01:21.044259+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/3369039463,v1:172.21.15.96:6801/3369039463]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:21.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[42377]: audit 2021-07-26T16:01:21.324287+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:21.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[42377]: audit 2021-07-26T16:01:21.329147+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:21.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[42377]: audit 2021-07-26T16:01:21.331955+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:01:21.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[42377]: audit 2021-07-26T16:01:21.333902+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:01:21.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[41341]: audit 2021-07-26T16:01:20.957146+0000 mon.a (mon.0) 505 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T16:01:21.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[41341]: audit 2021-07-26T16:01:20.960181+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/3369039463,v1:172.21.15.96:6801/3369039463]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T16:01:21.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[41341]: audit 2021-07-26T16:01:21.037658+0000 mon.a (mon.0) 506 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-07-26T16:01:21.965 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[41341]: cluster 2021-07-26T16:01:21.037944+0000 mon.a (mon.0) 507 : cluster [DBG] osdmap e310: 8 total, 6 up, 8 in 2021-07-26T16:01:21.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[41341]: audit 2021-07-26T16:01:21.041149+0000 mon.a (mon.0) 508 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:21.966 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[41341]: audit 2021-07-26T16:01:21.044259+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/3369039463,v1:172.21.15.96:6801/3369039463]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:21.967 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[41341]: audit 2021-07-26T16:01:21.324287+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:21.967 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[41341]: audit 2021-07-26T16:01:21.329147+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:21.967 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[41341]: audit 2021-07-26T16:01:21.331955+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:01:21.968 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:21 smithi033 bash[41341]: audit 2021-07-26T16:01:21.333902+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:01:21.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[33981]: audit 2021-07-26T16:01:20.957146+0000 mon.a (mon.0) 505 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T16:01:21.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[33981]: audit 2021-07-26T16:01:20.960181+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/3369039463,v1:172.21.15.96:6801/3369039463]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-07-26T16:01:21.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[33981]: audit 2021-07-26T16:01:21.037658+0000 mon.a (mon.0) 506 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-07-26T16:01:21.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[33981]: cluster 2021-07-26T16:01:21.037944+0000 mon.a (mon.0) 507 : cluster [DBG] osdmap e310: 8 total, 6 up, 8 in 2021-07-26T16:01:21.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[33981]: audit 2021-07-26T16:01:21.041149+0000 mon.a (mon.0) 508 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:21.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[33981]: audit 2021-07-26T16:01:21.044259+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.15.96:6800/3369039463,v1:172.21.15.96:6801/3369039463]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:21.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[33981]: audit 2021-07-26T16:01:21.324287+0000 mon.a (mon.0) 509 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:21.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[33981]: audit 2021-07-26T16:01:21.329147+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:21.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[33981]: audit 2021-07-26T16:01:21.331955+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:01:21.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:21 smithi096 bash[33981]: audit 2021-07-26T16:01:21.333902+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:01:22.053 INFO:tasks.rados.rados.0.smithi033.stdout:1281: done (2 left) 2021-07-26T16:01:22.054 INFO:tasks.rados.rados.0.smithi033.stdout:1282: setattr oid 33 current snap is 124 2021-07-26T16:01:22.054 INFO:tasks.rados.rados.0.smithi033.stdout:1283: copy_from oid 2 from oid 17 current snap is 124 2021-07-26T16:01:22.054 INFO:tasks.rados.rados.0.smithi033.stdout:1284: read oid 47 snap -1 2021-07-26T16:01:22.055 INFO:tasks.rados.rados.0.smithi033.stdout:1284: expect (ObjNum 384 snap 119 seq_num 384) 2021-07-26T16:01:22.055 INFO:tasks.rados.rados.0.smithi033.stdout:1285: snap_create 2021-07-26T16:01:22.055 INFO:tasks.rados.rados.0.smithi033.stdout:1279: finishing rollback tid 0 to smithi03339061-42 2021-07-26T16:01:22.055 INFO:tasks.rados.rados.0.smithi033.stdout:1279: finishing rollback tid 1 to smithi03339061-42 2021-07-26T16:01:22.056 INFO:tasks.rados.rados.0.smithi033.stdout:1279: finishing rollback tid 2 to smithi03339061-42 2021-07-26T16:01:22.056 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 243 (ObjNum 379 snap 118 seq_num 379) dirty exists 2021-07-26T16:01:22.056 INFO:tasks.rados.rados.0.smithi033.stdout:1280: expect (ObjNum 263 snap 81 seq_num 263) 2021-07-26T16:01:22.111 INFO:tasks.rados.rados.0.smithi033.stdout:1284: expect (ObjNum 384 snap 119 seq_num 384) 2021-07-26T16:01:22.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:22 smithi096 bash[33981]: cluster 2021-07-26T16:01:21.016464+0000 mgr.y (mgr.34104) 180 : cluster [DBG] pgmap v262: 25 pgs: 2 peering, 7 active+clean, 3 active+undersized, 8 active+undersized+degraded, 2 stale+active+clean, 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait; 175 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 3.1 MiB/s wr, 11 op/s; 48/252 objects degraded (19.048%) 2021-07-26T16:01:22.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:22 smithi096 bash[33981]: cluster 2021-07-26T16:01:22.044713+0000 mon.a (mon.0) 510 : cluster [INF] osd.4 [v2:172.21.15.96:6800/3369039463,v1:172.21.15.96:6801/3369039463] boot 2021-07-26T16:01:22.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:22 smithi096 bash[33981]: cluster 2021-07-26T16:01:22.044904+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e311: 8 total, 7 up, 8 in 2021-07-26T16:01:22.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:22 smithi096 bash[33981]: audit 2021-07-26T16:01:22.046724+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T16:01:22.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:22 smithi033 bash[42377]: cluster 2021-07-26T16:01:21.016464+0000 mgr.y (mgr.34104) 180 : cluster [DBG] pgmap v262: 25 pgs: 2 peering, 7 active+clean, 3 active+undersized, 8 active+undersized+degraded, 2 stale+active+clean, 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait; 175 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 3.1 MiB/s wr, 11 op/s; 48/252 objects degraded (19.048%) 2021-07-26T16:01:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:22 smithi033 bash[42377]: cluster 2021-07-26T16:01:22.044713+0000 mon.a (mon.0) 510 : cluster [INF] osd.4 [v2:172.21.15.96:6800/3369039463,v1:172.21.15.96:6801/3369039463] boot 2021-07-26T16:01:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:22 smithi033 bash[42377]: cluster 2021-07-26T16:01:22.044904+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e311: 8 total, 7 up, 8 in 2021-07-26T16:01:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:22 smithi033 bash[42377]: audit 2021-07-26T16:01:22.046724+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T16:01:22.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:22 smithi033 bash[41341]: cluster 2021-07-26T16:01:21.016464+0000 mgr.y (mgr.34104) 180 : cluster [DBG] pgmap v262: 25 pgs: 2 peering, 7 active+clean, 3 active+undersized, 8 active+undersized+degraded, 2 stale+active+clean, 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait; 175 MiB data, 744 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 3.1 MiB/s wr, 11 op/s; 48/252 objects degraded (19.048%) 2021-07-26T16:01:22.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:22 smithi033 bash[41341]: cluster 2021-07-26T16:01:22.044713+0000 mon.a (mon.0) 510 : cluster [INF] osd.4 [v2:172.21.15.96:6800/3369039463,v1:172.21.15.96:6801/3369039463] boot 2021-07-26T16:01:22.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:22 smithi033 bash[41341]: cluster 2021-07-26T16:01:22.044904+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e311: 8 total, 7 up, 8 in 2021-07-26T16:01:22.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:22 smithi033 bash[41341]: audit 2021-07-26T16:01:22.046724+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-07-26T16:01:23.055 INFO:tasks.rados.rados.0.smithi033.stdout:1279: done (5 left) 2021-07-26T16:01:23.055 INFO:tasks.rados.rados.0.smithi033.stdout:1280: done (4 left) 2021-07-26T16:01:23.056 INFO:tasks.rados.rados.0.smithi033.stdout:1284: done (3 left) 2021-07-26T16:01:23.056 INFO:tasks.rados.rados.0.smithi033.stdout:1285: done (2 left) 2021-07-26T16:01:23.057 INFO:tasks.rados.rados.0.smithi033.stdout:1286: rmattr oid 37 current snap is 125 2021-07-26T16:01:23.057 INFO:tasks.rados.rados.0.smithi033.stdout:1286: done (2 left) 2021-07-26T16:01:23.057 INFO:tasks.rados.rados.0.smithi033.stdout:1287: snap_create 2021-07-26T16:01:23.096 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 706 (ObjNum 397 snap 122 seq_num 397) dirty exists 2021-07-26T16:01:23.236 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:22 smithi096 bash[36451]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-07-26T16:01:23.236 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:22 smithi096 bash[36451]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-07-26T16:01:23.236 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:22 smithi096 bash[36451]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-07-26T16:01:23.237 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:22 smithi096 bash[36451]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-07-26T16:01:23.237 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:22 smithi096 bash[36451]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-07-26T16:01:23.237 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:22 smithi096 bash[36451]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-07-26T16:01:23.237 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:22 smithi096 bash[36451]: --> ceph-volume lvm activate successful for osd ID: 5 2021-07-26T16:01:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:23 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:23.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:23 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:23.518Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:23 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:23.518Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:01:23.985 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:23 smithi096 bash[36584]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:23.986 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:01:23 smithi096 bash[25729]: debug 2021-07-26T16:01:23.488+0000 7fd5ef664700 -1 osd.7 pg_epoch: 312 pg[3.es0( v 312'138 (0'0,312'138] local-lis/les=311/312 n=6 ec=57/57 lis/c=311/311 les/c/f=312/312/0 sis=311) [7,4,1]p7(0) r=0 lpr=311 crt=312'138 lcod 300'136 mlcod 300'136 active+clean+snaptrim trimq=[cc~1,e1~2,e7~1,e9~1,ee~1,f2~1,f6~1] ps=[a8~1]] removing snap head 2021-07-26T16:01:24.061 INFO:tasks.rados.rados.0.smithi033.stdout:1282: done (2 left) 2021-07-26T16:01:24.062 INFO:tasks.rados.rados.0.smithi033.stdout:1287: done (1 left) 2021-07-26T16:01:24.062 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 126 2021-07-26T16:01:24.062 INFO:tasks.rados.rados.0.smithi033.stdout:1288: seq_num 400 ranges {1392640=704512,2097152=720896,2818048=483328} 2021-07-26T16:01:24.077 INFO:tasks.rados.rados.0.smithi033.stdout:1288: writing smithi03339061-1 from 1392640 to 2097152 tid 1 2021-07-26T16:01:24.081 INFO:tasks.rados.rados.0.smithi033.stdout:1288: writing smithi03339061-1 from 2097152 to 2818048 tid 2 2021-07-26T16:01:24.084 INFO:tasks.rados.rados.0.smithi033.stdout:1288: writing smithi03339061-1 from 2818048 to 3301376 tid 3 2021-07-26T16:01:24.084 INFO:tasks.rados.rados.0.smithi033.stdout:1289: delete oid 16 current snap is 126 2021-07-26T16:01:24.091 INFO:tasks.rados.rados.0.smithi033.stdout:1288: finishing write tid 1 to smithi03339061-1 2021-07-26T16:01:24.092 INFO:tasks.rados.rados.0.smithi033.stdout:1289: done (2 left) 2021-07-26T16:01:24.092 INFO:tasks.rados.rados.0.smithi033.stdout:1290: read oid 6 snap -1 2021-07-26T16:01:24.092 INFO:tasks.rados.rados.0.smithi033.stdout:1290: expect deleted 2021-07-26T16:01:24.092 INFO:tasks.rados.rados.0.smithi033.stdout:1291: delete oid 36 current snap is 126 2021-07-26T16:01:24.093 INFO:tasks.rados.rados.0.smithi033.stdout:1288: finishing write tid 2 to smithi03339061-1 2021-07-26T16:01:24.093 INFO:tasks.rados.rados.0.smithi033.stdout:1288: finishing write tid 3 to smithi03339061-1 2021-07-26T16:01:24.093 INFO:tasks.rados.rados.0.smithi033.stdout:1288: finishing write tid 4 to smithi03339061-1 2021-07-26T16:01:24.094 INFO:tasks.rados.rados.0.smithi033.stdout:1288: finishing write tid 5 to smithi03339061-1 2021-07-26T16:01:24.094 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 48 (ObjNum 400 snap 126 seq_num 400) dirty exists 2021-07-26T16:01:24.094 INFO:tasks.rados.rados.0.smithi033.stdout:1288: left oid 1 (ObjNum 400 snap 126 seq_num 400) 2021-07-26T16:01:24.094 INFO:tasks.rados.rados.0.smithi033.stdout:1288: done (3 left) 2021-07-26T16:01:24.095 INFO:tasks.rados.rados.0.smithi033.stdout:1290: done (2 left) 2021-07-26T16:01:24.095 INFO:tasks.rados.rados.0.smithi033.stdout:1291: done (1 left) 2021-07-26T16:01:24.095 INFO:tasks.rados.rados.0.smithi033.stdout:1292: snap_remove snap 124 2021-07-26T16:01:24.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:24 smithi033 bash[42377]: cluster 2021-07-26T16:01:23.017334+0000 mgr.y (mgr.34104) 181 : cluster [DBG] pgmap v265: 25 pgs: 2 peering, 7 active+clean, 3 active+undersized, 8 active+undersized+degraded, 2 stale+active+clean, 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait; 175 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 9.9 MiB/s rd, 0 B/s wr, 3 op/s; 48/252 objects degraded (19.048%) 2021-07-26T16:01:24.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:24 smithi033 bash[42377]: cluster 2021-07-26T16:01:23.048499+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e312: 8 total, 7 up, 8 in 2021-07-26T16:01:24.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:24 smithi033 bash[41341]: cluster 2021-07-26T16:01:23.017334+0000 mgr.y (mgr.34104) 181 : cluster [DBG] pgmap v265: 25 pgs: 2 peering, 7 active+clean, 3 active+undersized, 8 active+undersized+degraded, 2 stale+active+clean, 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait; 175 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 9.9 MiB/s rd, 0 B/s wr, 3 op/s; 48/252 objects degraded (19.048%) 2021-07-26T16:01:24.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:24 smithi033 bash[41341]: cluster 2021-07-26T16:01:23.048499+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e312: 8 total, 7 up, 8 in 2021-07-26T16:01:24.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:24 smithi096 bash[33981]: cluster 2021-07-26T16:01:23.017334+0000 mgr.y (mgr.34104) 181 : cluster [DBG] pgmap v265: 25 pgs: 2 peering, 7 active+clean, 3 active+undersized, 8 active+undersized+degraded, 2 stale+active+clean, 2 active+clean+snaptrim, 1 active+clean+snaptrim_wait; 175 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 9.9 MiB/s rd, 0 B/s wr, 3 op/s; 48/252 objects degraded (19.048%) 2021-07-26T16:01:24.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:24 smithi096 bash[33981]: cluster 2021-07-26T16:01:23.048499+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e312: 8 total, 7 up, 8 in 2021-07-26T16:01:24.985 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:24 smithi096 bash[36584]: debug 2021-07-26T16:01:24.648+0000 7fbe93429700 1 -- 172.21.15.96:0/2941196773 <== mon.2 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55608bcec340 con 0x55608bd46800 2021-07-26T16:01:25.073 INFO:tasks.rados.rados.0.smithi033.stdout:1292: done (1 left) 2021-07-26T16:01:25.073 INFO:tasks.rados.rados.0.smithi033.stdout:1293: read oid 40 snap -1 2021-07-26T16:01:25.073 INFO:tasks.rados.rados.0.smithi033.stdout:1293: expect (ObjNum 282 snap 86 seq_num 282) 2021-07-26T16:01:25.074 INFO:tasks.rados.rados.0.smithi033.stdout:1294: snap_create 2021-07-26T16:01:25.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:25 smithi033 bash[41341]: cluster 2021-07-26T16:01:24.059066+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e313: 8 total, 7 up, 8 in 2021-07-26T16:01:25.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:25 smithi033 bash[42377]: cluster 2021-07-26T16:01:24.059066+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e313: 8 total, 7 up, 8 in 2021-07-26T16:01:25.485 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:25 smithi096 bash[36584]: debug 2021-07-26T16:01:25.212+0000 7fbe9ac7d0c0 -1 Falling back to public interface 2021-07-26T16:01:25.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:25 smithi096 bash[33981]: cluster 2021-07-26T16:01:24.059066+0000 mon.a (mon.0) 513 : cluster [DBG] osdmap e313: 8 total, 7 up, 8 in 2021-07-26T16:01:26.103 INFO:tasks.rados.rados.0.smithi033.stdout:1294: done (2 left) 2021-07-26T16:01:26.105 INFO:tasks.rados.rados.0.smithi033.stdout:1295: snap_create 2021-07-26T16:01:26.209 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 16:01:25 smithi033 bash[39943]: debug 2021-07-26T16:01:25.871+0000 7fa4db1f3700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2021-07-26T16:01:26.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[42377]: cluster 2021-07-26T16:01:25.018285+0000 mgr.y (mgr.34104) 182 : cluster [DBG] pgmap v268: 25 pgs: 1 peering, 13 active+clean, 3 active+undersized, 8 active+undersized+degraded; 180 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 2.7 MiB/s wr, 9 op/s; 37/225 objects degraded (16.444%); 3.5 MiB/s, 0 objects/s recovering 2021-07-26T16:01:26.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[42377]: cluster 2021-07-26T16:01:25.053113+0000 mon.a (mon.0) 514 : cluster [WRN] Health check update: Degraded data redundancy: 37/225 objects degraded (16.444%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:26.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[42377]: cluster 2021-07-26T16:01:25.069545+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e314: 8 total, 7 up, 8 in 2021-07-26T16:01:26.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[42377]: audit 2021-07-26T16:01:25.848853+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:26.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[42377]: audit 2021-07-26T16:01:25.858172+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:26.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[42377]: audit 2021-07-26T16:01:25.864164+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:26.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[42377]: audit 2021-07-26T16:01:25.866923+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:26.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[42377]: audit 2021-07-26T16:01:25.869305+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:26.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[42377]: audit 2021-07-26T16:01:25.871085+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:26.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[42377]: audit 2021-07-26T16:01:25.873780+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:26.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[42377]: cluster 2021-07-26T16:01:25.982900+0000 mon.a (mon.0) 518 : cluster [WRN] Health check update: 1 osds down (OSD_DOWN) 2021-07-26T16:01:26.213 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[41341]: cluster 2021-07-26T16:01:25.018285+0000 mgr.y (mgr.34104) 182 : cluster [DBG] pgmap v268: 25 pgs: 1 peering, 13 active+clean, 3 active+undersized, 8 active+undersized+degraded; 180 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 2.7 MiB/s wr, 9 op/s; 37/225 objects degraded (16.444%); 3.5 MiB/s, 0 objects/s recovering 2021-07-26T16:01:26.214 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[41341]: cluster 2021-07-26T16:01:25.053113+0000 mon.a (mon.0) 514 : cluster [WRN] Health check update: Degraded data redundancy: 37/225 objects degraded (16.444%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:26.214 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[41341]: cluster 2021-07-26T16:01:25.069545+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e314: 8 total, 7 up, 8 in 2021-07-26T16:01:26.214 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[41341]: audit 2021-07-26T16:01:25.848853+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:26.215 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[41341]: audit 2021-07-26T16:01:25.858172+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:26.215 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[41341]: audit 2021-07-26T16:01:25.864164+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:26.216 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[41341]: audit 2021-07-26T16:01:25.866923+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:26.216 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[41341]: audit 2021-07-26T16:01:25.869305+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:26.216 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[41341]: audit 2021-07-26T16:01:25.871085+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:26.216 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[41341]: audit 2021-07-26T16:01:25.873780+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:26.217 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:26 smithi033 bash[41341]: cluster 2021-07-26T16:01:25.982900+0000 mon.a (mon.0) 518 : cluster [WRN] Health check update: 1 osds down (OSD_DOWN) 2021-07-26T16:01:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:26 smithi096 bash[33981]: cluster 2021-07-26T16:01:25.018285+0000 mgr.y (mgr.34104) 182 : cluster [DBG] pgmap v268: 25 pgs: 1 peering, 13 active+clean, 3 active+undersized, 8 active+undersized+degraded; 180 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 2.7 MiB/s wr, 9 op/s; 37/225 objects degraded (16.444%); 3.5 MiB/s, 0 objects/s recovering 2021-07-26T16:01:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:26 smithi096 bash[33981]: cluster 2021-07-26T16:01:25.053113+0000 mon.a (mon.0) 514 : cluster [WRN] Health check update: Degraded data redundancy: 37/225 objects degraded (16.444%), 8 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:26 smithi096 bash[33981]: cluster 2021-07-26T16:01:25.069545+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e314: 8 total, 7 up, 8 in 2021-07-26T16:01:26.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:26 smithi096 bash[33981]: audit 2021-07-26T16:01:25.848853+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:26.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:26 smithi096 bash[33981]: audit 2021-07-26T16:01:25.858172+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:26.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:26 smithi096 bash[33981]: audit 2021-07-26T16:01:25.864164+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:26.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:26 smithi096 bash[33981]: audit 2021-07-26T16:01:25.866923+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:26.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:26 smithi096 bash[33981]: audit 2021-07-26T16:01:25.869305+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:26.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:26 smithi096 bash[33981]: audit 2021-07-26T16:01:25.871085+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:26.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:26 smithi096 bash[33981]: audit 2021-07-26T16:01:25.873780+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:26.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:26 smithi096 bash[33981]: cluster 2021-07-26T16:01:25.982900+0000 mon.a (mon.0) 518 : cluster [WRN] Health check update: 1 osds down (OSD_DOWN) 2021-07-26T16:01:27.112 INFO:tasks.rados.rados.0.smithi033.stdout:1295: done (2 left) 2021-07-26T16:01:27.113 INFO:tasks.rados.rados.0.smithi033.stdout:1296: setattr oid 45 current snap is 128 2021-07-26T16:01:27.115 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 128 2021-07-26T16:01:27.115 INFO:tasks.rados.rados.0.smithi033.stdout:1297: seq_num 403 ranges {0=753664,753664=425984,1179648=720896,1900544=57344} 2021-07-26T16:01:27.122 INFO:tasks.rados.rados.0.smithi033.stdout:1297: writing smithi03339061-13 from 0 to 753664 tid 1 2021-07-26T16:01:27.125 INFO:tasks.rados.rados.0.smithi033.stdout:1297: writing smithi03339061-13 from 753664 to 1179648 tid 2 2021-07-26T16:01:27.129 INFO:tasks.rados.rados.0.smithi033.stdout:1297: writing smithi03339061-13 from 1179648 to 1900544 tid 3 2021-07-26T16:01:27.130 INFO:tasks.rados.rados.0.smithi033.stdout:1297: writing smithi03339061-13 from 1900544 to 1957888 tid 4 2021-07-26T16:01:27.131 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 730 (ObjNum 281 snap 86 seq_num 281) dirty exists 2021-07-26T16:01:27.131 INFO:tasks.rados.rados.0.smithi033.stdout:1296: done (3 left) 2021-07-26T16:01:27.131 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 128 2021-07-26T16:01:27.132 INFO:tasks.rados.rados.0.smithi033.stdout:1298: seq_num 404 ranges {2318336=770048,3088384=712704,3801088=491520} 2021-07-26T16:01:27.148 INFO:tasks.rados.rados.0.smithi033.stdout:1298: writing smithi03339061-24 from 2318336 to 3088384 tid 1 2021-07-26T16:01:27.152 INFO:tasks.rados.rados.0.smithi033.stdout:1298: writing smithi03339061-24 from 3088384 to 3801088 tid 2 2021-07-26T16:01:27.155 INFO:tasks.rados.rados.0.smithi033.stdout:1298: writing smithi03339061-24 from 3801088 to 4292608 tid 3 2021-07-26T16:01:27.155 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 128 2021-07-26T16:01:27.156 INFO:tasks.rados.rados.0.smithi033.stdout:1297: finishing write tid 1 to smithi03339061-13 2021-07-26T16:01:27.156 INFO:tasks.rados.rados.0.smithi033.stdout:1299: seq_num 405 ranges {2539520=786432,3325952=589824,3915776=614400} 2021-07-26T16:01:27.174 INFO:tasks.rados.rados.0.smithi033.stdout:1299: writing smithi03339061-29 from 2539520 to 3325952 tid 1 2021-07-26T16:01:27.177 INFO:tasks.rados.rados.0.smithi033.stdout:1299: writing smithi03339061-29 from 3325952 to 3915776 tid 2 2021-07-26T16:01:27.183 INFO:tasks.rados.rados.0.smithi033.stdout:1299: writing smithi03339061-29 from 3915776 to 4530176 tid 3 2021-07-26T16:01:27.183 INFO:tasks.rados.rados.0.smithi033.stdout:1300: read oid 36 snap 122 2021-07-26T16:01:27.184 INFO:tasks.rados.rados.0.smithi033.stdout:1300: expect (ObjNum 363 snap 115 seq_num 363) 2021-07-26T16:01:27.184 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 128 2021-07-26T16:01:27.184 INFO:tasks.rados.rados.0.smithi033.stdout:1297: finishing write tid 2 to smithi03339061-13 2021-07-26T16:01:27.184 INFO:tasks.rados.rados.0.smithi033.stdout:1301: seq_num 406 ranges {1458176=802816,2260992=475136,2736128=499712,3235840=229376} 2021-07-26T16:01:27.193 INFO:tasks.rados.rados.0.smithi033.stdout:1301: writing smithi03339061-31 from 1458176 to 2260992 tid 1 2021-07-26T16:01:27.196 INFO:tasks.rados.rados.0.smithi033.stdout:1301: writing smithi03339061-31 from 2260992 to 2736128 tid 2 2021-07-26T16:01:27.199 INFO:tasks.rados.rados.0.smithi033.stdout:1301: writing smithi03339061-31 from 2736128 to 3235840 tid 3 2021-07-26T16:01:27.201 INFO:tasks.rados.rados.0.smithi033.stdout:1301: writing smithi03339061-31 from 3235840 to 3465216 tid 4 2021-07-26T16:01:27.201 INFO:tasks.rados.rados.0.smithi033.stdout:1302: setattr oid 38 current snap is 128 2021-07-26T16:01:27.201 INFO:tasks.rados.rados.0.smithi033.stdout:1297: finishing write tid 3 to smithi03339061-13 2021-07-26T16:01:27.202 INFO:tasks.rados.rados.0.smithi033.stdout:1297: finishing write tid 4 to smithi03339061-13 2021-07-26T16:01:27.202 INFO:tasks.rados.rados.0.smithi033.stdout:1297: finishing write tid 5 to smithi03339061-13 2021-07-26T16:01:27.202 INFO:tasks.rados.rados.0.smithi033.stdout:1297: finishing write tid 6 to smithi03339061-13 2021-07-26T16:01:27.202 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 487 (ObjNum 403 snap 128 seq_num 403) dirty exists 2021-07-26T16:01:27.202 INFO:tasks.rados.rados.0.smithi033.stdout:1297: left oid 13 (ObjNum 403 snap 128 seq_num 403) 2021-07-26T16:01:27.203 INFO:tasks.rados.rados.0.smithi033.stdout:1298: finishing write tid 1 to smithi03339061-24 2021-07-26T16:01:27.203 INFO:tasks.rados.rados.0.smithi033.stdout:1298: finishing write tid 2 to smithi03339061-24 2021-07-26T16:01:27.203 INFO:tasks.rados.rados.0.smithi033.stdout:1298: finishing write tid 3 to smithi03339061-24 2021-07-26T16:01:27.203 INFO:tasks.rados.rados.0.smithi033.stdout:1298: finishing write tid 4 to smithi03339061-24 2021-07-26T16:01:27.203 INFO:tasks.rados.rados.0.smithi033.stdout:1298: finishing write tid 5 to smithi03339061-24 2021-07-26T16:01:27.204 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 618 (ObjNum 404 snap 128 seq_num 404) dirty exists 2021-07-26T16:01:27.204 INFO:tasks.rados.rados.0.smithi033.stdout:1298: left oid 24 (ObjNum 404 snap 128 seq_num 404) 2021-07-26T16:01:27.204 INFO:tasks.rados.rados.0.smithi033.stdout:1299: finishing write tid 1 to smithi03339061-29 2021-07-26T16:01:27.204 INFO:tasks.rados.rados.0.smithi033.stdout:1299: finishing write tid 2 to smithi03339061-29 2021-07-26T16:01:27.205 INFO:tasks.rados.rados.0.smithi033.stdout:1299: finishing write tid 3 to smithi03339061-29 2021-07-26T16:01:27.205 INFO:tasks.rados.rados.0.smithi033.stdout:1299: finishing write tid 4 to smithi03339061-29 2021-07-26T16:01:27.205 INFO:tasks.rados.rados.0.smithi033.stdout:1299: finishing write tid 5 to smithi03339061-29 2021-07-26T16:01:27.205 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 194 (ObjNum 405 snap 128 seq_num 405) dirty exists 2021-07-26T16:01:27.205 INFO:tasks.rados.rados.0.smithi033.stdout:1299: left oid 29 (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:01:27.206 INFO:tasks.rados.rados.0.smithi033.stdout:1300: expect (ObjNum 363 snap 115 seq_num 363) 2021-07-26T16:01:27.244 INFO:tasks.rados.rados.0.smithi033.stdout:1301: finishing write tid 1 to smithi03339061-31 2021-07-26T16:01:27.245 INFO:tasks.rados.rados.0.smithi033.stdout:1301: finishing write tid 2 to smithi03339061-31 2021-07-26T16:01:27.245 INFO:tasks.rados.rados.0.smithi033.stdout:1301: finishing write tid 3 to smithi03339061-31 2021-07-26T16:01:27.245 INFO:tasks.rados.rados.0.smithi033.stdout:1301: finishing write tid 4 to smithi03339061-31 2021-07-26T16:01:27.245 INFO:tasks.rados.rados.0.smithi033.stdout:1301: finishing write tid 5 to smithi03339061-31 2021-07-26T16:01:27.246 INFO:tasks.rados.rados.0.smithi033.stdout:1301: finishing write tid 6 to smithi03339061-31 2021-07-26T16:01:27.246 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 58 (ObjNum 406 snap 128 seq_num 406) dirty exists 2021-07-26T16:01:27.246 INFO:tasks.rados.rados.0.smithi033.stdout:1301: left oid 31 (ObjNum 406 snap 128 seq_num 406) 2021-07-26T16:01:27.246 INFO:tasks.rados.rados.0.smithi033.stdout:1297: done (7 left) 2021-07-26T16:01:27.246 INFO:tasks.rados.rados.0.smithi033.stdout:1298: done (6 left) 2021-07-26T16:01:27.247 INFO:tasks.rados.rados.0.smithi033.stdout:1299: done (5 left) 2021-07-26T16:01:27.247 INFO:tasks.rados.rados.0.smithi033.stdout:1300: done (4 left) 2021-07-26T16:01:27.247 INFO:tasks.rados.rados.0.smithi033.stdout:1301: done (3 left) 2021-07-26T16:01:27.248 INFO:tasks.rados.rados.0.smithi033.stdout:1303: read oid 8 snap -1 2021-07-26T16:01:27.248 INFO:tasks.rados.rados.0.smithi033.stdout:1303: expect (ObjNum 374 snap 118 seq_num 374) 2021-07-26T16:01:27.249 INFO:tasks.rados.rados.0.smithi033.stdout:1304: read oid 46 snap -1 2021-07-26T16:01:27.249 INFO:tasks.rados.rados.0.smithi033.stdout:1304: expect deleted 2021-07-26T16:01:27.250 INFO:tasks.rados.rados.0.smithi033.stdout:1305: snap_remove snap 126 2021-07-26T16:01:27.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:27 smithi033 bash[41341]: audit 2021-07-26T16:01:25.874072+0000 mgr.y (mgr.34104) 183 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:27.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:27 smithi033 bash[41341]: cephadm 2021-07-26T16:01:25.875511+0000 mgr.y (mgr.34104) 184 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2021-07-26T16:01:27.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:27 smithi033 bash[41341]: cluster 2021-07-26T16:01:26.098331+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e315: 8 total, 7 up, 8 in 2021-07-26T16:01:27.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:27 smithi033 bash[42377]: audit 2021-07-26T16:01:25.874072+0000 mgr.y (mgr.34104) 183 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:27.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:27 smithi033 bash[42377]: cephadm 2021-07-26T16:01:25.875511+0000 mgr.y (mgr.34104) 184 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2021-07-26T16:01:27.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:27 smithi033 bash[42377]: cluster 2021-07-26T16:01:26.098331+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e315: 8 total, 7 up, 8 in 2021-07-26T16:01:27.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:27 smithi096 bash[33981]: audit 2021-07-26T16:01:25.874072+0000 mgr.y (mgr.34104) 183 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:27.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:27 smithi096 bash[33981]: cephadm 2021-07-26T16:01:25.875511+0000 mgr.y (mgr.34104) 184 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (4 PGs are or would become offline) 2021-07-26T16:01:27.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:27 smithi096 bash[33981]: cluster 2021-07-26T16:01:26.098331+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e315: 8 total, 7 up, 8 in 2021-07-26T16:01:28.133 INFO:tasks.rados.rados.0.smithi033.stdout:1305: done (5 left) 2021-07-26T16:01:28.134 INFO:tasks.rados.rados.0.smithi033.stdout:1306: rollback oid 39 current snap is 128 2021-07-26T16:01:28.134 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 39 to 122 2021-07-26T16:01:28.134 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 424 (ObjNum 398 snap 122 seq_num 398) dirty exists 2021-07-26T16:01:28.134 INFO:tasks.rados.rados.0.smithi033.stdout:1303: expect (ObjNum 374 snap 118 seq_num 374) 2021-07-26T16:01:28.329 INFO:tasks.rados.rados.0.smithi033.stdout:1306: finishing rollback tid 0 to smithi03339061-39 2021-07-26T16:01:28.329 INFO:tasks.rados.rados.0.smithi033.stdout:1306: finishing rollback tid 1 to smithi03339061-39 2021-07-26T16:01:28.330 INFO:tasks.rados.rados.0.smithi033.stdout:1306: finishing rollback tid 2 to smithi03339061-39 2021-07-26T16:01:28.330 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 576 (ObjNum 383 snap 119 seq_num 383) dirty exists 2021-07-26T16:01:28.330 INFO:tasks.rados.rados.0.smithi033.stdout:1302: done (5 left) 2021-07-26T16:01:28.330 INFO:tasks.rados.rados.0.smithi033.stdout:1303: done (4 left) 2021-07-26T16:01:28.331 INFO:tasks.rados.rados.0.smithi033.stdout:1304: done (3 left) 2021-07-26T16:01:28.331 INFO:tasks.rados.rados.0.smithi033.stdout:1306: done (2 left) 2021-07-26T16:01:28.331 INFO:tasks.rados.rados.0.smithi033.stdout:1307: copy_from oid 43 from oid 31 current snap is 128 2021-07-26T16:01:28.331 INFO:tasks.rados.rados.0.smithi033.stdout:1308: read oid 15 snap 122 2021-07-26T16:01:28.331 INFO:tasks.rados.rados.0.smithi033.stdout:1308: expect deleted 2021-07-26T16:01:28.332 INFO:tasks.rados.rados.0.smithi033.stdout:1309: snap_create 2021-07-26T16:01:28.358 INFO:tasks.rados.rados.0.smithi033.stdout:1307: finishing copy_from to smithi03339061-43 2021-07-26T16:01:28.358 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 58 (ObjNum 406 snap 128 seq_num 406) dirty exists 2021-07-26T16:01:28.359 INFO:tasks.rados.rados.0.smithi033.stdout:1307: finishing copy_from racing read to smithi03339061-43 2021-07-26T16:01:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:28 smithi033 bash[42377]: cluster 2021-07-26T16:01:27.019062+0000 mgr.y (mgr.34104) 185 : cluster [DBG] pgmap v271: 25 pgs: 2 active+clean+wait, 1 peering, 16 active+clean, 2 active+undersized, 4 active+undersized+degraded; 170 MiB data, 691 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 11 op/s; 17/189 objects degraded (8.995%); 5.0 MiB/s, 1 objects/s recovering 2021-07-26T16:01:28.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:28 smithi033 bash[42377]: cluster 2021-07-26T16:01:27.108508+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e316: 8 total, 7 up, 8 in 2021-07-26T16:01:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:28 smithi033 bash[41341]: cluster 2021-07-26T16:01:27.019062+0000 mgr.y (mgr.34104) 185 : cluster [DBG] pgmap v271: 25 pgs: 2 active+clean+wait, 1 peering, 16 active+clean, 2 active+undersized, 4 active+undersized+degraded; 170 MiB data, 691 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 11 op/s; 17/189 objects degraded (8.995%); 5.0 MiB/s, 1 objects/s recovering 2021-07-26T16:01:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:28 smithi033 bash[41341]: cluster 2021-07-26T16:01:27.108508+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e316: 8 total, 7 up, 8 in 2021-07-26T16:01:28.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:28 smithi096 bash[33981]: cluster 2021-07-26T16:01:27.019062+0000 mgr.y (mgr.34104) 185 : cluster [DBG] pgmap v271: 25 pgs: 2 active+clean+wait, 1 peering, 16 active+clean, 2 active+undersized, 4 active+undersized+degraded; 170 MiB data, 691 MiB used, 715 GiB / 715 GiB avail; 4.2 MiB/s rd, 3.1 MiB/s wr, 11 op/s; 17/189 objects degraded (8.995%); 5.0 MiB/s, 1 objects/s recovering 2021-07-26T16:01:28.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:28 smithi096 bash[33981]: cluster 2021-07-26T16:01:27.108508+0000 mon.a (mon.0) 520 : cluster [DBG] osdmap e316: 8 total, 7 up, 8 in 2021-07-26T16:01:28.985 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:28 smithi096 bash[36584]: debug 2021-07-26T16:01:28.572+0000 7fbe9ac7d0c0 -1 osd.5 307 log_to_monitors {default=true} 2021-07-26T16:01:29.148 INFO:tasks.rados.rados.0.smithi033.stdout:1307: done (4 left) 2021-07-26T16:01:29.148 INFO:tasks.rados.rados.0.smithi033.stdout:1309: done (3 left) 2021-07-26T16:01:29.148 INFO:tasks.rados.rados.0.smithi033.stdout:1310: rmattr oid 13 current snap is 129 2021-07-26T16:01:29.149 INFO:tasks.rados.rados.0.smithi033.stdout:1310: done (3 left) 2021-07-26T16:01:29.149 INFO:tasks.rados.rados.0.smithi033.stdout:1311: snap_remove snap 125 2021-07-26T16:01:29.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:29 smithi033 bash[41341]: cluster 2021-07-26T16:01:28.128651+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e317: 8 total, 7 up, 8 in 2021-07-26T16:01:29.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:29 smithi033 bash[41341]: audit 2021-07-26T16:01:28.579518+0000 mon.a (mon.0) 522 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T16:01:29.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:29 smithi033 bash[41341]: audit 2021-07-26T16:01:28.582464+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/2596074962,v1:172.21.15.96:6809/2596074962]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T16:01:29.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:29 smithi033 bash[42377]: cluster 2021-07-26T16:01:28.128651+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e317: 8 total, 7 up, 8 in 2021-07-26T16:01:29.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:29 smithi033 bash[42377]: audit 2021-07-26T16:01:28.579518+0000 mon.a (mon.0) 522 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T16:01:29.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:29 smithi033 bash[42377]: audit 2021-07-26T16:01:28.582464+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/2596074962,v1:172.21.15.96:6809/2596074962]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T16:01:29.486 INFO:journalctl@ceph.osd.5.smithi096.stdout:Jul 26 16:01:29 smithi096 bash[36584]: debug 2021-07-26T16:01:29.156+0000 7fbe8ddd5700 -1 osd.5 307 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-07-26T16:01:29.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:29 smithi096 bash[33981]: cluster 2021-07-26T16:01:28.128651+0000 mon.a (mon.0) 521 : cluster [DBG] osdmap e317: 8 total, 7 up, 8 in 2021-07-26T16:01:29.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:29 smithi096 bash[33981]: audit 2021-07-26T16:01:28.579518+0000 mon.a (mon.0) 522 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T16:01:29.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:29 smithi096 bash[33981]: audit 2021-07-26T16:01:28.582464+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/2596074962,v1:172.21.15.96:6809/2596074962]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-07-26T16:01:30.148 INFO:tasks.rados.rados.0.smithi033.stdout:1311: done (3 left) 2021-07-26T16:01:30.148 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 129 2021-07-26T16:01:30.149 INFO:tasks.rados.rados.0.smithi033.stdout:1312: seq_num 407 ranges {1875968=425984,2301952=761856,3063808=704512,3768320=139264} 2021-07-26T16:01:30.163 INFO:tasks.rados.rados.0.smithi033.stdout:1312: writing smithi03339061-41 from 1875968 to 2301952 tid 1 2021-07-26T16:01:30.168 INFO:tasks.rados.rados.0.smithi033.stdout:1312: writing smithi03339061-41 from 2301952 to 3063808 tid 2 2021-07-26T16:01:30.171 INFO:tasks.rados.rados.0.smithi033.stdout:1312: writing smithi03339061-41 from 3063808 to 3768320 tid 3 2021-07-26T16:01:30.173 INFO:tasks.rados.rados.0.smithi033.stdout:1312: writing smithi03339061-41 from 3768320 to 3907584 tid 4 2021-07-26T16:01:30.173 INFO:tasks.rados.rados.0.smithi033.stdout:1313: read oid 3 snap -1 2021-07-26T16:01:30.173 INFO:tasks.rados.rados.0.smithi033.stdout:1313: expect (ObjNum 367 snap 117 seq_num 367) 2021-07-26T16:01:30.173 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 129 2021-07-26T16:01:30.173 INFO:tasks.rados.rados.0.smithi033.stdout:1314: seq_num 408 ranges {5300224=442368,5742592=647168,6389760=507904,6897664=450560} 2021-07-26T16:01:30.207 INFO:tasks.rados.rados.0.smithi033.stdout:1314: writing smithi03339061-12 from 5300224 to 5742592 tid 1 2021-07-26T16:01:30.210 INFO:tasks.rados.rados.0.smithi033.stdout:1314: writing smithi03339061-12 from 5742592 to 6389760 tid 2 2021-07-26T16:01:30.213 INFO:tasks.rados.rados.0.smithi033.stdout:1314: writing smithi03339061-12 from 6389760 to 6897664 tid 3 2021-07-26T16:01:30.216 INFO:tasks.rados.rados.0.smithi033.stdout:1314: writing smithi03339061-12 from 6897664 to 7348224 tid 4 2021-07-26T16:01:30.217 INFO:tasks.rados.rados.0.smithi033.stdout:1315: read oid 49 snap -1 2021-07-26T16:01:30.217 INFO:tasks.rados.rados.0.smithi033.stdout:1315: expect (ObjNum 275 snap 85 seq_num 275) 2021-07-26T16:01:30.217 INFO:tasks.rados.rados.0.smithi033.stdout:1316: rollback oid 4 current snap is 129 2021-07-26T16:01:30.217 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 4 to 128 2021-07-26T16:01:30.218 INFO:tasks.rados.rados.0.smithi033.stdout:1313: expect (ObjNum 367 snap 117 seq_num 367) 2021-07-26T16:01:30.259 INFO:tasks.rados.rados.0.smithi033.stdout:1316: finishing rollback tid 0 to smithi03339061-4 2021-07-26T16:01:30.260 INFO:tasks.rados.rados.0.smithi033.stdout:1316: finishing rollback tid 1 to smithi03339061-4 2021-07-26T16:01:30.260 INFO:tasks.rados.rados.0.smithi033.stdout:1316: finishing rollback tid 2 to smithi03339061-4 2021-07-26T16:01:30.261 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 490 (ObjNum 339 snap 111 seq_num 339) dirty exists 2021-07-26T16:01:30.261 INFO:tasks.rados.rados.0.smithi033.stdout:1313: done (7 left) 2021-07-26T16:01:30.261 INFO:tasks.rados.rados.0.smithi033.stdout:1316: done (6 left) 2021-07-26T16:01:30.261 INFO:tasks.rados.rados.0.smithi033.stdout:1317: read oid 14 snap -1 2021-07-26T16:01:30.262 INFO:tasks.rados.rados.0.smithi033.stdout:1317: expect deleted 2021-07-26T16:01:30.262 INFO:tasks.rados.rados.0.smithi033.stdout:1318: rollback oid 32 current snap is 129 2021-07-26T16:01:30.262 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 32 to 122 2021-07-26T16:01:30.262 INFO:tasks.rados.rados.0.smithi033.stdout:1319: rollback oid 21 current snap is 129 2021-07-26T16:01:30.262 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 21 to 122 2021-07-26T16:01:30.263 INFO:tasks.rados.rados.0.smithi033.stdout:1320: delete oid 18 current snap is 129 2021-07-26T16:01:30.264 INFO:tasks.rados.rados.0.smithi033.stdout:1317: done (9 left) 2021-07-26T16:01:30.264 INFO:tasks.rados.rados.0.smithi033.stdout:1320: done (8 left) 2021-07-26T16:01:30.264 INFO:tasks.rados.rados.0.smithi033.stdout:1321: read oid 18 snap -1 2021-07-26T16:01:30.264 INFO:tasks.rados.rados.0.smithi033.stdout:1321: expect deleted 2021-07-26T16:01:30.265 INFO:tasks.rados.rados.0.smithi033.stdout:1322: read oid 9 snap 128 2021-07-26T16:01:30.265 INFO:tasks.rados.rados.0.smithi033.stdout:1322: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T16:01:30.265 INFO:tasks.rados.rados.0.smithi033.stdout:1323: delete oid 26 current snap is 129 2021-07-26T16:01:30.269 INFO:tasks.rados.rados.0.smithi033.stdout:1318: finishing rollback tid 0 to smithi03339061-32 2021-07-26T16:01:30.270 INFO:tasks.rados.rados.0.smithi033.stdout:1318: finishing rollback tid 1 to smithi03339061-32 2021-07-26T16:01:30.270 INFO:tasks.rados.rados.0.smithi033.stdout:1318: finishing rollback tid 2 to smithi03339061-32 2021-07-26T16:01:30.270 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 316 (ObjNum 282 snap 86 seq_num 282) dirty exists 2021-07-26T16:01:30.271 INFO:tasks.rados.rados.0.smithi033.stdout:1318: done (10 left) 2021-07-26T16:01:30.271 INFO:tasks.rados.rados.0.smithi033.stdout:1321: done (9 left) 2021-07-26T16:01:30.272 INFO:tasks.rados.rados.0.smithi033.stdout:1323: done (8 left) 2021-07-26T16:01:30.272 INFO:tasks.rados.rados.0.smithi033.stdout:1324: read oid 6 snap 120 2021-07-26T16:01:30.272 INFO:tasks.rados.rados.0.smithi033.stdout:1324: expect deleted 2021-07-26T16:01:30.272 INFO:tasks.rados.rados.0.smithi033.stdout:1325: rollback oid 14 current snap is 129 2021-07-26T16:01:30.272 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 14 to 120 2021-07-26T16:01:30.274 INFO:tasks.rados.rados.0.smithi033.stdout:1326: snap_create 2021-07-26T16:01:30.276 INFO:tasks.rados.rados.0.smithi033.stdout:1325: finishing rollback tid 1 to smithi03339061-14 2021-07-26T16:01:30.276 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 0 (ObjNum 2005002048 snap 22002 seq_num 2006019664) dirty dne 2021-07-26T16:01:30.276 INFO:tasks.rados.rados.0.smithi033.stdout:1322: expect (ObjNum 222 snap 63 seq_num 222) 2021-07-26T16:01:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:30 smithi033 bash[41341]: cluster 2021-07-26T16:01:29.019947+0000 mgr.y (mgr.34104) 186 : cluster [DBG] pgmap v274: 25 pgs: 2 active+clean+wait, 17 active+clean, 2 active+undersized, 4 active+undersized+degraded; 162 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 948 KiB/s wr, 17 op/s; 17/171 objects degraded (9.942%); 7.1 MiB/s, 2 objects/s recovering 2021-07-26T16:01:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:30 smithi033 bash[41341]: audit 2021-07-26T16:01:29.145255+0000 mon.a (mon.0) 523 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-07-26T16:01:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:30 smithi033 bash[41341]: cluster 2021-07-26T16:01:29.145508+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e318: 8 total, 7 up, 8 in 2021-07-26T16:01:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:30 smithi033 bash[41341]: audit 2021-07-26T16:01:29.147148+0000 mon.a (mon.0) 525 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:30.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:30 smithi033 bash[41341]: audit 2021-07-26T16:01:29.150234+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/2596074962,v1:172.21.15.96:6809/2596074962]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:30.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:30 smithi033 bash[42377]: cluster 2021-07-26T16:01:29.019947+0000 mgr.y (mgr.34104) 186 : cluster [DBG] pgmap v274: 25 pgs: 2 active+clean+wait, 17 active+clean, 2 active+undersized, 4 active+undersized+degraded; 162 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 948 KiB/s wr, 17 op/s; 17/171 objects degraded (9.942%); 7.1 MiB/s, 2 objects/s recovering 2021-07-26T16:01:30.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:30 smithi033 bash[42377]: audit 2021-07-26T16:01:29.145255+0000 mon.a (mon.0) 523 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-07-26T16:01:30.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:30 smithi033 bash[42377]: cluster 2021-07-26T16:01:29.145508+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e318: 8 total, 7 up, 8 in 2021-07-26T16:01:30.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:30 smithi033 bash[42377]: audit 2021-07-26T16:01:29.147148+0000 mon.a (mon.0) 525 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:30.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:30 smithi033 bash[42377]: audit 2021-07-26T16:01:29.150234+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/2596074962,v1:172.21.15.96:6809/2596074962]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:30.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:30 smithi096 bash[33981]: cluster 2021-07-26T16:01:29.019947+0000 mgr.y (mgr.34104) 186 : cluster [DBG] pgmap v274: 25 pgs: 2 active+clean+wait, 17 active+clean, 2 active+undersized, 4 active+undersized+degraded; 162 MiB data, 686 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 948 KiB/s wr, 17 op/s; 17/171 objects degraded (9.942%); 7.1 MiB/s, 2 objects/s recovering 2021-07-26T16:01:30.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:30 smithi096 bash[33981]: audit 2021-07-26T16:01:29.145255+0000 mon.a (mon.0) 523 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-07-26T16:01:30.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:30 smithi096 bash[33981]: cluster 2021-07-26T16:01:29.145508+0000 mon.a (mon.0) 524 : cluster [DBG] osdmap e318: 8 total, 7 up, 8 in 2021-07-26T16:01:30.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:30 smithi096 bash[33981]: audit 2021-07-26T16:01:29.147148+0000 mon.a (mon.0) 525 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:30.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:30 smithi096 bash[33981]: audit 2021-07-26T16:01:29.150234+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.15.96:6808/2596074962,v1:172.21.15.96:6809/2596074962]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:31.001 INFO:tasks.rados.rados.0.smithi033.stdout:1322: done (10 left) 2021-07-26T16:01:31.001 INFO:tasks.rados.rados.0.smithi033.stdout:1324: done (9 left) 2021-07-26T16:01:31.001 INFO:tasks.rados.rados.0.smithi033.stdout:1325: done (8 left) 2021-07-26T16:01:31.002 INFO:tasks.rados.rados.0.smithi033.stdout:1326: done (7 left) 2021-07-26T16:01:31.002 INFO:tasks.rados.rados.0.smithi033.stdout:1327: rollback oid 46 current snap is 130 2021-07-26T16:01:31.002 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 46 to 129 2021-07-26T16:01:31.002 INFO:tasks.rados.rados.0.smithi033.stdout:1328: read oid 36 snap -1 2021-07-26T16:01:31.003 INFO:tasks.rados.rados.0.smithi033.stdout:1328: expect deleted 2021-07-26T16:01:31.003 INFO:tasks.rados.rados.0.smithi033.stdout:1329: snap_remove snap 127 2021-07-26T16:01:31.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[41341]: cluster 2021-07-26T16:01:30.133871+0000 mon.a (mon.0) 526 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:01:31.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[41341]: cluster 2021-07-26T16:01:30.144197+0000 mon.a (mon.0) 527 : cluster [INF] osd.5 [v2:172.21.15.96:6808/2596074962,v1:172.21.15.96:6809/2596074962] boot 2021-07-26T16:01:31.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[41341]: cluster 2021-07-26T16:01:30.144698+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2021-07-26T16:01:31.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[41341]: audit 2021-07-26T16:01:30.146095+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T16:01:31.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[41341]: cluster 2021-07-26T16:01:30.984701+0000 mon.a (mon.0) 529 : cluster [WRN] Health check update: Degraded data redundancy: 17/171 objects degraded (9.942%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:31.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[41341]: cluster 2021-07-26T16:01:30.994886+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2021-07-26T16:01:31.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[42377]: cluster 2021-07-26T16:01:30.133871+0000 mon.a (mon.0) 526 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:01:31.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[42377]: cluster 2021-07-26T16:01:30.144197+0000 mon.a (mon.0) 527 : cluster [INF] osd.5 [v2:172.21.15.96:6808/2596074962,v1:172.21.15.96:6809/2596074962] boot 2021-07-26T16:01:31.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[42377]: cluster 2021-07-26T16:01:30.144698+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2021-07-26T16:01:31.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[42377]: audit 2021-07-26T16:01:30.146095+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T16:01:31.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[42377]: cluster 2021-07-26T16:01:30.984701+0000 mon.a (mon.0) 529 : cluster [WRN] Health check update: Degraded data redundancy: 17/171 objects degraded (9.942%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:31.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:31 smithi033 bash[42377]: cluster 2021-07-26T16:01:30.994886+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2021-07-26T16:01:31.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:31 smithi096 bash[33981]: cluster 2021-07-26T16:01:30.133871+0000 mon.a (mon.0) 526 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:01:31.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:31 smithi096 bash[33981]: cluster 2021-07-26T16:01:30.144197+0000 mon.a (mon.0) 527 : cluster [INF] osd.5 [v2:172.21.15.96:6808/2596074962,v1:172.21.15.96:6809/2596074962] boot 2021-07-26T16:01:31.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:31 smithi096 bash[33981]: cluster 2021-07-26T16:01:30.144698+0000 mon.a (mon.0) 528 : cluster [DBG] osdmap e319: 8 total, 8 up, 8 in 2021-07-26T16:01:31.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:31 smithi096 bash[33981]: audit 2021-07-26T16:01:30.146095+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-07-26T16:01:31.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:31 smithi096 bash[33981]: cluster 2021-07-26T16:01:30.984701+0000 mon.a (mon.0) 529 : cluster [WRN] Health check update: Degraded data redundancy: 17/171 objects degraded (9.942%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:31.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:31 smithi096 bash[33981]: cluster 2021-07-26T16:01:30.994886+0000 mon.a (mon.0) 530 : cluster [DBG] osdmap e320: 8 total, 8 up, 8 in 2021-07-26T16:01:32.021 INFO:tasks.rados.rados.0.smithi033.stdout:1329: done (9 left) 2021-07-26T16:01:32.021 INFO:tasks.rados.rados.0.smithi033.stdout:1330: read oid 11 snap -1 2021-07-26T16:01:32.021 INFO:tasks.rados.rados.0.smithi033.stdout:1330: expect (ObjNum 366 snap 117 seq_num 366) 2021-07-26T16:01:32.021 INFO:tasks.rados.rados.0.smithi033.stdout:1331: setattr oid 27 current snap is 130 2021-07-26T16:01:32.026 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 130 2021-07-26T16:01:32.026 INFO:tasks.rados.rados.0.smithi033.stdout:1332: seq_num 411 ranges {1605632=491520,2097152=753664,2850816=688128,3538944=163840} 2021-07-26T16:01:32.039 INFO:tasks.rados.rados.0.smithi033.stdout:1332: writing smithi03339061-25 from 1605632 to 2097152 tid 1 2021-07-26T16:01:32.044 INFO:tasks.rados.rados.0.smithi033.stdout:1332: writing smithi03339061-25 from 2097152 to 2850816 tid 2 2021-07-26T16:01:32.048 INFO:tasks.rados.rados.0.smithi033.stdout:1332: writing smithi03339061-25 from 2850816 to 3538944 tid 3 2021-07-26T16:01:32.049 INFO:tasks.rados.rados.0.smithi033.stdout:1332: writing smithi03339061-25 from 3538944 to 3702784 tid 4 2021-07-26T16:01:32.049 INFO:tasks.rados.rados.0.smithi033.stdout:1333: snap_remove snap 128 2021-07-26T16:01:32.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:32 smithi033 bash[41341]: cluster 2021-07-26T16:01:31.020608+0000 mgr.y (mgr.34104) 187 : cluster [DBG] pgmap v278: 25 pgs: 2 active+clean+wait, 17 active+clean, 2 active+undersized, 4 active+undersized+degraded; 167 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.9 MiB/s wr, 23 op/s; 17/183 objects degraded (9.290%); 5.6 MiB/s, 1 objects/s recovering 2021-07-26T16:01:32.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:32 smithi033 bash[41341]: cluster 2021-07-26T16:01:32.013931+0000 mon.a (mon.0) 531 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2021-07-26T16:01:32.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:32 smithi033 bash[42377]: cluster 2021-07-26T16:01:31.020608+0000 mgr.y (mgr.34104) 187 : cluster [DBG] pgmap v278: 25 pgs: 2 active+clean+wait, 17 active+clean, 2 active+undersized, 4 active+undersized+degraded; 167 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.9 MiB/s wr, 23 op/s; 17/183 objects degraded (9.290%); 5.6 MiB/s, 1 objects/s recovering 2021-07-26T16:01:32.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:32 smithi033 bash[42377]: cluster 2021-07-26T16:01:32.013931+0000 mon.a (mon.0) 531 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2021-07-26T16:01:32.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:32 smithi096 bash[33981]: cluster 2021-07-26T16:01:31.020608+0000 mgr.y (mgr.34104) 187 : cluster [DBG] pgmap v278: 25 pgs: 2 active+clean+wait, 17 active+clean, 2 active+undersized, 4 active+undersized+degraded; 167 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.9 MiB/s wr, 23 op/s; 17/183 objects degraded (9.290%); 5.6 MiB/s, 1 objects/s recovering 2021-07-26T16:01:32.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:32 smithi096 bash[33981]: cluster 2021-07-26T16:01:32.013931+0000 mon.a (mon.0) 531 : cluster [DBG] osdmap e321: 8 total, 8 up, 8 in 2021-07-26T16:01:33.027 INFO:tasks.rados.rados.0.smithi033.stdout:1333: done (12 left) 2021-07-26T16:01:33.027 INFO:tasks.rados.rados.0.smithi033.stdout:1334: read oid 37 snap -1 2021-07-26T16:01:33.028 INFO:tasks.rados.rados.0.smithi033.stdout:1334: expect deleted 2021-07-26T16:01:33.028 INFO:tasks.rados.rados.0.smithi033.stdout:1335: read oid 28 snap -1 2021-07-26T16:01:33.028 INFO:tasks.rados.rados.0.smithi033.stdout:1335: expect (ObjNum 362 snap 115 seq_num 362) 2021-07-26T16:01:33.028 INFO:tasks.rados.rados.0.smithi033.stdout:1327: finishing rollback tid 1 to smithi03339061-46 2021-07-26T16:01:33.029 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 0 (ObjNum 2006447440 snap 22002 seq_num 1058725024) dirty dne 2021-07-26T16:01:33.029 INFO:tasks.rados.rados.0.smithi033.stdout:1319: finishing rollback tid 0 to smithi03339061-21 2021-07-26T16:01:33.029 INFO:tasks.rados.rados.0.smithi033.stdout:1319: finishing rollback tid 1 to smithi03339061-21 2021-07-26T16:01:33.029 INFO:tasks.rados.rados.0.smithi033.stdout:1319: finishing rollback tid 2 to smithi03339061-21 2021-07-26T16:01:33.029 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 580 (ObjNum 275 snap 85 seq_num 275) dirty exists 2021-07-26T16:01:33.030 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 584 (ObjNum 321 snap 102 seq_num 321) dirty exists 2021-07-26T16:01:33.030 INFO:tasks.rados.rados.0.smithi033.stdout:1332: finishing write tid 1 to smithi03339061-25 2021-07-26T16:01:33.030 INFO:tasks.rados.rados.0.smithi033.stdout:1332: finishing write tid 2 to smithi03339061-25 2021-07-26T16:01:33.030 INFO:tasks.rados.rados.0.smithi033.stdout:1332: finishing write tid 3 to smithi03339061-25 2021-07-26T16:01:33.030 INFO:tasks.rados.rados.0.smithi033.stdout:1332: finishing write tid 4 to smithi03339061-25 2021-07-26T16:01:33.031 INFO:tasks.rados.rados.0.smithi033.stdout:1332: finishing write tid 5 to smithi03339061-25 2021-07-26T16:01:33.031 INFO:tasks.rados.rados.0.smithi033.stdout:1332: finishing write tid 6 to smithi03339061-25 2021-07-26T16:01:33.031 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 324 (ObjNum 411 snap 130 seq_num 411) dirty exists 2021-07-26T16:01:33.031 INFO:tasks.rados.rados.0.smithi033.stdout:1332: left oid 25 (ObjNum 411 snap 130 seq_num 411) 2021-07-26T16:01:33.032 INFO:tasks.rados.rados.0.smithi033.stdout:1330: expect (ObjNum 366 snap 117 seq_num 366) 2021-07-26T16:01:33.695 INFO:tasks.rados.rados.0.smithi033.stdout:1319: done (13 left) 2021-07-26T16:01:33.695 INFO:tasks.rados.rados.0.smithi033.stdout:1327: done (12 left) 2021-07-26T16:01:33.696 INFO:tasks.rados.rados.0.smithi033.stdout:1328: done (11 left) 2021-07-26T16:01:33.696 INFO:tasks.rados.rados.0.smithi033.stdout:1330: done (10 left) 2021-07-26T16:01:33.696 INFO:tasks.rados.rados.0.smithi033.stdout:1331: done (9 left) 2021-07-26T16:01:33.696 INFO:tasks.rados.rados.0.smithi033.stdout:1332: done (8 left) 2021-07-26T16:01:33.697 INFO:tasks.rados.rados.0.smithi033.stdout:1334: done (7 left) 2021-07-26T16:01:33.697 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 130 2021-07-26T16:01:33.697 INFO:tasks.rados.rados.0.smithi033.stdout:1336: seq_num 412 ranges {1777664=507904,2285568=630784,2916352=491520,3407872=483328} 2021-07-26T16:01:33.717 INFO:tasks.rados.rados.0.smithi033.stdout:1336: writing smithi03339061-20 from 1777664 to 2285568 tid 1 2021-07-26T16:01:33.721 INFO:tasks.rados.rados.0.smithi033.stdout:1336: writing smithi03339061-20 from 2285568 to 2916352 tid 2 2021-07-26T16:01:33.723 INFO:tasks.rados.rados.0.smithi033.stdout:1336: writing smithi03339061-20 from 2916352 to 3407872 tid 3 2021-07-26T16:01:33.726 INFO:tasks.rados.rados.0.smithi033.stdout:1336: writing smithi03339061-20 from 3407872 to 3891200 tid 4 2021-07-26T16:01:33.727 INFO:tasks.rados.rados.0.smithi033.stdout:1337: delete oid 43 current snap is 130 2021-07-26T16:01:33.727 INFO:tasks.rados.rados.0.smithi033.stdout:1336: finishing write tid 1 to smithi03339061-20 2021-07-26T16:01:33.731 INFO:tasks.rados.rados.0.smithi033.stdout:1336: finishing write tid 2 to smithi03339061-20 2021-07-26T16:01:33.732 INFO:tasks.rados.rados.0.smithi033.stdout:1336: finishing write tid 3 to smithi03339061-20 2021-07-26T16:01:33.732 INFO:tasks.rados.rados.0.smithi033.stdout:1336: finishing write tid 4 to smithi03339061-20 2021-07-26T16:01:33.733 INFO:tasks.rados.rados.0.smithi033.stdout:1336: finishing write tid 5 to smithi03339061-20 2021-07-26T16:01:33.734 INFO:tasks.rados.rados.0.smithi033.stdout:1336: finishing write tid 6 to smithi03339061-20 2021-07-26T16:01:33.734 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 495 (ObjNum 412 snap 130 seq_num 412) dirty exists 2021-07-26T16:01:33.735 INFO:tasks.rados.rados.0.smithi033.stdout:1336: left oid 20 (ObjNum 412 snap 130 seq_num 412) 2021-07-26T16:01:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:33 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:33.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:33 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:33.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:33 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:33.519Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:01:34.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:34 smithi033 bash[41341]: cluster 2021-07-26T16:01:33.021378+0000 mgr.y (mgr.34104) 188 : cluster [DBG] pgmap v281: 25 pgs: 2 active+clean+wait, 17 active+clean, 2 active+undersized, 4 active+undersized+degraded; 167 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.5 MiB/s wr, 7 op/s; 17/186 objects degraded (9.140%) 2021-07-26T16:01:34.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:34 smithi033 bash[41341]: cluster 2021-07-26T16:01:33.023429+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2021-07-26T16:01:34.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:34 smithi033 bash[42377]: cluster 2021-07-26T16:01:33.021378+0000 mgr.y (mgr.34104) 188 : cluster [DBG] pgmap v281: 25 pgs: 2 active+clean+wait, 17 active+clean, 2 active+undersized, 4 active+undersized+degraded; 167 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.5 MiB/s wr, 7 op/s; 17/186 objects degraded (9.140%) 2021-07-26T16:01:34.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:34 smithi033 bash[42377]: cluster 2021-07-26T16:01:33.023429+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2021-07-26T16:01:34.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:34 smithi096 bash[33981]: cluster 2021-07-26T16:01:33.021378+0000 mgr.y (mgr.34104) 188 : cluster [DBG] pgmap v281: 25 pgs: 2 active+clean+wait, 17 active+clean, 2 active+undersized, 4 active+undersized+degraded; 167 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.5 MiB/s wr, 7 op/s; 17/186 objects degraded (9.140%) 2021-07-26T16:01:34.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:34 smithi096 bash[33981]: cluster 2021-07-26T16:01:33.023429+0000 mon.a (mon.0) 532 : cluster [DBG] osdmap e322: 8 total, 8 up, 8 in 2021-07-26T16:01:34.581 INFO:tasks.rados.rados.0.smithi033.stdout:1315: expect (ObjNum 275 snap 85 seq_num 275) 2021-07-26T16:01:34.865 INFO:tasks.rados.rados.0.smithi033.stdout:1293: expect (ObjNum 282 snap 86 seq_num 282) 2021-07-26T16:01:35.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:35 smithi033 bash[41341]: cluster 2021-07-26T16:01:35.073790+0000 mon.a (mon.0) 533 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/186 objects degraded (9.140%), 4 pgs degraded) 2021-07-26T16:01:35.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:35 smithi033 bash[41341]: cluster 2021-07-26T16:01:35.073857+0000 mon.a (mon.0) 534 : cluster [INF] Cluster is now healthy 2021-07-26T16:01:35.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:35 smithi033 bash[42377]: cluster 2021-07-26T16:01:35.073790+0000 mon.a (mon.0) 533 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/186 objects degraded (9.140%), 4 pgs degraded) 2021-07-26T16:01:35.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:35 smithi033 bash[42377]: cluster 2021-07-26T16:01:35.073857+0000 mon.a (mon.0) 534 : cluster [INF] Cluster is now healthy 2021-07-26T16:01:35.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:35 smithi096 bash[33981]: cluster 2021-07-26T16:01:35.073790+0000 mon.a (mon.0) 533 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/186 objects degraded (9.140%), 4 pgs degraded) 2021-07-26T16:01:35.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:35 smithi096 bash[33981]: cluster 2021-07-26T16:01:35.073857+0000 mon.a (mon.0) 534 : cluster [INF] Cluster is now healthy 2021-07-26T16:01:36.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:36 smithi033 bash[41341]: cluster 2021-07-26T16:01:35.021895+0000 mgr.y (mgr.34104) 189 : cluster [DBG] pgmap v282: 25 pgs: 2 active+clean+snaptrim, 6 active+clean+wait, 17 active+clean; 171 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s; 5.0 MiB/s, 1 objects/s recovering 2021-07-26T16:01:36.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:36 smithi033 bash[41341]: cluster 2021-07-26T16:01:35.999810+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2021-07-26T16:01:36.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:36 smithi033 bash[42377]: cluster 2021-07-26T16:01:35.021895+0000 mgr.y (mgr.34104) 189 : cluster [DBG] pgmap v282: 25 pgs: 2 active+clean+snaptrim, 6 active+clean+wait, 17 active+clean; 171 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s; 5.0 MiB/s, 1 objects/s recovering 2021-07-26T16:01:36.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:36 smithi033 bash[42377]: cluster 2021-07-26T16:01:35.999810+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2021-07-26T16:01:36.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:36 smithi096 bash[33981]: cluster 2021-07-26T16:01:35.021895+0000 mgr.y (mgr.34104) 189 : cluster [DBG] pgmap v282: 25 pgs: 2 active+clean+snaptrim, 6 active+clean+wait, 17 active+clean; 171 MiB data, 675 MiB used, 715 GiB / 715 GiB avail; 8.2 MiB/s rd, 1.1 MiB/s wr, 10 op/s; 5.0 MiB/s, 1 objects/s recovering 2021-07-26T16:01:36.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:36 smithi096 bash[33981]: cluster 2021-07-26T16:01:35.999810+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e323: 8 total, 8 up, 8 in 2021-07-26T16:01:38.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:38 smithi033 bash[41341]: cluster 2021-07-26T16:01:37.022571+0000 mgr.y (mgr.34104) 190 : cluster [DBG] pgmap v284: 25 pgs: 2 active+clean+snaptrim, 4 active+clean+wait, 19 active+clean; 175 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 10 op/s; 4.0 MiB/s, 1 objects/s recovering 2021-07-26T16:01:38.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:38 smithi033 bash[42377]: cluster 2021-07-26T16:01:37.022571+0000 mgr.y (mgr.34104) 190 : cluster [DBG] pgmap v284: 25 pgs: 2 active+clean+snaptrim, 4 active+clean+wait, 19 active+clean; 175 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 10 op/s; 4.0 MiB/s, 1 objects/s recovering 2021-07-26T16:01:38.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:38 smithi096 bash[33981]: cluster 2021-07-26T16:01:37.022571+0000 mgr.y (mgr.34104) 190 : cluster [DBG] pgmap v284: 25 pgs: 2 active+clean+snaptrim, 4 active+clean+wait, 19 active+clean; 175 MiB data, 683 MiB used, 715 GiB / 715 GiB avail; 14 MiB/s rd, 1.2 MiB/s wr, 10 op/s; 4.0 MiB/s, 1 objects/s recovering 2021-07-26T16:01:40.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:40 smithi033 bash[41341]: cluster 2021-07-26T16:01:39.023299+0000 mgr.y (mgr.34104) 191 : cluster [DBG] pgmap v285: 25 pgs: 4 active+clean+wait, 21 active+clean; 175 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 8 op/s; 3.5 MiB/s, 1 objects/s recovering 2021-07-26T16:01:40.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:40 smithi033 bash[42377]: cluster 2021-07-26T16:01:39.023299+0000 mgr.y (mgr.34104) 191 : cluster [DBG] pgmap v285: 25 pgs: 4 active+clean+wait, 21 active+clean; 175 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 8 op/s; 3.5 MiB/s, 1 objects/s recovering 2021-07-26T16:01:40.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:40 smithi096 bash[33981]: cluster 2021-07-26T16:01:39.023299+0000 mgr.y (mgr.34104) 191 : cluster [DBG] pgmap v285: 25 pgs: 4 active+clean+wait, 21 active+clean; 175 MiB data, 684 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 8 op/s; 3.5 MiB/s, 1 objects/s recovering 2021-07-26T16:01:41.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:41 smithi033 bash[41341]: audit 2021-07-26T16:01:40.880538+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:41.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:41 smithi033 bash[41341]: cluster 2021-07-26T16:01:40.999438+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2021-07-26T16:01:41.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:41 smithi033 bash[42377]: audit 2021-07-26T16:01:40.880538+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:41.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:41 smithi033 bash[42377]: cluster 2021-07-26T16:01:40.999438+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2021-07-26T16:01:41.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:41 smithi096 bash[33981]: audit 2021-07-26T16:01:40.880538+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:41.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:41 smithi096 bash[33981]: cluster 2021-07-26T16:01:40.999438+0000 mon.a (mon.0) 536 : cluster [DBG] osdmap e324: 8 total, 8 up, 8 in 2021-07-26T16:01:42.422 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:42 smithi096 bash[33981]: audit 2021-07-26T16:01:40.880969+0000 mgr.y (mgr.34104) 192 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:42.422 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:42 smithi096 bash[33981]: cephadm 2021-07-26T16:01:40.883246+0000 mgr.y (mgr.34104) 193 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-07-26T16:01:42.423 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:42 smithi096 bash[33981]: cluster 2021-07-26T16:01:41.023883+0000 mgr.y (mgr.34104) 194 : cluster [DBG] pgmap v287: 25 pgs: 4 active+clean+wait, 21 active+clean; 175 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 937 KiB/s wr, 7 op/s; 3.0 MiB/s, 0 objects/s recovering 2021-07-26T16:01:42.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:42 smithi033 bash[41341]: audit 2021-07-26T16:01:40.880969+0000 mgr.y (mgr.34104) 192 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:42.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:42 smithi033 bash[41341]: cephadm 2021-07-26T16:01:40.883246+0000 mgr.y (mgr.34104) 193 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-07-26T16:01:42.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:42 smithi033 bash[41341]: cluster 2021-07-26T16:01:41.023883+0000 mgr.y (mgr.34104) 194 : cluster [DBG] pgmap v287: 25 pgs: 4 active+clean+wait, 21 active+clean; 175 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 937 KiB/s wr, 7 op/s; 3.0 MiB/s, 0 objects/s recovering 2021-07-26T16:01:42.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:42 smithi033 bash[42377]: audit 2021-07-26T16:01:40.880969+0000 mgr.y (mgr.34104) 192 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2021-07-26T16:01:42.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:42 smithi033 bash[42377]: cephadm 2021-07-26T16:01:40.883246+0000 mgr.y (mgr.34104) 193 : cephadm [INF] Upgrade: osd.6 is safe to restart 2021-07-26T16:01:42.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:42 smithi033 bash[42377]: cluster 2021-07-26T16:01:41.023883+0000 mgr.y (mgr.34104) 194 : cluster [DBG] pgmap v287: 25 pgs: 4 active+clean+wait, 21 active+clean; 175 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 10 MiB/s rd, 937 KiB/s wr, 7 op/s; 3.0 MiB/s, 0 objects/s recovering 2021-07-26T16:01:43.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:43 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:43.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:43.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:43 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:43.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:43.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:43 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:43.519Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:01:44.038 INFO:tasks.rados.rados.0.smithi033.stdout:1314: finishing write tid 1 to smithi03339061-12 2021-07-26T16:01:44.039 INFO:tasks.rados.rados.0.smithi033.stdout:1312: finishing write tid 1 to smithi03339061-41 2021-07-26T16:01:44.039 INFO:tasks.rados.rados.0.smithi033.stdout:1312: finishing write tid 2 to smithi03339061-41 2021-07-26T16:01:44.042 INFO:tasks.rados.rados.0.smithi033.stdout:1312: finishing write tid 3 to smithi03339061-41 2021-07-26T16:01:44.043 INFO:tasks.rados.rados.0.smithi033.stdout:1312: finishing write tid 4 to smithi03339061-41 2021-07-26T16:01:44.044 INFO:tasks.rados.rados.0.smithi033.stdout:1312: finishing write tid 5 to smithi03339061-41 2021-07-26T16:01:44.047 INFO:tasks.rados.rados.0.smithi033.stdout:1314: finishing write tid 2 to smithi03339061-12 2021-07-26T16:01:44.047 INFO:tasks.rados.rados.0.smithi033.stdout:1314: finishing write tid 3 to smithi03339061-12 2021-07-26T16:01:44.048 INFO:tasks.rados.rados.0.smithi033.stdout:1314: finishing write tid 4 to smithi03339061-12 2021-07-26T16:01:44.048 INFO:tasks.rados.rados.0.smithi033.stdout:1312: finishing write tid 6 to smithi03339061-41 2021-07-26T16:01:44.048 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 488 (ObjNum 407 snap 129 seq_num 407) dirty exists 2021-07-26T16:01:44.048 INFO:tasks.rados.rados.0.smithi033.stdout:1312: left oid 41 (ObjNum 407 snap 129 seq_num 407) 2021-07-26T16:01:44.049 INFO:tasks.rados.rados.0.smithi033.stdout:1293: done (8 left) 2021-07-26T16:01:44.050 INFO:tasks.rados.rados.0.smithi033.stdout:1308: done (7 left) 2021-07-26T16:01:44.050 INFO:tasks.rados.rados.0.smithi033.stdout:1312: done (6 left) 2021-07-26T16:01:44.051 INFO:tasks.rados.rados.0.smithi033.stdout:1315: done (5 left) 2021-07-26T16:01:44.051 INFO:tasks.rados.rados.0.smithi033.stdout:1336: done (4 left) 2021-07-26T16:01:44.052 INFO:tasks.rados.rados.0.smithi033.stdout:1337: done (3 left) 2021-07-26T16:01:44.052 INFO:tasks.rados.rados.0.smithi033.stdout:1338: read oid 16 snap 122 2021-07-26T16:01:44.052 INFO:tasks.rados.rados.0.smithi033.stdout:1338: expect deleted 2021-07-26T16:01:44.052 INFO:tasks.rados.rados.0.smithi033.stdout:1339: snap_create 2021-07-26T16:01:44.054 INFO:tasks.rados.rados.0.smithi033.stdout:1283: finishing copy_from to smithi03339061-2 2021-07-26T16:01:44.055 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 204 (ObjNum 295 snap 91 seq_num 295) dirty exists 2021-07-26T16:01:44.055 INFO:tasks.rados.rados.0.smithi033.stdout:1283: finishing copy_from racing read to smithi03339061-2 2021-07-26T16:01:44.055 INFO:tasks.rados.rados.0.smithi033.stdout:1314: finishing write tid 5 to smithi03339061-12 2021-07-26T16:01:44.056 INFO:tasks.rados.rados.0.smithi033.stdout:1335: expect (ObjNum 362 snap 115 seq_num 362) 2021-07-26T16:01:44.093 INFO:tasks.rados.rados.0.smithi033.stdout:1314: finishing write tid 6 to smithi03339061-12 2021-07-26T16:01:44.093 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 355 (ObjNum 408 snap 129 seq_num 408) dirty exists 2021-07-26T16:01:44.093 INFO:tasks.rados.rados.0.smithi033.stdout:1314: left oid 12 (ObjNum 408 snap 129 seq_num 408) 2021-07-26T16:01:44.277 INFO:tasks.rados.rados.0.smithi033.stdout:1283: done (4 left) 2021-07-26T16:01:44.278 INFO:tasks.rados.rados.0.smithi033.stdout:1314: done (3 left) 2021-07-26T16:01:44.278 INFO:tasks.rados.rados.0.smithi033.stdout:1335: done (2 left) 2021-07-26T16:01:44.278 INFO:tasks.rados.rados.0.smithi033.stdout:1338: done (1 left) 2021-07-26T16:01:44.279 INFO:tasks.rados.rados.0.smithi033.stdout:1339: done (0 left) 2021-07-26T16:01:44.279 INFO:tasks.rados.rados.0.smithi033.stdout:1340: rollback oid 30 current snap is 131 2021-07-26T16:01:44.279 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 30 to 122 2021-07-26T16:01:44.279 INFO:tasks.rados.rados.0.smithi033.stdout:1341: snap_remove snap 130 2021-07-26T16:01:44.605 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:44 smithi096 bash[33981]: cluster 2021-07-26T16:01:43.024691+0000 mgr.y (mgr.34104) 195 : cluster [DBG] pgmap v288: 25 pgs: 4 active+clean+wait, 21 active+clean; 175 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s rd, 514 KiB/s wr, 2 op/s 2021-07-26T16:01:44.605 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:44 smithi096 bash[33981]: cephadm 2021-07-26T16:01:43.260589+0000 mgr.y (mgr.34104) 196 : cephadm [INF] Upgrade: Updating osd.6 2021-07-26T16:01:44.605 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:44 smithi096 bash[33981]: audit 2021-07-26T16:01:43.269972+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:44.606 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:44 smithi096 bash[33981]: cephadm 2021-07-26T16:01:43.273340+0000 mgr.y (mgr.34104) 197 : cephadm [INF] Deploying daemon osd.6 on smithi096 2021-07-26T16:01:44.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:44 smithi033 bash[41341]: cluster 2021-07-26T16:01:43.024691+0000 mgr.y (mgr.34104) 195 : cluster [DBG] pgmap v288: 25 pgs: 4 active+clean+wait, 21 active+clean; 175 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s rd, 514 KiB/s wr, 2 op/s 2021-07-26T16:01:44.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:44 smithi033 bash[41341]: cephadm 2021-07-26T16:01:43.260589+0000 mgr.y (mgr.34104) 196 : cephadm [INF] Upgrade: Updating osd.6 2021-07-26T16:01:44.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:44 smithi033 bash[41341]: audit 2021-07-26T16:01:43.269972+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:44.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:44 smithi033 bash[41341]: cephadm 2021-07-26T16:01:43.273340+0000 mgr.y (mgr.34104) 197 : cephadm [INF] Deploying daemon osd.6 on smithi096 2021-07-26T16:01:44.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:44 smithi033 bash[42377]: cluster 2021-07-26T16:01:43.024691+0000 mgr.y (mgr.34104) 195 : cluster [DBG] pgmap v288: 25 pgs: 4 active+clean+wait, 21 active+clean; 175 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s rd, 514 KiB/s wr, 2 op/s 2021-07-26T16:01:44.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:44 smithi033 bash[42377]: cephadm 2021-07-26T16:01:43.260589+0000 mgr.y (mgr.34104) 196 : cephadm [INF] Upgrade: Updating osd.6 2021-07-26T16:01:44.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:44 smithi033 bash[42377]: audit 2021-07-26T16:01:43.269972+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:44.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:44 smithi033 bash[42377]: cephadm 2021-07-26T16:01:43.273340+0000 mgr.y (mgr.34104) 197 : cephadm [INF] Deploying daemon osd.6 on smithi096 2021-07-26T16:01:45.290 INFO:tasks.rados.rados.0.smithi033.stdout:1341: done (1 left) 2021-07-26T16:01:45.290 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 131 2021-07-26T16:01:45.290 INFO:tasks.rados.rados.0.smithi033.stdout:1342: seq_num 414 ranges {3891200=540672,4431872=802816,5234688=458752,5693440=344064} 2021-07-26T16:01:45.315 INFO:tasks.rados.rados.0.smithi033.stdout:1342: writing smithi03339061-20 from 3891200 to 4431872 tid 1 2021-07-26T16:01:45.321 INFO:tasks.rados.rados.0.smithi033.stdout:1342: writing smithi03339061-20 from 4431872 to 5234688 tid 2 2021-07-26T16:01:45.329 INFO:tasks.rados.rados.0.smithi033.stdout:1342: writing smithi03339061-20 from 5234688 to 5693440 tid 3 2021-07-26T16:01:45.329 INFO:tasks.rados.rados.0.smithi033.stdout:1342: writing smithi03339061-20 from 5693440 to 6037504 tid 4 2021-07-26T16:01:45.329 INFO:tasks.rados.rados.0.smithi033.stdout:1343: delete oid 45 current snap is 131 2021-07-26T16:01:45.329 INFO:tasks.rados.rados.0.smithi033.stdout:1340: finishing rollback tid 0 to smithi03339061-30 2021-07-26T16:01:45.329 INFO:tasks.rados.rados.0.smithi033.stdout:1340: finishing rollback tid 1 to smithi03339061-30 2021-07-26T16:01:45.330 INFO:tasks.rados.rados.0.smithi033.stdout:1340: finishing rollback tid 2 to smithi03339061-30 2021-07-26T16:01:45.330 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 628 (ObjNum 394 snap 120 seq_num 394) dirty exists 2021-07-26T16:01:45.330 INFO:tasks.rados.rados.0.smithi033.stdout:1342: finishing write tid 1 to smithi03339061-20 2021-07-26T16:01:45.330 INFO:tasks.rados.rados.0.smithi033.stdout:1342: finishing write tid 2 to smithi03339061-20 2021-07-26T16:01:45.331 INFO:tasks.rados.rados.0.smithi033.stdout:1342: finishing write tid 3 to smithi03339061-20 2021-07-26T16:01:45.331 INFO:tasks.rados.rados.0.smithi033.stdout:1342: finishing write tid 4 to smithi03339061-20 2021-07-26T16:01:45.332 INFO:tasks.rados.rados.0.smithi033.stdout:1342: finishing write tid 5 to smithi03339061-20 2021-07-26T16:01:45.332 INFO:tasks.rados.rados.0.smithi033.stdout:1340: done (2 left) 2021-07-26T16:01:45.332 INFO:tasks.rados.rados.0.smithi033.stdout:1343: done (1 left) 2021-07-26T16:01:45.332 INFO:tasks.rados.rados.0.smithi033.stdout:1344: snap_remove snap 120 2021-07-26T16:01:45.574 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:45 smithi096 bash[33981]: cluster 2021-07-26T16:01:44.273960+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2021-07-26T16:01:45.575 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:45 smithi096 bash[33981]: audit 2021-07-26T16:01:44.512579+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:45.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:45 smithi033 bash[41341]: cluster 2021-07-26T16:01:44.273960+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2021-07-26T16:01:45.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:45 smithi033 bash[41341]: audit 2021-07-26T16:01:44.512579+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:45.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:45 smithi033 bash[42377]: cluster 2021-07-26T16:01:44.273960+0000 mon.a (mon.0) 538 : cluster [DBG] osdmap e325: 8 total, 8 up, 8 in 2021-07-26T16:01:45.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:45 smithi033 bash[42377]: audit 2021-07-26T16:01:44.512579+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:45.911 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:45 smithi096 systemd[1]: Stopping Ceph osd.6 for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T16:01:45.912 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:45 smithi096 docker[37723]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:45.912 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:45 smithi096 bash[23105]: debug 2021-07-26T16:01:45.683+0000 7f3dfd349700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-07-26T16:01:45.912 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:45 smithi096 bash[23105]: debug 2021-07-26T16:01:45.683+0000 7f3dfd349700 -1 osd.6 326 *** Got signal Terminated *** 2021-07-26T16:01:45.913 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:45 smithi096 bash[23105]: debug 2021-07-26T16:01:45.683+0000 7f3dfd349700 -1 osd.6 326 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:01:46.310 INFO:tasks.rados.rados.0.smithi033.stdout:1342: finishing write tid 6 to smithi03339061-20 2021-07-26T16:01:46.310 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 500 (ObjNum 414 snap 131 seq_num 414) dirty exists 2021-07-26T16:01:46.311 INFO:tasks.rados.rados.0.smithi033.stdout:1342: left oid 20 (ObjNum 414 snap 131 seq_num 414) 2021-07-26T16:01:46.311 INFO:tasks.rados.rados.0.smithi033.stdout:1342: done (1 left) 2021-07-26T16:01:46.311 INFO:tasks.rados.rados.0.smithi033.stdout:1344: done (0 left) 2021-07-26T16:01:46.311 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 131 2021-07-26T16:01:46.311 INFO:tasks.rados.rados.0.smithi033.stdout:1345: seq_num 416 ranges {9895936=573440,10469376=573440,11042816=475136,11517952=557056} 2021-07-26T16:01:46.369 INFO:tasks.rados.rados.0.smithi033.stdout:1345: writing smithi03339061-32 from 9895936 to 10469376 tid 1 2021-07-26T16:01:46.372 INFO:tasks.rados.rados.0.smithi033.stdout:1345: writing smithi03339061-32 from 10469376 to 11042816 tid 2 2021-07-26T16:01:46.375 INFO:tasks.rados.rados.0.smithi033.stdout:1345: writing smithi03339061-32 from 11042816 to 11517952 tid 3 2021-07-26T16:01:46.379 INFO:tasks.rados.rados.0.smithi033.stdout:1345: writing smithi03339061-32 from 11517952 to 12075008 tid 4 2021-07-26T16:01:46.379 INFO:tasks.rados.rados.0.smithi033.stdout:1345: finishing write tid 1 to smithi03339061-32 2021-07-26T16:01:46.379 INFO:tasks.rados.rados.0.smithi033.stdout:1346: read oid 23 snap -1 2021-07-26T16:01:46.379 INFO:tasks.rados.rados.0.smithi033.stdout:1346: expect (ObjNum 322 snap 104 seq_num 322) 2021-07-26T16:01:46.389 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 131 2021-07-26T16:01:46.389 INFO:tasks.rados.rados.0.smithi033.stdout:1347: seq_num 417 ranges {3907584=589824,4497408=458752,4956160=679936,5636096=466944} 2021-07-26T16:01:46.404 INFO:tasks.rados.rados.0.smithi033.stdout:1347: writing smithi03339061-41 from 3907584 to 4497408 tid 1 2021-07-26T16:01:46.407 INFO:tasks.rados.rados.0.smithi033.stdout:1347: writing smithi03339061-41 from 4497408 to 4956160 tid 2 2021-07-26T16:01:46.410 INFO:tasks.rados.rados.0.smithi033.stdout:1347: writing smithi03339061-41 from 4956160 to 5636096 tid 3 2021-07-26T16:01:46.413 INFO:tasks.rados.rados.0.smithi033.stdout:1347: writing smithi03339061-41 from 5636096 to 6103040 tid 4 2021-07-26T16:01:46.414 INFO:tasks.rados.rados.0.smithi033.stdout:1348: read oid 36 snap -1 2021-07-26T16:01:46.414 INFO:tasks.rados.rados.0.smithi033.stdout:1348: expect deleted 2021-07-26T16:01:46.414 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 131 2021-07-26T16:01:46.414 INFO:tasks.rados.rados.0.smithi033.stdout:1349: seq_num 418 ranges {6414336=606208,7020544=737280,7757824=434176,8192000=434176} 2021-07-26T16:01:46.453 INFO:tasks.rados.rados.0.smithi033.stdout:1349: writing smithi03339061-21 from 6414336 to 7020544 tid 1 2021-07-26T16:01:46.524 INFO:tasks.rados.rados.0.smithi033.stdout:1349: writing smithi03339061-21 from 7020544 to 7757824 tid 2 2021-07-26T16:01:46.524 INFO:tasks.rados.rados.0.smithi033.stdout:1349: writing smithi03339061-21 from 7757824 to 8192000 tid 3 2021-07-26T16:01:46.525 INFO:tasks.rados.rados.0.smithi033.stdout:1349: writing smithi03339061-21 from 8192000 to 8626176 tid 4 2021-07-26T16:01:46.525 INFO:tasks.rados.rados.0.smithi033.stdout:1350: setattr oid 20 current snap is 131 2021-07-26T16:01:46.525 INFO:tasks.rados.rados.0.smithi033.stdout:1345: finishing write tid 2 to smithi03339061-32 2021-07-26T16:01:46.525 INFO:tasks.rados.rados.0.smithi033.stdout:1345: finishing write tid 3 to smithi03339061-32 2021-07-26T16:01:46.526 INFO:tasks.rados.rados.0.smithi033.stdout:1345: finishing write tid 4 to smithi03339061-32 2021-07-26T16:01:46.526 INFO:tasks.rados.rados.0.smithi033.stdout:1345: finishing write tid 5 to smithi03339061-32 2021-07-26T16:01:46.526 INFO:tasks.rados.rados.0.smithi033.stdout:1345: finishing write tid 6 to smithi03339061-32 2021-07-26T16:01:46.527 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 338 (ObjNum 416 snap 131 seq_num 416) dirty exists 2021-07-26T16:01:46.527 INFO:tasks.rados.rados.0.smithi033.stdout:1345: left oid 32 (ObjNum 416 snap 131 seq_num 416) 2021-07-26T16:01:46.527 INFO:tasks.rados.rados.0.smithi033.stdout:1345: done (5 left) 2021-07-26T16:01:46.528 INFO:tasks.rados.rados.0.smithi033.stdout:1348: done (4 left) 2021-07-26T16:01:46.528 INFO:tasks.rados.rados.0.smithi033.stdout:1351: delete oid 3 current snap is 131 2021-07-26T16:01:46.564 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.025488+0000 mgr.y (mgr.34104) 198 : cluster [DBG] pgmap v290: 25 pgs: 25 active+clean; 181 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 465 KiB/s rd, 793 KiB/s wr, 2 op/s 2021-07-26T16:01:46.565 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.286050+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2021-07-26T16:01:46.565 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.956482+0000 mon.a (mon.0) 541 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-07-26T16:01:46.565 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.956686+0000 mon.a (mon.0) 542 : cluster [INF] osd.6 failed (root=default,host=smithi096) (connection refused reported by osd.7) 2021-07-26T16:01:46.565 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.957545+0000 mon.a (mon.0) 543 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-07-26T16:01:46.566 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.958139+0000 mon.a (mon.0) 544 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.566 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.958754+0000 mon.a (mon.0) 545 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-07-26T16:01:46.567 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.959549+0000 mon.a (mon.0) 546 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-07-26T16:01:46.567 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.960020+0000 mon.a (mon.0) 547 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-07-26T16:01:46.567 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.960290+0000 mon.a (mon.0) 548 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.567 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.960477+0000 mon.a (mon.0) 549 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-07-26T16:01:46.568 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.960740+0000 mon.a (mon.0) 550 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-07-26T16:01:46.568 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.960951+0000 mon.a (mon.0) 551 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-07-26T16:01:46.568 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.961398+0000 mon.a (mon.0) 552 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-07-26T16:01:46.568 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.961597+0000 mon.a (mon.0) 553 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-07-26T16:01:46.568 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.962046+0000 mon.a (mon.0) 554 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-07-26T16:01:46.569 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:45.962247+0000 mon.a (mon.0) 555 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-07-26T16:01:46.570 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:46.031098+0000 mon.a (mon.0) 556 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.570 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[33981]: cluster 2021-07-26T16:01:46.232194+0000 mon.a (mon.0) 557 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.025488+0000 mgr.y (mgr.34104) 198 : cluster [DBG] pgmap v290: 25 pgs: 25 active+clean; 181 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 465 KiB/s rd, 793 KiB/s wr, 2 op/s 2021-07-26T16:01:46.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.286050+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2021-07-26T16:01:46.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.956482+0000 mon.a (mon.0) 541 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-07-26T16:01:46.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.956686+0000 mon.a (mon.0) 542 : cluster [INF] osd.6 failed (root=default,host=smithi096) (connection refused reported by osd.7) 2021-07-26T16:01:46.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.957545+0000 mon.a (mon.0) 543 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-07-26T16:01:46.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.958139+0000 mon.a (mon.0) 544 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.958754+0000 mon.a (mon.0) 545 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-07-26T16:01:46.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.959549+0000 mon.a (mon.0) 546 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-07-26T16:01:46.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.960020+0000 mon.a (mon.0) 547 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-07-26T16:01:46.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.960290+0000 mon.a (mon.0) 548 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.960477+0000 mon.a (mon.0) 549 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-07-26T16:01:46.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.960740+0000 mon.a (mon.0) 550 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-07-26T16:01:46.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.960951+0000 mon.a (mon.0) 551 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-07-26T16:01:46.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.961398+0000 mon.a (mon.0) 552 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-07-26T16:01:46.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.961597+0000 mon.a (mon.0) 553 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-07-26T16:01:46.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.962046+0000 mon.a (mon.0) 554 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-07-26T16:01:46.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:45.962247+0000 mon.a (mon.0) 555 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-07-26T16:01:46.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:46.031098+0000 mon.a (mon.0) 556 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[42377]: cluster 2021-07-26T16:01:46.232194+0000 mon.a (mon.0) 557 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.714 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.025488+0000 mgr.y (mgr.34104) 198 : cluster [DBG] pgmap v290: 25 pgs: 25 active+clean; 181 MiB data, 685 MiB used, 715 GiB / 715 GiB avail; 465 KiB/s rd, 793 KiB/s wr, 2 op/s 2021-07-26T16:01:46.714 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.286050+0000 mon.a (mon.0) 540 : cluster [DBG] osdmap e326: 8 total, 8 up, 8 in 2021-07-26T16:01:46.714 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.956482+0000 mon.a (mon.0) 541 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-07-26T16:01:46.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.956686+0000 mon.a (mon.0) 542 : cluster [INF] osd.6 failed (root=default,host=smithi096) (connection refused reported by osd.7) 2021-07-26T16:01:46.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.957545+0000 mon.a (mon.0) 543 : cluster [DBG] osd.6 reported immediately failed by osd.7 2021-07-26T16:01:46.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.958139+0000 mon.a (mon.0) 544 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.958754+0000 mon.a (mon.0) 545 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-07-26T16:01:46.715 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.959549+0000 mon.a (mon.0) 546 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-07-26T16:01:46.716 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.960020+0000 mon.a (mon.0) 547 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-07-26T16:01:46.716 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.960290+0000 mon.a (mon.0) 548 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.716 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.960477+0000 mon.a (mon.0) 549 : cluster [DBG] osd.6 reported immediately failed by osd.2 2021-07-26T16:01:46.716 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.960740+0000 mon.a (mon.0) 550 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-07-26T16:01:46.717 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.960951+0000 mon.a (mon.0) 551 : cluster [DBG] osd.6 reported immediately failed by osd.5 2021-07-26T16:01:46.717 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.961398+0000 mon.a (mon.0) 552 : cluster [DBG] osd.6 reported immediately failed by osd.0 2021-07-26T16:01:46.717 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.961597+0000 mon.a (mon.0) 553 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-07-26T16:01:46.717 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.962046+0000 mon.a (mon.0) 554 : cluster [DBG] osd.6 reported immediately failed by osd.3 2021-07-26T16:01:46.718 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:45.962247+0000 mon.a (mon.0) 555 : cluster [DBG] osd.6 reported immediately failed by osd.4 2021-07-26T16:01:46.718 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:46.031098+0000 mon.a (mon.0) 556 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.718 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:46 smithi033 bash[41341]: cluster 2021-07-26T16:01:46.232194+0000 mon.a (mon.0) 557 : cluster [DBG] osd.6 reported immediately failed by osd.1 2021-07-26T16:01:46.985 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:46 smithi096 docker[37723]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-osd.6 2021-07-26T16:01:46.986 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:46 smithi096 bash[37771]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:47.323 INFO:tasks.rados.rados.0.smithi033.stdout:1351: done (4 left) 2021-07-26T16:01:47.323 INFO:tasks.rados.rados.0.smithi033.stdout:1352: rollback oid 45 current snap is 131 2021-07-26T16:01:47.323 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 45 to 122 2021-07-26T16:01:47.324 INFO:tasks.rados.rados.0.smithi033.stdout:1353: delete oid 3 current snap is 131 2021-07-26T16:01:47.326 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 501 (ObjNum 414 snap 131 seq_num 414) dirty exists 2021-07-26T16:01:47.327 INFO:tasks.rados.rados.0.smithi033.stdout:1350: done (5 left) 2021-07-26T16:01:47.327 INFO:tasks.rados.rados.0.smithi033.stdout:1353: done (4 left) 2021-07-26T16:01:47.327 INFO:tasks.rados.rados.0.smithi033.stdout:1354: delete oid 19 current snap is 131 2021-07-26T16:01:47.328 INFO:tasks.rados.rados.0.smithi033.stdout:1352: finishing rollback tid 1 to smithi03339061-45 2021-07-26T16:01:47.328 INFO:tasks.rados.rados.0.smithi033.stdout:1352: finishing rollback tid 2 to smithi03339061-45 2021-07-26T16:01:47.328 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 762 (ObjNum 281 snap 86 seq_num 281) dirty exists 2021-07-26T16:01:47.329 INFO:tasks.rados.rados.0.smithi033.stdout:1347: finishing write tid 1 to smithi03339061-41 2021-07-26T16:01:47.331 INFO:tasks.rados.rados.0.smithi033.stdout:1352: done (4 left) 2021-07-26T16:01:47.331 INFO:tasks.rados.rados.0.smithi033.stdout:1354: done (3 left) 2021-07-26T16:01:47.332 INFO:tasks.rados.rados.0.smithi033.stdout:1347: finishing write tid 2 to smithi03339061-41 2021-07-26T16:01:47.332 INFO:tasks.rados.rados.0.smithi033.stdout:1355: read oid 6 snap -1 2021-07-26T16:01:47.332 INFO:tasks.rados.rados.0.smithi033.stdout:1355: expect deleted 2021-07-26T16:01:47.332 INFO:tasks.rados.rados.0.smithi033.stdout:1356: setattr oid 3 current snap is 131 2021-07-26T16:01:47.333 INFO:tasks.rados.rados.0.smithi033.stdout:1347: finishing write tid 3 to smithi03339061-41 2021-07-26T16:01:47.333 INFO:tasks.rados.rados.0.smithi033.stdout:1357: snap_remove snap 129 2021-07-26T16:01:47.657 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:47 smithi096 bash[33981]: cluster 2021-07-26T16:01:46.290063+0000 mon.a (mon.0) 558 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:01:47.657 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:47 smithi096 bash[33981]: cluster 2021-07-26T16:01:46.305278+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e327: 8 total, 7 up, 8 in 2021-07-26T16:01:47.703 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T16:01:47.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:47 smithi033 bash[41341]: cluster 2021-07-26T16:01:46.290063+0000 mon.a (mon.0) 558 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:01:47.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:47 smithi033 bash[41341]: cluster 2021-07-26T16:01:46.305278+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e327: 8 total, 7 up, 8 in 2021-07-26T16:01:47.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:47 smithi033 bash[42377]: cluster 2021-07-26T16:01:46.290063+0000 mon.a (mon.0) 558 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:01:47.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:47 smithi033 bash[42377]: cluster 2021-07-26T16:01:46.305278+0000 mon.a (mon.0) 559 : cluster [DBG] osdmap e327: 8 total, 7 up, 8 in 2021-07-26T16:01:48.034 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T16:01:48.034 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (8m) 59s ago 8m 15.1M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T16:01:48.034 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (8m) 22s ago 8m 25.7M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T16:01:48.034 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (4m) 22s ago 13m 373M - 17.0.0-6381-gbccf07c2 6cdb40438e66 909ec99bd712 2021-07-26T16:01:48.035 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (4m) 59s ago 15m 416M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T16:01:48.035 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (3m) 59s ago 15m 50.6M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 7649338580a7 2021-07-26T16:01:48.035 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (3m) 22s ago 13m 40.4M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 5a3d2fea4cb3 2021-07-26T16:01:48.035 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (3m) 59s ago 13m 42.9M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 76ce8786552e 2021-07-26T16:01:48.035 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (9m) 59s ago 9m 11.2M - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T16:01:48.036 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (9m) 22s ago 9m 11.9M - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T16:01:48.036 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (2m) 59s ago 12m 123M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 7275343c45f7 2021-07-26T16:01:48.036 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (117s) 59s ago 12m 116M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 778afc05022e 2021-07-26T16:01:48.036 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (89s) 59s ago 11m 99.6M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 e78ad82b00b5 2021-07-26T16:01:48.037 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (60s) 59s ago 11m - 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 315a7c006da7 2021-07-26T16:01:48.037 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (32s) 22s ago 10m 150M 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 545d7f10ed9e 2021-07-26T16:01:48.037 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (24s) 22s ago 10m - 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 1c135b673521 2021-07-26T16:01:48.037 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (10m) 22s ago 10m 159M 3552M 16.2.5 34f74fddb18e 4fad5a8407d4 2021-07-26T16:01:48.037 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (9m) 22s ago 9m 137M 3552M 16.2.5 34f74fddb18e a988c60ad3d5 2021-07-26T16:01:48.038 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (8m) 22s ago 9m 39.5M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T16:01:48.329 INFO:tasks.rados.rados.0.smithi033.stdout:1346: expect (ObjNum 322 snap 104 seq_num 322) 2021-07-26T16:01:48.349 INFO:tasks.rados.rados.0.smithi033.stdout:1347: finishing write tid 4 to smithi03339061-41 2021-07-26T16:01:48.349 INFO:tasks.rados.rados.0.smithi033.stdout:1347: finishing write tid 5 to smithi03339061-41 2021-07-26T16:01:48.349 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 245 (ObjNum 2007108608 snap 22002 seq_num 2006515264) dirty exists 2021-07-26T16:01:48.349 INFO:tasks.rados.rados.0.smithi033.stdout:1347: finishing write tid 6 to smithi03339061-41 2021-07-26T16:01:48.350 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 494 (ObjNum 417 snap 131 seq_num 417) dirty exists 2021-07-26T16:01:48.350 INFO:tasks.rados.rados.0.smithi033.stdout:1347: left oid 41 (ObjNum 417 snap 131 seq_num 417) 2021-07-26T16:01:48.350 INFO:tasks.rados.rados.0.smithi033.stdout:1349: finishing write tid 1 to smithi03339061-21 2021-07-26T16:01:48.351 INFO:tasks.rados.rados.0.smithi033.stdout:1346: done (5 left) 2021-07-26T16:01:48.351 INFO:tasks.rados.rados.0.smithi033.stdout:1347: done (4 left) 2021-07-26T16:01:48.351 INFO:tasks.rados.rados.0.smithi033.stdout:1355: done (3 left) 2021-07-26T16:01:48.351 INFO:tasks.rados.rados.0.smithi033.stdout:1356: done (2 left) 2021-07-26T16:01:48.352 INFO:tasks.rados.rados.0.smithi033.stdout:1357: done (1 left) 2021-07-26T16:01:48.352 INFO:tasks.rados.rados.0.smithi033.stdout:1358: read oid 41 snap -1 2021-07-26T16:01:48.352 INFO:tasks.rados.rados.0.smithi033.stdout:1358: expect (ObjNum 417 snap 131 seq_num 417) 2021-07-26T16:01:48.352 INFO:tasks.rados.rados.0.smithi033.stdout:1359: rmattr oid 42 current snap is 131 2021-07-26T16:01:48.352 INFO:tasks.rados.rados.0.smithi033.stdout:1349: finishing write tid 2 to smithi03339061-21 2021-07-26T16:01:48.353 INFO:tasks.rados.rados.0.smithi033.stdout:1349: finishing write tid 3 to smithi03339061-21 2021-07-26T16:01:48.353 INFO:tasks.rados.rados.0.smithi033.stdout:1349: finishing write tid 4 to smithi03339061-21 2021-07-26T16:01:48.353 INFO:tasks.rados.rados.0.smithi033.stdout:1349: finishing write tid 5 to smithi03339061-21 2021-07-26T16:01:48.354 INFO:tasks.rados.rados.0.smithi033.stdout:1349: finishing write tid 6 to smithi03339061-21 2021-07-26T16:01:48.354 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 598 (ObjNum 418 snap 131 seq_num 418) dirty exists 2021-07-26T16:01:48.354 INFO:tasks.rados.rados.0.smithi033.stdout:1349: left oid 21 (ObjNum 418 snap 131 seq_num 418) 2021-07-26T16:01:48.354 INFO:tasks.rados.rados.0.smithi033.stdout:1349: done (2 left) 2021-07-26T16:01:48.355 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 131 2021-07-26T16:01:48.355 INFO:tasks.rados.rados.0.smithi033.stdout:1360: seq_num 422 ranges {2433024=671744,3104768=729088,3833856=417792,4251648=458752} 2021-07-26T16:01:48.369 INFO:tasks.rados.rados.0.smithi033.stdout:1360: writing smithi03339061-35 from 2433024 to 3104768 tid 1 2021-07-26T16:01:48.374 INFO:tasks.rados.rados.0.smithi033.stdout:1360: writing smithi03339061-35 from 3104768 to 3833856 tid 2 2021-07-26T16:01:48.376 INFO:tasks.rados.rados.0.smithi033.stdout:1360: writing smithi03339061-35 from 3833856 to 4251648 tid 3 2021-07-26T16:01:48.379 INFO:tasks.rados.rados.0.smithi033.stdout:1360: writing smithi03339061-35 from 4251648 to 4710400 tid 4 2021-07-26T16:01:48.380 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 131 2021-07-26T16:01:48.380 INFO:tasks.rados.rados.0.smithi033.stdout:1361: seq_num 423 ranges {5832704=688128,6520832=614400,7135232=622592,7757824=368640} 2021-07-26T16:01:48.417 INFO:tasks.rados.rados.0.smithi033.stdout:1361: writing smithi03339061-47 from 5832704 to 6520832 tid 1 2021-07-26T16:01:48.419 INFO:tasks.rados.rados.0.smithi033.stdout:1361: writing smithi03339061-47 from 6520832 to 7135232 tid 2 2021-07-26T16:01:48.423 INFO:tasks.rados.rados.0.smithi033.stdout:1361: writing smithi03339061-47 from 7135232 to 7757824 tid 3 2021-07-26T16:01:48.426 INFO:tasks.rados.rados.0.smithi033.stdout:1361: writing smithi03339061-47 from 7757824 to 8126464 tid 4 2021-07-26T16:01:48.426 INFO:tasks.rados.rados.0.smithi033.stdout:1362: snap_create 2021-07-26T16:01:48.426 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 246 (ObjNum 379 snap 118 seq_num 379) dirty exists 2021-07-26T16:01:48.426 INFO:tasks.rados.rados.0.smithi033.stdout:1360: finishing write tid 1 to smithi03339061-35 2021-07-26T16:01:48.427 INFO:tasks.rados.rados.0.smithi033.stdout:1358: expect (ObjNum 417 snap 131 seq_num 417) 2021-07-26T16:01:48.455 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T16:01:48.455 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T16:01:48.455 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T16:01:48.455 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:01:48.456 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T16:01:48.456 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T16:01:48.456 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:01:48.456 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T16:01:48.457 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 1, 2021-07-26T16:01:48.457 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 6 2021-07-26T16:01:48.457 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:01:48.457 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T16:01:48.457 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T16:01:48.458 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 16.2.5 (0883bdea7337b95e4b611c768c0279868462204a) pacific (stable)": 1, 2021-07-26T16:01:48.458 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 11 2021-07-26T16:01:48.458 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T16:01:48.458 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T16:01:48.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:48 smithi096 bash[33981]: cluster 2021-07-26T16:01:47.026182+0000 mgr.y (mgr.34104) 199 : cluster [DBG] pgmap v293: 25 pgs: 2 stale+active+clean, 23 active+clean; 183 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 620 KiB/s rd, 1.4 MiB/s wr, 4 op/s 2021-07-26T16:01:48.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:48 smithi096 bash[33981]: cluster 2021-07-26T16:01:47.312526+0000 mon.a (mon.0) 560 : cluster [DBG] osdmap e328: 8 total, 7 up, 8 in 2021-07-26T16:01:48.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:48 smithi033 bash[41341]: cluster 2021-07-26T16:01:47.026182+0000 mgr.y (mgr.34104) 199 : cluster [DBG] pgmap v293: 25 pgs: 2 stale+active+clean, 23 active+clean; 183 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 620 KiB/s rd, 1.4 MiB/s wr, 4 op/s 2021-07-26T16:01:48.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:48 smithi033 bash[41341]: cluster 2021-07-26T16:01:47.312526+0000 mon.a (mon.0) 560 : cluster [DBG] osdmap e328: 8 total, 7 up, 8 in 2021-07-26T16:01:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:48 smithi033 bash[42377]: cluster 2021-07-26T16:01:47.026182+0000 mgr.y (mgr.34104) 199 : cluster [DBG] pgmap v293: 25 pgs: 2 stale+active+clean, 23 active+clean; 183 MiB data, 688 MiB used, 715 GiB / 715 GiB avail; 620 KiB/s rd, 1.4 MiB/s wr, 4 op/s 2021-07-26T16:01:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:48 smithi033 bash[42377]: cluster 2021-07-26T16:01:47.312526+0000 mon.a (mon.0) 560 : cluster [DBG] osdmap e328: 8 total, 7 up, 8 in 2021-07-26T16:01:48.710 INFO:tasks.rados.rados.0.smithi033.stdout:1360: finishing write tid 2 to smithi03339061-35 2021-07-26T16:01:48.712 INFO:tasks.rados.rados.0.smithi033.stdout:1360: finishing write tid 3 to smithi03339061-35 2021-07-26T16:01:48.712 INFO:tasks.rados.rados.0.smithi033.stdout:1360: finishing write tid 4 to smithi03339061-35 2021-07-26T16:01:48.712 INFO:tasks.rados.rados.0.smithi033.stdout:1360: finishing write tid 5 to smithi03339061-35 2021-07-26T16:01:48.712 INFO:tasks.rados.rados.0.smithi033.stdout:1360: finishing write tid 6 to smithi03339061-35 2021-07-26T16:01:48.713 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 450 (ObjNum 422 snap 131 seq_num 422) dirty exists 2021-07-26T16:01:48.713 INFO:tasks.rados.rados.0.smithi033.stdout:1360: left oid 35 (ObjNum 422 snap 131 seq_num 422) 2021-07-26T16:01:48.713 INFO:tasks.rados.rados.0.smithi033.stdout:1361: finishing write tid 1 to smithi03339061-47 2021-07-26T16:01:48.713 INFO:tasks.rados.rados.0.smithi033.stdout:1361: finishing write tid 2 to smithi03339061-47 2021-07-26T16:01:48.714 INFO:tasks.rados.rados.0.smithi033.stdout:1361: finishing write tid 3 to smithi03339061-47 2021-07-26T16:01:48.714 INFO:tasks.rados.rados.0.smithi033.stdout:1361: finishing write tid 4 to smithi03339061-47 2021-07-26T16:01:48.714 INFO:tasks.rados.rados.0.smithi033.stdout:1361: finishing write tid 5 to smithi03339061-47 2021-07-26T16:01:48.714 INFO:tasks.rados.rados.0.smithi033.stdout:1361: finishing write tid 6 to smithi03339061-47 2021-07-26T16:01:48.715 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 642 (ObjNum 423 snap 131 seq_num 423) dirty exists 2021-07-26T16:01:48.715 INFO:tasks.rados.rados.0.smithi033.stdout:1361: left oid 47 (ObjNum 423 snap 131 seq_num 423) 2021-07-26T16:01:49.099 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:48 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.6.service: Succeeded. 2021-07-26T16:01:49.099 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:48 smithi096 systemd[1]: Stopped Ceph osd.6 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:01:49.099 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:49 smithi096 systemd[1]: Started Ceph osd.6 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:01:49.339 INFO:tasks.rados.rados.0.smithi033.stdout:1358: done (4 left) 2021-07-26T16:01:49.340 INFO:tasks.rados.rados.0.smithi033.stdout:1359: done (3 left) 2021-07-26T16:01:49.340 INFO:tasks.rados.rados.0.smithi033.stdout:1360: done (2 left) 2021-07-26T16:01:49.340 INFO:tasks.rados.rados.0.smithi033.stdout:1361: done (1 left) 2021-07-26T16:01:49.340 INFO:tasks.rados.rados.0.smithi033.stdout:1362: done (0 left) 2021-07-26T16:01:49.341 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 132 2021-07-26T16:01:49.341 INFO:tasks.rados.rados.0.smithi033.stdout:1363: seq_num 424 ranges {2433024=704512,3137536=491520,3629056=434176,4063232=679936} 2021-07-26T16:01:49.357 INFO:tasks.rados.rados.0.smithi033.stdout:1363: writing smithi03339061-9 from 2433024 to 3137536 tid 1 2021-07-26T16:01:49.366 INFO:tasks.rados.rados.0.smithi033.stdout:1363: writing smithi03339061-9 from 3137536 to 3629056 tid 2 2021-07-26T16:01:49.367 INFO:tasks.rados.rados.0.smithi033.stdout:1363: writing smithi03339061-9 from 3629056 to 4063232 tid 3 2021-07-26T16:01:49.367 INFO:tasks.rados.rados.0.smithi033.stdout:1363: writing smithi03339061-9 from 4063232 to 4743168 tid 4 2021-07-26T16:01:49.369 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 132 2021-07-26T16:01:49.369 INFO:tasks.rados.rados.0.smithi033.stdout:1364: seq_num 425 ranges {3678208=720896,4399104=778240,5177344=638976,5816320=188416} 2021-07-26T16:01:49.392 INFO:tasks.rados.rados.0.smithi033.stdout:1364: writing smithi03339061-10 from 3678208 to 4399104 tid 1 2021-07-26T16:01:49.396 INFO:tasks.rados.rados.0.smithi033.stdout:1364: writing smithi03339061-10 from 4399104 to 5177344 tid 2 2021-07-26T16:01:49.400 INFO:tasks.rados.rados.0.smithi033.stdout:1364: writing smithi03339061-10 from 5177344 to 5816320 tid 3 2021-07-26T16:01:49.402 INFO:tasks.rados.rados.0.smithi033.stdout:1364: writing smithi03339061-10 from 5816320 to 6004736 tid 4 2021-07-26T16:01:49.402 INFO:tasks.rados.rados.0.smithi033.stdout:1365: copy_from oid 6 from oid 7 current snap is 132 2021-07-26T16:01:49.403 INFO:tasks.rados.rados.0.smithi033.stdout:1363: finishing write tid 1 to smithi03339061-9 2021-07-26T16:01:49.403 INFO:tasks.rados.rados.0.smithi033.stdout:1363: finishing write tid 2 to smithi03339061-9 2021-07-26T16:01:49.403 INFO:tasks.rados.rados.0.smithi033.stdout:1363: finishing write tid 3 to smithi03339061-9 2021-07-26T16:01:49.403 INFO:tasks.rados.rados.0.smithi033.stdout:1363: finishing write tid 4 to smithi03339061-9 2021-07-26T16:01:49.404 INFO:tasks.rados.rados.0.smithi033.stdout:1363: finishing write tid 5 to smithi03339061-9 2021-07-26T16:01:49.404 INFO:tasks.rados.rados.0.smithi033.stdout:1363: finishing write tid 6 to smithi03339061-9 2021-07-26T16:01:49.404 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 456 (ObjNum 424 snap 132 seq_num 424) dirty exists 2021-07-26T16:01:49.404 INFO:tasks.rados.rados.0.smithi033.stdout:1363: left oid 9 (ObjNum 424 snap 132 seq_num 424) 2021-07-26T16:01:49.404 INFO:tasks.rados.rados.0.smithi033.stdout:1364: finishing write tid 1 to smithi03339061-10 2021-07-26T16:01:49.405 INFO:tasks.rados.rados.0.smithi033.stdout:1363: done (2 left) 2021-07-26T16:01:49.405 INFO:tasks.rados.rados.0.smithi033.stdout:1366: rmattr oid 50 current snap is 132 2021-07-26T16:01:49.405 INFO:tasks.rados.rados.0.smithi033.stdout:1366: done (2 left) 2021-07-26T16:01:49.405 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 132 2021-07-26T16:01:49.405 INFO:tasks.rados.rados.0.smithi033.stdout:1367: seq_num 426 ranges {5996544=737280,6733824=712704,7446528=802816,8249344=90112} 2021-07-26T16:01:49.440 INFO:tasks.rados.rados.0.smithi033.stdout:1367: writing smithi03339061-38 from 5996544 to 6733824 tid 1 2021-07-26T16:01:49.444 INFO:tasks.rados.rados.0.smithi033.stdout:1367: writing smithi03339061-38 from 6733824 to 7446528 tid 2 2021-07-26T16:01:49.449 INFO:tasks.rados.rados.0.smithi033.stdout:1367: writing smithi03339061-38 from 7446528 to 8249344 tid 3 2021-07-26T16:01:49.450 INFO:tasks.rados.rados.0.smithi033.stdout:1367: writing smithi03339061-38 from 8249344 to 8339456 tid 4 2021-07-26T16:01:49.450 INFO:tasks.rados.rados.0.smithi033.stdout:1368: delete oid 18 current snap is 132 2021-07-26T16:01:49.451 INFO:tasks.rados.rados.0.smithi033.stdout:1364: finishing write tid 2 to smithi03339061-10 2021-07-26T16:01:49.451 INFO:tasks.rados.rados.0.smithi033.stdout:1364: finishing write tid 3 to smithi03339061-10 2021-07-26T16:01:49.451 INFO:tasks.rados.rados.0.smithi033.stdout:1364: finishing write tid 4 to smithi03339061-10 2021-07-26T16:01:49.451 INFO:tasks.rados.rados.0.smithi033.stdout:1364: finishing write tid 5 to smithi03339061-10 2021-07-26T16:01:49.452 INFO:tasks.rados.rados.0.smithi033.stdout:1364: finishing write tid 6 to smithi03339061-10 2021-07-26T16:01:49.452 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 648 (ObjNum 425 snap 132 seq_num 425) dirty exists 2021-07-26T16:01:49.452 INFO:tasks.rados.rados.0.smithi033.stdout:1364: left oid 10 (ObjNum 425 snap 132 seq_num 425) 2021-07-26T16:01:49.452 INFO:tasks.rados.rados.0.smithi033.stdout:1365: finishing copy_from to smithi03339061-6 2021-07-26T16:01:49.453 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 568 (ObjNum 389 snap 119 seq_num 389) dirty exists 2021-07-26T16:01:49.453 INFO:tasks.rados.rados.0.smithi033.stdout:1365: finishing copy_from racing read to smithi03339061-6 2021-07-26T16:01:49.453 INFO:tasks.rados.rados.0.smithi033.stdout:1367: finishing write tid 1 to smithi03339061-38 2021-07-26T16:01:49.453 INFO:tasks.rados.rados.0.smithi033.stdout:1367: finishing write tid 2 to smithi03339061-38 2021-07-26T16:01:49.454 INFO:tasks.rados.rados.0.smithi033.stdout:1364: done (3 left) 2021-07-26T16:01:49.455 INFO:tasks.rados.rados.0.smithi033.stdout:1365: done (2 left) 2021-07-26T16:01:49.455 INFO:tasks.rados.rados.0.smithi033.stdout:1368: done (1 left) 2021-07-26T16:01:49.455 INFO:tasks.rados.rados.0.smithi033.stdout:1369: read oid 11 snap -1 2021-07-26T16:01:49.455 INFO:tasks.rados.rados.0.smithi033.stdout:1369: expect (ObjNum 366 snap 117 seq_num 366) 2021-07-26T16:01:49.455 INFO:tasks.rados.rados.0.smithi033.stdout:1370: snap_create 2021-07-26T16:01:49.456 INFO:tasks.rados.rados.0.smithi033.stdout:1367: finishing write tid 3 to smithi03339061-38 2021-07-26T16:01:49.456 INFO:tasks.rados.rados.0.smithi033.stdout:1367: finishing write tid 4 to smithi03339061-38 2021-07-26T16:01:49.457 INFO:tasks.rados.rados.0.smithi033.stdout:1367: finishing write tid 5 to smithi03339061-38 2021-07-26T16:01:49.457 INFO:tasks.rados.rados.0.smithi033.stdout:1367: finishing write tid 6 to smithi03339061-38 2021-07-26T16:01:49.457 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 429 (ObjNum 426 snap 132 seq_num 426) dirty exists 2021-07-26T16:01:49.457 INFO:tasks.rados.rados.0.smithi033.stdout:1367: left oid 38 (ObjNum 426 snap 132 seq_num 426) 2021-07-26T16:01:49.487 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:49 smithi096 bash[37883]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:49.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:49 smithi096 bash[33981]: audit 2021-07-26T16:01:47.685249+0000 mgr.y (mgr.34104) 200 : audit [DBG] from='client.34293 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:49.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:49 smithi096 bash[33981]: audit 2021-07-26T16:01:48.012195+0000 mgr.y (mgr.34104) 201 : audit [DBG] from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:49.491 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:49 smithi096 bash[33981]: cluster 2021-07-26T16:01:48.323138+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e329: 8 total, 7 up, 8 in 2021-07-26T16:01:49.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:49 smithi096 bash[33981]: audit 2021-07-26T16:01:48.452170+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.15.33:0/1732559683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:49.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:49 smithi096 bash[33981]: audit 2021-07-26T16:01:49.058530+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:49.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:49 smithi096 bash[33981]: audit 2021-07-26T16:01:49.061528+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:49.492 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:49 smithi096 bash[33981]: audit 2021-07-26T16:01:49.064325+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:01:49.493 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:49 smithi096 bash[33981]: audit 2021-07-26T16:01:49.065961+0000 mon.c (mon.1) 100 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:01:49.495 INFO:tasks.rados.rados.0.smithi033.stdout:1369: expect (ObjNum 366 snap 117 seq_num 366) 2021-07-26T16:01:49.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[41341]: audit 2021-07-26T16:01:47.685249+0000 mgr.y (mgr.34104) 200 : audit [DBG] from='client.34293 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:49.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[41341]: audit 2021-07-26T16:01:48.012195+0000 mgr.y (mgr.34104) 201 : audit [DBG] from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:49.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[41341]: cluster 2021-07-26T16:01:48.323138+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e329: 8 total, 7 up, 8 in 2021-07-26T16:01:49.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[41341]: audit 2021-07-26T16:01:48.452170+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.15.33:0/1732559683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:49.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[41341]: audit 2021-07-26T16:01:49.058530+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:49.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[41341]: audit 2021-07-26T16:01:49.061528+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:49.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[41341]: audit 2021-07-26T16:01:49.064325+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:01:49.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[41341]: audit 2021-07-26T16:01:49.065961+0000 mon.c (mon.1) 100 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:01:49.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[42377]: audit 2021-07-26T16:01:47.685249+0000 mgr.y (mgr.34104) 200 : audit [DBG] from='client.34293 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:49.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[42377]: audit 2021-07-26T16:01:48.012195+0000 mgr.y (mgr.34104) 201 : audit [DBG] from='client.34299 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:01:49.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[42377]: cluster 2021-07-26T16:01:48.323138+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e329: 8 total, 7 up, 8 in 2021-07-26T16:01:49.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[42377]: audit 2021-07-26T16:01:48.452170+0000 mon.a (mon.0) 562 : audit [DBG] from='client.? 172.21.15.33:0/1732559683' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:49.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[42377]: audit 2021-07-26T16:01:49.058530+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:49.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[42377]: audit 2021-07-26T16:01:49.061528+0000 mon.c (mon.1) 98 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:49.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[42377]: audit 2021-07-26T16:01:49.064325+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:01:49.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:49 smithi033 bash[42377]: audit 2021-07-26T16:01:49.065961+0000 mon.c (mon.1) 100 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:01:50.347 INFO:tasks.rados.rados.0.smithi033.stdout:1367: done (2 left) 2021-07-26T16:01:50.348 INFO:tasks.rados.rados.0.smithi033.stdout:1369: done (1 left) 2021-07-26T16:01:50.348 INFO:tasks.rados.rados.0.smithi033.stdout:1370: done (0 left) 2021-07-26T16:01:50.348 INFO:tasks.rados.rados.0.smithi033.stdout:1371: delete oid 24 current snap is 133 2021-07-26T16:01:50.350 INFO:tasks.rados.rados.0.smithi033.stdout:1371: done (0 left) 2021-07-26T16:01:50.351 INFO:tasks.rados.rados.0.smithi033.stdout:1372: snap_create 2021-07-26T16:01:50.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:50 smithi033 bash[41341]: cluster 2021-07-26T16:01:49.026954+0000 mgr.y (mgr.34104) 202 : cluster [DBG] pgmap v296: 25 pgs: 1 active+undersized+degraded, 2 stale+active+clean, 22 active+clean; 187 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 439 KiB/s rd, 1.0 MiB/s wr, 5 op/s; 9/225 objects degraded (4.000%) 2021-07-26T16:01:50.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:50 smithi033 bash[41341]: cluster 2021-07-26T16:01:49.318166+0000 mon.a (mon.0) 564 : cluster [WRN] Health check failed: Degraded data redundancy: 9/225 objects degraded (4.000%), 1 pg degraded (PG_DEGRADED) 2021-07-26T16:01:50.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:50 smithi033 bash[41341]: cluster 2021-07-26T16:01:49.336298+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e330: 8 total, 7 up, 8 in 2021-07-26T16:01:50.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:50 smithi033 bash[42377]: cluster 2021-07-26T16:01:49.026954+0000 mgr.y (mgr.34104) 202 : cluster [DBG] pgmap v296: 25 pgs: 1 active+undersized+degraded, 2 stale+active+clean, 22 active+clean; 187 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 439 KiB/s rd, 1.0 MiB/s wr, 5 op/s; 9/225 objects degraded (4.000%) 2021-07-26T16:01:50.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:50 smithi033 bash[42377]: cluster 2021-07-26T16:01:49.318166+0000 mon.a (mon.0) 564 : cluster [WRN] Health check failed: Degraded data redundancy: 9/225 objects degraded (4.000%), 1 pg degraded (PG_DEGRADED) 2021-07-26T16:01:50.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:50 smithi033 bash[42377]: cluster 2021-07-26T16:01:49.336298+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e330: 8 total, 7 up, 8 in 2021-07-26T16:01:50.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:50 smithi096 bash[33981]: cluster 2021-07-26T16:01:49.026954+0000 mgr.y (mgr.34104) 202 : cluster [DBG] pgmap v296: 25 pgs: 1 active+undersized+degraded, 2 stale+active+clean, 22 active+clean; 187 MiB data, 696 MiB used, 715 GiB / 715 GiB avail; 439 KiB/s rd, 1.0 MiB/s wr, 5 op/s; 9/225 objects degraded (4.000%) 2021-07-26T16:01:50.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:50 smithi096 bash[33981]: cluster 2021-07-26T16:01:49.318166+0000 mon.a (mon.0) 564 : cluster [WRN] Health check failed: Degraded data redundancy: 9/225 objects degraded (4.000%), 1 pg degraded (PG_DEGRADED) 2021-07-26T16:01:50.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:50 smithi096 bash[33981]: cluster 2021-07-26T16:01:49.336298+0000 mon.a (mon.0) 565 : cluster [DBG] osdmap e330: 8 total, 7 up, 8 in 2021-07-26T16:01:51.235 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:50 smithi096 bash[37883]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-07-26T16:01:51.236 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:50 smithi096 bash[37883]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-07-26T16:01:51.236 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:50 smithi096 bash[37883]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-07-26T16:01:51.236 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:50 smithi096 bash[37883]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-07-26T16:01:51.237 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:50 smithi096 bash[37883]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-07-26T16:01:51.237 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:50 smithi096 bash[37883]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-07-26T16:01:51.237 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:50 smithi096 bash[37883]: --> ceph-volume lvm activate successful for osd ID: 6 2021-07-26T16:01:51.352 INFO:tasks.rados.rados.0.smithi033.stdout:1372: done (0 left) 2021-07-26T16:01:51.352 INFO:tasks.rados.rados.0.smithi033.stdout:1373: snap_remove snap 122 2021-07-26T16:01:51.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:51 smithi033 bash[41341]: cluster 2021-07-26T16:01:50.340353+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e331: 8 total, 7 up, 8 in 2021-07-26T16:01:51.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:51 smithi033 bash[42377]: cluster 2021-07-26T16:01:50.340353+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e331: 8 total, 7 up, 8 in 2021-07-26T16:01:51.735 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:51 smithi096 bash[37997]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:01:51.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:51 smithi096 bash[33981]: cluster 2021-07-26T16:01:50.340353+0000 mon.a (mon.0) 566 : cluster [DBG] osdmap e331: 8 total, 7 up, 8 in 2021-07-26T16:01:52.368 INFO:tasks.rados.rados.0.smithi033.stdout:1373: done (0 left) 2021-07-26T16:01:52.369 INFO:tasks.rados.rados.0.smithi033.stdout:1374: snap_create 2021-07-26T16:01:52.485 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:01:52 smithi096 bash[25729]: debug 2021-07-26T16:01:52.355+0000 7fd5efe65700 -1 osd.7 pg_epoch: 333 pg[3.ds0( v 327'296 (0'0,327'296] local-lis/les=319/320 n=4 ec=57/57 lis/c=319/319 les/c/f=320/320/0 sis=319) [7,5,3]p7(0) r=0 lpr=319 crt=327'296 lcod 320'294 mlcod 320'294 active+clean+snaptrim trimq=[f4~1] ps=[f1~1,100~1,103~1]] removing snap head 2021-07-26T16:01:52.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:52 smithi096 bash[33981]: cluster 2021-07-26T16:01:51.027727+0000 mgr.y (mgr.34104) 203 : cluster [DBG] pgmap v299: 25 pgs: 3 active+undersized, 5 active+undersized+degraded, 1 stale+active+clean, 16 active+clean; 196 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 17 op/s; 34/237 objects degraded (14.346%) 2021-07-26T16:01:52.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:52 smithi096 bash[33981]: cluster 2021-07-26T16:01:51.348399+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e332: 8 total, 7 up, 8 in 2021-07-26T16:01:52.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:52 smithi033 bash[41341]: cluster 2021-07-26T16:01:51.027727+0000 mgr.y (mgr.34104) 203 : cluster [DBG] pgmap v299: 25 pgs: 3 active+undersized, 5 active+undersized+degraded, 1 stale+active+clean, 16 active+clean; 196 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 17 op/s; 34/237 objects degraded (14.346%) 2021-07-26T16:01:52.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:52 smithi033 bash[41341]: cluster 2021-07-26T16:01:51.348399+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e332: 8 total, 7 up, 8 in 2021-07-26T16:01:52.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:52 smithi033 bash[42377]: cluster 2021-07-26T16:01:51.027727+0000 mgr.y (mgr.34104) 203 : cluster [DBG] pgmap v299: 25 pgs: 3 active+undersized, 5 active+undersized+degraded, 1 stale+active+clean, 16 active+clean; 196 MiB data, 714 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 2.7 MiB/s wr, 17 op/s; 34/237 objects degraded (14.346%) 2021-07-26T16:01:52.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:52 smithi033 bash[42377]: cluster 2021-07-26T16:01:51.348399+0000 mon.a (mon.0) 567 : cluster [DBG] osdmap e332: 8 total, 7 up, 8 in 2021-07-26T16:01:52.985 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:52 smithi096 bash[37997]: debug 2021-07-26T16:01:52.631+0000 7f79660e6700 1 -- 172.21.15.96:0/2703662529 <== mon.2 v2:172.21.15.96:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557ca044e340 con 0x557ca04a8c00 2021-07-26T16:01:53.386 INFO:tasks.rados.rados.0.smithi033.stdout:1374: done (0 left) 2021-07-26T16:01:53.386 INFO:tasks.rados.rados.0.smithi033.stdout:1375: read oid 11 snap -1 2021-07-26T16:01:53.390 INFO:tasks.rados.rados.0.smithi033.stdout:1375: expect (ObjNum 366 snap 117 seq_num 366) 2021-07-26T16:01:53.390 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 135 2021-07-26T16:01:53.391 INFO:tasks.rados.rados.0.smithi033.stdout:1376: seq_num 429 ranges {0=794624,794624=770048,1564672=622592,2187264=212992} 2021-07-26T16:01:53.394 INFO:tasks.rados.rados.0.smithi033.stdout:1376: writing smithi03339061-24 from 0 to 794624 tid 1 2021-07-26T16:01:53.399 INFO:tasks.rados.rados.0.smithi033.stdout:1376: writing smithi03339061-24 from 794624 to 1564672 tid 2 2021-07-26T16:01:53.402 INFO:tasks.rados.rados.0.smithi033.stdout:1376: writing smithi03339061-24 from 1564672 to 2187264 tid 3 2021-07-26T16:01:53.404 INFO:tasks.rados.rados.0.smithi033.stdout:1376: writing smithi03339061-24 from 2187264 to 2400256 tid 4 2021-07-26T16:01:53.404 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 135 2021-07-26T16:01:53.405 INFO:tasks.rados.rados.0.smithi033.stdout:1376: finishing write tid 1 to smithi03339061-24 2021-07-26T16:01:53.405 INFO:tasks.rados.rados.0.smithi033.stdout:1377: seq_num 430 ranges {12075008=8192} 2021-07-26T16:01:53.473 INFO:tasks.rados.rados.0.smithi033.stdout:1377: writing smithi03339061-32 from 12075008 to 12083200 tid 1 2021-07-26T16:01:53.474 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 135 2021-07-26T16:01:53.474 INFO:tasks.rados.rados.0.smithi033.stdout:1378: seq_num 431 ranges {0=24576} 2021-07-26T16:01:53.474 INFO:tasks.rados.rados.0.smithi033.stdout:1378: writing smithi03339061-36 from 0 to 24576 tid 1 2021-07-26T16:01:53.475 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 135 2021-07-26T16:01:53.475 INFO:tasks.rados.rados.0.smithi033.stdout:1379: seq_num 432 ranges {2015232=40960} 2021-07-26T16:01:53.485 INFO:tasks.rados.rados.0.smithi033.stdout:1379: writing smithi03339061-22 from 2015232 to 2056192 tid 1 2021-07-26T16:01:53.486 INFO:tasks.rados.rados.0.smithi033.stdout:1380: snap_remove snap 132 2021-07-26T16:01:53.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:53 smithi096 bash[33981]: cluster 2021-07-26T16:01:52.361230+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e333: 8 total, 7 up, 8 in 2021-07-26T16:01:53.488 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:53 smithi096 bash[37997]: debug 2021-07-26T16:01:53.191+0000 7f796d93a0c0 -1 Falling back to public interface 2021-07-26T16:01:53.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:53 smithi033 bash[41341]: cluster 2021-07-26T16:01:52.361230+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e333: 8 total, 7 up, 8 in 2021-07-26T16:01:53.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:53 smithi033 bash[42377]: cluster 2021-07-26T16:01:52.361230+0000 mon.a (mon.0) 568 : cluster [DBG] osdmap e333: 8 total, 7 up, 8 in 2021-07-26T16:01:53.709 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:53 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:53.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:53.710 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:53 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:53.519Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:01:53.710 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:01:53 smithi033 bash[32681]: level=error ts=2021-07-26T16:01:53.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:01:54.383 INFO:journalctl@ceph.mgr.y.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[39943]: debug 2021-07-26T16:01:54.090+0000 7fa4db1f3700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:01:54.384 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[41341]: cluster 2021-07-26T16:01:53.028597+0000 mgr.y (mgr.34104) 204 : cluster [DBG] pgmap v302: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 196 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 9.5 MiB/s rd, 4.4 MiB/s wr, 27 op/s; 38/219 objects degraded (17.352%) 2021-07-26T16:01:54.385 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[41341]: cluster 2021-07-26T16:01:53.382985+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e334: 8 total, 7 up, 8 in 2021-07-26T16:01:54.386 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[41341]: audit 2021-07-26T16:01:53.789919+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:54.386 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[41341]: audit 2021-07-26T16:01:54.068089+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:54.386 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[41341]: audit 2021-07-26T16:01:54.081901+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:54.386 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[41341]: audit 2021-07-26T16:01:54.084050+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:54.387 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[41341]: audit 2021-07-26T16:01:54.086566+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:54.387 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[41341]: audit 2021-07-26T16:01:54.088675+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:54.387 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[41341]: audit 2021-07-26T16:01:54.091741+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:01:54.405 INFO:tasks.rados.rados.0.smithi033.stdout:1376: finishing write tid 2 to smithi03339061-24 2021-07-26T16:01:54.405 INFO:tasks.rados.rados.0.smithi033.stdout:1376: finishing write tid 3 to smithi03339061-24 2021-07-26T16:01:54.406 INFO:tasks.rados.rados.0.smithi033.stdout:1376: finishing write tid 4 to smithi03339061-24 2021-07-26T16:01:54.406 INFO:tasks.rados.rados.0.smithi033.stdout:1376: finishing write tid 5 to smithi03339061-24 2021-07-26T16:01:54.406 INFO:tasks.rados.rados.0.smithi033.stdout:1376: finishing write tid 6 to smithi03339061-24 2021-07-26T16:01:54.406 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 663 (ObjNum 429 snap 135 seq_num 429) dirty exists 2021-07-26T16:01:54.406 INFO:tasks.rados.rados.0.smithi033.stdout:1376: left oid 24 (ObjNum 429 snap 135 seq_num 429) 2021-07-26T16:01:54.407 INFO:tasks.rados.rados.0.smithi033.stdout:1375: expect (ObjNum 366 snap 117 seq_num 366) 2021-07-26T16:01:54.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[42377]: cluster 2021-07-26T16:01:53.028597+0000 mgr.y (mgr.34104) 204 : cluster [DBG] pgmap v302: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 196 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 9.5 MiB/s rd, 4.4 MiB/s wr, 27 op/s; 38/219 objects degraded (17.352%) 2021-07-26T16:01:54.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[42377]: cluster 2021-07-26T16:01:53.382985+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e334: 8 total, 7 up, 8 in 2021-07-26T16:01:54.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[42377]: audit 2021-07-26T16:01:53.789919+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:54.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[42377]: audit 2021-07-26T16:01:54.068089+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:54.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[42377]: audit 2021-07-26T16:01:54.081901+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:54.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[42377]: audit 2021-07-26T16:01:54.084050+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:54.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[42377]: audit 2021-07-26T16:01:54.086566+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:54.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[42377]: audit 2021-07-26T16:01:54.088675+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:54.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:54 smithi033 bash[42377]: audit 2021-07-26T16:01:54.091741+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:01:54.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:54 smithi096 bash[33981]: cluster 2021-07-26T16:01:53.028597+0000 mgr.y (mgr.34104) 204 : cluster [DBG] pgmap v302: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 196 MiB data, 722 MiB used, 715 GiB / 715 GiB avail; 9.5 MiB/s rd, 4.4 MiB/s wr, 27 op/s; 38/219 objects degraded (17.352%) 2021-07-26T16:01:54.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:54 smithi096 bash[33981]: cluster 2021-07-26T16:01:53.382985+0000 mon.a (mon.0) 569 : cluster [DBG] osdmap e334: 8 total, 7 up, 8 in 2021-07-26T16:01:54.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:54 smithi096 bash[33981]: audit 2021-07-26T16:01:53.789919+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:54.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:54 smithi096 bash[33981]: audit 2021-07-26T16:01:54.068089+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:01:54.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:54 smithi096 bash[33981]: audit 2021-07-26T16:01:54.081901+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:01:54.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:54 smithi096 bash[33981]: audit 2021-07-26T16:01:54.084050+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:54.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:54 smithi096 bash[33981]: audit 2021-07-26T16:01:54.086566+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:54.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:54 smithi096 bash[33981]: audit 2021-07-26T16:01:54.088675+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:01:54.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:54 smithi096 bash[33981]: audit 2021-07-26T16:01:54.091741+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:01:55.076 INFO:tasks.rados.rados.0.smithi033.stdout:1378: finishing write tid 1 to smithi03339061-36 2021-07-26T16:01:55.077 INFO:tasks.rados.rados.0.smithi033.stdout:1378: finishing write tid 2 to smithi03339061-36 2021-07-26T16:01:55.077 INFO:tasks.rados.rados.0.smithi033.stdout:1375: done (5 left) 2021-07-26T16:01:55.077 INFO:tasks.rados.rados.0.smithi033.stdout:1376: done (4 left) 2021-07-26T16:01:55.077 INFO:tasks.rados.rados.0.smithi033.stdout:1380: done (3 left) 2021-07-26T16:01:55.077 INFO:tasks.rados.rados.0.smithi033.stdout:1381: rollback oid 20 current snap is 135 2021-07-26T16:01:55.078 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 20 to 133 2021-07-26T16:01:55.078 INFO:tasks.rados.rados.0.smithi033.stdout:1377: finishing write tid 1 to smithi03339061-32 2021-07-26T16:01:55.078 INFO:tasks.rados.rados.0.smithi033.stdout:1377: finishing write tid 2 to smithi03339061-32 2021-07-26T16:01:55.078 INFO:tasks.rados.rados.0.smithi033.stdout:1378: finishing write tid 3 to smithi03339061-36 2021-07-26T16:01:55.079 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 427 (ObjNum 431 snap 135 seq_num 431) dirty exists 2021-07-26T16:01:55.079 INFO:tasks.rados.rados.0.smithi033.stdout:1378: left oid 36 (ObjNum 431 snap 135 seq_num 431) 2021-07-26T16:01:55.079 INFO:tasks.rados.rados.0.smithi033.stdout:1377: finishing write tid 3 to smithi03339061-32 2021-07-26T16:01:55.079 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 349 (ObjNum 430 snap 135 seq_num 430) dirty exists 2021-07-26T16:01:55.079 INFO:tasks.rados.rados.0.smithi033.stdout:1377: left oid 32 (ObjNum 430 snap 135 seq_num 430) 2021-07-26T16:01:55.080 INFO:tasks.rados.rados.0.smithi033.stdout:1379: finishing write tid 1 to smithi03339061-22 2021-07-26T16:01:55.080 INFO:tasks.rados.rados.0.smithi033.stdout:1379: finishing write tid 2 to smithi03339061-22 2021-07-26T16:01:55.080 INFO:tasks.rados.rados.0.smithi033.stdout:1379: finishing write tid 3 to smithi03339061-22 2021-07-26T16:01:55.080 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 777 (ObjNum 432 snap 135 seq_num 432) dirty exists 2021-07-26T16:01:55.081 INFO:tasks.rados.rados.0.smithi033.stdout:1379: left oid 22 (ObjNum 432 snap 135 seq_num 432) 2021-07-26T16:01:55.081 INFO:tasks.rados.rados.0.smithi033.stdout:1377: done (3 left) 2021-07-26T16:01:55.081 INFO:tasks.rados.rados.0.smithi033.stdout:1378: done (2 left) 2021-07-26T16:01:55.081 INFO:tasks.rados.rados.0.smithi033.stdout:1379: done (1 left) 2021-07-26T16:01:55.082 INFO:tasks.rados.rados.0.smithi033.stdout:1382: snap_remove snap 134 2021-07-26T16:01:55.416 INFO:tasks.rados.rados.0.smithi033.stdout:1382: done (1 left) 2021-07-26T16:01:55.417 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 135 2021-07-26T16:01:55.417 INFO:tasks.rados.rados.0.smithi033.stdout:1381: finishing rollback tid 0 to smithi03339061-20 2021-07-26T16:01:55.417 INFO:tasks.rados.rados.0.smithi033.stdout:1381: finishing rollback tid 1 to smithi03339061-20 2021-07-26T16:01:55.418 INFO:tasks.rados.rados.0.smithi033.stdout:1381: finishing rollback tid 2 to smithi03339061-20 2021-07-26T16:01:55.418 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 504 (ObjNum 414 snap 131 seq_num 414) dirty exists 2021-07-26T16:01:55.419 INFO:tasks.rados.rados.0.smithi033.stdout:1383: seq_num 433 ranges {2400256=57344} 2021-07-26T16:01:55.433 INFO:tasks.rados.rados.0.smithi033.stdout:1383: writing smithi03339061-24 from 2400256 to 2457600 tid 1 2021-07-26T16:01:55.433 INFO:tasks.rados.rados.0.smithi033.stdout:1381: done (1 left) 2021-07-26T16:01:55.433 INFO:tasks.rados.rados.0.smithi033.stdout:1384: read oid 34 snap 131 2021-07-26T16:01:55.433 INFO:tasks.rados.rados.0.smithi033.stdout:1384: expect (ObjNum 353 snap 112 seq_num 353) 2021-07-26T16:01:55.434 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 17 current snap is 135 2021-07-26T16:01:55.434 INFO:tasks.rados.rados.0.smithi033.stdout:1385: seq_num 434 ranges {2416640=73728} 2021-07-26T16:01:55.447 INFO:tasks.rados.rados.0.smithi033.stdout:1385: writing smithi03339061-17 from 2416640 to 2490368 tid 1 2021-07-26T16:01:55.447 INFO:tasks.rados.rados.0.smithi033.stdout:1386: copy_from oid 40 from oid 41 current snap is 135 2021-07-26T16:01:55.447 INFO:tasks.rados.rados.0.smithi033.stdout:1383: finishing write tid 1 to smithi03339061-24 2021-07-26T16:01:55.447 INFO:tasks.rados.rados.0.smithi033.stdout:1387: snap_remove snap 133 2021-07-26T16:01:55.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:55 smithi033 bash[41341]: audit 2021-07-26T16:01:54.092076+0000 mgr.y (mgr.34104) 205 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:01:55.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:55 smithi033 bash[41341]: cephadm 2021-07-26T16:01:54.093619+0000 mgr.y (mgr.34104) 206 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:01:55.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:55 smithi033 bash[41341]: cluster 2021-07-26T16:01:54.402347+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e335: 8 total, 7 up, 8 in 2021-07-26T16:01:55.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:55 smithi033 bash[42377]: audit 2021-07-26T16:01:54.092076+0000 mgr.y (mgr.34104) 205 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:01:55.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:55 smithi033 bash[42377]: cephadm 2021-07-26T16:01:54.093619+0000 mgr.y (mgr.34104) 206 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:01:55.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:55 smithi033 bash[42377]: cluster 2021-07-26T16:01:54.402347+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e335: 8 total, 7 up, 8 in 2021-07-26T16:01:55.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:55 smithi096 bash[33981]: audit 2021-07-26T16:01:54.092076+0000 mgr.y (mgr.34104) 205 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:01:55.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:55 smithi096 bash[33981]: cephadm 2021-07-26T16:01:54.093619+0000 mgr.y (mgr.34104) 206 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (2 PGs are or would become offline) 2021-07-26T16:01:55.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:55 smithi096 bash[33981]: cluster 2021-07-26T16:01:54.402347+0000 mon.a (mon.0) 572 : cluster [DBG] osdmap e335: 8 total, 7 up, 8 in 2021-07-26T16:01:56.013 INFO:tasks.rados.rados.0.smithi033.stdout:1387: done (4 left) 2021-07-26T16:01:56.014 INFO:tasks.rados.rados.0.smithi033.stdout:1388: snap_create 2021-07-26T16:01:56.014 INFO:tasks.rados.rados.0.smithi033.stdout:1383: finishing write tid 2 to smithi03339061-24 2021-07-26T16:01:56.014 INFO:tasks.rados.rados.0.smithi033.stdout:1383: finishing write tid 3 to smithi03339061-24 2021-07-26T16:01:56.015 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 667 (ObjNum 433 snap 135 seq_num 433) dirty exists 2021-07-26T16:01:56.015 INFO:tasks.rados.rados.0.smithi033.stdout:1383: left oid 24 (ObjNum 433 snap 135 seq_num 433) 2021-07-26T16:01:56.015 INFO:tasks.rados.rados.0.smithi033.stdout:1384: expect (ObjNum 353 snap 112 seq_num 353) 2021-07-26T16:01:56.098 INFO:tasks.rados.rados.0.smithi033.stdout:1385: finishing write tid 1 to smithi03339061-17 2021-07-26T16:01:56.098 INFO:tasks.rados.rados.0.smithi033.stdout:1385: finishing write tid 2 to smithi03339061-17 2021-07-26T16:01:56.099 INFO:tasks.rados.rados.0.smithi033.stdout:1385: finishing write tid 3 to smithi03339061-17 2021-07-26T16:01:56.099 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 206 (ObjNum 434 snap 135 seq_num 434) dirty exists 2021-07-26T16:01:56.099 INFO:tasks.rados.rados.0.smithi033.stdout:1385: left oid 17 (ObjNum 434 snap 135 seq_num 434) 2021-07-26T16:01:56.099 INFO:tasks.rados.rados.0.smithi033.stdout:1386: finishing copy_from to smithi03339061-40 2021-07-26T16:01:56.100 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 494 (ObjNum 417 snap 131 seq_num 417) dirty exists 2021-07-26T16:01:56.100 INFO:tasks.rados.rados.0.smithi033.stdout:1386: finishing copy_from racing read to smithi03339061-40 2021-07-26T16:01:56.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:56 smithi033 bash[41341]: cluster 2021-07-26T16:01:55.029132+0000 mgr.y (mgr.34104) 207 : cluster [DBG] pgmap v305: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 192 MiB data, 724 MiB used, 715 GiB / 715 GiB avail; 5.1 MiB/s rd, 2.3 MiB/s wr, 16 op/s; 38/207 objects degraded (18.357%) 2021-07-26T16:01:56.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:56 smithi033 bash[41341]: cluster 2021-07-26T16:01:55.392500+0000 mon.a (mon.0) 573 : cluster [WRN] Health check update: Degraded data redundancy: 38/207 objects degraded (18.357%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:56.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:56 smithi033 bash[41341]: cluster 2021-07-26T16:01:55.412104+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e336: 8 total, 7 up, 8 in 2021-07-26T16:01:56.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:56 smithi033 bash[41341]: cluster 2021-07-26T16:01:56.008020+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e337: 8 total, 7 up, 8 in 2021-07-26T16:01:56.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:56 smithi033 bash[42377]: cluster 2021-07-26T16:01:55.029132+0000 mgr.y (mgr.34104) 207 : cluster [DBG] pgmap v305: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 192 MiB data, 724 MiB used, 715 GiB / 715 GiB avail; 5.1 MiB/s rd, 2.3 MiB/s wr, 16 op/s; 38/207 objects degraded (18.357%) 2021-07-26T16:01:56.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:56 smithi033 bash[42377]: cluster 2021-07-26T16:01:55.392500+0000 mon.a (mon.0) 573 : cluster [WRN] Health check update: Degraded data redundancy: 38/207 objects degraded (18.357%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:56.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:56 smithi033 bash[42377]: cluster 2021-07-26T16:01:55.412104+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e336: 8 total, 7 up, 8 in 2021-07-26T16:01:56.715 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:56 smithi033 bash[42377]: cluster 2021-07-26T16:01:56.008020+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e337: 8 total, 7 up, 8 in 2021-07-26T16:01:56.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:56 smithi096 bash[33981]: cluster 2021-07-26T16:01:55.029132+0000 mgr.y (mgr.34104) 207 : cluster [DBG] pgmap v305: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 192 MiB data, 724 MiB used, 715 GiB / 715 GiB avail; 5.1 MiB/s rd, 2.3 MiB/s wr, 16 op/s; 38/207 objects degraded (18.357%) 2021-07-26T16:01:56.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:56 smithi096 bash[33981]: cluster 2021-07-26T16:01:55.392500+0000 mon.a (mon.0) 573 : cluster [WRN] Health check update: Degraded data redundancy: 38/207 objects degraded (18.357%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T16:01:56.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:56 smithi096 bash[33981]: cluster 2021-07-26T16:01:55.412104+0000 mon.a (mon.0) 574 : cluster [DBG] osdmap e336: 8 total, 7 up, 8 in 2021-07-26T16:01:56.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:56 smithi096 bash[33981]: cluster 2021-07-26T16:01:56.008020+0000 mon.a (mon.0) 575 : cluster [DBG] osdmap e337: 8 total, 7 up, 8 in 2021-07-26T16:01:57.029 INFO:tasks.rados.rados.0.smithi033.stdout:1383: done (4 left) 2021-07-26T16:01:57.030 INFO:tasks.rados.rados.0.smithi033.stdout:1384: done (3 left) 2021-07-26T16:01:57.030 INFO:tasks.rados.rados.0.smithi033.stdout:1385: done (2 left) 2021-07-26T16:01:57.030 INFO:tasks.rados.rados.0.smithi033.stdout:1386: done (1 left) 2021-07-26T16:01:57.031 INFO:tasks.rados.rados.0.smithi033.stdout:1388: done (0 left) 2021-07-26T16:01:57.031 INFO:tasks.rados.rados.0.smithi033.stdout:1389: read oid 28 snap -1 2021-07-26T16:01:57.032 INFO:tasks.rados.rados.0.smithi033.stdout:1389: expect (ObjNum 362 snap 115 seq_num 362) 2021-07-26T16:01:57.032 INFO:tasks.rados.rados.0.smithi033.stdout:1390: read oid 11 snap -1 2021-07-26T16:01:57.032 INFO:tasks.rados.rados.0.smithi033.stdout:1390: expect (ObjNum 366 snap 117 seq_num 366) 2021-07-26T16:01:57.033 INFO:tasks.rados.rados.0.smithi033.stdout:1391: read oid 14 snap -1 2021-07-26T16:01:57.033 INFO:tasks.rados.rados.0.smithi033.stdout:1391: expect deleted 2021-07-26T16:01:57.034 INFO:tasks.rados.rados.0.smithi033.stdout:1392: copy_from oid 50 from oid 12 current snap is 136 2021-07-26T16:01:57.034 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 136 2021-07-26T16:01:57.035 INFO:tasks.rados.rados.0.smithi033.stdout:1393: seq_num 435 ranges {2318336=90112} 2021-07-26T16:01:57.047 INFO:tasks.rados.rados.0.smithi033.stdout:1393: writing smithi03339061-45 from 2318336 to 2408448 tid 1 2021-07-26T16:01:57.048 INFO:tasks.rados.rados.0.smithi033.stdout:1394: read oid 2 snap 135 2021-07-26T16:01:57.048 INFO:tasks.rados.rados.0.smithi033.stdout:1394: expect (ObjNum 295 snap 91 seq_num 295) 2021-07-26T16:01:57.048 INFO:tasks.rados.rados.0.smithi033.stdout:1395: rollback oid 38 current snap is 136 2021-07-26T16:01:57.049 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 38 to 131 2021-07-26T16:01:57.049 INFO:tasks.rados.rados.0.smithi033.stdout:1396: copy_from oid 15 from oid 20 current snap is 136 2021-07-26T16:01:57.049 INFO:tasks.rados.rados.0.smithi033.stdout:1391: done (7 left) 2021-07-26T16:01:57.049 INFO:tasks.rados.rados.0.smithi033.stdout:1397: read oid 32 snap -1 2021-07-26T16:01:57.049 INFO:tasks.rados.rados.0.smithi033.stdout:1397: expect (ObjNum 430 snap 135 seq_num 430) 2021-07-26T16:01:57.050 INFO:tasks.rados.rados.0.smithi033.stdout:1398: read oid 27 snap -1 2021-07-26T16:01:57.050 INFO:tasks.rados.rados.0.smithi033.stdout:1398: expect (ObjNum 321 snap 102 seq_num 321) 2021-07-26T16:01:57.050 INFO:tasks.rados.rados.0.smithi033.stdout:1399: read oid 36 snap -1 2021-07-26T16:01:57.050 INFO:tasks.rados.rados.0.smithi033.stdout:1399: expect (ObjNum 431 snap 135 seq_num 431) 2021-07-26T16:01:57.051 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 136 2021-07-26T16:01:57.051 INFO:tasks.rados.rados.0.smithi033.stdout:1400: seq_num 436 ranges {0=106496} 2021-07-26T16:01:57.052 INFO:tasks.rados.rados.0.smithi033.stdout:1400: writing smithi03339061-18 from 0 to 106496 tid 1 2021-07-26T16:01:57.053 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 136 2021-07-26T16:01:57.053 INFO:tasks.rados.rados.0.smithi033.stdout:1401: seq_num 437 ranges {2457600=122880} 2021-07-26T16:01:57.063 INFO:tasks.rados.rados.0.smithi033.stdout:1401: writing smithi03339061-24 from 2457600 to 2580480 tid 1 2021-07-26T16:01:57.063 INFO:tasks.rados.rados.0.smithi033.stdout:1402: setattr oid 5 current snap is 136 2021-07-26T16:01:57.063 INFO:tasks.rados.rados.0.smithi033.stdout:1395: finishing rollback tid 0 to smithi03339061-38 2021-07-26T16:01:57.063 INFO:tasks.rados.rados.0.smithi033.stdout:1389: expect (ObjNum 362 snap 115 seq_num 362) 2021-07-26T16:01:57.117 INFO:tasks.rados.rados.0.smithi033.stdout:1393: finishing write tid 1 to smithi03339061-45 2021-07-26T16:01:57.117 INFO:tasks.rados.rados.0.smithi033.stdout:1393: finishing write tid 2 to smithi03339061-45 2021-07-26T16:01:57.118 INFO:tasks.rados.rados.0.smithi033.stdout:1395: finishing rollback tid 1 to smithi03339061-38 2021-07-26T16:01:57.118 INFO:tasks.rados.rados.0.smithi033.stdout:1400: finishing write tid 1 to smithi03339061-18 2021-07-26T16:01:57.118 INFO:tasks.rados.rados.0.smithi033.stdout:1395: finishing rollback tid 2 to smithi03339061-38 2021-07-26T16:01:57.118 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 432 (ObjNum 398 snap 122 seq_num 398) dirty exists 2021-07-26T16:01:57.119 INFO:tasks.rados.rados.0.smithi033.stdout:1400: finishing write tid 2 to smithi03339061-18 2021-07-26T16:01:57.119 INFO:tasks.rados.rados.0.smithi033.stdout:1393: finishing write tid 3 to smithi03339061-45 2021-07-26T16:01:57.119 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 786 (ObjNum 435 snap 136 seq_num 435) dirty exists 2021-07-26T16:01:57.119 INFO:tasks.rados.rados.0.smithi033.stdout:1393: left oid 45 (ObjNum 435 snap 136 seq_num 435) 2021-07-26T16:01:57.120 INFO:tasks.rados.rados.0.smithi033.stdout:1400: finishing write tid 3 to smithi03339061-18 2021-07-26T16:01:57.120 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 788 (ObjNum 436 snap 136 seq_num 436) dirty exists 2021-07-26T16:01:57.120 INFO:tasks.rados.rados.0.smithi033.stdout:1400: left oid 18 (ObjNum 436 snap 136 seq_num 436) 2021-07-26T16:01:57.121 INFO:tasks.rados.rados.0.smithi033.stdout:1401: finishing write tid 1 to smithi03339061-24 2021-07-26T16:01:57.121 INFO:tasks.rados.rados.0.smithi033.stdout:1401: finishing write tid 2 to smithi03339061-24 2021-07-26T16:01:57.121 INFO:tasks.rados.rados.0.smithi033.stdout:1401: finishing write tid 3 to smithi03339061-24 2021-07-26T16:01:57.121 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 670 (ObjNum 437 snap 136 seq_num 437) dirty exists 2021-07-26T16:01:57.121 INFO:tasks.rados.rados.0.smithi033.stdout:1401: left oid 24 (ObjNum 437 snap 136 seq_num 437) 2021-07-26T16:01:57.122 INFO:tasks.rados.rados.0.smithi033.stdout:1394: expect (ObjNum 295 snap 91 seq_num 295) 2021-07-26T16:01:57.231 INFO:tasks.rados.rados.0.smithi033.stdout:1390: expect (ObjNum 366 snap 117 seq_num 366) 2021-07-26T16:01:57.239 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:56 smithi096 bash[37997]: debug 2021-07-26T16:01:56.915+0000 7f796d93a0c0 -1 osd.6 326 log_to_monitors {default=true} 2021-07-26T16:01:57.239 INFO:journalctl@ceph.osd.6.smithi096.stdout:Jul 26 16:01:57 smithi096 bash[37997]: debug 2021-07-26T16:01:57.039+0000 7f795ca8a700 -1 osd.6 326 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-07-26T16:01:57.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[41341]: audit 2021-07-26T16:01:56.923701+0000 mon.a (mon.0) 576 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T16:01:57.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[41341]: audit 2021-07-26T16:01:56.926592+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/1665653065,v1:172.21.15.96:6817/1665653065]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T16:01:57.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[41341]: audit 2021-07-26T16:01:57.022850+0000 mon.a (mon.0) 577 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-07-26T16:01:57.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[41341]: cluster 2021-07-26T16:01:57.023008+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e338: 8 total, 7 up, 8 in 2021-07-26T16:01:57.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[41341]: audit 2021-07-26T16:01:57.025043+0000 mon.a (mon.0) 579 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:57.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[41341]: audit 2021-07-26T16:01:57.028149+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/1665653065,v1:172.21.15.96:6817/1665653065]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:57.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[42377]: audit 2021-07-26T16:01:56.923701+0000 mon.a (mon.0) 576 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T16:01:57.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[42377]: audit 2021-07-26T16:01:56.926592+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/1665653065,v1:172.21.15.96:6817/1665653065]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T16:01:57.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[42377]: audit 2021-07-26T16:01:57.022850+0000 mon.a (mon.0) 577 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-07-26T16:01:57.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[42377]: cluster 2021-07-26T16:01:57.023008+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e338: 8 total, 7 up, 8 in 2021-07-26T16:01:57.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[42377]: audit 2021-07-26T16:01:57.025043+0000 mon.a (mon.0) 579 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:57.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:57 smithi033 bash[42377]: audit 2021-07-26T16:01:57.028149+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/1665653065,v1:172.21.15.96:6817/1665653065]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:57.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:57 smithi096 bash[33981]: audit 2021-07-26T16:01:56.923701+0000 mon.a (mon.0) 576 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T16:01:57.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:57 smithi096 bash[33981]: audit 2021-07-26T16:01:56.926592+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/1665653065,v1:172.21.15.96:6817/1665653065]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-07-26T16:01:57.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:57 smithi096 bash[33981]: audit 2021-07-26T16:01:57.022850+0000 mon.a (mon.0) 577 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-07-26T16:01:57.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:57 smithi096 bash[33981]: cluster 2021-07-26T16:01:57.023008+0000 mon.a (mon.0) 578 : cluster [DBG] osdmap e338: 8 total, 7 up, 8 in 2021-07-26T16:01:57.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:57 smithi096 bash[33981]: audit 2021-07-26T16:01:57.025043+0000 mon.a (mon.0) 579 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:57.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:57 smithi096 bash[33981]: audit 2021-07-26T16:01:57.028149+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.15.96:6816/1665653065,v1:172.21.15.96:6817/1665653065]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:01:57.892 INFO:tasks.rados.rados.0.smithi033.stdout:1399: expect (ObjNum 431 snap 135 seq_num 431) 2021-07-26T16:01:57.893 INFO:tasks.rados.rados.0.smithi033.stdout:1398: expect (ObjNum 321 snap 102 seq_num 321) 2021-07-26T16:01:58.446 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 495 (ObjNum 296 snap 93 seq_num 296) dirty exists 2021-07-26T16:01:58.447 INFO:tasks.rados.rados.0.smithi033.stdout:1396: finishing copy_from to smithi03339061-15 2021-07-26T16:01:58.447 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 504 (ObjNum 414 snap 131 seq_num 414) dirty exists 2021-07-26T16:01:58.447 INFO:tasks.rados.rados.0.smithi033.stdout:1396: finishing copy_from racing read to smithi03339061-15 2021-07-26T16:01:58.447 INFO:tasks.rados.rados.0.smithi033.stdout:1397: expect (ObjNum 430 snap 135 seq_num 430) 2021-07-26T16:01:58.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:58 smithi033 bash[41341]: cluster 2021-07-26T16:01:57.029662+0000 mgr.y (mgr.34104) 208 : cluster [DBG] pgmap v309: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 197 MiB data, 725 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s rd, 1.6 MiB/s wr, 4 op/s; 39/210 objects degraded (18.571%) 2021-07-26T16:01:58.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:58 smithi033 bash[41341]: cluster 2021-07-26T16:01:58.017838+0000 mon.a (mon.0) 580 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:01:58.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:58 smithi033 bash[41341]: cluster 2021-07-26T16:01:58.029061+0000 mon.a (mon.0) 581 : cluster [INF] osd.6 [v2:172.21.15.96:6816/1665653065,v1:172.21.15.96:6817/1665653065] boot 2021-07-26T16:01:58.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:58 smithi033 bash[41341]: cluster 2021-07-26T16:01:58.029111+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2021-07-26T16:01:58.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:01:58 smithi033 bash[41341]: audit 2021-07-26T16:01:58.029330+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T16:01:58.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:58 smithi033 bash[42377]: cluster 2021-07-26T16:01:57.029662+0000 mgr.y (mgr.34104) 208 : cluster [DBG] pgmap v309: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 197 MiB data, 725 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s rd, 1.6 MiB/s wr, 4 op/s; 39/210 objects degraded (18.571%) 2021-07-26T16:01:58.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:58 smithi033 bash[42377]: cluster 2021-07-26T16:01:58.017838+0000 mon.a (mon.0) 580 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:01:58.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:58 smithi033 bash[42377]: cluster 2021-07-26T16:01:58.029061+0000 mon.a (mon.0) 581 : cluster [INF] osd.6 [v2:172.21.15.96:6816/1665653065,v1:172.21.15.96:6817/1665653065] boot 2021-07-26T16:01:58.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:58 smithi033 bash[42377]: cluster 2021-07-26T16:01:58.029111+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2021-07-26T16:01:58.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:01:58 smithi033 bash[42377]: audit 2021-07-26T16:01:58.029330+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T16:01:58.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:58 smithi096 bash[33981]: cluster 2021-07-26T16:01:57.029662+0000 mgr.y (mgr.34104) 208 : cluster [DBG] pgmap v309: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 197 MiB data, 725 MiB used, 715 GiB / 715 GiB avail; 6.7 MiB/s rd, 1.6 MiB/s wr, 4 op/s; 39/210 objects degraded (18.571%) 2021-07-26T16:01:58.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:58 smithi096 bash[33981]: cluster 2021-07-26T16:01:58.017838+0000 mon.a (mon.0) 580 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:01:58.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:58 smithi096 bash[33981]: cluster 2021-07-26T16:01:58.029061+0000 mon.a (mon.0) 581 : cluster [INF] osd.6 [v2:172.21.15.96:6816/1665653065,v1:172.21.15.96:6817/1665653065] boot 2021-07-26T16:01:58.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:58 smithi096 bash[33981]: cluster 2021-07-26T16:01:58.029111+0000 mon.a (mon.0) 582 : cluster [DBG] osdmap e339: 8 total, 8 up, 8 in 2021-07-26T16:01:58.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:01:58 smithi096 bash[33981]: audit 2021-07-26T16:01:58.029330+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-07-26T16:01:59.530 INFO:tasks.rados.rados.0.smithi033.stdout:1392: finishing copy_from to smithi03339061-50 2021-07-26T16:01:59.530 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 355 (ObjNum 408 snap 129 seq_num 408) dirty exists 2021-07-26T16:01:59.530 INFO:tasks.rados.rados.0.smithi033.stdout:1392: finishing copy_from racing read to smithi03339061-50 2021-07-26T16:01:59.531 INFO:tasks.rados.rados.0.smithi033.stdout:1389: done (12 left) 2021-07-26T16:01:59.531 INFO:tasks.rados.rados.0.smithi033.stdout:1390: done (11 left) 2021-07-26T16:01:59.531 INFO:tasks.rados.rados.0.smithi033.stdout:1392: done (10 left) 2021-07-26T16:01:59.532 INFO:tasks.rados.rados.0.smithi033.stdout:1393: done (9 left) 2021-07-26T16:01:59.532 INFO:tasks.rados.rados.0.smithi033.stdout:1394: done (8 left) 2021-07-26T16:01:59.532 INFO:tasks.rados.rados.0.smithi033.stdout:1395: done (7 left) 2021-07-26T16:01:59.532 INFO:tasks.rados.rados.0.smithi033.stdout:1396: done (6 left) 2021-07-26T16:01:59.532 INFO:tasks.rados.rados.0.smithi033.stdout:1397: done (5 left) 2021-07-26T16:01:59.533 INFO:tasks.rados.rados.0.smithi033.stdout:1398: done (4 left) 2021-07-26T16:01:59.533 INFO:tasks.rados.rados.0.smithi033.stdout:1399: done (3 left) 2021-07-26T16:01:59.533 INFO:tasks.rados.rados.0.smithi033.stdout:1400: done (2 left) 2021-07-26T16:01:59.534 INFO:tasks.rados.rados.0.smithi033.stdout:1401: done (1 left) 2021-07-26T16:01:59.534 INFO:tasks.rados.rados.0.smithi033.stdout:1402: done (0 left) 2021-07-26T16:01:59.534 INFO:tasks.rados.rados.0.smithi033.stdout:1403: delete oid 7 current snap is 136 2021-07-26T16:01:59.535 INFO:tasks.rados.rados.0.smithi033.stdout:1403: done (0 left) 2021-07-26T16:01:59.535 INFO:tasks.rados.rados.0.smithi033.stdout:1404: snap_remove snap 131 2021-07-26T16:02:00.047 INFO:tasks.rados.rados.0.smithi033.stdout:1404: done (0 left) 2021-07-26T16:02:00.047 INFO:tasks.rados.rados.0.smithi033.stdout:1405: read oid 12 snap 135 2021-07-26T16:02:00.047 INFO:tasks.rados.rados.0.smithi033.stdout:1405: expect (ObjNum 408 snap 129 seq_num 408) 2021-07-26T16:02:00.047 INFO:tasks.rados.rados.0.smithi033.stdout:1406: delete oid 3 current snap is 136 2021-07-26T16:02:00.090 INFO:tasks.rados.rados.0.smithi033.stdout:1405: expect (ObjNum 408 snap 129 seq_num 408) 2021-07-26T16:02:00.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:00 smithi033 bash[41341]: cluster 2021-07-26T16:01:59.030513+0000 mgr.y (mgr.34104) 209 : cluster [DBG] pgmap v312: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 200 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 6.5 MiB/s rd, 2.4 MiB/s wr, 9 op/s; 39/225 objects degraded (17.333%) 2021-07-26T16:02:00.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:00 smithi033 bash[41341]: cluster 2021-07-26T16:01:59.033648+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2021-07-26T16:02:00.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:00 smithi033 bash[42377]: cluster 2021-07-26T16:01:59.030513+0000 mgr.y (mgr.34104) 209 : cluster [DBG] pgmap v312: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 200 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 6.5 MiB/s rd, 2.4 MiB/s wr, 9 op/s; 39/225 objects degraded (17.333%) 2021-07-26T16:02:00.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:00 smithi033 bash[42377]: cluster 2021-07-26T16:01:59.033648+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2021-07-26T16:02:00.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:00 smithi096 bash[33981]: cluster 2021-07-26T16:01:59.030513+0000 mgr.y (mgr.34104) 209 : cluster [DBG] pgmap v312: 25 pgs: 3 active+undersized, 6 active+undersized+degraded, 16 active+clean; 200 MiB data, 651 MiB used, 715 GiB / 715 GiB avail; 6.5 MiB/s rd, 2.4 MiB/s wr, 9 op/s; 39/225 objects degraded (17.333%) 2021-07-26T16:02:00.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:00 smithi096 bash[33981]: cluster 2021-07-26T16:01:59.033648+0000 mon.a (mon.0) 583 : cluster [DBG] osdmap e340: 8 total, 8 up, 8 in 2021-07-26T16:02:01.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:01 smithi033 bash[41341]: cluster 2021-07-26T16:02:00.042627+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2021-07-26T16:02:01.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:01 smithi033 bash[41341]: cluster 2021-07-26T16:02:00.997979+0000 mon.a (mon.0) 585 : cluster [WRN] Health check update: Degraded data redundancy: 39/225 objects degraded (17.333%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:01.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:01 smithi033 bash[42377]: cluster 2021-07-26T16:02:00.042627+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2021-07-26T16:02:01.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:01 smithi033 bash[42377]: cluster 2021-07-26T16:02:00.997979+0000 mon.a (mon.0) 585 : cluster [WRN] Health check update: Degraded data redundancy: 39/225 objects degraded (17.333%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:01.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:01 smithi096 bash[33981]: cluster 2021-07-26T16:02:00.042627+0000 mon.a (mon.0) 584 : cluster [DBG] osdmap e341: 8 total, 8 up, 8 in 2021-07-26T16:02:01.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:01 smithi096 bash[33981]: cluster 2021-07-26T16:02:00.997979+0000 mon.a (mon.0) 585 : cluster [WRN] Health check update: Degraded data redundancy: 39/225 objects degraded (17.333%), 6 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:02.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:02 smithi033 bash[41341]: cluster 2021-07-26T16:02:01.031351+0000 mgr.y (mgr.34104) 210 : cluster [DBG] pgmap v314: 25 pgs: 1 active+undersized, 2 active+undersized+degraded, 22 active+clean; 195 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 16 MiB/s rd, 686 KiB/s wr, 16 op/s; 13/189 objects degraded (6.878%); 9.0 MiB/s, 2 objects/s recovering 2021-07-26T16:02:02.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:02 smithi033 bash[42377]: cluster 2021-07-26T16:02:01.031351+0000 mgr.y (mgr.34104) 210 : cluster [DBG] pgmap v314: 25 pgs: 1 active+undersized, 2 active+undersized+degraded, 22 active+clean; 195 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 16 MiB/s rd, 686 KiB/s wr, 16 op/s; 13/189 objects degraded (6.878%); 9.0 MiB/s, 2 objects/s recovering 2021-07-26T16:02:02.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:02 smithi096 bash[33981]: cluster 2021-07-26T16:02:01.031351+0000 mgr.y (mgr.34104) 210 : cluster [DBG] pgmap v314: 25 pgs: 1 active+undersized, 2 active+undersized+degraded, 22 active+clean; 195 MiB data, 666 MiB used, 715 GiB / 715 GiB avail; 16 MiB/s rd, 686 KiB/s wr, 16 op/s; 13/189 objects degraded (6.878%); 9.0 MiB/s, 2 objects/s recovering 2021-07-26T16:02:03.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:03 smithi033 bash[41341]: cluster 2021-07-26T16:02:03.041467+0000 mon.a (mon.0) 586 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/189 objects degraded (6.878%), 2 pgs degraded) 2021-07-26T16:02:03.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:03 smithi033 bash[41341]: cluster 2021-07-26T16:02:03.041541+0000 mon.a (mon.0) 587 : cluster [INF] Cluster is now healthy 2021-07-26T16:02:03.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:03 smithi033 bash[42377]: cluster 2021-07-26T16:02:03.041467+0000 mon.a (mon.0) 586 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/189 objects degraded (6.878%), 2 pgs degraded) 2021-07-26T16:02:03.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:03 smithi033 bash[42377]: cluster 2021-07-26T16:02:03.041541+0000 mon.a (mon.0) 587 : cluster [INF] Cluster is now healthy 2021-07-26T16:02:03.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:03 smithi096 bash[33981]: cluster 2021-07-26T16:02:03.041467+0000 mon.a (mon.0) 586 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 13/189 objects degraded (6.878%), 2 pgs degraded) 2021-07-26T16:02:03.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:03 smithi096 bash[33981]: cluster 2021-07-26T16:02:03.041541+0000 mon.a (mon.0) 587 : cluster [INF] Cluster is now healthy 2021-07-26T16:02:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:03 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:03.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:03 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:03.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:03 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:03.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:02:04.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:04 smithi033 bash[41341]: cluster 2021-07-26T16:02:03.032139+0000 mgr.y (mgr.34104) 211 : cluster [DBG] pgmap v315: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 2.6 MiB/s wr, 12 op/s; 9.5 MiB/s, 2 objects/s recovering 2021-07-26T16:02:04.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:04 smithi033 bash[42377]: cluster 2021-07-26T16:02:03.032139+0000 mgr.y (mgr.34104) 211 : cluster [DBG] pgmap v315: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 2.6 MiB/s wr, 12 op/s; 9.5 MiB/s, 2 objects/s recovering 2021-07-26T16:02:04.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:04 smithi096 bash[33981]: cluster 2021-07-26T16:02:03.032139+0000 mgr.y (mgr.34104) 211 : cluster [DBG] pgmap v315: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 676 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 2.6 MiB/s wr, 12 op/s; 9.5 MiB/s, 2 objects/s recovering 2021-07-26T16:02:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:06 smithi033 bash[41341]: cluster 2021-07-26T16:02:05.032936+0000 mgr.y (mgr.34104) 212 : cluster [DBG] pgmap v316: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 7 op/s; 8.1 MiB/s, 2 objects/s recovering 2021-07-26T16:02:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:06 smithi033 bash[41341]: cluster 2021-07-26T16:02:06.008569+0000 mon.a (mon.0) 588 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2021-07-26T16:02:06.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:06 smithi033 bash[42377]: cluster 2021-07-26T16:02:05.032936+0000 mgr.y (mgr.34104) 212 : cluster [DBG] pgmap v316: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 7 op/s; 8.1 MiB/s, 2 objects/s recovering 2021-07-26T16:02:06.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:06 smithi033 bash[42377]: cluster 2021-07-26T16:02:06.008569+0000 mon.a (mon.0) 588 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2021-07-26T16:02:06.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:06 smithi096 bash[33981]: cluster 2021-07-26T16:02:05.032936+0000 mgr.y (mgr.34104) 212 : cluster [DBG] pgmap v316: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 659 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 1.8 MiB/s wr, 7 op/s; 8.1 MiB/s, 2 objects/s recovering 2021-07-26T16:02:06.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:06 smithi096 bash[33981]: cluster 2021-07-26T16:02:06.008569+0000 mon.a (mon.0) 588 : cluster [DBG] osdmap e342: 8 total, 8 up, 8 in 2021-07-26T16:02:08.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:08 smithi033 bash[41341]: cluster 2021-07-26T16:02:07.033656+0000 mgr.y (mgr.34104) 213 : cluster [DBG] pgmap v318: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 9.2 MiB/s rd, 1.6 MiB/s wr, 6 op/s; 7.1 MiB/s, 2 objects/s recovering 2021-07-26T16:02:08.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:08 smithi033 bash[42377]: cluster 2021-07-26T16:02:07.033656+0000 mgr.y (mgr.34104) 213 : cluster [DBG] pgmap v318: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 9.2 MiB/s rd, 1.6 MiB/s wr, 6 op/s; 7.1 MiB/s, 2 objects/s recovering 2021-07-26T16:02:08.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:08 smithi096 bash[33981]: cluster 2021-07-26T16:02:07.033656+0000 mgr.y (mgr.34104) 213 : cluster [DBG] pgmap v318: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 9.2 MiB/s rd, 1.6 MiB/s wr, 6 op/s; 7.1 MiB/s, 2 objects/s recovering 2021-07-26T16:02:10.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[42377]: cluster 2021-07-26T16:02:09.034374+0000 mgr.y (mgr.34104) 214 : cluster [DBG] pgmap v319: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.4 MiB/s wr, 1 op/s; 5.2 MiB/s, 1 objects/s recovering 2021-07-26T16:02:10.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[42377]: audit 2021-07-26T16:02:09.114191+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:02:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[42377]: audit 2021-07-26T16:02:09.114532+0000 mgr.y (mgr.34104) 215 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:02:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[42377]: cephadm 2021-07-26T16:02:09.116460+0000 mgr.y (mgr.34104) 216 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-07-26T16:02:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[42377]: audit 2021-07-26T16:02:09.175753+0000 mon.c (mon.1) 108 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:02:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[42377]: audit 2021-07-26T16:02:09.176514+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:02:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[42377]: audit 2021-07-26T16:02:09.206499+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:02:10.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[42377]: audit 2021-07-26T16:02:09.207336+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:02:10.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[42377]: audit 2021-07-26T16:02:09.564123+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:10.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[41341]: cluster 2021-07-26T16:02:09.034374+0000 mgr.y (mgr.34104) 214 : cluster [DBG] pgmap v319: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.4 MiB/s wr, 1 op/s; 5.2 MiB/s, 1 objects/s recovering 2021-07-26T16:02:10.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[41341]: audit 2021-07-26T16:02:09.114191+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:02:10.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[41341]: audit 2021-07-26T16:02:09.114532+0000 mgr.y (mgr.34104) 215 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:02:10.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[41341]: cephadm 2021-07-26T16:02:09.116460+0000 mgr.y (mgr.34104) 216 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-07-26T16:02:10.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[41341]: audit 2021-07-26T16:02:09.175753+0000 mon.c (mon.1) 108 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:02:10.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[41341]: audit 2021-07-26T16:02:09.176514+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:02:10.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[41341]: audit 2021-07-26T16:02:09.206499+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:02:10.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[41341]: audit 2021-07-26T16:02:09.207336+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:02:10.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:10 smithi033 bash[41341]: audit 2021-07-26T16:02:09.564123+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:10.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:10 smithi096 bash[33981]: cluster 2021-07-26T16:02:09.034374+0000 mgr.y (mgr.34104) 214 : cluster [DBG] pgmap v319: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.4 MiB/s wr, 1 op/s; 5.2 MiB/s, 1 objects/s recovering 2021-07-26T16:02:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:10 smithi096 bash[33981]: audit 2021-07-26T16:02:09.114191+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:02:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:10 smithi096 bash[33981]: audit 2021-07-26T16:02:09.114532+0000 mgr.y (mgr.34104) 215 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2021-07-26T16:02:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:10 smithi096 bash[33981]: cephadm 2021-07-26T16:02:09.116460+0000 mgr.y (mgr.34104) 216 : cephadm [INF] Upgrade: osd.7 is safe to restart 2021-07-26T16:02:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:10 smithi096 bash[33981]: audit 2021-07-26T16:02:09.175753+0000 mon.c (mon.1) 108 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:02:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:10 smithi096 bash[33981]: audit 2021-07-26T16:02:09.176514+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:02:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:10 smithi096 bash[33981]: audit 2021-07-26T16:02:09.206499+0000 mon.c (mon.1) 109 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:02:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:10 smithi096 bash[33981]: audit 2021-07-26T16:02:09.207336+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:02:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:10 smithi096 bash[33981]: audit 2021-07-26T16:02:09.564123+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:11.325 INFO:tasks.rados.rados.0.smithi033.stdout:1405: done (1 left) 2021-07-26T16:02:11.326 INFO:tasks.rados.rados.0.smithi033.stdout:1406: done (0 left) 2021-07-26T16:02:11.326 INFO:tasks.rados.rados.0.smithi033.stdout:1407: read oid 32 snap -1 2021-07-26T16:02:11.326 INFO:tasks.rados.rados.0.smithi033.stdout:1407: expect (ObjNum 430 snap 135 seq_num 430) 2021-07-26T16:02:11.326 INFO:tasks.rados.rados.0.smithi033.stdout:1408: copy_from oid 11 from oid 28 current snap is 136 2021-07-26T16:02:11.326 INFO:tasks.rados.rados.0.smithi033.stdout:1409: read oid 48 snap -1 2021-07-26T16:02:11.327 INFO:tasks.rados.rados.0.smithi033.stdout:1409: expect (ObjNum 399 snap 123 seq_num 399) 2021-07-26T16:02:11.327 INFO:tasks.rados.rados.0.smithi033.stdout:1410: read oid 8 snap -1 2021-07-26T16:02:11.327 INFO:tasks.rados.rados.0.smithi033.stdout:1410: expect (ObjNum 374 snap 118 seq_num 374) 2021-07-26T16:02:11.327 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 136 2021-07-26T16:02:11.328 INFO:tasks.rados.rados.0.smithi033.stdout:1411: seq_num 440 ranges {5496832=172032} 2021-07-26T16:02:11.364 INFO:tasks.rados.rados.0.smithi033.stdout:1411: writing smithi03339061-42 from 5496832 to 5668864 tid 1 2021-07-26T16:02:11.365 INFO:tasks.rados.rados.0.smithi033.stdout:1412: snap_remove snap 135 2021-07-26T16:02:12.023 INFO:tasks.rados.rados.0.smithi033.stdout:1412: done (5 left) 2021-07-26T16:02:12.023 INFO:tasks.rados.rados.0.smithi033.stdout:1413: rollback oid 21 current snap is 136 2021-07-26T16:02:12.024 INFO:tasks.rados.rados.0.smithi033.stdout:1408: finishing copy_from to smithi03339061-11 2021-07-26T16:02:12.024 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 307 (ObjNum 362 snap 115 seq_num 362) dirty exists 2021-07-26T16:02:12.025 INFO:tasks.rados.rados.0.smithi033.stdout:1408: finishing copy_from racing read to smithi03339061-11 2021-07-26T16:02:12.025 INFO:tasks.rados.rados.0.smithi033.stdout:1410: expect (ObjNum 374 snap 118 seq_num 374) 2021-07-26T16:02:12.222 INFO:tasks.rados.rados.0.smithi033.stdout:1411: finishing write tid 1 to smithi03339061-42 2021-07-26T16:02:12.222 INFO:tasks.rados.rados.0.smithi033.stdout:1411: finishing write tid 2 to smithi03339061-42 2021-07-26T16:02:12.222 INFO:tasks.rados.rados.0.smithi033.stdout:1411: finishing write tid 3 to smithi03339061-42 2021-07-26T16:02:12.222 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 249 (ObjNum 440 snap 136 seq_num 440) dirty exists 2021-07-26T16:02:12.223 INFO:tasks.rados.rados.0.smithi033.stdout:1411: left oid 42 (ObjNum 440 snap 136 seq_num 440) 2021-07-26T16:02:12.223 INFO:tasks.rados.rados.0.smithi033.stdout:1409: expect (ObjNum 399 snap 123 seq_num 399) 2021-07-26T16:02:12.795 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:12 smithi096 bash[33981]: cluster 2021-07-26T16:02:11.035205+0000 mgr.y (mgr.34104) 217 : cluster [DBG] pgmap v320: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.3 MiB/s wr, 0 op/s; 2.1 MiB/s, 0 objects/s recovering 2021-07-26T16:02:12.795 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:12 smithi096 bash[33981]: cephadm 2021-07-26T16:02:11.531122+0000 mgr.y (mgr.34104) 218 : cephadm [INF] Upgrade: Updating osd.7 2021-07-26T16:02:12.796 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:12 smithi096 bash[33981]: audit 2021-07-26T16:02:11.541762+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:12.796 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:12 smithi096 bash[33981]: cephadm 2021-07-26T16:02:11.544976+0000 mgr.y (mgr.34104) 219 : cephadm [INF] Deploying daemon osd.7 on smithi096 2021-07-26T16:02:12.796 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:12 smithi096 bash[33981]: cluster 2021-07-26T16:02:12.018556+0000 mon.a (mon.0) 593 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2021-07-26T16:02:12.834 INFO:tasks.rados.rados.0.smithi033.stdout:1407: expect (ObjNum 430 snap 135 seq_num 430) 2021-07-26T16:02:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:12 smithi033 bash[41341]: cluster 2021-07-26T16:02:11.035205+0000 mgr.y (mgr.34104) 217 : cluster [DBG] pgmap v320: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.3 MiB/s wr, 0 op/s; 2.1 MiB/s, 0 objects/s recovering 2021-07-26T16:02:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:12 smithi033 bash[41341]: cephadm 2021-07-26T16:02:11.531122+0000 mgr.y (mgr.34104) 218 : cephadm [INF] Upgrade: Updating osd.7 2021-07-26T16:02:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:12 smithi033 bash[41341]: audit 2021-07-26T16:02:11.541762+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:12 smithi033 bash[41341]: cephadm 2021-07-26T16:02:11.544976+0000 mgr.y (mgr.34104) 219 : cephadm [INF] Deploying daemon osd.7 on smithi096 2021-07-26T16:02:12.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:12 smithi033 bash[41341]: cluster 2021-07-26T16:02:12.018556+0000 mon.a (mon.0) 593 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2021-07-26T16:02:12.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:12 smithi033 bash[42377]: cluster 2021-07-26T16:02:11.035205+0000 mgr.y (mgr.34104) 217 : cluster [DBG] pgmap v320: 25 pgs: 2 active+clean+wait, 23 active+clean; 193 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.3 MiB/s wr, 0 op/s; 2.1 MiB/s, 0 objects/s recovering 2021-07-26T16:02:12.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:12 smithi033 bash[42377]: cephadm 2021-07-26T16:02:11.531122+0000 mgr.y (mgr.34104) 218 : cephadm [INF] Upgrade: Updating osd.7 2021-07-26T16:02:12.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:12 smithi033 bash[42377]: audit 2021-07-26T16:02:11.541762+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:12.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:12 smithi033 bash[42377]: cephadm 2021-07-26T16:02:11.544976+0000 mgr.y (mgr.34104) 219 : cephadm [INF] Deploying daemon osd.7 on smithi096 2021-07-26T16:02:12.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:12 smithi033 bash[42377]: cluster 2021-07-26T16:02:12.018556+0000 mon.a (mon.0) 593 : cluster [DBG] osdmap e343: 8 total, 8 up, 8 in 2021-07-26T16:02:13.846 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:13 smithi096 systemd[1]: Stopping Ceph osd.7 for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T16:02:13.938 INFO:tasks.rados.rados.0.smithi033.stdout:1407: done (5 left) 2021-07-26T16:02:13.938 INFO:tasks.rados.rados.0.smithi033.stdout:1408: done (4 left) 2021-07-26T16:02:13.938 INFO:tasks.rados.rados.0.smithi033.stdout:1409: done (3 left) 2021-07-26T16:02:13.938 INFO:tasks.rados.rados.0.smithi033.stdout:1410: done (2 left) 2021-07-26T16:02:13.939 INFO:tasks.rados.rados.0.smithi033.stdout:1411: done (1 left) 2021-07-26T16:02:13.939 INFO:tasks.rados.rados.0.smithi033.stdout:1413: done (0 left) 2021-07-26T16:02:13.939 INFO:tasks.rados.rados.0.smithi033.stdout:1414: read oid 43 snap -1 2021-07-26T16:02:13.939 INFO:tasks.rados.rados.0.smithi033.stdout:1414: expect deleted 2021-07-26T16:02:13.940 INFO:tasks.rados.rados.0.smithi033.stdout:1415: setattr oid 26 current snap is 136 2021-07-26T16:02:13.945 INFO:tasks.rados.rados.0.smithi033.stdout:1414: done (1 left) 2021-07-26T16:02:13.945 INFO:tasks.rados.rados.0.smithi033.stdout:1416: read oid 27 snap -1 2021-07-26T16:02:13.945 INFO:tasks.rados.rados.0.smithi033.stdout:1416: expect (ObjNum 321 snap 102 seq_num 321) 2021-07-26T16:02:13.945 INFO:tasks.rados.rados.0.smithi033.stdout:1417: rmattr oid 44 current snap is 136 2021-07-26T16:02:13.946 INFO:tasks.rados.rados.0.smithi033.stdout:1418: copy_from oid 14 from oid 47 current snap is 136 2021-07-26T16:02:13.946 INFO:tasks.rados.rados.0.smithi033.stdout:1419: read oid 46 snap -1 2021-07-26T16:02:13.947 INFO:tasks.rados.rados.0.smithi033.stdout:1419: expect deleted 2021-07-26T16:02:13.947 INFO:tasks.rados.rados.0.smithi033.stdout:1420: snap_create 2021-07-26T16:02:13.951 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 795 (ObjNum 288 snap 0 seq_num 33) dirty exists 2021-07-26T16:02:13.952 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 505 (ObjNum 232 snap 65 seq_num 232) dirty exists 2021-07-26T16:02:13.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:13 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:13.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:13.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:13 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:13.520Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:13.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:13 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:13.520Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:02:13.979 INFO:tasks.rados.rados.0.smithi033.stdout:1416: expect (ObjNum 321 snap 102 seq_num 321) 2021-07-26T16:02:14.155 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:13 smithi096 docker[39153]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:02:14.155 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:13 smithi096 bash[25729]: debug 2021-07-26T16:02:13.915+0000 7fd6150f2700 -1 received signal: Terminated from /sbin/docker-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-07-26T16:02:14.155 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:13 smithi096 bash[25729]: debug 2021-07-26T16:02:13.915+0000 7fd6150f2700 -1 osd.7 343 *** Got signal Terminated *** 2021-07-26T16:02:14.156 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:13 smithi096 bash[25729]: debug 2021-07-26T16:02:13.915+0000 7fd6150f2700 -1 osd.7 343 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:02:14.544 INFO:tasks.rados.rados.0.smithi033.stdout:1418: finishing copy_from to smithi03339061-14 2021-07-26T16:02:14.545 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 642 (ObjNum 423 snap 131 seq_num 423) dirty exists 2021-07-26T16:02:14.545 INFO:tasks.rados.rados.0.smithi033.stdout:1418: finishing copy_from racing read to smithi03339061-14 2021-07-26T16:02:14.560 INFO:tasks.rados.rados.0.smithi033.stdout:1415: done (5 left) 2021-07-26T16:02:14.560 INFO:tasks.rados.rados.0.smithi033.stdout:1416: done (4 left) 2021-07-26T16:02:14.560 INFO:tasks.rados.rados.0.smithi033.stdout:1417: done (3 left) 2021-07-26T16:02:14.561 INFO:tasks.rados.rados.0.smithi033.stdout:1418: done (2 left) 2021-07-26T16:02:14.561 INFO:tasks.rados.rados.0.smithi033.stdout:1420: done (1 left) 2021-07-26T16:02:14.561 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 44 current snap is 137 2021-07-26T16:02:14.561 INFO:tasks.rados.rados.0.smithi033.stdout:1421: seq_num 441 ranges {2097152=188416} 2021-07-26T16:02:14.576 INFO:tasks.rados.rados.0.smithi033.stdout:1421: writing smithi03339061-44 from 2097152 to 2285568 tid 1 2021-07-26T16:02:14.576 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 137 2021-07-26T16:02:14.577 INFO:tasks.rados.rados.0.smithi033.stdout:1422: seq_num 442 ranges {8167424=204800} 2021-07-26T16:02:14.624 INFO:tasks.rados.rados.0.smithi033.stdout:1422: writing smithi03339061-27 from 8167424 to 8372224 tid 1 2021-07-26T16:02:14.624 INFO:tasks.rados.rados.0.smithi033.stdout:1423: delete oid 4 current snap is 137 2021-07-26T16:02:14.624 INFO:tasks.rados.rados.0.smithi033.stdout:1421: finishing write tid 1 to smithi03339061-44 2021-07-26T16:02:14.625 INFO:tasks.rados.rados.0.smithi033.stdout:1421: finishing write tid 2 to smithi03339061-44 2021-07-26T16:02:14.625 INFO:tasks.rados.rados.0.smithi033.stdout:1421: finishing write tid 3 to smithi03339061-44 2021-07-26T16:02:14.625 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 644 (ObjNum 441 snap 137 seq_num 441) dirty exists 2021-07-26T16:02:14.625 INFO:tasks.rados.rados.0.smithi033.stdout:1421: left oid 44 (ObjNum 441 snap 137 seq_num 441) 2021-07-26T16:02:14.627 INFO:tasks.rados.rados.0.smithi033.stdout:1421: done (3 left) 2021-07-26T16:02:14.627 INFO:tasks.rados.rados.0.smithi033.stdout:1423: done (2 left) 2021-07-26T16:02:14.627 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 17 current snap is 137 2021-07-26T16:02:14.627 INFO:tasks.rados.rados.0.smithi033.stdout:1424: seq_num 444 ranges {2490368=237568} 2021-07-26T16:02:14.649 INFO:tasks.rados.rados.0.smithi033.stdout:1424: writing smithi03339061-17 from 2490368 to 2727936 tid 1 2021-07-26T16:02:14.649 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 137 2021-07-26T16:02:14.649 INFO:tasks.rados.rados.0.smithi033.stdout:1425: seq_num 445 ranges {3465216=253952} 2021-07-26T16:02:14.669 INFO:tasks.rados.rados.0.smithi033.stdout:1425: writing smithi03339061-31 from 3465216 to 3719168 tid 1 2021-07-26T16:02:14.670 INFO:tasks.rados.rados.0.smithi033.stdout:1426: read oid 49 snap 136 2021-07-26T16:02:14.670 INFO:tasks.rados.rados.0.smithi033.stdout:1426: expect (ObjNum 275 snap 85 seq_num 275) 2021-07-26T16:02:14.670 INFO:tasks.rados.rados.0.smithi033.stdout:1427: snap_create 2021-07-26T16:02:14.670 INFO:tasks.rados.rados.0.smithi033.stdout:1422: finishing write tid 1 to smithi03339061-27 2021-07-26T16:02:14.671 INFO:tasks.rados.rados.0.smithi033.stdout:1422: finishing write tid 2 to smithi03339061-27 2021-07-26T16:02:14.671 INFO:tasks.rados.rados.0.smithi033.stdout:1422: finishing write tid 3 to smithi03339061-27 2021-07-26T16:02:14.671 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 615 (ObjNum 442 snap 137 seq_num 442) dirty exists 2021-07-26T16:02:14.671 INFO:tasks.rados.rados.0.smithi033.stdout:1422: left oid 27 (ObjNum 442 snap 137 seq_num 442) 2021-07-26T16:02:14.702 INFO:tasks.rados.rados.0.smithi033.stdout:1426: expect (ObjNum 275 snap 85 seq_num 275) 2021-07-26T16:02:14.859 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:14 smithi096 docker[39153]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-osd.7 2021-07-26T16:02:14.860 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:13.035873+0000 mgr.y (mgr.34104) 220 : cluster [DBG] pgmap v322: 25 pgs: 25 active+clean; 188 MiB data, 654 MiB used, 715 GiB / 715 GiB avail; 4.3 MiB/s rd, 21 KiB/s wr, 1 op/s 2021-07-26T16:02:14.860 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.188375+0000 mon.a (mon.0) 594 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-07-26T16:02:14.861 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.188500+0000 mon.a (mon.0) 595 : cluster [INF] osd.7 failed (root=default,host=smithi096) (connection refused reported by osd.1) 2021-07-26T16:02:14.861 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.189114+0000 mon.a (mon.0) 596 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-07-26T16:02:14.861 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.189510+0000 mon.a (mon.0) 597 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-07-26T16:02:14.862 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.190078+0000 mon.a (mon.0) 598 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-07-26T16:02:14.862 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.190609+0000 mon.a (mon.0) 599 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-07-26T16:02:14.862 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.191007+0000 mon.a (mon.0) 600 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-07-26T16:02:14.863 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.191574+0000 mon.a (mon.0) 601 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-07-26T16:02:14.863 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.191897+0000 mon.a (mon.0) 602 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-07-26T16:02:14.863 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.192181+0000 mon.a (mon.0) 603 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-07-26T16:02:14.863 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.192440+0000 mon.a (mon.0) 604 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-07-26T16:02:14.864 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.192698+0000 mon.a (mon.0) 605 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-07-26T16:02:14.864 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.192955+0000 mon.a (mon.0) 606 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-07-26T16:02:14.864 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.193209+0000 mon.a (mon.0) 607 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-07-26T16:02:14.864 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.193456+0000 mon.a (mon.0) 608 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-07-26T16:02:14.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:13.035873+0000 mgr.y (mgr.34104) 220 : cluster [DBG] pgmap v322: 25 pgs: 25 active+clean; 188 MiB data, 654 MiB used, 715 GiB / 715 GiB avail; 4.3 MiB/s rd, 21 KiB/s wr, 1 op/s 2021-07-26T16:02:14.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.188375+0000 mon.a (mon.0) 594 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-07-26T16:02:14.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.188500+0000 mon.a (mon.0) 595 : cluster [INF] osd.7 failed (root=default,host=smithi096) (connection refused reported by osd.1) 2021-07-26T16:02:14.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.189114+0000 mon.a (mon.0) 596 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-07-26T16:02:14.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.189510+0000 mon.a (mon.0) 597 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-07-26T16:02:14.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.190078+0000 mon.a (mon.0) 598 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-07-26T16:02:14.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.190609+0000 mon.a (mon.0) 599 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-07-26T16:02:14.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.191007+0000 mon.a (mon.0) 600 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-07-26T16:02:14.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.191574+0000 mon.a (mon.0) 601 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-07-26T16:02:14.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.191897+0000 mon.a (mon.0) 602 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-07-26T16:02:14.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.192181+0000 mon.a (mon.0) 603 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-07-26T16:02:14.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.192440+0000 mon.a (mon.0) 604 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-07-26T16:02:14.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.192698+0000 mon.a (mon.0) 605 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-07-26T16:02:14.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.192955+0000 mon.a (mon.0) 606 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-07-26T16:02:14.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.193209+0000 mon.a (mon.0) 607 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-07-26T16:02:14.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.193456+0000 mon.a (mon.0) 608 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-07-26T16:02:14.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:13.035873+0000 mgr.y (mgr.34104) 220 : cluster [DBG] pgmap v322: 25 pgs: 25 active+clean; 188 MiB data, 654 MiB used, 715 GiB / 715 GiB avail; 4.3 MiB/s rd, 21 KiB/s wr, 1 op/s 2021-07-26T16:02:14.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.188375+0000 mon.a (mon.0) 594 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-07-26T16:02:14.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.188500+0000 mon.a (mon.0) 595 : cluster [INF] osd.7 failed (root=default,host=smithi096) (connection refused reported by osd.1) 2021-07-26T16:02:14.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.189114+0000 mon.a (mon.0) 596 : cluster [DBG] osd.7 reported immediately failed by osd.1 2021-07-26T16:02:14.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.189510+0000 mon.a (mon.0) 597 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-07-26T16:02:14.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.190078+0000 mon.a (mon.0) 598 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-07-26T16:02:14.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.190609+0000 mon.a (mon.0) 599 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-07-26T16:02:14.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.191007+0000 mon.a (mon.0) 600 : cluster [DBG] osd.7 reported immediately failed by osd.2 2021-07-26T16:02:14.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.191574+0000 mon.a (mon.0) 601 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-07-26T16:02:14.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.191897+0000 mon.a (mon.0) 602 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-07-26T16:02:14.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.192181+0000 mon.a (mon.0) 603 : cluster [DBG] osd.7 reported immediately failed by osd.3 2021-07-26T16:02:14.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.192440+0000 mon.a (mon.0) 604 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-07-26T16:02:14.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.192698+0000 mon.a (mon.0) 605 : cluster [DBG] osd.7 reported immediately failed by osd.0 2021-07-26T16:02:14.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.192955+0000 mon.a (mon.0) 606 : cluster [DBG] osd.7 reported immediately failed by osd.5 2021-07-26T16:02:14.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.193209+0000 mon.a (mon.0) 607 : cluster [DBG] osd.7 reported immediately failed by osd.6 2021-07-26T16:02:14.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:14 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.193456+0000 mon.a (mon.0) 608 : cluster [DBG] osd.7 reported immediately failed by osd.4 2021-07-26T16:02:15.235 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:14 smithi096 bash[39200]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:02:15.571 INFO:tasks.rados.rados.0.smithi033.stdout:1422: done (5 left) 2021-07-26T16:02:15.571 INFO:tasks.rados.rados.0.smithi033.stdout:1426: done (4 left) 2021-07-26T16:02:15.572 INFO:tasks.rados.rados.0.smithi033.stdout:1427: done (3 left) 2021-07-26T16:02:15.572 INFO:tasks.rados.rados.0.smithi033.stdout:1428: snap_create 2021-07-26T16:02:15.575 INFO:tasks.rados.rados.0.smithi033.stdout:1425: finishing write tid 1 to smithi03339061-31 2021-07-26T16:02:15.576 INFO:tasks.rados.rados.0.smithi033.stdout:1425: finishing write tid 2 to smithi03339061-31 2021-07-26T16:02:15.577 INFO:tasks.rados.rados.0.smithi033.stdout:1425: finishing write tid 3 to smithi03339061-31 2021-07-26T16:02:15.577 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 71 (ObjNum 445 snap 137 seq_num 445) dirty exists 2021-07-26T16:02:15.577 INFO:tasks.rados.rados.0.smithi033.stdout:1425: left oid 31 (ObjNum 445 snap 137 seq_num 445) 2021-07-26T16:02:15.578 INFO:tasks.rados.rados.0.smithi033.stdout:1424: finishing write tid 1 to smithi03339061-17 2021-07-26T16:02:15.579 INFO:tasks.rados.rados.0.smithi033.stdout:1424: finishing write tid 2 to smithi03339061-17 2021-07-26T16:02:15.580 INFO:tasks.rados.rados.0.smithi033.stdout:1424: finishing write tid 3 to smithi03339061-17 2021-07-26T16:02:15.580 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 496 (ObjNum 444 snap 137 seq_num 444) dirty exists 2021-07-26T16:02:15.580 INFO:tasks.rados.rados.0.smithi033.stdout:1424: left oid 17 (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:02:15.900 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:15 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.540380+0000 mon.a (mon.0) 609 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:02:15.901 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:15 smithi096 bash[33981]: cluster 2021-07-26T16:02:14.554447+0000 mon.a (mon.0) 610 : cluster [DBG] osdmap e344: 8 total, 7 up, 8 in 2021-07-26T16:02:15.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:15 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.540380+0000 mon.a (mon.0) 609 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:02:15.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:15 smithi033 bash[41341]: cluster 2021-07-26T16:02:14.554447+0000 mon.a (mon.0) 610 : cluster [DBG] osdmap e344: 8 total, 7 up, 8 in 2021-07-26T16:02:15.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:15 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.540380+0000 mon.a (mon.0) 609 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2021-07-26T16:02:15.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:15 smithi033 bash[42377]: cluster 2021-07-26T16:02:14.554447+0000 mon.a (mon.0) 610 : cluster [DBG] osdmap e344: 8 total, 7 up, 8 in 2021-07-26T16:02:16.584 INFO:tasks.rados.rados.0.smithi033.stdout:1419: done (3 left) 2021-07-26T16:02:16.584 INFO:tasks.rados.rados.0.smithi033.stdout:1424: done (2 left) 2021-07-26T16:02:16.585 INFO:tasks.rados.rados.0.smithi033.stdout:1425: done (1 left) 2021-07-26T16:02:16.585 INFO:tasks.rados.rados.0.smithi033.stdout:1428: done (0 left) 2021-07-26T16:02:16.585 INFO:tasks.rados.rados.0.smithi033.stdout:1429: rollback oid 43 current snap is 139 2021-07-26T16:02:16.585 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 43 to 137 2021-07-26T16:02:16.586 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 139 2021-07-26T16:02:16.586 INFO:tasks.rados.rados.0.smithi033.stdout:1430: seq_num 446 ranges {0=278528} 2021-07-26T16:02:16.587 INFO:tasks.rados.rados.0.smithi033.stdout:1430: writing smithi03339061-4 from 0 to 278528 tid 1 2021-07-26T16:02:16.588 INFO:tasks.rados.rados.0.smithi033.stdout:1431: read oid 18 snap -1 2021-07-26T16:02:16.588 INFO:tasks.rados.rados.0.smithi033.stdout:1431: expect (ObjNum 436 snap 136 seq_num 436) 2021-07-26T16:02:16.588 INFO:tasks.rados.rados.0.smithi033.stdout:1432: copy_from oid 6 from oid 29 current snap is 139 2021-07-26T16:02:16.588 INFO:tasks.rados.rados.0.smithi033.stdout:1433: setattr oid 2 current snap is 139 2021-07-26T16:02:16.589 INFO:tasks.rados.rados.0.smithi033.stdout:1429: finishing rollback tid 1 to smithi03339061-43 2021-07-26T16:02:16.589 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 0 (ObjNum 1716411495 snap 1432572249 seq_num 1566531163) dirty dne 2021-07-26T16:02:16.591 INFO:tasks.rados.rados.0.smithi033.stdout:1429: done (4 left) 2021-07-26T16:02:16.591 INFO:tasks.rados.rados.0.smithi033.stdout:1434: rollback oid 45 current snap is 139 2021-07-26T16:02:16.591 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 45 to 136 2021-07-26T16:02:16.592 INFO:tasks.rados.rados.0.smithi033.stdout:1435: read oid 33 snap -1 2021-07-26T16:02:16.592 INFO:tasks.rados.rados.0.smithi033.stdout:1435: expect (ObjNum 397 snap 122 seq_num 397) 2021-07-26T16:02:16.592 INFO:tasks.rados.rados.0.smithi033.stdout:1436: copy_from oid 24 from oid 50 current snap is 139 2021-07-26T16:02:16.592 INFO:tasks.rados.rados.0.smithi033.stdout:1437: delete oid 20 current snap is 139 2021-07-26T16:02:16.593 INFO:tasks.rados.rados.0.smithi033.stdout:1431: expect (ObjNum 436 snap 136 seq_num 436) 2021-07-26T16:02:16.598 INFO:tasks.rados.rados.0.smithi033.stdout:1430: finishing write tid 1 to smithi03339061-4 2021-07-26T16:02:16.598 INFO:tasks.rados.rados.0.smithi033.stdout:1430: finishing write tid 2 to smithi03339061-4 2021-07-26T16:02:16.599 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 365 (ObjNum 295 snap 91 seq_num 295) dirty exists 2021-07-26T16:02:16.599 INFO:tasks.rados.rados.0.smithi033.stdout:1431: done (7 left) 2021-07-26T16:02:16.600 INFO:tasks.rados.rados.0.smithi033.stdout:1433: done (6 left) 2021-07-26T16:02:16.600 INFO:tasks.rados.rados.0.smithi033.stdout:1437: done (5 left) 2021-07-26T16:02:16.600 INFO:tasks.rados.rados.0.smithi033.stdout:1438: rollback oid 41 current snap is 139 2021-07-26T16:02:16.600 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 41 to 136 2021-07-26T16:02:16.600 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 139 2021-07-26T16:02:16.601 INFO:tasks.rados.rados.0.smithi033.stdout:1439: seq_num 448 ranges {1622016=311296} 2021-07-26T16:02:16.610 INFO:tasks.rados.rados.0.smithi033.stdout:1439: writing smithi03339061-39 from 1622016 to 1933312 tid 1 2021-07-26T16:02:16.610 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 139 2021-07-26T16:02:16.611 INFO:tasks.rados.rados.0.smithi033.stdout:1440: seq_num 449 ranges {5668864=327680} 2021-07-26T16:02:16.645 INFO:tasks.rados.rados.0.smithi033.stdout:1440: writing smithi03339061-42 from 5668864 to 5996544 tid 1 2021-07-26T16:02:16.645 INFO:tasks.rados.rados.0.smithi033.stdout:1441: read oid 32 snap -1 2021-07-26T16:02:16.646 INFO:tasks.rados.rados.0.smithi033.stdout:1441: expect (ObjNum 430 snap 135 seq_num 430) 2021-07-26T16:02:16.646 INFO:tasks.rados.rados.0.smithi033.stdout:1442: read oid 10 snap -1 2021-07-26T16:02:16.646 INFO:tasks.rados.rados.0.smithi033.stdout:1442: expect (ObjNum 425 snap 132 seq_num 425) 2021-07-26T16:02:16.646 INFO:tasks.rados.rados.0.smithi033.stdout:1443: read oid 15 snap 138 2021-07-26T16:02:16.647 INFO:tasks.rados.rados.0.smithi033.stdout:1443: expect (ObjNum 414 snap 131 seq_num 414) 2021-07-26T16:02:16.647 INFO:tasks.rados.rados.0.smithi033.stdout:1444: delete oid 2 current snap is 139 2021-07-26T16:02:16.647 INFO:tasks.rados.rados.0.smithi033.stdout:1430: finishing write tid 3 to smithi03339061-4 2021-07-26T16:02:16.647 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 647 (ObjNum 446 snap 139 seq_num 446) dirty exists 2021-07-26T16:02:16.647 INFO:tasks.rados.rados.0.smithi033.stdout:1430: left oid 4 (ObjNum 446 snap 139 seq_num 446) 2021-07-26T16:02:16.648 INFO:tasks.rados.rados.0.smithi033.stdout:1434: finishing rollback tid 0 to smithi03339061-45 2021-07-26T16:02:16.648 INFO:tasks.rados.rados.0.smithi033.stdout:1434: finishing rollback tid 1 to smithi03339061-45 2021-07-26T16:02:16.648 INFO:tasks.rados.rados.0.smithi033.stdout:1434: finishing rollback tid 2 to smithi03339061-45 2021-07-26T16:02:16.648 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 799 (ObjNum 435 snap 136 seq_num 435) dirty exists 2021-07-26T16:02:16.648 INFO:tasks.rados.rados.0.smithi033.stdout:1438: finishing rollback tid 0 to smithi03339061-41 2021-07-26T16:02:16.649 INFO:tasks.rados.rados.0.smithi033.stdout:1438: finishing rollback tid 1 to smithi03339061-41 2021-07-26T16:02:16.649 INFO:tasks.rados.rados.0.smithi033.stdout:1438: finishing rollback tid 2 to smithi03339061-41 2021-07-26T16:02:16.650 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 511 (ObjNum 417 snap 131 seq_num 417) dirty exists 2021-07-26T16:02:16.650 INFO:tasks.rados.rados.0.smithi033.stdout:1439: finishing write tid 1 to smithi03339061-39 2021-07-26T16:02:16.650 INFO:tasks.rados.rados.0.smithi033.stdout:1439: finishing write tid 2 to smithi03339061-39 2021-07-26T16:02:16.650 INFO:tasks.rados.rados.0.smithi033.stdout:1439: finishing write tid 3 to smithi03339061-39 2021-07-26T16:02:16.651 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 618 (ObjNum 448 snap 139 seq_num 448) dirty exists 2021-07-26T16:02:16.651 INFO:tasks.rados.rados.0.smithi033.stdout:1439: left oid 39 (ObjNum 448 snap 139 seq_num 448) 2021-07-26T16:02:16.651 INFO:tasks.rados.rados.0.smithi033.stdout:1435: expect (ObjNum 397 snap 122 seq_num 397) 2021-07-26T16:02:16.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:16 smithi096 bash[33981]: cluster 2021-07-26T16:02:15.036501+0000 mgr.y (mgr.34104) 221 : cluster [DBG] pgmap v324: 25 pgs: 6 stale+active+clean, 19 active+clean; 188 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 7.7 MiB/s rd, 21 KiB/s wr, 1 op/s 2021-07-26T16:02:16.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:16 smithi096 bash[33981]: cluster 2021-07-26T16:02:15.563841+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e345: 8 total, 7 up, 8 in 2021-07-26T16:02:16.912 INFO:tasks.rados.rados.0.smithi033.stdout:1432: finishing copy_from to smithi03339061-6 2021-07-26T16:02:16.912 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 194 (ObjNum 405 snap 128 seq_num 405) dirty exists 2021-07-26T16:02:16.912 INFO:tasks.rados.rados.0.smithi033.stdout:1432: finishing copy_from racing read to smithi03339061-6 2021-07-26T16:02:16.912 INFO:tasks.rados.rados.0.smithi033.stdout:1430: done (11 left) 2021-07-26T16:02:16.913 INFO:tasks.rados.rados.0.smithi033.stdout:1432: done (10 left) 2021-07-26T16:02:16.913 INFO:tasks.rados.rados.0.smithi033.stdout:1434: done (9 left) 2021-07-26T16:02:16.913 INFO:tasks.rados.rados.0.smithi033.stdout:1435: done (8 left) 2021-07-26T16:02:16.913 INFO:tasks.rados.rados.0.smithi033.stdout:1438: done (7 left) 2021-07-26T16:02:16.913 INFO:tasks.rados.rados.0.smithi033.stdout:1439: done (6 left) 2021-07-26T16:02:16.914 INFO:tasks.rados.rados.0.smithi033.stdout:1444: done (5 left) 2021-07-26T16:02:16.914 INFO:tasks.rados.rados.0.smithi033.stdout:1445: read oid 9 snap -1 2021-07-26T16:02:16.914 INFO:tasks.rados.rados.0.smithi033.stdout:1445: expect (ObjNum 424 snap 132 seq_num 424) 2021-07-26T16:02:16.914 INFO:tasks.rados.rados.0.smithi033.stdout:1446: read oid 47 snap -1 2021-07-26T16:02:16.915 INFO:tasks.rados.rados.0.smithi033.stdout:1446: expect (ObjNum 423 snap 131 seq_num 423) 2021-07-26T16:02:16.915 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 139 2021-07-26T16:02:16.915 INFO:tasks.rados.rados.0.smithi033.stdout:1436: finishing copy_from to smithi03339061-24 2021-07-26T16:02:16.915 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 355 (ObjNum 408 snap 129 seq_num 408) dirty exists 2021-07-26T16:02:16.915 INFO:tasks.rados.rados.0.smithi033.stdout:1436: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:02:16.916 INFO:tasks.rados.rados.0.smithi033.stdout:1440: finishing write tid 1 to smithi03339061-42 2021-07-26T16:02:16.916 INFO:tasks.rados.rados.0.smithi033.stdout:1440: finishing write tid 2 to smithi03339061-42 2021-07-26T16:02:16.916 INFO:tasks.rados.rados.0.smithi033.stdout:1440: finishing write tid 3 to smithi03339061-42 2021-07-26T16:02:16.916 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 251 (ObjNum 449 snap 139 seq_num 449) dirty exists 2021-07-26T16:02:16.916 INFO:tasks.rados.rados.0.smithi033.stdout:1440: left oid 42 (ObjNum 449 snap 139 seq_num 449) 2021-07-26T16:02:16.917 INFO:tasks.rados.rados.0.smithi033.stdout:1447: seq_num 451 ranges {598016=360448} 2021-07-26T16:02:16.917 INFO:tasks.rados.rados.0.smithi033.stdout:1447: writing smithi03339061-23 from 598016 to 958464 tid 1 2021-07-26T16:02:16.918 INFO:tasks.rados.rados.0.smithi033.stdout:1436: done (7 left) 2021-07-26T16:02:16.918 INFO:tasks.rados.rados.0.smithi033.stdout:1440: done (6 left) 2021-07-26T16:02:16.918 INFO:tasks.rados.rados.0.smithi033.stdout:1448: snap_remove snap 137 2021-07-26T16:02:16.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:16 smithi033 bash[42377]: cluster 2021-07-26T16:02:15.036501+0000 mgr.y (mgr.34104) 221 : cluster [DBG] pgmap v324: 25 pgs: 6 stale+active+clean, 19 active+clean; 188 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 7.7 MiB/s rd, 21 KiB/s wr, 1 op/s 2021-07-26T16:02:16.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:16 smithi033 bash[42377]: cluster 2021-07-26T16:02:15.563841+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e345: 8 total, 7 up, 8 in 2021-07-26T16:02:16.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:16 smithi033 bash[41341]: cluster 2021-07-26T16:02:15.036501+0000 mgr.y (mgr.34104) 221 : cluster [DBG] pgmap v324: 25 pgs: 6 stale+active+clean, 19 active+clean; 188 MiB data, 650 MiB used, 715 GiB / 715 GiB avail; 7.7 MiB/s rd, 21 KiB/s wr, 1 op/s 2021-07-26T16:02:16.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:16 smithi033 bash[41341]: cluster 2021-07-26T16:02:15.563841+0000 mon.a (mon.0) 611 : cluster [DBG] osdmap e345: 8 total, 7 up, 8 in 2021-07-26T16:02:17.324 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:17 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@osd.7.service: Succeeded. 2021-07-26T16:02:17.325 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:17 smithi096 systemd[1]: Stopped Ceph osd.7 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:02:17.325 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:17 smithi096 systemd[1]: Started Ceph osd.7 for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:02:17.587 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:17 smithi096 bash[39316]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:02:17.594 INFO:tasks.rados.rados.0.smithi033.stdout:1448: done (6 left) 2021-07-26T16:02:17.594 INFO:tasks.rados.rados.0.smithi033.stdout:1449: read oid 36 snap -1 2021-07-26T16:02:17.594 INFO:tasks.rados.rados.0.smithi033.stdout:1449: expect (ObjNum 431 snap 135 seq_num 431) 2021-07-26T16:02:17.595 INFO:tasks.rados.rados.0.smithi033.stdout:1450: rmattr oid 13 current snap is 139 2021-07-26T16:02:17.595 INFO:tasks.rados.rados.0.smithi033.stdout:1450: done (7 left) 2021-07-26T16:02:17.595 INFO:tasks.rados.rados.0.smithi033.stdout:1451: read oid 27 snap 136 2021-07-26T16:02:17.595 INFO:tasks.rados.rados.0.smithi033.stdout:1451: expect (ObjNum 321 snap 102 seq_num 321) 2021-07-26T16:02:17.595 INFO:tasks.rados.rados.0.smithi033.stdout:1452: snap_create 2021-07-26T16:02:17.596 INFO:tasks.rados.rados.0.smithi033.stdout:1442: expect (ObjNum 425 snap 132 seq_num 425) 2021-07-26T16:02:17.855 INFO:tasks.rados.rados.0.smithi033.stdout:1443: expect (ObjNum 414 snap 131 seq_num 414) 2021-07-26T16:02:17.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:17 smithi033 bash[41341]: cluster 2021-07-26T16:02:16.580965+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e346: 8 total, 7 up, 8 in 2021-07-26T16:02:17.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:17 smithi033 bash[41341]: audit 2021-07-26T16:02:17.277247+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:17.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:17 smithi033 bash[41341]: audit 2021-07-26T16:02:17.281403+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:17.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:17 smithi033 bash[41341]: audit 2021-07-26T16:02:17.283737+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:17.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:17 smithi033 bash[41341]: audit 2021-07-26T16:02:17.285562+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:17.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:17 smithi033 bash[42377]: cluster 2021-07-26T16:02:16.580965+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e346: 8 total, 7 up, 8 in 2021-07-26T16:02:17.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:17 smithi033 bash[42377]: audit 2021-07-26T16:02:17.277247+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:17.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:17 smithi033 bash[42377]: audit 2021-07-26T16:02:17.281403+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:17.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:17 smithi033 bash[42377]: audit 2021-07-26T16:02:17.283737+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:17.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:17 smithi033 bash[42377]: audit 2021-07-26T16:02:17.285562+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:17.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:17 smithi096 bash[33981]: cluster 2021-07-26T16:02:16.580965+0000 mon.a (mon.0) 612 : cluster [DBG] osdmap e346: 8 total, 7 up, 8 in 2021-07-26T16:02:17.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:17 smithi096 bash[33981]: audit 2021-07-26T16:02:17.277247+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:17.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:17 smithi096 bash[33981]: audit 2021-07-26T16:02:17.281403+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:17.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:17 smithi096 bash[33981]: audit 2021-07-26T16:02:17.283737+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:17.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:17 smithi096 bash[33981]: audit 2021-07-26T16:02:17.285562+0000 mon.c (mon.1) 112 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:18.102 INFO:tasks.rados.rados.0.smithi033.stdout:1441: expect (ObjNum 430 snap 135 seq_num 430) 2021-07-26T16:02:18.806 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T16:02:18.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:18 smithi033 bash[41341]: cluster 2021-07-26T16:02:17.037365+0000 mgr.y (mgr.34104) 222 : cluster [DBG] pgmap v327: 25 pgs: 1 active+undersized, 4 active+undersized+degraded, 2 peering, 1 stale+active+clean, 17 active+clean; 195 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 18 MiB/s rd, 1.7 MiB/s wr, 6 op/s; 8/150 objects degraded (5.333%) 2021-07-26T16:02:18.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:18 smithi033 bash[41341]: cluster 2021-07-26T16:02:17.573224+0000 mon.a (mon.0) 614 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-07-26T16:02:18.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:18 smithi033 bash[41341]: cluster 2021-07-26T16:02:17.573293+0000 mon.a (mon.0) 615 : cluster [WRN] Health check failed: Degraded data redundancy: 8/150 objects degraded (5.333%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:18.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:18 smithi033 bash[41341]: cluster 2021-07-26T16:02:17.589974+0000 mon.a (mon.0) 616 : cluster [DBG] osdmap e347: 8 total, 7 up, 8 in 2021-07-26T16:02:18.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:18 smithi033 bash[42377]: cluster 2021-07-26T16:02:17.037365+0000 mgr.y (mgr.34104) 222 : cluster [DBG] pgmap v327: 25 pgs: 1 active+undersized, 4 active+undersized+degraded, 2 peering, 1 stale+active+clean, 17 active+clean; 195 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 18 MiB/s rd, 1.7 MiB/s wr, 6 op/s; 8/150 objects degraded (5.333%) 2021-07-26T16:02:18.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:18 smithi033 bash[42377]: cluster 2021-07-26T16:02:17.573224+0000 mon.a (mon.0) 614 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-07-26T16:02:18.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:18 smithi033 bash[42377]: cluster 2021-07-26T16:02:17.573293+0000 mon.a (mon.0) 615 : cluster [WRN] Health check failed: Degraded data redundancy: 8/150 objects degraded (5.333%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:18.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:18 smithi033 bash[42377]: cluster 2021-07-26T16:02:17.589974+0000 mon.a (mon.0) 616 : cluster [DBG] osdmap e347: 8 total, 7 up, 8 in 2021-07-26T16:02:18.974 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:18 smithi096 bash[33981]: cluster 2021-07-26T16:02:17.037365+0000 mgr.y (mgr.34104) 222 : cluster [DBG] pgmap v327: 25 pgs: 1 active+undersized, 4 active+undersized+degraded, 2 peering, 1 stale+active+clean, 17 active+clean; 195 MiB data, 660 MiB used, 715 GiB / 715 GiB avail; 18 MiB/s rd, 1.7 MiB/s wr, 6 op/s; 8/150 objects degraded (5.333%) 2021-07-26T16:02:18.975 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:18 smithi096 bash[33981]: cluster 2021-07-26T16:02:17.573224+0000 mon.a (mon.0) 614 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-07-26T16:02:18.975 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:18 smithi096 bash[33981]: cluster 2021-07-26T16:02:17.573293+0000 mon.a (mon.0) 615 : cluster [WRN] Health check failed: Degraded data redundancy: 8/150 objects degraded (5.333%), 4 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:18.975 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:18 smithi096 bash[33981]: cluster 2021-07-26T16:02:17.589974+0000 mon.a (mon.0) 616 : cluster [DBG] osdmap e347: 8 total, 7 up, 8 in 2021-07-26T16:02:18.976 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:18 smithi096 bash[39316]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-07-26T16:02:18.976 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:18 smithi096 bash[39316]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-07-26T16:02:18.976 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:18 smithi096 bash[39316]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-07-26T16:02:18.977 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:18 smithi096 bash[39316]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-07-26T16:02:18.977 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:18 smithi096 bash[39316]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-07-26T16:02:18.978 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:18 smithi096 bash[39316]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-07-26T16:02:18.978 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:18 smithi096 bash[39316]: --> ceph-volume lvm activate successful for osd ID: 7 2021-07-26T16:02:19.129 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T16:02:19.129 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (8m) 90s ago 9m 15.1M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T16:02:19.129 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (9m) 25s ago 9m 25.6M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T16:02:19.129 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (4m) 25s ago 13m 373M - 17.0.0-6381-gbccf07c2 6cdb40438e66 909ec99bd712 2021-07-26T16:02:19.130 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (4m) 90s ago 16m 416M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T16:02:19.130 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (4m) 90s ago 16m 50.6M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 7649338580a7 2021-07-26T16:02:19.130 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (3m) 25s ago 13m 43.2M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 5a3d2fea4cb3 2021-07-26T16:02:19.130 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (3m) 90s ago 14m 42.9M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 76ce8786552e 2021-07-26T16:02:19.131 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (9m) 90s ago 9m 11.2M - 0.18.1 e5a616e4b9cf 4e57a809ad10 2021-07-26T16:02:19.131 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (9m) 25s ago 9m 11.9M - 0.18.1 e5a616e4b9cf 2cd3148b8449 2021-07-26T16:02:19.131 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (2m) 90s ago 13m 123M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 7275343c45f7 2021-07-26T16:02:19.131 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (2m) 90s ago 12m 116M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 778afc05022e 2021-07-26T16:02:19.131 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (2m) 90s ago 12m 99.6M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 e78ad82b00b5 2021-07-26T16:02:19.132 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (91s) 90s ago 11m - 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 315a7c006da7 2021-07-26T16:02:19.132 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (63s) 25s ago 11m 158M 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 545d7f10ed9e 2021-07-26T16:02:19.132 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (55s) 25s ago 11m 108M 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 1c135b673521 2021-07-26T16:02:19.132 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (27s) 25s ago 10m - 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 edd8a674092a 2021-07-26T16:02:19.132 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 starting - - - 3552M 2021-07-26T16:02:19.133 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (8m) 25s ago 9m 39.9M - 2.18.1 de242295e225 a11ef3961015 2021-07-26T16:02:19.183 INFO:tasks.rados.rados.0.smithi033.stdout:1447: finishing write tid 1 to smithi03339061-23 2021-07-26T16:02:19.183 INFO:tasks.rados.rados.0.smithi033.stdout:1447: finishing write tid 2 to smithi03339061-23 2021-07-26T16:02:19.183 INFO:tasks.rados.rados.0.smithi033.stdout:1447: finishing write tid 3 to smithi03339061-23 2021-07-26T16:02:19.184 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 621 (ObjNum 451 snap 139 seq_num 451) dirty exists 2021-07-26T16:02:19.184 INFO:tasks.rados.rados.0.smithi033.stdout:1447: left oid 23 (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:02:19.184 INFO:tasks.rados.rados.0.smithi033.stdout:1445: expect (ObjNum 424 snap 132 seq_num 424) 2021-07-26T16:02:19.365 INFO:tasks.rados.rados.0.smithi033.stdout:1446: expect (ObjNum 423 snap 131 seq_num 423) 2021-07-26T16:02:19.509 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T16:02:19.510 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T16:02:19.510 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T16:02:19.510 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:02:19.510 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T16:02:19.510 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T16:02:19.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:02:19.511 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T16:02:19.511 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 7 2021-07-26T16:02:19.511 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:02:19.512 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T16:02:19.512 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T16:02:19.512 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 12 2021-07-26T16:02:19.512 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T16:02:19.512 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T16:02:19.774 INFO:tasks.rados.rados.0.smithi033.stdout:1449: expect (ObjNum 431 snap 135 seq_num 431) 2021-07-26T16:02:19.775 INFO:tasks.rados.rados.0.smithi033.stdout:1451: expect (ObjNum 321 snap 102 seq_num 321) 2021-07-26T16:02:19.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:19 smithi033 bash[41341]: cluster 2021-07-26T16:02:18.596164+0000 mon.a (mon.0) 617 : cluster [DBG] osdmap e348: 8 total, 7 up, 8 in 2021-07-26T16:02:19.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:19 smithi033 bash[41341]: audit 2021-07-26T16:02:19.506555+0000 mon.a (mon.0) 618 : audit [DBG] from='client.? 172.21.15.33:0/2777174266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:19.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:19 smithi033 bash[42377]: cluster 2021-07-26T16:02:18.596164+0000 mon.a (mon.0) 617 : cluster [DBG] osdmap e348: 8 total, 7 up, 8 in 2021-07-26T16:02:19.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:19 smithi033 bash[42377]: audit 2021-07-26T16:02:19.506555+0000 mon.a (mon.0) 618 : audit [DBG] from='client.? 172.21.15.33:0/2777174266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:19.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:19 smithi096 bash[33981]: cluster 2021-07-26T16:02:18.596164+0000 mon.a (mon.0) 617 : cluster [DBG] osdmap e348: 8 total, 7 up, 8 in 2021-07-26T16:02:19.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:19 smithi096 bash[33981]: audit 2021-07-26T16:02:19.506555+0000 mon.a (mon.0) 618 : audit [DBG] from='client.? 172.21.15.33:0/2777174266' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:19.986 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:19 smithi096 bash[39437]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:02:20.328 INFO:tasks.rados.rados.0.smithi033.stdout:1441: done (8 left) 2021-07-26T16:02:20.328 INFO:tasks.rados.rados.0.smithi033.stdout:1442: done (7 left) 2021-07-26T16:02:20.329 INFO:tasks.rados.rados.0.smithi033.stdout:1443: done (6 left) 2021-07-26T16:02:20.329 INFO:tasks.rados.rados.0.smithi033.stdout:1445: done (5 left) 2021-07-26T16:02:20.330 INFO:tasks.rados.rados.0.smithi033.stdout:1446: done (4 left) 2021-07-26T16:02:20.330 INFO:tasks.rados.rados.0.smithi033.stdout:1447: done (3 left) 2021-07-26T16:02:20.330 INFO:tasks.rados.rados.0.smithi033.stdout:1449: done (2 left) 2021-07-26T16:02:20.330 INFO:tasks.rados.rados.0.smithi033.stdout:1451: done (1 left) 2021-07-26T16:02:20.331 INFO:tasks.rados.rados.0.smithi033.stdout:1452: done (0 left) 2021-07-26T16:02:20.331 INFO:tasks.rados.rados.0.smithi033.stdout:1453: copy_from oid 50 from oid 10 current snap is 140 2021-07-26T16:02:20.331 INFO:tasks.rados.rados.0.smithi033.stdout:1454: snap_remove snap 139 2021-07-26T16:02:20.625 INFO:tasks.rados.rados.0.smithi033.stdout:1454: done (1 left) 2021-07-26T16:02:20.625 INFO:tasks.rados.rados.0.smithi033.stdout:1455: copy_from oid 5 from oid 2 current snap is 140 2021-07-26T16:02:20.626 INFO:tasks.rados.rados.0.smithi033.stdout:1453: finishing copy_from to smithi03339061-50 2021-07-26T16:02:20.626 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 648 (ObjNum 425 snap 132 seq_num 425) dirty exists 2021-07-26T16:02:20.627 INFO:tasks.rados.rados.0.smithi033.stdout:1453: finishing copy_from racing read to smithi03339061-50 2021-07-26T16:02:20.627 INFO:tasks.rados.rados.0.smithi033.stdout:1453: done (1 left) 2021-07-26T16:02:20.627 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 140 2021-07-26T16:02:20.628 INFO:tasks.rados.rados.0.smithi033.stdout:1456: seq_num 452 ranges {0=376832} 2021-07-26T16:02:20.629 INFO:tasks.rados.rados.0.smithi033.stdout:1456: writing smithi03339061-7 from 0 to 376832 tid 1 2021-07-26T16:02:20.630 INFO:tasks.rados.rados.0.smithi033.stdout:1457: snap_create 2021-07-26T16:02:20.630 INFO:tasks.rados.rados.0.smithi033.stdout:1455: finishing copy_from to smithi03339061-5 2021-07-26T16:02:20.631 INFO:tasks.rados.rados.0.smithi033.stdout:1455: got expected ENOENT (src dne) 2021-07-26T16:02:20.631 INFO:tasks.rados.rados.0.smithi033.stdout:1455: finishing copy_from racing read to smithi03339061-5 2021-07-26T16:02:20.632 INFO:tasks.rados.rados.0.smithi033.stdout:1456: finishing write tid 1 to smithi03339061-7 2021-07-26T16:02:20.633 INFO:tasks.rados.rados.0.smithi033.stdout:1456: finishing write tid 2 to smithi03339061-7 2021-07-26T16:02:20.634 INFO:tasks.rados.rados.0.smithi033.stdout:1456: finishing write tid 3 to smithi03339061-7 2021-07-26T16:02:20.635 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 627 (ObjNum 452 snap 140 seq_num 452) dirty exists 2021-07-26T16:02:20.635 INFO:tasks.rados.rados.0.smithi033.stdout:1456: left oid 7 (ObjNum 452 snap 140 seq_num 452) 2021-07-26T16:02:20.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:20 smithi033 bash[41341]: audit 2021-07-26T16:02:18.784039+0000 mgr.y (mgr.34104) 223 : audit [DBG] from='client.44257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:20.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:20 smithi033 bash[41341]: cluster 2021-07-26T16:02:19.037877+0000 mgr.y (mgr.34104) 224 : cluster [DBG] pgmap v330: 25 pgs: 2 active+undersized, 6 active+undersized+degraded, 2 peering, 1 stale+active+clean, 14 active+clean; 207 MiB data, 678 MiB used, 715 GiB / 715 GiB avail; 42 MiB/s rd, 5.2 MiB/s wr, 21 op/s; 14/174 objects degraded (8.046%) 2021-07-26T16:02:20.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:20 smithi033 bash[41341]: audit 2021-07-26T16:02:19.111038+0000 mgr.y (mgr.34104) 225 : audit [DBG] from='client.44263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:20.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:20 smithi033 bash[42377]: audit 2021-07-26T16:02:18.784039+0000 mgr.y (mgr.34104) 223 : audit [DBG] from='client.44257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:20.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:20 smithi033 bash[42377]: cluster 2021-07-26T16:02:19.037877+0000 mgr.y (mgr.34104) 224 : cluster [DBG] pgmap v330: 25 pgs: 2 active+undersized, 6 active+undersized+degraded, 2 peering, 1 stale+active+clean, 14 active+clean; 207 MiB data, 678 MiB used, 715 GiB / 715 GiB avail; 42 MiB/s rd, 5.2 MiB/s wr, 21 op/s; 14/174 objects degraded (8.046%) 2021-07-26T16:02:20.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:20 smithi033 bash[42377]: audit 2021-07-26T16:02:19.111038+0000 mgr.y (mgr.34104) 225 : audit [DBG] from='client.44263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:20.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:20 smithi096 bash[33981]: audit 2021-07-26T16:02:18.784039+0000 mgr.y (mgr.34104) 223 : audit [DBG] from='client.44257 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:20.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:20 smithi096 bash[33981]: cluster 2021-07-26T16:02:19.037877+0000 mgr.y (mgr.34104) 224 : cluster [DBG] pgmap v330: 25 pgs: 2 active+undersized, 6 active+undersized+degraded, 2 peering, 1 stale+active+clean, 14 active+clean; 207 MiB data, 678 MiB used, 715 GiB / 715 GiB avail; 42 MiB/s rd, 5.2 MiB/s wr, 21 op/s; 14/174 objects degraded (8.046%) 2021-07-26T16:02:20.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:20 smithi096 bash[33981]: audit 2021-07-26T16:02:19.111038+0000 mgr.y (mgr.34104) 225 : audit [DBG] from='client.44263 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:21.631 INFO:tasks.rados.rados.0.smithi033.stdout:1455: done (2 left) 2021-07-26T16:02:21.632 INFO:tasks.rados.rados.0.smithi033.stdout:1456: done (1 left) 2021-07-26T16:02:21.632 INFO:tasks.rados.rados.0.smithi033.stdout:1457: done (0 left) 2021-07-26T16:02:21.632 INFO:tasks.rados.rados.0.smithi033.stdout:1458: read oid 9 snap -1 2021-07-26T16:02:21.632 INFO:tasks.rados.rados.0.smithi033.stdout:1458: expect (ObjNum 424 snap 132 seq_num 424) 2021-07-26T16:02:21.633 INFO:tasks.rados.rados.0.smithi033.stdout:1459: read oid 49 snap 140 2021-07-26T16:02:21.633 INFO:tasks.rados.rados.0.smithi033.stdout:1459: expect (ObjNum 275 snap 85 seq_num 275) 2021-07-26T16:02:21.633 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 141 2021-07-26T16:02:21.633 INFO:tasks.rados.rados.0.smithi033.stdout:1460: seq_num 453 ranges {5996544=393216} 2021-07-26T16:02:21.669 INFO:tasks.rados.rados.0.smithi033.stdout:1460: writing smithi03339061-38 from 5996544 to 6389760 tid 1 2021-07-26T16:02:21.669 INFO:tasks.rados.rados.0.smithi033.stdout:1461: copy_from oid 5 from oid 22 current snap is 141 2021-07-26T16:02:21.670 INFO:tasks.rados.rados.0.smithi033.stdout:1458: expect (ObjNum 424 snap 132 seq_num 424) 2021-07-26T16:02:21.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:21 smithi096 bash[33981]: cluster 2021-07-26T16:02:20.618569+0000 mon.a (mon.0) 619 : cluster [DBG] osdmap e349: 8 total, 7 up, 8 in 2021-07-26T16:02:21.735 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:21 smithi096 bash[39437]: debug 2021-07-26T16:02:21.383+0000 7f75ec4e60c0 -1 Falling back to public interface 2021-07-26T16:02:21.867 INFO:tasks.rados.rados.0.smithi033.stdout:1459: expect (ObjNum 275 snap 85 seq_num 275) 2021-07-26T16:02:21.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:21 smithi033 bash[41341]: cluster 2021-07-26T16:02:20.618569+0000 mon.a (mon.0) 619 : cluster [DBG] osdmap e349: 8 total, 7 up, 8 in 2021-07-26T16:02:21.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:21 smithi033 bash[42377]: cluster 2021-07-26T16:02:20.618569+0000 mon.a (mon.0) 619 : cluster [DBG] osdmap e349: 8 total, 7 up, 8 in 2021-07-26T16:02:22.141 INFO:tasks.rados.rados.0.smithi033.stdout:1458: done (3 left) 2021-07-26T16:02:22.141 INFO:tasks.rados.rados.0.smithi033.stdout:1459: done (2 left) 2021-07-26T16:02:22.142 INFO:tasks.rados.rados.0.smithi033.stdout:1462: delete oid 11 current snap is 141 2021-07-26T16:02:22.142 INFO:tasks.rados.rados.0.smithi033.stdout:1460: finishing write tid 1 to smithi03339061-38 2021-07-26T16:02:22.142 INFO:tasks.rados.rados.0.smithi033.stdout:1460: finishing write tid 2 to smithi03339061-38 2021-07-26T16:02:22.142 INFO:tasks.rados.rados.0.smithi033.stdout:1460: finishing write tid 3 to smithi03339061-38 2021-07-26T16:02:22.143 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 434 (ObjNum 453 snap 141 seq_num 453) dirty exists 2021-07-26T16:02:22.143 INFO:tasks.rados.rados.0.smithi033.stdout:1460: left oid 38 (ObjNum 453 snap 141 seq_num 453) 2021-07-26T16:02:22.143 INFO:tasks.rados.rados.0.smithi033.stdout:1461: finishing copy_from to smithi03339061-5 2021-07-26T16:02:22.143 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 777 (ObjNum 432 snap 135 seq_num 432) dirty exists 2021-07-26T16:02:22.144 INFO:tasks.rados.rados.0.smithi033.stdout:1461: finishing copy_from racing read to smithi03339061-5 2021-07-26T16:02:22.144 INFO:tasks.rados.rados.0.smithi033.stdout:1460: done (2 left) 2021-07-26T16:02:22.144 INFO:tasks.rados.rados.0.smithi033.stdout:1461: done (1 left) 2021-07-26T16:02:22.145 INFO:tasks.rados.rados.0.smithi033.stdout:1462: done (0 left) 2021-07-26T16:02:22.145 INFO:tasks.rados.rados.0.smithi033.stdout:1463: delete oid 34 current snap is 141 2021-07-26T16:02:22.148 INFO:tasks.rados.rados.0.smithi033.stdout:1463: done (0 left) 2021-07-26T16:02:22.148 INFO:tasks.rados.rados.0.smithi033.stdout:1464: snap_create 2021-07-26T16:02:22.741 INFO:tasks.rados.rados.0.smithi033.stdout:1464: done (0 left) 2021-07-26T16:02:22.741 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 142 2021-07-26T16:02:22.742 INFO:tasks.rados.rados.0.smithi033.stdout:1465: seq_num 456 ranges {6414336=442368} 2021-07-26T16:02:22.781 INFO:tasks.rados.rados.0.smithi033.stdout:1465: writing smithi03339061-49 from 6414336 to 6856704 tid 1 2021-07-26T16:02:22.782 INFO:tasks.rados.rados.0.smithi033.stdout:1466: setattr oid 31 current snap is 142 2021-07-26T16:02:22.782 INFO:tasks.rados.rados.0.smithi033.stdout:1467: read oid 35 snap -1 2021-07-26T16:02:22.783 INFO:tasks.rados.rados.0.smithi033.stdout:1467: expect (ObjNum 422 snap 131 seq_num 422) 2021-07-26T16:02:22.783 INFO:tasks.rados.rados.0.smithi033.stdout:1468: snap_remove snap 141 2021-07-26T16:02:22.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: cluster 2021-07-26T16:02:21.038645+0000 mgr.y (mgr.34104) 226 : cluster [DBG] pgmap v332: 25 pgs: 5 active+undersized, 7 active+undersized+degraded, 13 active+clean; 201 MiB data, 680 MiB used, 715 GiB / 715 GiB avail; 34 MiB/s rd, 3.1 MiB/s wr, 20 op/s; 17/183 objects degraded (9.290%) 2021-07-26T16:02:22.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: cluster 2021-07-26T16:02:21.626387+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e350: 8 total, 7 up, 8 in 2021-07-26T16:02:22.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.643268+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:22.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.650738+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:22.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.657303+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:22.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.659079+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.660866+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.662018+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.663843+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: cephadm 2021-07-26T16:02:21.664758+0000 mgr.y (mgr.34104) 227 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-07-26T16:02:22.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.671976+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:22.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.674105+0000 mon.c (mon.1) 118 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-07-26T16:02:22.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.674598+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-07-26T16:02:22.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.681781+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-07-26T16:02:22.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.684803+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-07-26T16:02:22.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.685395+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-07-26T16:02:22.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.690552+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-07-26T16:02:22.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.691523+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-07-26T16:02:22.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.691867+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-07-26T16:02:22.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: cluster 2021-07-26T16:02:21.038645+0000 mgr.y (mgr.34104) 226 : cluster [DBG] pgmap v332: 25 pgs: 5 active+undersized, 7 active+undersized+degraded, 13 active+clean; 201 MiB data, 680 MiB used, 715 GiB / 715 GiB avail; 34 MiB/s rd, 3.1 MiB/s wr, 20 op/s; 17/183 objects degraded (9.290%) 2021-07-26T16:02:22.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: cluster 2021-07-26T16:02:21.626387+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e350: 8 total, 7 up, 8 in 2021-07-26T16:02:22.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.643268+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:22.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.650738+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:22.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.657303+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:22.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.659079+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.660866+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.662018+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.663843+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: cephadm 2021-07-26T16:02:21.664758+0000 mgr.y (mgr.34104) 227 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-07-26T16:02:22.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.671976+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:22.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.674105+0000 mon.c (mon.1) 118 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-07-26T16:02:22.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.674598+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-07-26T16:02:22.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.681781+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-07-26T16:02:22.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.684803+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-07-26T16:02:22.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.685395+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-07-26T16:02:22.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.690552+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-07-26T16:02:22.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.691523+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-07-26T16:02:22.969 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.691867+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-07-26T16:02:22.970 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.695724+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-07-26T16:02:22.970 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.697165+0000 mon.c (mon.1) 121 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-07-26T16:02:22.971 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.697515+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-07-26T16:02:22.971 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.701306+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-07-26T16:02:22.971 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.703320+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-07-26T16:02:22.971 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.703768+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-07-26T16:02:22.971 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.708464+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-07-26T16:02:22.972 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.710324+0000 mon.c (mon.1) 123 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-07-26T16:02:22.972 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.710707+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-07-26T16:02:22.972 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.714690+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-07-26T16:02:22.972 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.717133+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-07-26T16:02:22.973 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.717521+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-07-26T16:02:22.973 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.722900+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-07-26T16:02:22.973 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.723842+0000 mon.c (mon.1) 125 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-07-26T16:02:22.973 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.724144+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-07-26T16:02:22.974 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.728428+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-07-26T16:02:22.974 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.733622+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-07-26T16:02:22.974 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: audit 2021-07-26T16:02:21.734030+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-07-26T16:02:22.974 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[41341]: cluster 2021-07-26T16:02:22.009144+0000 mon.a (mon.0) 641 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-07-26T16:02:22.975 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.695724+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-07-26T16:02:22.975 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.697165+0000 mon.c (mon.1) 121 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-07-26T16:02:22.975 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.697515+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-07-26T16:02:22.976 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.701306+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-07-26T16:02:22.976 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.703320+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-07-26T16:02:22.976 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.703768+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-07-26T16:02:22.976 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.708464+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-07-26T16:02:22.977 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.710324+0000 mon.c (mon.1) 123 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-07-26T16:02:22.977 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.710707+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-07-26T16:02:22.977 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.714690+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-07-26T16:02:22.977 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.717133+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-07-26T16:02:22.978 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.717521+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-07-26T16:02:22.978 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.722900+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-07-26T16:02:22.978 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.723842+0000 mon.c (mon.1) 125 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-07-26T16:02:22.978 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.724144+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-07-26T16:02:22.978 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.728428+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-07-26T16:02:22.979 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.733622+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-07-26T16:02:22.979 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: audit 2021-07-26T16:02:21.734030+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-07-26T16:02:22.979 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:22 smithi033 bash[42377]: cluster 2021-07-26T16:02:22.009144+0000 mon.a (mon.0) 641 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-07-26T16:02:22.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: cluster 2021-07-26T16:02:21.038645+0000 mgr.y (mgr.34104) 226 : cluster [DBG] pgmap v332: 25 pgs: 5 active+undersized, 7 active+undersized+degraded, 13 active+clean; 201 MiB data, 680 MiB used, 715 GiB / 715 GiB avail; 34 MiB/s rd, 3.1 MiB/s wr, 20 op/s; 17/183 objects degraded (9.290%) 2021-07-26T16:02:22.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: cluster 2021-07-26T16:02:21.626387+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e350: 8 total, 7 up, 8 in 2021-07-26T16:02:22.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.643268+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:22.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.650738+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:22.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.657303+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:22.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.659079+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.660866+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.662018+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.663843+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:22.990 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: cephadm 2021-07-26T16:02:21.664758+0000 mgr.y (mgr.34104) 227 : cephadm [INF] Upgrade: Setting container_image for all osd 2021-07-26T16:02:22.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.671976+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:22.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.674105+0000 mon.c (mon.1) 118 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-07-26T16:02:22.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.674598+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2021-07-26T16:02:22.991 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.681781+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2021-07-26T16:02:22.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.684803+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-07-26T16:02:22.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.685395+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2021-07-26T16:02:22.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.690552+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2021-07-26T16:02:22.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.691523+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-07-26T16:02:22.992 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.691867+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2021-07-26T16:02:22.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.695724+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2021-07-26T16:02:22.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.697165+0000 mon.c (mon.1) 121 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-07-26T16:02:22.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.697515+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2021-07-26T16:02:22.993 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.701306+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2021-07-26T16:02:22.994 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.703320+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-07-26T16:02:22.994 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.703768+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2021-07-26T16:02:22.994 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.708464+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2021-07-26T16:02:22.994 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.710324+0000 mon.c (mon.1) 123 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-07-26T16:02:22.994 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.710707+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2021-07-26T16:02:22.995 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.714690+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2021-07-26T16:02:22.995 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.717133+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-07-26T16:02:22.995 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.717521+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2021-07-26T16:02:22.995 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.722900+0000 mon.a (mon.0) 637 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2021-07-26T16:02:22.996 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.723842+0000 mon.c (mon.1) 125 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-07-26T16:02:22.996 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.724144+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2021-07-26T16:02:22.996 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.728428+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2021-07-26T16:02:22.996 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.733622+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-07-26T16:02:22.997 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: audit 2021-07-26T16:02:21.734030+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "quincy"}]: dispatch 2021-07-26T16:02:22.997 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:22 smithi096 bash[33981]: cluster 2021-07-26T16:02:22.009144+0000 mon.a (mon.0) 641 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2021-07-26T16:02:23.792 INFO:tasks.rados.rados.0.smithi033.stdout:1468: done (3 left) 2021-07-26T16:02:23.793 INFO:tasks.rados.rados.0.smithi033.stdout:1469: setattr oid 18 current snap is 142 2021-07-26T16:02:23.793 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 73 (ObjNum 445 snap 137 seq_num 445) dirty exists 2021-07-26T16:02:23.794 INFO:tasks.rados.rados.0.smithi033.stdout:1465: finishing write tid 1 to smithi03339061-49 2021-07-26T16:02:23.794 INFO:tasks.rados.rados.0.smithi033.stdout:1465: finishing write tid 2 to smithi03339061-49 2021-07-26T16:02:23.794 INFO:tasks.rados.rados.0.smithi033.stdout:1467: expect (ObjNum 422 snap 131 seq_num 422) 2021-07-26T16:02:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:23.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:23.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:23.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:23.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:23.521Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:02:23.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: cephadm 2021-07-26T16:02:21.733218+0000 mgr.y (mgr.34104) 228 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-07-26T16:02:23.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.736236+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-07-26T16:02:23.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: cluster 2021-07-26T16:02:22.736617+0000 mon.a (mon.0) 643 : cluster [DBG] osdmap e351: 8 total, 7 up, 8 in 2021-07-26T16:02:23.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.740335+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.747261+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.749341+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.757760+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.759059+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.767539+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.769681+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.771184+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.780618+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.782435+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.964 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[41341]: audit 2021-07-26T16:02:22.794571+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: cephadm 2021-07-26T16:02:21.733218+0000 mgr.y (mgr.34104) 228 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-07-26T16:02:23.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.736236+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-07-26T16:02:23.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: cluster 2021-07-26T16:02:22.736617+0000 mon.a (mon.0) 643 : cluster [DBG] osdmap e351: 8 total, 7 up, 8 in 2021-07-26T16:02:23.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.740335+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.747261+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.749341+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.757760+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.759059+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.767539+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.769681+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.771184+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.780618+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.782435+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:23 smithi033 bash[42377]: audit 2021-07-26T16:02:22.794571+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.981 INFO:tasks.rados.rados.0.smithi033.stdout:1465: finishing write tid 3 to smithi03339061-49 2021-07-26T16:02:23.981 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 522 (ObjNum 456 snap 142 seq_num 456) dirty exists 2021-07-26T16:02:23.981 INFO:tasks.rados.rados.0.smithi033.stdout:1465: left oid 49 (ObjNum 456 snap 142 seq_num 456) 2021-07-26T16:02:23.982 INFO:tasks.rados.rados.0.smithi033.stdout:1465: done (3 left) 2021-07-26T16:02:23.982 INFO:tasks.rados.rados.0.smithi033.stdout:1466: done (2 left) 2021-07-26T16:02:23.982 INFO:tasks.rados.rados.0.smithi033.stdout:1467: done (1 left) 2021-07-26T16:02:23.982 INFO:tasks.rados.rados.0.smithi033.stdout:1470: snap_create 2021-07-26T16:02:23.985 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 807 (ObjNum 436 snap 136 seq_num 436) dirty exists 2021-07-26T16:02:23.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: cephadm 2021-07-26T16:02:21.733218+0000 mgr.y (mgr.34104) 228 : cephadm [INF] Upgrade: Setting require_osd_release to 17 quincy 2021-07-26T16:02:23.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.736236+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "quincy"}]': finished 2021-07-26T16:02:23.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: cluster 2021-07-26T16:02:22.736617+0000 mon.a (mon.0) 643 : cluster [DBG] osdmap e351: 8 total, 7 up, 8 in 2021-07-26T16:02:23.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.740335+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.747261+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.749341+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.757760+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.759059+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.767539+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.769681+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.771184+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.780618+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:23.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.782435+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:23.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:23 smithi096 bash[33981]: audit 2021-07-26T16:02:22.794571+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:24.805 INFO:tasks.rados.rados.0.smithi033.stdout:1469: done (1 left) 2021-07-26T16:02:24.805 INFO:tasks.rados.rados.0.smithi033.stdout:1470: done (0 left) 2021-07-26T16:02:24.805 INFO:tasks.rados.rados.0.smithi033.stdout:1471: snap_create 2021-07-26T16:02:24.922 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[42377]: cephadm 2021-07-26T16:02:22.741497+0000 mgr.y (mgr.34104) 229 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-07-26T16:02:24.923 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[42377]: cephadm 2021-07-26T16:02:22.750286+0000 mgr.y (mgr.34104) 230 : cephadm [INF] Upgrade: Setting container_image for all rgw 2021-07-26T16:02:24.923 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[42377]: cephadm 2021-07-26T16:02:22.759964+0000 mgr.y (mgr.34104) 231 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2021-07-26T16:02:24.923 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[42377]: cephadm 2021-07-26T16:02:22.772277+0000 mgr.y (mgr.34104) 232 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2021-07-26T16:02:24.923 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[42377]: cephadm 2021-07-26T16:02:22.788030+0000 mgr.y (mgr.34104) 233 : cephadm [INF] Upgrade: Setting container_image for all nfs 2021-07-26T16:02:24.923 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[42377]: cluster 2021-07-26T16:02:23.039485+0000 mgr.y (mgr.34104) 234 : cluster [DBG] pgmap v335: 25 pgs: 5 active+undersized, 7 active+undersized+degraded, 13 active+clean; 207 MiB data, 697 MiB used, 715 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.8 MiB/s wr, 11 op/s; 18/192 objects degraded (9.375%) 2021-07-26T16:02:24.924 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[42377]: cluster 2021-07-26T16:02:23.788322+0000 mon.a (mon.0) 649 : cluster [DBG] osdmap e352: 8 total, 7 up, 8 in 2021-07-26T16:02:24.924 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[42377]: cluster 2021-07-26T16:02:23.790914+0000 mon.a (mon.0) 650 : cluster [WRN] Health check update: Degraded data redundancy: 18/192 objects degraded (9.375%), 7 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:24.924 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[41341]: cephadm 2021-07-26T16:02:22.741497+0000 mgr.y (mgr.34104) 229 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-07-26T16:02:24.925 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[41341]: cephadm 2021-07-26T16:02:22.750286+0000 mgr.y (mgr.34104) 230 : cephadm [INF] Upgrade: Setting container_image for all rgw 2021-07-26T16:02:24.925 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[41341]: cephadm 2021-07-26T16:02:22.759964+0000 mgr.y (mgr.34104) 231 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2021-07-26T16:02:24.925 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[41341]: cephadm 2021-07-26T16:02:22.772277+0000 mgr.y (mgr.34104) 232 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2021-07-26T16:02:24.925 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[41341]: cephadm 2021-07-26T16:02:22.788030+0000 mgr.y (mgr.34104) 233 : cephadm [INF] Upgrade: Setting container_image for all nfs 2021-07-26T16:02:24.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[41341]: cluster 2021-07-26T16:02:23.039485+0000 mgr.y (mgr.34104) 234 : cluster [DBG] pgmap v335: 25 pgs: 5 active+undersized, 7 active+undersized+degraded, 13 active+clean; 207 MiB data, 697 MiB used, 715 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.8 MiB/s wr, 11 op/s; 18/192 objects degraded (9.375%) 2021-07-26T16:02:24.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[41341]: cluster 2021-07-26T16:02:23.788322+0000 mon.a (mon.0) 649 : cluster [DBG] osdmap e352: 8 total, 7 up, 8 in 2021-07-26T16:02:24.926 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:24 smithi033 bash[41341]: cluster 2021-07-26T16:02:23.790914+0000 mon.a (mon.0) 650 : cluster [WRN] Health check update: Degraded data redundancy: 18/192 objects degraded (9.375%), 7 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:24.985 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:24 smithi096 bash[39437]: debug 2021-07-26T16:02:24.715+0000 7f75ec4e60c0 -1 osd.7 343 log_to_monitors {default=true} 2021-07-26T16:02:24.985 INFO:journalctl@ceph.osd.7.smithi096.stdout:Jul 26 16:02:24 smithi096 bash[39437]: debug 2021-07-26T16:02:24.815+0000 7f75dde3b700 -1 osd.7 343 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-07-26T16:02:24.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:24 smithi096 bash[33981]: cephadm 2021-07-26T16:02:22.741497+0000 mgr.y (mgr.34104) 229 : cephadm [INF] Upgrade: Setting container_image for all mds 2021-07-26T16:02:24.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:24 smithi096 bash[33981]: cephadm 2021-07-26T16:02:22.750286+0000 mgr.y (mgr.34104) 230 : cephadm [INF] Upgrade: Setting container_image for all rgw 2021-07-26T16:02:24.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:24 smithi096 bash[33981]: cephadm 2021-07-26T16:02:22.759964+0000 mgr.y (mgr.34104) 231 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2021-07-26T16:02:24.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:24 smithi096 bash[33981]: cephadm 2021-07-26T16:02:22.772277+0000 mgr.y (mgr.34104) 232 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2021-07-26T16:02:24.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:24 smithi096 bash[33981]: cephadm 2021-07-26T16:02:22.788030+0000 mgr.y (mgr.34104) 233 : cephadm [INF] Upgrade: Setting container_image for all nfs 2021-07-26T16:02:24.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:24 smithi096 bash[33981]: cluster 2021-07-26T16:02:23.039485+0000 mgr.y (mgr.34104) 234 : cluster [DBG] pgmap v335: 25 pgs: 5 active+undersized, 7 active+undersized+degraded, 13 active+clean; 207 MiB data, 697 MiB used, 715 GiB / 715 GiB avail; 7.0 MiB/s rd, 1.8 MiB/s wr, 11 op/s; 18/192 objects degraded (9.375%) 2021-07-26T16:02:24.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:24 smithi096 bash[33981]: cluster 2021-07-26T16:02:23.788322+0000 mon.a (mon.0) 649 : cluster [DBG] osdmap e352: 8 total, 7 up, 8 in 2021-07-26T16:02:24.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:24 smithi096 bash[33981]: cluster 2021-07-26T16:02:23.790914+0000 mon.a (mon.0) 650 : cluster [WRN] Health check update: Degraded data redundancy: 18/192 objects degraded (9.375%), 7 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:25.813 INFO:tasks.rados.rados.0.smithi033.stdout:1471: done (0 left) 2021-07-26T16:02:25.814 INFO:tasks.rados.rados.0.smithi033.stdout:1472: snap_remove snap 143 2021-07-26T16:02:25.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[42377]: audit 2021-07-26T16:02:24.721992+0000 mon.a (mon.0) 651 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T16:02:25.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[42377]: audit 2021-07-26T16:02:24.725394+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/1016563140,v1:172.21.15.96:6825/1016563140]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T16:02:25.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[42377]: audit 2021-07-26T16:02:24.800700+0000 mon.a (mon.0) 652 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-07-26T16:02:25.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[42377]: cluster 2021-07-26T16:02:24.800882+0000 mon.a (mon.0) 653 : cluster [DBG] osdmap e353: 8 total, 7 up, 8 in 2021-07-26T16:02:25.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[42377]: audit 2021-07-26T16:02:24.802965+0000 mon.a (mon.0) 654 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:02:25.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[42377]: audit 2021-07-26T16:02:24.806249+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/1016563140,v1:172.21.15.96:6825/1016563140]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:02:25.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[41341]: audit 2021-07-26T16:02:24.721992+0000 mon.a (mon.0) 651 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T16:02:25.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[41341]: audit 2021-07-26T16:02:24.725394+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/1016563140,v1:172.21.15.96:6825/1016563140]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T16:02:25.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[41341]: audit 2021-07-26T16:02:24.800700+0000 mon.a (mon.0) 652 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-07-26T16:02:25.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[41341]: cluster 2021-07-26T16:02:24.800882+0000 mon.a (mon.0) 653 : cluster [DBG] osdmap e353: 8 total, 7 up, 8 in 2021-07-26T16:02:25.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[41341]: audit 2021-07-26T16:02:24.802965+0000 mon.a (mon.0) 654 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:02:25.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:25 smithi033 bash[41341]: audit 2021-07-26T16:02:24.806249+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/1016563140,v1:172.21.15.96:6825/1016563140]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:02:25.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:25 smithi096 bash[33981]: audit 2021-07-26T16:02:24.721992+0000 mon.a (mon.0) 651 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T16:02:25.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:25 smithi096 bash[33981]: audit 2021-07-26T16:02:24.725394+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/1016563140,v1:172.21.15.96:6825/1016563140]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-07-26T16:02:25.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:25 smithi096 bash[33981]: audit 2021-07-26T16:02:24.800700+0000 mon.a (mon.0) 652 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-07-26T16:02:25.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:25 smithi096 bash[33981]: cluster 2021-07-26T16:02:24.800882+0000 mon.a (mon.0) 653 : cluster [DBG] osdmap e353: 8 total, 7 up, 8 in 2021-07-26T16:02:25.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:25 smithi096 bash[33981]: audit 2021-07-26T16:02:24.802965+0000 mon.a (mon.0) 654 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:02:25.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:25 smithi096 bash[33981]: audit 2021-07-26T16:02:24.806249+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.15.96:6824/1016563140,v1:172.21.15.96:6825/1016563140]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi096", "root=default"]}]: dispatch 2021-07-26T16:02:26.024 INFO:tasks.rados.rados.0.smithi033.stdout:1472: done (0 left) 2021-07-26T16:02:26.024 INFO:tasks.rados.rados.0.smithi033.stdout:1473: rollback oid 7 current snap is 144 2021-07-26T16:02:26.024 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 7 to 136 2021-07-26T16:02:26.029 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 144 2021-07-26T16:02:26.029 INFO:tasks.rados.rados.0.smithi033.stdout:1474: seq_num 457 ranges {3719168=458752} 2021-07-26T16:02:26.048 INFO:tasks.rados.rados.0.smithi033.stdout:1474: writing smithi03339061-31 from 3719168 to 4177920 tid 1 2021-07-26T16:02:26.049 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 144 2021-07-26T16:02:26.049 INFO:tasks.rados.rados.0.smithi033.stdout:1473: finishing rollback tid 0 to smithi03339061-7 2021-07-26T16:02:26.049 INFO:tasks.rados.rados.0.smithi033.stdout:1475: seq_num 458 ranges {6004736=475136} 2021-07-26T16:02:26.085 INFO:tasks.rados.rados.0.smithi033.stdout:1475: writing smithi03339061-50 from 6004736 to 6479872 tid 1 2021-07-26T16:02:26.086 INFO:tasks.rados.rados.0.smithi033.stdout:1476: read oid 9 snap -1 2021-07-26T16:02:26.086 INFO:tasks.rados.rados.0.smithi033.stdout:1476: expect (ObjNum 424 snap 132 seq_num 424) 2021-07-26T16:02:26.086 INFO:tasks.rados.rados.0.smithi033.stdout:1477: snap_remove snap 142 2021-07-26T16:02:26.231 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:26 smithi033 systemd[1]: Stopping Ceph node-exporter.a for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T16:02:26.231 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:26 smithi033 docker[49625]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:02:26.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[41341]: cluster 2021-07-26T16:02:25.040271+0000 mgr.y (mgr.34104) 235 : cluster [DBG] pgmap v338: 25 pgs: 5 active+undersized, 7 active+undersized+degraded, 13 active+clean; 209 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 4.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s; 20/201 objects degraded (9.950%) 2021-07-26T16:02:26.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[41341]: cephadm 2021-07-26T16:02:25.666877+0000 mgr.y (mgr.34104) 236 : cephadm [INF] Upgrade: Updating node-exporter.a 2021-07-26T16:02:26.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[41341]: cephadm 2021-07-26T16:02:25.667188+0000 mgr.y (mgr.34104) 237 : cephadm [INF] Deploying daemon node-exporter.a on smithi033 2021-07-26T16:02:26.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[41341]: cluster 2021-07-26T16:02:25.796719+0000 mon.a (mon.0) 655 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:02:26.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[41341]: audit 2021-07-26T16:02:25.809450+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T16:02:26.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[41341]: cluster 2021-07-26T16:02:25.810410+0000 mon.a (mon.0) 656 : cluster [INF] osd.7 [v2:172.21.15.96:6824/1016563140,v1:172.21.15.96:6825/1016563140] boot 2021-07-26T16:02:26.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[41341]: cluster 2021-07-26T16:02:25.810456+0000 mon.a (mon.0) 657 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2021-07-26T16:02:26.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[41341]: cluster 2021-07-26T16:02:26.017185+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2021-07-26T16:02:26.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[42377]: cluster 2021-07-26T16:02:25.040271+0000 mgr.y (mgr.34104) 235 : cluster [DBG] pgmap v338: 25 pgs: 5 active+undersized, 7 active+undersized+degraded, 13 active+clean; 209 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 4.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s; 20/201 objects degraded (9.950%) 2021-07-26T16:02:26.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[42377]: cephadm 2021-07-26T16:02:25.666877+0000 mgr.y (mgr.34104) 236 : cephadm [INF] Upgrade: Updating node-exporter.a 2021-07-26T16:02:26.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[42377]: cephadm 2021-07-26T16:02:25.667188+0000 mgr.y (mgr.34104) 237 : cephadm [INF] Deploying daemon node-exporter.a on smithi033 2021-07-26T16:02:26.962 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[42377]: cluster 2021-07-26T16:02:25.796719+0000 mon.a (mon.0) 655 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:02:26.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[42377]: audit 2021-07-26T16:02:25.809450+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T16:02:26.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[42377]: cluster 2021-07-26T16:02:25.810410+0000 mon.a (mon.0) 656 : cluster [INF] osd.7 [v2:172.21.15.96:6824/1016563140,v1:172.21.15.96:6825/1016563140] boot 2021-07-26T16:02:26.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[42377]: cluster 2021-07-26T16:02:25.810456+0000 mon.a (mon.0) 657 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2021-07-26T16:02:26.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:26 smithi033 bash[42377]: cluster 2021-07-26T16:02:26.017185+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2021-07-26T16:02:26.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:26 smithi096 bash[33981]: cluster 2021-07-26T16:02:25.040271+0000 mgr.y (mgr.34104) 235 : cluster [DBG] pgmap v338: 25 pgs: 5 active+undersized, 7 active+undersized+degraded, 13 active+clean; 209 MiB data, 646 MiB used, 715 GiB / 715 GiB avail; 4.3 MiB/s rd, 2.1 MiB/s wr, 4 op/s; 20/201 objects degraded (9.950%) 2021-07-26T16:02:26.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:26 smithi096 bash[33981]: cephadm 2021-07-26T16:02:25.666877+0000 mgr.y (mgr.34104) 236 : cephadm [INF] Upgrade: Updating node-exporter.a 2021-07-26T16:02:26.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:26 smithi096 bash[33981]: cephadm 2021-07-26T16:02:25.667188+0000 mgr.y (mgr.34104) 237 : cephadm [INF] Deploying daemon node-exporter.a on smithi033 2021-07-26T16:02:26.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:26 smithi096 bash[33981]: cluster 2021-07-26T16:02:25.796719+0000 mon.a (mon.0) 655 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2021-07-26T16:02:26.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:26 smithi096 bash[33981]: audit 2021-07-26T16:02:25.809450+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-07-26T16:02:26.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:26 smithi096 bash[33981]: cluster 2021-07-26T16:02:25.810410+0000 mon.a (mon.0) 656 : cluster [INF] osd.7 [v2:172.21.15.96:6824/1016563140,v1:172.21.15.96:6825/1016563140] boot 2021-07-26T16:02:26.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:26 smithi096 bash[33981]: cluster 2021-07-26T16:02:25.810456+0000 mon.a (mon.0) 657 : cluster [DBG] osdmap e354: 8 total, 8 up, 8 in 2021-07-26T16:02:26.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:26 smithi096 bash[33981]: cluster 2021-07-26T16:02:26.017185+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e355: 8 total, 8 up, 8 in 2021-07-26T16:02:27.037 INFO:tasks.rados.rados.0.smithi033.stdout:1477: done (4 left) 2021-07-26T16:02:27.038 INFO:tasks.rados.rados.0.smithi033.stdout:1478: rollback oid 37 current snap is 144 2021-07-26T16:02:27.038 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 37 to 136 2021-07-26T16:02:27.038 INFO:tasks.rados.rados.0.smithi033.stdout:1473: finishing rollback tid 1 to smithi03339061-7 2021-07-26T16:02:27.039 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 630 (ObjNum 0 snap 32561 seq_num 2006183968) dirty dne 2021-07-26T16:02:27.039 INFO:tasks.rados.rados.0.smithi033.stdout:1475: finishing write tid 1 to smithi03339061-50 2021-07-26T16:02:27.039 INFO:tasks.rados.rados.0.smithi033.stdout:1475: finishing write tid 2 to smithi03339061-50 2021-07-26T16:02:27.039 INFO:tasks.rados.rados.0.smithi033.stdout:1475: finishing write tid 3 to smithi03339061-50 2021-07-26T16:02:27.040 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 650 (ObjNum 458 snap 144 seq_num 458) dirty exists 2021-07-26T16:02:27.040 INFO:tasks.rados.rados.0.smithi033.stdout:1475: left oid 50 (ObjNum 458 snap 144 seq_num 458) 2021-07-26T16:02:27.040 INFO:tasks.rados.rados.0.smithi033.stdout:1476: expect (ObjNum 424 snap 132 seq_num 424) 2021-07-26T16:02:27.241 INFO:tasks.rados.rados.0.smithi033.stdout:1478: finishing rollback tid 1 to smithi03339061-37 2021-07-26T16:02:27.242 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 0 (ObjNum 0 snap 32561 seq_num 2006498016) dirty dne 2021-07-26T16:02:27.242 INFO:tasks.rados.rados.0.smithi033.stdout:1473: done (4 left) 2021-07-26T16:02:27.242 INFO:tasks.rados.rados.0.smithi033.stdout:1475: done (3 left) 2021-07-26T16:02:27.242 INFO:tasks.rados.rados.0.smithi033.stdout:1476: done (2 left) 2021-07-26T16:02:27.243 INFO:tasks.rados.rados.0.smithi033.stdout:1478: done (1 left) 2021-07-26T16:02:27.243 INFO:tasks.rados.rados.0.smithi033.stdout:1479: copy_from oid 9 from oid 25 current snap is 144 2021-07-26T16:02:27.243 INFO:tasks.rados.rados.0.smithi033.stdout:1480: setattr oid 6 current snap is 144 2021-07-26T16:02:27.247 INFO:tasks.rados.rados.0.smithi033.stdout:1481: copy_from oid 14 from oid 49 current snap is 144 2021-07-26T16:02:27.247 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 144 2021-07-26T16:02:27.247 INFO:tasks.rados.rados.0.smithi033.stdout:1482: seq_num 459 ranges {1957888=491520} 2021-07-26T16:02:27.266 INFO:tasks.rados.rados.0.smithi033.stdout:1482: writing smithi03339061-13 from 1957888 to 2449408 tid 1 2021-07-26T16:02:27.267 INFO:tasks.rados.rados.0.smithi033.stdout:1483: snap_remove snap 138 2021-07-26T16:02:27.323 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:27 smithi033 docker[49625]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-node-exporter.a 2021-07-26T16:02:27.324 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:27 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2021-07-26T16:02:27.324 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:27 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@node-exporter.a.service: Failed with result 'exit-code'. 2021-07-26T16:02:27.324 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:27 smithi033 systemd[1]: Stopped Ceph node-exporter.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:02:27.325 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:27 smithi033 systemd[1]: Started Ceph node-exporter.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:02:27.710 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:27 smithi033 bash[49701]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:02:28.046 INFO:tasks.rados.rados.0.smithi033.stdout:1483: done (5 left) 2021-07-26T16:02:28.047 INFO:tasks.rados.rados.0.smithi033.stdout:1484: copy_from oid 46 from oid 27 current snap is 144 2021-07-26T16:02:28.047 INFO:tasks.rados.rados.0.smithi033.stdout:1485: snap_create 2021-07-26T16:02:28.047 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 809 (ObjNum 405 snap 128 seq_num 405) dirty exists 2021-07-26T16:02:28.047 INFO:tasks.rados.rados.0.smithi033.stdout:1482: finishing write tid 1 to smithi03339061-13 2021-07-26T16:02:28.048 INFO:tasks.rados.rados.0.smithi033.stdout:1482: finishing write tid 2 to smithi03339061-13 2021-07-26T16:02:28.048 INFO:tasks.rados.rados.0.smithi033.stdout:1479: finishing copy_from to smithi03339061-9 2021-07-26T16:02:28.048 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 324 (ObjNum 411 snap 130 seq_num 411) dirty exists 2021-07-26T16:02:28.048 INFO:tasks.rados.rados.0.smithi033.stdout:1482: finishing write tid 3 to smithi03339061-13 2021-07-26T16:02:28.048 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 650 (ObjNum 459 snap 144 seq_num 459) dirty exists 2021-07-26T16:02:28.049 INFO:tasks.rados.rados.0.smithi033.stdout:1482: left oid 13 (ObjNum 459 snap 144 seq_num 459) 2021-07-26T16:02:28.049 INFO:tasks.rados.rados.0.smithi033.stdout:1479: finishing copy_from racing read to smithi03339061-9 2021-07-26T16:02:28.049 INFO:tasks.rados.rados.0.smithi033.stdout:1481: finishing copy_from to smithi03339061-14 2021-07-26T16:02:28.049 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 522 (ObjNum 456 snap 142 seq_num 456) dirty exists 2021-07-26T16:02:28.049 INFO:tasks.rados.rados.0.smithi033.stdout:1481: finishing copy_from racing read to smithi03339061-14 2021-07-26T16:02:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[41341]: cluster 2021-07-26T16:02:27.033040+0000 mon.a (mon.0) 659 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2021-07-26T16:02:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[41341]: cluster 2021-07-26T16:02:27.041035+0000 mgr.y (mgr.34104) 238 : cluster [DBG] pgmap v342: 25 pgs: 1 active+recovering+degraded, 5 active+undersized, 6 active+undersized+degraded, 13 active+clean; 210 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 14 MiB/s rd, 891 KiB/s wr, 7 op/s; 18/207 objects degraded (8.696%); 747 KiB/s, 0 objects/s recovering 2021-07-26T16:02:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[41341]: audit 2021-07-26T16:02:27.360146+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:28.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[41341]: audit 2021-07-26T16:02:27.362202+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:28.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[41341]: audit 2021-07-26T16:02:27.364566+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:28.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[41341]: audit 2021-07-26T16:02:27.365704+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:28.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[42377]: cluster 2021-07-26T16:02:27.033040+0000 mon.a (mon.0) 659 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2021-07-26T16:02:28.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[42377]: cluster 2021-07-26T16:02:27.041035+0000 mgr.y (mgr.34104) 238 : cluster [DBG] pgmap v342: 25 pgs: 1 active+recovering+degraded, 5 active+undersized, 6 active+undersized+degraded, 13 active+clean; 210 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 14 MiB/s rd, 891 KiB/s wr, 7 op/s; 18/207 objects degraded (8.696%); 747 KiB/s, 0 objects/s recovering 2021-07-26T16:02:28.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[42377]: audit 2021-07-26T16:02:27.360146+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:28.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[42377]: audit 2021-07-26T16:02:27.362202+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:28.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[42377]: audit 2021-07-26T16:02:27.364566+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:28.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[42377]: audit 2021-07-26T16:02:27.365704+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:28.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:28 smithi096 bash[33981]: cluster 2021-07-26T16:02:27.033040+0000 mon.a (mon.0) 659 : cluster [DBG] osdmap e356: 8 total, 8 up, 8 in 2021-07-26T16:02:28.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:28 smithi096 bash[33981]: cluster 2021-07-26T16:02:27.041035+0000 mgr.y (mgr.34104) 238 : cluster [DBG] pgmap v342: 25 pgs: 1 active+recovering+degraded, 5 active+undersized, 6 active+undersized+degraded, 13 active+clean; 210 MiB data, 649 MiB used, 715 GiB / 715 GiB avail; 14 MiB/s rd, 891 KiB/s wr, 7 op/s; 18/207 objects degraded (8.696%); 747 KiB/s, 0 objects/s recovering 2021-07-26T16:02:28.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:28 smithi096 bash[33981]: audit 2021-07-26T16:02:27.360146+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:28.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:28 smithi096 bash[33981]: audit 2021-07-26T16:02:27.362202+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:28.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:28 smithi096 bash[33981]: audit 2021-07-26T16:02:27.364566+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:28.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:28 smithi096 bash[33981]: audit 2021-07-26T16:02:27.365704+0000 mon.c (mon.1) 136 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:28.959 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-07-26T16:02:28.963 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-07-26T16:02:28.963 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-07-26T16:02:28.964 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-07-26T16:02:28.964 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-07-26T16:02:28.964 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-07-26T16:02:28.964 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-07-26T16:02:28.965 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-07-26T16:02:28.965 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-07-26T16:02:28.965 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-07-26T16:02:28.965 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-07-26T16:02:28.965 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-07-26T16:02:28.966 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-07-26T16:02:28.968 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-07-26T16:02:28.968 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-07-26T16:02:28.968 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-07-26T16:02:28.969 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-07-26T16:02:28.969 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-07-26T16:02:28.969 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-07-26T16:02:28.969 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-07-26T16:02:28.969 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-07-26T16:02:28.970 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-07-26T16:02:28.970 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-07-26T16:02:28.970 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-07-26T16:02:28.971 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-07-26T16:02:28.971 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-07-26T16:02:28.971 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-07-26T16:02:28.972 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-07-26T16:02:28.972 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-07-26T16:02:28.972 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - time" source="node_exporter.go:104" 2021-07-26T16:02:28.972 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-07-26T16:02:28.972 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-07-26T16:02:28.973 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-07-26T16:02:28.973 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-07-26T16:02:28.974 INFO:journalctl@ceph.node-exporter.a.smithi033.stdout:Jul 26 16:02:28 smithi033 bash[49701]: time="2021-07-26T16:02:28Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-07-26T16:02:29.047 INFO:tasks.rados.rados.0.smithi033.stdout:1479: done (6 left) 2021-07-26T16:02:29.048 INFO:tasks.rados.rados.0.smithi033.stdout:1480: done (5 left) 2021-07-26T16:02:29.048 INFO:tasks.rados.rados.0.smithi033.stdout:1481: done (4 left) 2021-07-26T16:02:29.048 INFO:tasks.rados.rados.0.smithi033.stdout:1482: done (3 left) 2021-07-26T16:02:29.049 INFO:tasks.rados.rados.0.smithi033.stdout:1485: done (2 left) 2021-07-26T16:02:29.049 INFO:tasks.rados.rados.0.smithi033.stdout:1486: delete oid 8 current snap is 145 2021-07-26T16:02:29.052 INFO:tasks.rados.rados.0.smithi033.stdout:1486: done (2 left) 2021-07-26T16:02:29.052 INFO:tasks.rados.rados.0.smithi033.stdout:1487: rollback oid 43 current snap is 145 2021-07-26T16:02:29.052 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 43 to 136 2021-07-26T16:02:29.053 INFO:tasks.rados.rados.0.smithi033.stdout:1488: read oid 23 snap -1 2021-07-26T16:02:29.053 INFO:tasks.rados.rados.0.smithi033.stdout:1488: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:02:29.053 INFO:tasks.rados.rados.0.smithi033.stdout:1489: copy_from oid 24 from oid 25 current snap is 145 2021-07-26T16:02:29.053 INFO:tasks.rados.rados.0.smithi033.stdout:1490: snap_create 2021-07-26T16:02:29.059 INFO:tasks.rados.rados.0.smithi033.stdout:1487: finishing rollback tid 1 to smithi03339061-43 2021-07-26T16:02:29.059 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 0 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T16:02:29.059 INFO:tasks.rados.rados.0.smithi033.stdout:1488: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:02:29.096 INFO:tasks.rados.rados.0.smithi033.stdout:1489: finishing copy_from to smithi03339061-24 2021-07-26T16:02:29.096 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 324 (ObjNum 411 snap 130 seq_num 411) dirty exists 2021-07-26T16:02:29.097 INFO:tasks.rados.rados.0.smithi033.stdout:1489: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:02:29.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:29 smithi033 bash[41341]: cluster 2021-07-26T16:02:28.042538+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2021-07-26T16:02:29.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:29 smithi033 bash[42377]: cluster 2021-07-26T16:02:28.042538+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2021-07-26T16:02:29.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:29 smithi096 bash[33981]: cluster 2021-07-26T16:02:28.042538+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e357: 8 total, 8 up, 8 in 2021-07-26T16:02:30.068 INFO:tasks.rados.rados.0.smithi033.stdout:1487: done (5 left) 2021-07-26T16:02:30.068 INFO:tasks.rados.rados.0.smithi033.stdout:1488: done (4 left) 2021-07-26T16:02:30.069 INFO:tasks.rados.rados.0.smithi033.stdout:1489: done (3 left) 2021-07-26T16:02:30.069 INFO:tasks.rados.rados.0.smithi033.stdout:1490: done (2 left) 2021-07-26T16:02:30.069 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 146 2021-07-26T16:02:30.069 INFO:tasks.rados.rados.0.smithi033.stdout:1491: seq_num 461 ranges {6389760=524288} 2021-07-26T16:02:30.111 INFO:tasks.rados.rados.0.smithi033.stdout:1491: writing smithi03339061-38 from 6389760 to 6914048 tid 1 2021-07-26T16:02:30.111 INFO:tasks.rados.rados.0.smithi033.stdout:1492: read oid 42 snap -1 2021-07-26T16:02:30.111 INFO:tasks.rados.rados.0.smithi033.stdout:1492: expect (ObjNum 449 snap 139 seq_num 449) 2021-07-26T16:02:30.111 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 146 2021-07-26T16:02:30.112 INFO:tasks.rados.rados.0.smithi033.stdout:1493: seq_num 462 ranges {3702784=540672} 2021-07-26T16:02:30.135 INFO:tasks.rados.rados.0.smithi033.stdout:1493: writing smithi03339061-24 from 3702784 to 4243456 tid 1 2021-07-26T16:02:30.135 INFO:tasks.rados.rados.0.smithi033.stdout:1494: snap_create 2021-07-26T16:02:30.135 INFO:tasks.rados.rados.0.smithi033.stdout:1491: finishing write tid 1 to smithi03339061-38 2021-07-26T16:02:30.136 INFO:tasks.rados.rados.0.smithi033.stdout:1491: finishing write tid 2 to smithi03339061-38 2021-07-26T16:02:30.136 INFO:tasks.rados.rados.0.smithi033.stdout:1491: finishing write tid 3 to smithi03339061-38 2021-07-26T16:02:30.136 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 436 (ObjNum 461 snap 146 seq_num 461) dirty exists 2021-07-26T16:02:30.137 INFO:tasks.rados.rados.0.smithi033.stdout:1491: left oid 38 (ObjNum 461 snap 146 seq_num 461) 2021-07-26T16:02:30.140 INFO:tasks.rados.rados.0.smithi033.stdout:1493: finishing write tid 1 to smithi03339061-24 2021-07-26T16:02:30.141 INFO:tasks.rados.rados.0.smithi033.stdout:1493: finishing write tid 2 to smithi03339061-24 2021-07-26T16:02:30.142 INFO:tasks.rados.rados.0.smithi033.stdout:1493: finishing write tid 3 to smithi03339061-24 2021-07-26T16:02:30.143 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 688 (ObjNum 462 snap 146 seq_num 462) dirty exists 2021-07-26T16:02:30.143 INFO:tasks.rados.rados.0.smithi033.stdout:1493: left oid 24 (ObjNum 462 snap 146 seq_num 462) 2021-07-26T16:02:30.149 INFO:tasks.rados.rados.0.smithi033.stdout:1492: expect (ObjNum 449 snap 139 seq_num 449) 2021-07-26T16:02:30.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:30 smithi033 bash[41341]: cluster 2021-07-26T16:02:29.041977+0000 mgr.y (mgr.34104) 239 : cluster [DBG] pgmap v345: 25 pgs: 1 active+recovering+degraded, 4 active+undersized, 4 active+undersized+degraded, 16 active+clean; 210 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 5.7 MiB/s rd, 277 KiB/s wr, 16 op/s; 11/216 objects degraded (5.093%); 7.3 MiB/s, 1 objects/s recovering 2021-07-26T16:02:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:30 smithi033 bash[41341]: cluster 2021-07-26T16:02:29.043307+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2021-07-26T16:02:30.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:30 smithi033 bash[42377]: cluster 2021-07-26T16:02:29.041977+0000 mgr.y (mgr.34104) 239 : cluster [DBG] pgmap v345: 25 pgs: 1 active+recovering+degraded, 4 active+undersized, 4 active+undersized+degraded, 16 active+clean; 210 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 5.7 MiB/s rd, 277 KiB/s wr, 16 op/s; 11/216 objects degraded (5.093%); 7.3 MiB/s, 1 objects/s recovering 2021-07-26T16:02:30.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:30 smithi033 bash[42377]: cluster 2021-07-26T16:02:29.043307+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2021-07-26T16:02:30.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:30 smithi096 bash[33981]: cluster 2021-07-26T16:02:29.041977+0000 mgr.y (mgr.34104) 239 : cluster [DBG] pgmap v345: 25 pgs: 1 active+recovering+degraded, 4 active+undersized, 4 active+undersized+degraded, 16 active+clean; 210 MiB data, 656 MiB used, 715 GiB / 715 GiB avail; 5.7 MiB/s rd, 277 KiB/s wr, 16 op/s; 11/216 objects degraded (5.093%); 7.3 MiB/s, 1 objects/s recovering 2021-07-26T16:02:30.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:30 smithi096 bash[33981]: cluster 2021-07-26T16:02:29.043307+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e358: 8 total, 8 up, 8 in 2021-07-26T16:02:31.072 INFO:tasks.rados.rados.0.smithi033.stdout:1491: done (5 left) 2021-07-26T16:02:31.072 INFO:tasks.rados.rados.0.smithi033.stdout:1492: done (4 left) 2021-07-26T16:02:31.073 INFO:tasks.rados.rados.0.smithi033.stdout:1493: done (3 left) 2021-07-26T16:02:31.073 INFO:tasks.rados.rados.0.smithi033.stdout:1494: done (2 left) 2021-07-26T16:02:31.073 INFO:tasks.rados.rados.0.smithi033.stdout:1495: rollback oid 21 current snap is 147 2021-07-26T16:02:31.073 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 21 to 145 2021-07-26T16:02:31.073 INFO:tasks.rados.rados.0.smithi033.stdout:1496: read oid 25 snap -1 2021-07-26T16:02:31.074 INFO:tasks.rados.rados.0.smithi033.stdout:1496: expect (ObjNum 411 snap 130 seq_num 411) 2021-07-26T16:02:31.074 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 147 2021-07-26T16:02:31.074 INFO:tasks.rados.rados.0.smithi033.stdout:1497: seq_num 463 ranges {4710400=557056} 2021-07-26T16:02:31.105 INFO:tasks.rados.rados.0.smithi033.stdout:1497: writing smithi03339061-35 from 4710400 to 5267456 tid 1 2021-07-26T16:02:31.105 INFO:tasks.rados.rados.0.smithi033.stdout:1498: copy_from oid 44 from oid 41 current snap is 147 2021-07-26T16:02:31.105 INFO:tasks.rados.rados.0.smithi033.stdout:1495: finishing rollback tid 0 to smithi03339061-21 2021-07-26T16:02:31.105 INFO:tasks.rados.rados.0.smithi033.stdout:1499: copy_from oid 14 from oid 20 current snap is 147 2021-07-26T16:02:31.106 INFO:tasks.rados.rados.0.smithi033.stdout:1495: finishing rollback tid 1 to smithi03339061-21 2021-07-26T16:02:31.106 INFO:tasks.rados.rados.0.smithi033.stdout:1495: finishing rollback tid 2 to smithi03339061-21 2021-07-26T16:02:31.106 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 640 (ObjNum 418 snap 131 seq_num 418) dirty exists 2021-07-26T16:02:31.106 INFO:tasks.rados.rados.0.smithi033.stdout:1496: expect (ObjNum 411 snap 130 seq_num 411) 2021-07-26T16:02:31.238 INFO:tasks.rados.rados.0.smithi033.stdout:1499: finishing copy_from to smithi03339061-14 2021-07-26T16:02:31.238 INFO:tasks.rados.rados.0.smithi033.stdout:1499: got expected ENOENT (src dne) 2021-07-26T16:02:31.239 INFO:tasks.rados.rados.0.smithi033.stdout:1499: finishing copy_from racing read to smithi03339061-14 2021-07-26T16:02:31.239 INFO:tasks.rados.rados.0.smithi033.stdout:1497: finishing write tid 1 to smithi03339061-35 2021-07-26T16:02:31.239 INFO:tasks.rados.rados.0.smithi033.stdout:1497: finishing write tid 2 to smithi03339061-35 2021-07-26T16:02:31.239 INFO:tasks.rados.rados.0.smithi033.stdout:1495: done (6 left) 2021-07-26T16:02:31.240 INFO:tasks.rados.rados.0.smithi033.stdout:1496: done (5 left) 2021-07-26T16:02:31.240 INFO:tasks.rados.rados.0.smithi033.stdout:1499: done (4 left) 2021-07-26T16:02:31.240 INFO:tasks.rados.rados.0.smithi033.stdout:1500: snap_create 2021-07-26T16:02:31.240 INFO:tasks.rados.rados.0.smithi033.stdout:1497: finishing write tid 3 to smithi03339061-35 2021-07-26T16:02:31.241 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 475 (ObjNum 463 snap 147 seq_num 463) dirty exists 2021-07-26T16:02:31.241 INFO:tasks.rados.rados.0.smithi033.stdout:1497: left oid 35 (ObjNum 463 snap 147 seq_num 463) 2021-07-26T16:02:31.241 INFO:tasks.rados.rados.0.smithi033.stdout:1498: finishing copy_from to smithi03339061-44 2021-07-26T16:02:31.242 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 511 (ObjNum 417 snap 131 seq_num 417) dirty exists 2021-07-26T16:02:31.242 INFO:tasks.rados.rados.0.smithi033.stdout:1498: finishing copy_from racing read to smithi03339061-44 2021-07-26T16:02:31.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:31 smithi033 bash[41341]: cluster 2021-07-26T16:02:30.045588+0000 mon.a (mon.0) 663 : cluster [WRN] Health check update: Degraded data redundancy: 11/216 objects degraded (5.093%), 5 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:31.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:31 smithi033 bash[41341]: cluster 2021-07-26T16:02:30.065087+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2021-07-26T16:02:31.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:31 smithi033 bash[42377]: cluster 2021-07-26T16:02:30.045588+0000 mon.a (mon.0) 663 : cluster [WRN] Health check update: Degraded data redundancy: 11/216 objects degraded (5.093%), 5 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:31.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:31 smithi033 bash[42377]: cluster 2021-07-26T16:02:30.065087+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2021-07-26T16:02:31.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:31 smithi096 bash[33981]: cluster 2021-07-26T16:02:30.045588+0000 mon.a (mon.0) 663 : cluster [WRN] Health check update: Degraded data redundancy: 11/216 objects degraded (5.093%), 5 pgs degraded (PG_DEGRADED) 2021-07-26T16:02:31.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:31 smithi096 bash[33981]: cluster 2021-07-26T16:02:30.065087+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e359: 8 total, 8 up, 8 in 2021-07-26T16:02:32.077 INFO:tasks.rados.rados.0.smithi033.stdout:1497: done (4 left) 2021-07-26T16:02:32.077 INFO:tasks.rados.rados.0.smithi033.stdout:1498: done (3 left) 2021-07-26T16:02:32.078 INFO:tasks.rados.rados.0.smithi033.stdout:1500: done (2 left) 2021-07-26T16:02:32.078 INFO:tasks.rados.rados.0.smithi033.stdout:1501: delete oid 4 current snap is 148 2021-07-26T16:02:32.081 INFO:tasks.rados.rados.0.smithi033.stdout:1501: done (2 left) 2021-07-26T16:02:32.081 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 148 2021-07-26T16:02:32.081 INFO:tasks.rados.rados.0.smithi033.stdout:1502: seq_num 465 ranges {4530176=598016} 2021-07-26T16:02:32.110 INFO:tasks.rados.rados.0.smithi033.stdout:1502: writing smithi03339061-29 from 4530176 to 5128192 tid 1 2021-07-26T16:02:32.111 INFO:tasks.rados.rados.0.smithi033.stdout:1503: rmattr oid 23 current snap is 148 2021-07-26T16:02:32.111 INFO:tasks.rados.rados.0.smithi033.stdout:1503: done (3 left) 2021-07-26T16:02:32.111 INFO:tasks.rados.rados.0.smithi033.stdout:1504: snap_remove snap 144 2021-07-26T16:02:32.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:32 smithi033 bash[41341]: cluster 2021-07-26T16:02:31.042776+0000 mgr.y (mgr.34104) 240 : cluster [DBG] pgmap v347: 25 pgs: 6 active+clean+wait, 1 active+recovering+degraded, 18 active+clean; 220 MiB data, 682 MiB used, 715 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.6 MiB/s wr, 18 op/s; 1/231 objects degraded (0.433%); 8.7 MiB/s, 2 objects/s recovering 2021-07-26T16:02:32.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:32 smithi033 bash[41341]: cluster 2021-07-26T16:02:31.069162+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2021-07-26T16:02:32.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:32 smithi033 bash[41341]: audit 2021-07-26T16:02:31.557911+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:32.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:32 smithi033 bash[42377]: cluster 2021-07-26T16:02:31.042776+0000 mgr.y (mgr.34104) 240 : cluster [DBG] pgmap v347: 25 pgs: 6 active+clean+wait, 1 active+recovering+degraded, 18 active+clean; 220 MiB data, 682 MiB used, 715 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.6 MiB/s wr, 18 op/s; 1/231 objects degraded (0.433%); 8.7 MiB/s, 2 objects/s recovering 2021-07-26T16:02:32.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:32 smithi033 bash[42377]: cluster 2021-07-26T16:02:31.069162+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2021-07-26T16:02:32.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:32 smithi033 bash[42377]: audit 2021-07-26T16:02:31.557911+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:32.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:32 smithi096 bash[33981]: cluster 2021-07-26T16:02:31.042776+0000 mgr.y (mgr.34104) 240 : cluster [DBG] pgmap v347: 25 pgs: 6 active+clean+wait, 1 active+recovering+degraded, 18 active+clean; 220 MiB data, 682 MiB used, 715 GiB / 715 GiB avail; 3.4 MiB/s rd, 2.6 MiB/s wr, 18 op/s; 1/231 objects degraded (0.433%); 8.7 MiB/s, 2 objects/s recovering 2021-07-26T16:02:32.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:32 smithi096 bash[33981]: cluster 2021-07-26T16:02:31.069162+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e360: 8 total, 8 up, 8 in 2021-07-26T16:02:32.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:32 smithi096 bash[33981]: audit 2021-07-26T16:02:31.557911+0000 mon.a (mon.0) 666 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:33.096 INFO:tasks.rados.rados.0.smithi033.stdout:1504: done (3 left) 2021-07-26T16:02:33.096 INFO:tasks.rados.rados.0.smithi033.stdout:1505: delete oid 1 current snap is 148 2021-07-26T16:02:33.104 INFO:tasks.rados.rados.0.smithi033.stdout:1505: done (3 left) 2021-07-26T16:02:33.104 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 148 2021-07-26T16:02:33.104 INFO:tasks.rados.rados.0.smithi033.stdout:1506: seq_num 467 ranges {5996544=630784} 2021-07-26T16:02:33.141 INFO:tasks.rados.rados.0.smithi033.stdout:1506: writing smithi03339061-42 from 5996544 to 6627328 tid 1 2021-07-26T16:02:33.141 INFO:tasks.rados.rados.0.smithi033.stdout:1507: snap_remove snap 146 2021-07-26T16:02:33.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: cluster 2021-07-26T16:02:32.073747+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2021-07-26T16:02:33.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.388773+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:33.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.397429+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:33.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.408106+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:33.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.410334+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.412204+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.413655+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.416536+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.419567+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.421444+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.423346+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.425169+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.427088+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[42377]: audit 2021-07-26T16:02:32.428960+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: cluster 2021-07-26T16:02:32.073747+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2021-07-26T16:02:33.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.388773+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:33.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.397429+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:33.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.408106+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:33.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.410334+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.412204+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.413655+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.416536+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.419567+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.421444+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.423346+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.425169+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.427088+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[41341]: audit 2021-07-26T16:02:32.428960+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: cluster 2021-07-26T16:02:32.073747+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e361: 8 total, 8 up, 8 in 2021-07-26T16:02:33.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.388773+0000 mon.a (mon.0) 668 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:33.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.397429+0000 mon.a (mon.0) 669 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:33.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.408106+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:33.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.410334+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.412204+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.413655+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.416536+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.419567+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.421444+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.423346+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.425169+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.427088+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:33 smithi096 bash[33981]: audit 2021-07-26T16:02:32.428960+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:33.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:33.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:33.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:33 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:33.521Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:02:34.112 INFO:tasks.rados.rados.0.smithi033.stdout:1507: done (4 left) 2021-07-26T16:02:34.112 INFO:tasks.rados.rados.0.smithi033.stdout:1508: read oid 35 snap -1 2021-07-26T16:02:34.112 INFO:tasks.rados.rados.0.smithi033.stdout:1508: expect (ObjNum 463 snap 147 seq_num 463) 2021-07-26T16:02:34.113 INFO:tasks.rados.rados.0.smithi033.stdout:1506: finishing write tid 1 to smithi03339061-42 2021-07-26T16:02:34.113 INFO:tasks.rados.rados.0.smithi033.stdout:1506: finishing write tid 2 to smithi03339061-42 2021-07-26T16:02:34.113 INFO:tasks.rados.rados.0.smithi033.stdout:1506: finishing write tid 3 to smithi03339061-42 2021-07-26T16:02:34.113 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 253 (ObjNum 467 snap 148 seq_num 467) dirty exists 2021-07-26T16:02:34.113 INFO:tasks.rados.rados.0.smithi033.stdout:1506: left oid 42 (ObjNum 467 snap 148 seq_num 467) 2021-07-26T16:02:34.114 INFO:tasks.rados.rados.0.smithi033.stdout:1506: done (4 left) 2021-07-26T16:02:34.114 INFO:tasks.rados.rados.0.smithi033.stdout:1509: delete oid 7 current snap is 148 2021-07-26T16:02:34.124 INFO:tasks.rados.rados.0.smithi033.stdout:1509: done (4 left) 2021-07-26T16:02:34.124 INFO:tasks.rados.rados.0.smithi033.stdout:1510: read oid 11 snap 145 2021-07-26T16:02:34.125 INFO:tasks.rados.rados.0.smithi033.stdout:1510: expect deleted 2021-07-26T16:02:34.125 INFO:tasks.rados.rados.0.smithi033.stdout:1511: read oid 19 snap 147 2021-07-26T16:02:34.125 INFO:tasks.rados.rados.0.smithi033.stdout:1511: expect deleted 2021-07-26T16:02:34.125 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 148 2021-07-26T16:02:34.126 INFO:tasks.rados.rados.0.smithi033.stdout:1512: seq_num 469 ranges {0=663552} 2021-07-26T16:02:34.128 INFO:tasks.rados.rados.0.smithi033.stdout:1512: writing smithi03339061-43 from 0 to 663552 tid 1 2021-07-26T16:02:34.129 INFO:tasks.rados.rados.0.smithi033.stdout:1513: rollback oid 6 current snap is 148 2021-07-26T16:02:34.129 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 140 2021-07-26T16:02:34.129 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 148 2021-07-26T16:02:34.129 INFO:tasks.rados.rados.0.smithi033.stdout:1514: seq_num 470 ranges {6479872=679936} 2021-07-26T16:02:34.171 INFO:tasks.rados.rados.0.smithi033.stdout:1514: writing smithi03339061-50 from 6479872 to 7159808 tid 1 2021-07-26T16:02:34.171 INFO:tasks.rados.rados.0.smithi033.stdout:1515: setattr oid 24 current snap is 148 2021-07-26T16:02:34.171 INFO:tasks.rados.rados.0.smithi033.stdout:1512: finishing write tid 1 to smithi03339061-43 2021-07-26T16:02:34.171 INFO:tasks.rados.rados.0.smithi033.stdout:1512: finishing write tid 2 to smithi03339061-43 2021-07-26T16:02:34.172 INFO:tasks.rados.rados.0.smithi033.stdout:1513: finishing rollback tid 0 to smithi03339061-6 2021-07-26T16:02:34.172 INFO:tasks.rados.rados.0.smithi033.stdout:1513: finishing rollback tid 1 to smithi03339061-6 2021-07-26T16:02:34.172 INFO:tasks.rados.rados.0.smithi033.stdout:1513: finishing rollback tid 2 to smithi03339061-6 2021-07-26T16:02:34.172 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 819 (ObjNum 405 snap 128 seq_num 405) dirty exists 2021-07-26T16:02:34.173 INFO:tasks.rados.rados.0.smithi033.stdout:1512: finishing write tid 3 to smithi03339061-43 2021-07-26T16:02:34.173 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 779 (ObjNum 469 snap 148 seq_num 469) dirty exists 2021-07-26T16:02:34.173 INFO:tasks.rados.rados.0.smithi033.stdout:1512: left oid 43 (ObjNum 469 snap 148 seq_num 469) 2021-07-26T16:02:34.173 INFO:tasks.rados.rados.0.smithi033.stdout:1508: expect (ObjNum 463 snap 147 seq_num 463) 2021-07-26T16:02:34.368 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:34 smithi096 bash[33981]: cluster 2021-07-26T16:02:33.043524+0000 mgr.y (mgr.34104) 241 : cluster [DBG] pgmap v350: 25 pgs: 6 active+clean+wait, 19 active+clean; 225 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 13 op/s; 4.1 MiB/s, 1 objects/s recovering 2021-07-26T16:02:34.368 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:34 smithi096 bash[33981]: cluster 2021-07-26T16:02:33.091097+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2021-07-26T16:02:34.369 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:34 smithi096 bash[33981]: cluster 2021-07-26T16:02:33.394492+0000 mon.a (mon.0) 671 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/231 objects degraded (0.433%), 1 pg degraded) 2021-07-26T16:02:34.370 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:34 smithi096 bash[33981]: cluster 2021-07-26T16:02:33.394561+0000 mon.a (mon.0) 672 : cluster [INF] Cluster is now healthy 2021-07-26T16:02:34.461 INFO:tasks.rados.rados.0.smithi033.stdout:1514: finishing write tid 1 to smithi03339061-50 2021-07-26T16:02:34.462 INFO:tasks.rados.rados.0.smithi033.stdout:1514: finishing write tid 2 to smithi03339061-50 2021-07-26T16:02:34.462 INFO:tasks.rados.rados.0.smithi033.stdout:1514: finishing write tid 3 to smithi03339061-50 2021-07-26T16:02:34.462 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 652 (ObjNum 470 snap 148 seq_num 470) dirty exists 2021-07-26T16:02:34.462 INFO:tasks.rados.rados.0.smithi033.stdout:1514: left oid 50 (ObjNum 470 snap 148 seq_num 470) 2021-07-26T16:02:34.463 INFO:tasks.rados.rados.0.smithi033.stdout:1508: done (9 left) 2021-07-26T16:02:34.463 INFO:tasks.rados.rados.0.smithi033.stdout:1511: done (8 left) 2021-07-26T16:02:34.463 INFO:tasks.rados.rados.0.smithi033.stdout:1512: done (7 left) 2021-07-26T16:02:34.463 INFO:tasks.rados.rados.0.smithi033.stdout:1513: done (6 left) 2021-07-26T16:02:34.464 INFO:tasks.rados.rados.0.smithi033.stdout:1514: done (5 left) 2021-07-26T16:02:34.464 INFO:tasks.rados.rados.0.smithi033.stdout:1516: copy_from oid 20 from oid 21 current snap is 148 2021-07-26T16:02:34.464 INFO:tasks.rados.rados.0.smithi033.stdout:1517: read oid 7 snap -1 2021-07-26T16:02:34.465 INFO:tasks.rados.rados.0.smithi033.stdout:1517: expect deleted 2021-07-26T16:02:34.465 INFO:tasks.rados.rados.0.smithi033.stdout:1518: rollback oid 5 current snap is 148 2021-07-26T16:02:34.465 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 5 to 147 2021-07-26T16:02:34.465 INFO:tasks.rados.rados.0.smithi033.stdout:1519: read oid 48 snap -1 2021-07-26T16:02:34.465 INFO:tasks.rados.rados.0.smithi033.stdout:1519: expect (ObjNum 399 snap 123 seq_num 399) 2021-07-26T16:02:34.466 INFO:tasks.rados.rados.0.smithi033.stdout:1520: copy_from oid 13 from oid 3 current snap is 148 2021-07-26T16:02:34.466 INFO:tasks.rados.rados.0.smithi033.stdout:1521: snap_remove snap 136 2021-07-26T16:02:34.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:34 smithi033 bash[41341]: cluster 2021-07-26T16:02:33.043524+0000 mgr.y (mgr.34104) 241 : cluster [DBG] pgmap v350: 25 pgs: 6 active+clean+wait, 19 active+clean; 225 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 13 op/s; 4.1 MiB/s, 1 objects/s recovering 2021-07-26T16:02:34.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:34 smithi033 bash[41341]: cluster 2021-07-26T16:02:33.091097+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2021-07-26T16:02:34.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:34 smithi033 bash[41341]: cluster 2021-07-26T16:02:33.394492+0000 mon.a (mon.0) 671 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/231 objects degraded (0.433%), 1 pg degraded) 2021-07-26T16:02:34.467 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:34 smithi033 bash[41341]: cluster 2021-07-26T16:02:33.394561+0000 mon.a (mon.0) 672 : cluster [INF] Cluster is now healthy 2021-07-26T16:02:34.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:34 smithi033 bash[42377]: cluster 2021-07-26T16:02:33.043524+0000 mgr.y (mgr.34104) 241 : cluster [DBG] pgmap v350: 25 pgs: 6 active+clean+wait, 19 active+clean; 225 MiB data, 699 MiB used, 715 GiB / 715 GiB avail; 11 MiB/s rd, 3.8 MiB/s wr, 13 op/s; 4.1 MiB/s, 1 objects/s recovering 2021-07-26T16:02:34.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:34 smithi033 bash[42377]: cluster 2021-07-26T16:02:33.091097+0000 mon.a (mon.0) 670 : cluster [DBG] osdmap e362: 8 total, 8 up, 8 in 2021-07-26T16:02:34.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:34 smithi033 bash[42377]: cluster 2021-07-26T16:02:33.394492+0000 mon.a (mon.0) 671 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/231 objects degraded (0.433%), 1 pg degraded) 2021-07-26T16:02:34.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:34 smithi033 bash[42377]: cluster 2021-07-26T16:02:33.394561+0000 mon.a (mon.0) 672 : cluster [INF] Cluster is now healthy 2021-07-26T16:02:35.122 INFO:tasks.rados.rados.0.smithi033.stdout:1521: done (10 left) 2021-07-26T16:02:35.123 INFO:tasks.rados.rados.0.smithi033.stdout:1522: read oid 15 snap -1 2021-07-26T16:02:35.123 INFO:tasks.rados.rados.0.smithi033.stdout:1522: expect (ObjNum 414 snap 131 seq_num 414) 2021-07-26T16:02:35.123 INFO:tasks.rados.rados.0.smithi033.stdout:1523: read oid 18 snap -1 2021-07-26T16:02:35.123 INFO:tasks.rados.rados.0.smithi033.stdout:1523: expect (ObjNum 436 snap 136 seq_num 436) 2021-07-26T16:02:35.123 INFO:tasks.rados.rados.0.smithi033.stdout:1524: read oid 40 snap 145 2021-07-26T16:02:35.124 INFO:tasks.rados.rados.0.smithi033.stdout:1524: expect (ObjNum 417 snap 131 seq_num 417) 2021-07-26T16:02:35.124 INFO:tasks.rados.rados.0.smithi033.stdout:1525: delete oid 37 current snap is 148 2021-07-26T16:02:35.124 INFO:tasks.rados.rados.0.smithi033.stdout:1520: finishing copy_from to smithi03339061-13 2021-07-26T16:02:35.124 INFO:tasks.rados.rados.0.smithi033.stdout:1520: got expected ENOENT (src dne) 2021-07-26T16:02:35.125 INFO:tasks.rados.rados.0.smithi033.stdout:1520: finishing copy_from racing read to smithi03339061-13 2021-07-26T16:02:35.125 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 692 (ObjNum 462 snap 146 seq_num 462) dirty exists 2021-07-26T16:02:35.125 INFO:tasks.rados.rados.0.smithi033.stdout:1518: finishing rollback tid 0 to smithi03339061-5 2021-07-26T16:02:35.125 INFO:tasks.rados.rados.0.smithi033.stdout:1518: finishing rollback tid 1 to smithi03339061-5 2021-07-26T16:02:35.125 INFO:tasks.rados.rados.0.smithi033.stdout:1518: finishing rollback tid 2 to smithi03339061-5 2021-07-26T16:02:35.126 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 782 (ObjNum 432 snap 135 seq_num 432) dirty exists 2021-07-26T16:02:35.127 INFO:tasks.rados.rados.0.smithi033.stdout:1516: finishing copy_from to smithi03339061-20 2021-07-26T16:02:35.127 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 640 (ObjNum 418 snap 131 seq_num 418) dirty exists 2021-07-26T16:02:35.127 INFO:tasks.rados.rados.0.smithi033.stdout:1516: finishing copy_from racing read to smithi03339061-20 2021-07-26T16:02:35.127 INFO:tasks.rados.rados.0.smithi033.stdout:1519: expect (ObjNum 399 snap 123 seq_num 399) 2021-07-26T16:02:35.363 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:35 smithi096 bash[33981]: cluster 2021-07-26T16:02:34.108722+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2021-07-26T16:02:35.364 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:35 smithi096 systemd[1]: Stopping Ceph node-exporter.b for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T16:02:35.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:35 smithi033 bash[41341]: cluster 2021-07-26T16:02:34.108722+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2021-07-26T16:02:35.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:35 smithi033 bash[42377]: cluster 2021-07-26T16:02:34.108722+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e363: 8 total, 8 up, 8 in 2021-07-26T16:02:35.735 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:35 smithi096 docker[40852]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:02:35.750 INFO:tasks.rados.rados.0.smithi033.stdout:1523: expect (ObjNum 436 snap 136 seq_num 436) 2021-07-26T16:02:35.754 INFO:tasks.rados.rados.0.smithi033.stdout:1524: expect (ObjNum 417 snap 131 seq_num 417) 2021-07-26T16:02:36.014 INFO:tasks.rados.rados.0.smithi033.stdout:1522: expect (ObjNum 414 snap 131 seq_num 414) 2021-07-26T16:02:36.267 INFO:tasks.rados.rados.0.smithi033.stdout:1515: done (13 left) 2021-07-26T16:02:36.267 INFO:tasks.rados.rados.0.smithi033.stdout:1516: done (12 left) 2021-07-26T16:02:36.268 INFO:tasks.rados.rados.0.smithi033.stdout:1517: done (11 left) 2021-07-26T16:02:36.268 INFO:tasks.rados.rados.0.smithi033.stdout:1518: done (10 left) 2021-07-26T16:02:36.268 INFO:tasks.rados.rados.0.smithi033.stdout:1519: done (9 left) 2021-07-26T16:02:36.268 INFO:tasks.rados.rados.0.smithi033.stdout:1520: done (8 left) 2021-07-26T16:02:36.269 INFO:tasks.rados.rados.0.smithi033.stdout:1522: done (7 left) 2021-07-26T16:02:36.269 INFO:tasks.rados.rados.0.smithi033.stdout:1523: done (6 left) 2021-07-26T16:02:36.269 INFO:tasks.rados.rados.0.smithi033.stdout:1524: done (5 left) 2021-07-26T16:02:36.269 INFO:tasks.rados.rados.0.smithi033.stdout:1525: done (4 left) 2021-07-26T16:02:36.270 INFO:tasks.rados.rados.0.smithi033.stdout:1526: snap_remove snap 140 2021-07-26T16:02:36.373 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:36 smithi096 docker[40852]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-node-exporter.b 2021-07-26T16:02:36.373 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:36 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2021-07-26T16:02:36.373 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:36 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@node-exporter.b.service: Failed with result 'exit-code'. 2021-07-26T16:02:36.374 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:36 smithi096 systemd[1]: Stopped Ceph node-exporter.b for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:02:36.374 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:36 smithi096 bash[33981]: cephadm 2021-07-26T16:02:34.923783+0000 mgr.y (mgr.34104) 242 : cephadm [INF] Upgrade: Updating node-exporter.b 2021-07-26T16:02:36.374 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:36 smithi096 bash[33981]: cephadm 2021-07-26T16:02:34.924112+0000 mgr.y (mgr.34104) 243 : cephadm [INF] Deploying daemon node-exporter.b on smithi096 2021-07-26T16:02:36.375 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:36 smithi096 bash[33981]: cluster 2021-07-26T16:02:35.044296+0000 mgr.y (mgr.34104) 244 : cluster [DBG] pgmap v353: 25 pgs: 6 active+clean+wait, 19 active+clean; 226 MiB data, 704 MiB used, 715 GiB / 715 GiB avail; 7.7 MiB/s rd, 1.3 MiB/s wr, 6 op/s; 666 KiB/s, 0 objects/s recovering 2021-07-26T16:02:36.375 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:36 smithi096 bash[33981]: cluster 2021-07-26T16:02:35.117916+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2021-07-26T16:02:36.375 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:36 smithi096 bash[33981]: cluster 2021-07-26T16:02:36.020115+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2021-07-26T16:02:36.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:36 smithi033 bash[41341]: cephadm 2021-07-26T16:02:34.923783+0000 mgr.y (mgr.34104) 242 : cephadm [INF] Upgrade: Updating node-exporter.b 2021-07-26T16:02:36.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:36 smithi033 bash[41341]: cephadm 2021-07-26T16:02:34.924112+0000 mgr.y (mgr.34104) 243 : cephadm [INF] Deploying daemon node-exporter.b on smithi096 2021-07-26T16:02:36.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:36 smithi033 bash[41341]: cluster 2021-07-26T16:02:35.044296+0000 mgr.y (mgr.34104) 244 : cluster [DBG] pgmap v353: 25 pgs: 6 active+clean+wait, 19 active+clean; 226 MiB data, 704 MiB used, 715 GiB / 715 GiB avail; 7.7 MiB/s rd, 1.3 MiB/s wr, 6 op/s; 666 KiB/s, 0 objects/s recovering 2021-07-26T16:02:36.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:36 smithi033 bash[41341]: cluster 2021-07-26T16:02:35.117916+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2021-07-26T16:02:36.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:36 smithi033 bash[41341]: cluster 2021-07-26T16:02:36.020115+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2021-07-26T16:02:36.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:36 smithi033 bash[42377]: cephadm 2021-07-26T16:02:34.923783+0000 mgr.y (mgr.34104) 242 : cephadm [INF] Upgrade: Updating node-exporter.b 2021-07-26T16:02:36.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:36 smithi033 bash[42377]: cephadm 2021-07-26T16:02:34.924112+0000 mgr.y (mgr.34104) 243 : cephadm [INF] Deploying daemon node-exporter.b on smithi096 2021-07-26T16:02:36.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:36 smithi033 bash[42377]: cluster 2021-07-26T16:02:35.044296+0000 mgr.y (mgr.34104) 244 : cluster [DBG] pgmap v353: 25 pgs: 6 active+clean+wait, 19 active+clean; 226 MiB data, 704 MiB used, 715 GiB / 715 GiB avail; 7.7 MiB/s rd, 1.3 MiB/s wr, 6 op/s; 666 KiB/s, 0 objects/s recovering 2021-07-26T16:02:36.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:36 smithi033 bash[42377]: cluster 2021-07-26T16:02:35.117916+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e364: 8 total, 8 up, 8 in 2021-07-26T16:02:36.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:36 smithi033 bash[42377]: cluster 2021-07-26T16:02:36.020115+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e365: 8 total, 8 up, 8 in 2021-07-26T16:02:36.735 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:36 smithi096 systemd[1]: Started Ceph node-exporter.b for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:02:36.735 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:36 smithi096 bash[40919]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:02:37.131 INFO:tasks.rados.rados.0.smithi033.stdout:1526: done (4 left) 2021-07-26T16:02:37.131 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 148 2021-07-26T16:02:37.132 INFO:tasks.rados.rados.0.smithi033.stdout:1527: seq_num 472 ranges {7348224=712704} 2021-07-26T16:02:37.175 INFO:tasks.rados.rados.0.smithi033.stdout:1527: writing smithi03339061-12 from 7348224 to 8060928 tid 1 2021-07-26T16:02:37.175 INFO:tasks.rados.rados.0.smithi033.stdout:1528: setattr oid 32 current snap is 148 2021-07-26T16:02:37.176 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 148 2021-07-26T16:02:37.176 INFO:tasks.rados.rados.0.smithi033.stdout:1529: seq_num 473 ranges {0=729088} 2021-07-26T16:02:37.180 INFO:tasks.rados.rados.0.smithi033.stdout:1529: writing smithi03339061-7 from 0 to 729088 tid 1 2021-07-26T16:02:37.182 INFO:tasks.rados.rados.0.smithi033.stdout:1530: copy_from oid 10 from oid 43 current snap is 148 2021-07-26T16:02:37.182 INFO:tasks.rados.rados.0.smithi033.stdout:1531: rollback oid 38 current snap is 148 2021-07-26T16:02:37.182 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 38 to 147 2021-07-26T16:02:37.182 INFO:tasks.rados.rados.0.smithi033.stdout:1532: delete oid 33 current snap is 148 2021-07-26T16:02:37.183 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 653 (ObjNum 430 snap 135 seq_num 430) dirty exists 2021-07-26T16:02:37.184 INFO:tasks.rados.rados.0.smithi033.stdout:1527: finishing write tid 1 to smithi03339061-12 2021-07-26T16:02:37.184 INFO:tasks.rados.rados.0.smithi033.stdout:1527: finishing write tid 2 to smithi03339061-12 2021-07-26T16:02:37.186 INFO:tasks.rados.rados.0.smithi033.stdout:1527: finishing write tid 3 to smithi03339061-12 2021-07-26T16:02:37.186 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 375 (ObjNum 472 snap 148 seq_num 472) dirty exists 2021-07-26T16:02:37.186 INFO:tasks.rados.rados.0.smithi033.stdout:1527: left oid 12 (ObjNum 472 snap 148 seq_num 472) 2021-07-26T16:02:37.187 INFO:tasks.rados.rados.0.smithi033.stdout:1529: finishing write tid 1 to smithi03339061-7 2021-07-26T16:02:37.188 INFO:tasks.rados.rados.0.smithi033.stdout:1529: finishing write tid 2 to smithi03339061-7 2021-07-26T16:02:37.188 INFO:tasks.rados.rados.0.smithi033.stdout:1531: finishing rollback tid 0 to smithi03339061-38 2021-07-26T16:02:37.188 INFO:tasks.rados.rados.0.smithi033.stdout:1531: finishing rollback tid 1 to smithi03339061-38 2021-07-26T16:02:37.189 INFO:tasks.rados.rados.0.smithi033.stdout:1531: finishing rollback tid 2 to smithi03339061-38 2021-07-26T16:02:37.189 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 439 (ObjNum 461 snap 146 seq_num 461) dirty exists 2021-07-26T16:02:37.190 INFO:tasks.rados.rados.0.smithi033.stdout:1527: done (9 left) 2021-07-26T16:02:37.191 INFO:tasks.rados.rados.0.smithi033.stdout:1528: done (8 left) 2021-07-26T16:02:37.191 INFO:tasks.rados.rados.0.smithi033.stdout:1531: done (7 left) 2021-07-26T16:02:37.191 INFO:tasks.rados.rados.0.smithi033.stdout:1532: done (6 left) 2021-07-26T16:02:37.191 INFO:tasks.rados.rados.0.smithi033.stdout:1533: copy_from oid 41 from oid 30 current snap is 148 2021-07-26T16:02:37.191 INFO:tasks.rados.rados.0.smithi033.stdout:1534: copy_from oid 37 from oid 6 current snap is 148 2021-07-26T16:02:37.192 INFO:tasks.rados.rados.0.smithi033.stdout:1535: read oid 3 snap -1 2021-07-26T16:02:37.192 INFO:tasks.rados.rados.0.smithi033.stdout:1535: expect deleted 2021-07-26T16:02:37.192 INFO:tasks.rados.rados.0.smithi033.stdout:1536: delete oid 15 current snap is 148 2021-07-26T16:02:37.193 INFO:tasks.rados.rados.0.smithi033.stdout:1529: finishing write tid 3 to smithi03339061-7 2021-07-26T16:02:37.194 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 659 (ObjNum 473 snap 148 seq_num 473) dirty exists 2021-07-26T16:02:37.194 INFO:tasks.rados.rados.0.smithi033.stdout:1529: left oid 7 (ObjNum 473 snap 148 seq_num 473) 2021-07-26T16:02:37.195 INFO:tasks.rados.rados.0.smithi033.stdout:1529: done (9 left) 2021-07-26T16:02:37.195 INFO:tasks.rados.rados.0.smithi033.stdout:1535: done (8 left) 2021-07-26T16:02:37.196 INFO:tasks.rados.rados.0.smithi033.stdout:1536: done (7 left) 2021-07-26T16:02:37.196 INFO:tasks.rados.rados.0.smithi033.stdout:1537: rmattr oid 48 current snap is 148 2021-07-26T16:02:37.196 INFO:tasks.rados.rados.0.smithi033.stdout:1537: done (7 left) 2021-07-26T16:02:37.196 INFO:tasks.rados.rados.0.smithi033.stdout:1538: read oid 47 snap -1 2021-07-26T16:02:37.197 INFO:tasks.rados.rados.0.smithi033.stdout:1538: expect (ObjNum 423 snap 131 seq_num 423) 2021-07-26T16:02:37.197 INFO:tasks.rados.rados.0.smithi033.stdout:1539: rollback oid 1 current snap is 148 2021-07-26T16:02:37.197 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 1 to 145 2021-07-26T16:02:37.197 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 148 2021-07-26T16:02:37.197 INFO:tasks.rados.rados.0.smithi033.stdout:1540: seq_num 476 ranges {5267456=778240} 2021-07-26T16:02:37.232 INFO:tasks.rados.rados.0.smithi033.stdout:1540: writing smithi03339061-35 from 5267456 to 6045696 tid 1 2021-07-26T16:02:37.233 INFO:tasks.rados.rados.0.smithi033.stdout:1541: snap_create 2021-07-26T16:02:37.233 INFO:tasks.rados.rados.0.smithi033.stdout:1539: finishing rollback tid 1 to smithi03339061-1 2021-07-26T16:02:37.233 INFO:tasks.rados.rados.0.smithi033.stdout:1539: finishing rollback tid 2 to smithi03339061-1 2021-07-26T16:02:37.233 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 66 (ObjNum 400 snap 126 seq_num 400) dirty exists 2021-07-26T16:02:37.234 INFO:tasks.rados.rados.0.smithi033.stdout:1530: finishing copy_from to smithi03339061-10 2021-07-26T16:02:37.235 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 779 (ObjNum 469 snap 148 seq_num 469) dirty exists 2021-07-26T16:02:37.236 INFO:tasks.rados.rados.0.smithi033.stdout:1530: finishing copy_from racing read to smithi03339061-10 2021-07-26T16:02:37.237 INFO:tasks.rados.rados.0.smithi033.stdout:1540: finishing write tid 1 to smithi03339061-35 2021-07-26T16:02:37.237 INFO:tasks.rados.rados.0.smithi033.stdout:1540: finishing write tid 2 to smithi03339061-35 2021-07-26T16:02:37.237 INFO:tasks.rados.rados.0.smithi033.stdout:1534: finishing copy_from to smithi03339061-37 2021-07-26T16:02:37.238 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 819 (ObjNum 405 snap 128 seq_num 405) dirty exists 2021-07-26T16:02:37.238 INFO:tasks.rados.rados.0.smithi033.stdout:1534: finishing copy_from racing read to smithi03339061-37 2021-07-26T16:02:37.239 INFO:tasks.rados.rados.0.smithi033.stdout:1540: finishing write tid 3 to smithi03339061-35 2021-07-26T16:02:37.239 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 496 (ObjNum 476 snap 148 seq_num 476) dirty exists 2021-07-26T16:02:37.239 INFO:tasks.rados.rados.0.smithi033.stdout:1540: left oid 35 (ObjNum 476 snap 148 seq_num 476) 2021-07-26T16:02:37.244 INFO:tasks.rados.rados.0.smithi033.stdout:1538: expect (ObjNum 423 snap 131 seq_num 423) 2021-07-26T16:02:37.656 INFO:tasks.rados.rados.0.smithi033.stdout:1533: finishing copy_from to smithi03339061-41 2021-07-26T16:02:37.656 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 628 (ObjNum 394 snap 120 seq_num 394) dirty exists 2021-07-26T16:02:37.656 INFO:tasks.rados.rados.0.smithi033.stdout:1533: finishing copy_from racing read to smithi03339061-41 2021-07-26T16:02:37.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:37 smithi033 bash[41341]: audit 2021-07-26T16:02:36.535611+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:37.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:37 smithi033 bash[41341]: audit 2021-07-26T16:02:36.538297+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:37.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:37 smithi033 bash[41341]: audit 2021-07-26T16:02:36.540526+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:37.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:37 smithi033 bash[41341]: audit 2021-07-26T16:02:36.542293+0000 mon.c (mon.1) 150 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:37.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:37 smithi033 bash[41341]: cluster 2021-07-26T16:02:37.124736+0000 mon.a (mon.0) 677 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2021-07-26T16:02:37.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:37 smithi033 bash[42377]: audit 2021-07-26T16:02:36.535611+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:37.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:37 smithi033 bash[42377]: audit 2021-07-26T16:02:36.538297+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:37.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:37 smithi033 bash[42377]: audit 2021-07-26T16:02:36.540526+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:37.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:37 smithi033 bash[42377]: audit 2021-07-26T16:02:36.542293+0000 mon.c (mon.1) 150 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:37.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:37 smithi033 bash[42377]: cluster 2021-07-26T16:02:37.124736+0000 mon.a (mon.0) 677 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2021-07-26T16:02:37.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[33981]: audit 2021-07-26T16:02:36.535611+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:37.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[33981]: audit 2021-07-26T16:02:36.538297+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:37.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[33981]: audit 2021-07-26T16:02:36.540526+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:37.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[33981]: audit 2021-07-26T16:02:36.542293+0000 mon.c (mon.1) 150 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:37.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[33981]: cluster 2021-07-26T16:02:37.124736+0000 mon.a (mon.0) 677 : cluster [DBG] osdmap e366: 8 total, 8 up, 8 in 2021-07-26T16:02:37.987 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-07-26T16:02:37.987 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-07-26T16:02:37.987 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-07-26T16:02:37.988 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-07-26T16:02:37.988 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-07-26T16:02:37.988 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-07-26T16:02:37.988 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-07-26T16:02:37.988 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-07-26T16:02:37.989 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-07-26T16:02:37.989 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-07-26T16:02:37.989 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-07-26T16:02:37.989 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-07-26T16:02:37.990 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-07-26T16:02:37.990 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-07-26T16:02:37.990 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-07-26T16:02:37.990 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-07-26T16:02:37.991 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-07-26T16:02:37.991 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-07-26T16:02:37.991 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-07-26T16:02:37.991 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-07-26T16:02:37.992 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-07-26T16:02:37.992 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-07-26T16:02:37.992 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-07-26T16:02:37.992 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-07-26T16:02:37.992 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-07-26T16:02:37.993 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-07-26T16:02:37.993 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-07-26T16:02:37.993 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-07-26T16:02:37.993 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-07-26T16:02:37.994 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - time" source="node_exporter.go:104" 2021-07-26T16:02:37.994 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-07-26T16:02:37.994 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-07-26T16:02:37.994 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-07-26T16:02:37.995 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-07-26T16:02:37.995 INFO:journalctl@ceph.node-exporter.b.smithi096.stdout:Jul 26 16:02:37 smithi096 bash[40919]: time="2021-07-26T16:02:37Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-07-26T16:02:38.128 INFO:tasks.rados.rados.0.smithi033.stdout:1530: done (10 left) 2021-07-26T16:02:38.129 INFO:tasks.rados.rados.0.smithi033.stdout:1533: done (9 left) 2021-07-26T16:02:38.129 INFO:tasks.rados.rados.0.smithi033.stdout:1534: done (8 left) 2021-07-26T16:02:38.129 INFO:tasks.rados.rados.0.smithi033.stdout:1538: done (7 left) 2021-07-26T16:02:38.129 INFO:tasks.rados.rados.0.smithi033.stdout:1539: done (6 left) 2021-07-26T16:02:38.129 INFO:tasks.rados.rados.0.smithi033.stdout:1540: done (5 left) 2021-07-26T16:02:38.130 INFO:tasks.rados.rados.0.smithi033.stdout:1541: done (4 left) 2021-07-26T16:02:38.130 INFO:tasks.rados.rados.0.smithi033.stdout:1542: snap_remove snap 148 2021-07-26T16:02:38.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:38 smithi033 bash[41341]: cluster 2021-07-26T16:02:37.045008+0000 mgr.y (mgr.34104) 245 : cluster [DBG] pgmap v356: 25 pgs: 6 active+clean+wait, 19 active+clean; 225 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 7 op/s 2021-07-26T16:02:38.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:38 smithi033 bash[41341]: cluster 2021-07-26T16:02:38.125219+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2021-07-26T16:02:38.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:38 smithi033 bash[42377]: cluster 2021-07-26T16:02:37.045008+0000 mgr.y (mgr.34104) 245 : cluster [DBG] pgmap v356: 25 pgs: 6 active+clean+wait, 19 active+clean; 225 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 7 op/s 2021-07-26T16:02:38.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:38 smithi033 bash[42377]: cluster 2021-07-26T16:02:38.125219+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2021-07-26T16:02:38.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:38 smithi096 bash[33981]: cluster 2021-07-26T16:02:37.045008+0000 mgr.y (mgr.34104) 245 : cluster [DBG] pgmap v356: 25 pgs: 6 active+clean+wait, 19 active+clean; 225 MiB data, 707 MiB used, 715 GiB / 715 GiB avail; 12 MiB/s rd, 4.0 MiB/s wr, 7 op/s 2021-07-26T16:02:38.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:38 smithi096 bash[33981]: cluster 2021-07-26T16:02:38.125219+0000 mon.a (mon.0) 678 : cluster [DBG] osdmap e367: 8 total, 8 up, 8 in 2021-07-26T16:02:39.131 INFO:tasks.rados.rados.0.smithi033.stdout:1542: done (4 left) 2021-07-26T16:02:39.132 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 149 2021-07-26T16:02:39.132 INFO:tasks.rados.rados.0.smithi033.stdout:1543: seq_num 477 ranges {106496=794624} 2021-07-26T16:02:39.140 INFO:tasks.rados.rados.0.smithi033.stdout:1543: writing smithi03339061-18 from 106496 to 901120 tid 1 2021-07-26T16:02:39.140 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 149 2021-07-26T16:02:39.141 INFO:tasks.rados.rados.0.smithi033.stdout:1544: seq_num 478 ranges {0=409600,409600=401408} 2021-07-26T16:02:39.142 INFO:tasks.rados.rados.0.smithi033.stdout:1544: writing smithi03339061-33 from 0 to 409600 tid 1 2021-07-26T16:02:39.146 INFO:tasks.rados.rados.0.smithi033.stdout:1544: writing smithi03339061-33 from 409600 to 811008 tid 2 2021-07-26T16:02:39.146 INFO:tasks.rados.rados.0.smithi033.stdout:1545: copy_from oid 19 from oid 2 current snap is 149 2021-07-26T16:02:39.146 INFO:tasks.rados.rados.0.smithi033.stdout:1546: read oid 26 snap -1 2021-07-26T16:02:39.147 INFO:tasks.rados.rados.0.smithi033.stdout:1546: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:02:39.147 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 149 2021-07-26T16:02:39.147 INFO:tasks.rados.rados.0.smithi033.stdout:1547: seq_num 479 ranges {1269760=425984,1695744=401408} 2021-07-26T16:02:39.156 INFO:tasks.rados.rados.0.smithi033.stdout:1547: writing smithi03339061-28 from 1269760 to 1695744 tid 1 2021-07-26T16:02:39.160 INFO:tasks.rados.rados.0.smithi033.stdout:1547: writing smithi03339061-28 from 1695744 to 2097152 tid 2 2021-07-26T16:02:39.160 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 149 2021-07-26T16:02:39.161 INFO:tasks.rados.rados.0.smithi033.stdout:1545: finishing copy_from to smithi03339061-19 2021-07-26T16:02:39.161 INFO:tasks.rados.rados.0.smithi033.stdout:1545: got expected ENOENT (src dne) 2021-07-26T16:02:39.161 INFO:tasks.rados.rados.0.smithi033.stdout:1548: seq_num 480 ranges {3301376=442368,3743744=401408} 2021-07-26T16:02:39.180 INFO:tasks.rados.rados.0.smithi033.stdout:1548: writing smithi03339061-1 from 3301376 to 3743744 tid 1 2021-07-26T16:02:39.182 INFO:tasks.rados.rados.0.smithi033.stdout:1548: writing smithi03339061-1 from 3743744 to 4145152 tid 2 2021-07-26T16:02:39.183 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 149 2021-07-26T16:02:39.183 INFO:tasks.rados.rados.0.smithi033.stdout:1543: finishing write tid 1 to smithi03339061-18 2021-07-26T16:02:39.183 INFO:tasks.rados.rados.0.smithi033.stdout:1545: finishing copy_from racing read to smithi03339061-19 2021-07-26T16:02:39.183 INFO:tasks.rados.rados.0.smithi033.stdout:1543: finishing write tid 2 to smithi03339061-18 2021-07-26T16:02:39.184 INFO:tasks.rados.rados.0.smithi033.stdout:1544: finishing write tid 1 to smithi03339061-33 2021-07-26T16:02:39.184 INFO:tasks.rados.rados.0.smithi033.stdout:1543: finishing write tid 3 to smithi03339061-18 2021-07-26T16:02:39.184 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 834 (ObjNum 477 snap 149 seq_num 477) dirty exists 2021-07-26T16:02:39.184 INFO:tasks.rados.rados.0.smithi033.stdout:1543: left oid 18 (ObjNum 477 snap 149 seq_num 477) 2021-07-26T16:02:39.184 INFO:tasks.rados.rados.0.smithi033.stdout:1546: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:02:39.191 INFO:tasks.rados.rados.0.smithi033.stdout:1544: finishing write tid 2 to smithi03339061-33 2021-07-26T16:02:39.191 INFO:tasks.rados.rados.0.smithi033.stdout:1544: finishing write tid 3 to smithi03339061-33 2021-07-26T16:02:39.192 INFO:tasks.rados.rados.0.smithi033.stdout:1544: finishing write tid 4 to smithi03339061-33 2021-07-26T16:02:39.192 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 837 (ObjNum 478 snap 149 seq_num 478) dirty exists 2021-07-26T16:02:39.192 INFO:tasks.rados.rados.0.smithi033.stdout:1544: left oid 33 (ObjNum 478 snap 149 seq_num 478) 2021-07-26T16:02:39.192 INFO:tasks.rados.rados.0.smithi033.stdout:1549: seq_num 481 ranges {12083200=458752,12541952=401408} 2021-07-26T16:02:39.263 INFO:tasks.rados.rados.0.smithi033.stdout:1549: writing smithi03339061-32 from 12083200 to 12541952 tid 1 2021-07-26T16:02:39.265 INFO:tasks.rados.rados.0.smithi033.stdout:1549: writing smithi03339061-32 from 12541952 to 12943360 tid 2 2021-07-26T16:02:39.265 INFO:tasks.rados.rados.0.smithi033.stdout:1543: done (10 left) 2021-07-26T16:02:39.265 INFO:tasks.rados.rados.0.smithi033.stdout:1544: done (9 left) 2021-07-26T16:02:39.266 INFO:tasks.rados.rados.0.smithi033.stdout:1545: done (8 left) 2021-07-26T16:02:39.266 INFO:tasks.rados.rados.0.smithi033.stdout:1546: done (7 left) 2021-07-26T16:02:39.266 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 149 2021-07-26T16:02:39.266 INFO:tasks.rados.rados.0.smithi033.stdout:1547: finishing write tid 1 to smithi03339061-28 2021-07-26T16:02:39.266 INFO:tasks.rados.rados.0.smithi033.stdout:1550: seq_num 482 ranges {24576=475136,499712=401408} 2021-07-26T16:02:39.268 INFO:tasks.rados.rados.0.smithi033.stdout:1550: writing smithi03339061-36 from 24576 to 499712 tid 1 2021-07-26T16:02:39.271 INFO:tasks.rados.rados.0.smithi033.stdout:1550: writing smithi03339061-36 from 499712 to 901120 tid 2 2021-07-26T16:02:39.271 INFO:tasks.rados.rados.0.smithi033.stdout:1551: delete oid 20 current snap is 149 2021-07-26T16:02:39.271 INFO:tasks.rados.rados.0.smithi033.stdout:1547: finishing write tid 2 to smithi03339061-28 2021-07-26T16:02:39.272 INFO:tasks.rados.rados.0.smithi033.stdout:1547: finishing write tid 3 to smithi03339061-28 2021-07-26T16:02:39.272 INFO:tasks.rados.rados.0.smithi033.stdout:1547: finishing write tid 4 to smithi03339061-28 2021-07-26T16:02:39.272 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 379 (ObjNum 479 snap 149 seq_num 479) dirty exists 2021-07-26T16:02:39.272 INFO:tasks.rados.rados.0.smithi033.stdout:1547: left oid 28 (ObjNum 479 snap 149 seq_num 479) 2021-07-26T16:02:39.272 INFO:tasks.rados.rados.0.smithi033.stdout:1548: finishing write tid 1 to smithi03339061-1 2021-07-26T16:02:39.273 INFO:tasks.rados.rados.0.smithi033.stdout:1548: finishing write tid 2 to smithi03339061-1 2021-07-26T16:02:39.273 INFO:tasks.rados.rados.0.smithi033.stdout:1548: finishing write tid 3 to smithi03339061-1 2021-07-26T16:02:39.273 INFO:tasks.rados.rados.0.smithi033.stdout:1548: finishing write tid 4 to smithi03339061-1 2021-07-26T16:02:39.273 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 69 (ObjNum 480 snap 149 seq_num 480) dirty exists 2021-07-26T16:02:39.273 INFO:tasks.rados.rados.0.smithi033.stdout:1548: left oid 1 (ObjNum 480 snap 149 seq_num 480) 2021-07-26T16:02:39.274 INFO:tasks.rados.rados.0.smithi033.stdout:1549: finishing write tid 1 to smithi03339061-32 2021-07-26T16:02:39.274 INFO:tasks.rados.rados.0.smithi033.stdout:1549: finishing write tid 2 to smithi03339061-32 2021-07-26T16:02:39.275 INFO:tasks.rados.rados.0.smithi033.stdout:1549: finishing write tid 3 to smithi03339061-32 2021-07-26T16:02:39.275 INFO:tasks.rados.rados.0.smithi033.stdout:1549: finishing write tid 4 to smithi03339061-32 2021-07-26T16:02:39.276 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 656 (ObjNum 481 snap 149 seq_num 481) dirty exists 2021-07-26T16:02:39.279 INFO:tasks.rados.rados.0.smithi033.stdout:1549: left oid 32 (ObjNum 481 snap 149 seq_num 481) 2021-07-26T16:02:39.280 INFO:tasks.rados.rados.0.smithi033.stdout:1547: done (8 left) 2021-07-26T16:02:39.280 INFO:tasks.rados.rados.0.smithi033.stdout:1548: done (7 left) 2021-07-26T16:02:39.280 INFO:tasks.rados.rados.0.smithi033.stdout:1549: done (6 left) 2021-07-26T16:02:39.280 INFO:tasks.rados.rados.0.smithi033.stdout:1551: done (5 left) 2021-07-26T16:02:39.281 INFO:tasks.rados.rados.0.smithi033.stdout:1552: rollback oid 13 current snap is 149 2021-07-26T16:02:39.281 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 13 to 147 2021-07-26T16:02:39.281 INFO:tasks.rados.rados.0.smithi033.stdout:1553: read oid 38 snap -1 2021-07-26T16:02:39.281 INFO:tasks.rados.rados.0.smithi033.stdout:1553: expect (ObjNum 461 snap 146 seq_num 461) 2021-07-26T16:02:39.282 INFO:tasks.rados.rados.0.smithi033.stdout:1554: rollback oid 39 current snap is 149 2021-07-26T16:02:39.282 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 39 to 147 2021-07-26T16:02:39.282 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 149 2021-07-26T16:02:39.282 INFO:tasks.rados.rados.0.smithi033.stdout:1555: seq_num 484 ranges {8126464=507904,8634368=401408} 2021-07-26T16:02:39.327 INFO:tasks.rados.rados.0.smithi033.stdout:1555: writing smithi03339061-47 from 8126464 to 8634368 tid 1 2021-07-26T16:02:39.329 INFO:tasks.rados.rados.0.smithi033.stdout:1555: writing smithi03339061-47 from 8634368 to 9035776 tid 2 2021-07-26T16:02:39.330 INFO:tasks.rados.rados.0.smithi033.stdout:1556: setattr oid 43 current snap is 149 2021-07-26T16:02:39.330 INFO:tasks.rados.rados.0.smithi033.stdout:1552: finishing rollback tid 0 to smithi03339061-13 2021-07-26T16:02:39.330 INFO:tasks.rados.rados.0.smithi033.stdout:1552: finishing rollback tid 1 to smithi03339061-13 2021-07-26T16:02:39.330 INFO:tasks.rados.rados.0.smithi033.stdout:1552: finishing rollback tid 2 to smithi03339061-13 2021-07-26T16:02:39.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 655 (ObjNum 459 snap 144 seq_num 459) dirty exists 2021-07-26T16:02:39.331 INFO:tasks.rados.rados.0.smithi033.stdout:1554: finishing rollback tid 0 to smithi03339061-39 2021-07-26T16:02:39.331 INFO:tasks.rados.rados.0.smithi033.stdout:1554: finishing rollback tid 1 to smithi03339061-39 2021-07-26T16:02:39.331 INFO:tasks.rados.rados.0.smithi033.stdout:1554: finishing rollback tid 2 to smithi03339061-39 2021-07-26T16:02:39.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 663 (ObjNum 448 snap 139 seq_num 448) dirty exists 2021-07-26T16:02:39.332 INFO:tasks.rados.rados.0.smithi033.stdout:1553: expect (ObjNum 461 snap 146 seq_num 461) 2021-07-26T16:02:39.876 INFO:tasks.rados.rados.0.smithi033.stdout:1555: finishing write tid 1 to smithi03339061-47 2021-07-26T16:02:39.876 INFO:tasks.rados.rados.0.smithi033.stdout:1555: finishing write tid 2 to smithi03339061-47 2021-07-26T16:02:39.877 INFO:tasks.rados.rados.0.smithi033.stdout:1555: finishing write tid 3 to smithi03339061-47 2021-07-26T16:02:39.877 INFO:tasks.rados.rados.0.smithi033.stdout:1555: finishing write tid 4 to smithi03339061-47 2021-07-26T16:02:39.877 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 822 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:02:39.877 INFO:tasks.rados.rados.0.smithi033.stdout:1555: left oid 47 (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:02:39.878 INFO:tasks.rados.rados.0.smithi033.stdout:1474: finishing write tid 1 to smithi03339061-31 2021-07-26T16:02:39.878 INFO:tasks.rados.rados.0.smithi033.stdout:1474: finishing write tid 2 to smithi03339061-31 2021-07-26T16:02:39.878 INFO:tasks.rados.rados.0.smithi033.stdout:1550: finishing write tid 1 to smithi03339061-36 2021-07-26T16:02:39.878 INFO:tasks.rados.rados.0.smithi033.stdout:1502: finishing write tid 1 to smithi03339061-29 2021-07-26T16:02:39.878 INFO:tasks.rados.rados.0.smithi033.stdout:1502: finishing write tid 2 to smithi03339061-29 2021-07-26T16:02:39.879 INFO:tasks.rados.rados.0.smithi033.stdout:1550: finishing write tid 2 to smithi03339061-36 2021-07-26T16:02:39.879 INFO:tasks.rados.rados.0.smithi033.stdout:1474: finishing write tid 3 to smithi03339061-31 2021-07-26T16:02:39.879 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 84 (ObjNum 457 snap 144 seq_num 457) dirty exists 2021-07-26T16:02:39.879 INFO:tasks.rados.rados.0.smithi033.stdout:1474: left oid 31 (ObjNum 457 snap 144 seq_num 457) 2021-07-26T16:02:39.880 INFO:tasks.rados.rados.0.smithi033.stdout:1550: finishing write tid 3 to smithi03339061-36 2021-07-26T16:02:39.880 INFO:tasks.rados.rados.0.smithi033.stdout:1502: finishing write tid 3 to smithi03339061-29 2021-07-26T16:02:39.881 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 196 (ObjNum 465 snap 148 seq_num 465) dirty exists 2021-07-26T16:02:39.881 INFO:tasks.rados.rados.0.smithi033.stdout:1502: left oid 29 (ObjNum 465 snap 148 seq_num 465) 2021-07-26T16:02:39.882 INFO:tasks.rados.rados.0.smithi033.stdout:1550: finishing write tid 4 to smithi03339061-36 2021-07-26T16:02:39.882 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 432 (ObjNum 482 snap 149 seq_num 482) dirty exists 2021-07-26T16:02:39.883 INFO:tasks.rados.rados.0.smithi033.stdout:1550: left oid 36 (ObjNum 482 snap 149 seq_num 482) 2021-07-26T16:02:39.883 INFO:tasks.rados.rados.0.smithi033.stdout:1484: finishing copy_from to smithi03339061-46 2021-07-26T16:02:39.883 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 615 (ObjNum 442 snap 137 seq_num 442) dirty exists 2021-07-26T16:02:39.883 INFO:tasks.rados.rados.0.smithi033.stdout:1484: finishing copy_from racing read to smithi03339061-46 2021-07-26T16:02:39.883 INFO:tasks.rados.rados.0.smithi033.stdout:1474: done (9 left) 2021-07-26T16:02:39.884 INFO:tasks.rados.rados.0.smithi033.stdout:1484: done (8 left) 2021-07-26T16:02:39.884 INFO:tasks.rados.rados.0.smithi033.stdout:1502: done (7 left) 2021-07-26T16:02:39.884 INFO:tasks.rados.rados.0.smithi033.stdout:1510: done (6 left) 2021-07-26T16:02:39.884 INFO:tasks.rados.rados.0.smithi033.stdout:1550: done (5 left) 2021-07-26T16:02:39.885 INFO:tasks.rados.rados.0.smithi033.stdout:1552: done (4 left) 2021-07-26T16:02:39.885 INFO:tasks.rados.rados.0.smithi033.stdout:1553: done (3 left) 2021-07-26T16:02:39.885 INFO:tasks.rados.rados.0.smithi033.stdout:1554: done (2 left) 2021-07-26T16:02:39.885 INFO:tasks.rados.rados.0.smithi033.stdout:1555: done (1 left) 2021-07-26T16:02:39.885 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 149 2021-07-26T16:02:39.886 INFO:tasks.rados.rados.0.smithi033.stdout:1557: seq_num 485 ranges {2408448=532480,2940928=401408} 2021-07-26T16:02:39.893 INFO:tasks.rados.rados.0.smithi033.stdout:1557: writing smithi03339061-45 from 2408448 to 2940928 tid 1 2021-07-26T16:02:39.896 INFO:tasks.rados.rados.0.smithi033.stdout:1557: writing smithi03339061-45 from 2940928 to 3342336 tid 2 2021-07-26T16:02:39.896 INFO:tasks.rados.rados.0.smithi033.stdout:1558: read oid 38 snap -1 2021-07-26T16:02:39.896 INFO:tasks.rados.rados.0.smithi033.stdout:1558: expect (ObjNum 461 snap 146 seq_num 461) 2021-07-26T16:02:39.897 INFO:tasks.rados.rados.0.smithi033.stdout:1559: rollback oid 44 current snap is 149 2021-07-26T16:02:39.897 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 145 2021-07-26T16:02:39.897 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 783 (ObjNum 469 snap 148 seq_num 469) dirty exists 2021-07-26T16:02:39.897 INFO:tasks.rados.rados.0.smithi033.stdout:1556: done (3 left) 2021-07-26T16:02:39.897 INFO:tasks.rados.rados.0.smithi033.stdout:1560: snap_create 2021-07-26T16:02:39.906 INFO:tasks.rados.rados.0.smithi033.stdout:1559: finishing rollback tid 0 to smithi03339061-44 2021-07-26T16:02:39.906 INFO:tasks.rados.rados.0.smithi033.stdout:1559: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:02:39.907 INFO:tasks.rados.rados.0.smithi033.stdout:1559: finishing rollback tid 2 to smithi03339061-44 2021-07-26T16:02:39.907 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 658 (ObjNum 441 snap 137 seq_num 441) dirty exists 2021-07-26T16:02:39.908 INFO:tasks.rados.rados.0.smithi033.stdout:1557: finishing write tid 1 to smithi03339061-45 2021-07-26T16:02:39.908 INFO:tasks.rados.rados.0.smithi033.stdout:1557: finishing write tid 2 to smithi03339061-45 2021-07-26T16:02:39.908 INFO:tasks.rados.rados.0.smithi033.stdout:1557: finishing write tid 3 to smithi03339061-45 2021-07-26T16:02:39.909 INFO:tasks.rados.rados.0.smithi033.stdout:1557: finishing write tid 4 to smithi03339061-45 2021-07-26T16:02:39.909 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 841 (ObjNum 485 snap 149 seq_num 485) dirty exists 2021-07-26T16:02:39.909 INFO:tasks.rados.rados.0.smithi033.stdout:1557: left oid 45 (ObjNum 485 snap 149 seq_num 485) 2021-07-26T16:02:39.921 INFO:tasks.rados.rados.0.smithi033.stdout:1558: expect (ObjNum 461 snap 146 seq_num 461) 2021-07-26T16:02:40.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:40 smithi033 bash[41341]: cluster 2021-07-26T16:02:39.045726+0000 mgr.y (mgr.34104) 246 : cluster [DBG] pgmap v359: 25 pgs: 6 active+clean+wait, 19 active+clean; 219 MiB data, 704 MiB used, 715 GiB / 715 GiB avail; 18 MiB/s rd, 5.4 MiB/s wr, 17 op/s 2021-07-26T16:02:40.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:40 smithi033 bash[41341]: cluster 2021-07-26T16:02:39.128413+0000 mon.a (mon.0) 679 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2021-07-26T16:02:40.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:40 smithi033 bash[41341]: audit 2021-07-26T16:02:39.615629+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:40.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:40 smithi033 bash[42377]: cluster 2021-07-26T16:02:39.045726+0000 mgr.y (mgr.34104) 246 : cluster [DBG] pgmap v359: 25 pgs: 6 active+clean+wait, 19 active+clean; 219 MiB data, 704 MiB used, 715 GiB / 715 GiB avail; 18 MiB/s rd, 5.4 MiB/s wr, 17 op/s 2021-07-26T16:02:40.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:40 smithi033 bash[42377]: cluster 2021-07-26T16:02:39.128413+0000 mon.a (mon.0) 679 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2021-07-26T16:02:40.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:40 smithi033 bash[42377]: audit 2021-07-26T16:02:39.615629+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:40.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:40 smithi096 bash[33981]: cluster 2021-07-26T16:02:39.045726+0000 mgr.y (mgr.34104) 246 : cluster [DBG] pgmap v359: 25 pgs: 6 active+clean+wait, 19 active+clean; 219 MiB data, 704 MiB used, 715 GiB / 715 GiB avail; 18 MiB/s rd, 5.4 MiB/s wr, 17 op/s 2021-07-26T16:02:40.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:40 smithi096 bash[33981]: cluster 2021-07-26T16:02:39.128413+0000 mon.a (mon.0) 679 : cluster [DBG] osdmap e368: 8 total, 8 up, 8 in 2021-07-26T16:02:40.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:40 smithi096 bash[33981]: audit 2021-07-26T16:02:39.615629+0000 mon.a (mon.0) 680 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:40.624 INFO:tasks.rados.rados.0.smithi033.stdout:1557: done (3 left) 2021-07-26T16:02:40.624 INFO:tasks.rados.rados.0.smithi033.stdout:1558: done (2 left) 2021-07-26T16:02:40.625 INFO:tasks.rados.rados.0.smithi033.stdout:1559: done (1 left) 2021-07-26T16:02:40.625 INFO:tasks.rados.rados.0.smithi033.stdout:1560: done (0 left) 2021-07-26T16:02:40.625 INFO:tasks.rados.rados.0.smithi033.stdout:1561: snap_create 2021-07-26T16:02:41.032 INFO:tasks.rados.rados.0.smithi033.stdout:1561: done (0 left) 2021-07-26T16:02:41.032 INFO:tasks.rados.rados.0.smithi033.stdout:1562: read oid 37 snap -1 2021-07-26T16:02:41.032 INFO:tasks.rados.rados.0.smithi033.stdout:1562: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:02:41.033 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 151 2021-07-26T16:02:41.033 INFO:tasks.rados.rados.0.smithi033.stdout:1563: seq_num 486 ranges {3342336=548864,3891200=401408} 2021-07-26T16:02:41.057 INFO:tasks.rados.rados.0.smithi033.stdout:1563: writing smithi03339061-45 from 3342336 to 3891200 tid 1 2021-07-26T16:02:41.059 INFO:tasks.rados.rados.0.smithi033.stdout:1563: writing smithi03339061-45 from 3891200 to 4292608 tid 2 2021-07-26T16:02:41.059 INFO:tasks.rados.rados.0.smithi033.stdout:1564: copy_from oid 16 from oid 27 current snap is 151 2021-07-26T16:02:41.060 INFO:tasks.rados.rados.0.smithi033.stdout:1562: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:02:41.244 INFO:tasks.rados.rados.0.smithi033.stdout:1563: finishing write tid 1 to smithi03339061-45 2021-07-26T16:02:41.244 INFO:tasks.rados.rados.0.smithi033.stdout:1563: finishing write tid 2 to smithi03339061-45 2021-07-26T16:02:41.244 INFO:tasks.rados.rados.0.smithi033.stdout:1563: finishing write tid 3 to smithi03339061-45 2021-07-26T16:02:41.245 INFO:tasks.rados.rados.0.smithi033.stdout:1563: finishing write tid 4 to smithi03339061-45 2021-07-26T16:02:41.245 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 845 (ObjNum 486 snap 151 seq_num 486) dirty exists 2021-07-26T16:02:41.245 INFO:tasks.rados.rados.0.smithi033.stdout:1563: left oid 45 (ObjNum 486 snap 151 seq_num 486) 2021-07-26T16:02:41.245 INFO:tasks.rados.rados.0.smithi033.stdout:1562: done (2 left) 2021-07-26T16:02:41.246 INFO:tasks.rados.rados.0.smithi033.stdout:1563: done (1 left) 2021-07-26T16:02:41.246 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 151 2021-07-26T16:02:41.246 INFO:tasks.rados.rados.0.smithi033.stdout:1564: finishing copy_from to smithi03339061-16 2021-07-26T16:02:41.246 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 615 (ObjNum 442 snap 137 seq_num 442) dirty exists 2021-07-26T16:02:41.247 INFO:tasks.rados.rados.0.smithi033.stdout:1565: seq_num 487 ranges {7159808=565248,7725056=401408} 2021-07-26T16:02:41.295 INFO:tasks.rados.rados.0.smithi033.stdout:1565: writing smithi03339061-50 from 7159808 to 7725056 tid 1 2021-07-26T16:02:41.298 INFO:tasks.rados.rados.0.smithi033.stdout:1565: writing smithi03339061-50 from 7725056 to 8126464 tid 2 2021-07-26T16:02:41.298 INFO:tasks.rados.rados.0.smithi033.stdout:1566: snap_remove snap 149 2021-07-26T16:02:41.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: cluster 2021-07-26T16:02:40.620352+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2021-07-26T16:02:41.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.778865+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:41.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.788849+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:41.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.797949+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:41.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.800391+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.802567+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.804459+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.807619+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.810646+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.812559+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.814299+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.816218+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.962 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.817953+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.819691+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: audit 2021-07-26T16:02:40.821600+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.963 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[41341]: cluster 2021-07-26T16:02:41.026114+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2021-07-26T16:02:41.963 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: cluster 2021-07-26T16:02:40.620352+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2021-07-26T16:02:41.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.778865+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:41.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.788849+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:41.964 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.797949+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:41.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.800391+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.965 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.802567+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.804459+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.807619+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.810646+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.966 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.812559+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.814299+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.816218+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.817953+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.967 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.819691+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: audit 2021-07-26T16:02:40.821600+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.968 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:41 smithi033 bash[42377]: cluster 2021-07-26T16:02:41.026114+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2021-07-26T16:02:41.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: cluster 2021-07-26T16:02:40.620352+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e369: 8 total, 8 up, 8 in 2021-07-26T16:02:41.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.778865+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:41.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.788849+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:41.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.797949+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:41.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.800391+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.802567+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.804459+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.807619+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.987 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.810646+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.812559+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.814299+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.816218+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.817953+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.819691+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: audit 2021-07-26T16:02:40.821600+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:41.989 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:41 smithi096 bash[33981]: cluster 2021-07-26T16:02:41.026114+0000 mon.a (mon.0) 684 : cluster [DBG] osdmap e370: 8 total, 8 up, 8 in 2021-07-26T16:02:42.052 INFO:tasks.rados.rados.0.smithi033.stdout:1566: done (2 left) 2021-07-26T16:02:42.052 INFO:tasks.rados.rados.0.smithi033.stdout:1567: copy_from oid 43 from oid 10 current snap is 151 2021-07-26T16:02:42.052 INFO:tasks.rados.rados.0.smithi033.stdout:1564: finishing copy_from racing read to smithi03339061-16 2021-07-26T16:02:42.053 INFO:tasks.rados.rados.0.smithi033.stdout:1565: finishing write tid 1 to smithi03339061-50 2021-07-26T16:02:42.053 INFO:tasks.rados.rados.0.smithi033.stdout:1565: finishing write tid 2 to smithi03339061-50 2021-07-26T16:02:42.053 INFO:tasks.rados.rados.0.smithi033.stdout:1565: finishing write tid 3 to smithi03339061-50 2021-07-26T16:02:42.053 INFO:tasks.rados.rados.0.smithi033.stdout:1565: finishing write tid 4 to smithi03339061-50 2021-07-26T16:02:42.054 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 659 (ObjNum 487 snap 151 seq_num 487) dirty exists 2021-07-26T16:02:42.054 INFO:tasks.rados.rados.0.smithi033.stdout:1565: left oid 50 (ObjNum 487 snap 151 seq_num 487) 2021-07-26T16:02:42.054 INFO:tasks.rados.rados.0.smithi033.stdout:1564: done (2 left) 2021-07-26T16:02:42.054 INFO:tasks.rados.rados.0.smithi033.stdout:1565: done (1 left) 2021-07-26T16:02:42.055 INFO:tasks.rados.rados.0.smithi033.stdout:1568: snap_create 2021-07-26T16:02:42.061 INFO:tasks.rados.rados.0.smithi033.stdout:1567: finishing copy_from to smithi03339061-43 2021-07-26T16:02:42.062 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 779 (ObjNum 469 snap 148 seq_num 469) dirty exists 2021-07-26T16:02:42.062 INFO:tasks.rados.rados.0.smithi033.stdout:1567: finishing copy_from racing read to smithi03339061-43 2021-07-26T16:02:42.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:42 smithi033 bash[41341]: cluster 2021-07-26T16:02:41.046267+0000 mgr.y (mgr.34104) 247 : cluster [DBG] pgmap v363: 25 pgs: 25 active+clean; 217 MiB data, 692 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 8.0 MiB/s wr, 19 op/s 2021-07-26T16:02:42.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:42 smithi033 bash[41341]: cluster 2021-07-26T16:02:42.047993+0000 mon.a (mon.0) 685 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2021-07-26T16:02:42.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:42 smithi033 bash[42377]: cluster 2021-07-26T16:02:41.046267+0000 mgr.y (mgr.34104) 247 : cluster [DBG] pgmap v363: 25 pgs: 25 active+clean; 217 MiB data, 692 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 8.0 MiB/s wr, 19 op/s 2021-07-26T16:02:42.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:42 smithi033 bash[42377]: cluster 2021-07-26T16:02:42.047993+0000 mon.a (mon.0) 685 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2021-07-26T16:02:42.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:42 smithi096 bash[33981]: cluster 2021-07-26T16:02:41.046267+0000 mgr.y (mgr.34104) 247 : cluster [DBG] pgmap v363: 25 pgs: 25 active+clean; 217 MiB data, 692 MiB used, 715 GiB / 715 GiB avail; 13 MiB/s rd, 8.0 MiB/s wr, 19 op/s 2021-07-26T16:02:42.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:42 smithi096 bash[33981]: cluster 2021-07-26T16:02:42.047993+0000 mon.a (mon.0) 685 : cluster [DBG] osdmap e371: 8 total, 8 up, 8 in 2021-07-26T16:02:43.058 INFO:tasks.rados.rados.0.smithi033.stdout:1567: done (1 left) 2021-07-26T16:02:43.059 INFO:tasks.rados.rados.0.smithi033.stdout:1568: done (0 left) 2021-07-26T16:02:43.059 INFO:tasks.rados.rados.0.smithi033.stdout:1569: read oid 44 snap -1 2021-07-26T16:02:43.059 INFO:tasks.rados.rados.0.smithi033.stdout:1569: expect (ObjNum 441 snap 137 seq_num 441) 2021-07-26T16:02:43.059 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 152 2021-07-26T16:02:43.059 INFO:tasks.rados.rados.0.smithi033.stdout:1570: seq_num 488 ranges {2056192=581632,2637824=401408} 2021-07-26T16:02:43.077 INFO:tasks.rados.rados.0.smithi033.stdout:1570: writing smithi03339061-5 from 2056192 to 2637824 tid 1 2021-07-26T16:02:43.079 INFO:tasks.rados.rados.0.smithi033.stdout:1570: writing smithi03339061-5 from 2637824 to 3039232 tid 2 2021-07-26T16:02:43.079 INFO:tasks.rados.rados.0.smithi033.stdout:1571: rmattr oid 32 current snap is 152 2021-07-26T16:02:43.079 INFO:tasks.rados.rados.0.smithi033.stdout:1569: expect (ObjNum 441 snap 137 seq_num 441) 2021-07-26T16:02:43.194 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 660 (ObjNum 481 snap 149 seq_num 481) dirty exists 2021-07-26T16:02:43.195 INFO:tasks.rados.rados.0.smithi033.stdout:1570: finishing write tid 1 to smithi03339061-5 2021-07-26T16:02:43.195 INFO:tasks.rados.rados.0.smithi033.stdout:1570: finishing write tid 2 to smithi03339061-5 2021-07-26T16:02:43.195 INFO:tasks.rados.rados.0.smithi033.stdout:1570: finishing write tid 3 to smithi03339061-5 2021-07-26T16:02:43.195 INFO:tasks.rados.rados.0.smithi033.stdout:1570: finishing write tid 4 to smithi03339061-5 2021-07-26T16:02:43.196 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 786 (ObjNum 488 snap 152 seq_num 488) dirty exists 2021-07-26T16:02:43.196 INFO:tasks.rados.rados.0.smithi033.stdout:1570: left oid 5 (ObjNum 488 snap 152 seq_num 488) 2021-07-26T16:02:43.196 INFO:tasks.rados.rados.0.smithi033.stdout:1569: done (2 left) 2021-07-26T16:02:43.196 INFO:tasks.rados.rados.0.smithi033.stdout:1570: done (1 left) 2021-07-26T16:02:43.197 INFO:tasks.rados.rados.0.smithi033.stdout:1571: done (0 left) 2021-07-26T16:02:43.197 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 152 2021-07-26T16:02:43.197 INFO:tasks.rados.rados.0.smithi033.stdout:1572: seq_num 489 ranges {2097152=598016,2695168=401408} 2021-07-26T16:02:43.219 INFO:tasks.rados.rados.0.smithi033.stdout:1572: writing smithi03339061-28 from 2097152 to 2695168 tid 1 2021-07-26T16:02:43.223 INFO:tasks.rados.rados.0.smithi033.stdout:1572: writing smithi03339061-28 from 2695168 to 3096576 tid 2 2021-07-26T16:02:43.224 INFO:tasks.rados.rados.0.smithi033.stdout:1573: read oid 29 snap -1 2021-07-26T16:02:43.224 INFO:tasks.rados.rados.0.smithi033.stdout:1573: expect (ObjNum 465 snap 148 seq_num 465) 2021-07-26T16:02:43.225 INFO:tasks.rados.rados.0.smithi033.stdout:1574: read oid 37 snap -1 2021-07-26T16:02:43.225 INFO:tasks.rados.rados.0.smithi033.stdout:1574: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:02:43.226 INFO:tasks.rados.rados.0.smithi033.stdout:1575: rollback oid 47 current snap is 152 2021-07-26T16:02:43.226 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 47 to 150 2021-07-26T16:02:43.227 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 152 2021-07-26T16:02:43.227 INFO:tasks.rados.rados.0.smithi033.stdout:1576: seq_num 490 ranges {9338880=614400,9953280=401408} 2021-07-26T16:02:43.279 INFO:tasks.rados.rados.0.smithi033.stdout:1576: writing smithi03339061-48 from 9338880 to 9953280 tid 1 2021-07-26T16:02:43.282 INFO:tasks.rados.rados.0.smithi033.stdout:1576: writing smithi03339061-48 from 9953280 to 10354688 tid 2 2021-07-26T16:02:43.282 INFO:tasks.rados.rados.0.smithi033.stdout:1577: copy_from oid 11 from oid 24 current snap is 152 2021-07-26T16:02:43.283 INFO:tasks.rados.rados.0.smithi033.stdout:1572: finishing write tid 1 to smithi03339061-28 2021-07-26T16:02:43.283 INFO:tasks.rados.rados.0.smithi033.stdout:1572: finishing write tid 2 to smithi03339061-28 2021-07-26T16:02:43.283 INFO:tasks.rados.rados.0.smithi033.stdout:1572: finishing write tid 3 to smithi03339061-28 2021-07-26T16:02:43.283 INFO:tasks.rados.rados.0.smithi033.stdout:1578: read oid 1 snap -1 2021-07-26T16:02:43.283 INFO:tasks.rados.rados.0.smithi033.stdout:1578: expect (ObjNum 480 snap 149 seq_num 480) 2021-07-26T16:02:43.284 INFO:tasks.rados.rados.0.smithi033.stdout:1579: read oid 22 snap -1 2021-07-26T16:02:43.284 INFO:tasks.rados.rados.0.smithi033.stdout:1579: expect (ObjNum 432 snap 135 seq_num 432) 2021-07-26T16:02:43.284 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 152 2021-07-26T16:02:43.284 INFO:tasks.rados.rados.0.smithi033.stdout:1572: finishing write tid 4 to smithi03339061-28 2021-07-26T16:02:43.285 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 383 (ObjNum 489 snap 152 seq_num 489) dirty exists 2021-07-26T16:02:43.285 INFO:tasks.rados.rados.0.smithi033.stdout:1572: left oid 28 (ObjNum 489 snap 152 seq_num 489) 2021-07-26T16:02:43.285 INFO:tasks.rados.rados.0.smithi033.stdout:1574: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:02:43.482 INFO:tasks.rados.rados.0.smithi033.stdout:1575: finishing rollback tid 0 to smithi03339061-47 2021-07-26T16:02:43.482 INFO:tasks.rados.rados.0.smithi033.stdout:1575: finishing rollback tid 1 to smithi03339061-47 2021-07-26T16:02:43.483 INFO:tasks.rados.rados.0.smithi033.stdout:1575: finishing rollback tid 2 to smithi03339061-47 2021-07-26T16:02:43.483 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 825 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:02:43.483 INFO:tasks.rados.rados.0.smithi033.stdout:1573: expect (ObjNum 465 snap 148 seq_num 465) 2021-07-26T16:02:43.754 INFO:tasks.rados.rados.0.smithi033.stdout:1579: expect (ObjNum 432 snap 135 seq_num 432) 2021-07-26T16:02:43.839 INFO:tasks.rados.rados.0.smithi033.stdout:1576: finishing write tid 1 to smithi03339061-48 2021-07-26T16:02:43.840 INFO:tasks.rados.rados.0.smithi033.stdout:1576: finishing write tid 2 to smithi03339061-48 2021-07-26T16:02:43.840 INFO:tasks.rados.rados.0.smithi033.stdout:1576: finishing write tid 3 to smithi03339061-48 2021-07-26T16:02:43.840 INFO:tasks.rados.rados.0.smithi033.stdout:1576: finishing write tid 4 to smithi03339061-48 2021-07-26T16:02:43.840 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 789 (ObjNum 490 snap 152 seq_num 490) dirty exists 2021-07-26T16:02:43.841 INFO:tasks.rados.rados.0.smithi033.stdout:1576: left oid 48 (ObjNum 490 snap 152 seq_num 490) 2021-07-26T16:02:43.841 INFO:tasks.rados.rados.0.smithi033.stdout:1578: expect (ObjNum 480 snap 149 seq_num 480) 2021-07-26T16:02:43.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:43 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:43.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:43.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:43 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:43.521Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:43.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:43 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:43.521Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:02:44.022 INFO:tasks.rados.rados.0.smithi033.stdout:1577: finishing copy_from to smithi03339061-11 2021-07-26T16:02:44.022 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 692 (ObjNum 462 snap 146 seq_num 462) dirty exists 2021-07-26T16:02:44.023 INFO:tasks.rados.rados.0.smithi033.stdout:1577: finishing copy_from racing read to smithi03339061-11 2021-07-26T16:02:44.023 INFO:tasks.rados.rados.0.smithi033.stdout:1580: seq_num 491 ranges {8126464=630784,8757248=401408} 2021-07-26T16:02:44.081 INFO:tasks.rados.rados.0.smithi033.stdout:1580: writing smithi03339061-50 from 8126464 to 8757248 tid 1 2021-07-26T16:02:44.086 INFO:tasks.rados.rados.0.smithi033.stdout:1580: writing smithi03339061-50 from 8757248 to 9158656 tid 2 2021-07-26T16:02:44.086 INFO:tasks.rados.rados.0.smithi033.stdout:1572: done (8 left) 2021-07-26T16:02:44.087 INFO:tasks.rados.rados.0.smithi033.stdout:1573: done (7 left) 2021-07-26T16:02:44.087 INFO:tasks.rados.rados.0.smithi033.stdout:1574: done (6 left) 2021-07-26T16:02:44.087 INFO:tasks.rados.rados.0.smithi033.stdout:1575: done (5 left) 2021-07-26T16:02:44.087 INFO:tasks.rados.rados.0.smithi033.stdout:1576: done (4 left) 2021-07-26T16:02:44.087 INFO:tasks.rados.rados.0.smithi033.stdout:1577: done (3 left) 2021-07-26T16:02:44.088 INFO:tasks.rados.rados.0.smithi033.stdout:1578: done (2 left) 2021-07-26T16:02:44.088 INFO:tasks.rados.rados.0.smithi033.stdout:1579: done (1 left) 2021-07-26T16:02:44.088 INFO:tasks.rados.rados.0.smithi033.stdout:1581: rollback oid 46 current snap is 152 2021-07-26T16:02:44.088 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 46 to 145 2021-07-26T16:02:44.088 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 152 2021-07-26T16:02:44.089 INFO:tasks.rados.rados.0.smithi033.stdout:1582: seq_num 492 ranges {901120=647168,1548288=401408} 2021-07-26T16:02:44.093 INFO:tasks.rados.rados.0.smithi033.stdout:1582: writing smithi03339061-36 from 901120 to 1548288 tid 1 2021-07-26T16:02:44.095 INFO:tasks.rados.rados.0.smithi033.stdout:1582: writing smithi03339061-36 from 1548288 to 1949696 tid 2 2021-07-26T16:02:44.096 INFO:tasks.rados.rados.0.smithi033.stdout:1583: snap_create 2021-07-26T16:02:44.096 INFO:tasks.rados.rados.0.smithi033.stdout:1580: finishing write tid 1 to smithi03339061-50 2021-07-26T16:02:44.096 INFO:tasks.rados.rados.0.smithi033.stdout:1580: finishing write tid 2 to smithi03339061-50 2021-07-26T16:02:44.096 INFO:tasks.rados.rados.0.smithi033.stdout:1580: finishing write tid 3 to smithi03339061-50 2021-07-26T16:02:44.097 INFO:tasks.rados.rados.0.smithi033.stdout:1581: finishing rollback tid 0 to smithi03339061-46 2021-07-26T16:02:44.097 INFO:tasks.rados.rados.0.smithi033.stdout:1580: finishing write tid 4 to smithi03339061-50 2021-07-26T16:02:44.097 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 663 (ObjNum 491 snap 152 seq_num 491) dirty exists 2021-07-26T16:02:44.097 INFO:tasks.rados.rados.0.smithi033.stdout:1580: left oid 50 (ObjNum 491 snap 152 seq_num 491) 2021-07-26T16:02:44.097 INFO:tasks.rados.rados.0.smithi033.stdout:1581: finishing rollback tid 1 to smithi03339061-46 2021-07-26T16:02:44.098 INFO:tasks.rados.rados.0.smithi033.stdout:1581: finishing rollback tid 2 to smithi03339061-46 2021-07-26T16:02:44.098 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 618 (ObjNum 442 snap 137 seq_num 442) dirty exists 2021-07-26T16:02:44.101 INFO:tasks.rados.rados.0.smithi033.stdout:1582: finishing write tid 1 to smithi03339061-36 2021-07-26T16:02:44.101 INFO:tasks.rados.rados.0.smithi033.stdout:1582: finishing write tid 2 to smithi03339061-36 2021-07-26T16:02:44.101 INFO:tasks.rados.rados.0.smithi033.stdout:1582: finishing write tid 3 to smithi03339061-36 2021-07-26T16:02:44.103 INFO:tasks.rados.rados.0.smithi033.stdout:1582: finishing write tid 4 to smithi03339061-36 2021-07-26T16:02:44.103 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 695 (ObjNum 492 snap 152 seq_num 492) dirty exists 2021-07-26T16:02:44.103 INFO:tasks.rados.rados.0.smithi033.stdout:1582: left oid 36 (ObjNum 492 snap 152 seq_num 492) 2021-07-26T16:02:44.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:44 smithi033 bash[41341]: cluster 2021-07-26T16:02:43.047091+0000 mgr.y (mgr.34104) 248 : cluster [DBG] pgmap v365: 25 pgs: 25 active+clean; 234 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 20 MiB/s rd, 10 MiB/s wr, 27 op/s 2021-07-26T16:02:44.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:44 smithi033 bash[41341]: cluster 2021-07-26T16:02:43.052063+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2021-07-26T16:02:44.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:44 smithi033 bash[41341]: cephadm 2021-07-26T16:02:43.214249+0000 mgr.y (mgr.34104) 249 : cephadm [INF] Upgrade: Updating prometheus.a 2021-07-26T16:02:44.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:44 smithi033 bash[41341]: cephadm 2021-07-26T16:02:43.236894+0000 mgr.y (mgr.34104) 250 : cephadm [INF] Deploying daemon prometheus.a on smithi096 2021-07-26T16:02:44.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:44 smithi033 bash[42377]: cluster 2021-07-26T16:02:43.047091+0000 mgr.y (mgr.34104) 248 : cluster [DBG] pgmap v365: 25 pgs: 25 active+clean; 234 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 20 MiB/s rd, 10 MiB/s wr, 27 op/s 2021-07-26T16:02:44.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:44 smithi033 bash[42377]: cluster 2021-07-26T16:02:43.052063+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2021-07-26T16:02:44.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:44 smithi033 bash[42377]: cephadm 2021-07-26T16:02:43.214249+0000 mgr.y (mgr.34104) 249 : cephadm [INF] Upgrade: Updating prometheus.a 2021-07-26T16:02:44.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:44 smithi033 bash[42377]: cephadm 2021-07-26T16:02:43.236894+0000 mgr.y (mgr.34104) 250 : cephadm [INF] Deploying daemon prometheus.a on smithi096 2021-07-26T16:02:44.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:44 smithi096 bash[33981]: cluster 2021-07-26T16:02:43.047091+0000 mgr.y (mgr.34104) 248 : cluster [DBG] pgmap v365: 25 pgs: 25 active+clean; 234 MiB data, 720 MiB used, 715 GiB / 715 GiB avail; 20 MiB/s rd, 10 MiB/s wr, 27 op/s 2021-07-26T16:02:44.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:44 smithi096 bash[33981]: cluster 2021-07-26T16:02:43.052063+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e372: 8 total, 8 up, 8 in 2021-07-26T16:02:44.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:44 smithi096 bash[33981]: cephadm 2021-07-26T16:02:43.214249+0000 mgr.y (mgr.34104) 249 : cephadm [INF] Upgrade: Updating prometheus.a 2021-07-26T16:02:44.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:44 smithi096 bash[33981]: cephadm 2021-07-26T16:02:43.236894+0000 mgr.y (mgr.34104) 250 : cephadm [INF] Deploying daemon prometheus.a on smithi096 2021-07-26T16:02:45.072 INFO:tasks.rados.rados.0.smithi033.stdout:1580: done (3 left) 2021-07-26T16:02:45.073 INFO:tasks.rados.rados.0.smithi033.stdout:1581: done (2 left) 2021-07-26T16:02:45.073 INFO:tasks.rados.rados.0.smithi033.stdout:1582: done (1 left) 2021-07-26T16:02:45.073 INFO:tasks.rados.rados.0.smithi033.stdout:1583: done (0 left) 2021-07-26T16:02:45.073 INFO:tasks.rados.rados.0.smithi033.stdout:1584: read oid 12 snap -1 2021-07-26T16:02:45.074 INFO:tasks.rados.rados.0.smithi033.stdout:1584: expect (ObjNum 472 snap 148 seq_num 472) 2021-07-26T16:02:45.074 INFO:tasks.rados.rados.0.smithi033.stdout:1585: rollback oid 6 current snap is 153 2021-07-26T16:02:45.074 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 150 2021-07-26T16:02:45.075 INFO:tasks.rados.rados.0.smithi033.stdout:1586: delete oid 36 current snap is 153 2021-07-26T16:02:45.079 INFO:tasks.rados.rados.0.smithi033.stdout:1585: finishing rollback tid 0 to smithi03339061-6 2021-07-26T16:02:45.080 INFO:tasks.rados.rados.0.smithi033.stdout:1585: finishing rollback tid 1 to smithi03339061-6 2021-07-26T16:02:45.081 INFO:tasks.rados.rados.0.smithi033.stdout:1585: finishing rollback tid 2 to smithi03339061-6 2021-07-26T16:02:45.081 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 851 (ObjNum 405 snap 128 seq_num 405) dirty exists 2021-07-26T16:02:45.081 INFO:tasks.rados.rados.0.smithi033.stdout:1585: done (2 left) 2021-07-26T16:02:45.081 INFO:tasks.rados.rados.0.smithi033.stdout:1586: done (1 left) 2021-07-26T16:02:45.081 INFO:tasks.rados.rados.0.smithi033.stdout:1587: snap_remove snap 147 2021-07-26T16:02:46.035 INFO:tasks.rados.rados.0.smithi033.stdout:1587: done (1 left) 2021-07-26T16:02:46.036 INFO:tasks.rados.rados.0.smithi033.stdout:1588: read oid 44 snap 151 2021-07-26T16:02:46.036 INFO:tasks.rados.rados.0.smithi033.stdout:1588: expect (ObjNum 441 snap 137 seq_num 441) 2021-07-26T16:02:46.036 INFO:tasks.rados.rados.0.smithi033.stdout:1589: setattr oid 24 current snap is 153 2021-07-26T16:02:46.036 INFO:tasks.rados.rados.0.smithi033.stdout:1590: read oid 49 snap -1 2021-07-26T16:02:46.037 INFO:tasks.rados.rados.0.smithi033.stdout:1590: expect (ObjNum 456 snap 142 seq_num 456) 2021-07-26T16:02:46.037 INFO:tasks.rados.rados.0.smithi033.stdout:1591: rollback oid 27 current snap is 153 2021-07-26T16:02:46.037 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 27 to 145 2021-07-26T16:02:46.037 INFO:tasks.rados.rados.0.smithi033.stdout:1584: expect (ObjNum 472 snap 148 seq_num 472) 2021-07-26T16:02:46.416 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:46 smithi096 bash[33981]: cluster 2021-07-26T16:02:45.047905+0000 mgr.y (mgr.34104) 251 : cluster [DBG] pgmap v367: 25 pgs: 25 active+clean; 243 MiB data, 730 MiB used, 715 GiB / 715 GiB avail; 15 MiB/s rd, 5.3 MiB/s wr, 27 op/s 2021-07-26T16:02:46.417 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:46 smithi096 bash[33981]: cluster 2021-07-26T16:02:45.067023+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2021-07-26T16:02:46.417 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:46 smithi096 bash[33981]: cluster 2021-07-26T16:02:46.025527+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2021-07-26T16:02:46.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:46 smithi033 bash[41341]: cluster 2021-07-26T16:02:45.047905+0000 mgr.y (mgr.34104) 251 : cluster [DBG] pgmap v367: 25 pgs: 25 active+clean; 243 MiB data, 730 MiB used, 715 GiB / 715 GiB avail; 15 MiB/s rd, 5.3 MiB/s wr, 27 op/s 2021-07-26T16:02:46.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:46 smithi033 bash[41341]: cluster 2021-07-26T16:02:45.067023+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2021-07-26T16:02:46.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:46 smithi033 bash[41341]: cluster 2021-07-26T16:02:46.025527+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2021-07-26T16:02:46.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:46 smithi033 bash[42377]: cluster 2021-07-26T16:02:45.047905+0000 mgr.y (mgr.34104) 251 : cluster [DBG] pgmap v367: 25 pgs: 25 active+clean; 243 MiB data, 730 MiB used, 715 GiB / 715 GiB avail; 15 MiB/s rd, 5.3 MiB/s wr, 27 op/s 2021-07-26T16:02:46.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:46 smithi033 bash[42377]: cluster 2021-07-26T16:02:45.067023+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e373: 8 total, 8 up, 8 in 2021-07-26T16:02:46.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:46 smithi033 bash[42377]: cluster 2021-07-26T16:02:46.025527+0000 mon.a (mon.0) 688 : cluster [DBG] osdmap e374: 8 total, 8 up, 8 in 2021-07-26T16:02:46.602 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 826 (ObjNum 462 snap 146 seq_num 462) dirty exists 2021-07-26T16:02:46.602 INFO:tasks.rados.rados.0.smithi033.stdout:1591: finishing rollback tid 0 to smithi03339061-27 2021-07-26T16:02:46.603 INFO:tasks.rados.rados.0.smithi033.stdout:1591: finishing rollback tid 1 to smithi03339061-27 2021-07-26T16:02:46.603 INFO:tasks.rados.rados.0.smithi033.stdout:1591: finishing rollback tid 2 to smithi03339061-27 2021-07-26T16:02:46.603 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 667 (ObjNum 442 snap 137 seq_num 442) dirty exists 2021-07-26T16:02:46.603 INFO:tasks.rados.rados.0.smithi033.stdout:1588: expect (ObjNum 441 snap 137 seq_num 441) 2021-07-26T16:02:46.706 INFO:tasks.rados.rados.0.smithi033.stdout:1590: expect (ObjNum 456 snap 142 seq_num 456) 2021-07-26T16:02:47.093 INFO:tasks.rados.rados.0.smithi033.stdout:1584: done (4 left) 2021-07-26T16:02:47.093 INFO:tasks.rados.rados.0.smithi033.stdout:1588: done (3 left) 2021-07-26T16:02:47.094 INFO:tasks.rados.rados.0.smithi033.stdout:1589: done (2 left) 2021-07-26T16:02:47.094 INFO:tasks.rados.rados.0.smithi033.stdout:1590: done (1 left) 2021-07-26T16:02:47.094 INFO:tasks.rados.rados.0.smithi033.stdout:1591: done (0 left) 2021-07-26T16:02:47.094 INFO:tasks.rados.rados.0.smithi033.stdout:1592: delete oid 50 current snap is 153 2021-07-26T16:02:47.097 INFO:tasks.rados.rados.0.smithi033.stdout:1592: done (0 left) 2021-07-26T16:02:47.097 INFO:tasks.rados.rados.0.smithi033.stdout:1593: snap_create 2021-07-26T16:02:47.485 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 systemd[1]: Stopping Ceph prometheus.a for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T16:02:47.985 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 docker[41651]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:02:47.986 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=warn ts=2021-07-26T16:02:47.579Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-07-26T16:02:47.986 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=info ts=2021-07-26T16:02:47.579Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2021-07-26T16:02:47.986 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=info ts=2021-07-26T16:02:47.579Z caller=main.go:561 msg="Stopping notify discovery manager..." 2021-07-26T16:02:47.986 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=info ts=2021-07-26T16:02:47.579Z caller=main.go:543 msg="Scrape discovery manager stopped" 2021-07-26T16:02:47.987 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=info ts=2021-07-26T16:02:47.579Z caller=main.go:583 msg="Stopping scrape manager..." 2021-07-26T16:02:47.987 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=info ts=2021-07-26T16:02:47.579Z caller=main.go:557 msg="Notify discovery manager stopped" 2021-07-26T16:02:47.987 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=info ts=2021-07-26T16:02:47.579Z caller=main.go:577 msg="Scrape manager stopped" 2021-07-26T16:02:47.987 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=info ts=2021-07-26T16:02:47.579Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2021-07-26T16:02:47.987 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=info ts=2021-07-26T16:02:47.580Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2021-07-26T16:02:47.988 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=info ts=2021-07-26T16:02:47.580Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-07-26T16:02:47.988 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=info ts=2021-07-26T16:02:47.580Z caller=main.go:749 msg="Notifier manager stopped" 2021-07-26T16:02:47.988 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:47 smithi096 bash[29300]: level=info ts=2021-07-26T16:02:47.580Z caller=main.go:761 msg="See you next time!" 2021-07-26T16:02:48.081 INFO:tasks.rados.rados.0.smithi033.stdout:1593: done (0 left) 2021-07-26T16:02:48.081 INFO:tasks.rados.rados.0.smithi033.stdout:1594: copy_from oid 2 from oid 47 current snap is 154 2021-07-26T16:02:48.082 INFO:tasks.rados.rados.0.smithi033.stdout:1595: snap_remove snap 145 2021-07-26T16:02:48.421 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:48 smithi096 bash[33981]: cluster 2021-07-26T16:02:47.048536+0000 mgr.y (mgr.34104) 252 : cluster [DBG] pgmap v370: 25 pgs: 25 active+clean; 244 MiB data, 745 MiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 21 op/s 2021-07-26T16:02:48.422 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:48 smithi096 docker[41651]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-prometheus.a 2021-07-26T16:02:48.422 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:48 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@prometheus.a.service: Succeeded. 2021-07-26T16:02:48.423 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:48 smithi096 systemd[1]: Stopped Ceph prometheus.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:02:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:48 smithi033 bash[41341]: cluster 2021-07-26T16:02:47.048536+0000 mgr.y (mgr.34104) 252 : cluster [DBG] pgmap v370: 25 pgs: 25 active+clean; 244 MiB data, 745 MiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 21 op/s 2021-07-26T16:02:48.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:48 smithi033 bash[42377]: cluster 2021-07-26T16:02:47.048536+0000 mgr.y (mgr.34104) 252 : cluster [DBG] pgmap v370: 25 pgs: 25 active+clean; 244 MiB data, 745 MiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 2.7 MiB/s wr, 21 op/s 2021-07-26T16:02:48.735 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:48 smithi096 systemd[1]: Started Ceph prometheus.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:02:48.735 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:48 smithi096 bash[41725]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:02:49.096 INFO:tasks.rados.rados.0.smithi033.stdout:1595: done (1 left) 2021-07-26T16:02:49.097 INFO:tasks.rados.rados.0.smithi033.stdout:1596: rollback oid 25 current snap is 154 2021-07-26T16:02:49.097 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 25 to 151 2021-07-26T16:02:49.097 INFO:tasks.rados.rados.0.smithi033.stdout:1597: rmattr oid 5 current snap is 154 2021-07-26T16:02:49.098 INFO:tasks.rados.rados.0.smithi033.stdout:1597: done (2 left) 2021-07-26T16:02:49.098 INFO:tasks.rados.rados.0.smithi033.stdout:1598: read oid 48 snap 151 2021-07-26T16:02:49.098 INFO:tasks.rados.rados.0.smithi033.stdout:1598: expect (ObjNum 399 snap 123 seq_num 399) 2021-07-26T16:02:49.098 INFO:tasks.rados.rados.0.smithi033.stdout:1599: delete oid 43 current snap is 154 2021-07-26T16:02:49.098 INFO:tasks.rados.rados.0.smithi033.stdout:1594: finishing copy_from to smithi03339061-2 2021-07-26T16:02:49.099 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 825 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:02:49.099 INFO:tasks.rados.rados.0.smithi033.stdout:1594: finishing copy_from racing read to smithi03339061-2 2021-07-26T16:02:49.108 INFO:tasks.rados.rados.0.smithi033.stdout:1596: finishing rollback tid 0 to smithi03339061-25 2021-07-26T16:02:49.108 INFO:tasks.rados.rados.0.smithi033.stdout:1596: finishing rollback tid 1 to smithi03339061-25 2021-07-26T16:02:49.111 INFO:tasks.rados.rados.0.smithi033.stdout:1596: finishing rollback tid 2 to smithi03339061-25 2021-07-26T16:02:49.112 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 667 (ObjNum 411 snap 130 seq_num 411) dirty exists 2021-07-26T16:02:49.153 INFO:tasks.rados.rados.0.smithi033.stdout:1598: expect (ObjNum 399 snap 123 seq_num 399) 2021-07-26T16:02:49.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:49 smithi033 bash[41341]: cluster 2021-07-26T16:02:48.075369+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2021-07-26T16:02:49.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:49 smithi033 bash[41341]: audit 2021-07-26T16:02:48.582649+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:49.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:49 smithi033 bash[41341]: audit 2021-07-26T16:02:48.586796+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:49.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:49 smithi033 bash[41341]: audit 2021-07-26T16:02:48.589271+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:49.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:49 smithi033 bash[41341]: audit 2021-07-26T16:02:48.590857+0000 mon.c (mon.1) 165 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:49.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:49 smithi033 bash[42377]: cluster 2021-07-26T16:02:48.075369+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2021-07-26T16:02:49.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:49 smithi033 bash[42377]: audit 2021-07-26T16:02:48.582649+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:49.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:49 smithi033 bash[42377]: audit 2021-07-26T16:02:48.586796+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:49.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:49 smithi033 bash[42377]: audit 2021-07-26T16:02:48.589271+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:49.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:49 smithi033 bash[42377]: audit 2021-07-26T16:02:48.590857+0000 mon.c (mon.1) 165 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:49.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[33981]: cluster 2021-07-26T16:02:48.075369+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e375: 8 total, 8 up, 8 in 2021-07-26T16:02:49.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[33981]: audit 2021-07-26T16:02:48.582649+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:49.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[33981]: audit 2021-07-26T16:02:48.586796+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:49.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[33981]: audit 2021-07-26T16:02:48.589271+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:02:49.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[33981]: audit 2021-07-26T16:02:48.590857+0000 mon.c (mon.1) 165 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:02:49.783 INFO:tasks.rados.rados.0.smithi033.stdout:1594: done (3 left) 2021-07-26T16:02:49.783 INFO:tasks.rados.rados.0.smithi033.stdout:1596: done (2 left) 2021-07-26T16:02:49.784 INFO:tasks.rados.rados.0.smithi033.stdout:1598: done (1 left) 2021-07-26T16:02:49.784 INFO:tasks.rados.rados.0.smithi033.stdout:1599: done (0 left) 2021-07-26T16:02:49.784 INFO:tasks.rados.rados.0.smithi033.stdout:1600: read oid 42 snap -1 2021-07-26T16:02:49.784 INFO:tasks.rados.rados.0.smithi033.stdout:1600: expect (ObjNum 467 snap 148 seq_num 467) 2021-07-26T16:02:49.785 INFO:tasks.rados.rados.0.smithi033.stdout:1601: delete oid 4 current snap is 154 2021-07-26T16:02:49.785 INFO:tasks.rados.rados.0.smithi033.stdout:1601: done (1 left) 2021-07-26T16:02:49.786 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 154 2021-07-26T16:02:49.787 INFO:tasks.rados.rados.0.smithi033.stdout:1602: seq_num 497 ranges {3702784=729088,4431872=401408} 2021-07-26T16:02:49.820 INFO:tasks.rados.rados.0.smithi033.stdout:1602: writing smithi03339061-25 from 3702784 to 4431872 tid 1 2021-07-26T16:02:49.820 INFO:tasks.rados.rados.0.smithi033.stdout:1602: writing smithi03339061-25 from 4431872 to 4833280 tid 2 2021-07-26T16:02:49.821 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 154 2021-07-26T16:02:49.821 INFO:tasks.rados.rados.0.smithi033.stdout:1603: seq_num 498 ranges {10354688=745472,11100160=401408} 2021-07-26T16:02:49.871 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T16:02:49.882 INFO:tasks.rados.rados.0.smithi033.stdout:1603: writing smithi03339061-48 from 10354688 to 11100160 tid 1 2021-07-26T16:02:49.886 INFO:tasks.rados.rados.0.smithi033.stdout:1603: writing smithi03339061-48 from 11100160 to 11501568 tid 2 2021-07-26T16:02:49.887 INFO:tasks.rados.rados.0.smithi033.stdout:1604: read oid 6 snap -1 2021-07-26T16:02:49.887 INFO:tasks.rados.rados.0.smithi033.stdout:1604: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:02:49.887 INFO:tasks.rados.rados.0.smithi033.stdout:1605: snap_remove snap 151 2021-07-26T16:02:49.985 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.752Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-07-26T16:02:49.986 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.752Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-07-26T16:02:49.986 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.752Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-07-26T16:02:49.986 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.752Z caller=main.go:339 host_details="(Linux 5.4.0-80-generic #90-Ubuntu SMP Fri Jul 9 22:49:44 UTC 2021 x86_64 smithi096 (none))" 2021-07-26T16:02:49.986 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.752Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-07-26T16:02:49.987 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.752Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-07-26T16:02:49.987 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.754Z caller=main.go:678 msg="Starting TSDB ..." 2021-07-26T16:02:49.987 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.754Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-07-26T16:02:49.988 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.761Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-07-26T16:02:49.988 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.762Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2021-07-26T16:02:49.988 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.781Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2021-07-26T16:02:49.988 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.781Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2021-07-26T16:02:49.988 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.781Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=19.73104ms 2021-07-26T16:02:49.989 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.783Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-07-26T16:02:49.989 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.784Z caller=main.go:695 msg="TSDB started" 2021-07-26T16:02:49.989 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.784Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-07-26T16:02:49.989 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.789Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-07-26T16:02:49.990 INFO:journalctl@ceph.prometheus.a.smithi096.stdout:Jul 26 16:02:49 smithi096 bash[41725]: level=info ts=2021-07-26T16:02:49.789Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-07-26T16:02:50.198 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T16:02:50.199 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (9m) 17s ago 9m 15.2M - 0.20.0 0881eb8f169f b1aff1777b59 2021-07-26T16:02:50.199 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (9m) 9s ago 9m 25.8M - 6.7.4 3b1077a63311 afe71c4052a3 2021-07-26T16:02:50.199 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (5m) 9s ago 14m 373M - 17.0.0-6381-gbccf07c2 6cdb40438e66 909ec99bd712 2021-07-26T16:02:50.199 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (5m) 17s ago 16m 418M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T16:02:50.200 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (4m) 17s ago 16m 55.7M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 7649338580a7 2021-07-26T16:02:50.200 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (4m) 9s ago 14m 45.0M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 5a3d2fea4cb3 2021-07-26T16:02:50.201 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (4m) 17s ago 14m 46.8M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 76ce8786552e 2021-07-26T16:02:50.201 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (22s) 17s ago 10m 2923k - 0.18.1 e5a616e4b9cf 6b78d170c031 2021-07-26T16:02:50.201 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (13s) 9s ago 10m 2832k - 0.18.1 e5a616e4b9cf ff3f734afbfe 2021-07-26T16:02:50.201 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (3m) 17s ago 13m 164M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 7275343c45f7 2021-07-26T16:02:50.201 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (3m) 17s ago 13m 171M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 778afc05022e 2021-07-26T16:02:50.202 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (2m) 17s ago 12m 122M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 e78ad82b00b5 2021-07-26T16:02:50.202 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (2m) 17s ago 12m 217M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 315a7c006da7 2021-07-26T16:02:50.202 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (94s) 9s ago 11m 184M 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 545d7f10ed9e 2021-07-26T16:02:50.202 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (86s) 9s ago 11m 127M 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 1c135b673521 2021-07-26T16:02:50.203 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (58s) 9s ago 11m 142M 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 edd8a674092a 2021-07-26T16:02:50.204 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (30s) 9s ago 10m 99.9M 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 e93762a78988 2021-07-26T16:02:50.204 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 starting - - - - 2021-07-26T16:02:50.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:50 smithi033 bash[41341]: cluster 2021-07-26T16:02:49.049277+0000 mgr.y (mgr.34104) 253 : cluster [DBG] pgmap v372: 25 pgs: 25 active+clean; 244 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2021-07-26T16:02:50.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:50 smithi033 bash[41341]: cluster 2021-07-26T16:02:49.090670+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2021-07-26T16:02:50.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:50 smithi033 bash[42377]: cluster 2021-07-26T16:02:49.049277+0000 mgr.y (mgr.34104) 253 : cluster [DBG] pgmap v372: 25 pgs: 25 active+clean; 244 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2021-07-26T16:02:50.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:50 smithi033 bash[42377]: cluster 2021-07-26T16:02:49.090670+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2021-07-26T16:02:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:50 smithi096 bash[33981]: cluster 2021-07-26T16:02:49.049277+0000 mgr.y (mgr.34104) 253 : cluster [DBG] pgmap v372: 25 pgs: 25 active+clean; 244 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.6 MiB/s wr, 17 op/s 2021-07-26T16:02:50.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:50 smithi096 bash[33981]: cluster 2021-07-26T16:02:49.090670+0000 mon.a (mon.0) 691 : cluster [DBG] osdmap e376: 8 total, 8 up, 8 in 2021-07-26T16:02:50.597 INFO:tasks.rados.rados.0.smithi033.stdout:1600: expect (ObjNum 467 snap 148 seq_num 467) 2021-07-26T16:02:50.598 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T16:02:50.598 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T16:02:50.598 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T16:02:50.598 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:02:50.599 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T16:02:50.599 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T16:02:50.599 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:02:50.599 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T16:02:50.600 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 8 2021-07-26T16:02:50.600 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:02:50.600 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T16:02:50.600 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T16:02:50.600 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 13 2021-07-26T16:02:50.601 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T16:02:50.601 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T16:02:51.185 INFO:tasks.rados.rados.0.smithi033.stdout:1602: finishing write tid 1 to smithi03339061-25 2021-07-26T16:02:51.186 INFO:tasks.rados.rados.0.smithi033.stdout:1602: finishing write tid 2 to smithi03339061-25 2021-07-26T16:02:51.186 INFO:tasks.rados.rados.0.smithi033.stdout:1602: finishing write tid 3 to smithi03339061-25 2021-07-26T16:02:51.205 INFO:tasks.rados.rados.0.smithi033.stdout:1602: finishing write tid 4 to smithi03339061-25 2021-07-26T16:02:51.208 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 670 (ObjNum 497 snap 154 seq_num 497) dirty exists 2021-07-26T16:02:51.208 INFO:tasks.rados.rados.0.smithi033.stdout:1602: left oid 25 (ObjNum 497 snap 154 seq_num 497) 2021-07-26T16:02:51.208 INFO:tasks.rados.rados.0.smithi033.stdout:1603: finishing write tid 1 to smithi03339061-48 2021-07-26T16:02:51.208 INFO:tasks.rados.rados.0.smithi033.stdout:1603: finishing write tid 2 to smithi03339061-48 2021-07-26T16:02:51.209 INFO:tasks.rados.rados.0.smithi033.stdout:1603: finishing write tid 3 to smithi03339061-48 2021-07-26T16:02:51.209 INFO:tasks.rados.rados.0.smithi033.stdout:1603: finishing write tid 4 to smithi03339061-48 2021-07-26T16:02:51.210 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 793 (ObjNum 498 snap 154 seq_num 498) dirty exists 2021-07-26T16:02:51.210 INFO:tasks.rados.rados.0.smithi033.stdout:1603: left oid 48 (ObjNum 498 snap 154 seq_num 498) 2021-07-26T16:02:51.210 INFO:tasks.rados.rados.0.smithi033.stdout:1604: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:02:51.362 INFO:tasks.rados.rados.0.smithi033.stdout:1600: done (4 left) 2021-07-26T16:02:51.362 INFO:tasks.rados.rados.0.smithi033.stdout:1602: done (3 left) 2021-07-26T16:02:51.362 INFO:tasks.rados.rados.0.smithi033.stdout:1603: done (2 left) 2021-07-26T16:02:51.363 INFO:tasks.rados.rados.0.smithi033.stdout:1604: done (1 left) 2021-07-26T16:02:51.363 INFO:tasks.rados.rados.0.smithi033.stdout:1605: done (0 left) 2021-07-26T16:02:51.363 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 154 2021-07-26T16:02:51.363 INFO:tasks.rados.rados.0.smithi033.stdout:1606: seq_num 499 ranges {8372224=761856,9134080=401408} 2021-07-26T16:02:51.420 INFO:tasks.rados.rados.0.smithi033.stdout:1606: writing smithi03339061-46 from 8372224 to 9134080 tid 1 2021-07-26T16:02:51.423 INFO:tasks.rados.rados.0.smithi033.stdout:1606: writing smithi03339061-46 from 9134080 to 9535488 tid 2 2021-07-26T16:02:51.425 INFO:tasks.rados.rados.0.smithi033.stdout:1607: copy_from oid 29 from oid 48 current snap is 154 2021-07-26T16:02:51.425 INFO:tasks.rados.rados.0.smithi033.stdout:1608: snap_remove snap 150 2021-07-26T16:02:51.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:51 smithi033 bash[41341]: audit 2021-07-26T16:02:49.852930+0000 mgr.y (mgr.34104) 254 : audit [DBG] from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:51.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:51 smithi033 bash[41341]: audit 2021-07-26T16:02:50.178290+0000 mgr.y (mgr.34104) 255 : audit [DBG] from='client.44284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:51.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:51 smithi033 bash[41341]: cluster 2021-07-26T16:02:50.590531+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2021-07-26T16:02:51.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:51 smithi033 bash[41341]: audit 2021-07-26T16:02:50.591916+0000 mon.a (mon.0) 693 : audit [DBG] from='client.? 172.21.15.33:0/4034999943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:51.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:51 smithi033 bash[41341]: cluster 2021-07-26T16:02:51.027476+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2021-07-26T16:02:51.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:51 smithi033 bash[42377]: audit 2021-07-26T16:02:49.852930+0000 mgr.y (mgr.34104) 254 : audit [DBG] from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:51.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:51 smithi033 bash[42377]: audit 2021-07-26T16:02:50.178290+0000 mgr.y (mgr.34104) 255 : audit [DBG] from='client.44284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:51.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:51 smithi033 bash[42377]: cluster 2021-07-26T16:02:50.590531+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2021-07-26T16:02:51.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:51 smithi033 bash[42377]: audit 2021-07-26T16:02:50.591916+0000 mon.a (mon.0) 693 : audit [DBG] from='client.? 172.21.15.33:0/4034999943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:51.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:51 smithi033 bash[42377]: cluster 2021-07-26T16:02:51.027476+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2021-07-26T16:02:51.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:51 smithi096 bash[33981]: audit 2021-07-26T16:02:49.852930+0000 mgr.y (mgr.34104) 254 : audit [DBG] from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:51.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:51 smithi096 bash[33981]: audit 2021-07-26T16:02:50.178290+0000 mgr.y (mgr.34104) 255 : audit [DBG] from='client.44284 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:02:51.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:51 smithi096 bash[33981]: cluster 2021-07-26T16:02:50.590531+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e377: 8 total, 8 up, 8 in 2021-07-26T16:02:51.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:51 smithi096 bash[33981]: audit 2021-07-26T16:02:50.591916+0000 mon.a (mon.0) 693 : audit [DBG] from='client.? 172.21.15.33:0/4034999943' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:51.988 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:51 smithi096 bash[33981]: cluster 2021-07-26T16:02:51.027476+0000 mon.a (mon.0) 694 : cluster [DBG] osdmap e378: 8 total, 8 up, 8 in 2021-07-26T16:02:52.050 INFO:tasks.rados.rados.0.smithi033.stdout:1608: done (2 left) 2021-07-26T16:02:52.050 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 154 2021-07-26T16:02:52.050 INFO:tasks.rados.rados.0.smithi033.stdout:1609: seq_num 500 ranges {6856704=778240,7634944=401408} 2021-07-26T16:02:52.094 INFO:tasks.rados.rados.0.smithi033.stdout:1609: writing smithi03339061-49 from 6856704 to 7634944 tid 1 2021-07-26T16:02:52.096 INFO:tasks.rados.rados.0.smithi033.stdout:1609: writing smithi03339061-49 from 7634944 to 8036352 tid 2 2021-07-26T16:02:52.097 INFO:tasks.rados.rados.0.smithi033.stdout:1610: read oid 30 snap -1 2021-07-26T16:02:52.097 INFO:tasks.rados.rados.0.smithi033.stdout:1610: expect (ObjNum 394 snap 120 seq_num 394) 2021-07-26T16:02:52.097 INFO:tasks.rados.rados.0.smithi033.stdout:1611: snap_create 2021-07-26T16:02:52.097 INFO:tasks.rados.rados.0.smithi033.stdout:1606: finishing write tid 1 to smithi03339061-46 2021-07-26T16:02:52.098 INFO:tasks.rados.rados.0.smithi033.stdout:1606: finishing write tid 2 to smithi03339061-46 2021-07-26T16:02:52.098 INFO:tasks.rados.rados.0.smithi033.stdout:1606: finishing write tid 3 to smithi03339061-46 2021-07-26T16:02:52.098 INFO:tasks.rados.rados.0.smithi033.stdout:1606: finishing write tid 4 to smithi03339061-46 2021-07-26T16:02:52.098 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 621 (ObjNum 499 snap 154 seq_num 499) dirty exists 2021-07-26T16:02:52.099 INFO:tasks.rados.rados.0.smithi033.stdout:1606: left oid 46 (ObjNum 499 snap 154 seq_num 499) 2021-07-26T16:02:52.099 INFO:tasks.rados.rados.0.smithi033.stdout:1607: finishing copy_from to smithi03339061-29 2021-07-26T16:02:52.099 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 793 (ObjNum 498 snap 154 seq_num 498) dirty exists 2021-07-26T16:02:52.099 INFO:tasks.rados.rados.0.smithi033.stdout:1607: finishing copy_from racing read to smithi03339061-29 2021-07-26T16:02:52.110 INFO:tasks.rados.rados.0.smithi033.stdout:1609: finishing write tid 1 to smithi03339061-49 2021-07-26T16:02:52.110 INFO:tasks.rados.rados.0.smithi033.stdout:1609: finishing write tid 2 to smithi03339061-49 2021-07-26T16:02:52.110 INFO:tasks.rados.rados.0.smithi033.stdout:1609: finishing write tid 3 to smithi03339061-49 2021-07-26T16:02:52.111 INFO:tasks.rados.rados.0.smithi033.stdout:1609: finishing write tid 4 to smithi03339061-49 2021-07-26T16:02:52.111 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 526 (ObjNum 500 snap 154 seq_num 500) dirty exists 2021-07-26T16:02:52.111 INFO:tasks.rados.rados.0.smithi033.stdout:1609: left oid 49 (ObjNum 500 snap 154 seq_num 500) 2021-07-26T16:02:52.158 INFO:tasks.rados.rados.0.smithi033.stdout:1610: expect (ObjNum 394 snap 120 seq_num 394) 2021-07-26T16:02:52.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:52 smithi033 bash[42377]: cluster 2021-07-26T16:02:51.049790+0000 mgr.y (mgr.34104) 256 : cluster [DBG] pgmap v376: 25 pgs: 25 active+clean; 240 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2021-07-26T16:02:52.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:52 smithi033 bash[42377]: cluster 2021-07-26T16:02:52.044434+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2021-07-26T16:02:52.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:52 smithi033 bash[41341]: cluster 2021-07-26T16:02:51.049790+0000 mgr.y (mgr.34104) 256 : cluster [DBG] pgmap v376: 25 pgs: 25 active+clean; 240 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2021-07-26T16:02:52.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:52 smithi033 bash[41341]: cluster 2021-07-26T16:02:52.044434+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2021-07-26T16:02:52.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:52 smithi096 bash[33981]: cluster 2021-07-26T16:02:51.049790+0000 mgr.y (mgr.34104) 256 : cluster [DBG] pgmap v376: 25 pgs: 25 active+clean; 240 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 19 MiB/s rd, 2.2 MiB/s wr, 12 op/s 2021-07-26T16:02:52.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:52 smithi096 bash[33981]: cluster 2021-07-26T16:02:52.044434+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e379: 8 total, 8 up, 8 in 2021-07-26T16:02:53.737 INFO:tasks.rados.rados.0.smithi033.stdout:1606: done (4 left) 2021-07-26T16:02:53.737 INFO:tasks.rados.rados.0.smithi033.stdout:1607: done (3 left) 2021-07-26T16:02:53.738 INFO:tasks.rados.rados.0.smithi033.stdout:1609: done (2 left) 2021-07-26T16:02:53.738 INFO:tasks.rados.rados.0.smithi033.stdout:1610: done (1 left) 2021-07-26T16:02:53.738 INFO:tasks.rados.rados.0.smithi033.stdout:1611: done (0 left) 2021-07-26T16:02:53.738 INFO:tasks.rados.rados.0.smithi033.stdout:1612: setattr oid 37 current snap is 155 2021-07-26T16:02:53.741 INFO:tasks.rados.rados.0.smithi033.stdout:1613: copy_from oid 34 from oid 33 current snap is 155 2021-07-26T16:02:53.741 INFO:tasks.rados.rados.0.smithi033.stdout:1614: copy_from oid 16 from oid 43 current snap is 155 2021-07-26T16:02:53.742 INFO:tasks.rados.rados.0.smithi033.stdout:1615: rollback oid 13 current snap is 155 2021-07-26T16:02:53.742 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 13 to 154 2021-07-26T16:02:53.742 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 155 2021-07-26T16:02:53.742 INFO:tasks.rados.rados.0.smithi033.stdout:1616: seq_num 501 ranges {4243456=794624,5038080=401408} 2021-07-26T16:02:53.774 INFO:tasks.rados.rados.0.smithi033.stdout:1616: writing smithi03339061-24 from 4243456 to 5038080 tid 1 2021-07-26T16:02:53.778 INFO:tasks.rados.rados.0.smithi033.stdout:1616: writing smithi03339061-24 from 5038080 to 5439488 tid 2 2021-07-26T16:02:53.778 INFO:tasks.rados.rados.0.smithi033.stdout:1617: copy_from oid 38 from oid 11 current snap is 155 2021-07-26T16:02:53.778 INFO:tasks.rados.rados.0.smithi033.stdout:1614: finishing copy_from to smithi03339061-16 2021-07-26T16:02:53.779 INFO:tasks.rados.rados.0.smithi033.stdout:1614: got expected ENOENT (src dne) 2021-07-26T16:02:53.779 INFO:tasks.rados.rados.0.smithi033.stdout:1618: rollback oid 47 current snap is 155 2021-07-26T16:02:53.779 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 47 to 152 2021-07-26T16:02:53.779 INFO:tasks.rados.rados.0.smithi033.stdout:1614: finishing copy_from racing read to smithi03339061-16 2021-07-26T16:02:53.779 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 827 (ObjNum 405 snap 128 seq_num 405) dirty exists 2021-07-26T16:02:53.780 INFO:tasks.rados.rados.0.smithi033.stdout:1615: finishing rollback tid 0 to smithi03339061-13 2021-07-26T16:02:53.780 INFO:tasks.rados.rados.0.smithi033.stdout:1612: done (6 left) 2021-07-26T16:02:53.780 INFO:tasks.rados.rados.0.smithi033.stdout:1614: done (5 left) 2021-07-26T16:02:53.780 INFO:tasks.rados.rados.0.smithi033.stdout:1619: snap_create 2021-07-26T16:02:53.781 INFO:tasks.rados.rados.0.smithi033.stdout:1615: finishing rollback tid 1 to smithi03339061-13 2021-07-26T16:02:53.781 INFO:tasks.rados.rados.0.smithi033.stdout:1615: finishing rollback tid 2 to smithi03339061-13 2021-07-26T16:02:53.781 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 661 (ObjNum 459 snap 144 seq_num 459) dirty exists 2021-07-26T16:02:53.781 INFO:tasks.rados.rados.0.smithi033.stdout:1613: finishing copy_from to smithi03339061-34 2021-07-26T16:02:53.782 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 837 (ObjNum 478 snap 149 seq_num 478) dirty exists 2021-07-26T16:02:53.782 INFO:tasks.rados.rados.0.smithi033.stdout:1613: finishing copy_from racing read to smithi03339061-34 2021-07-26T16:02:53.787 INFO:tasks.rados.rados.0.smithi033.stdout:1616: finishing write tid 1 to smithi03339061-24 2021-07-26T16:02:53.787 INFO:tasks.rados.rados.0.smithi033.stdout:1616: finishing write tid 2 to smithi03339061-24 2021-07-26T16:02:53.788 INFO:tasks.rados.rados.0.smithi033.stdout:1616: finishing write tid 3 to smithi03339061-24 2021-07-26T16:02:53.789 INFO:tasks.rados.rados.0.smithi033.stdout:1618: finishing rollback tid 0 to smithi03339061-47 2021-07-26T16:02:53.790 INFO:tasks.rados.rados.0.smithi033.stdout:1618: finishing rollback tid 1 to smithi03339061-47 2021-07-26T16:02:53.790 INFO:tasks.rados.rados.0.smithi033.stdout:1618: finishing rollback tid 2 to smithi03339061-47 2021-07-26T16:02:53.790 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 833 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:02:53.791 INFO:tasks.rados.rados.0.smithi033.stdout:1616: finishing write tid 4 to smithi03339061-24 2021-07-26T16:02:53.791 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 830 (ObjNum 501 snap 155 seq_num 501) dirty exists 2021-07-26T16:02:53.791 INFO:tasks.rados.rados.0.smithi033.stdout:1616: left oid 24 (ObjNum 501 snap 155 seq_num 501) 2021-07-26T16:02:53.811 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:53.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:53.811 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:53.522Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:02:53.811 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[32681]: level=error ts=2021-07-26T16:02:53.522Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=12 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:02:53.812 INFO:tasks.rados.rados.0.smithi033.stdout:1617: finishing copy_from to smithi03339061-38 2021-07-26T16:02:53.812 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 692 (ObjNum 462 snap 146 seq_num 462) dirty exists 2021-07-26T16:02:53.813 INFO:tasks.rados.rados.0.smithi033.stdout:1617: finishing copy_from racing read to smithi03339061-38 2021-07-26T16:02:54.059 INFO:tasks.rados.rados.0.smithi033.stdout:1613: done (5 left) 2021-07-26T16:02:54.059 INFO:tasks.rados.rados.0.smithi033.stdout:1615: done (4 left) 2021-07-26T16:02:54.059 INFO:tasks.rados.rados.0.smithi033.stdout:1616: done (3 left) 2021-07-26T16:02:54.060 INFO:tasks.rados.rados.0.smithi033.stdout:1617: done (2 left) 2021-07-26T16:02:54.060 INFO:tasks.rados.rados.0.smithi033.stdout:1618: done (1 left) 2021-07-26T16:02:54.061 INFO:tasks.rados.rados.0.smithi033.stdout:1619: done (0 left) 2021-07-26T16:02:54.061 INFO:tasks.rados.rados.0.smithi033.stdout:1620: rmattr oid 9 current snap is 156 2021-07-26T16:02:54.061 INFO:tasks.rados.rados.0.smithi033.stdout:1620: done (0 left) 2021-07-26T16:02:54.061 INFO:tasks.rados.rados.0.smithi033.stdout:1621: copy_from oid 8 from oid 42 current snap is 156 2021-07-26T16:02:54.062 INFO:tasks.rados.rados.0.smithi033.stdout:1622: delete oid 3 current snap is 156 2021-07-26T16:02:54.069 INFO:tasks.rados.rados.0.smithi033.stdout:1622: done (1 left) 2021-07-26T16:02:54.069 INFO:tasks.rados.rados.0.smithi033.stdout:1623: rollback oid 25 current snap is 156 2021-07-26T16:02:54.070 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 25 to 155 2021-07-26T16:02:54.070 INFO:tasks.rados.rados.0.smithi033.stdout:1624: snap_create 2021-07-26T16:02:54.076 INFO:tasks.rados.rados.0.smithi033.stdout:1623: finishing rollback tid 0 to smithi03339061-25 2021-07-26T16:02:54.077 INFO:tasks.rados.rados.0.smithi033.stdout:1623: finishing rollback tid 1 to smithi03339061-25 2021-07-26T16:02:54.077 INFO:tasks.rados.rados.0.smithi033.stdout:1623: finishing rollback tid 2 to smithi03339061-25 2021-07-26T16:02:54.078 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 673 (ObjNum 497 snap 154 seq_num 497) dirty exists 2021-07-26T16:02:54.111 INFO:tasks.rados.rados.0.smithi033.stdout:1621: finishing copy_from to smithi03339061-8 2021-07-26T16:02:54.111 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 253 (ObjNum 467 snap 148 seq_num 467) dirty exists 2021-07-26T16:02:54.111 INFO:tasks.rados.rados.0.smithi033.stdout:1621: finishing copy_from racing read to smithi03339061-8 2021-07-26T16:02:54.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.807710+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:54.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.814412+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:54.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.822789+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T16:02:54.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.823434+0000 mgr.y (mgr.34104) 257 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T16:02:54.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.825999+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:54.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.827806+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.829816+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.831085+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.833570+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.836012+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.837473+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.838790+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.840046+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.841275+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.212 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.842724+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.844368+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: audit 2021-07-26T16:02:52.845675+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: cluster 2021-07-26T16:02:53.045071+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2021-07-26T16:02:54.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[42377]: cluster 2021-07-26T16:02:53.050199+0000 mgr.y (mgr.34104) 258 : cluster [DBG] pgmap v379: 25 pgs: 25 active+clean; 221 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 33 MiB/s rd, 2.4 MiB/s wr, 8 op/s 2021-07-26T16:02:54.214 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.807710+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:54.214 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.814412+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:54.214 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.822789+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T16:02:54.214 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.823434+0000 mgr.y (mgr.34104) 257 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T16:02:54.215 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.825999+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:54.215 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.827806+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.215 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.829816+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.215 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.831085+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.218 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.833570+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.218 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.836012+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.218 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.837473+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.219 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.838790+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.219 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.840046+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.219 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.841275+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.220 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.842724+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.220 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.844368+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.220 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: audit 2021-07-26T16:02:52.845675+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.220 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: cluster 2021-07-26T16:02:53.045071+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2021-07-26T16:02:54.221 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:53 smithi033 bash[41341]: cluster 2021-07-26T16:02:53.050199+0000 mgr.y (mgr.34104) 258 : cluster [DBG] pgmap v379: 25 pgs: 25 active+clean; 221 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 33 MiB/s rd, 2.4 MiB/s wr, 8 op/s 2021-07-26T16:02:54.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.807710+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:54.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.814412+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:02:54.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.822789+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T16:02:54.236 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.823434+0000 mgr.y (mgr.34104) 257 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-07-26T16:02:54.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.825999+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:02:54.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.827806+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.829816+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.831085+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.237 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.833570+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.836012+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.837473+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.838790+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.238 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.840046+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.841275+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.842724+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.844368+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.239 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: audit 2021-07-26T16:02:52.845675+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:02:54.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: cluster 2021-07-26T16:02:53.045071+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e380: 8 total, 8 up, 8 in 2021-07-26T16:02:54.240 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:53 smithi096 bash[33981]: cluster 2021-07-26T16:02:53.050199+0000 mgr.y (mgr.34104) 258 : cluster [DBG] pgmap v379: 25 pgs: 25 active+clean; 221 MiB data, 754 MiB used, 714 GiB / 715 GiB avail; 33 MiB/s rd, 2.4 MiB/s wr, 8 op/s 2021-07-26T16:02:55.060 INFO:tasks.rados.rados.0.smithi033.stdout:1621: done (2 left) 2021-07-26T16:02:55.061 INFO:tasks.rados.rados.0.smithi033.stdout:1623: done (1 left) 2021-07-26T16:02:55.061 INFO:tasks.rados.rados.0.smithi033.stdout:1624: done (0 left) 2021-07-26T16:02:55.061 INFO:tasks.rados.rados.0.smithi033.stdout:1625: read oid 30 snap 154 2021-07-26T16:02:55.061 INFO:tasks.rados.rados.0.smithi033.stdout:1625: expect (ObjNum 394 snap 120 seq_num 394) 2021-07-26T16:02:55.062 INFO:tasks.rados.rados.0.smithi033.stdout:1626: rollback oid 17 current snap is 157 2021-07-26T16:02:55.062 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 17 to 154 2021-07-26T16:02:55.062 INFO:tasks.rados.rados.0.smithi033.stdout:1627: read oid 14 snap 156 2021-07-26T16:02:55.062 INFO:tasks.rados.rados.0.smithi033.stdout:1627: expect (ObjNum 456 snap 142 seq_num 456) 2021-07-26T16:02:55.063 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 157 2021-07-26T16:02:55.063 INFO:tasks.rados.rados.0.smithi033.stdout:1628: seq_num 503 ranges {4292608=425984,4718592=704512,5423104=98304} 2021-07-26T16:02:55.090 INFO:tasks.rados.rados.0.smithi033.stdout:1628: writing smithi03339061-45 from 4292608 to 4718592 tid 1 2021-07-26T16:02:55.097 INFO:tasks.rados.rados.0.smithi033.stdout:1628: writing smithi03339061-45 from 4718592 to 5423104 tid 2 2021-07-26T16:02:55.097 INFO:tasks.rados.rados.0.smithi033.stdout:1628: writing smithi03339061-45 from 5423104 to 5521408 tid 3 2021-07-26T16:02:55.097 INFO:tasks.rados.rados.0.smithi033.stdout:1626: finishing rollback tid 0 to smithi03339061-17 2021-07-26T16:02:55.097 INFO:tasks.rados.rados.0.smithi033.stdout:1629: rmattr oid 7 current snap is 157 2021-07-26T16:02:55.098 INFO:tasks.rados.rados.0.smithi033.stdout:1629: done (4 left) 2021-07-26T16:02:55.098 INFO:tasks.rados.rados.0.smithi033.stdout:1630: copy_from oid 33 from oid 36 current snap is 157 2021-07-26T16:02:55.098 INFO:tasks.rados.rados.0.smithi033.stdout:1626: finishing rollback tid 1 to smithi03339061-17 2021-07-26T16:02:55.098 INFO:tasks.rados.rados.0.smithi033.stdout:1626: finishing rollback tid 2 to smithi03339061-17 2021-07-26T16:02:55.099 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 499 (ObjNum 444 snap 137 seq_num 444) dirty exists 2021-07-26T16:02:55.099 INFO:tasks.rados.rados.0.smithi033.stdout:1626: done (4 left) 2021-07-26T16:02:55.099 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 157 2021-07-26T16:02:55.099 INFO:tasks.rados.rados.0.smithi033.stdout:1631: seq_num 504 ranges {4243456=450560,4694016=589824,5283840=212992} 2021-07-26T16:02:55.123 INFO:tasks.rados.rados.0.smithi033.stdout:1631: writing smithi03339061-11 from 4243456 to 4694016 tid 1 2021-07-26T16:02:55.126 INFO:tasks.rados.rados.0.smithi033.stdout:1631: writing smithi03339061-11 from 4694016 to 5283840 tid 2 2021-07-26T16:02:55.128 INFO:tasks.rados.rados.0.smithi033.stdout:1631: writing smithi03339061-11 from 5283840 to 5496832 tid 3 2021-07-26T16:02:55.128 INFO:tasks.rados.rados.0.smithi033.stdout:1627: expect (ObjNum 456 snap 142 seq_num 456) 2021-07-26T16:02:55.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:55 smithi033 bash[41341]: cluster 2021-07-26T16:02:54.052871+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2021-07-26T16:02:55.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:55 smithi033 bash[42377]: cluster 2021-07-26T16:02:54.052871+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2021-07-26T16:02:55.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:55 smithi096 bash[33981]: cluster 2021-07-26T16:02:54.052871+0000 mon.a (mon.0) 699 : cluster [DBG] osdmap e381: 8 total, 8 up, 8 in 2021-07-26T16:02:55.533 INFO:tasks.rados.rados.0.smithi033.stdout:1627: done (4 left) 2021-07-26T16:02:55.534 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 157 2021-07-26T16:02:55.534 INFO:tasks.rados.rados.0.smithi033.stdout:1628: finishing write tid 1 to smithi03339061-45 2021-07-26T16:02:55.534 INFO:tasks.rados.rados.0.smithi033.stdout:1628: finishing write tid 2 to smithi03339061-45 2021-07-26T16:02:55.534 INFO:tasks.rados.rados.0.smithi033.stdout:1632: seq_num 505 ranges {0=466944,466944=475136,942080=327680} 2021-07-26T16:02:55.536 INFO:tasks.rados.rados.0.smithi033.stdout:1632: writing smithi03339061-15 from 0 to 466944 tid 1 2021-07-26T16:02:55.538 INFO:tasks.rados.rados.0.smithi033.stdout:1632: writing smithi03339061-15 from 466944 to 942080 tid 2 2021-07-26T16:02:55.541 INFO:tasks.rados.rados.0.smithi033.stdout:1632: writing smithi03339061-15 from 942080 to 1269760 tid 3 2021-07-26T16:02:55.542 INFO:tasks.rados.rados.0.smithi033.stdout:1628: finishing write tid 3 to smithi03339061-45 2021-07-26T16:02:55.542 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 157 2021-07-26T16:02:55.542 INFO:tasks.rados.rados.0.smithi033.stdout:1630: finishing copy_from to smithi03339061-33 2021-07-26T16:02:55.542 INFO:tasks.rados.rados.0.smithi033.stdout:1630: got expected ENOENT (src dne) 2021-07-26T16:02:55.543 INFO:tasks.rados.rados.0.smithi033.stdout:1630: finishing copy_from racing read to smithi03339061-33 2021-07-26T16:02:55.543 INFO:tasks.rados.rados.0.smithi033.stdout:1628: finishing write tid 4 to smithi03339061-45 2021-07-26T16:02:55.543 INFO:tasks.rados.rados.0.smithi033.stdout:1628: finishing write tid 5 to smithi03339061-45 2021-07-26T16:02:55.543 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 878 (ObjNum 503 snap 157 seq_num 503) dirty exists 2021-07-26T16:02:55.543 INFO:tasks.rados.rados.0.smithi033.stdout:1628: left oid 45 (ObjNum 503 snap 157 seq_num 503) 2021-07-26T16:02:55.544 INFO:tasks.rados.rados.0.smithi033.stdout:1625: expect (ObjNum 394 snap 120 seq_num 394) 2021-07-26T16:02:56.065 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:56 smithi033 bash[41341]: cluster 2021-07-26T16:02:55.051106+0000 mgr.y (mgr.34104) 259 : cluster [DBG] pgmap v381: 25 pgs: 25 active+clean; 235 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 3.7 MiB/s wr, 7 op/s 2021-07-26T16:02:56.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:56 smithi033 bash[41341]: cluster 2021-07-26T16:02:55.055938+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2021-07-26T16:02:56.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:56 smithi033 bash[41341]: cephadm 2021-07-26T16:02:55.516273+0000 mgr.y (mgr.34104) 260 : cephadm [INF] Upgrade: Updating alertmanager.a 2021-07-26T16:02:56.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:56 smithi033 bash[41341]: cephadm 2021-07-26T16:02:55.521114+0000 mgr.y (mgr.34104) 261 : cephadm [INF] Deploying daemon alertmanager.a on smithi033 2021-07-26T16:02:56.066 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:56 smithi033 bash[41341]: cluster 2021-07-26T16:02:56.029588+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2021-07-26T16:02:56.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:56 smithi033 bash[42377]: cluster 2021-07-26T16:02:55.051106+0000 mgr.y (mgr.34104) 259 : cluster [DBG] pgmap v381: 25 pgs: 25 active+clean; 235 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 3.7 MiB/s wr, 7 op/s 2021-07-26T16:02:56.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:56 smithi033 bash[42377]: cluster 2021-07-26T16:02:55.055938+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2021-07-26T16:02:56.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:56 smithi033 bash[42377]: cephadm 2021-07-26T16:02:55.516273+0000 mgr.y (mgr.34104) 260 : cephadm [INF] Upgrade: Updating alertmanager.a 2021-07-26T16:02:56.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:56 smithi033 bash[42377]: cephadm 2021-07-26T16:02:55.521114+0000 mgr.y (mgr.34104) 261 : cephadm [INF] Deploying daemon alertmanager.a on smithi033 2021-07-26T16:02:56.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:56 smithi033 bash[42377]: cluster 2021-07-26T16:02:56.029588+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2021-07-26T16:02:56.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:56 smithi096 bash[33981]: cluster 2021-07-26T16:02:55.051106+0000 mgr.y (mgr.34104) 259 : cluster [DBG] pgmap v381: 25 pgs: 25 active+clean; 235 MiB data, 765 MiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 3.7 MiB/s wr, 7 op/s 2021-07-26T16:02:56.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:56 smithi096 bash[33981]: cluster 2021-07-26T16:02:55.055938+0000 mon.a (mon.0) 700 : cluster [DBG] osdmap e382: 8 total, 8 up, 8 in 2021-07-26T16:02:56.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:56 smithi096 bash[33981]: cephadm 2021-07-26T16:02:55.516273+0000 mgr.y (mgr.34104) 260 : cephadm [INF] Upgrade: Updating alertmanager.a 2021-07-26T16:02:56.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:56 smithi096 bash[33981]: cephadm 2021-07-26T16:02:55.521114+0000 mgr.y (mgr.34104) 261 : cephadm [INF] Deploying daemon alertmanager.a on smithi033 2021-07-26T16:02:56.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:56 smithi096 bash[33981]: cluster 2021-07-26T16:02:56.029588+0000 mon.a (mon.0) 701 : cluster [DBG] osdmap e383: 8 total, 8 up, 8 in 2021-07-26T16:02:57.108 INFO:tasks.rados.rados.0.smithi033.stdout:1631: finishing write tid 1 to smithi03339061-11 2021-07-26T16:02:57.108 INFO:tasks.rados.rados.0.smithi033.stdout:1631: finishing write tid 2 to smithi03339061-11 2021-07-26T16:02:57.109 INFO:tasks.rados.rados.0.smithi033.stdout:1631: finishing write tid 3 to smithi03339061-11 2021-07-26T16:02:57.109 INFO:tasks.rados.rados.0.smithi033.stdout:1631: finishing write tid 4 to smithi03339061-11 2021-07-26T16:02:57.109 INFO:tasks.rados.rados.0.smithi033.stdout:1631: finishing write tid 5 to smithi03339061-11 2021-07-26T16:02:57.110 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 841 (ObjNum 504 snap 157 seq_num 504) dirty exists 2021-07-26T16:02:57.110 INFO:tasks.rados.rados.0.smithi033.stdout:1631: left oid 11 (ObjNum 504 snap 157 seq_num 504) 2021-07-26T16:02:57.111 INFO:tasks.rados.rados.0.smithi033.stdout:1632: finishing write tid 1 to smithi03339061-15 2021-07-26T16:02:57.111 INFO:tasks.rados.rados.0.smithi033.stdout:1632: finishing write tid 2 to smithi03339061-15 2021-07-26T16:02:57.112 INFO:tasks.rados.rados.0.smithi033.stdout:1632: finishing write tid 3 to smithi03339061-15 2021-07-26T16:02:57.112 INFO:tasks.rados.rados.0.smithi033.stdout:1632: finishing write tid 4 to smithi03339061-15 2021-07-26T16:02:57.112 INFO:tasks.rados.rados.0.smithi033.stdout:1633: seq_num 506 ranges {0=483328,483328=761856,1245184=40960} 2021-07-26T16:02:57.114 INFO:tasks.rados.rados.0.smithi033.stdout:1633: writing smithi03339061-26 from 0 to 483328 tid 1 2021-07-26T16:02:57.123 INFO:tasks.rados.rados.0.smithi033.stdout:1633: writing smithi03339061-26 from 483328 to 1245184 tid 2 2021-07-26T16:02:57.124 INFO:tasks.rados.rados.0.smithi033.stdout:1633: writing smithi03339061-26 from 1245184 to 1286144 tid 3 2021-07-26T16:02:57.124 INFO:tasks.rados.rados.0.smithi033.stdout:1632: finishing write tid 5 to smithi03339061-15 2021-07-26T16:02:57.124 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 530 (ObjNum 505 snap 157 seq_num 505) dirty exists 2021-07-26T16:02:57.124 INFO:tasks.rados.rados.0.smithi033.stdout:1632: left oid 15 (ObjNum 505 snap 157 seq_num 505) 2021-07-26T16:02:57.124 INFO:tasks.rados.rados.0.smithi033.stdout:1633: finishing write tid 1 to smithi03339061-26 2021-07-26T16:02:57.125 INFO:tasks.rados.rados.0.smithi033.stdout:1625: done (5 left) 2021-07-26T16:02:57.125 INFO:tasks.rados.rados.0.smithi033.stdout:1628: done (4 left) 2021-07-26T16:02:57.126 INFO:tasks.rados.rados.0.smithi033.stdout:1630: done (3 left) 2021-07-26T16:02:57.126 INFO:tasks.rados.rados.0.smithi033.stdout:1631: done (2 left) 2021-07-26T16:02:57.126 INFO:tasks.rados.rados.0.smithi033.stdout:1632: done (1 left) 2021-07-26T16:02:57.126 INFO:tasks.rados.rados.0.smithi033.stdout:1634: snap_create 2021-07-26T16:02:57.128 INFO:tasks.rados.rados.0.smithi033.stdout:1633: finishing write tid 2 to smithi03339061-26 2021-07-26T16:02:57.129 INFO:tasks.rados.rados.0.smithi033.stdout:1633: finishing write tid 3 to smithi03339061-26 2021-07-26T16:02:57.129 INFO:tasks.rados.rados.0.smithi033.stdout:1633: finishing write tid 4 to smithi03339061-26 2021-07-26T16:02:57.133 INFO:tasks.rados.rados.0.smithi033.stdout:1633: finishing write tid 5 to smithi03339061-26 2021-07-26T16:02:57.133 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 883 (ObjNum 506 snap 157 seq_num 506) dirty exists 2021-07-26T16:02:57.133 INFO:tasks.rados.rados.0.smithi033.stdout:1633: left oid 26 (ObjNum 506 snap 157 seq_num 506) 2021-07-26T16:02:58.076 INFO:tasks.rados.rados.0.smithi033.stdout:1633: done (1 left) 2021-07-26T16:02:58.077 INFO:tasks.rados.rados.0.smithi033.stdout:1634: done (0 left) 2021-07-26T16:02:58.077 INFO:tasks.rados.rados.0.smithi033.stdout:1635: delete oid 40 current snap is 158 2021-07-26T16:02:58.085 INFO:tasks.rados.rados.0.smithi033.stdout:1635: done (0 left) 2021-07-26T16:02:58.086 INFO:tasks.rados.rados.0.smithi033.stdout:1636: read oid 17 snap 157 2021-07-26T16:02:58.086 INFO:tasks.rados.rados.0.smithi033.stdout:1636: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:02:58.086 INFO:tasks.rados.rados.0.smithi033.stdout:1637: rollback oid 10 current snap is 158 2021-07-26T16:02:58.087 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 10 to 156 2021-07-26T16:02:58.087 INFO:tasks.rados.rados.0.smithi033.stdout:1638: rollback oid 16 current snap is 158 2021-07-26T16:02:58.087 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 16 to 155 2021-07-26T16:02:58.087 INFO:tasks.rados.rados.0.smithi033.stdout:1639: snap_create 2021-07-26T16:02:58.092 INFO:tasks.rados.rados.0.smithi033.stdout:1638: finishing rollback tid 0 to smithi03339061-16 2021-07-26T16:02:58.093 INFO:tasks.rados.rados.0.smithi033.stdout:1637: finishing rollback tid 0 to smithi03339061-10 2021-07-26T16:02:58.093 INFO:tasks.rados.rados.0.smithi033.stdout:1637: finishing rollback tid 1 to smithi03339061-10 2021-07-26T16:02:58.094 INFO:tasks.rados.rados.0.smithi033.stdout:1637: finishing rollback tid 2 to smithi03339061-10 2021-07-26T16:02:58.094 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 836 (ObjNum 469 snap 148 seq_num 469) dirty exists 2021-07-26T16:02:58.095 INFO:tasks.rados.rados.0.smithi033.stdout:1638: finishing rollback tid 1 to smithi03339061-16 2021-07-26T16:02:58.095 INFO:tasks.rados.rados.0.smithi033.stdout:1638: finishing rollback tid 2 to smithi03339061-16 2021-07-26T16:02:58.095 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 676 (ObjNum 442 snap 137 seq_num 442) dirty exists 2021-07-26T16:02:58.100 INFO:tasks.rados.rados.0.smithi033.stdout:1636: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:02:58.377 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:58 smithi033 bash[42377]: cluster 2021-07-26T16:02:57.051830+0000 mgr.y (mgr.34104) 262 : cluster [DBG] pgmap v384: 25 pgs: 25 active+clean; 243 MiB data, 797 MiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 5.6 MiB/s wr, 8 op/s 2021-07-26T16:02:58.378 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:58 smithi033 bash[41341]: cluster 2021-07-26T16:02:57.051830+0000 mgr.y (mgr.34104) 262 : cluster [DBG] pgmap v384: 25 pgs: 25 active+clean; 243 MiB data, 797 MiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 5.6 MiB/s wr, 8 op/s 2021-07-26T16:02:58.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:58 smithi096 bash[33981]: cluster 2021-07-26T16:02:57.051830+0000 mgr.y (mgr.34104) 262 : cluster [DBG] pgmap v384: 25 pgs: 25 active+clean; 243 MiB data, 797 MiB used, 714 GiB / 715 GiB avail; 4.9 MiB/s rd, 5.6 MiB/s wr, 8 op/s 2021-07-26T16:02:59.094 INFO:tasks.rados.rados.0.smithi033.stdout:1636: done (3 left) 2021-07-26T16:02:59.094 INFO:tasks.rados.rados.0.smithi033.stdout:1637: done (2 left) 2021-07-26T16:02:59.095 INFO:tasks.rados.rados.0.smithi033.stdout:1638: done (1 left) 2021-07-26T16:02:59.095 INFO:tasks.rados.rados.0.smithi033.stdout:1639: done (0 left) 2021-07-26T16:02:59.095 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 159 2021-07-26T16:02:59.095 INFO:tasks.rados.rados.0.smithi033.stdout:1640: seq_num 508 ranges {4243456=516096,4759552=524288,5283840=278528} 2021-07-26T16:02:59.126 INFO:tasks.rados.rados.0.smithi033.stdout:1640: writing smithi03339061-38 from 4243456 to 4759552 tid 1 2021-07-26T16:02:59.129 INFO:tasks.rados.rados.0.smithi033.stdout:1640: writing smithi03339061-38 from 4759552 to 5283840 tid 2 2021-07-26T16:02:59.132 INFO:tasks.rados.rados.0.smithi033.stdout:1640: writing smithi03339061-38 from 5283840 to 5562368 tid 3 2021-07-26T16:02:59.132 INFO:tasks.rados.rados.0.smithi033.stdout:1641: snap_create 2021-07-26T16:02:59.134 INFO:tasks.rados.rados.0.smithi033.stdout:1640: finishing write tid 1 to smithi03339061-38 2021-07-26T16:02:59.137 INFO:tasks.rados.rados.0.smithi033.stdout:1640: finishing write tid 2 to smithi03339061-38 2021-07-26T16:02:59.138 INFO:tasks.rados.rados.0.smithi033.stdout:1640: finishing write tid 3 to smithi03339061-38 2021-07-26T16:02:59.138 INFO:tasks.rados.rados.0.smithi033.stdout:1640: finishing write tid 4 to smithi03339061-38 2021-07-26T16:02:59.140 INFO:tasks.rados.rados.0.smithi033.stdout:1640: finishing write tid 5 to smithi03339061-38 2021-07-26T16:02:59.140 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 696 (ObjNum 508 snap 159 seq_num 508) dirty exists 2021-07-26T16:02:59.140 INFO:tasks.rados.rados.0.smithi033.stdout:1640: left oid 38 (ObjNum 508 snap 159 seq_num 508) 2021-07-26T16:02:59.391 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:02:59 smithi033 bash[41341]: cluster 2021-07-26T16:02:58.071316+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2021-07-26T16:02:59.392 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:02:59 smithi033 bash[42377]: cluster 2021-07-26T16:02:58.071316+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2021-07-26T16:02:59.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:02:59 smithi096 bash[33981]: cluster 2021-07-26T16:02:58.071316+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e384: 8 total, 8 up, 8 in 2021-07-26T16:03:00.103 INFO:tasks.rados.rados.0.smithi033.stdout:1640: done (1 left) 2021-07-26T16:03:00.103 INFO:tasks.rados.rados.0.smithi033.stdout:1641: done (0 left) 2021-07-26T16:03:00.103 INFO:tasks.rados.rados.0.smithi033.stdout:1642: setattr oid 29 current snap is 160 2021-07-26T16:03:00.104 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 160 2021-07-26T16:03:00.104 INFO:tasks.rados.rados.0.smithi033.stdout:1643: seq_num 509 ranges {4177920=532480,4710400=409600,5120000=393216} 2021-07-26T16:03:00.135 INFO:tasks.rados.rados.0.smithi033.stdout:1643: writing smithi03339061-31 from 4177920 to 4710400 tid 1 2021-07-26T16:03:00.137 INFO:tasks.rados.rados.0.smithi033.stdout:1643: writing smithi03339061-31 from 4710400 to 5120000 tid 2 2021-07-26T16:03:00.139 INFO:tasks.rados.rados.0.smithi033.stdout:1643: writing smithi03339061-31 from 5120000 to 5513216 tid 3 2021-07-26T16:03:00.141 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 160 2021-07-26T16:03:00.141 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 794 (ObjNum 498 snap 154 seq_num 498) dirty exists 2021-07-26T16:03:00.142 INFO:tasks.rados.rados.0.smithi033.stdout:1644: seq_num 510 ranges {9535488=548864,10084352=745472,10829824=57344} 2021-07-26T16:03:00.196 INFO:tasks.rados.rados.0.smithi033.stdout:1644: writing smithi03339061-46 from 9535488 to 10084352 tid 1 2021-07-26T16:03:00.200 INFO:tasks.rados.rados.0.smithi033.stdout:1644: writing smithi03339061-46 from 10084352 to 10829824 tid 2 2021-07-26T16:03:00.201 INFO:tasks.rados.rados.0.smithi033.stdout:1644: writing smithi03339061-46 from 10829824 to 10887168 tid 3 2021-07-26T16:03:00.202 INFO:tasks.rados.rados.0.smithi033.stdout:1642: done (2 left) 2021-07-26T16:03:00.202 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 160 2021-07-26T16:03:00.202 INFO:tasks.rados.rados.0.smithi033.stdout:1643: finishing write tid 1 to smithi03339061-31 2021-07-26T16:03:00.202 INFO:tasks.rados.rados.0.smithi033.stdout:1643: finishing write tid 2 to smithi03339061-31 2021-07-26T16:03:00.203 INFO:tasks.rados.rados.0.smithi033.stdout:1643: finishing write tid 3 to smithi03339061-31 2021-07-26T16:03:00.203 INFO:tasks.rados.rados.0.smithi033.stdout:1643: finishing write tid 4 to smithi03339061-31 2021-07-26T16:03:00.203 INFO:tasks.rados.rados.0.smithi033.stdout:1643: finishing write tid 5 to smithi03339061-31 2021-07-26T16:03:00.203 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 89 (ObjNum 509 snap 160 seq_num 509) dirty exists 2021-07-26T16:03:00.204 INFO:tasks.rados.rados.0.smithi033.stdout:1643: left oid 31 (ObjNum 509 snap 160 seq_num 509) 2021-07-26T16:03:00.204 INFO:tasks.rados.rados.0.smithi033.stdout:1645: seq_num 511 ranges {4833280=565248,5398528=630784,6029312=172032} 2021-07-26T16:03:00.231 INFO:tasks.rados.rados.0.smithi033.stdout:1645: writing smithi03339061-25 from 4833280 to 5398528 tid 1 2021-07-26T16:03:00.235 INFO:tasks.rados.rados.0.smithi033.stdout:1645: writing smithi03339061-25 from 5398528 to 6029312 tid 2 2021-07-26T16:03:00.236 INFO:tasks.rados.rados.0.smithi033.stdout:1645: writing smithi03339061-25 from 6029312 to 6201344 tid 3 2021-07-26T16:03:00.236 INFO:tasks.rados.rados.0.smithi033.stdout:1643: done (2 left) 2021-07-26T16:03:00.236 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 160 2021-07-26T16:03:00.237 INFO:tasks.rados.rados.0.smithi033.stdout:1644: finishing write tid 1 to smithi03339061-46 2021-07-26T16:03:00.237 INFO:tasks.rados.rados.0.smithi033.stdout:1646: seq_num 512 ranges {6627328=581632,7208960=516096,7725056=286720} 2021-07-26T16:03:00.277 INFO:tasks.rados.rados.0.smithi033.stdout:1646: writing smithi03339061-42 from 6627328 to 7208960 tid 1 2021-07-26T16:03:00.279 INFO:tasks.rados.rados.0.smithi033.stdout:1646: writing smithi03339061-42 from 7208960 to 7725056 tid 2 2021-07-26T16:03:00.281 INFO:tasks.rados.rados.0.smithi033.stdout:1646: writing smithi03339061-42 from 7725056 to 8011776 tid 3 2021-07-26T16:03:00.282 INFO:tasks.rados.rados.0.smithi033.stdout:1647: rmattr oid 18 current snap is 160 2021-07-26T16:03:00.282 INFO:tasks.rados.rados.0.smithi033.stdout:1644: finishing write tid 2 to smithi03339061-46 2021-07-26T16:03:00.282 INFO:tasks.rados.rados.0.smithi033.stdout:1644: finishing write tid 3 to smithi03339061-46 2021-07-26T16:03:00.282 INFO:tasks.rados.rados.0.smithi033.stdout:1644: finishing write tid 4 to smithi03339061-46 2021-07-26T16:03:00.283 INFO:tasks.rados.rados.0.smithi033.stdout:1644: finishing write tid 5 to smithi03339061-46 2021-07-26T16:03:00.283 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 798 (ObjNum 510 snap 160 seq_num 510) dirty exists 2021-07-26T16:03:00.283 INFO:tasks.rados.rados.0.smithi033.stdout:1644: left oid 46 (ObjNum 510 snap 160 seq_num 510) 2021-07-26T16:03:00.283 INFO:tasks.rados.rados.0.smithi033.stdout:1645: finishing write tid 1 to smithi03339061-25 2021-07-26T16:03:00.284 INFO:tasks.rados.rados.0.smithi033.stdout:1645: finishing write tid 2 to smithi03339061-25 2021-07-26T16:03:00.284 INFO:tasks.rados.rados.0.smithi033.stdout:1645: finishing write tid 3 to smithi03339061-25 2021-07-26T16:03:00.284 INFO:tasks.rados.rados.0.smithi033.stdout:1645: finishing write tid 4 to smithi03339061-25 2021-07-26T16:03:00.284 INFO:tasks.rados.rados.0.smithi033.stdout:1645: finishing write tid 5 to smithi03339061-25 2021-07-26T16:03:00.284 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 680 (ObjNum 511 snap 160 seq_num 511) dirty exists 2021-07-26T16:03:00.286 INFO:tasks.rados.rados.0.smithi033.stdout:1645: left oid 25 (ObjNum 511 snap 160 seq_num 511) 2021-07-26T16:03:00.286 INFO:tasks.rados.rados.0.smithi033.stdout:1644: done (3 left) 2021-07-26T16:03:00.286 INFO:tasks.rados.rados.0.smithi033.stdout:1645: done (2 left) 2021-07-26T16:03:00.287 INFO:tasks.rados.rados.0.smithi033.stdout:1648: setattr oid 39 current snap is 160 2021-07-26T16:03:00.287 INFO:tasks.rados.rados.0.smithi033.stdout:1649: rollback oid 4 current snap is 160 2021-07-26T16:03:00.288 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 4 to 159 2021-07-26T16:03:00.288 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 160 2021-07-26T16:03:00.288 INFO:tasks.rados.rados.0.smithi033.stdout:1650: seq_num 513 ranges {6627328=598016,7225344=794624,8019968=8192} 2021-07-26T16:03:00.325 INFO:tasks.rados.rados.0.smithi033.stdout:1650: writing smithi03339061-8 from 6627328 to 7225344 tid 1 2021-07-26T16:03:00.331 INFO:tasks.rados.rados.0.smithi033.stdout:1650: writing smithi03339061-8 from 7225344 to 8019968 tid 2 2021-07-26T16:03:00.331 INFO:tasks.rados.rados.0.smithi033.stdout:1650: writing smithi03339061-8 from 8019968 to 8028160 tid 3 2021-07-26T16:03:00.331 INFO:tasks.rados.rados.0.smithi033.stdout:1651: rollback oid 28 current snap is 160 2021-07-26T16:03:00.331 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 28 to 158 2021-07-26T16:03:00.332 INFO:tasks.rados.rados.0.smithi033.stdout:1649: finishing rollback tid 1 to smithi03339061-4 2021-07-26T16:03:00.332 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 0 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T16:03:00.332 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 885 (ObjNum 477 snap 149 seq_num 477) dirty exists 2021-07-26T16:03:00.332 INFO:tasks.rados.rados.0.smithi033.stdout:1646: finishing write tid 1 to smithi03339061-42 2021-07-26T16:03:00.333 INFO:tasks.rados.rados.0.smithi033.stdout:1647: done (5 left) 2021-07-26T16:03:00.333 INFO:tasks.rados.rados.0.smithi033.stdout:1649: done (4 left) 2021-07-26T16:03:00.333 INFO:tasks.rados.rados.0.smithi033.stdout:1652: copy_from oid 37 from oid 20 current snap is 160 2021-07-26T16:03:00.333 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 681 (ObjNum 448 snap 139 seq_num 448) dirty exists 2021-07-26T16:03:00.333 INFO:tasks.rados.rados.0.smithi033.stdout:1646: finishing write tid 2 to smithi03339061-42 2021-07-26T16:03:00.334 INFO:tasks.rados.rados.0.smithi033.stdout:1646: finishing write tid 3 to smithi03339061-42 2021-07-26T16:03:00.334 INFO:tasks.rados.rados.0.smithi033.stdout:1646: finishing write tid 4 to smithi03339061-42 2021-07-26T16:03:00.334 INFO:tasks.rados.rados.0.smithi033.stdout:1646: finishing write tid 5 to smithi03339061-42 2021-07-26T16:03:00.335 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 260 (ObjNum 512 snap 160 seq_num 512) dirty exists 2021-07-26T16:03:00.335 INFO:tasks.rados.rados.0.smithi033.stdout:1646: left oid 42 (ObjNum 512 snap 160 seq_num 512) 2021-07-26T16:03:00.336 INFO:tasks.rados.rados.0.smithi033.stdout:1646: done (4 left) 2021-07-26T16:03:00.336 INFO:tasks.rados.rados.0.smithi033.stdout:1648: done (3 left) 2021-07-26T16:03:00.336 INFO:tasks.rados.rados.0.smithi033.stdout:1653: delete oid 22 current snap is 160 2021-07-26T16:03:00.336 INFO:tasks.rados.rados.0.smithi033.stdout:1650: finishing write tid 1 to smithi03339061-8 2021-07-26T16:03:00.338 INFO:tasks.rados.rados.0.smithi033.stdout:1652: finishing copy_from to smithi03339061-37 2021-07-26T16:03:00.338 INFO:tasks.rados.rados.0.smithi033.stdout:1652: got expected ENOENT (src dne) 2021-07-26T16:03:00.338 INFO:tasks.rados.rados.0.smithi033.stdout:1652: finishing copy_from racing read to smithi03339061-37 2021-07-26T16:03:00.339 INFO:tasks.rados.rados.0.smithi033.stdout:1652: done (3 left) 2021-07-26T16:03:00.339 INFO:tasks.rados.rados.0.smithi033.stdout:1653: done (2 left) 2021-07-26T16:03:00.339 INFO:tasks.rados.rados.0.smithi033.stdout:1654: rmattr oid 45 current snap is 160 2021-07-26T16:03:00.339 INFO:tasks.rados.rados.0.smithi033.stdout:1655: copy_from oid 18 from oid 49 current snap is 160 2021-07-26T16:03:00.340 INFO:tasks.rados.rados.0.smithi033.stdout:1656: setattr oid 14 current snap is 160 2021-07-26T16:03:00.340 INFO:tasks.rados.rados.0.smithi033.stdout:1657: snap_create 2021-07-26T16:03:00.340 INFO:tasks.rados.rados.0.smithi033.stdout:1650: finishing write tid 2 to smithi03339061-8 2021-07-26T16:03:00.341 INFO:tasks.rados.rados.0.smithi033.stdout:1650: finishing write tid 3 to smithi03339061-8 2021-07-26T16:03:00.341 INFO:tasks.rados.rados.0.smithi033.stdout:1650: finishing write tid 4 to smithi03339061-8 2021-07-26T16:03:00.341 INFO:tasks.rados.rados.0.smithi033.stdout:1651: finishing rollback tid 0 to smithi03339061-28 2021-07-26T16:03:00.342 INFO:tasks.rados.rados.0.smithi033.stdout:1651: finishing rollback tid 1 to smithi03339061-28 2021-07-26T16:03:00.342 INFO:tasks.rados.rados.0.smithi033.stdout:1651: finishing rollback tid 2 to smithi03339061-28 2021-07-26T16:03:00.342 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 828 (ObjNum 489 snap 152 seq_num 489) dirty exists 2021-07-26T16:03:00.342 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 889 (ObjNum 503 snap 157 seq_num 503) dirty exists 2021-07-26T16:03:00.343 INFO:tasks.rados.rados.0.smithi033.stdout:1650: finishing write tid 5 to smithi03339061-8 2021-07-26T16:03:00.344 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 506 (ObjNum 513 snap 160 seq_num 513) dirty exists 2021-07-26T16:03:00.344 INFO:tasks.rados.rados.0.smithi033.stdout:1650: left oid 8 (ObjNum 513 snap 160 seq_num 513) 2021-07-26T16:03:00.344 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 662 (ObjNum 456 snap 142 seq_num 456) dirty exists 2021-07-26T16:03:00.368 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:00 smithi033 bash[42377]: cluster 2021-07-26T16:02:59.052747+0000 mgr.y (mgr.34104) 263 : cluster [DBG] pgmap v386: 25 pgs: 25 active+clean; 251 MiB data, 807 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 15 op/s 2021-07-26T16:03:00.369 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:00 smithi033 bash[42377]: cluster 2021-07-26T16:02:59.091456+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2021-07-26T16:03:00.369 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:00 smithi033 systemd[1]: Stopping Ceph alertmanager.a for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T16:03:00.370 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:00 smithi033 bash[41341]: cluster 2021-07-26T16:02:59.052747+0000 mgr.y (mgr.34104) 263 : cluster [DBG] pgmap v386: 25 pgs: 25 active+clean; 251 MiB data, 807 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 15 op/s 2021-07-26T16:03:00.370 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:00 smithi033 bash[41341]: cluster 2021-07-26T16:02:59.091456+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2021-07-26T16:03:00.383 INFO:tasks.rados.rados.0.smithi033.stdout:1655: finishing copy_from to smithi03339061-18 2021-07-26T16:03:00.383 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 526 (ObjNum 500 snap 154 seq_num 500) dirty exists 2021-07-26T16:03:00.385 INFO:tasks.rados.rados.0.smithi033.stdout:1655: finishing copy_from racing read to smithi03339061-18 2021-07-26T16:03:00.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:00 smithi096 bash[33981]: cluster 2021-07-26T16:02:59.052747+0000 mgr.y (mgr.34104) 263 : cluster [DBG] pgmap v386: 25 pgs: 25 active+clean; 251 MiB data, 807 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 15 op/s 2021-07-26T16:03:00.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:00 smithi096 bash[33981]: cluster 2021-07-26T16:02:59.091456+0000 mon.a (mon.0) 703 : cluster [DBG] osdmap e385: 8 total, 8 up, 8 in 2021-07-26T16:03:00.636 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:00 smithi033 docker[50456]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:03:00.636 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:00 smithi033 bash[32681]: level=info ts=2021-07-26T16:03:00.432Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2021-07-26T16:03:01.036 INFO:tasks.rados.rados.0.smithi033.stdout:1650: done (5 left) 2021-07-26T16:03:01.036 INFO:tasks.rados.rados.0.smithi033.stdout:1651: done (4 left) 2021-07-26T16:03:01.036 INFO:tasks.rados.rados.0.smithi033.stdout:1654: done (3 left) 2021-07-26T16:03:01.037 INFO:tasks.rados.rados.0.smithi033.stdout:1655: done (2 left) 2021-07-26T16:03:01.037 INFO:tasks.rados.rados.0.smithi033.stdout:1656: done (1 left) 2021-07-26T16:03:01.037 INFO:tasks.rados.rados.0.smithi033.stdout:1657: done (0 left) 2021-07-26T16:03:01.037 INFO:tasks.rados.rados.0.smithi033.stdout:1658: delete oid 24 current snap is 161 2021-07-26T16:03:01.041 INFO:tasks.rados.rados.0.smithi033.stdout:1658: done (0 left) 2021-07-26T16:03:01.042 INFO:tasks.rados.rados.0.smithi033.stdout:1659: rmattr oid 14 current snap is 161 2021-07-26T16:03:01.042 INFO:tasks.rados.rados.0.smithi033.stdout:1660: delete oid 7 current snap is 161 2021-07-26T16:03:01.047 INFO:tasks.rados.rados.0.smithi033.stdout:1660: done (1 left) 2021-07-26T16:03:01.047 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 161 2021-07-26T16:03:01.047 INFO:tasks.rados.rados.0.smithi033.stdout:1661: seq_num 517 ranges {11501568=663552,12165120=786432,12951552=16384} 2021-07-26T16:03:01.115 INFO:tasks.rados.rados.0.smithi033.stdout:1661: writing smithi03339061-29 from 11501568 to 12165120 tid 1 2021-07-26T16:03:01.119 INFO:tasks.rados.rados.0.smithi033.stdout:1661: writing smithi03339061-29 from 12165120 to 12951552 tid 2 2021-07-26T16:03:01.119 INFO:tasks.rados.rados.0.smithi033.stdout:1661: writing smithi03339061-29 from 12951552 to 12967936 tid 3 2021-07-26T16:03:01.120 INFO:tasks.rados.rados.0.smithi033.stdout:1662: snap_create 2021-07-26T16:03:01.120 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 663 (ObjNum 456 snap 142 seq_num 456) dirty exists 2021-07-26T16:03:01.130 INFO:tasks.rados.rados.0.smithi033.stdout:1661: finishing write tid 1 to smithi03339061-29 2021-07-26T16:03:01.130 INFO:tasks.rados.rados.0.smithi033.stdout:1661: finishing write tid 2 to smithi03339061-29 2021-07-26T16:03:01.130 INFO:tasks.rados.rados.0.smithi033.stdout:1661: finishing write tid 3 to smithi03339061-29 2021-07-26T16:03:01.130 INFO:tasks.rados.rados.0.smithi033.stdout:1661: finishing write tid 4 to smithi03339061-29 2021-07-26T16:03:01.132 INFO:tasks.rados.rados.0.smithi033.stdout:1661: finishing write tid 5 to smithi03339061-29 2021-07-26T16:03:01.134 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 802 (ObjNum 517 snap 161 seq_num 517) dirty exists 2021-07-26T16:03:01.134 INFO:tasks.rados.rados.0.smithi033.stdout:1661: left oid 29 (ObjNum 517 snap 161 seq_num 517) 2021-07-26T16:03:01.350 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:01 smithi033 bash[41341]: cluster 2021-07-26T16:03:00.099635+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2021-07-26T16:03:01.352 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:01 smithi033 bash[41341]: cluster 2021-07-26T16:03:01.032030+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2021-07-26T16:03:01.352 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:01 smithi033 bash[42377]: cluster 2021-07-26T16:03:00.099635+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2021-07-26T16:03:01.352 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:01 smithi033 bash[42377]: cluster 2021-07-26T16:03:01.032030+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2021-07-26T16:03:01.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:01 smithi096 bash[33981]: cluster 2021-07-26T16:03:00.099635+0000 mon.a (mon.0) 704 : cluster [DBG] osdmap e386: 8 total, 8 up, 8 in 2021-07-26T16:03:01.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:01 smithi096 bash[33981]: cluster 2021-07-26T16:03:01.032030+0000 mon.a (mon.0) 705 : cluster [DBG] osdmap e387: 8 total, 8 up, 8 in 2021-07-26T16:03:01.663 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:01 smithi033 docker[50456]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-alertmanager.a 2021-07-26T16:03:01.663 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:01 smithi033 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@alertmanager.a.service: Succeeded. 2021-07-26T16:03:01.664 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:01 smithi033 systemd[1]: Stopped Ceph alertmanager.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:03:01.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:01 smithi033 systemd[1]: Started Ceph alertmanager.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:03:01.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:01 smithi033 bash[50539]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:03:02.118 INFO:tasks.rados.rados.0.smithi033.stdout:1659: done (2 left) 2021-07-26T16:03:02.118 INFO:tasks.rados.rados.0.smithi033.stdout:1661: done (1 left) 2021-07-26T16:03:02.119 INFO:tasks.rados.rados.0.smithi033.stdout:1662: done (0 left) 2021-07-26T16:03:02.119 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 162 2021-07-26T16:03:02.119 INFO:tasks.rados.rados.0.smithi033.stdout:1663: seq_num 518 ranges {5521408=679936,6201344=671744,6873088=131072} 2021-07-26T16:03:02.157 INFO:tasks.rados.rados.0.smithi033.stdout:1663: writing smithi03339061-45 from 5521408 to 6201344 tid 1 2021-07-26T16:03:02.162 INFO:tasks.rados.rados.0.smithi033.stdout:1663: writing smithi03339061-45 from 6201344 to 6873088 tid 2 2021-07-26T16:03:02.163 INFO:tasks.rados.rados.0.smithi033.stdout:1663: writing smithi03339061-45 from 6873088 to 7004160 tid 3 2021-07-26T16:03:02.164 INFO:tasks.rados.rados.0.smithi033.stdout:1664: snap_remove snap 159 2021-07-26T16:03:02.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:02 smithi033 bash[42377]: cluster 2021-07-26T16:03:01.053389+0000 mgr.y (mgr.34104) 264 : cluster [DBG] pgmap v390: 25 pgs: 25 active+clean; 252 MiB data, 812 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2021-07-26T16:03:02.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:02 smithi033 bash[42377]: audit 2021-07-26T16:03:01.696066+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:02.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:02 smithi033 bash[42377]: audit 2021-07-26T16:03:01.697518+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:02.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:02 smithi033 bash[42377]: audit 2021-07-26T16:03:01.698853+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:02.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:02 smithi033 bash[42377]: audit 2021-07-26T16:03:01.699994+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:02.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:02 smithi033 bash[41341]: cluster 2021-07-26T16:03:01.053389+0000 mgr.y (mgr.34104) 264 : cluster [DBG] pgmap v390: 25 pgs: 25 active+clean; 252 MiB data, 812 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2021-07-26T16:03:02.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:02 smithi033 bash[41341]: audit 2021-07-26T16:03:01.696066+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:02.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:02 smithi033 bash[41341]: audit 2021-07-26T16:03:01.697518+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:02.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:02 smithi033 bash[41341]: audit 2021-07-26T16:03:01.698853+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:02.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:02 smithi033 bash[41341]: audit 2021-07-26T16:03:01.699994+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:02.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:02 smithi096 bash[33981]: cluster 2021-07-26T16:03:01.053389+0000 mgr.y (mgr.34104) 264 : cluster [DBG] pgmap v390: 25 pgs: 25 active+clean; 252 MiB data, 812 MiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.2 MiB/s wr, 11 op/s 2021-07-26T16:03:02.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:02 smithi096 bash[33981]: audit 2021-07-26T16:03:01.696066+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:02.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:02 smithi096 bash[33981]: audit 2021-07-26T16:03:01.697518+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:02.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:02 smithi096 bash[33981]: audit 2021-07-26T16:03:01.698853+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:02.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:02 smithi096 bash[33981]: audit 2021-07-26T16:03:01.699994+0000 mon.c (mon.1) 182 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:03.134 INFO:tasks.rados.rados.0.smithi033.stdout:1663: finishing write tid 1 to smithi03339061-45 2021-07-26T16:03:03.134 INFO:tasks.rados.rados.0.smithi033.stdout:1663: finishing write tid 2 to smithi03339061-45 2021-07-26T16:03:03.135 INFO:tasks.rados.rados.0.smithi033.stdout:1663: finishing write tid 3 to smithi03339061-45 2021-07-26T16:03:03.135 INFO:tasks.rados.rados.0.smithi033.stdout:1663: finishing write tid 4 to smithi03339061-45 2021-07-26T16:03:03.135 INFO:tasks.rados.rados.0.smithi033.stdout:1663: finishing write tid 5 to smithi03339061-45 2021-07-26T16:03:03.135 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 895 (ObjNum 518 snap 162 seq_num 518) dirty exists 2021-07-26T16:03:03.136 INFO:tasks.rados.rados.0.smithi033.stdout:1663: left oid 45 (ObjNum 518 snap 162 seq_num 518) 2021-07-26T16:03:03.136 INFO:tasks.rados.rados.0.smithi033.stdout:1663: done (1 left) 2021-07-26T16:03:03.136 INFO:tasks.rados.rados.0.smithi033.stdout:1664: done (0 left) 2021-07-26T16:03:03.136 INFO:tasks.rados.rados.0.smithi033.stdout:1665: copy_from oid 41 from oid 23 current snap is 162 2021-07-26T16:03:03.136 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 162 2021-07-26T16:03:03.137 INFO:tasks.rados.rados.0.smithi033.stdout:1666: seq_num 519 ranges {12943360=696320,13639680=548864,14188544=253952} 2021-07-26T16:03:03.212 INFO:tasks.rados.rados.0.smithi033.stdout:1666: writing smithi03339061-32 from 12943360 to 13639680 tid 1 2021-07-26T16:03:03.216 INFO:tasks.rados.rados.0.smithi033.stdout:1666: writing smithi03339061-32 from 13639680 to 14188544 tid 2 2021-07-26T16:03:03.217 INFO:tasks.rados.rados.0.smithi033.stdout:1666: writing smithi03339061-32 from 14188544 to 14442496 tid 3 2021-07-26T16:03:03.218 INFO:tasks.rados.rados.0.smithi033.stdout:1667: snap_remove snap 158 2021-07-26T16:03:03.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:03 smithi033 bash[41341]: cluster 2021-07-26T16:03:02.111920+0000 mon.a (mon.0) 707 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2021-07-26T16:03:03.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:03 smithi033 bash[42377]: cluster 2021-07-26T16:03:02.111920+0000 mon.a (mon.0) 707 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2021-07-26T16:03:03.460 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:03 smithi033 bash[50539]: level=info ts=2021-07-26T16:03:03.264Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-07-26T16:03:03.460 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:03 smithi033 bash[50539]: level=info ts=2021-07-26T16:03:03.264Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-07-26T16:03:03.461 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:03 smithi033 bash[50539]: level=info ts=2021-07-26T16:03:03.266Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.33 port=9094 2021-07-26T16:03:03.461 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:03 smithi033 bash[50539]: level=info ts=2021-07-26T16:03:03.269Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-07-26T16:03:03.461 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:03 smithi033 bash[50539]: level=info ts=2021-07-26T16:03:03.310Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-07-26T16:03:03.462 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:03 smithi033 bash[50539]: level=info ts=2021-07-26T16:03:03.310Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-07-26T16:03:03.462 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:03 smithi033 bash[50539]: level=info ts=2021-07-26T16:03:03.314Z caller=main.go:497 msg=Listening address=:9093 2021-07-26T16:03:03.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:03 smithi096 bash[33981]: cluster 2021-07-26T16:03:02.111920+0000 mon.a (mon.0) 707 : cluster [DBG] osdmap e388: 8 total, 8 up, 8 in 2021-07-26T16:03:04.151 INFO:tasks.rados.rados.0.smithi033.stdout:1665: finishing copy_from to smithi03339061-41 2021-07-26T16:03:04.151 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 621 (ObjNum 451 snap 139 seq_num 451) dirty exists 2021-07-26T16:03:04.152 INFO:tasks.rados.rados.0.smithi033.stdout:1665: finishing copy_from racing read to smithi03339061-41 2021-07-26T16:03:04.152 INFO:tasks.rados.rados.0.smithi033.stdout:1666: finishing write tid 1 to smithi03339061-32 2021-07-26T16:03:04.152 INFO:tasks.rados.rados.0.smithi033.stdout:1666: finishing write tid 2 to smithi03339061-32 2021-07-26T16:03:04.152 INFO:tasks.rados.rados.0.smithi033.stdout:1666: finishing write tid 3 to smithi03339061-32 2021-07-26T16:03:04.153 INFO:tasks.rados.rados.0.smithi033.stdout:1666: finishing write tid 4 to smithi03339061-32 2021-07-26T16:03:04.153 INFO:tasks.rados.rados.0.smithi033.stdout:1666: finishing write tid 5 to smithi03339061-32 2021-07-26T16:03:04.153 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 684 (ObjNum 519 snap 162 seq_num 519) dirty exists 2021-07-26T16:03:04.153 INFO:tasks.rados.rados.0.smithi033.stdout:1666: left oid 32 (ObjNum 519 snap 162 seq_num 519) 2021-07-26T16:03:04.153 INFO:tasks.rados.rados.0.smithi033.stdout:1665: done (2 left) 2021-07-26T16:03:04.154 INFO:tasks.rados.rados.0.smithi033.stdout:1666: done (1 left) 2021-07-26T16:03:04.154 INFO:tasks.rados.rados.0.smithi033.stdout:1667: done (0 left) 2021-07-26T16:03:04.154 INFO:tasks.rados.rados.0.smithi033.stdout:1668: delete oid 8 current snap is 162 2021-07-26T16:03:04.163 INFO:tasks.rados.rados.0.smithi033.stdout:1668: done (0 left) 2021-07-26T16:03:04.163 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 162 2021-07-26T16:03:04.163 INFO:tasks.rados.rados.0.smithi033.stdout:1669: seq_num 521 ranges {958464=729088,1687552=720896,2408448=81920} 2021-07-26T16:03:04.171 INFO:tasks.rados.rados.0.smithi033.stdout:1669: writing smithi03339061-23 from 958464 to 1687552 tid 1 2021-07-26T16:03:04.178 INFO:tasks.rados.rados.0.smithi033.stdout:1669: writing smithi03339061-23 from 1687552 to 2408448 tid 2 2021-07-26T16:03:04.178 INFO:tasks.rados.rados.0.smithi033.stdout:1669: writing smithi03339061-23 from 2408448 to 2490368 tid 3 2021-07-26T16:03:04.179 INFO:tasks.rados.rados.0.smithi033.stdout:1670: snap_create 2021-07-26T16:03:04.179 INFO:tasks.rados.rados.0.smithi033.stdout:1669: finishing write tid 1 to smithi03339061-23 2021-07-26T16:03:04.180 INFO:tasks.rados.rados.0.smithi033.stdout:1669: finishing write tid 2 to smithi03339061-23 2021-07-26T16:03:04.180 INFO:tasks.rados.rados.0.smithi033.stdout:1669: finishing write tid 3 to smithi03339061-23 2021-07-26T16:03:04.181 INFO:tasks.rados.rados.0.smithi033.stdout:1669: finishing write tid 4 to smithi03339061-23 2021-07-26T16:03:04.182 INFO:tasks.rados.rados.0.smithi033.stdout:1669: finishing write tid 5 to smithi03339061-23 2021-07-26T16:03:04.182 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 696 (ObjNum 521 snap 162 seq_num 521) dirty exists 2021-07-26T16:03:04.183 INFO:tasks.rados.rados.0.smithi033.stdout:1669: left oid 23 (ObjNum 521 snap 162 seq_num 521) 2021-07-26T16:03:04.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:04 smithi033 bash[41341]: cluster 2021-07-26T16:03:03.054062+0000 mgr.y (mgr.34104) 265 : cluster [DBG] pgmap v392: 25 pgs: 25 active+clean; 265 MiB data, 825 MiB used, 714 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 17 op/s 2021-07-26T16:03:04.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:04 smithi033 bash[41341]: cluster 2021-07-26T16:03:03.130208+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2021-07-26T16:03:04.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:04 smithi033 bash[42377]: cluster 2021-07-26T16:03:03.054062+0000 mgr.y (mgr.34104) 265 : cluster [DBG] pgmap v392: 25 pgs: 25 active+clean; 265 MiB data, 825 MiB used, 714 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 17 op/s 2021-07-26T16:03:04.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:04 smithi033 bash[42377]: cluster 2021-07-26T16:03:03.130208+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2021-07-26T16:03:04.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:04 smithi096 bash[33981]: cluster 2021-07-26T16:03:03.054062+0000 mgr.y (mgr.34104) 265 : cluster [DBG] pgmap v392: 25 pgs: 25 active+clean; 265 MiB data, 825 MiB used, 714 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 17 op/s 2021-07-26T16:03:04.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:04 smithi096 bash[33981]: cluster 2021-07-26T16:03:03.130208+0000 mon.a (mon.0) 708 : cluster [DBG] osdmap e389: 8 total, 8 up, 8 in 2021-07-26T16:03:05.155 INFO:tasks.rados.rados.0.smithi033.stdout:1669: done (1 left) 2021-07-26T16:03:05.155 INFO:tasks.rados.rados.0.smithi033.stdout:1670: done (0 left) 2021-07-26T16:03:05.155 INFO:tasks.rados.rados.0.smithi033.stdout:1671: read oid 33 snap -1 2021-07-26T16:03:05.156 INFO:tasks.rados.rados.0.smithi033.stdout:1671: expect (ObjNum 478 snap 149 seq_num 478) 2021-07-26T16:03:05.156 INFO:tasks.rados.rados.0.smithi033.stdout:1672: read oid 6 snap -1 2021-07-26T16:03:05.156 INFO:tasks.rados.rados.0.smithi033.stdout:1672: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:03:05.156 INFO:tasks.rados.rados.0.smithi033.stdout:1673: delete oid 48 current snap is 163 2021-07-26T16:03:05.161 INFO:tasks.rados.rados.0.smithi033.stdout:1671: expect (ObjNum 478 snap 149 seq_num 478) 2021-07-26T16:03:05.186 INFO:tasks.rados.rados.0.smithi033.stdout:1672: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:03:05.367 INFO:tasks.rados.rados.0.smithi033.stdout:1671: done (2 left) 2021-07-26T16:03:05.367 INFO:tasks.rados.rados.0.smithi033.stdout:1672: done (1 left) 2021-07-26T16:03:05.368 INFO:tasks.rados.rados.0.smithi033.stdout:1673: done (0 left) 2021-07-26T16:03:05.368 INFO:tasks.rados.rados.0.smithi033.stdout:1674: read oid 37 snap -1 2021-07-26T16:03:05.368 INFO:tasks.rados.rados.0.smithi033.stdout:1674: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:03:05.368 INFO:tasks.rados.rados.0.smithi033.stdout:1675: copy_from oid 11 from oid 23 current snap is 163 2021-07-26T16:03:05.369 INFO:tasks.rados.rados.0.smithi033.stdout:1676: rollback oid 39 current snap is 163 2021-07-26T16:03:05.369 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 39 to 162 2021-07-26T16:03:05.369 INFO:tasks.rados.rados.0.smithi033.stdout:1677: read oid 18 snap -1 2021-07-26T16:03:05.369 INFO:tasks.rados.rados.0.smithi033.stdout:1677: expect (ObjNum 500 snap 154 seq_num 500) 2021-07-26T16:03:05.369 INFO:tasks.rados.rados.0.smithi033.stdout:1678: read oid 34 snap -1 2021-07-26T16:03:05.370 INFO:tasks.rados.rados.0.smithi033.stdout:1678: expect (ObjNum 478 snap 149 seq_num 478) 2021-07-26T16:03:05.370 INFO:tasks.rados.rados.0.smithi033.stdout:1679: read oid 24 snap 160 2021-07-26T16:03:05.370 INFO:tasks.rados.rados.0.smithi033.stdout:1679: expect (ObjNum 501 snap 155 seq_num 501) 2021-07-26T16:03:05.371 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 163 2021-07-26T16:03:05.372 INFO:tasks.rados.rados.0.smithi033.stdout:1680: seq_num 523 ranges {4530176=770048,5300224=491520,5791744=311296} 2021-07-26T16:03:05.403 INFO:tasks.rados.rados.0.smithi033.stdout:1680: writing smithi03339061-6 from 4530176 to 5300224 tid 1 2021-07-26T16:03:05.405 INFO:tasks.rados.rados.0.smithi033.stdout:1680: writing smithi03339061-6 from 5300224 to 5791744 tid 2 2021-07-26T16:03:05.407 INFO:tasks.rados.rados.0.smithi033.stdout:1680: writing smithi03339061-6 from 5791744 to 6103040 tid 3 2021-07-26T16:03:05.407 INFO:tasks.rados.rados.0.smithi033.stdout:1681: copy_from oid 15 from oid 21 current snap is 163 2021-07-26T16:03:05.407 INFO:tasks.rados.rados.0.smithi033.stdout:1676: finishing rollback tid 0 to smithi03339061-39 2021-07-26T16:03:05.407 INFO:tasks.rados.rados.0.smithi033.stdout:1676: finishing rollback tid 1 to smithi03339061-39 2021-07-26T16:03:05.408 INFO:tasks.rados.rados.0.smithi033.stdout:1678: expect (ObjNum 478 snap 149 seq_num 478) 2021-07-26T16:03:05.434 INFO:tasks.rados.rados.0.smithi033.stdout:1676: finishing rollback tid 2 to smithi03339061-39 2021-07-26T16:03:05.435 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 700 (ObjNum 448 snap 139 seq_num 448) dirty exists 2021-07-26T16:03:05.435 INFO:tasks.rados.rados.0.smithi033.stdout:1676: done (7 left) 2021-07-26T16:03:05.435 INFO:tasks.rados.rados.0.smithi033.stdout:1678: done (6 left) 2021-07-26T16:03:05.435 INFO:tasks.rados.rados.0.smithi033.stdout:1682: read oid 17 snap 156 2021-07-26T16:03:05.436 INFO:tasks.rados.rados.0.smithi033.stdout:1682: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:03:05.436 INFO:tasks.rados.rados.0.smithi033.stdout:1683: snap_remove snap 155 2021-07-26T16:03:05.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:05 smithi033 bash[41341]: cluster 2021-07-26T16:03:04.145048+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2021-07-26T16:03:05.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:05 smithi033 bash[42377]: cluster 2021-07-26T16:03:04.145048+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2021-07-26T16:03:05.460 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:05 smithi033 bash[50539]: level=info ts=2021-07-26T16:03:05.270Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000131584s 2021-07-26T16:03:05.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:05 smithi096 bash[33981]: cluster 2021-07-26T16:03:04.145048+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e390: 8 total, 8 up, 8 in 2021-07-26T16:03:06.162 INFO:tasks.rados.rados.0.smithi033.stdout:1683: done (7 left) 2021-07-26T16:03:06.162 INFO:tasks.rados.rados.0.smithi033.stdout:1684: read oid 10 snap 162 2021-07-26T16:03:06.163 INFO:tasks.rados.rados.0.smithi033.stdout:1684: expect (ObjNum 469 snap 148 seq_num 469) 2021-07-26T16:03:06.163 INFO:tasks.rados.rados.0.smithi033.stdout:1685: read oid 30 snap 152 2021-07-26T16:03:06.163 INFO:tasks.rados.rados.0.smithi033.stdout:1685: expect (ObjNum 394 snap 120 seq_num 394) 2021-07-26T16:03:06.164 INFO:tasks.rados.rados.0.smithi033.stdout:1686: copy_from oid 12 from oid 48 current snap is 163 2021-07-26T16:03:06.164 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 163 2021-07-26T16:03:06.164 INFO:tasks.rados.rados.0.smithi033.stdout:1687: seq_num 524 ranges {0=786432,786432=778240,1564672=24576} 2021-07-26T16:03:06.170 INFO:tasks.rados.rados.0.smithi033.stdout:1687: writing smithi03339061-43 from 0 to 786432 tid 1 2021-07-26T16:03:06.176 INFO:tasks.rados.rados.0.smithi033.stdout:1687: writing smithi03339061-43 from 786432 to 1564672 tid 2 2021-07-26T16:03:06.177 INFO:tasks.rados.rados.0.smithi033.stdout:1687: writing smithi03339061-43 from 1564672 to 1589248 tid 3 2021-07-26T16:03:06.177 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 163 2021-07-26T16:03:06.177 INFO:tasks.rados.rados.0.smithi033.stdout:1688: seq_num 525 ranges {811008=802816,1613824=712704,2326528=90112} 2021-07-26T16:03:06.185 INFO:tasks.rados.rados.0.smithi033.stdout:1688: writing smithi03339061-33 from 811008 to 1613824 tid 1 2021-07-26T16:03:06.190 INFO:tasks.rados.rados.0.smithi033.stdout:1688: writing smithi03339061-33 from 1613824 to 2326528 tid 2 2021-07-26T16:03:06.191 INFO:tasks.rados.rados.0.smithi033.stdout:1688: writing smithi03339061-33 from 2326528 to 2416640 tid 3 2021-07-26T16:03:06.191 INFO:tasks.rados.rados.0.smithi033.stdout:1674: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:03:06.399 INFO:tasks.rados.rados.0.smithi033.stdout:1677: expect (ObjNum 500 snap 154 seq_num 500) 2021-07-26T16:03:06.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:06 smithi033 bash[41341]: cluster 2021-07-26T16:03:05.054819+0000 mgr.y (mgr.34104) 266 : cluster [DBG] pgmap v395: 25 pgs: 25 active+clean; 270 MiB data, 836 MiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 26 op/s 2021-07-26T16:03:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:06 smithi033 bash[41341]: cluster 2021-07-26T16:03:05.151967+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2021-07-26T16:03:06.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:06 smithi033 bash[42377]: cluster 2021-07-26T16:03:05.054819+0000 mgr.y (mgr.34104) 266 : cluster [DBG] pgmap v395: 25 pgs: 25 active+clean; 270 MiB data, 836 MiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 26 op/s 2021-07-26T16:03:06.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:06 smithi033 bash[42377]: cluster 2021-07-26T16:03:05.151967+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2021-07-26T16:03:06.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:06 smithi096 bash[33981]: cluster 2021-07-26T16:03:05.054819+0000 mgr.y (mgr.34104) 266 : cluster [DBG] pgmap v395: 25 pgs: 25 active+clean; 270 MiB data, 836 MiB used, 714 GiB / 715 GiB avail; 1.9 MiB/s rd, 4.4 MiB/s wr, 26 op/s 2021-07-26T16:03:06.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:06 smithi096 bash[33981]: cluster 2021-07-26T16:03:05.151967+0000 mon.a (mon.0) 710 : cluster [DBG] osdmap e391: 8 total, 8 up, 8 in 2021-07-26T16:03:06.946 INFO:tasks.rados.rados.0.smithi033.stdout:1679: expect (ObjNum 501 snap 155 seq_num 501) 2021-07-26T16:03:07.262 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: cluster 2021-07-26T16:03:06.155046+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2021-07-26T16:03:07.262 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.675479+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:07.265 INFO:tasks.rados.rados.0.smithi033.stdout:1680: finishing write tid 1 to smithi03339061-6 2021-07-26T16:03:07.265 INFO:tasks.rados.rados.0.smithi033.stdout:1680: finishing write tid 2 to smithi03339061-6 2021-07-26T16:03:07.265 INFO:tasks.rados.rados.0.smithi033.stdout:1680: finishing write tid 3 to smithi03339061-6 2021-07-26T16:03:07.265 INFO:tasks.rados.rados.0.smithi033.stdout:1680: finishing write tid 4 to smithi03339061-6 2021-07-26T16:03:07.266 INFO:tasks.rados.rados.0.smithi033.stdout:1680: finishing write tid 5 to smithi03339061-6 2021-07-26T16:03:07.266 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 912 (ObjNum 523 snap 163 seq_num 523) dirty exists 2021-07-26T16:03:07.266 INFO:tasks.rados.rados.0.smithi033.stdout:1680: left oid 6 (ObjNum 523 snap 163 seq_num 523) 2021-07-26T16:03:07.267 INFO:tasks.rados.rados.0.smithi033.stdout:1675: finishing copy_from to smithi03339061-11 2021-07-26T16:03:07.267 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 696 (ObjNum 521 snap 162 seq_num 521) dirty exists 2021-07-26T16:03:07.267 INFO:tasks.rados.rados.0.smithi033.stdout:1674: done (11 left) 2021-07-26T16:03:07.267 INFO:tasks.rados.rados.0.smithi033.stdout:1677: done (10 left) 2021-07-26T16:03:07.268 INFO:tasks.rados.rados.0.smithi033.stdout:1679: done (9 left) 2021-07-26T16:03:07.268 INFO:tasks.rados.rados.0.smithi033.stdout:1680: done (8 left) 2021-07-26T16:03:07.268 INFO:tasks.rados.rados.0.smithi033.stdout:1689: copy_from oid 16 from oid 46 current snap is 163 2021-07-26T16:03:07.268 INFO:tasks.rados.rados.0.smithi033.stdout:1675: finishing copy_from racing read to smithi03339061-11 2021-07-26T16:03:07.269 INFO:tasks.rados.rados.0.smithi033.stdout:1682: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:03:07.444 INFO:tasks.rados.rados.0.smithi033.stdout:1681: finishing copy_from to smithi03339061-15 2021-07-26T16:03:07.444 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 640 (ObjNum 418 snap 131 seq_num 418) dirty exists 2021-07-26T16:03:07.444 INFO:tasks.rados.rados.0.smithi033.stdout:1681: finishing copy_from racing read to smithi03339061-15 2021-07-26T16:03:07.445 INFO:tasks.rados.rados.0.smithi033.stdout:1684: expect (ObjNum 469 snap 148 seq_num 469) 2021-07-26T16:03:07.457 INFO:tasks.rados.rados.0.smithi033.stdout:1687: finishing write tid 1 to smithi03339061-43 2021-07-26T16:03:07.458 INFO:tasks.rados.rados.0.smithi033.stdout:1686: finishing copy_from to smithi03339061-12 2021-07-26T16:03:07.458 INFO:tasks.rados.rados.0.smithi033.stdout:1686: got expected ENOENT (src dne) 2021-07-26T16:03:07.458 INFO:tasks.rados.rados.0.smithi033.stdout:1686: finishing copy_from racing read to smithi03339061-12 2021-07-26T16:03:07.459 INFO:tasks.rados.rados.0.smithi033.stdout:1687: finishing write tid 2 to smithi03339061-43 2021-07-26T16:03:07.459 INFO:tasks.rados.rados.0.smithi033.stdout:1687: finishing write tid 3 to smithi03339061-43 2021-07-26T16:03:07.459 INFO:tasks.rados.rados.0.smithi033.stdout:1687: finishing write tid 4 to smithi03339061-43 2021-07-26T16:03:07.459 INFO:tasks.rados.rados.0.smithi033.stdout:1687: finishing write tid 5 to smithi03339061-43 2021-07-26T16:03:07.459 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 798 (ObjNum 524 snap 163 seq_num 524) dirty exists 2021-07-26T16:03:07.460 INFO:tasks.rados.rados.0.smithi033.stdout:1687: left oid 43 (ObjNum 524 snap 163 seq_num 524) 2021-07-26T16:03:07.460 INFO:tasks.rados.rados.0.smithi033.stdout:1688: finishing write tid 1 to smithi03339061-33 2021-07-26T16:03:07.460 INFO:tasks.rados.rados.0.smithi033.stdout:1675: done (8 left) 2021-07-26T16:03:07.460 INFO:tasks.rados.rados.0.smithi033.stdout:1681: done (7 left) 2021-07-26T16:03:07.461 INFO:tasks.rados.rados.0.smithi033.stdout:1682: done (6 left) 2021-07-26T16:03:07.461 INFO:tasks.rados.rados.0.smithi033.stdout:1684: done (5 left) 2021-07-26T16:03:07.461 INFO:tasks.rados.rados.0.smithi033.stdout:1686: done (4 left) 2021-07-26T16:03:07.461 INFO:tasks.rados.rados.0.smithi033.stdout:1687: done (3 left) 2021-07-26T16:03:07.462 INFO:tasks.rados.rados.0.smithi033.stdout:1690: delete oid 49 current snap is 163 2021-07-26T16:03:07.462 INFO:tasks.rados.rados.0.smithi033.stdout:1688: finishing write tid 2 to smithi03339061-33 2021-07-26T16:03:07.462 INFO:tasks.rados.rados.0.smithi033.stdout:1688: finishing write tid 3 to smithi03339061-33 2021-07-26T16:03:07.462 INFO:tasks.rados.rados.0.smithi033.stdout:1688: finishing write tid 4 to smithi03339061-33 2021-07-26T16:03:07.463 INFO:tasks.rados.rados.0.smithi033.stdout:1688: finishing write tid 5 to smithi03339061-33 2021-07-26T16:03:07.463 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 917 (ObjNum 525 snap 163 seq_num 525) dirty exists 2021-07-26T16:03:07.463 INFO:tasks.rados.rados.0.smithi033.stdout:1688: left oid 33 (ObjNum 525 snap 163 seq_num 525) 2021-07-26T16:03:07.463 INFO:tasks.rados.rados.0.smithi033.stdout:1685: expect (ObjNum 394 snap 120 seq_num 394) 2021-07-26T16:03:07.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: cluster 2021-07-26T16:03:06.155046+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2021-07-26T16:03:07.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.675479+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:07.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.684799+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:07.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.697196+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T16:03:07.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.699875+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:07.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.701713+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.703423+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.704830+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.706781+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.708675+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.709877+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.711056+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.712275+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.713416+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.714706+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.474 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.716181+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.474 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.717634+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.474 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[41341]: audit 2021-07-26T16:03:06.719192+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: cluster 2021-07-26T16:03:06.155046+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e392: 8 total, 8 up, 8 in 2021-07-26T16:03:07.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.675479+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:07.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.684799+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:07.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.697196+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T16:03:07.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.699875+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:07.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.701713+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.703423+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.704830+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.706781+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.708675+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.709877+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.711056+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.712275+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.713416+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.478 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.714706+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.478 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.716181+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.478 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.717634+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.478 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:07 smithi033 bash[42377]: audit 2021-07-26T16:03:06.719192+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.743 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.684799+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:07.745 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.697196+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T16:03:07.745 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.699875+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:07.745 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.701713+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.745 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.703423+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.746 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.704830+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.746 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.706781+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.746 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.708675+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.746 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.709877+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.746 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.711056+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.747 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.712275+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.747 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.713416+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.747 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.714706+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.748 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.716181+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.748 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.717634+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:07.749 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:07 smithi096 bash[33981]: audit 2021-07-26T16:03:06.719192+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:08.425 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:08 smithi096 bash[33981]: audit 2021-07-26T16:03:06.697709+0000 mgr.y (mgr.34104) 267 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T16:03:08.425 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:08 smithi096 bash[33981]: cluster 2021-07-26T16:03:07.055451+0000 mgr.y (mgr.34104) 268 : cluster [DBG] pgmap v398: 25 pgs: 25 active+clean; 281 MiB data, 870 MiB used, 714 GiB / 715 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 22 op/s 2021-07-26T16:03:08.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:08 smithi033 bash[42377]: audit 2021-07-26T16:03:06.697709+0000 mgr.y (mgr.34104) 267 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T16:03:08.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:08 smithi033 bash[42377]: cluster 2021-07-26T16:03:07.055451+0000 mgr.y (mgr.34104) 268 : cluster [DBG] pgmap v398: 25 pgs: 25 active+clean; 281 MiB data, 870 MiB used, 714 GiB / 715 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 22 op/s 2021-07-26T16:03:08.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:08 smithi033 bash[41341]: audit 2021-07-26T16:03:06.697709+0000 mgr.y (mgr.34104) 267 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-07-26T16:03:08.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:08 smithi033 bash[41341]: cluster 2021-07-26T16:03:07.055451+0000 mgr.y (mgr.34104) 268 : cluster [DBG] pgmap v398: 25 pgs: 25 active+clean; 281 MiB data, 870 MiB used, 714 GiB / 715 GiB avail; 2.0 MiB/s rd, 4.0 MiB/s wr, 22 op/s 2021-07-26T16:03:09.010 INFO:tasks.rados.rados.0.smithi033.stdout:1689: finishing copy_from to smithi03339061-16 2021-07-26T16:03:09.010 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 798 (ObjNum 510 snap 160 seq_num 510) dirty exists 2021-07-26T16:03:09.010 INFO:tasks.rados.rados.0.smithi033.stdout:1689: finishing copy_from racing read to smithi03339061-16 2021-07-26T16:03:09.011 INFO:tasks.rados.rados.0.smithi033.stdout:1685: done (3 left) 2021-07-26T16:03:09.015 INFO:tasks.rados.rados.0.smithi033.stdout:1688: done (2 left) 2021-07-26T16:03:09.015 INFO:tasks.rados.rados.0.smithi033.stdout:1689: done (1 left) 2021-07-26T16:03:09.016 INFO:tasks.rados.rados.0.smithi033.stdout:1690: done (0 left) 2021-07-26T16:03:09.016 INFO:tasks.rados.rados.0.smithi033.stdout:1691: read oid 17 snap 160 2021-07-26T16:03:09.016 INFO:tasks.rados.rados.0.smithi033.stdout:1691: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:03:09.016 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 163 2021-07-26T16:03:09.016 INFO:tasks.rados.rados.0.smithi033.stdout:1692: seq_num 527 ranges {5562368=434176,5996544=475136,6471680=565248,7036928=163840} 2021-07-26T16:03:09.057 INFO:tasks.rados.rados.0.smithi033.stdout:1692: writing smithi03339061-38 from 5562368 to 5996544 tid 1 2021-07-26T16:03:09.060 INFO:tasks.rados.rados.0.smithi033.stdout:1692: writing smithi03339061-38 from 5996544 to 6471680 tid 2 2021-07-26T16:03:09.063 INFO:tasks.rados.rados.0.smithi033.stdout:1692: writing smithi03339061-38 from 6471680 to 7036928 tid 3 2021-07-26T16:03:09.064 INFO:tasks.rados.rados.0.smithi033.stdout:1692: writing smithi03339061-38 from 7036928 to 7200768 tid 4 2021-07-26T16:03:09.065 INFO:tasks.rados.rados.0.smithi033.stdout:1693: delete oid 46 current snap is 163 2021-07-26T16:03:09.065 INFO:tasks.rados.rados.0.smithi033.stdout:1691: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:03:09.263 INFO:tasks.rados.rados.0.smithi033.stdout:1692: finishing write tid 1 to smithi03339061-38 2021-07-26T16:03:09.264 INFO:tasks.rados.rados.0.smithi033.stdout:1692: finishing write tid 2 to smithi03339061-38 2021-07-26T16:03:09.264 INFO:tasks.rados.rados.0.smithi033.stdout:1692: finishing write tid 3 to smithi03339061-38 2021-07-26T16:03:09.264 INFO:tasks.rados.rados.0.smithi033.stdout:1692: finishing write tid 4 to smithi03339061-38 2021-07-26T16:03:09.264 INFO:tasks.rados.rados.0.smithi033.stdout:1692: finishing write tid 5 to smithi03339061-38 2021-07-26T16:03:09.265 INFO:tasks.rados.rados.0.smithi033.stdout:1692: finishing write tid 6 to smithi03339061-38 2021-07-26T16:03:09.265 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 701 (ObjNum 527 snap 163 seq_num 527) dirty exists 2021-07-26T16:03:09.265 INFO:tasks.rados.rados.0.smithi033.stdout:1692: left oid 38 (ObjNum 527 snap 163 seq_num 527) 2021-07-26T16:03:09.265 INFO:tasks.rados.rados.0.smithi033.stdout:1691: done (2 left) 2021-07-26T16:03:09.265 INFO:tasks.rados.rados.0.smithi033.stdout:1692: done (1 left) 2021-07-26T16:03:09.266 INFO:tasks.rados.rados.0.smithi033.stdout:1693: done (0 left) 2021-07-26T16:03:09.266 INFO:tasks.rados.rados.0.smithi033.stdout:1694: delete oid 48 current snap is 163 2021-07-26T16:03:09.266 INFO:tasks.rados.rados.0.smithi033.stdout:1694: done (0 left) 2021-07-26T16:03:09.267 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 163 2021-07-26T16:03:09.267 INFO:tasks.rados.rados.0.smithi033.stdout:1695: seq_num 530 ranges {3702784=483328,4186112=532480,4718592=671744} 2021-07-26T16:03:09.297 INFO:tasks.rados.rados.0.smithi033.stdout:1695: writing smithi03339061-9 from 3702784 to 4186112 tid 1 2021-07-26T16:03:09.300 INFO:tasks.rados.rados.0.smithi033.stdout:1695: writing smithi03339061-9 from 4186112 to 4718592 tid 2 2021-07-26T16:03:09.304 INFO:tasks.rados.rados.0.smithi033.stdout:1695: writing smithi03339061-9 from 4718592 to 5390336 tid 3 2021-07-26T16:03:09.305 INFO:tasks.rados.rados.0.smithi033.stdout:1696: snap_remove snap 153 2021-07-26T16:03:10.186 INFO:tasks.rados.rados.0.smithi033.stdout:1696: done (1 left) 2021-07-26T16:03:10.186 INFO:tasks.rados.rados.0.smithi033.stdout:1697: snap_remove snap 157 2021-07-26T16:03:10.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[42377]: cluster 2021-07-26T16:03:09.056256+0000 mgr.y (mgr.34104) 269 : cluster [DBG] pgmap v399: 25 pgs: 25 active+clean; 285 MiB data, 886 MiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 3.4 MiB/s wr, 22 op/s 2021-07-26T16:03:10.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[42377]: cephadm 2021-07-26T16:03:09.093914+0000 mgr.y (mgr.34104) 270 : cephadm [INF] Upgrade: Updating grafana.a 2021-07-26T16:03:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[42377]: cephadm 2021-07-26T16:03:09.133933+0000 mgr.y (mgr.34104) 271 : cephadm [INF] Deploying daemon grafana.a on smithi096 2021-07-26T16:03:10.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[42377]: audit 2021-07-26T16:03:09.218480+0000 mon.c (mon.1) 198 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:03:10.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[42377]: audit 2021-07-26T16:03:09.219193+0000 mon.c (mon.1) 199 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:03:10.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[42377]: audit 2021-07-26T16:03:09.219239+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:03:10.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[42377]: audit 2021-07-26T16:03:09.219856+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:03:10.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[41341]: cluster 2021-07-26T16:03:09.056256+0000 mgr.y (mgr.34104) 269 : cluster [DBG] pgmap v399: 25 pgs: 25 active+clean; 285 MiB data, 886 MiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 3.4 MiB/s wr, 22 op/s 2021-07-26T16:03:10.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[41341]: cephadm 2021-07-26T16:03:09.093914+0000 mgr.y (mgr.34104) 270 : cephadm [INF] Upgrade: Updating grafana.a 2021-07-26T16:03:10.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[41341]: cephadm 2021-07-26T16:03:09.133933+0000 mgr.y (mgr.34104) 271 : cephadm [INF] Deploying daemon grafana.a on smithi096 2021-07-26T16:03:10.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[41341]: audit 2021-07-26T16:03:09.218480+0000 mon.c (mon.1) 198 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:03:10.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[41341]: audit 2021-07-26T16:03:09.219193+0000 mon.c (mon.1) 199 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:03:10.465 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[41341]: audit 2021-07-26T16:03:09.219239+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:03:10.466 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:10 smithi033 bash[41341]: audit 2021-07-26T16:03:09.219856+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:03:10.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:10 smithi096 bash[33981]: cluster 2021-07-26T16:03:09.056256+0000 mgr.y (mgr.34104) 269 : cluster [DBG] pgmap v399: 25 pgs: 25 active+clean; 285 MiB data, 886 MiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 3.4 MiB/s wr, 22 op/s 2021-07-26T16:03:10.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:10 smithi096 bash[33981]: cephadm 2021-07-26T16:03:09.093914+0000 mgr.y (mgr.34104) 270 : cephadm [INF] Upgrade: Updating grafana.a 2021-07-26T16:03:10.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:10 smithi096 bash[33981]: cephadm 2021-07-26T16:03:09.133933+0000 mgr.y (mgr.34104) 271 : cephadm [INF] Deploying daemon grafana.a on smithi096 2021-07-26T16:03:10.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:10 smithi096 bash[33981]: audit 2021-07-26T16:03:09.218480+0000 mon.c (mon.1) 198 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:03:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:10 smithi096 bash[33981]: audit 2021-07-26T16:03:09.219193+0000 mon.c (mon.1) 199 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:03:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:10 smithi096 bash[33981]: audit 2021-07-26T16:03:09.219239+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:03:10.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:10 smithi096 bash[33981]: audit 2021-07-26T16:03:09.219856+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:03:11.040 INFO:tasks.rados.rados.0.smithi033.stdout:1697: done (1 left) 2021-07-26T16:03:11.041 INFO:tasks.rados.rados.0.smithi033.stdout:1698: copy_from oid 15 from oid 42 current snap is 163 2021-07-26T16:03:11.041 INFO:tasks.rados.rados.0.smithi033.stdout:1695: finishing write tid 1 to smithi03339061-9 2021-07-26T16:03:11.041 INFO:tasks.rados.rados.0.smithi033.stdout:1695: finishing write tid 2 to smithi03339061-9 2021-07-26T16:03:11.042 INFO:tasks.rados.rados.0.smithi033.stdout:1695: finishing write tid 3 to smithi03339061-9 2021-07-26T16:03:11.042 INFO:tasks.rados.rados.0.smithi033.stdout:1695: finishing write tid 4 to smithi03339061-9 2021-07-26T16:03:11.042 INFO:tasks.rados.rados.0.smithi033.stdout:1695: finishing write tid 5 to smithi03339061-9 2021-07-26T16:03:11.042 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 517 (ObjNum 530 snap 163 seq_num 530) dirty exists 2021-07-26T16:03:11.042 INFO:tasks.rados.rados.0.smithi033.stdout:1695: left oid 9 (ObjNum 530 snap 163 seq_num 530) 2021-07-26T16:03:11.043 INFO:tasks.rados.rados.0.smithi033.stdout:1695: done (1 left) 2021-07-26T16:03:11.043 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 163 2021-07-26T16:03:11.043 INFO:tasks.rados.rados.0.smithi033.stdout:1699: seq_num 531 ranges {6103040=499712,6602752=417792,7020544=548864,7569408=237568} 2021-07-26T16:03:11.081 INFO:tasks.rados.rados.0.smithi033.stdout:1699: writing smithi03339061-6 from 6103040 to 6602752 tid 1 2021-07-26T16:03:11.083 INFO:tasks.rados.rados.0.smithi033.stdout:1699: writing smithi03339061-6 from 6602752 to 7020544 tid 2 2021-07-26T16:03:11.087 INFO:tasks.rados.rados.0.smithi033.stdout:1699: writing smithi03339061-6 from 7020544 to 7569408 tid 3 2021-07-26T16:03:11.089 INFO:tasks.rados.rados.0.smithi033.stdout:1699: writing smithi03339061-6 from 7569408 to 7806976 tid 4 2021-07-26T16:03:11.089 INFO:tasks.rados.rados.0.smithi033.stdout:1700: read oid 46 snap -1 2021-07-26T16:03:11.089 INFO:tasks.rados.rados.0.smithi033.stdout:1700: expect deleted 2021-07-26T16:03:11.090 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 163 2021-07-26T16:03:11.090 INFO:tasks.rados.rados.0.smithi033.stdout:1701: seq_num 532 ranges {4145152=516096,4661248=696320,5357568=507904} 2021-07-26T16:03:11.116 INFO:tasks.rados.rados.0.smithi033.stdout:1701: writing smithi03339061-1 from 4145152 to 4661248 tid 1 2021-07-26T16:03:11.119 INFO:tasks.rados.rados.0.smithi033.stdout:1701: writing smithi03339061-1 from 4661248 to 5357568 tid 2 2021-07-26T16:03:11.123 INFO:tasks.rados.rados.0.smithi033.stdout:1701: writing smithi03339061-1 from 5357568 to 5865472 tid 3 2021-07-26T16:03:11.124 INFO:tasks.rados.rados.0.smithi033.stdout:1702: rollback oid 33 current snap is 163 2021-07-26T16:03:11.124 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 156 2021-07-26T16:03:11.124 INFO:tasks.rados.rados.0.smithi033.stdout:1700: done (4 left) 2021-07-26T16:03:11.124 INFO:tasks.rados.rados.0.smithi033.stdout:1703: read oid 37 snap -1 2021-07-26T16:03:11.125 INFO:tasks.rados.rados.0.smithi033.stdout:1703: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:03:11.125 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 163 2021-07-26T16:03:11.125 INFO:tasks.rados.rados.0.smithi033.stdout:1699: finishing write tid 1 to smithi03339061-6 2021-07-26T16:03:11.125 INFO:tasks.rados.rados.0.smithi033.stdout:1699: finishing write tid 2 to smithi03339061-6 2021-07-26T16:03:11.125 INFO:tasks.rados.rados.0.smithi033.stdout:1704: seq_num 533 ranges {1286144=532480,1818624=630784,2449408=516096,2965504=57344} 2021-07-26T16:03:11.134 INFO:tasks.rados.rados.0.smithi033.stdout:1704: writing smithi03339061-26 from 1286144 to 1818624 tid 1 2021-07-26T16:03:11.138 INFO:tasks.rados.rados.0.smithi033.stdout:1704: writing smithi03339061-26 from 1818624 to 2449408 tid 2 2021-07-26T16:03:11.142 INFO:tasks.rados.rados.0.smithi033.stdout:1704: writing smithi03339061-26 from 2449408 to 2965504 tid 3 2021-07-26T16:03:11.144 INFO:tasks.rados.rados.0.smithi033.stdout:1704: writing smithi03339061-26 from 2965504 to 3022848 tid 4 2021-07-26T16:03:11.144 INFO:tasks.rados.rados.0.smithi033.stdout:1705: rollback oid 12 current snap is 163 2021-07-26T16:03:11.145 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 12 to 154 2021-07-26T16:03:11.145 INFO:tasks.rados.rados.0.smithi033.stdout:1699: finishing write tid 3 to smithi03339061-6 2021-07-26T16:03:11.145 INFO:tasks.rados.rados.0.smithi033.stdout:1699: finishing write tid 4 to smithi03339061-6 2021-07-26T16:03:11.145 INFO:tasks.rados.rados.0.smithi033.stdout:1699: finishing write tid 5 to smithi03339061-6 2021-07-26T16:03:11.146 INFO:tasks.rados.rados.0.smithi033.stdout:1698: finishing copy_from to smithi03339061-15 2021-07-26T16:03:11.146 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 260 (ObjNum 512 snap 160 seq_num 512) dirty exists 2021-07-26T16:03:11.146 INFO:tasks.rados.rados.0.smithi033.stdout:1698: finishing copy_from racing read to smithi03339061-15 2021-07-26T16:03:11.146 INFO:tasks.rados.rados.0.smithi033.stdout:1699: finishing write tid 6 to smithi03339061-6 2021-07-26T16:03:11.147 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 954 (ObjNum 531 snap 163 seq_num 531) dirty exists 2021-07-26T16:03:11.147 INFO:tasks.rados.rados.0.smithi033.stdout:1699: left oid 6 (ObjNum 531 snap 163 seq_num 531) 2021-07-26T16:03:11.147 INFO:tasks.rados.rados.0.smithi033.stdout:1701: finishing write tid 1 to smithi03339061-1 2021-07-26T16:03:11.147 INFO:tasks.rados.rados.0.smithi033.stdout:1701: finishing write tid 2 to smithi03339061-1 2021-07-26T16:03:11.147 INFO:tasks.rados.rados.0.smithi033.stdout:1701: finishing write tid 3 to smithi03339061-1 2021-07-26T16:03:11.148 INFO:tasks.rados.rados.0.smithi033.stdout:1698: done (6 left) 2021-07-26T16:03:11.148 INFO:tasks.rados.rados.0.smithi033.stdout:1699: done (5 left) 2021-07-26T16:03:11.148 INFO:tasks.rados.rados.0.smithi033.stdout:1706: delete oid 7 current snap is 163 2021-07-26T16:03:11.148 INFO:tasks.rados.rados.0.smithi033.stdout:1701: finishing write tid 4 to smithi03339061-1 2021-07-26T16:03:11.149 INFO:tasks.rados.rados.0.smithi033.stdout:1702: finishing rollback tid 0 to smithi03339061-33 2021-07-26T16:03:11.149 INFO:tasks.rados.rados.0.smithi033.stdout:1701: finishing write tid 5 to smithi03339061-1 2021-07-26T16:03:11.149 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 78 (ObjNum 532 snap 163 seq_num 532) dirty exists 2021-07-26T16:03:11.149 INFO:tasks.rados.rados.0.smithi033.stdout:1701: left oid 1 (ObjNum 532 snap 163 seq_num 532) 2021-07-26T16:03:11.150 INFO:tasks.rados.rados.0.smithi033.stdout:1702: finishing rollback tid 1 to smithi03339061-33 2021-07-26T16:03:11.150 INFO:tasks.rados.rados.0.smithi033.stdout:1702: finishing rollback tid 2 to smithi03339061-33 2021-07-26T16:03:11.150 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 957 (ObjNum 478 snap 149 seq_num 478) dirty exists 2021-07-26T16:03:11.151 INFO:tasks.rados.rados.0.smithi033.stdout:1704: finishing write tid 1 to smithi03339061-26 2021-07-26T16:03:11.151 INFO:tasks.rados.rados.0.smithi033.stdout:1703: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:03:11.332 INFO:tasks.rados.rados.0.smithi033.stdout:1704: finishing write tid 2 to smithi03339061-26 2021-07-26T16:03:11.333 INFO:tasks.rados.rados.0.smithi033.stdout:1705: finishing rollback tid 0 to smithi03339061-12 2021-07-26T16:03:11.333 INFO:tasks.rados.rados.0.smithi033.stdout:1704: finishing write tid 3 to smithi03339061-26 2021-07-26T16:03:11.333 INFO:tasks.rados.rados.0.smithi033.stdout:1705: finishing rollback tid 1 to smithi03339061-12 2021-07-26T16:03:11.334 INFO:tasks.rados.rados.0.smithi033.stdout:1704: finishing write tid 4 to smithi03339061-26 2021-07-26T16:03:11.334 INFO:tasks.rados.rados.0.smithi033.stdout:1705: finishing rollback tid 2 to smithi03339061-12 2021-07-26T16:03:11.334 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 831 (ObjNum 472 snap 148 seq_num 472) dirty exists 2021-07-26T16:03:11.334 INFO:tasks.rados.rados.0.smithi033.stdout:1704: finishing write tid 5 to smithi03339061-26 2021-07-26T16:03:11.335 INFO:tasks.rados.rados.0.smithi033.stdout:1704: finishing write tid 6 to smithi03339061-26 2021-07-26T16:03:11.335 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 963 (ObjNum 533 snap 163 seq_num 533) dirty exists 2021-07-26T16:03:11.335 INFO:tasks.rados.rados.0.smithi033.stdout:1704: left oid 26 (ObjNum 533 snap 163 seq_num 533) 2021-07-26T16:03:11.335 INFO:tasks.rados.rados.0.smithi033.stdout:1701: done (5 left) 2021-07-26T16:03:11.335 INFO:tasks.rados.rados.0.smithi033.stdout:1702: done (4 left) 2021-07-26T16:03:11.336 INFO:tasks.rados.rados.0.smithi033.stdout:1703: done (3 left) 2021-07-26T16:03:11.336 INFO:tasks.rados.rados.0.smithi033.stdout:1704: done (2 left) 2021-07-26T16:03:11.336 INFO:tasks.rados.rados.0.smithi033.stdout:1705: done (1 left) 2021-07-26T16:03:11.336 INFO:tasks.rados.rados.0.smithi033.stdout:1706: done (0 left) 2021-07-26T16:03:11.337 INFO:tasks.rados.rados.0.smithi033.stdout:1707: snap_remove snap 160 2021-07-26T16:03:11.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:11 smithi033 bash[41341]: cluster 2021-07-26T16:03:10.179337+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2021-07-26T16:03:11.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:11 smithi033 bash[41341]: cluster 2021-07-26T16:03:11.035810+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2021-07-26T16:03:11.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:11 smithi033 bash[42377]: cluster 2021-07-26T16:03:10.179337+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2021-07-26T16:03:11.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:11 smithi033 bash[42377]: cluster 2021-07-26T16:03:11.035810+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2021-07-26T16:03:11.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:11 smithi096 bash[33981]: cluster 2021-07-26T16:03:10.179337+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e393: 8 total, 8 up, 8 in 2021-07-26T16:03:11.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:11 smithi096 bash[33981]: cluster 2021-07-26T16:03:11.035810+0000 mon.a (mon.0) 717 : cluster [DBG] osdmap e394: 8 total, 8 up, 8 in 2021-07-26T16:03:12.216 INFO:tasks.rados.rados.0.smithi033.stdout:1707: done (0 left) 2021-07-26T16:03:12.216 INFO:tasks.rados.rados.0.smithi033.stdout:1708: snap_create 2021-07-26T16:03:12.342 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:12 smithi096 bash[33981]: cluster 2021-07-26T16:03:11.057079+0000 mgr.y (mgr.34104) 272 : cluster [DBG] pgmap v402: 25 pgs: 25 active+clean; 291 MiB data, 900 MiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2021-07-26T16:03:12.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:12 smithi033 bash[42377]: cluster 2021-07-26T16:03:11.057079+0000 mgr.y (mgr.34104) 272 : cluster [DBG] pgmap v402: 25 pgs: 25 active+clean; 291 MiB data, 900 MiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2021-07-26T16:03:12.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:12 smithi033 bash[41341]: cluster 2021-07-26T16:03:11.057079+0000 mgr.y (mgr.34104) 272 : cluster [DBG] pgmap v402: 25 pgs: 25 active+clean; 291 MiB data, 900 MiB used, 714 GiB / 715 GiB avail; 20 MiB/s rd, 3.6 MiB/s wr, 19 op/s 2021-07-26T16:03:13.156 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 systemd[1]: Stopping Ceph grafana.a for 7e62724e-ee28-11eb-8c23-001a4aab830c... 2021-07-26T16:03:13.220 INFO:tasks.rados.rados.0.smithi033.stdout:1708: done (0 left) 2021-07-26T16:03:13.221 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 164 2021-07-26T16:03:13.221 INFO:tasks.rados.rados.0.smithi033.stdout:1709: seq_num 535 ranges {663552=565248,1228800=802816,2031616=401408} 2021-07-26T16:03:13.230 INFO:tasks.rados.rados.0.smithi033.stdout:1709: writing smithi03339061-10 from 663552 to 1228800 tid 1 2021-07-26T16:03:13.236 INFO:tasks.rados.rados.0.smithi033.stdout:1709: writing smithi03339061-10 from 1228800 to 2031616 tid 2 2021-07-26T16:03:13.239 INFO:tasks.rados.rados.0.smithi033.stdout:1709: writing smithi03339061-10 from 2031616 to 2433024 tid 3 2021-07-26T16:03:13.239 INFO:tasks.rados.rados.0.smithi033.stdout:1710: snap_create 2021-07-26T16:03:13.239 INFO:tasks.rados.rados.0.smithi033.stdout:1709: finishing write tid 1 to smithi03339061-10 2021-07-26T16:03:13.243 INFO:tasks.rados.rados.0.smithi033.stdout:1709: finishing write tid 2 to smithi03339061-10 2021-07-26T16:03:13.244 INFO:tasks.rados.rados.0.smithi033.stdout:1709: finishing write tid 3 to smithi03339061-10 2021-07-26T16:03:13.244 INFO:tasks.rados.rados.0.smithi033.stdout:1709: finishing write tid 4 to smithi03339061-10 2021-07-26T16:03:13.246 INFO:tasks.rados.rados.0.smithi033.stdout:1709: finishing write tid 5 to smithi03339061-10 2021-07-26T16:03:13.247 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 841 (ObjNum 535 snap 164 seq_num 535) dirty exists 2021-07-26T16:03:13.247 INFO:tasks.rados.rados.0.smithi033.stdout:1709: left oid 10 (ObjNum 535 snap 164 seq_num 535) 2021-07-26T16:03:13.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[33981]: cluster 2021-07-26T16:03:12.209665+0000 mon.a (mon.0) 718 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2021-07-26T16:03:13.485 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 docker[42463]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:03:13.486 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2021-07-26T16:03:13.486 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" 2021-07-26T16:03:13.486 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Stopped CleanUpService" logger=server reason="context canceled" 2021-07-26T16:03:13.486 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Stopped Stream Manager" 2021-07-26T16:03:13.487 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Stopped AlertEngine" logger=server reason="context canceled" 2021-07-26T16:03:13.487 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Stopped InternalMetricsService" logger=server reason="context canceled" 2021-07-26T16:03:13.487 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" 2021-07-26T16:03:13.487 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" 2021-07-26T16:03:13.488 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Stopped PluginManager" logger=server reason="context canceled" 2021-07-26T16:03:13.488 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Stopped provisioningServiceImpl" logger=server reason="context canceled" 2021-07-26T16:03:13.488 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Stopped RemoteCache" logger=server reason="context canceled" 2021-07-26T16:03:13.488 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:13 smithi096 bash[28628]: t=2021-07-26T16:03:13+0000 lvl=info msg="Stopped UserAuthTokenService" logger=server reason="context canceled" 2021-07-26T16:03:13.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:13 smithi033 bash[41341]: cluster 2021-07-26T16:03:12.209665+0000 mon.a (mon.0) 718 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2021-07-26T16:03:13.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:13 smithi033 bash[42377]: cluster 2021-07-26T16:03:12.209665+0000 mon.a (mon.0) 718 : cluster [DBG] osdmap e395: 8 total, 8 up, 8 in 2021-07-26T16:03:13.710 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:03:13 smithi033 bash[50539]: level=info ts=2021-07-26T16:03:13.271Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.001148235s 2021-07-26T16:03:14.224 INFO:tasks.rados.rados.0.smithi033.stdout:1709: done (1 left) 2021-07-26T16:03:14.225 INFO:tasks.rados.rados.0.smithi033.stdout:1710: done (0 left) 2021-07-26T16:03:14.225 INFO:tasks.rados.rados.0.smithi033.stdout:1711: rollback oid 27 current snap is 165 2021-07-26T16:03:14.226 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 27 to 161 2021-07-26T16:03:14.226 INFO:tasks.rados.rados.0.smithi033.stdout:1712: delete oid 39 current snap is 165 2021-07-26T16:03:14.234 INFO:tasks.rados.rados.0.smithi033.stdout:1711: finishing rollback tid 0 to smithi03339061-27 2021-07-26T16:03:14.235 INFO:tasks.rados.rados.0.smithi033.stdout:1711: finishing rollback tid 1 to smithi03339061-27 2021-07-26T16:03:14.237 INFO:tasks.rados.rados.0.smithi033.stdout:1711: finishing rollback tid 2 to smithi03339061-27 2021-07-26T16:03:14.237 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 729 (ObjNum 442 snap 137 seq_num 442) dirty exists 2021-07-26T16:03:14.238 INFO:tasks.rados.rados.0.smithi033.stdout:1711: done (1 left) 2021-07-26T16:03:14.238 INFO:tasks.rados.rados.0.smithi033.stdout:1712: done (0 left) 2021-07-26T16:03:14.239 INFO:tasks.rados.rados.0.smithi033.stdout:1713: rollback oid 50 current snap is 165 2021-07-26T16:03:14.239 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 50 to 164 2021-07-26T16:03:14.240 INFO:tasks.rados.rados.0.smithi033.stdout:1714: copy_from oid 26 from oid 41 current snap is 165 2021-07-26T16:03:14.240 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 165 2021-07-26T16:03:14.240 INFO:tasks.rados.rados.0.smithi033.stdout:1715: seq_num 537 ranges {0=598016,598016=573440,1171456=491520,1662976=139264} 2021-07-26T16:03:14.241 INFO:tasks.rados.rados.0.smithi033.stdout:1715: writing smithi03339061-20 from 0 to 598016 tid 1 2021-07-26T16:03:14.245 INFO:tasks.rados.rados.0.smithi033.stdout:1715: writing smithi03339061-20 from 598016 to 1171456 tid 2 2021-07-26T16:03:14.249 INFO:tasks.rados.rados.0.smithi033.stdout:1715: writing smithi03339061-20 from 1171456 to 1662976 tid 3 2021-07-26T16:03:14.251 INFO:tasks.rados.rados.0.smithi033.stdout:1715: writing smithi03339061-20 from 1662976 to 1802240 tid 4 2021-07-26T16:03:14.251 INFO:tasks.rados.rados.0.smithi033.stdout:1716: snap_create 2021-07-26T16:03:14.251 INFO:tasks.rados.rados.0.smithi033.stdout:1713: finishing rollback tid 1 to smithi03339061-50 2021-07-26T16:03:14.252 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 664 (ObjNum 2007155808 snap 22002 seq_num 2006045328) dirty dne 2021-07-26T16:03:14.252 INFO:tasks.rados.rados.0.smithi033.stdout:1714: finishing copy_from to smithi03339061-26 2021-07-26T16:03:14.252 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 621 (ObjNum 451 snap 139 seq_num 451) dirty exists 2021-07-26T16:03:14.254 INFO:tasks.rados.rados.0.smithi033.stdout:1714: finishing copy_from racing read to smithi03339061-26 2021-07-26T16:03:14.255 INFO:tasks.rados.rados.0.smithi033.stdout:1715: finishing write tid 1 to smithi03339061-20 2021-07-26T16:03:14.256 INFO:tasks.rados.rados.0.smithi033.stdout:1715: finishing write tid 2 to smithi03339061-20 2021-07-26T16:03:14.256 INFO:tasks.rados.rados.0.smithi033.stdout:1715: finishing write tid 3 to smithi03339061-20 2021-07-26T16:03:14.256 INFO:tasks.rados.rados.0.smithi033.stdout:1715: finishing write tid 4 to smithi03339061-20 2021-07-26T16:03:14.256 INFO:tasks.rados.rados.0.smithi033.stdout:1715: finishing write tid 5 to smithi03339061-20 2021-07-26T16:03:14.257 INFO:tasks.rados.rados.0.smithi033.stdout:1715: finishing write tid 6 to smithi03339061-20 2021-07-26T16:03:14.258 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 668 (ObjNum 537 snap 165 seq_num 537) dirty exists 2021-07-26T16:03:14.258 INFO:tasks.rados.rados.0.smithi033.stdout:1715: left oid 20 (ObjNum 537 snap 165 seq_num 537) 2021-07-26T16:03:14.331 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:14 smithi096 docker[42463]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c-grafana.a 2021-07-26T16:03:14.331 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:14 smithi096 systemd[1]: ceph-7e62724e-ee28-11eb-8c23-001a4aab830c@grafana.a.service: Succeeded. 2021-07-26T16:03:14.331 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:14 smithi096 systemd[1]: Stopped Ceph grafana.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:03:14.332 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:14 smithi096 bash[33981]: cluster 2021-07-26T16:03:13.057850+0000 mgr.y (mgr.34104) 273 : cluster [DBG] pgmap v404: 25 pgs: 25 active+clean; 306 MiB data, 914 MiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2021-07-26T16:03:14.332 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:14 smithi096 bash[33981]: cluster 2021-07-26T16:03:13.217017+0000 mon.a (mon.0) 719 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2021-07-26T16:03:14.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:14 smithi033 bash[41341]: cluster 2021-07-26T16:03:13.057850+0000 mgr.y (mgr.34104) 273 : cluster [DBG] pgmap v404: 25 pgs: 25 active+clean; 306 MiB data, 914 MiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2021-07-26T16:03:14.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:14 smithi033 bash[41341]: cluster 2021-07-26T16:03:13.217017+0000 mon.a (mon.0) 719 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2021-07-26T16:03:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:14 smithi033 bash[42377]: cluster 2021-07-26T16:03:13.057850+0000 mgr.y (mgr.34104) 273 : cluster [DBG] pgmap v404: 25 pgs: 25 active+clean; 306 MiB data, 914 MiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 4.5 MiB/s wr, 17 op/s 2021-07-26T16:03:14.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:14 smithi033 bash[42377]: cluster 2021-07-26T16:03:13.217017+0000 mon.a (mon.0) 719 : cluster [DBG] osdmap e396: 8 total, 8 up, 8 in 2021-07-26T16:03:14.737 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:14 smithi096 systemd[1]: Started Ceph grafana.a for 7e62724e-ee28-11eb-8c23-001a4aab830c. 2021-07-26T16:03:14.739 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:14 smithi096 bash[42542]: WARNING: Error loading config file: .dockercfg: $HOME is not defined 2021-07-26T16:03:15.242 INFO:tasks.rados.rados.0.smithi033.stdout:1713: done (3 left) 2021-07-26T16:03:15.242 INFO:tasks.rados.rados.0.smithi033.stdout:1714: done (2 left) 2021-07-26T16:03:15.243 INFO:tasks.rados.rados.0.smithi033.stdout:1715: done (1 left) 2021-07-26T16:03:15.243 INFO:tasks.rados.rados.0.smithi033.stdout:1716: done (0 left) 2021-07-26T16:03:15.243 INFO:tasks.rados.rados.0.smithi033.stdout:1717: snap_remove snap 154 2021-07-26T16:03:15.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[33981]: cluster 2021-07-26T16:03:14.217662+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2021-07-26T16:03:15.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[33981]: audit 2021-07-26T16:03:14.368475+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:15.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[33981]: audit 2021-07-26T16:03:14.371411+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:15.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[33981]: audit 2021-07-26T16:03:14.374296+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:15.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[33981]: audit 2021-07-26T16:03:14.376596+0000 mon.c (mon.1) 202 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:15.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:15 smithi033 bash[42377]: cluster 2021-07-26T16:03:14.217662+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2021-07-26T16:03:15.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:15 smithi033 bash[42377]: audit 2021-07-26T16:03:14.368475+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:15.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:15 smithi033 bash[42377]: audit 2021-07-26T16:03:14.371411+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:15.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:15 smithi033 bash[42377]: audit 2021-07-26T16:03:14.374296+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:15.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:15 smithi033 bash[42377]: audit 2021-07-26T16:03:14.376596+0000 mon.c (mon.1) 202 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:15.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:15 smithi033 bash[41341]: cluster 2021-07-26T16:03:14.217662+0000 mon.a (mon.0) 720 : cluster [DBG] osdmap e397: 8 total, 8 up, 8 in 2021-07-26T16:03:15.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:15 smithi033 bash[41341]: audit 2021-07-26T16:03:14.368475+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:15.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:15 smithi033 bash[41341]: audit 2021-07-26T16:03:14.371411+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:15.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:15 smithi033 bash[41341]: audit 2021-07-26T16:03:14.374296+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:15.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:15 smithi033 bash[41341]: audit 2021-07-26T16:03:14.376596+0000 mon.c (mon.1) 202 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:15.985 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Starting Grafana" logger=server version=6.7.4 commit=8e44bbc5f5 branch=HEAD compiled=2020-05-26T17:35:38+0000 2021-07-26T16:03:15.986 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-07-26T16:03:15.986 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-07-26T16:03:15.986 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-07-26T16:03:15.987 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-07-26T16:03:15.987 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-07-26T16:03:15.987 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-07-26T16:03:15.987 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-07-26T16:03:15.987 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-07-26T16:03:15.988 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-07-26T16:03:15.988 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-07-26T16:03:15.988 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-07-26T16:03:15.988 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="App mode production" logger=settings 2021-07-26T16:03:15.989 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-07-26T16:03:15.989 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-07-26T16:03:15.989 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-07-26T16:03:15.989 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-07-26T16:03:15.989 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-07-26T16:03:15.990 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-07-26T16:03:15.990 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-07-26T16:03:15.990 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-07-26T16:03:15.990 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-07-26T16:03:15.990 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing HooksService" logger=server 2021-07-26T16:03:15.991 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-07-26T16:03:15.991 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-07-26T16:03:15.991 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-07-26T16:03:15.991 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-07-26T16:03:15.992 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-07-26T16:03:15.992 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-07-26T16:03:15.992 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-07-26T16:03:15.992 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-07-26T16:03:15.993 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-07-26T16:03:15.993 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing LoginService" logger=server 2021-07-26T16:03:15.993 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing SearchService" logger=server 2021-07-26T16:03:15.993 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing TracingService" logger=server 2021-07-26T16:03:15.993 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-07-26T16:03:15.994 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-07-26T16:03:15.994 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-07-26T16:03:15.994 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-07-26T16:03:15.995 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-07-26T16:03:15.995 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-07-26T16:03:15.995 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin. Read more at https://grafana.com/docs/grafana/latest/administration/image_rendering/" logger=rendering renderer=phantomJS 2021-07-26T16:03:15.995 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="Initializing Stream Manager" 2021-07-26T16:03:15.995 INFO:journalctl@ceph.grafana.a.smithi096.stdout:Jul 26 16:03:15 smithi096 bash[42542]: t=2021-07-26T16:03:15+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2021-07-26T16:03:16.042 INFO:tasks.rados.rados.0.smithi033.stdout:1717: done (0 left) 2021-07-26T16:03:16.043 INFO:tasks.rados.rados.0.smithi033.stdout:1718: read oid 42 snap 152 2021-07-26T16:03:16.043 INFO:tasks.rados.rados.0.smithi033.stdout:1718: expect (ObjNum 467 snap 148 seq_num 467) 2021-07-26T16:03:16.048 INFO:tasks.rados.rados.0.smithi033.stdout:1719: snap_remove snap 161 2021-07-26T16:03:16.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:16 smithi033 bash[42377]: cluster 2021-07-26T16:03:15.058630+0000 mgr.y (mgr.34104) 274 : cluster [DBG] pgmap v407: 25 pgs: 25 active+clean; 306 MiB data, 919 MiB used, 714 GiB / 715 GiB avail; 5.2 MiB/s rd, 4.2 MiB/s wr, 9 op/s 2021-07-26T16:03:16.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:16 smithi033 bash[42377]: cluster 2021-07-26T16:03:15.238780+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2021-07-26T16:03:16.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:16 smithi033 bash[42377]: cluster 2021-07-26T16:03:16.039170+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2021-07-26T16:03:16.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:16 smithi033 bash[41341]: cluster 2021-07-26T16:03:15.058630+0000 mgr.y (mgr.34104) 274 : cluster [DBG] pgmap v407: 25 pgs: 25 active+clean; 306 MiB data, 919 MiB used, 714 GiB / 715 GiB avail; 5.2 MiB/s rd, 4.2 MiB/s wr, 9 op/s 2021-07-26T16:03:16.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:16 smithi033 bash[41341]: cluster 2021-07-26T16:03:15.238780+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2021-07-26T16:03:16.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:16 smithi033 bash[41341]: cluster 2021-07-26T16:03:16.039170+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2021-07-26T16:03:16.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:16 smithi096 bash[33981]: cluster 2021-07-26T16:03:15.058630+0000 mgr.y (mgr.34104) 274 : cluster [DBG] pgmap v407: 25 pgs: 25 active+clean; 306 MiB data, 919 MiB used, 714 GiB / 715 GiB avail; 5.2 MiB/s rd, 4.2 MiB/s wr, 9 op/s 2021-07-26T16:03:16.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:16 smithi096 bash[33981]: cluster 2021-07-26T16:03:15.238780+0000 mon.a (mon.0) 722 : cluster [DBG] osdmap e398: 8 total, 8 up, 8 in 2021-07-26T16:03:16.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:16 smithi096 bash[33981]: cluster 2021-07-26T16:03:16.039170+0000 mon.a (mon.0) 723 : cluster [DBG] osdmap e399: 8 total, 8 up, 8 in 2021-07-26T16:03:17.060 INFO:tasks.rados.rados.0.smithi033.stdout:1718: expect (ObjNum 467 snap 148 seq_num 467) 2021-07-26T16:03:17.647 INFO:tasks.rados.rados.0.smithi033.stdout:1718: done (1 left) 2021-07-26T16:03:17.647 INFO:tasks.rados.rados.0.smithi033.stdout:1719: done (0 left) 2021-07-26T16:03:17.648 INFO:tasks.rados.rados.0.smithi033.stdout:1720: snap_remove snap 152 2021-07-26T16:03:18.070 INFO:tasks.rados.rados.0.smithi033.stdout:1720: done (0 left) 2021-07-26T16:03:18.070 INFO:tasks.rados.rados.0.smithi033.stdout:1721: read oid 28 snap 162 2021-07-26T16:03:18.070 INFO:tasks.rados.rados.0.smithi033.stdout:1721: expect (ObjNum 489 snap 152 seq_num 489) 2021-07-26T16:03:18.070 INFO:tasks.rados.rados.0.smithi033.stdout:1722: rmattr oid 2 current snap is 166 2021-07-26T16:03:18.071 INFO:tasks.rados.rados.0.smithi033.stdout:1723: snap_create 2021-07-26T16:03:18.095 INFO:tasks.rados.rados.0.smithi033.stdout:1721: expect (ObjNum 489 snap 152 seq_num 489) 2021-07-26T16:03:18.235 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 832 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:03:18.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:18 smithi033 bash[41341]: cluster 2021-07-26T16:03:17.053158+0000 mon.a (mon.0) 724 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2021-07-26T16:03:18.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:18 smithi033 bash[41341]: cluster 2021-07-26T16:03:17.059336+0000 mgr.y (mgr.34104) 275 : cluster [DBG] pgmap v411: 25 pgs: 25 active+clean; 307 MiB data, 921 MiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.4 MiB/s wr, 3 op/s 2021-07-26T16:03:18.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:18 smithi033 bash[42377]: cluster 2021-07-26T16:03:17.053158+0000 mon.a (mon.0) 724 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2021-07-26T16:03:18.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:18 smithi033 bash[42377]: cluster 2021-07-26T16:03:17.059336+0000 mgr.y (mgr.34104) 275 : cluster [DBG] pgmap v411: 25 pgs: 25 active+clean; 307 MiB data, 921 MiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.4 MiB/s wr, 3 op/s 2021-07-26T16:03:18.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:18 smithi096 bash[33981]: cluster 2021-07-26T16:03:17.053158+0000 mon.a (mon.0) 724 : cluster [DBG] osdmap e400: 8 total, 8 up, 8 in 2021-07-26T16:03:18.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:18 smithi096 bash[33981]: cluster 2021-07-26T16:03:17.059336+0000 mgr.y (mgr.34104) 275 : cluster [DBG] pgmap v411: 25 pgs: 25 active+clean; 307 MiB data, 921 MiB used, 714 GiB / 715 GiB avail; 5.0 MiB/s rd, 2.4 MiB/s wr, 3 op/s 2021-07-26T16:03:19.080 INFO:tasks.rados.rados.0.smithi033.stdout:1721: done (2 left) 2021-07-26T16:03:19.080 INFO:tasks.rados.rados.0.smithi033.stdout:1722: done (1 left) 2021-07-26T16:03:19.081 INFO:tasks.rados.rados.0.smithi033.stdout:1723: done (0 left) 2021-07-26T16:03:19.081 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 167 2021-07-26T16:03:19.081 INFO:tasks.rados.rados.0.smithi033.stdout:1724: seq_num 538 ranges {8011776=614400,8626176=450560,9076736=704512,9781248=49152} 2021-07-26T16:03:19.135 INFO:tasks.rados.rados.0.smithi033.stdout:1724: writing smithi03339061-15 from 8011776 to 8626176 tid 1 2021-07-26T16:03:19.135 INFO:tasks.rados.rados.0.smithi033.stdout:1724: writing smithi03339061-15 from 8626176 to 9076736 tid 2 2021-07-26T16:03:19.141 INFO:tasks.rados.rados.0.smithi033.stdout:1724: writing smithi03339061-15 from 9076736 to 9781248 tid 3 2021-07-26T16:03:19.141 INFO:tasks.rados.rados.0.smithi033.stdout:1724: writing smithi03339061-15 from 9781248 to 9830400 tid 4 2021-07-26T16:03:19.141 INFO:tasks.rados.rados.0.smithi033.stdout:1725: rollback oid 30 current snap is 167 2021-07-26T16:03:19.141 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 30 to 165 2021-07-26T16:03:19.142 INFO:tasks.rados.rados.0.smithi033.stdout:1726: copy_from oid 14 from oid 25 current snap is 167 2021-07-26T16:03:19.142 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 167 2021-07-26T16:03:19.142 INFO:tasks.rados.rados.0.smithi033.stdout:1727: seq_num 539 ranges {8011776=630784,8642560=737280,9379840=466944} 2021-07-26T16:03:19.186 INFO:tasks.rados.rados.0.smithi033.stdout:1727: writing smithi03339061-42 from 8011776 to 8642560 tid 1 2021-07-26T16:03:19.190 INFO:tasks.rados.rados.0.smithi033.stdout:1727: writing smithi03339061-42 from 8642560 to 9379840 tid 2 2021-07-26T16:03:19.193 INFO:tasks.rados.rados.0.smithi033.stdout:1727: writing smithi03339061-42 from 9379840 to 9846784 tid 3 2021-07-26T16:03:19.193 INFO:tasks.rados.rados.0.smithi033.stdout:1728: delete oid 40 current snap is 167 2021-07-26T16:03:19.193 INFO:tasks.rados.rados.0.smithi033.stdout:1724: finishing write tid 1 to smithi03339061-15 2021-07-26T16:03:19.194 INFO:tasks.rados.rados.0.smithi033.stdout:1724: finishing write tid 2 to smithi03339061-15 2021-07-26T16:03:19.194 INFO:tasks.rados.rados.0.smithi033.stdout:1725: finishing rollback tid 0 to smithi03339061-30 2021-07-26T16:03:19.194 INFO:tasks.rados.rados.0.smithi033.stdout:1725: finishing rollback tid 1 to smithi03339061-30 2021-07-26T16:03:19.194 INFO:tasks.rados.rados.0.smithi033.stdout:1725: finishing rollback tid 2 to smithi03339061-30 2021-07-26T16:03:19.195 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 844 (ObjNum 394 snap 120 seq_num 394) dirty exists 2021-07-26T16:03:19.195 INFO:tasks.rados.rados.0.smithi033.stdout:1724: finishing write tid 3 to smithi03339061-15 2021-07-26T16:03:19.195 INFO:tasks.rados.rados.0.smithi033.stdout:1724: finishing write tid 4 to smithi03339061-15 2021-07-26T16:03:19.195 INFO:tasks.rados.rados.0.smithi033.stdout:1724: finishing write tid 5 to smithi03339061-15 2021-07-26T16:03:19.195 INFO:tasks.rados.rados.0.smithi033.stdout:1724: finishing write tid 6 to smithi03339061-15 2021-07-26T16:03:19.196 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 646 (ObjNum 538 snap 167 seq_num 538) dirty exists 2021-07-26T16:03:19.196 INFO:tasks.rados.rados.0.smithi033.stdout:1724: left oid 15 (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:03:19.196 INFO:tasks.rados.rados.0.smithi033.stdout:1726: finishing copy_from to smithi03339061-14 2021-07-26T16:03:19.196 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 680 (ObjNum 511 snap 160 seq_num 511) dirty exists 2021-07-26T16:03:19.196 INFO:tasks.rados.rados.0.smithi033.stdout:1726: finishing copy_from racing read to smithi03339061-14 2021-07-26T16:03:19.197 INFO:tasks.rados.rados.0.smithi033.stdout:1724: done (4 left) 2021-07-26T16:03:19.198 INFO:tasks.rados.rados.0.smithi033.stdout:1725: done (3 left) 2021-07-26T16:03:19.198 INFO:tasks.rados.rados.0.smithi033.stdout:1726: done (2 left) 2021-07-26T16:03:19.198 INFO:tasks.rados.rados.0.smithi033.stdout:1728: done (1 left) 2021-07-26T16:03:19.199 INFO:tasks.rados.rados.0.smithi033.stdout:1729: read oid 26 snap -1 2021-07-26T16:03:19.199 INFO:tasks.rados.rados.0.smithi033.stdout:1729: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:03:19.199 INFO:tasks.rados.rados.0.smithi033.stdout:1730: read oid 29 snap -1 2021-07-26T16:03:19.199 INFO:tasks.rados.rados.0.smithi033.stdout:1730: expect (ObjNum 517 snap 161 seq_num 517) 2021-07-26T16:03:19.199 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 167 2021-07-26T16:03:19.200 INFO:tasks.rados.rados.0.smithi033.stdout:1731: seq_num 541 ranges {7806976=663552,8470528=557056,9027584=475136,9502720=172032} 2021-07-26T16:03:19.241 INFO:tasks.rados.rados.0.smithi033.stdout:1731: writing smithi03339061-6 from 7806976 to 8470528 tid 1 2021-07-26T16:03:19.244 INFO:tasks.rados.rados.0.smithi033.stdout:1731: writing smithi03339061-6 from 8470528 to 9027584 tid 2 2021-07-26T16:03:19.247 INFO:tasks.rados.rados.0.smithi033.stdout:1731: writing smithi03339061-6 from 9027584 to 9502720 tid 3 2021-07-26T16:03:19.248 INFO:tasks.rados.rados.0.smithi033.stdout:1731: writing smithi03339061-6 from 9502720 to 9674752 tid 4 2021-07-26T16:03:19.248 INFO:tasks.rados.rados.0.smithi033.stdout:1732: snap_create 2021-07-26T16:03:19.249 INFO:tasks.rados.rados.0.smithi033.stdout:1727: finishing write tid 1 to smithi03339061-42 2021-07-26T16:03:19.249 INFO:tasks.rados.rados.0.smithi033.stdout:1727: finishing write tid 2 to smithi03339061-42 2021-07-26T16:03:19.249 INFO:tasks.rados.rados.0.smithi033.stdout:1729: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:03:19.292 INFO:tasks.rados.rados.0.smithi033.stdout:1727: finishing write tid 3 to smithi03339061-42 2021-07-26T16:03:19.293 INFO:tasks.rados.rados.0.smithi033.stdout:1727: finishing write tid 4 to smithi03339061-42 2021-07-26T16:03:19.294 INFO:tasks.rados.rados.0.smithi033.stdout:1727: finishing write tid 5 to smithi03339061-42 2021-07-26T16:03:19.294 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 279 (ObjNum 539 snap 167 seq_num 539) dirty exists 2021-07-26T16:03:19.294 INFO:tasks.rados.rados.0.smithi033.stdout:1727: left oid 42 (ObjNum 539 snap 167 seq_num 539) 2021-07-26T16:03:19.294 INFO:tasks.rados.rados.0.smithi033.stdout:1731: finishing write tid 1 to smithi03339061-6 2021-07-26T16:03:19.294 INFO:tasks.rados.rados.0.smithi033.stdout:1731: finishing write tid 2 to smithi03339061-6 2021-07-26T16:03:19.299 INFO:tasks.rados.rados.0.smithi033.stdout:1731: finishing write tid 3 to smithi03339061-6 2021-07-26T16:03:19.299 INFO:tasks.rados.rados.0.smithi033.stdout:1731: finishing write tid 4 to smithi03339061-6 2021-07-26T16:03:19.299 INFO:tasks.rados.rados.0.smithi033.stdout:1731: finishing write tid 5 to smithi03339061-6 2021-07-26T16:03:19.300 INFO:tasks.rados.rados.0.smithi033.stdout:1731: finishing write tid 6 to smithi03339061-6 2021-07-26T16:03:19.300 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1011 (ObjNum 541 snap 167 seq_num 541) dirty exists 2021-07-26T16:03:19.300 INFO:tasks.rados.rados.0.smithi033.stdout:1731: left oid 6 (ObjNum 541 snap 167 seq_num 541) 2021-07-26T16:03:19.300 INFO:tasks.rados.rados.0.smithi033.stdout:1730: expect (ObjNum 517 snap 161 seq_num 517) 2021-07-26T16:03:19.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:19 smithi033 bash[41341]: cluster 2021-07-26T16:03:18.063732+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2021-07-26T16:03:19.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:19 smithi033 bash[42377]: cluster 2021-07-26T16:03:18.063732+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2021-07-26T16:03:19.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:19 smithi096 bash[33981]: cluster 2021-07-26T16:03:18.063732+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e401: 8 total, 8 up, 8 in 2021-07-26T16:03:20.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: cluster 2021-07-26T16:03:19.059983+0000 mgr.y (mgr.34104) 276 : cluster [DBG] pgmap v413: 25 pgs: 25 active+clean; 310 MiB data, 927 MiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2021-07-26T16:03:20.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: cluster 2021-07-26T16:03:19.076494+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2021-07-26T16:03:20.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.571227+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.578741+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.589773+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T16:03:20.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.590297+0000 mgr.y (mgr.34104) 277 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T16:03:20.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.592265+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:20.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.594696+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.597119+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.598840+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.601891+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.604352+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.605589+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.606816+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.608013+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.609360+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.610894+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.463 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.612601+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.613934+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.464 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.615310+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: cluster 2021-07-26T16:03:19.059983+0000 mgr.y (mgr.34104) 276 : cluster [DBG] pgmap v413: 25 pgs: 25 active+clean; 310 MiB data, 927 MiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2021-07-26T16:03:20.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: cluster 2021-07-26T16:03:19.076494+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2021-07-26T16:03:20.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.571227+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.578741+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.589773+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T16:03:20.465 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.590297+0000 mgr.y (mgr.34104) 277 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T16:03:20.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.592265+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:20.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.594696+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.597119+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.598840+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.466 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.601891+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.604352+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.605589+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.606816+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.467 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.608013+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.609360+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.610894+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.612601+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.613934+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.468 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.615310+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.616652+0000 mon.c (mon.1) 218 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.469 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: cephadm 2021-07-26T16:03:19.617623+0000 mgr.y (mgr.34104) 278 : cephadm [INF] Upgrade: Finalizing container_image settings 2021-07-26T16:03:20.470 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.623388+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.470 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.624994+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2021-07-26T16:03:20.470 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.625372+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2021-07-26T16:03:20.470 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.630174+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2021-07-26T16:03:20.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.632602+0000 mon.c (mon.1) 220 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.633006+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.637983+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2021-07-26T16:03:20.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.639039+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2021-07-26T16:03:20.471 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.639406+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2021-07-26T16:03:20.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.644215+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2021-07-26T16:03:20.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.645616+0000 mon.c (mon.1) 222 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2021-07-26T16:03:20.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.646122+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2021-07-26T16:03:20.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.651843+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2021-07-26T16:03:20.472 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.652995+0000 mon.c (mon.1) 223 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2021-07-26T16:03:20.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.653348+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2021-07-26T16:03:20.473 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.658093+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2021-07-26T16:03:20.473 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.616652+0000 mon.c (mon.1) 218 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.474 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: cephadm 2021-07-26T16:03:19.617623+0000 mgr.y (mgr.34104) 278 : cephadm [INF] Upgrade: Finalizing container_image settings 2021-07-26T16:03:20.474 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.623388+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.474 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.624994+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2021-07-26T16:03:20.474 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.625372+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2021-07-26T16:03:20.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.630174+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2021-07-26T16:03:20.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.632602+0000 mon.c (mon.1) 220 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.633006+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.475 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.637983+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2021-07-26T16:03:20.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.639039+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2021-07-26T16:03:20.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.639406+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2021-07-26T16:03:20.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.644215+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2021-07-26T16:03:20.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.645616+0000 mon.c (mon.1) 222 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2021-07-26T16:03:20.476 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.646122+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2021-07-26T16:03:20.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.651843+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2021-07-26T16:03:20.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.652995+0000 mon.c (mon.1) 223 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2021-07-26T16:03:20.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.653348+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2021-07-26T16:03:20.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.658093+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2021-07-26T16:03:20.477 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.659192+0000 mon.c (mon.1) 224 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2021-07-26T16:03:20.478 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.659543+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2021-07-26T16:03:20.478 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.664613+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2021-07-26T16:03:20.478 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.665782+0000 mon.c (mon.1) 225 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2021-07-26T16:03:20.478 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.666155+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2021-07-26T16:03:20.479 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.671098+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2021-07-26T16:03:20.479 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.672484+0000 mon.c (mon.1) 226 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.479 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.672860+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.479 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.673863+0000 mon.c (mon.1) 227 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2021-07-26T16:03:20.479 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.674242+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2021-07-26T16:03:20.480 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.679597+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2021-07-26T16:03:20.480 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.680906+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2021-07-26T16:03:20.480 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.681257+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2021-07-26T16:03:20.480 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.685889+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2021-07-26T16:03:20.480 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.686949+0000 mon.c (mon.1) 229 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.481 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.687351+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.481 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.688424+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.481 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.659192+0000 mon.c (mon.1) 224 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2021-07-26T16:03:20.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.659543+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2021-07-26T16:03:20.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.664613+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2021-07-26T16:03:20.482 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.665782+0000 mon.c (mon.1) 225 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2021-07-26T16:03:20.484 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.666155+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2021-07-26T16:03:20.484 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.671098+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2021-07-26T16:03:20.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.672484+0000 mon.c (mon.1) 226 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.672860+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.673863+0000 mon.c (mon.1) 227 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2021-07-26T16:03:20.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.674242+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2021-07-26T16:03:20.485 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.679597+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2021-07-26T16:03:20.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.680906+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2021-07-26T16:03:20.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.681257+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2021-07-26T16:03:20.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.685889+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2021-07-26T16:03:20.486 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.686949+0000 mon.c (mon.1) 229 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.487 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.687351+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.487 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.688424+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.487 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.688750+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.488 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.689687+0000 mon.c (mon.1) 231 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.488 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.690028+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.488 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.690944+0000 mon.c (mon.1) 232 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.488 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.691252+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.489 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.692790+0000 mon.c (mon.1) 233 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2021-07-26T16:03:20.489 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.693155+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2021-07-26T16:03:20.489 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.697383+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2021-07-26T16:03:20.489 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.698231+0000 mon.c (mon.1) 234 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:20.489 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.699640+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:20.490 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.700889+0000 mon.c (mon.1) 236 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:20.490 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.953424+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.490 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.958887+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:20.490 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.960181+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:20.490 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.961274+0000 mon.c (mon.1) 239 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:20.491 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[42377]: audit 2021-07-26T16:03:19.967703+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.688750+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.491 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.689687+0000 mon.c (mon.1) 231 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.690028+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.690944+0000 mon.c (mon.1) 232 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.691252+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.692790+0000 mon.c (mon.1) 233 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2021-07-26T16:03:20.492 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.693155+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2021-07-26T16:03:20.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.697383+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2021-07-26T16:03:20.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.698231+0000 mon.c (mon.1) 234 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:20.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.699640+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:20.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.700889+0000 mon.c (mon.1) 236 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:20.493 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.953424+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.958887+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:20.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.960181+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:20.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.961274+0000 mon.c (mon.1) 239 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:20.494 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:20 smithi033 bash[41341]: audit 2021-07-26T16:03:19.967703+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: cluster 2021-07-26T16:03:19.059983+0000 mgr.y (mgr.34104) 276 : cluster [DBG] pgmap v413: 25 pgs: 25 active+clean; 310 MiB data, 927 MiB used, 714 GiB / 715 GiB avail; 4.8 MiB/s rd, 3.0 MiB/s wr, 5 op/s 2021-07-26T16:03:20.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: cluster 2021-07-26T16:03:19.076494+0000 mon.a (mon.0) 726 : cluster [DBG] osdmap e402: 8 total, 8 up, 8 in 2021-07-26T16:03:20.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.571227+0000 mon.a (mon.0) 727 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.578741+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.589773+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T16:03:20.496 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.590297+0000 mgr.y (mgr.34104) 277 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-07-26T16:03:20.497 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.592265+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:20.497 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.594696+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.497 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.597119+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.497 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.598840+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.498 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.601891+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.498 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.604352+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.498 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.605589+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.498 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.606816+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.498 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.608013+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.499 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.609360+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.499 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.610894+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.499 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.612601+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.499 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.613934+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.500 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.615310+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.500 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.616652+0000 mon.c (mon.1) 218 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:20.500 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: cephadm 2021-07-26T16:03:19.617623+0000 mgr.y (mgr.34104) 278 : cephadm [INF] Upgrade: Finalizing container_image settings 2021-07-26T16:03:20.500 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.623388+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.500 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.624994+0000 mon.c (mon.1) 219 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2021-07-26T16:03:20.501 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.625372+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2021-07-26T16:03:20.501 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.630174+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2021-07-26T16:03:20.501 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.632602+0000 mon.c (mon.1) 220 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.501 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.633006+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.501 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.637983+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2021-07-26T16:03:20.502 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.639039+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2021-07-26T16:03:20.502 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.639406+0000 mon.a (mon.0) 734 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2021-07-26T16:03:20.502 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.644215+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2021-07-26T16:03:20.502 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.645616+0000 mon.c (mon.1) 222 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2021-07-26T16:03:20.503 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.646122+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2021-07-26T16:03:20.503 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.651843+0000 mon.a (mon.0) 737 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2021-07-26T16:03:20.503 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.652995+0000 mon.c (mon.1) 223 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2021-07-26T16:03:20.503 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.653348+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2021-07-26T16:03:20.503 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.658093+0000 mon.a (mon.0) 739 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2021-07-26T16:03:20.504 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.659192+0000 mon.c (mon.1) 224 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2021-07-26T16:03:20.504 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.659543+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2021-07-26T16:03:20.504 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.664613+0000 mon.a (mon.0) 741 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2021-07-26T16:03:20.505 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.665782+0000 mon.c (mon.1) 225 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2021-07-26T16:03:20.505 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.666155+0000 mon.a (mon.0) 742 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2021-07-26T16:03:20.505 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.671098+0000 mon.a (mon.0) 743 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2021-07-26T16:03:20.505 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.672484+0000 mon.c (mon.1) 226 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.506 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.672860+0000 mon.a (mon.0) 744 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.506 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.673863+0000 mon.c (mon.1) 227 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2021-07-26T16:03:20.506 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.674242+0000 mon.a (mon.0) 745 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2021-07-26T16:03:20.506 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.679597+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2021-07-26T16:03:20.507 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.680906+0000 mon.c (mon.1) 228 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2021-07-26T16:03:20.507 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.681257+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2021-07-26T16:03:20.507 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.685889+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2021-07-26T16:03:20.507 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.686949+0000 mon.c (mon.1) 229 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.507 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.687351+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.508 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.688424+0000 mon.c (mon.1) 230 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.508 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.688750+0000 mon.a (mon.0) 750 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.508 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.689687+0000 mon.c (mon.1) 231 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.509 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.690028+0000 mon.a (mon.0) 751 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.509 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.690944+0000 mon.c (mon.1) 232 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.509 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.691252+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2021-07-26T16:03:20.509 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.692790+0000 mon.c (mon.1) 233 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2021-07-26T16:03:20.509 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.693155+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2021-07-26T16:03:20.510 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.697383+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2021-07-26T16:03:20.510 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.698231+0000 mon.c (mon.1) 234 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:20.510 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.699640+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:20.510 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.700889+0000 mon.c (mon.1) 236 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:20.510 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.953424+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.511 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.958887+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:03:20.511 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.960181+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:03:20.511 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.961274+0000 mon.c (mon.1) 239 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:03:20.511 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:20 smithi096 bash[33981]: audit 2021-07-26T16:03:19.967703+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:20.520 INFO:tasks.rados.rados.0.smithi033.stdout:1727: done (4 left) 2021-07-26T16:03:20.520 INFO:tasks.rados.rados.0.smithi033.stdout:1729: done (3 left) 2021-07-26T16:03:20.520 INFO:tasks.rados.rados.0.smithi033.stdout:1730: done (2 left) 2021-07-26T16:03:20.521 INFO:tasks.rados.rados.0.smithi033.stdout:1731: done (1 left) 2021-07-26T16:03:20.521 INFO:tasks.rados.rados.0.smithi033.stdout:1732: done (0 left) 2021-07-26T16:03:20.521 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 168 2021-07-26T16:03:20.521 INFO:tasks.rados.rados.0.smithi033.stdout:1733: seq_num 542 ranges {0=679936,679936=442368,1122304=679936,1802240=81920} 2021-07-26T16:03:20.531 INFO:tasks.rados.rados.0.smithi033.stdout:1733: writing smithi03339061-22 from 0 to 679936 tid 1 2021-07-26T16:03:20.536 INFO:tasks.rados.rados.0.smithi033.stdout:1733: writing smithi03339061-22 from 679936 to 1122304 tid 2 2021-07-26T16:03:20.541 INFO:tasks.rados.rados.0.smithi033.stdout:1733: writing smithi03339061-22 from 1122304 to 1802240 tid 3 2021-07-26T16:03:20.541 INFO:tasks.rados.rados.0.smithi033.stdout:1733: writing smithi03339061-22 from 1802240 to 1884160 tid 4 2021-07-26T16:03:20.541 INFO:tasks.rados.rados.0.smithi033.stdout:1734: copy_from oid 50 from oid 15 current snap is 168 2021-07-26T16:03:20.542 INFO:tasks.rados.rados.0.smithi033.stdout:1733: finishing write tid 1 to smithi03339061-22 2021-07-26T16:03:20.542 INFO:tasks.rados.rados.0.smithi033.stdout:1733: finishing write tid 2 to smithi03339061-22 2021-07-26T16:03:20.542 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 168 2021-07-26T16:03:20.542 INFO:tasks.rados.rados.0.smithi033.stdout:1735: seq_num 543 ranges {0=704512,704512=729088,1433600=475136} 2021-07-26T16:03:20.544 INFO:tasks.rados.rados.0.smithi033.stdout:1735: writing smithi03339061-8 from 0 to 704512 tid 1 2021-07-26T16:03:20.548 INFO:tasks.rados.rados.0.smithi033.stdout:1735: writing smithi03339061-8 from 704512 to 1433600 tid 2 2021-07-26T16:03:20.552 INFO:tasks.rados.rados.0.smithi033.stdout:1735: writing smithi03339061-8 from 1433600 to 1908736 tid 3 2021-07-26T16:03:20.552 INFO:tasks.rados.rados.0.smithi033.stdout:1736: copy_from oid 31 from oid 27 current snap is 168 2021-07-26T16:03:20.552 INFO:tasks.rados.rados.0.smithi033.stdout:1735: finishing write tid 1 to smithi03339061-8 2021-07-26T16:03:20.553 INFO:tasks.rados.rados.0.smithi033.stdout:1737: snap_create 2021-07-26T16:03:20.560 INFO:tasks.rados.rados.0.smithi033.stdout:1733: finishing write tid 3 to smithi03339061-22 2021-07-26T16:03:20.560 INFO:tasks.rados.rados.0.smithi033.stdout:1733: finishing write tid 4 to smithi03339061-22 2021-07-26T16:03:20.561 INFO:tasks.rados.rados.0.smithi033.stdout:1733: finishing write tid 5 to smithi03339061-22 2021-07-26T16:03:20.561 INFO:tasks.rados.rados.0.smithi033.stdout:1735: finishing write tid 2 to smithi03339061-8 2021-07-26T16:03:20.561 INFO:tasks.rados.rados.0.smithi033.stdout:1735: finishing write tid 3 to smithi03339061-8 2021-07-26T16:03:20.562 INFO:tasks.rados.rados.0.smithi033.stdout:1735: finishing write tid 4 to smithi03339061-8 2021-07-26T16:03:20.562 INFO:tasks.rados.rados.0.smithi033.stdout:1733: finishing write tid 6 to smithi03339061-22 2021-07-26T16:03:20.562 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1016 (ObjNum 542 snap 168 seq_num 542) dirty exists 2021-07-26T16:03:20.563 INFO:tasks.rados.rados.0.smithi033.stdout:1733: left oid 22 (ObjNum 542 snap 168 seq_num 542) 2021-07-26T16:03:20.563 INFO:tasks.rados.rados.0.smithi033.stdout:1735: finishing write tid 5 to smithi03339061-8 2021-07-26T16:03:20.563 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 539 (ObjNum 543 snap 168 seq_num 543) dirty exists 2021-07-26T16:03:20.564 INFO:tasks.rados.rados.0.smithi033.stdout:1735: left oid 8 (ObjNum 543 snap 168 seq_num 543) 2021-07-26T16:03:20.608 INFO:tasks.rados.rados.0.smithi033.stdout:1736: finishing copy_from to smithi03339061-31 2021-07-26T16:03:20.608 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 729 (ObjNum 442 snap 137 seq_num 442) dirty exists 2021-07-26T16:03:20.609 INFO:tasks.rados.rados.0.smithi033.stdout:1736: finishing copy_from racing read to smithi03339061-31 2021-07-26T16:03:20.625 INFO:tasks.rados.rados.0.smithi033.stdout:1734: finishing copy_from to smithi03339061-50 2021-07-26T16:03:20.625 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 646 (ObjNum 538 snap 167 seq_num 538) dirty exists 2021-07-26T16:03:20.626 INFO:tasks.rados.rados.0.smithi033.stdout:1734: finishing copy_from racing read to smithi03339061-50 2021-07-26T16:03:21.048 INFO:tasks.rados.rados.0.smithi033.stdout:1733: done (4 left) 2021-07-26T16:03:21.048 INFO:tasks.rados.rados.0.smithi033.stdout:1734: done (3 left) 2021-07-26T16:03:21.048 INFO:tasks.rados.rados.0.smithi033.stdout:1735: done (2 left) 2021-07-26T16:03:21.049 INFO:tasks.rados.rados.0.smithi033.stdout:1736: done (1 left) 2021-07-26T16:03:21.049 INFO:tasks.rados.rados.0.smithi033.stdout:1737: done (0 left) 2021-07-26T16:03:21.049 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 169 2021-07-26T16:03:21.049 INFO:tasks.rados.rados.0.smithi033.stdout:1738: seq_num 544 ranges {1589248=720896,2310144=614400,2924544=589824} 2021-07-26T16:03:21.063 INFO:tasks.rados.rados.0.smithi033.stdout:1738: writing smithi03339061-43 from 1589248 to 2310144 tid 1 2021-07-26T16:03:21.069 INFO:tasks.rados.rados.0.smithi033.stdout:1738: writing smithi03339061-43 from 2310144 to 2924544 tid 2 2021-07-26T16:03:21.072 INFO:tasks.rados.rados.0.smithi033.stdout:1738: writing smithi03339061-43 from 2924544 to 3514368 tid 3 2021-07-26T16:03:21.073 INFO:tasks.rados.rados.0.smithi033.stdout:1739: delete oid 18 current snap is 169 2021-07-26T16:03:21.079 INFO:tasks.rados.rados.0.smithi033.stdout:1739: done (1 left) 2021-07-26T16:03:21.079 INFO:tasks.rados.rados.0.smithi033.stdout:1740: read oid 13 snap -1 2021-07-26T16:03:21.079 INFO:tasks.rados.rados.0.smithi033.stdout:1740: expect (ObjNum 459 snap 144 seq_num 459) 2021-07-26T16:03:21.079 INFO:tasks.rados.rados.0.smithi033.stdout:1741: snap_create 2021-07-26T16:03:21.080 INFO:tasks.rados.rados.0.smithi033.stdout:1738: finishing write tid 1 to smithi03339061-43 2021-07-26T16:03:21.080 INFO:tasks.rados.rados.0.smithi033.stdout:1738: finishing write tid 2 to smithi03339061-43 2021-07-26T16:03:21.117 INFO:tasks.rados.rados.0.smithi033.stdout:1738: finishing write tid 3 to smithi03339061-43 2021-07-26T16:03:21.118 INFO:tasks.rados.rados.0.smithi033.stdout:1738: finishing write tid 4 to smithi03339061-43 2021-07-26T16:03:21.120 INFO:tasks.rados.rados.0.smithi033.stdout:1738: finishing write tid 5 to smithi03339061-43 2021-07-26T16:03:21.120 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 802 (ObjNum 544 snap 169 seq_num 544) dirty exists 2021-07-26T16:03:21.121 INFO:tasks.rados.rados.0.smithi033.stdout:1738: left oid 43 (ObjNum 544 snap 169 seq_num 544) 2021-07-26T16:03:21.130 INFO:tasks.rados.rados.0.smithi033.stdout:1740: expect (ObjNum 459 snap 144 seq_num 459) 2021-07-26T16:03:21.215 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:21 smithi033 bash[42377]: cephadm 2021-07-26T16:03:19.692086+0000 mgr.y (mgr.34104) 279 : cephadm [INF] Upgrade: Complete! 2021-07-26T16:03:21.215 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:21 smithi033 bash[42377]: cluster 2021-07-26T16:03:20.077625+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2021-07-26T16:03:21.215 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:21 smithi033 bash[42377]: cluster 2021-07-26T16:03:21.044562+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2021-07-26T16:03:21.216 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:21 smithi033 bash[41341]: cephadm 2021-07-26T16:03:19.692086+0000 mgr.y (mgr.34104) 279 : cephadm [INF] Upgrade: Complete! 2021-07-26T16:03:21.216 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:21 smithi033 bash[41341]: cluster 2021-07-26T16:03:20.077625+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2021-07-26T16:03:21.216 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:21 smithi033 bash[41341]: cluster 2021-07-26T16:03:21.044562+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2021-07-26T16:03:21.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:21 smithi096 bash[33981]: cephadm 2021-07-26T16:03:19.692086+0000 mgr.y (mgr.34104) 279 : cephadm [INF] Upgrade: Complete! 2021-07-26T16:03:21.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:21 smithi096 bash[33981]: cluster 2021-07-26T16:03:20.077625+0000 mon.a (mon.0) 757 : cluster [DBG] osdmap e403: 8 total, 8 up, 8 in 2021-07-26T16:03:21.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:21 smithi096 bash[33981]: cluster 2021-07-26T16:03:21.044562+0000 mon.a (mon.0) 758 : cluster [DBG] osdmap e404: 8 total, 8 up, 8 in 2021-07-26T16:03:22.068 INFO:tasks.rados.rados.0.smithi033.stdout:1738: done (2 left) 2021-07-26T16:03:22.068 INFO:tasks.rados.rados.0.smithi033.stdout:1740: done (1 left) 2021-07-26T16:03:22.069 INFO:tasks.rados.rados.0.smithi033.stdout:1741: done (0 left) 2021-07-26T16:03:22.069 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 170 2021-07-26T16:03:22.069 INFO:tasks.rados.rados.0.smithi033.stdout:1742: seq_num 546 ranges {0=753664,753664=778240,1531904=425984} 2021-07-26T16:03:22.078 INFO:tasks.rados.rados.0.smithi033.stdout:1742: writing smithi03339061-7 from 0 to 753664 tid 1 2021-07-26T16:03:22.083 INFO:tasks.rados.rados.0.smithi033.stdout:1742: writing smithi03339061-7 from 753664 to 1531904 tid 2 2021-07-26T16:03:22.087 INFO:tasks.rados.rados.0.smithi033.stdout:1742: writing smithi03339061-7 from 1531904 to 1957888 tid 3 2021-07-26T16:03:22.087 INFO:tasks.rados.rados.0.smithi033.stdout:1743: read oid 43 snap -1 2021-07-26T16:03:22.087 INFO:tasks.rados.rados.0.smithi033.stdout:1743: expect (ObjNum 544 snap 169 seq_num 544) 2021-07-26T16:03:22.088 INFO:tasks.rados.rados.0.smithi033.stdout:1744: snap_remove snap 168 2021-07-26T16:03:22.103 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -e sha1=bccf07c244ef1754a7e8d345570b6a04f2ee5a7e -- bash -c 'ceph orch ps' 2021-07-26T16:03:22.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:22 smithi033 bash[42377]: audit 2021-07-26T16:03:20.919641+0000 mgr.y (mgr.34104) 280 : audit [DBG] from='client.44296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:03:22.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:22 smithi033 bash[42377]: cluster 2021-07-26T16:03:21.060472+0000 mgr.y (mgr.34104) 281 : cluster [DBG] pgmap v417: 25 pgs: 25 active+clean; 307 MiB data, 926 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.1 MiB/s wr, 6 op/s 2021-07-26T16:03:22.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:22 smithi033 bash[42377]: cluster 2021-07-26T16:03:22.065176+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2021-07-26T16:03:22.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:22 smithi033 bash[41341]: audit 2021-07-26T16:03:20.919641+0000 mgr.y (mgr.34104) 280 : audit [DBG] from='client.44296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:03:22.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:22 smithi033 bash[41341]: cluster 2021-07-26T16:03:21.060472+0000 mgr.y (mgr.34104) 281 : cluster [DBG] pgmap v417: 25 pgs: 25 active+clean; 307 MiB data, 926 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.1 MiB/s wr, 6 op/s 2021-07-26T16:03:22.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:22 smithi033 bash[41341]: cluster 2021-07-26T16:03:22.065176+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2021-07-26T16:03:22.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:22 smithi096 bash[33981]: audit 2021-07-26T16:03:20.919641+0000 mgr.y (mgr.34104) 280 : audit [DBG] from='client.44296 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:03:22.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:22 smithi096 bash[33981]: cluster 2021-07-26T16:03:21.060472+0000 mgr.y (mgr.34104) 281 : cluster [DBG] pgmap v417: 25 pgs: 25 active+clean; 307 MiB data, 926 MiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.1 MiB/s wr, 6 op/s 2021-07-26T16:03:22.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:22 smithi096 bash[33981]: cluster 2021-07-26T16:03:22.065176+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e405: 8 total, 8 up, 8 in 2021-07-26T16:03:23.071 INFO:tasks.rados.rados.0.smithi033.stdout:1744: done (2 left) 2021-07-26T16:03:23.071 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 170 2021-07-26T16:03:23.071 INFO:tasks.rados.rados.0.smithi033.stdout:1742: finishing write tid 1 to smithi03339061-7 2021-07-26T16:03:23.072 INFO:tasks.rados.rados.0.smithi033.stdout:1745: seq_num 547 ranges {6201344=770048,6971392=663552,7634944=466944,8101888=73728} 2021-07-26T16:03:23.109 INFO:tasks.rados.rados.0.smithi033.stdout:1745: writing smithi03339061-25 from 6201344 to 6971392 tid 1 2021-07-26T16:03:23.112 INFO:tasks.rados.rados.0.smithi033.stdout:1745: writing smithi03339061-25 from 6971392 to 7634944 tid 2 2021-07-26T16:03:23.115 INFO:tasks.rados.rados.0.smithi033.stdout:1745: writing smithi03339061-25 from 7634944 to 8101888 tid 3 2021-07-26T16:03:23.115 INFO:tasks.rados.rados.0.smithi033.stdout:1745: writing smithi03339061-25 from 8101888 to 8175616 tid 4 2021-07-26T16:03:23.116 INFO:tasks.rados.rados.0.smithi033.stdout:1746: snap_remove snap 165 2021-07-26T16:03:24.080 INFO:tasks.rados.rados.0.smithi033.stdout:1746: done (3 left) 2021-07-26T16:03:24.080 INFO:tasks.rados.rados.0.smithi033.stdout:1747: setattr oid 40 current snap is 170 2021-07-26T16:03:24.080 INFO:tasks.rados.rados.0.smithi033.stdout:1742: finishing write tid 2 to smithi03339061-7 2021-07-26T16:03:24.081 INFO:tasks.rados.rados.0.smithi033.stdout:1742: finishing write tid 3 to smithi03339061-7 2021-07-26T16:03:24.081 INFO:tasks.rados.rados.0.smithi033.stdout:1742: finishing write tid 4 to smithi03339061-7 2021-07-26T16:03:24.081 INFO:tasks.rados.rados.0.smithi033.stdout:1742: finishing write tid 5 to smithi03339061-7 2021-07-26T16:03:24.081 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 757 (ObjNum 546 snap 170 seq_num 546) dirty exists 2021-07-26T16:03:24.081 INFO:tasks.rados.rados.0.smithi033.stdout:1742: left oid 7 (ObjNum 546 snap 170 seq_num 546) 2021-07-26T16:03:24.082 INFO:tasks.rados.rados.0.smithi033.stdout:1743: expect (ObjNum 544 snap 169 seq_num 544) 2021-07-26T16:03:24.204 INFO:tasks.rados.rados.0.smithi033.stdout:1745: finishing write tid 1 to smithi03339061-25 2021-07-26T16:03:24.205 INFO:tasks.rados.rados.0.smithi033.stdout:1745: finishing write tid 2 to smithi03339061-25 2021-07-26T16:03:24.205 INFO:tasks.rados.rados.0.smithi033.stdout:1745: finishing write tid 3 to smithi03339061-25 2021-07-26T16:03:24.206 INFO:tasks.rados.rados.0.smithi033.stdout:1745: finishing write tid 4 to smithi03339061-25 2021-07-26T16:03:24.206 INFO:tasks.rados.rados.0.smithi033.stdout:1745: finishing write tid 5 to smithi03339061-25 2021-07-26T16:03:24.206 INFO:tasks.rados.rados.0.smithi033.stdout:1745: finishing write tid 6 to smithi03339061-25 2021-07-26T16:03:24.206 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 803 (ObjNum 547 snap 170 seq_num 547) dirty exists 2021-07-26T16:03:24.207 INFO:tasks.rados.rados.0.smithi033.stdout:1745: left oid 25 (ObjNum 547 snap 170 seq_num 547) 2021-07-26T16:03:24.210 INFO:tasks.rados.rados.0.smithi033.stdout:1742: done (3 left) 2021-07-26T16:03:24.210 INFO:tasks.rados.rados.0.smithi033.stdout:1743: done (2 left) 2021-07-26T16:03:24.210 INFO:tasks.rados.rados.0.smithi033.stdout:1745: done (1 left) 2021-07-26T16:03:24.211 INFO:tasks.rados.rados.0.smithi033.stdout:1748: copy_from oid 22 from oid 29 current snap is 170 2021-07-26T16:03:24.211 INFO:tasks.rados.rados.0.smithi033.stdout:1749: rmattr oid 38 current snap is 170 2021-07-26T16:03:24.211 INFO:tasks.rados.rados.0.smithi033.stdout:1750: rollback oid 12 current snap is 170 2021-07-26T16:03:24.211 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 12 to 167 2021-07-26T16:03:24.211 INFO:tasks.rados.rados.0.smithi033.stdout:1751: snap_create 2021-07-26T16:03:24.217 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 702 (ObjNum 527 snap 163 seq_num 527) dirty exists 2021-07-26T16:03:24.219 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 501 (ObjNum 1 snap 32561 seq_num 2007137856) dirty exists 2021-07-26T16:03:24.220 INFO:tasks.rados.rados.0.smithi033.stdout:1750: finishing rollback tid 0 to smithi03339061-12 2021-07-26T16:03:24.220 INFO:tasks.rados.rados.0.smithi033.stdout:1750: finishing rollback tid 1 to smithi03339061-12 2021-07-26T16:03:24.221 INFO:tasks.rados.rados.0.smithi033.stdout:1750: finishing rollback tid 2 to smithi03339061-12 2021-07-26T16:03:24.221 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 835 (ObjNum 472 snap 148 seq_num 472) dirty exists 2021-07-26T16:03:24.270 INFO:tasks.rados.rados.0.smithi033.stdout:1748: finishing copy_from to smithi03339061-22 2021-07-26T16:03:24.270 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 802 (ObjNum 517 snap 161 seq_num 517) dirty exists 2021-07-26T16:03:24.271 INFO:tasks.rados.rados.0.smithi033.stdout:1748: finishing copy_from racing read to smithi03339061-22 2021-07-26T16:03:24.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:24 smithi033 bash[42377]: cluster 2021-07-26T16:03:23.061588+0000 mgr.y (mgr.34104) 282 : cluster [DBG] pgmap v419: 25 pgs: 25 active+clean; 310 MiB data, 959 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 6.1 MiB/s wr, 13 op/s 2021-07-26T16:03:24.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:24 smithi033 bash[42377]: cluster 2021-07-26T16:03:23.065979+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2021-07-26T16:03:24.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:24 smithi033 bash[41341]: cluster 2021-07-26T16:03:23.061588+0000 mgr.y (mgr.34104) 282 : cluster [DBG] pgmap v419: 25 pgs: 25 active+clean; 310 MiB data, 959 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 6.1 MiB/s wr, 13 op/s 2021-07-26T16:03:24.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:24 smithi033 bash[41341]: cluster 2021-07-26T16:03:23.065979+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2021-07-26T16:03:24.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:24 smithi096 bash[33981]: cluster 2021-07-26T16:03:23.061588+0000 mgr.y (mgr.34104) 282 : cluster [DBG] pgmap v419: 25 pgs: 25 active+clean; 310 MiB data, 959 MiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 6.1 MiB/s wr, 13 op/s 2021-07-26T16:03:24.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:24 smithi096 bash[33981]: cluster 2021-07-26T16:03:23.065979+0000 mon.a (mon.0) 760 : cluster [DBG] osdmap e406: 8 total, 8 up, 8 in 2021-07-26T16:03:25.092 INFO:tasks.rados.rados.0.smithi033.stdout:1747: done (4 left) 2021-07-26T16:03:25.093 INFO:tasks.rados.rados.0.smithi033.stdout:1748: done (3 left) 2021-07-26T16:03:25.093 INFO:tasks.rados.rados.0.smithi033.stdout:1749: done (2 left) 2021-07-26T16:03:25.093 INFO:tasks.rados.rados.0.smithi033.stdout:1750: done (1 left) 2021-07-26T16:03:25.094 INFO:tasks.rados.rados.0.smithi033.stdout:1751: done (0 left) 2021-07-26T16:03:25.094 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 171 2021-07-26T16:03:25.094 INFO:tasks.rados.rados.0.smithi033.stdout:1752: seq_num 548 ranges {0=786432,786432=598016,1384448=606208} 2021-07-26T16:03:25.100 INFO:tasks.rados.rados.0.smithi033.stdout:1752: writing smithi03339061-18 from 0 to 786432 tid 1 2021-07-26T16:03:25.103 INFO:tasks.rados.rados.0.smithi033.stdout:1752: writing smithi03339061-18 from 786432 to 1384448 tid 2 2021-07-26T16:03:25.110 INFO:tasks.rados.rados.0.smithi033.stdout:1752: writing smithi03339061-18 from 1384448 to 1990656 tid 3 2021-07-26T16:03:25.111 INFO:tasks.rados.rados.0.smithi033.stdout:1753: snap_create 2021-07-26T16:03:25.111 INFO:tasks.rados.rados.0.smithi033.stdout:1752: finishing write tid 1 to smithi03339061-18 2021-07-26T16:03:25.112 INFO:tasks.rados.rados.0.smithi033.stdout:1752: finishing write tid 2 to smithi03339061-18 2021-07-26T16:03:25.113 INFO:tasks.rados.rados.0.smithi033.stdout:1752: finishing write tid 3 to smithi03339061-18 2021-07-26T16:03:25.113 INFO:tasks.rados.rados.0.smithi033.stdout:1752: finishing write tid 4 to smithi03339061-18 2021-07-26T16:03:25.118 INFO:tasks.rados.rados.0.smithi033.stdout:1752: finishing write tid 5 to smithi03339061-18 2021-07-26T16:03:25.118 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 1030 (ObjNum 548 snap 171 seq_num 548) dirty exists 2021-07-26T16:03:25.119 INFO:tasks.rados.rados.0.smithi033.stdout:1752: left oid 18 (ObjNum 548 snap 171 seq_num 548) 2021-07-26T16:03:25.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:25 smithi033 bash[41341]: cluster 2021-07-26T16:03:24.074506+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2021-07-26T16:03:25.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:25 smithi033 bash[41341]: audit 2021-07-26T16:03:24.688275+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:25.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:25 smithi033 bash[42377]: cluster 2021-07-26T16:03:24.074506+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2021-07-26T16:03:25.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:25 smithi033 bash[42377]: audit 2021-07-26T16:03:24.688275+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:25.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:25 smithi096 bash[33981]: cluster 2021-07-26T16:03:24.074506+0000 mon.a (mon.0) 761 : cluster [DBG] osdmap e407: 8 total, 8 up, 8 in 2021-07-26T16:03:25.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:25 smithi096 bash[33981]: audit 2021-07-26T16:03:24.688275+0000 mon.a (mon.0) 762 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:03:26.002 INFO:teuthology.orchestra.run.smithi033.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2021-07-26T16:03:26.002 INFO:teuthology.orchestra.run.smithi033.stdout:alertmanager.a smithi033 *:9093,9094 running (24s) 19s ago 10m 10.0M - 0.20.0 0881eb8f169f 494e93537cfb 2021-07-26T16:03:26.002 INFO:teuthology.orchestra.run.smithi033.stdout:grafana.a smithi096 *:3000 running (11s) 6s ago 10m 18.7M - 6.7.4 3b1077a63311 c708def6dae3 2021-07-26T16:03:26.003 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.x smithi096 *:8443 running (5m) 6s ago 14m 373M - 17.0.0-6381-gbccf07c2 6cdb40438e66 909ec99bd712 2021-07-26T16:03:26.003 INFO:teuthology.orchestra.run.smithi033.stdout:mgr.y smithi033 *:8443 running (5m) 19s ago 17m 420M - 17.0.0-6381-gbccf07c2 6cdb40438e66 1fddebc25b31 2021-07-26T16:03:26.003 INFO:teuthology.orchestra.run.smithi033.stdout:mon.a smithi033 running (5m) 19s ago 17m 57.2M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 7649338580a7 2021-07-26T16:03:26.003 INFO:teuthology.orchestra.run.smithi033.stdout:mon.b smithi096 running (4m) 6s ago 15m 45.0M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 5a3d2fea4cb3 2021-07-26T16:03:26.004 INFO:teuthology.orchestra.run.smithi033.stdout:mon.c smithi033 running (5m) 19s ago 15m 47.4M 2048M 17.0.0-6381-gbccf07c2 6cdb40438e66 76ce8786552e 2021-07-26T16:03:26.004 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.a smithi033 *:9100 running (58s) 19s ago 10m 9276k - 0.18.1 e5a616e4b9cf 6b78d170c031 2021-07-26T16:03:26.004 INFO:teuthology.orchestra.run.smithi033.stdout:node-exporter.b smithi096 *:9100 running (49s) 6s ago 10m 8892k - 0.18.1 e5a616e4b9cf ff3f734afbfe 2021-07-26T16:03:26.004 INFO:teuthology.orchestra.run.smithi033.stdout:osd.0 smithi033 running (4m) 19s ago 14m 178M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 7275343c45f7 2021-07-26T16:03:26.004 INFO:teuthology.orchestra.run.smithi033.stdout:osd.1 smithi033 running (3m) 19s ago 13m 189M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 778afc05022e 2021-07-26T16:03:26.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.2 smithi033 running (3m) 19s ago 13m 128M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 e78ad82b00b5 2021-07-26T16:03:26.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.3 smithi033 running (2m) 19s ago 12m 222M 3553M 17.0.0-6381-gbccf07c2 6cdb40438e66 315a7c006da7 2021-07-26T16:03:26.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.4 smithi096 running (2m) 6s ago 12m 205M 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 545d7f10ed9e 2021-07-26T16:03:26.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.5 smithi096 running (2m) 6s ago 12m 132M 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 1c135b673521 2021-07-26T16:03:26.005 INFO:teuthology.orchestra.run.smithi033.stdout:osd.6 smithi096 running (94s) 6s ago 11m 163M 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 edd8a674092a 2021-07-26T16:03:26.006 INFO:teuthology.orchestra.run.smithi033.stdout:osd.7 smithi096 running (66s) 6s ago 11m 128M 3552M 17.0.0-6381-gbccf07c2 6cdb40438e66 e93762a78988 2021-07-26T16:03:26.006 INFO:teuthology.orchestra.run.smithi033.stdout:prometheus.a smithi096 *:9095 running (37s) 6s ago 10m 29.6M - 2.18.1 de242295e225 6c2ae6af8626 2021-07-26T16:03:26.059 INFO:tasks.rados.rados.0.smithi033.stdout:1752: done (1 left) 2021-07-26T16:03:26.059 INFO:tasks.rados.rados.0.smithi033.stdout:1753: done (0 left) 2021-07-26T16:03:26.060 INFO:tasks.rados.rados.0.smithi033.stdout:1754: setattr oid 44 current snap is 172 2021-07-26T16:03:26.060 INFO:tasks.rados.rados.0.smithi033.stdout:1755: rollback oid 20 current snap is 172 2021-07-26T16:03:26.060 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 20 to 166 2021-07-26T16:03:26.060 INFO:tasks.rados.rados.0.smithi033.stdout:1756: snap_remove snap 169 2021-07-26T16:03:26.468 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:26 smithi033 bash[41341]: cluster 2021-07-26T16:03:25.062429+0000 mgr.y (mgr.34104) 283 : cluster [DBG] pgmap v422: 25 pgs: 25 active+clean; 320 MiB data, 970 MiB used, 714 GiB / 715 GiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 12 op/s 2021-07-26T16:03:26.468 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:26 smithi033 bash[41341]: cluster 2021-07-26T16:03:25.086643+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2021-07-26T16:03:26.468 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:26 smithi033 bash[41341]: cluster 2021-07-26T16:03:26.053459+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2021-07-26T16:03:26.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:26 smithi033 bash[42377]: cluster 2021-07-26T16:03:25.062429+0000 mgr.y (mgr.34104) 283 : cluster [DBG] pgmap v422: 25 pgs: 25 active+clean; 320 MiB data, 970 MiB used, 714 GiB / 715 GiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 12 op/s 2021-07-26T16:03:26.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:26 smithi033 bash[42377]: cluster 2021-07-26T16:03:25.086643+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2021-07-26T16:03:26.469 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:26 smithi033 bash[42377]: cluster 2021-07-26T16:03:26.053459+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2021-07-26T16:03:26.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:26 smithi096 bash[33981]: cluster 2021-07-26T16:03:25.062429+0000 mgr.y (mgr.34104) 283 : cluster [DBG] pgmap v422: 25 pgs: 25 active+clean; 320 MiB data, 970 MiB used, 714 GiB / 715 GiB avail; 3.2 MiB/s rd, 7.0 MiB/s wr, 12 op/s 2021-07-26T16:03:26.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:26 smithi096 bash[33981]: cluster 2021-07-26T16:03:25.086643+0000 mon.a (mon.0) 763 : cluster [DBG] osdmap e408: 8 total, 8 up, 8 in 2021-07-26T16:03:26.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:26 smithi096 bash[33981]: cluster 2021-07-26T16:03:26.053459+0000 mon.a (mon.0) 764 : cluster [DBG] osdmap e409: 8 total, 8 up, 8 in 2021-07-26T16:03:26.808 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -e sha1=bccf07c244ef1754a7e8d345570b6a04f2ee5a7e -- bash -c 'ceph versions' 2021-07-26T16:03:27.072 INFO:tasks.rados.rados.0.smithi033.stdout:1756: done (2 left) 2021-07-26T16:03:27.072 INFO:tasks.rados.rados.0.smithi033.stdout:1757: copy_from oid 39 from oid 18 current snap is 172 2021-07-26T16:03:27.073 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 172 2021-07-26T16:03:27.073 INFO:tasks.rados.rados.0.smithi033.stdout:1758: seq_num 549 ranges {0=802816,802816=483328,1286144=434176,1720320=286720} 2021-07-26T16:03:27.078 INFO:tasks.rados.rados.0.smithi033.stdout:1758: writing smithi03339061-24 from 0 to 802816 tid 1 2021-07-26T16:03:27.081 INFO:tasks.rados.rados.0.smithi033.stdout:1758: writing smithi03339061-24 from 802816 to 1286144 tid 2 2021-07-26T16:03:27.095 INFO:tasks.rados.rados.0.smithi033.stdout:1758: writing smithi03339061-24 from 1286144 to 1720320 tid 3 2021-07-26T16:03:27.096 INFO:tasks.rados.rados.0.smithi033.stdout:1758: writing smithi03339061-24 from 1720320 to 2007040 tid 4 2021-07-26T16:03:27.096 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 172 2021-07-26T16:03:27.096 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 681 (ObjNum 441 snap 137 seq_num 441) dirty exists 2021-07-26T16:03:27.096 INFO:tasks.rados.rados.0.smithi033.stdout:1759: seq_num 550 ranges {12967936=417792,13385728=770048,14155776=638976,14794752=196608} 2021-07-26T16:03:27.163 INFO:tasks.rados.rados.0.smithi033.stdout:1759: writing smithi03339061-29 from 12967936 to 13385728 tid 1 2021-07-26T16:03:27.167 INFO:tasks.rados.rados.0.smithi033.stdout:1759: writing smithi03339061-29 from 13385728 to 14155776 tid 2 2021-07-26T16:03:27.171 INFO:tasks.rados.rados.0.smithi033.stdout:1759: writing smithi03339061-29 from 14155776 to 14794752 tid 3 2021-07-26T16:03:27.172 INFO:tasks.rados.rados.0.smithi033.stdout:1759: writing smithi03339061-29 from 14794752 to 14991360 tid 4 2021-07-26T16:03:27.172 INFO:tasks.rados.rados.0.smithi033.stdout:1754: done (4 left) 2021-07-26T16:03:27.173 INFO:tasks.rados.rados.0.smithi033.stdout:1760: read oid 31 snap -1 2021-07-26T16:03:27.173 INFO:tasks.rados.rados.0.smithi033.stdout:1760: expect (ObjNum 442 snap 137 seq_num 442) 2021-07-26T16:03:27.173 INFO:tasks.rados.rados.0.smithi033.stdout:1761: snap_remove snap 167 2021-07-26T16:03:27.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:27 smithi033 bash[41341]: audit 2021-07-26T16:03:25.987134+0000 mgr.y (mgr.34104) 284 : audit [DBG] from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:03:27.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:27 smithi033 bash[41341]: cluster 2021-07-26T16:03:27.065233+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2021-07-26T16:03:27.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:27 smithi033 bash[42377]: audit 2021-07-26T16:03:25.987134+0000 mgr.y (mgr.34104) 284 : audit [DBG] from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:03:27.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:27 smithi033 bash[42377]: cluster 2021-07-26T16:03:27.065233+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2021-07-26T16:03:27.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:27 smithi096 bash[33981]: audit 2021-07-26T16:03:25.987134+0000 mgr.y (mgr.34104) 284 : audit [DBG] from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2021-07-26T16:03:27.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:27 smithi096 bash[33981]: cluster 2021-07-26T16:03:27.065233+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e410: 8 total, 8 up, 8 in 2021-07-26T16:03:28.102 INFO:tasks.rados.rados.0.smithi033.stdout:1755: finishing rollback tid 0 to smithi03339061-20 2021-07-26T16:03:28.102 INFO:tasks.rados.rados.0.smithi033.stdout:1755: finishing rollback tid 1 to smithi03339061-20 2021-07-26T16:03:28.102 INFO:tasks.rados.rados.0.smithi033.stdout:1755: finishing rollback tid 2 to smithi03339061-20 2021-07-26T16:03:28.103 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 684 (ObjNum 537 snap 165 seq_num 537) dirty exists 2021-07-26T16:03:28.103 INFO:tasks.rados.rados.0.smithi033.stdout:1758: finishing write tid 1 to smithi03339061-24 2021-07-26T16:03:28.103 INFO:tasks.rados.rados.0.smithi033.stdout:1758: finishing write tid 2 to smithi03339061-24 2021-07-26T16:03:28.103 INFO:tasks.rados.rados.0.smithi033.stdout:1757: finishing copy_from to smithi03339061-39 2021-07-26T16:03:28.103 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1030 (ObjNum 548 snap 171 seq_num 548) dirty exists 2021-07-26T16:03:28.104 INFO:tasks.rados.rados.0.smithi033.stdout:1757: finishing copy_from racing read to smithi03339061-39 2021-07-26T16:03:28.104 INFO:tasks.rados.rados.0.smithi033.stdout:1758: finishing write tid 3 to smithi03339061-24 2021-07-26T16:03:28.104 INFO:tasks.rados.rados.0.smithi033.stdout:1758: finishing write tid 4 to smithi03339061-24 2021-07-26T16:03:28.104 INFO:tasks.rados.rados.0.smithi033.stdout:1758: finishing write tid 5 to smithi03339061-24 2021-07-26T16:03:28.105 INFO:tasks.rados.rados.0.smithi033.stdout:1758: finishing write tid 6 to smithi03339061-24 2021-07-26T16:03:28.105 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 849 (ObjNum 549 snap 172 seq_num 549) dirty exists 2021-07-26T16:03:28.105 INFO:tasks.rados.rados.0.smithi033.stdout:1758: left oid 24 (ObjNum 549 snap 172 seq_num 549) 2021-07-26T16:03:28.105 INFO:tasks.rados.rados.0.smithi033.stdout:1759: finishing write tid 1 to smithi03339061-29 2021-07-26T16:03:28.105 INFO:tasks.rados.rados.0.smithi033.stdout:1759: finishing write tid 2 to smithi03339061-29 2021-07-26T16:03:28.106 INFO:tasks.rados.rados.0.smithi033.stdout:1759: finishing write tid 3 to smithi03339061-29 2021-07-26T16:03:28.106 INFO:tasks.rados.rados.0.smithi033.stdout:1759: finishing write tid 4 to smithi03339061-29 2021-07-26T16:03:28.106 INFO:tasks.rados.rados.0.smithi033.stdout:1759: finishing write tid 5 to smithi03339061-29 2021-07-26T16:03:28.106 INFO:tasks.rados.rados.0.smithi033.stdout:1759: finishing write tid 6 to smithi03339061-29 2021-07-26T16:03:28.106 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 808 (ObjNum 550 snap 172 seq_num 550) dirty exists 2021-07-26T16:03:28.107 INFO:tasks.rados.rados.0.smithi033.stdout:1759: left oid 29 (ObjNum 550 snap 172 seq_num 550) 2021-07-26T16:03:28.107 INFO:tasks.rados.rados.0.smithi033.stdout:1760: expect (ObjNum 442 snap 137 seq_num 442) 2021-07-26T16:03:28.427 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:28 smithi033 bash[41341]: cluster 2021-07-26T16:03:27.063553+0000 mgr.y (mgr.34104) 285 : cluster [DBG] pgmap v426: 25 pgs: 25 active+clean; 324 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 11 op/s 2021-07-26T16:03:28.427 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:28 smithi033 bash[42377]: cluster 2021-07-26T16:03:27.063553+0000 mgr.y (mgr.34104) 285 : cluster [DBG] pgmap v426: 25 pgs: 25 active+clean; 324 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 11 op/s 2021-07-26T16:03:28.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:28 smithi096 bash[33981]: cluster 2021-07-26T16:03:27.063553+0000 mgr.y (mgr.34104) 285 : cluster [DBG] pgmap v426: 25 pgs: 25 active+clean; 324 MiB data, 996 MiB used, 714 GiB / 715 GiB avail; 4.3 MiB/s rd, 3.4 MiB/s wr, 11 op/s 2021-07-26T16:03:28.808 INFO:tasks.rados.rados.0.smithi033.stdout:1755: done (5 left) 2021-07-26T16:03:28.808 INFO:tasks.rados.rados.0.smithi033.stdout:1757: done (4 left) 2021-07-26T16:03:28.808 INFO:tasks.rados.rados.0.smithi033.stdout:1758: done (3 left) 2021-07-26T16:03:28.808 INFO:tasks.rados.rados.0.smithi033.stdout:1759: done (2 left) 2021-07-26T16:03:28.809 INFO:tasks.rados.rados.0.smithi033.stdout:1760: done (1 left) 2021-07-26T16:03:28.809 INFO:tasks.rados.rados.0.smithi033.stdout:1761: done (0 left) 2021-07-26T16:03:28.809 INFO:tasks.rados.rados.0.smithi033.stdout:1762: delete oid 12 current snap is 172 2021-07-26T16:03:28.812 INFO:tasks.rados.rados.0.smithi033.stdout:1762: done (0 left) 2021-07-26T16:03:28.812 INFO:tasks.rados.rados.0.smithi033.stdout:1763: read oid 19 snap -1 2021-07-26T16:03:28.813 INFO:tasks.rados.rados.0.smithi033.stdout:1763: expect deleted 2021-07-26T16:03:28.813 INFO:tasks.rados.rados.0.smithi033.stdout:1764: snap_remove snap 164 2021-07-26T16:03:29.126 INFO:tasks.rados.rados.0.smithi033.stdout:1763: done (1 left) 2021-07-26T16:03:29.127 INFO:tasks.rados.rados.0.smithi033.stdout:1764: done (0 left) 2021-07-26T16:03:29.127 INFO:tasks.rados.rados.0.smithi033.stdout:1765: copy_from oid 34 from oid 35 current snap is 172 2021-07-26T16:03:29.127 INFO:tasks.rados.rados.0.smithi033.stdout:1766: copy_from oid 45 from oid 31 current snap is 172 2021-07-26T16:03:29.127 INFO:tasks.rados.rados.0.smithi033.stdout:1767: snap_remove snap 156 2021-07-26T16:03:29.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:29 smithi033 bash[41341]: cluster 2021-07-26T16:03:28.093314+0000 mon.a (mon.0) 766 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2021-07-26T16:03:29.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:29 smithi033 bash[42377]: cluster 2021-07-26T16:03:28.093314+0000 mon.a (mon.0) 766 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2021-07-26T16:03:29.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:29 smithi096 bash[33981]: cluster 2021-07-26T16:03:28.093314+0000 mon.a (mon.0) 766 : cluster [DBG] osdmap e411: 8 total, 8 up, 8 in 2021-07-26T16:03:30.144 INFO:tasks.rados.rados.0.smithi033.stdout:1767: done (2 left) 2021-07-26T16:03:30.144 INFO:tasks.rados.rados.0.smithi033.stdout:1768: setattr oid 32 current snap is 172 2021-07-26T16:03:30.144 INFO:tasks.rados.rados.0.smithi033.stdout:1765: finishing copy_from to smithi03339061-34 2021-07-26T16:03:30.145 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 496 (ObjNum 476 snap 148 seq_num 476) dirty exists 2021-07-26T16:03:30.145 INFO:tasks.rados.rados.0.smithi033.stdout:1765: finishing copy_from racing read to smithi03339061-34 2021-07-26T16:03:30.145 INFO:tasks.rados.rados.0.smithi033.stdout:1766: finishing copy_from to smithi03339061-45 2021-07-26T16:03:30.145 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 729 (ObjNum 442 snap 137 seq_num 442) dirty exists 2021-07-26T16:03:30.145 INFO:tasks.rados.rados.0.smithi033.stdout:1766: finishing copy_from racing read to smithi03339061-45 2021-07-26T16:03:30.146 INFO:tasks.rados.rados.0.smithi033.stdout:1765: done (2 left) 2021-07-26T16:03:30.146 INFO:tasks.rados.rados.0.smithi033.stdout:1766: done (1 left) 2021-07-26T16:03:30.146 INFO:tasks.rados.rados.0.smithi033.stdout:1769: setattr oid 24 current snap is 172 2021-07-26T16:03:30.146 INFO:tasks.rados.rados.0.smithi033.stdout:1770: read oid 23 snap 171 2021-07-26T16:03:30.147 INFO:tasks.rados.rados.0.smithi033.stdout:1770: expect (ObjNum 521 snap 162 seq_num 521) 2021-07-26T16:03:30.147 INFO:tasks.rados.rados.0.smithi033.stdout:1771: delete oid 39 current snap is 172 2021-07-26T16:03:30.148 INFO:tasks.rados.rados.0.smithi033.stdout:1771: done (3 left) 2021-07-26T16:03:30.148 INFO:tasks.rados.rados.0.smithi033.stdout:1772: snap_create 2021-07-26T16:03:30.148 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 804 (ObjNum 519 snap 162 seq_num 519) dirty exists 2021-07-26T16:03:30.150 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 850 (ObjNum 549 snap 172 seq_num 549) dirty exists 2021-07-26T16:03:30.171 INFO:tasks.rados.rados.0.smithi033.stdout:1770: expect (ObjNum 521 snap 162 seq_num 521) 2021-07-26T16:03:30.401 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:30 smithi033 bash[42377]: cluster 2021-07-26T16:03:29.064187+0000 mgr.y (mgr.34104) 286 : cluster [DBG] pgmap v428: 25 pgs: 25 active+clean; 340 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 5.4 MiB/s wr, 13 op/s 2021-07-26T16:03:30.401 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:30 smithi033 bash[42377]: cluster 2021-07-26T16:03:29.107311+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2021-07-26T16:03:30.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:30 smithi033 bash[41341]: cluster 2021-07-26T16:03:29.064187+0000 mgr.y (mgr.34104) 286 : cluster [DBG] pgmap v428: 25 pgs: 25 active+clean; 340 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 5.4 MiB/s wr, 13 op/s 2021-07-26T16:03:30.402 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:30 smithi033 bash[41341]: cluster 2021-07-26T16:03:29.107311+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2021-07-26T16:03:30.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:30 smithi096 bash[33981]: cluster 2021-07-26T16:03:29.064187+0000 mgr.y (mgr.34104) 286 : cluster [DBG] pgmap v428: 25 pgs: 25 active+clean; 340 MiB data, 1007 MiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 5.4 MiB/s wr, 13 op/s 2021-07-26T16:03:30.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:30 smithi096 bash[33981]: cluster 2021-07-26T16:03:29.107311+0000 mon.a (mon.0) 767 : cluster [DBG] osdmap e412: 8 total, 8 up, 8 in 2021-07-26T16:03:30.791 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2021-07-26T16:03:30.791 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": { 2021-07-26T16:03:30.792 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 3 2021-07-26T16:03:30.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:03:30.792 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": { 2021-07-26T16:03:30.792 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 2 2021-07-26T16:03:30.792 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:03:30.793 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": { 2021-07-26T16:03:30.793 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 8 2021-07-26T16:03:30.793 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2021-07-26T16:03:30.793 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": {}, 2021-07-26T16:03:30.794 INFO:teuthology.orchestra.run.smithi033.stdout: "overall": { 2021-07-26T16:03:30.794 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)": 13 2021-07-26T16:03:30.794 INFO:teuthology.orchestra.run.smithi033.stdout: } 2021-07-26T16:03:30.796 INFO:teuthology.orchestra.run.smithi033.stdout:} 2021-07-26T16:03:31.056 INFO:tasks.rados.rados.0.smithi033.stdout:1768: done (3 left) 2021-07-26T16:03:31.057 INFO:tasks.rados.rados.0.smithi033.stdout:1769: done (2 left) 2021-07-26T16:03:31.057 INFO:tasks.rados.rados.0.smithi033.stdout:1770: done (1 left) 2021-07-26T16:03:31.057 INFO:tasks.rados.rados.0.smithi033.stdout:1772: done (0 left) 2021-07-26T16:03:31.057 INFO:tasks.rados.rados.0.smithi033.stdout:1773: delete oid 8 current snap is 173 2021-07-26T16:03:31.064 INFO:tasks.rados.rados.0.smithi033.stdout:1773: done (0 left) 2021-07-26T16:03:31.064 INFO:tasks.rados.rados.0.smithi033.stdout:1774: rollback oid 13 current snap is 173 2021-07-26T16:03:31.065 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 13 to 171 2021-07-26T16:03:31.065 INFO:tasks.rados.rados.0.smithi033.stdout:1775: snap_create 2021-07-26T16:03:31.072 INFO:tasks.rados.rados.0.smithi033.stdout:1774: finishing rollback tid 0 to smithi03339061-13 2021-07-26T16:03:31.072 INFO:tasks.rados.rados.0.smithi033.stdout:1774: finishing rollback tid 1 to smithi03339061-13 2021-07-26T16:03:31.072 INFO:tasks.rados.rados.0.smithi033.stdout:1774: finishing rollback tid 2 to smithi03339061-13 2021-07-26T16:03:31.072 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 687 (ObjNum 459 snap 144 seq_num 459) dirty exists 2021-07-26T16:03:31.212 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:31 smithi033 bash[41341]: cluster 2021-07-26T16:03:30.127379+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2021-07-26T16:03:31.212 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:31 smithi033 bash[41341]: audit 2021-07-26T16:03:30.784398+0000 mon.c (mon.1) 240 : audit [DBG] from='client.? 172.21.15.33:0/3025401629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:31.212 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:31 smithi033 bash[41341]: cluster 2021-07-26T16:03:31.052102+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2021-07-26T16:03:31.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:31 smithi033 bash[42377]: cluster 2021-07-26T16:03:30.127379+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2021-07-26T16:03:31.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:31 smithi033 bash[42377]: audit 2021-07-26T16:03:30.784398+0000 mon.c (mon.1) 240 : audit [DBG] from='client.? 172.21.15.33:0/3025401629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:31.213 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:31 smithi033 bash[42377]: cluster 2021-07-26T16:03:31.052102+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2021-07-26T16:03:31.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:31 smithi096 bash[33981]: cluster 2021-07-26T16:03:30.127379+0000 mon.a (mon.0) 768 : cluster [DBG] osdmap e413: 8 total, 8 up, 8 in 2021-07-26T16:03:31.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:31 smithi096 bash[33981]: audit 2021-07-26T16:03:30.784398+0000 mon.c (mon.1) 240 : audit [DBG] from='client.? 172.21.15.33:0/3025401629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:31.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:31 smithi096 bash[33981]: cluster 2021-07-26T16:03:31.052102+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e414: 8 total, 8 up, 8 in 2021-07-26T16:03:31.542 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -e sha1=bccf07c244ef1754a7e8d345570b6a04f2ee5a7e -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2021-07-26T16:03:32.068 INFO:tasks.rados.rados.0.smithi033.stdout:1774: done (1 left) 2021-07-26T16:03:32.068 INFO:tasks.rados.rados.0.smithi033.stdout:1775: done (0 left) 2021-07-26T16:03:32.069 INFO:tasks.rados.rados.0.smithi033.stdout:1776: snap_remove snap 170 2021-07-26T16:03:32.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:32 smithi033 bash[41341]: cluster 2021-07-26T16:03:31.064707+0000 mgr.y (mgr.34104) 287 : cluster [DBG] pgmap v432: 25 pgs: 25 active+clean; 341 MiB data, 1017 MiB used, 714 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.4 MiB/s wr, 13 op/s 2021-07-26T16:03:32.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:32 smithi033 bash[41341]: cluster 2021-07-26T16:03:32.062881+0000 mon.a (mon.0) 770 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2021-07-26T16:03:32.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:32 smithi033 bash[42377]: cluster 2021-07-26T16:03:31.064707+0000 mgr.y (mgr.34104) 287 : cluster [DBG] pgmap v432: 25 pgs: 25 active+clean; 341 MiB data, 1017 MiB used, 714 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.4 MiB/s wr, 13 op/s 2021-07-26T16:03:32.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:32 smithi033 bash[42377]: cluster 2021-07-26T16:03:32.062881+0000 mon.a (mon.0) 770 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2021-07-26T16:03:32.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:32 smithi096 bash[33981]: cluster 2021-07-26T16:03:31.064707+0000 mgr.y (mgr.34104) 287 : cluster [DBG] pgmap v432: 25 pgs: 25 active+clean; 341 MiB data, 1017 MiB used, 714 GiB / 715 GiB avail; 6.0 MiB/s rd, 6.4 MiB/s wr, 13 op/s 2021-07-26T16:03:32.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:32 smithi096 bash[33981]: cluster 2021-07-26T16:03:32.062881+0000 mon.a (mon.0) 770 : cluster [DBG] osdmap e415: 8 total, 8 up, 8 in 2021-07-26T16:03:33.077 INFO:tasks.rados.rados.0.smithi033.stdout:1776: done (0 left) 2021-07-26T16:03:33.077 INFO:tasks.rados.rados.0.smithi033.stdout:1777: copy_from oid 10 from oid 48 current snap is 174 2021-07-26T16:03:33.078 INFO:tasks.rados.rados.0.smithi033.stdout:1778: snap_create 2021-07-26T16:03:33.081 INFO:tasks.rados.rados.0.smithi033.stdout:1777: finishing copy_from to smithi03339061-10 2021-07-26T16:03:33.081 INFO:tasks.rados.rados.0.smithi033.stdout:1777: got expected ENOENT (src dne) 2021-07-26T16:03:33.081 INFO:tasks.rados.rados.0.smithi033.stdout:1777: finishing copy_from racing read to smithi03339061-10 2021-07-26T16:03:34.093 INFO:tasks.rados.rados.0.smithi033.stdout:1777: done (1 left) 2021-07-26T16:03:34.093 INFO:tasks.rados.rados.0.smithi033.stdout:1778: done (0 left) 2021-07-26T16:03:34.093 INFO:tasks.rados.rados.0.smithi033.stdout:1779: read oid 11 snap -1 2021-07-26T16:03:34.094 INFO:tasks.rados.rados.0.smithi033.stdout:1779: expect (ObjNum 521 snap 162 seq_num 521) 2021-07-26T16:03:34.094 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 34 current snap is 175 2021-07-26T16:03:34.094 INFO:tasks.rados.rados.0.smithi033.stdout:1780: seq_num 554 ranges {6045696=483328,6529024=704512,7233536=622592,7856128=278528} 2021-07-26T16:03:34.130 INFO:tasks.rados.rados.0.smithi033.stdout:1780: writing smithi03339061-34 from 6045696 to 6529024 tid 1 2021-07-26T16:03:34.134 INFO:tasks.rados.rados.0.smithi033.stdout:1780: writing smithi03339061-34 from 6529024 to 7233536 tid 2 2021-07-26T16:03:34.139 INFO:tasks.rados.rados.0.smithi033.stdout:1780: writing smithi03339061-34 from 7233536 to 7856128 tid 3 2021-07-26T16:03:34.139 INFO:tasks.rados.rados.0.smithi033.stdout:1780: writing smithi03339061-34 from 7856128 to 8134656 tid 4 2021-07-26T16:03:34.140 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 175 2021-07-26T16:03:34.140 INFO:tasks.rados.rados.0.smithi033.stdout:1781: seq_num 555 ranges {8372224=499712,8871936=638976,9510912=425984,9936896=540672} 2021-07-26T16:03:34.197 INFO:tasks.rados.rados.0.smithi033.stdout:1781: writing smithi03339061-45 from 8372224 to 8871936 tid 1 2021-07-26T16:03:34.198 INFO:tasks.rados.rados.0.smithi033.stdout:1781: writing smithi03339061-45 from 8871936 to 9510912 tid 2 2021-07-26T16:03:34.198 INFO:tasks.rados.rados.0.smithi033.stdout:1781: writing smithi03339061-45 from 9510912 to 9936896 tid 3 2021-07-26T16:03:34.200 INFO:tasks.rados.rados.0.smithi033.stdout:1781: writing smithi03339061-45 from 9936896 to 10477568 tid 4 2021-07-26T16:03:34.201 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 175 2021-07-26T16:03:34.201 INFO:tasks.rados.rados.0.smithi033.stdout:1782: seq_num 556 ranges {8175616=516096,8691712=524288,9216000=638976,9854976=442368} 2021-07-26T16:03:34.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:34 smithi033 bash[41341]: cluster 2021-07-26T16:03:33.065344+0000 mgr.y (mgr.34104) 288 : cluster [DBG] pgmap v434: 25 pgs: 25 active+clean; 333 MiB data, 1014 MiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 3.9 MiB/s wr, 21 op/s 2021-07-26T16:03:34.210 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:34 smithi033 bash[41341]: cluster 2021-07-26T16:03:33.071180+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2021-07-26T16:03:34.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:34 smithi033 bash[42377]: cluster 2021-07-26T16:03:33.065344+0000 mgr.y (mgr.34104) 288 : cluster [DBG] pgmap v434: 25 pgs: 25 active+clean; 333 MiB data, 1014 MiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 3.9 MiB/s wr, 21 op/s 2021-07-26T16:03:34.211 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:34 smithi033 bash[42377]: cluster 2021-07-26T16:03:33.071180+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2021-07-26T16:03:34.248 INFO:tasks.rados.rados.0.smithi033.stdout:1782: writing smithi03339061-25 from 8175616 to 8691712 tid 1 2021-07-26T16:03:34.251 INFO:tasks.rados.rados.0.smithi033.stdout:1782: writing smithi03339061-25 from 8691712 to 9216000 tid 2 2021-07-26T16:03:34.255 INFO:tasks.rados.rados.0.smithi033.stdout:1782: writing smithi03339061-25 from 9216000 to 9854976 tid 3 2021-07-26T16:03:34.258 INFO:tasks.rados.rados.0.smithi033.stdout:1782: writing smithi03339061-25 from 9854976 to 10297344 tid 4 2021-07-26T16:03:34.258 INFO:tasks.rados.rados.0.smithi033.stdout:1783: rollback oid 6 current snap is 175 2021-07-26T16:03:34.258 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 172 2021-07-26T16:03:34.258 INFO:tasks.rados.rados.0.smithi033.stdout:1779: expect (ObjNum 521 snap 162 seq_num 521) 2021-07-26T16:03:34.357 INFO:tasks.rados.rados.0.smithi033.stdout:1780: finishing write tid 1 to smithi03339061-34 2021-07-26T16:03:34.358 INFO:tasks.rados.rados.0.smithi033.stdout:1780: finishing write tid 2 to smithi03339061-34 2021-07-26T16:03:34.358 INFO:tasks.rados.rados.0.smithi033.stdout:1780: finishing write tid 3 to smithi03339061-34 2021-07-26T16:03:34.358 INFO:tasks.rados.rados.0.smithi033.stdout:1780: finishing write tid 4 to smithi03339061-34 2021-07-26T16:03:34.358 INFO:tasks.rados.rados.0.smithi033.stdout:1780: finishing write tid 5 to smithi03339061-34 2021-07-26T16:03:34.359 INFO:tasks.rados.rados.0.smithi033.stdout:1780: finishing write tid 6 to smithi03339061-34 2021-07-26T16:03:34.359 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 846 (ObjNum 554 snap 175 seq_num 554) dirty exists 2021-07-26T16:03:34.359 INFO:tasks.rados.rados.0.smithi033.stdout:1780: left oid 34 (ObjNum 554 snap 175 seq_num 554) 2021-07-26T16:03:34.359 INFO:tasks.rados.rados.0.smithi033.stdout:1781: finishing write tid 1 to smithi03339061-45 2021-07-26T16:03:34.360 INFO:tasks.rados.rados.0.smithi033.stdout:1779: done (4 left) 2021-07-26T16:03:34.360 INFO:tasks.rados.rados.0.smithi033.stdout:1780: done (3 left) 2021-07-26T16:03:34.360 INFO:tasks.rados.rados.0.smithi033.stdout:1784: setattr oid 43 current snap is 175 2021-07-26T16:03:34.360 INFO:tasks.rados.rados.0.smithi033.stdout:1781: finishing write tid 2 to smithi03339061-45 2021-07-26T16:03:34.360 INFO:tasks.rados.rados.0.smithi033.stdout:1781: finishing write tid 3 to smithi03339061-45 2021-07-26T16:03:34.361 INFO:tasks.rados.rados.0.smithi033.stdout:1781: finishing write tid 4 to smithi03339061-45 2021-07-26T16:03:34.361 INFO:tasks.rados.rados.0.smithi033.stdout:1781: finishing write tid 5 to smithi03339061-45 2021-07-26T16:03:34.361 INFO:tasks.rados.rados.0.smithi033.stdout:1781: finishing write tid 6 to smithi03339061-45 2021-07-26T16:03:34.361 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1062 (ObjNum 555 snap 175 seq_num 555) dirty exists 2021-07-26T16:03:34.361 INFO:tasks.rados.rados.0.smithi033.stdout:1781: left oid 45 (ObjNum 555 snap 175 seq_num 555) 2021-07-26T16:03:34.362 INFO:tasks.rados.rados.0.smithi033.stdout:1782: finishing write tid 1 to smithi03339061-25 2021-07-26T16:03:34.362 INFO:tasks.rados.rados.0.smithi033.stdout:1782: finishing write tid 2 to smithi03339061-25 2021-07-26T16:03:34.362 INFO:tasks.rados.rados.0.smithi033.stdout:1782: finishing write tid 3 to smithi03339061-25 2021-07-26T16:03:34.362 INFO:tasks.rados.rados.0.smithi033.stdout:1782: finishing write tid 4 to smithi03339061-25 2021-07-26T16:03:34.362 INFO:tasks.rados.rados.0.smithi033.stdout:1783: finishing rollback tid 0 to smithi03339061-6 2021-07-26T16:03:34.363 INFO:tasks.rados.rados.0.smithi033.stdout:1783: finishing rollback tid 1 to smithi03339061-6 2021-07-26T16:03:34.363 INFO:tasks.rados.rados.0.smithi033.stdout:1782: finishing write tid 5 to smithi03339061-25 2021-07-26T16:03:34.364 INFO:tasks.rados.rados.0.smithi033.stdout:1782: finishing write tid 6 to smithi03339061-25 2021-07-26T16:03:34.364 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 809 (ObjNum 556 snap 175 seq_num 556) dirty exists 2021-07-26T16:03:34.364 INFO:tasks.rados.rados.0.smithi033.stdout:1782: left oid 25 (ObjNum 556 snap 175 seq_num 556) 2021-07-26T16:03:34.364 INFO:tasks.rados.rados.0.smithi033.stdout:1783: finishing rollback tid 2 to smithi03339061-6 2021-07-26T16:03:34.364 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1066 (ObjNum 541 snap 167 seq_num 541) dirty exists 2021-07-26T16:03:34.365 INFO:tasks.rados.rados.0.smithi033.stdout:1781: done (3 left) 2021-07-26T16:03:34.366 INFO:tasks.rados.rados.0.smithi033.stdout:1782: done (2 left) 2021-07-26T16:03:34.366 INFO:tasks.rados.rados.0.smithi033.stdout:1783: done (1 left) 2021-07-26T16:03:34.366 INFO:tasks.rados.rados.0.smithi033.stdout:1785: read oid 25 snap 173 2021-07-26T16:03:34.366 INFO:tasks.rados.rados.0.smithi033.stdout:1785: expect (ObjNum 547 snap 170 seq_num 547) 2021-07-26T16:03:34.366 INFO:tasks.rados.rados.0.smithi033.stdout:1786: read oid 17 snap -1 2021-07-26T16:03:34.367 INFO:tasks.rados.rados.0.smithi033.stdout:1786: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:03:34.368 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 175 2021-07-26T16:03:34.368 INFO:tasks.rados.rados.0.smithi033.stdout:1787: seq_num 557 ranges {5390336=532480,5922816=802816,6725632=794624,7520256=8192} 2021-07-26T16:03:34.402 INFO:tasks.rados.rados.0.smithi033.stdout:1787: writing smithi03339061-9 from 5390336 to 5922816 tid 1 2021-07-26T16:03:34.407 INFO:tasks.rados.rados.0.smithi033.stdout:1787: writing smithi03339061-9 from 5922816 to 6725632 tid 2 2021-07-26T16:03:34.412 INFO:tasks.rados.rados.0.smithi033.stdout:1787: writing smithi03339061-9 from 6725632 to 7520256 tid 3 2021-07-26T16:03:34.412 INFO:tasks.rados.rados.0.smithi033.stdout:1787: writing smithi03339061-9 from 7520256 to 7528448 tid 4 2021-07-26T16:03:34.412 INFO:tasks.rados.rados.0.smithi033.stdout:1788: delete oid 29 current snap is 175 2021-07-26T16:03:34.412 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 803 (ObjNum 544 snap 169 seq_num 544) dirty exists 2021-07-26T16:03:34.413 INFO:tasks.rados.rados.0.smithi033.stdout:1786: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:03:34.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:34 smithi096 bash[33981]: cluster 2021-07-26T16:03:33.065344+0000 mgr.y (mgr.34104) 288 : cluster [DBG] pgmap v434: 25 pgs: 25 active+clean; 333 MiB data, 1014 MiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 3.9 MiB/s wr, 21 op/s 2021-07-26T16:03:34.488 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:34 smithi096 bash[33981]: cluster 2021-07-26T16:03:33.071180+0000 mon.a (mon.0) 771 : cluster [DBG] osdmap e416: 8 total, 8 up, 8 in 2021-07-26T16:03:34.613 INFO:tasks.rados.rados.0.smithi033.stdout:1785: expect (ObjNum 547 snap 170 seq_num 547) 2021-07-26T16:03:35.104 INFO:tasks.rados.rados.0.smithi033.stdout:1787: finishing write tid 1 to smithi03339061-9 2021-07-26T16:03:35.105 INFO:tasks.rados.rados.0.smithi033.stdout:1787: finishing write tid 2 to smithi03339061-9 2021-07-26T16:03:35.105 INFO:tasks.rados.rados.0.smithi033.stdout:1784: done (4 left) 2021-07-26T16:03:35.105 INFO:tasks.rados.rados.0.smithi033.stdout:1785: done (3 left) 2021-07-26T16:03:35.105 INFO:tasks.rados.rados.0.smithi033.stdout:1786: done (2 left) 2021-07-26T16:03:35.105 INFO:tasks.rados.rados.0.smithi033.stdout:1788: done (1 left) 2021-07-26T16:03:35.106 INFO:tasks.rados.rados.0.smithi033.stdout:1789: copy_from oid 45 from oid 25 current snap is 175 2021-07-26T16:03:35.106 INFO:tasks.rados.rados.0.smithi033.stdout:1787: finishing write tid 3 to smithi03339061-9 2021-07-26T16:03:35.106 INFO:tasks.rados.rados.0.smithi033.stdout:1787: finishing write tid 4 to smithi03339061-9 2021-07-26T16:03:35.106 INFO:tasks.rados.rados.0.smithi033.stdout:1787: finishing write tid 5 to smithi03339061-9 2021-07-26T16:03:35.107 INFO:tasks.rados.rados.0.smithi033.stdout:1787: finishing write tid 6 to smithi03339061-9 2021-07-26T16:03:35.107 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 553 (ObjNum 557 snap 175 seq_num 557) dirty exists 2021-07-26T16:03:35.107 INFO:tasks.rados.rados.0.smithi033.stdout:1787: left oid 9 (ObjNum 557 snap 175 seq_num 557) 2021-07-26T16:03:35.107 INFO:tasks.rados.rados.0.smithi033.stdout:1787: done (1 left) 2021-07-26T16:03:35.107 INFO:tasks.rados.rados.0.smithi033.stdout:1790: snap_create 2021-07-26T16:03:35.147 INFO:tasks.rados.rados.0.smithi033.stdout:1789: finishing copy_from to smithi03339061-45 2021-07-26T16:03:35.148 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 809 (ObjNum 556 snap 175 seq_num 556) dirty exists 2021-07-26T16:03:35.148 INFO:tasks.rados.rados.0.smithi033.stdout:1789: finishing copy_from racing read to smithi03339061-45 2021-07-26T16:03:35.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:35 smithi033 bash[42377]: cluster 2021-07-26T16:03:34.082411+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2021-07-26T16:03:35.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:35 smithi033 bash[41341]: cluster 2021-07-26T16:03:34.082411+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2021-07-26T16:03:35.490 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:35 smithi096 bash[33981]: cluster 2021-07-26T16:03:34.082411+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e417: 8 total, 8 up, 8 in 2021-07-26T16:03:35.498 INFO:teuthology.orchestra.run.smithi033.stdout:true 2021-07-26T16:03:36.060 INFO:tasks.rados.rados.0.smithi033.stdout:1789: done (1 left) 2021-07-26T16:03:36.060 INFO:tasks.rados.rados.0.smithi033.stdout:1790: done (0 left) 2021-07-26T16:03:36.061 INFO:tasks.rados.rados.0.smithi033.stdout:1791: delete oid 44 current snap is 176 2021-07-26T16:03:36.066 INFO:tasks.rados.rados.0.smithi033.stdout:1791: done (0 left) 2021-07-26T16:03:36.066 INFO:tasks.rados.rados.0.smithi033.stdout:1792: copy_from oid 39 from oid 22 current snap is 176 2021-07-26T16:03:36.066 INFO:tasks.rados.rados.0.smithi033.stdout:1793: snap_remove snap 171 2021-07-26T16:03:36.248 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -e sha1=bccf07c244ef1754a7e8d345570b6a04f2ee5a7e -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2021-07-26T16:03:36.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:36 smithi033 bash[42377]: cluster 2021-07-26T16:03:35.065940+0000 mgr.y (mgr.34104) 289 : cluster [DBG] pgmap v437: 25 pgs: 25 active+clean; 321 MiB data, 1002 MiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2021-07-26T16:03:36.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:36 smithi033 bash[42377]: audit 2021-07-26T16:03:35.482381+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.15.33:0/1596002114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:36.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:36 smithi033 bash[42377]: cluster 2021-07-26T16:03:36.056807+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2021-07-26T16:03:36.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:36 smithi033 bash[41341]: cluster 2021-07-26T16:03:35.065940+0000 mgr.y (mgr.34104) 289 : cluster [DBG] pgmap v437: 25 pgs: 25 active+clean; 321 MiB data, 1002 MiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2021-07-26T16:03:36.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:36 smithi033 bash[41341]: audit 2021-07-26T16:03:35.482381+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.15.33:0/1596002114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:36.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:36 smithi033 bash[41341]: cluster 2021-07-26T16:03:36.056807+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2021-07-26T16:03:36.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:36 smithi096 bash[33981]: cluster 2021-07-26T16:03:35.065940+0000 mgr.y (mgr.34104) 289 : cluster [DBG] pgmap v437: 25 pgs: 25 active+clean; 321 MiB data, 1002 MiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2021-07-26T16:03:36.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:36 smithi096 bash[33981]: audit 2021-07-26T16:03:35.482381+0000 mon.a (mon.0) 773 : audit [DBG] from='client.? 172.21.15.33:0/1596002114' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:36.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:36 smithi096 bash[33981]: cluster 2021-07-26T16:03:36.056807+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e418: 8 total, 8 up, 8 in 2021-07-26T16:03:37.075 INFO:tasks.rados.rados.0.smithi033.stdout:1793: done (1 left) 2021-07-26T16:03:37.075 INFO:tasks.rados.rados.0.smithi033.stdout:1794: read oid 14 snap -1 2021-07-26T16:03:37.075 INFO:tasks.rados.rados.0.smithi033.stdout:1794: expect (ObjNum 511 snap 160 seq_num 511) 2021-07-26T16:03:37.076 INFO:tasks.rados.rados.0.smithi033.stdout:1795: delete oid 30 current snap is 176 2021-07-26T16:03:37.076 INFO:tasks.rados.rados.0.smithi033.stdout:1792: finishing copy_from to smithi03339061-39 2021-07-26T16:03:37.076 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 802 (ObjNum 517 snap 161 seq_num 517) dirty exists 2021-07-26T16:03:37.077 INFO:tasks.rados.rados.0.smithi033.stdout:1792: finishing copy_from racing read to smithi03339061-39 2021-07-26T16:03:37.093 INFO:tasks.rados.rados.0.smithi033.stdout:1792: done (2 left) 2021-07-26T16:03:37.093 INFO:tasks.rados.rados.0.smithi033.stdout:1795: done (1 left) 2021-07-26T16:03:37.093 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 176 2021-07-26T16:03:37.094 INFO:tasks.rados.rados.0.smithi033.stdout:1796: seq_num 561 ranges {9846784=598016,10444800=745472,11190272=778240,11968512=81920} 2021-07-26T16:03:37.143 INFO:tasks.rados.rados.0.smithi033.stdout:1796: writing smithi03339061-42 from 9846784 to 10444800 tid 1 2021-07-26T16:03:37.147 INFO:tasks.rados.rados.0.smithi033.stdout:1796: writing smithi03339061-42 from 10444800 to 11190272 tid 2 2021-07-26T16:03:37.152 INFO:tasks.rados.rados.0.smithi033.stdout:1796: writing smithi03339061-42 from 11190272 to 11968512 tid 3 2021-07-26T16:03:37.153 INFO:tasks.rados.rados.0.smithi033.stdout:1796: writing smithi03339061-42 from 11968512 to 12050432 tid 4 2021-07-26T16:03:37.153 INFO:tasks.rados.rados.0.smithi033.stdout:1797: copy_from oid 1 from oid 8 current snap is 176 2021-07-26T16:03:37.153 INFO:tasks.rados.rados.0.smithi033.stdout:1794: expect (ObjNum 511 snap 160 seq_num 511) 2021-07-26T16:03:37.494 INFO:tasks.rados.rados.0.smithi033.stdout:1796: finishing write tid 1 to smithi03339061-42 2021-07-26T16:03:37.494 INFO:tasks.rados.rados.0.smithi033.stdout:1797: finishing copy_from to smithi03339061-1 2021-07-26T16:03:37.494 INFO:tasks.rados.rados.0.smithi033.stdout:1797: got expected ENOENT (src dne) 2021-07-26T16:03:37.495 INFO:tasks.rados.rados.0.smithi033.stdout:1797: finishing copy_from racing read to smithi03339061-1 2021-07-26T16:03:37.495 INFO:tasks.rados.rados.0.smithi033.stdout:1796: finishing write tid 2 to smithi03339061-42 2021-07-26T16:03:37.495 INFO:tasks.rados.rados.0.smithi033.stdout:1796: finishing write tid 3 to smithi03339061-42 2021-07-26T16:03:37.495 INFO:tasks.rados.rados.0.smithi033.stdout:1796: finishing write tid 4 to smithi03339061-42 2021-07-26T16:03:37.496 INFO:tasks.rados.rados.0.smithi033.stdout:1796: finishing write tid 5 to smithi03339061-42 2021-07-26T16:03:37.496 INFO:tasks.rados.rados.0.smithi033.stdout:1796: finishing write tid 6 to smithi03339061-42 2021-07-26T16:03:37.496 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 291 (ObjNum 561 snap 176 seq_num 561) dirty exists 2021-07-26T16:03:37.496 INFO:tasks.rados.rados.0.smithi033.stdout:1796: left oid 42 (ObjNum 561 snap 176 seq_num 561) 2021-07-26T16:03:37.496 INFO:tasks.rados.rados.0.smithi033.stdout:1794: done (2 left) 2021-07-26T16:03:37.497 INFO:tasks.rados.rados.0.smithi033.stdout:1796: done (1 left) 2021-07-26T16:03:37.497 INFO:tasks.rados.rados.0.smithi033.stdout:1797: done (0 left) 2021-07-26T16:03:37.497 INFO:tasks.rados.rados.0.smithi033.stdout:1798: snap_create 2021-07-26T16:03:38.082 INFO:tasks.rados.rados.0.smithi033.stdout:1798: done (0 left) 2021-07-26T16:03:38.082 INFO:tasks.rados.rados.0.smithi033.stdout:1799: delete oid 42 current snap is 177 2021-07-26T16:03:38.090 INFO:tasks.rados.rados.0.smithi033.stdout:1799: done (0 left) 2021-07-26T16:03:38.090 INFO:tasks.rados.rados.0.smithi033.stdout:1800: delete oid 48 current snap is 177 2021-07-26T16:03:38.095 INFO:tasks.rados.rados.0.smithi033.stdout:1800: done (0 left) 2021-07-26T16:03:38.096 INFO:tasks.rados.rados.0.smithi033.stdout:1801: rollback oid 47 current snap is 177 2021-07-26T16:03:38.096 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 47 to 175 2021-07-26T16:03:38.096 INFO:tasks.rados.rados.0.smithi033.stdout:1802: read oid 15 snap -1 2021-07-26T16:03:38.096 INFO:tasks.rados.rados.0.smithi033.stdout:1802: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:03:38.096 INFO:tasks.rados.rados.0.smithi033.stdout:1803: read oid 43 snap -1 2021-07-26T16:03:38.097 INFO:tasks.rados.rados.0.smithi033.stdout:1803: expect (ObjNum 544 snap 169 seq_num 544) 2021-07-26T16:03:38.097 INFO:tasks.rados.rados.0.smithi033.stdout:1804: setattr oid 37 current snap is 177 2021-07-26T16:03:38.099 INFO:tasks.rados.rados.0.smithi033.stdout:1805: read oid 41 snap 174 2021-07-26T16:03:38.099 INFO:tasks.rados.rados.0.smithi033.stdout:1805: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:03:38.099 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 177 2021-07-26T16:03:38.099 INFO:tasks.rados.rados.0.smithi033.stdout:1806: seq_num 564 ranges {2490368=655360,3145728=442368,3588096=598016,4186112=565248} 2021-07-26T16:03:38.128 INFO:tasks.rados.rados.0.smithi033.stdout:1806: writing smithi03339061-23 from 2490368 to 3145728 tid 1 2021-07-26T16:03:38.134 INFO:tasks.rados.rados.0.smithi033.stdout:1806: writing smithi03339061-23 from 3145728 to 3588096 tid 2 2021-07-26T16:03:38.138 INFO:tasks.rados.rados.0.smithi033.stdout:1806: writing smithi03339061-23 from 3588096 to 4186112 tid 3 2021-07-26T16:03:38.145 INFO:tasks.rados.rados.0.smithi033.stdout:1806: writing smithi03339061-23 from 4186112 to 4751360 tid 4 2021-07-26T16:03:38.145 INFO:tasks.rados.rados.0.smithi033.stdout:1801: finishing rollback tid 0 to smithi03339061-47 2021-07-26T16:03:38.145 INFO:tasks.rados.rados.0.smithi033.stdout:1801: finishing rollback tid 1 to smithi03339061-47 2021-07-26T16:03:38.146 INFO:tasks.rados.rados.0.smithi033.stdout:1801: finishing rollback tid 2 to smithi03339061-47 2021-07-26T16:03:38.146 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 854 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:03:38.146 INFO:tasks.rados.rados.0.smithi033.stdout:1801: done (5 left) 2021-07-26T16:03:38.146 INFO:tasks.rados.rados.0.smithi033.stdout:1807: copy_from oid 13 from oid 14 current snap is 177 2021-07-26T16:03:38.147 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 855 (ObjNum 405 snap 128 seq_num 405) dirty exists 2021-07-26T16:03:38.147 INFO:tasks.rados.rados.0.smithi033.stdout:1803: expect (ObjNum 544 snap 169 seq_num 544) 2021-07-26T16:03:38.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:38 smithi033 bash[41341]: cluster 2021-07-26T16:03:37.066555+0000 mgr.y (mgr.34104) 290 : cluster [DBG] pgmap v440: 25 pgs: 25 active+clean; 325 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 9.6 MiB/s rd, 1.5 MiB/s wr, 8 op/s 2021-07-26T16:03:38.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:38 smithi033 bash[41341]: cluster 2021-07-26T16:03:37.067025+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2021-07-26T16:03:38.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:38 smithi033 bash[42377]: cluster 2021-07-26T16:03:37.066555+0000 mgr.y (mgr.34104) 290 : cluster [DBG] pgmap v440: 25 pgs: 25 active+clean; 325 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 9.6 MiB/s rd, 1.5 MiB/s wr, 8 op/s 2021-07-26T16:03:38.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:38 smithi033 bash[42377]: cluster 2021-07-26T16:03:37.067025+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2021-07-26T16:03:38.275 INFO:tasks.rados.rados.0.smithi033.stdout:1805: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:03:38.311 INFO:tasks.rados.rados.0.smithi033.stdout:1806: finishing write tid 1 to smithi03339061-23 2021-07-26T16:03:38.311 INFO:tasks.rados.rados.0.smithi033.stdout:1806: finishing write tid 2 to smithi03339061-23 2021-07-26T16:03:38.311 INFO:tasks.rados.rados.0.smithi033.stdout:1806: finishing write tid 3 to smithi03339061-23 2021-07-26T16:03:38.312 INFO:tasks.rados.rados.0.smithi033.stdout:1802: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:03:38.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:38 smithi096 bash[33981]: cluster 2021-07-26T16:03:37.066555+0000 mgr.y (mgr.34104) 290 : cluster [DBG] pgmap v440: 25 pgs: 25 active+clean; 325 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 9.6 MiB/s rd, 1.5 MiB/s wr, 8 op/s 2021-07-26T16:03:38.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:38 smithi096 bash[33981]: cluster 2021-07-26T16:03:37.067025+0000 mon.a (mon.0) 775 : cluster [DBG] osdmap e419: 8 total, 8 up, 8 in 2021-07-26T16:03:39.218 INFO:tasks.rados.rados.0.smithi033.stdout:1806: finishing write tid 4 to smithi03339061-23 2021-07-26T16:03:39.219 INFO:tasks.rados.rados.0.smithi033.stdout:1806: finishing write tid 5 to smithi03339061-23 2021-07-26T16:03:39.219 INFO:tasks.rados.rados.0.smithi033.stdout:1806: finishing write tid 6 to smithi03339061-23 2021-07-26T16:03:39.219 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1036 (ObjNum 564 snap 177 seq_num 564) dirty exists 2021-07-26T16:03:39.220 INFO:tasks.rados.rados.0.smithi033.stdout:1806: left oid 23 (ObjNum 564 snap 177 seq_num 564) 2021-07-26T16:03:39.220 INFO:tasks.rados.rados.0.smithi033.stdout:1807: finishing copy_from to smithi03339061-13 2021-07-26T16:03:39.220 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 680 (ObjNum 511 snap 160 seq_num 511) dirty exists 2021-07-26T16:03:39.220 INFO:tasks.rados.rados.0.smithi033.stdout:1807: finishing copy_from racing read to smithi03339061-13 2021-07-26T16:03:39.221 INFO:tasks.rados.rados.0.smithi033.stdout:1802: done (5 left) 2021-07-26T16:03:39.221 INFO:tasks.rados.rados.0.smithi033.stdout:1803: done (4 left) 2021-07-26T16:03:39.221 INFO:tasks.rados.rados.0.smithi033.stdout:1804: done (3 left) 2021-07-26T16:03:39.221 INFO:tasks.rados.rados.0.smithi033.stdout:1805: done (2 left) 2021-07-26T16:03:39.221 INFO:tasks.rados.rados.0.smithi033.stdout:1806: done (1 left) 2021-07-26T16:03:39.222 INFO:tasks.rados.rados.0.smithi033.stdout:1807: done (0 left) 2021-07-26T16:03:39.222 INFO:tasks.rados.rados.0.smithi033.stdout:1808: rollback oid 9 current snap is 177 2021-07-26T16:03:39.222 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 9 to 175 2021-07-26T16:03:39.222 INFO:tasks.rados.rados.0.smithi033.stdout:1809: read oid 12 snap -1 2021-07-26T16:03:39.223 INFO:tasks.rados.rados.0.smithi033.stdout:1809: expect deleted 2021-07-26T16:03:39.223 INFO:tasks.rados.rados.0.smithi033.stdout:1810: copy_from oid 21 from oid 15 current snap is 177 2021-07-26T16:03:39.223 INFO:tasks.rados.rados.0.smithi033.stdout:1811: copy_from oid 13 from oid 36 current snap is 177 2021-07-26T16:03:39.223 INFO:tasks.rados.rados.0.smithi033.stdout:1812: snap_remove snap 163 2021-07-26T16:03:39.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:39 smithi033 bash[42377]: cluster 2021-07-26T16:03:38.078605+0000 mon.a (mon.0) 776 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2021-07-26T16:03:39.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:39 smithi033 bash[41341]: cluster 2021-07-26T16:03:38.078605+0000 mon.a (mon.0) 776 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2021-07-26T16:03:39.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:39 smithi096 bash[33981]: cluster 2021-07-26T16:03:38.078605+0000 mon.a (mon.0) 776 : cluster [DBG] osdmap e420: 8 total, 8 up, 8 in 2021-07-26T16:03:40.091 INFO:teuthology.orchestra.run.smithi033.stdout: "ceph version 17.0.0-6381-gbccf07c2 (bccf07c244ef1754a7e8d345570b6a04f2ee5a7e) quincy (dev)" 2021-07-26T16:03:40.092 INFO:tasks.rados.rados.0.smithi033.stdout:1812: done (4 left) 2021-07-26T16:03:40.092 INFO:tasks.rados.rados.0.smithi033.stdout:1813: read oid 41 snap -1 2021-07-26T16:03:40.092 INFO:tasks.rados.rados.0.smithi033.stdout:1813: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:03:40.093 INFO:tasks.rados.rados.0.smithi033.stdout:1814: read oid 46 snap 162 2021-07-26T16:03:40.093 INFO:tasks.rados.rados.0.smithi033.stdout:1814: expect (ObjNum 510 snap 160 seq_num 510) 2021-07-26T16:03:40.093 INFO:tasks.rados.rados.0.smithi033.stdout:1815: copy_from oid 24 from oid 34 current snap is 177 2021-07-26T16:03:40.093 INFO:tasks.rados.rados.0.smithi033.stdout:1816: delete oid 18 current snap is 177 2021-07-26T16:03:40.094 INFO:tasks.rados.rados.0.smithi033.stdout:1811: finishing copy_from to smithi03339061-13 2021-07-26T16:03:40.094 INFO:tasks.rados.rados.0.smithi033.stdout:1811: got expected ENOENT (src dne) 2021-07-26T16:03:40.094 INFO:tasks.rados.rados.0.smithi033.stdout:1811: finishing copy_from racing read to smithi03339061-13 2021-07-26T16:03:40.094 INFO:tasks.rados.rados.0.smithi033.stdout:1808: finishing rollback tid 0 to smithi03339061-9 2021-07-26T16:03:40.095 INFO:tasks.rados.rados.0.smithi033.stdout:1808: finishing rollback tid 1 to smithi03339061-9 2021-07-26T16:03:40.095 INFO:tasks.rados.rados.0.smithi033.stdout:1808: finishing rollback tid 2 to smithi03339061-9 2021-07-26T16:03:40.095 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 561 (ObjNum 557 snap 175 seq_num 557) dirty exists 2021-07-26T16:03:40.095 INFO:tasks.rados.rados.0.smithi033.stdout:1810: finishing copy_from to smithi03339061-21 2021-07-26T16:03:40.095 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 646 (ObjNum 538 snap 167 seq_num 538) dirty exists 2021-07-26T16:03:40.096 INFO:tasks.rados.rados.0.smithi033.stdout:1810: finishing copy_from racing read to smithi03339061-21 2021-07-26T16:03:40.109 INFO:tasks.rados.rados.0.smithi033.stdout:1813: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:03:40.153 INFO:tasks.rados.rados.0.smithi033.stdout:1808: done (7 left) 2021-07-26T16:03:40.154 INFO:tasks.rados.rados.0.smithi033.stdout:1809: done (6 left) 2021-07-26T16:03:40.154 INFO:tasks.rados.rados.0.smithi033.stdout:1810: done (5 left) 2021-07-26T16:03:40.154 INFO:tasks.rados.rados.0.smithi033.stdout:1811: done (4 left) 2021-07-26T16:03:40.154 INFO:tasks.rados.rados.0.smithi033.stdout:1813: done (3 left) 2021-07-26T16:03:40.155 INFO:tasks.rados.rados.0.smithi033.stdout:1816: done (2 left) 2021-07-26T16:03:40.155 INFO:tasks.rados.rados.0.smithi033.stdout:1817: rollback oid 32 current snap is 177 2021-07-26T16:03:40.155 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 32 to 175 2021-07-26T16:03:40.155 INFO:tasks.rados.rados.0.smithi033.stdout:1818: copy_from oid 18 from oid 37 current snap is 177 2021-07-26T16:03:40.155 INFO:tasks.rados.rados.0.smithi033.stdout:1819: delete oid 42 current snap is 177 2021-07-26T16:03:40.156 INFO:tasks.rados.rados.0.smithi033.stdout:1815: finishing copy_from to smithi03339061-24 2021-07-26T16:03:40.156 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 846 (ObjNum 554 snap 175 seq_num 554) dirty exists 2021-07-26T16:03:40.157 INFO:tasks.rados.rados.0.smithi033.stdout:1819: done (4 left) 2021-07-26T16:03:40.157 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 177 2021-07-26T16:03:40.157 INFO:tasks.rados.rados.0.smithi033.stdout:1820: seq_num 567 ranges {0=704512,704512=499712,1204224=770048,1974272=335872} 2021-07-26T16:03:40.163 INFO:tasks.rados.rados.0.smithi033.stdout:1820: writing smithi03339061-36 from 0 to 704512 tid 1 2021-07-26T16:03:40.166 INFO:tasks.rados.rados.0.smithi033.stdout:1820: writing smithi03339061-36 from 704512 to 1204224 tid 2 2021-07-26T16:03:40.171 INFO:tasks.rados.rados.0.smithi033.stdout:1820: writing smithi03339061-36 from 1204224 to 1974272 tid 3 2021-07-26T16:03:40.175 INFO:tasks.rados.rados.0.smithi033.stdout:1820: writing smithi03339061-36 from 1974272 to 2310144 tid 4 2021-07-26T16:03:40.175 INFO:tasks.rados.rados.0.smithi033.stdout:1821: copy_from oid 44 from oid 41 current snap is 177 2021-07-26T16:03:40.175 INFO:tasks.rados.rados.0.smithi033.stdout:1815: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:03:40.176 INFO:tasks.rados.rados.0.smithi033.stdout:1814: expect (ObjNum 510 snap 160 seq_num 510) 2021-07-26T16:03:40.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:40 smithi033 bash[42377]: cluster 2021-07-26T16:03:39.067120+0000 mgr.y (mgr.34104) 291 : cluster [DBG] pgmap v442: 25 pgs: 25 active+clean; 347 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.7 MiB/s rd, 6.1 MiB/s wr, 9 op/s 2021-07-26T16:03:40.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:40 smithi033 bash[42377]: audit 2021-07-26T16:03:40.071571+0000 mon.a (mon.0) 777 : audit [DBG] from='client.? 172.21.15.33:0/2195928038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:40.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:40 smithi033 bash[41341]: cluster 2021-07-26T16:03:39.067120+0000 mgr.y (mgr.34104) 291 : cluster [DBG] pgmap v442: 25 pgs: 25 active+clean; 347 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.7 MiB/s rd, 6.1 MiB/s wr, 9 op/s 2021-07-26T16:03:40.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:40 smithi033 bash[41341]: audit 2021-07-26T16:03:40.071571+0000 mon.a (mon.0) 777 : audit [DBG] from='client.? 172.21.15.33:0/2195928038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:40.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:40 smithi096 bash[33981]: cluster 2021-07-26T16:03:39.067120+0000 mgr.y (mgr.34104) 291 : cluster [DBG] pgmap v442: 25 pgs: 25 active+clean; 347 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.7 MiB/s rd, 6.1 MiB/s wr, 9 op/s 2021-07-26T16:03:40.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:40 smithi096 bash[33981]: audit 2021-07-26T16:03:40.071571+0000 mon.a (mon.0) 777 : audit [DBG] from='client.? 172.21.15.33:0/2195928038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2021-07-26T16:03:40.882 INFO:teuthology.task.sequential:In sequential, running task print... 2021-07-26T16:03:40.883 INFO:teuthology.task.print:**** done end upgrade, wait... 2021-07-26T16:03:40.883 DEBUG:teuthology.parallel:result is None 2021-07-26T16:03:41.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:41 smithi033 bash[41341]: cluster 2021-07-26T16:03:40.087745+0000 mon.a (mon.0) 778 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2021-07-26T16:03:41.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:41 smithi033 bash[41341]: cluster 2021-07-26T16:03:41.052538+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2021-07-26T16:03:41.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:41 smithi033 bash[42377]: cluster 2021-07-26T16:03:40.087745+0000 mon.a (mon.0) 778 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2021-07-26T16:03:41.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:41 smithi033 bash[42377]: cluster 2021-07-26T16:03:41.052538+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2021-07-26T16:03:41.229 INFO:tasks.rados.rados.0.smithi033.stdout:1817: finishing rollback tid 0 to smithi03339061-32 2021-07-26T16:03:41.230 INFO:tasks.rados.rados.0.smithi033.stdout:1817: finishing rollback tid 1 to smithi03339061-32 2021-07-26T16:03:41.230 INFO:tasks.rados.rados.0.smithi033.stdout:1817: finishing rollback tid 2 to smithi03339061-32 2021-07-26T16:03:41.230 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 812 (ObjNum 519 snap 162 seq_num 519) dirty exists 2021-07-26T16:03:41.230 INFO:tasks.rados.rados.0.smithi033.stdout:1820: finishing write tid 1 to smithi03339061-36 2021-07-26T16:03:41.230 INFO:tasks.rados.rados.0.smithi033.stdout:1818: finishing copy_from to smithi03339061-18 2021-07-26T16:03:41.231 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 855 (ObjNum 405 snap 128 seq_num 405) dirty exists 2021-07-26T16:03:41.231 INFO:tasks.rados.rados.0.smithi033.stdout:1820: finishing write tid 2 to smithi03339061-36 2021-07-26T16:03:41.231 INFO:tasks.rados.rados.0.smithi033.stdout:1820: finishing write tid 3 to smithi03339061-36 2021-07-26T16:03:41.231 INFO:tasks.rados.rados.0.smithi033.stdout:1820: finishing write tid 4 to smithi03339061-36 2021-07-26T16:03:41.232 INFO:tasks.rados.rados.0.smithi033.stdout:1818: finishing copy_from racing read to smithi03339061-18 2021-07-26T16:03:41.232 INFO:tasks.rados.rados.0.smithi033.stdout:1820: finishing write tid 5 to smithi03339061-36 2021-07-26T16:03:41.232 INFO:tasks.rados.rados.0.smithi033.stdout:1814: done (5 left) 2021-07-26T16:03:41.232 INFO:tasks.rados.rados.0.smithi033.stdout:1815: done (4 left) 2021-07-26T16:03:41.232 INFO:tasks.rados.rados.0.smithi033.stdout:1817: done (3 left) 2021-07-26T16:03:41.233 INFO:tasks.rados.rados.0.smithi033.stdout:1818: done (2 left) 2021-07-26T16:03:41.233 INFO:tasks.rados.rados.0.smithi033.stdout:1822: read oid 20 snap -1 2021-07-26T16:03:41.233 INFO:tasks.rados.rados.0.smithi033.stdout:1822: expect (ObjNum 537 snap 165 seq_num 537) 2021-07-26T16:03:41.233 INFO:tasks.rados.rados.0.smithi033.stdout:1823: setattr oid 5 current snap is 177 2021-07-26T16:03:41.233 INFO:tasks.rados.rados.0.smithi033.stdout:1821: finishing copy_from to smithi03339061-44 2021-07-26T16:03:41.234 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 621 (ObjNum 451 snap 139 seq_num 451) dirty exists 2021-07-26T16:03:41.234 INFO:tasks.rados.rados.0.smithi033.stdout:1821: finishing copy_from racing read to smithi03339061-44 2021-07-26T16:03:41.234 INFO:tasks.rados.rados.0.smithi033.stdout:1820: finishing write tid 6 to smithi03339061-36 2021-07-26T16:03:41.234 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 851 (ObjNum 567 snap 177 seq_num 567) dirty exists 2021-07-26T16:03:41.235 INFO:tasks.rados.rados.0.smithi033.stdout:1820: left oid 36 (ObjNum 567 snap 177 seq_num 567) 2021-07-26T16:03:41.236 INFO:tasks.rados.rados.0.smithi033.stdout:1820: done (3 left) 2021-07-26T16:03:41.236 INFO:tasks.rados.rados.0.smithi033.stdout:1821: done (2 left) 2021-07-26T16:03:41.237 INFO:tasks.rados.rados.0.smithi033.stdout:1824: copy_from oid 28 from oid 27 current snap is 177 2021-07-26T16:03:41.237 INFO:tasks.rados.rados.0.smithi033.stdout:1825: read oid 26 snap -1 2021-07-26T16:03:41.237 INFO:tasks.rados.rados.0.smithi033.stdout:1825: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:03:41.237 INFO:tasks.rados.rados.0.smithi033.stdout:1826: copy_from oid 16 from oid 15 current snap is 177 2021-07-26T16:03:41.238 INFO:tasks.rados.rados.0.smithi033.stdout:1827: rmattr oid 41 current snap is 177 2021-07-26T16:03:41.238 INFO:tasks.rados.rados.0.smithi033.stdout:1827: done (5 left) 2021-07-26T16:03:41.238 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 37 current snap is 177 2021-07-26T16:03:41.238 INFO:tasks.rados.rados.0.smithi033.stdout:1828: seq_num 568 ranges {4530176=720896,5251072=786432,6037504=581632,6619136=237568} 2021-07-26T16:03:41.271 INFO:tasks.rados.rados.0.smithi033.stdout:1828: writing smithi03339061-37 from 4530176 to 5251072 tid 1 2021-07-26T16:03:41.276 INFO:tasks.rados.rados.0.smithi033.stdout:1828: writing smithi03339061-37 from 5251072 to 6037504 tid 2 2021-07-26T16:03:41.280 INFO:tasks.rados.rados.0.smithi033.stdout:1828: writing smithi03339061-37 from 6037504 to 6619136 tid 3 2021-07-26T16:03:41.282 INFO:tasks.rados.rados.0.smithi033.stdout:1828: writing smithi03339061-37 from 6619136 to 6856704 tid 4 2021-07-26T16:03:41.282 INFO:tasks.rados.rados.0.smithi033.stdout:1829: rollback oid 34 current snap is 177 2021-07-26T16:03:41.283 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 34 to 175 2021-07-26T16:03:41.283 INFO:tasks.rados.rados.0.smithi033.stdout:1822: expect (ObjNum 537 snap 165 seq_num 537) 2021-07-26T16:03:41.334 INFO:tasks.rados.rados.0.smithi033.stdout:1825: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:03:41.370 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 804 (ObjNum 488 snap 152 seq_num 488) dirty exists 2021-07-26T16:03:41.370 INFO:tasks.rados.rados.0.smithi033.stdout:1828: finishing write tid 1 to smithi03339061-37 2021-07-26T16:03:41.370 INFO:tasks.rados.rados.0.smithi033.stdout:1829: finishing rollback tid 0 to smithi03339061-34 2021-07-26T16:03:41.370 INFO:tasks.rados.rados.0.smithi033.stdout:1829: finishing rollback tid 1 to smithi03339061-34 2021-07-26T16:03:41.371 INFO:tasks.rados.rados.0.smithi033.stdout:1829: finishing rollback tid 2 to smithi03339061-34 2021-07-26T16:03:41.371 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 854 (ObjNum 554 snap 175 seq_num 554) dirty exists 2021-07-26T16:03:41.371 INFO:tasks.rados.rados.0.smithi033.stdout:1828: finishing write tid 2 to smithi03339061-37 2021-07-26T16:03:41.371 INFO:tasks.rados.rados.0.smithi033.stdout:1828: finishing write tid 3 to smithi03339061-37 2021-07-26T16:03:41.372 INFO:tasks.rados.rados.0.smithi033.stdout:1828: finishing write tid 4 to smithi03339061-37 2021-07-26T16:03:41.372 INFO:tasks.rados.rados.0.smithi033.stdout:1828: finishing write tid 5 to smithi03339061-37 2021-07-26T16:03:41.372 INFO:tasks.rados.rados.0.smithi033.stdout:1826: finishing copy_from to smithi03339061-16 2021-07-26T16:03:41.372 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 646 (ObjNum 538 snap 167 seq_num 538) dirty exists 2021-07-26T16:03:41.373 INFO:tasks.rados.rados.0.smithi033.stdout:1824: finishing copy_from to smithi03339061-28 2021-07-26T16:03:41.373 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 729 (ObjNum 442 snap 137 seq_num 442) dirty exists 2021-07-26T16:03:41.373 INFO:tasks.rados.rados.0.smithi033.stdout:1824: finishing copy_from racing read to smithi03339061-28 2021-07-26T16:03:41.373 INFO:tasks.rados.rados.0.smithi033.stdout:1826: finishing copy_from racing read to smithi03339061-16 2021-07-26T16:03:41.374 INFO:tasks.rados.rados.0.smithi033.stdout:1828: finishing write tid 6 to smithi03339061-37 2021-07-26T16:03:41.374 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 860 (ObjNum 568 snap 177 seq_num 568) dirty exists 2021-07-26T16:03:41.374 INFO:tasks.rados.rados.0.smithi033.stdout:1828: left oid 37 (ObjNum 568 snap 177 seq_num 568) 2021-07-26T16:03:41.375 INFO:tasks.rados.rados.0.smithi033.stdout:1822: done (6 left) 2021-07-26T16:03:41.375 INFO:tasks.rados.rados.0.smithi033.stdout:1823: done (5 left) 2021-07-26T16:03:41.375 INFO:tasks.rados.rados.0.smithi033.stdout:1824: done (4 left) 2021-07-26T16:03:41.375 INFO:tasks.rados.rados.0.smithi033.stdout:1825: done (3 left) 2021-07-26T16:03:41.375 INFO:tasks.rados.rados.0.smithi033.stdout:1826: done (2 left) 2021-07-26T16:03:41.376 INFO:tasks.rados.rados.0.smithi033.stdout:1828: done (1 left) 2021-07-26T16:03:41.376 INFO:tasks.rados.rados.0.smithi033.stdout:1829: done (0 left) 2021-07-26T16:03:41.376 INFO:tasks.rados.rados.0.smithi033.stdout:1830: copy_from oid 48 from oid 18 current snap is 177 2021-07-26T16:03:41.377 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 3 current snap is 177 2021-07-26T16:03:41.377 INFO:tasks.rados.rados.0.smithi033.stdout:1831: seq_num 569 ranges {0=737280,737280=671744,1409024=737280,2146304=196608} 2021-07-26T16:03:41.381 INFO:tasks.rados.rados.0.smithi033.stdout:1831: writing smithi03339061-3 from 0 to 737280 tid 1 2021-07-26T16:03:41.386 INFO:tasks.rados.rados.0.smithi033.stdout:1831: writing smithi03339061-3 from 737280 to 1409024 tid 2 2021-07-26T16:03:41.389 INFO:tasks.rados.rados.0.smithi033.stdout:1831: writing smithi03339061-3 from 1409024 to 2146304 tid 3 2021-07-26T16:03:41.391 INFO:tasks.rados.rados.0.smithi033.stdout:1831: writing smithi03339061-3 from 2146304 to 2342912 tid 4 2021-07-26T16:03:41.391 INFO:tasks.rados.rados.0.smithi033.stdout:1832: read oid 9 snap -1 2021-07-26T16:03:41.392 INFO:tasks.rados.rados.0.smithi033.stdout:1832: expect (ObjNum 557 snap 175 seq_num 557) 2021-07-26T16:03:41.392 INFO:tasks.rados.rados.0.smithi033.stdout:1833: rollback oid 33 current snap is 177 2021-07-26T16:03:41.392 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 176 2021-07-26T16:03:41.392 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 177 2021-07-26T16:03:41.393 INFO:tasks.rados.rados.0.smithi033.stdout:1834: seq_num 570 ranges {0=753664,753664=548864,1302528=540672,1843200=516096} 2021-07-26T16:03:41.396 INFO:tasks.rados.rados.0.smithi033.stdout:1834: writing smithi03339061-8 from 0 to 753664 tid 1 2021-07-26T16:03:41.400 INFO:tasks.rados.rados.0.smithi033.stdout:1834: writing smithi03339061-8 from 753664 to 1302528 tid 2 2021-07-26T16:03:41.406 INFO:tasks.rados.rados.0.smithi033.stdout:1834: writing smithi03339061-8 from 1302528 to 1843200 tid 3 2021-07-26T16:03:41.407 INFO:tasks.rados.rados.0.smithi033.stdout:1834: writing smithi03339061-8 from 1843200 to 2359296 tid 4 2021-07-26T16:03:41.407 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 177 2021-07-26T16:03:41.407 INFO:tasks.rados.rados.0.smithi033.stdout:1831: finishing write tid 1 to smithi03339061-3 2021-07-26T16:03:41.407 INFO:tasks.rados.rados.0.smithi033.stdout:1835: seq_num 571 ranges {9674752=770048,10444800=483328,10928128=753664,11681792=368640} 2021-07-26T16:03:41.467 INFO:tasks.rados.rados.0.smithi033.stdout:1835: writing smithi03339061-6 from 9674752 to 10444800 tid 1 2021-07-26T16:03:41.468 INFO:tasks.rados.rados.0.smithi033.stdout:1835: writing smithi03339061-6 from 10444800 to 10928128 tid 2 2021-07-26T16:03:41.473 INFO:tasks.rados.rados.0.smithi033.stdout:1835: writing smithi03339061-6 from 10928128 to 11681792 tid 3 2021-07-26T16:03:41.476 INFO:tasks.rados.rados.0.smithi033.stdout:1835: writing smithi03339061-6 from 11681792 to 12050432 tid 4 2021-07-26T16:03:41.476 INFO:tasks.rados.rados.0.smithi033.stdout:1836: snap_create 2021-07-26T16:03:41.476 INFO:tasks.rados.rados.0.smithi033.stdout:1831: finishing write tid 2 to smithi03339061-3 2021-07-26T16:03:41.477 INFO:tasks.rados.rados.0.smithi033.stdout:1831: finishing write tid 3 to smithi03339061-3 2021-07-26T16:03:41.477 INFO:tasks.rados.rados.0.smithi033.stdout:1831: finishing write tid 4 to smithi03339061-3 2021-07-26T16:03:41.477 INFO:tasks.rados.rados.0.smithi033.stdout:1831: finishing write tid 5 to smithi03339061-3 2021-07-26T16:03:41.477 INFO:tasks.rados.rados.0.smithi033.stdout:1831: finishing write tid 6 to smithi03339061-3 2021-07-26T16:03:41.477 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 301 (ObjNum 569 snap 177 seq_num 569) dirty exists 2021-07-26T16:03:41.478 INFO:tasks.rados.rados.0.smithi033.stdout:1831: left oid 3 (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:03:41.478 INFO:tasks.rados.rados.0.smithi033.stdout:1830: finishing copy_from to smithi03339061-48 2021-07-26T16:03:41.478 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 855 (ObjNum 405 snap 128 seq_num 405) dirty exists 2021-07-26T16:03:41.479 INFO:tasks.rados.rados.0.smithi033.stdout:1830: finishing copy_from racing read to smithi03339061-48 2021-07-26T16:03:41.493 INFO:tasks.rados.rados.0.smithi033.stdout:1833: finishing rollback tid 0 to smithi03339061-33 2021-07-26T16:03:41.494 INFO:tasks.rados.rados.0.smithi033.stdout:1833: finishing rollback tid 1 to smithi03339061-33 2021-07-26T16:03:41.494 INFO:tasks.rados.rados.0.smithi033.stdout:1833: finishing rollback tid 2 to smithi03339061-33 2021-07-26T16:03:41.494 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 1086 (ObjNum 478 snap 149 seq_num 478) dirty exists 2021-07-26T16:03:41.494 INFO:tasks.rados.rados.0.smithi033.stdout:1832: expect (ObjNum 557 snap 175 seq_num 557) 2021-07-26T16:03:41.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:41 smithi096 bash[33981]: cluster 2021-07-26T16:03:40.087745+0000 mon.a (mon.0) 778 : cluster [DBG] osdmap e421: 8 total, 8 up, 8 in 2021-07-26T16:03:41.495 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:41 smithi096 bash[33981]: cluster 2021-07-26T16:03:41.052538+0000 mon.a (mon.0) 779 : cluster [DBG] osdmap e422: 8 total, 8 up, 8 in 2021-07-26T16:03:41.858 INFO:tasks.rados.rados.0.smithi033.stdout:1834: finishing write tid 1 to smithi03339061-8 2021-07-26T16:03:41.858 INFO:tasks.rados.rados.0.smithi033.stdout:1834: finishing write tid 2 to smithi03339061-8 2021-07-26T16:03:41.858 INFO:tasks.rados.rados.0.smithi033.stdout:1834: finishing write tid 3 to smithi03339061-8 2021-07-26T16:03:41.859 INFO:tasks.rados.rados.0.smithi033.stdout:1834: finishing write tid 4 to smithi03339061-8 2021-07-26T16:03:41.859 INFO:tasks.rados.rados.0.smithi033.stdout:1834: finishing write tid 5 to smithi03339061-8 2021-07-26T16:03:41.859 INFO:tasks.rados.rados.0.smithi033.stdout:1834: finishing write tid 6 to smithi03339061-8 2021-07-26T16:03:41.859 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 568 (ObjNum 570 snap 177 seq_num 570) dirty exists 2021-07-26T16:03:41.859 INFO:tasks.rados.rados.0.smithi033.stdout:1834: left oid 8 (ObjNum 570 snap 177 seq_num 570) 2021-07-26T16:03:41.860 INFO:tasks.rados.rados.0.smithi033.stdout:1835: finishing write tid 1 to smithi03339061-6 2021-07-26T16:03:41.860 INFO:tasks.rados.rados.0.smithi033.stdout:1835: finishing write tid 2 to smithi03339061-6 2021-07-26T16:03:41.860 INFO:tasks.rados.rados.0.smithi033.stdout:1835: finishing write tid 3 to smithi03339061-6 2021-07-26T16:03:41.860 INFO:tasks.rados.rados.0.smithi033.stdout:1835: finishing write tid 4 to smithi03339061-6 2021-07-26T16:03:41.861 INFO:tasks.rados.rados.0.smithi033.stdout:1835: finishing write tid 5 to smithi03339061-6 2021-07-26T16:03:41.861 INFO:tasks.rados.rados.0.smithi033.stdout:1835: finishing write tid 6 to smithi03339061-6 2021-07-26T16:03:41.861 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1092 (ObjNum 571 snap 177 seq_num 571) dirty exists 2021-07-26T16:03:41.861 INFO:tasks.rados.rados.0.smithi033.stdout:1835: left oid 6 (ObjNum 571 snap 177 seq_num 571) 2021-07-26T16:03:42.108 INFO:tasks.rados.rados.0.smithi033.stdout:1830: done (6 left) 2021-07-26T16:03:42.108 INFO:tasks.rados.rados.0.smithi033.stdout:1831: done (5 left) 2021-07-26T16:03:42.109 INFO:tasks.rados.rados.0.smithi033.stdout:1832: done (4 left) 2021-07-26T16:03:42.109 INFO:tasks.rados.rados.0.smithi033.stdout:1833: done (3 left) 2021-07-26T16:03:42.109 INFO:tasks.rados.rados.0.smithi033.stdout:1834: done (2 left) 2021-07-26T16:03:42.109 INFO:tasks.rados.rados.0.smithi033.stdout:1835: done (1 left) 2021-07-26T16:03:42.110 INFO:tasks.rados.rados.0.smithi033.stdout:1836: done (0 left) 2021-07-26T16:03:42.110 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 178 2021-07-26T16:03:42.110 INFO:tasks.rados.rados.0.smithi033.stdout:1837: seq_num 572 ranges {0=786432,786432=770048,1556480=557056,2113536=278528} 2021-07-26T16:03:42.118 INFO:tasks.rados.rados.0.smithi033.stdout:1837: writing smithi03339061-49 from 0 to 786432 tid 1 2021-07-26T16:03:42.122 INFO:tasks.rados.rados.0.smithi033.stdout:1837: writing smithi03339061-49 from 786432 to 1556480 tid 2 2021-07-26T16:03:42.126 INFO:tasks.rados.rados.0.smithi033.stdout:1837: writing smithi03339061-49 from 1556480 to 2113536 tid 3 2021-07-26T16:03:42.128 INFO:tasks.rados.rados.0.smithi033.stdout:1837: writing smithi03339061-49 from 2113536 to 2392064 tid 4 2021-07-26T16:03:42.128 INFO:tasks.rados.rados.0.smithi033.stdout:1838: delete oid 40 current snap is 178 2021-07-26T16:03:42.128 INFO:tasks.rados.rados.0.smithi033.stdout:1837: finishing write tid 1 to smithi03339061-49 2021-07-26T16:03:42.133 INFO:tasks.rados.rados.0.smithi033.stdout:1837: finishing write tid 2 to smithi03339061-49 2021-07-26T16:03:42.134 INFO:tasks.rados.rados.0.smithi033.stdout:1838: done (1 left) 2021-07-26T16:03:42.134 INFO:tasks.rados.rados.0.smithi033.stdout:1839: read oid 6 snap 174 2021-07-26T16:03:42.134 INFO:tasks.rados.rados.0.smithi033.stdout:1839: expect (ObjNum 541 snap 167 seq_num 541) 2021-07-26T16:03:42.135 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 178 2021-07-26T16:03:42.135 INFO:tasks.rados.rados.0.smithi033.stdout:1840: seq_num 574 ranges {5865472=16384} 2021-07-26T16:03:42.170 INFO:tasks.rados.rados.0.smithi033.stdout:1840: writing smithi03339061-1 from 5865472 to 5881856 tid 1 2021-07-26T16:03:42.170 INFO:tasks.rados.rados.0.smithi033.stdout:1841: copy_from oid 23 from oid 44 current snap is 178 2021-07-26T16:03:42.171 INFO:tasks.rados.rados.0.smithi033.stdout:1837: finishing write tid 3 to smithi03339061-49 2021-07-26T16:03:42.171 INFO:tasks.rados.rados.0.smithi033.stdout:1837: finishing write tid 4 to smithi03339061-49 2021-07-26T16:03:42.171 INFO:tasks.rados.rados.0.smithi033.stdout:1837: finishing write tid 5 to smithi03339061-49 2021-07-26T16:03:42.171 INFO:tasks.rados.rados.0.smithi033.stdout:1837: finishing write tid 6 to smithi03339061-49 2021-07-26T16:03:42.171 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 651 (ObjNum 572 snap 178 seq_num 572) dirty exists 2021-07-26T16:03:42.172 INFO:tasks.rados.rados.0.smithi033.stdout:1837: left oid 49 (ObjNum 572 snap 178 seq_num 572) 2021-07-26T16:03:42.172 INFO:tasks.rados.rados.0.smithi033.stdout:1837: done (3 left) 2021-07-26T16:03:42.172 INFO:tasks.rados.rados.0.smithi033.stdout:1842: snap_remove snap 166 2021-07-26T16:03:42.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:42 smithi033 bash[41341]: cluster 2021-07-26T16:03:41.067575+0000 mgr.y (mgr.34104) 292 : cluster [DBG] pgmap v445: 25 pgs: 25 active+clean; 354 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 13 op/s 2021-07-26T16:03:42.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:42 smithi033 bash[42377]: cluster 2021-07-26T16:03:41.067575+0000 mgr.y (mgr.34104) 292 : cluster [DBG] pgmap v445: 25 pgs: 25 active+clean; 354 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 13 op/s 2021-07-26T16:03:42.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:42 smithi096 bash[33981]: cluster 2021-07-26T16:03:41.067575+0000 mgr.y (mgr.34104) 292 : cluster [DBG] pgmap v445: 25 pgs: 25 active+clean; 354 MiB data, 1.0 GiB used, 714 GiB / 715 GiB avail; 7.7 MiB/s rd, 7.8 MiB/s wr, 13 op/s 2021-07-26T16:03:43.134 INFO:tasks.rados.rados.0.smithi033.stdout:1842: done (3 left) 2021-07-26T16:03:43.134 INFO:tasks.rados.rados.0.smithi033.stdout:1843: setattr oid 18 current snap is 178 2021-07-26T16:03:43.135 INFO:tasks.rados.rados.0.smithi033.stdout:1840: finishing write tid 1 to smithi03339061-1 2021-07-26T16:03:43.135 INFO:tasks.rados.rados.0.smithi033.stdout:1840: finishing write tid 2 to smithi03339061-1 2021-07-26T16:03:43.135 INFO:tasks.rados.rados.0.smithi033.stdout:1839: expect (ObjNum 541 snap 167 seq_num 541) 2021-07-26T16:03:43.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:43 smithi033 bash[41341]: cluster 2021-07-26T16:03:42.105091+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2021-07-26T16:03:43.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:43 smithi033 bash[42377]: cluster 2021-07-26T16:03:42.105091+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2021-07-26T16:03:43.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:43 smithi096 bash[33981]: cluster 2021-07-26T16:03:42.105091+0000 mon.a (mon.0) 780 : cluster [DBG] osdmap e423: 8 total, 8 up, 8 in 2021-07-26T16:03:43.760 INFO:tasks.rados.rados.0.smithi033.stdout:1840: finishing write tid 3 to smithi03339061-1 2021-07-26T16:03:43.760 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 91 (ObjNum 574 snap 178 seq_num 574) dirty exists 2021-07-26T16:03:43.761 INFO:tasks.rados.rados.0.smithi033.stdout:1840: left oid 1 (ObjNum 574 snap 178 seq_num 574) 2021-07-26T16:03:43.761 INFO:tasks.rados.rados.0.smithi033.stdout:1841: finishing copy_from to smithi03339061-23 2021-07-26T16:03:43.761 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 621 (ObjNum 451 snap 139 seq_num 451) dirty exists 2021-07-26T16:03:43.761 INFO:tasks.rados.rados.0.smithi033.stdout:1841: finishing copy_from racing read to smithi03339061-23 2021-07-26T16:03:43.761 INFO:tasks.rados.rados.0.smithi033.stdout:1839: done (3 left) 2021-07-26T16:03:43.762 INFO:tasks.rados.rados.0.smithi033.stdout:1840: done (2 left) 2021-07-26T16:03:43.762 INFO:tasks.rados.rados.0.smithi033.stdout:1841: done (1 left) 2021-07-26T16:03:43.762 INFO:tasks.rados.rados.0.smithi033.stdout:1844: copy_from oid 7 from oid 35 current snap is 178 2021-07-26T16:03:43.762 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 178 2021-07-26T16:03:43.763 INFO:tasks.rados.rados.0.smithi033.stdout:1845: seq_num 575 ranges {9830400=32768} 2021-07-26T16:03:43.827 INFO:tasks.rados.rados.0.smithi033.stdout:1845: writing smithi03339061-21 from 9830400 to 9863168 tid 1 2021-07-26T16:03:43.828 INFO:tasks.rados.rados.0.smithi033.stdout:1846: rollback oid 48 current snap is 178 2021-07-26T16:03:43.828 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 48 to 176 2021-07-26T16:03:43.828 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 1102 (ObjNum 405 snap 128 seq_num 405) dirty exists 2021-07-26T16:03:43.828 INFO:tasks.rados.rados.0.smithi033.stdout:1843: done (3 left) 2021-07-26T16:03:43.828 INFO:tasks.rados.rados.0.smithi033.stdout:1847: delete oid 18 current snap is 178 2021-07-26T16:03:43.829 INFO:tasks.rados.rados.0.smithi033.stdout:1844: finishing copy_from to smithi03339061-7 2021-07-26T16:03:43.829 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 496 (ObjNum 476 snap 148 seq_num 476) dirty exists 2021-07-26T16:03:43.829 INFO:tasks.rados.rados.0.smithi033.stdout:1844: finishing copy_from racing read to smithi03339061-7 2021-07-26T16:03:43.831 INFO:tasks.rados.rados.0.smithi033.stdout:1844: done (3 left) 2021-07-26T16:03:43.831 INFO:tasks.rados.rados.0.smithi033.stdout:1847: done (2 left) 2021-07-26T16:03:43.831 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 178 2021-07-26T16:03:43.832 INFO:tasks.rados.rados.0.smithi033.stdout:1848: seq_num 577 ranges {7528448=65536} 2021-07-26T16:03:43.879 INFO:tasks.rados.rados.0.smithi033.stdout:1848: writing smithi03339061-9 from 7528448 to 7593984 tid 1 2021-07-26T16:03:43.879 INFO:tasks.rados.rados.0.smithi033.stdout:1849: rollback oid 24 current snap is 178 2021-07-26T16:03:43.880 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 24 to 173 2021-07-26T16:03:43.880 INFO:tasks.rados.rados.0.smithi033.stdout:1846: finishing rollback tid 0 to smithi03339061-48 2021-07-26T16:03:43.880 INFO:tasks.rados.rados.0.smithi033.stdout:1846: finishing rollback tid 1 to smithi03339061-48 2021-07-26T16:03:43.880 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 857 (ObjNum 2006045328 snap 22002 seq_num 2006122816) dirty dne 2021-07-26T16:03:43.881 INFO:tasks.rados.rados.0.smithi033.stdout:1845: finishing write tid 1 to smithi03339061-21 2021-07-26T16:03:43.881 INFO:tasks.rados.rados.0.smithi033.stdout:1845: finishing write tid 2 to smithi03339061-21 2021-07-26T16:03:43.881 INFO:tasks.rados.rados.0.smithi033.stdout:1845: finishing write tid 3 to smithi03339061-21 2021-07-26T16:03:43.881 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1038 (ObjNum 575 snap 178 seq_num 575) dirty exists 2021-07-26T16:03:43.882 INFO:tasks.rados.rados.0.smithi033.stdout:1845: left oid 21 (ObjNum 575 snap 178 seq_num 575) 2021-07-26T16:03:43.882 INFO:tasks.rados.rados.0.smithi033.stdout:1845: done (3 left) 2021-07-26T16:03:43.882 INFO:tasks.rados.rados.0.smithi033.stdout:1846: done (2 left) 2021-07-26T16:03:43.883 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 178 2021-07-26T16:03:43.883 INFO:tasks.rados.rados.0.smithi033.stdout:1850: seq_num 578 ranges {2490368=81920} 2021-07-26T16:03:43.892 INFO:tasks.rados.rados.0.smithi033.stdout:1850: writing smithi03339061-11 from 2490368 to 2572288 tid 1 2021-07-26T16:03:43.892 INFO:tasks.rados.rados.0.smithi033.stdout:1851: rollback oid 44 current snap is 178 2021-07-26T16:03:43.892 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 174 2021-07-26T16:03:43.892 INFO:tasks.rados.rados.0.smithi033.stdout:1848: finishing write tid 1 to smithi03339061-9 2021-07-26T16:03:43.892 INFO:tasks.rados.rados.0.smithi033.stdout:1848: finishing write tid 2 to smithi03339061-9 2021-07-26T16:03:43.893 INFO:tasks.rados.rados.0.smithi033.stdout:1848: finishing write tid 3 to smithi03339061-9 2021-07-26T16:03:43.893 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 573 (ObjNum 577 snap 178 seq_num 577) dirty exists 2021-07-26T16:03:43.893 INFO:tasks.rados.rados.0.smithi033.stdout:1848: left oid 9 (ObjNum 577 snap 178 seq_num 577) 2021-07-26T16:03:43.893 INFO:tasks.rados.rados.0.smithi033.stdout:1849: finishing rollback tid 0 to smithi03339061-24 2021-07-26T16:03:43.894 INFO:tasks.rados.rados.0.smithi033.stdout:1849: finishing rollback tid 1 to smithi03339061-24 2021-07-26T16:03:43.894 INFO:tasks.rados.rados.0.smithi033.stdout:1849: finishing rollback tid 2 to smithi03339061-24 2021-07-26T16:03:43.894 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 863 (ObjNum 549 snap 172 seq_num 549) dirty exists 2021-07-26T16:03:43.895 INFO:tasks.rados.rados.0.smithi033.stdout:1848: done (3 left) 2021-07-26T16:03:43.895 INFO:tasks.rados.rados.0.smithi033.stdout:1849: done (2 left) 2021-07-26T16:03:43.895 INFO:tasks.rados.rados.0.smithi033.stdout:1852: snap_create 2021-07-26T16:03:43.896 INFO:tasks.rados.rados.0.smithi033.stdout:1851: finishing rollback tid 0 to smithi03339061-44 2021-07-26T16:03:43.896 INFO:tasks.rados.rados.0.smithi033.stdout:1851: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:03:43.897 INFO:tasks.rados.rados.0.smithi033.stdout:1851: finishing rollback tid 2 to smithi03339061-44 2021-07-26T16:03:43.898 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 691 (ObjNum 441 snap 137 seq_num 441) dirty exists 2021-07-26T16:03:43.898 INFO:tasks.rados.rados.0.smithi033.stdout:1850: finishing write tid 1 to smithi03339061-11 2021-07-26T16:03:43.898 INFO:tasks.rados.rados.0.smithi033.stdout:1850: finishing write tid 2 to smithi03339061-11 2021-07-26T16:03:43.900 INFO:tasks.rados.rados.0.smithi033.stdout:1850: finishing write tid 3 to smithi03339061-11 2021-07-26T16:03:43.901 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 856 (ObjNum 578 snap 178 seq_num 578) dirty exists 2021-07-26T16:03:43.901 INFO:tasks.rados.rados.0.smithi033.stdout:1850: left oid 11 (ObjNum 578 snap 178 seq_num 578) 2021-07-26T16:03:44.137 INFO:tasks.rados.rados.0.smithi033.stdout:1850: done (2 left) 2021-07-26T16:03:44.137 INFO:tasks.rados.rados.0.smithi033.stdout:1851: done (1 left) 2021-07-26T16:03:44.138 INFO:tasks.rados.rados.0.smithi033.stdout:1852: done (0 left) 2021-07-26T16:03:44.138 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 179 2021-07-26T16:03:44.138 INFO:tasks.rados.rados.0.smithi033.stdout:1853: seq_num 579 ranges {9830400=98304} 2021-07-26T16:03:44.195 INFO:tasks.rados.rados.0.smithi033.stdout:1853: writing smithi03339061-50 from 9830400 to 9928704 tid 1 2021-07-26T16:03:44.195 INFO:tasks.rados.rados.0.smithi033.stdout:1854: read oid 28 snap 174 2021-07-26T16:03:44.195 INFO:tasks.rados.rados.0.smithi033.stdout:1854: expect (ObjNum 489 snap 152 seq_num 489) 2021-07-26T16:03:44.196 INFO:tasks.rados.rados.0.smithi033.stdout:1855: snap_remove snap 177 2021-07-26T16:03:44.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:44 smithi033 bash[42377]: cluster 2021-07-26T16:03:43.068217+0000 mgr.y (mgr.34104) 293 : cluster [DBG] pgmap v447: 25 pgs: 25 active+clean; 395 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 9.9 MiB/s wr, 24 op/s 2021-07-26T16:03:44.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:44 smithi033 bash[42377]: cluster 2021-07-26T16:03:43.127575+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2021-07-26T16:03:44.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:44 smithi033 bash[41341]: cluster 2021-07-26T16:03:43.068217+0000 mgr.y (mgr.34104) 293 : cluster [DBG] pgmap v447: 25 pgs: 25 active+clean; 395 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 9.9 MiB/s wr, 24 op/s 2021-07-26T16:03:44.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:44 smithi033 bash[41341]: cluster 2021-07-26T16:03:43.127575+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2021-07-26T16:03:44.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:44 smithi096 bash[33981]: cluster 2021-07-26T16:03:43.068217+0000 mgr.y (mgr.34104) 293 : cluster [DBG] pgmap v447: 25 pgs: 25 active+clean; 395 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 9.9 MiB/s wr, 24 op/s 2021-07-26T16:03:44.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:44 smithi096 bash[33981]: cluster 2021-07-26T16:03:43.127575+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e424: 8 total, 8 up, 8 in 2021-07-26T16:03:45.161 INFO:tasks.rados.rados.0.smithi033.stdout:1855: done (2 left) 2021-07-26T16:03:45.161 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 179 2021-07-26T16:03:45.161 INFO:tasks.rados.rados.0.smithi033.stdout:1856: seq_num 580 ranges {7200768=114688} 2021-07-26T16:03:45.207 INFO:tasks.rados.rados.0.smithi033.stdout:1856: writing smithi03339061-38 from 7200768 to 7315456 tid 1 2021-07-26T16:03:45.207 INFO:tasks.rados.rados.0.smithi033.stdout:1857: snap_remove snap 178 2021-07-26T16:03:45.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:45 smithi033 bash[42377]: cluster 2021-07-26T16:03:44.131985+0000 mon.a (mon.0) 782 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2021-07-26T16:03:45.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:45 smithi033 bash[41341]: cluster 2021-07-26T16:03:44.131985+0000 mon.a (mon.0) 782 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2021-07-26T16:03:45.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:45 smithi096 bash[33981]: cluster 2021-07-26T16:03:44.131985+0000 mon.a (mon.0) 782 : cluster [DBG] osdmap e425: 8 total, 8 up, 8 in 2021-07-26T16:03:46.077 INFO:tasks.rados.rados.0.smithi033.stdout:1857: done (3 left) 2021-07-26T16:03:46.077 INFO:tasks.rados.rados.0.smithi033.stdout:1858: copy_from oid 49 from oid 25 current snap is 179 2021-07-26T16:03:46.078 INFO:tasks.rados.rados.0.smithi033.stdout:1853: finishing write tid 1 to smithi03339061-50 2021-07-26T16:03:46.078 INFO:tasks.rados.rados.0.smithi033.stdout:1853: finishing write tid 2 to smithi03339061-50 2021-07-26T16:03:46.078 INFO:tasks.rados.rados.0.smithi033.stdout:1853: finishing write tid 3 to smithi03339061-50 2021-07-26T16:03:46.078 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 814 (ObjNum 579 snap 179 seq_num 579) dirty exists 2021-07-26T16:03:46.079 INFO:tasks.rados.rados.0.smithi033.stdout:1853: left oid 50 (ObjNum 579 snap 179 seq_num 579) 2021-07-26T16:03:46.079 INFO:tasks.rados.rados.0.smithi033.stdout:1854: expect (ObjNum 489 snap 152 seq_num 489) 2021-07-26T16:03:46.226 INFO:tasks.rados.rados.0.smithi033.stdout:1856: finishing write tid 1 to smithi03339061-38 2021-07-26T16:03:46.226 INFO:tasks.rados.rados.0.smithi033.stdout:1856: finishing write tid 2 to smithi03339061-38 2021-07-26T16:03:46.227 INFO:tasks.rados.rados.0.smithi033.stdout:1856: finishing write tid 3 to smithi03339061-38 2021-07-26T16:03:46.227 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 704 (ObjNum 580 snap 179 seq_num 580) dirty exists 2021-07-26T16:03:46.227 INFO:tasks.rados.rados.0.smithi033.stdout:1856: left oid 38 (ObjNum 580 snap 179 seq_num 580) 2021-07-26T16:03:46.227 INFO:tasks.rados.rados.0.smithi033.stdout:1858: finishing copy_from to smithi03339061-49 2021-07-26T16:03:46.228 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 809 (ObjNum 556 snap 175 seq_num 556) dirty exists 2021-07-26T16:03:46.228 INFO:tasks.rados.rados.0.smithi033.stdout:1858: finishing copy_from racing read to smithi03339061-49 2021-07-26T16:03:46.228 INFO:tasks.rados.rados.0.smithi033.stdout:1853: done (3 left) 2021-07-26T16:03:46.228 INFO:tasks.rados.rados.0.smithi033.stdout:1854: done (2 left) 2021-07-26T16:03:46.229 INFO:tasks.rados.rados.0.smithi033.stdout:1856: done (1 left) 2021-07-26T16:03:46.229 INFO:tasks.rados.rados.0.smithi033.stdout:1858: done (0 left) 2021-07-26T16:03:46.229 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 179 2021-07-26T16:03:46.230 INFO:tasks.rados.rados.0.smithi033.stdout:1859: seq_num 581 ranges {6045696=139264} 2021-07-26T16:03:46.271 INFO:tasks.rados.rados.0.smithi033.stdout:1859: writing smithi03339061-35 from 6045696 to 6184960 tid 1 2021-07-26T16:03:46.272 INFO:tasks.rados.rados.0.smithi033.stdout:1860: rollback oid 1 current snap is 179 2021-07-26T16:03:46.273 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 1 to 175 2021-07-26T16:03:46.273 INFO:tasks.rados.rados.0.smithi033.stdout:1861: copy_from oid 13 from oid 21 current snap is 179 2021-07-26T16:03:46.273 INFO:tasks.rados.rados.0.smithi033.stdout:1862: snap_create 2021-07-26T16:03:46.276 INFO:tasks.rados.rados.0.smithi033.stdout:1860: finishing rollback tid 0 to smithi03339061-1 2021-07-26T16:03:46.277 INFO:tasks.rados.rados.0.smithi033.stdout:1859: finishing write tid 1 to smithi03339061-35 2021-07-26T16:03:46.278 INFO:tasks.rados.rados.0.smithi033.stdout:1859: finishing write tid 2 to smithi03339061-35 2021-07-26T16:03:46.278 INFO:tasks.rados.rados.0.smithi033.stdout:1860: finishing rollback tid 1 to smithi03339061-1 2021-07-26T16:03:46.279 INFO:tasks.rados.rados.0.smithi033.stdout:1860: finishing rollback tid 2 to smithi03339061-1 2021-07-26T16:03:46.279 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 98 (ObjNum 532 snap 163 seq_num 532) dirty exists 2021-07-26T16:03:46.280 INFO:tasks.rados.rados.0.smithi033.stdout:1859: finishing write tid 3 to smithi03339061-35 2021-07-26T16:03:46.281 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 578 (ObjNum 581 snap 179 seq_num 581) dirty exists 2021-07-26T16:03:46.281 INFO:tasks.rados.rados.0.smithi033.stdout:1859: left oid 35 (ObjNum 581 snap 179 seq_num 581) 2021-07-26T16:03:46.319 INFO:tasks.rados.rados.0.smithi033.stdout:1861: finishing copy_from to smithi03339061-13 2021-07-26T16:03:46.319 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1038 (ObjNum 575 snap 178 seq_num 575) dirty exists 2021-07-26T16:03:46.320 INFO:tasks.rados.rados.0.smithi033.stdout:1861: finishing copy_from racing read to smithi03339061-13 2021-07-26T16:03:46.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:46 smithi033 bash[41341]: cluster 2021-07-26T16:03:45.068964+0000 mgr.y (mgr.34104) 294 : cluster [DBG] pgmap v450: 25 pgs: 25 active+clean; 410 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 14 MiB/s wr, 31 op/s 2021-07-26T16:03:46.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:46 smithi033 bash[41341]: cluster 2021-07-26T16:03:45.156935+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2021-07-26T16:03:46.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:46 smithi033 bash[41341]: cluster 2021-07-26T16:03:46.072656+0000 mon.a (mon.0) 784 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2021-07-26T16:03:46.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:46 smithi033 bash[42377]: cluster 2021-07-26T16:03:45.068964+0000 mgr.y (mgr.34104) 294 : cluster [DBG] pgmap v450: 25 pgs: 25 active+clean; 410 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 14 MiB/s wr, 31 op/s 2021-07-26T16:03:46.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:46 smithi033 bash[42377]: cluster 2021-07-26T16:03:45.156935+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2021-07-26T16:03:46.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:46 smithi033 bash[42377]: cluster 2021-07-26T16:03:46.072656+0000 mon.a (mon.0) 784 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2021-07-26T16:03:46.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:46 smithi096 bash[33981]: cluster 2021-07-26T16:03:45.068964+0000 mgr.y (mgr.34104) 294 : cluster [DBG] pgmap v450: 25 pgs: 25 active+clean; 410 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 14 MiB/s wr, 31 op/s 2021-07-26T16:03:46.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:46 smithi096 bash[33981]: cluster 2021-07-26T16:03:45.156935+0000 mon.a (mon.0) 783 : cluster [DBG] osdmap e426: 8 total, 8 up, 8 in 2021-07-26T16:03:46.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:46 smithi096 bash[33981]: cluster 2021-07-26T16:03:46.072656+0000 mon.a (mon.0) 784 : cluster [DBG] osdmap e427: 8 total, 8 up, 8 in 2021-07-26T16:03:47.165 INFO:tasks.rados.rados.0.smithi033.stdout:1859: done (3 left) 2021-07-26T16:03:47.166 INFO:tasks.rados.rados.0.smithi033.stdout:1860: done (2 left) 2021-07-26T16:03:47.166 INFO:tasks.rados.rados.0.smithi033.stdout:1861: done (1 left) 2021-07-26T16:03:47.166 INFO:tasks.rados.rados.0.smithi033.stdout:1862: done (0 left) 2021-07-26T16:03:47.166 INFO:tasks.rados.rados.0.smithi033.stdout:1863: copy_from oid 35 from oid 2 current snap is 180 2021-07-26T16:03:47.166 INFO:tasks.rados.rados.0.smithi033.stdout:1864: copy_from oid 24 from oid 12 current snap is 180 2021-07-26T16:03:47.167 INFO:tasks.rados.rados.0.smithi033.stdout:1865: copy_from oid 44 from oid 36 current snap is 180 2021-07-26T16:03:47.167 INFO:tasks.rados.rados.0.smithi033.stdout:1866: snap_create 2021-07-26T16:03:47.172 INFO:tasks.rados.rados.0.smithi033.stdout:1864: finishing copy_from to smithi03339061-24 2021-07-26T16:03:47.173 INFO:tasks.rados.rados.0.smithi033.stdout:1864: got expected ENOENT (src dne) 2021-07-26T16:03:47.173 INFO:tasks.rados.rados.0.smithi033.stdout:1864: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:03:47.193 INFO:tasks.rados.rados.0.smithi033.stdout:1865: finishing copy_from to smithi03339061-44 2021-07-26T16:03:47.193 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 851 (ObjNum 567 snap 177 seq_num 567) dirty exists 2021-07-26T16:03:47.194 INFO:tasks.rados.rados.0.smithi033.stdout:1865: finishing copy_from racing read to smithi03339061-44 2021-07-26T16:03:47.226 INFO:tasks.rados.rados.0.smithi033.stdout:1863: finishing copy_from to smithi03339061-35 2021-07-26T16:03:47.228 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 832 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:03:47.229 INFO:tasks.rados.rados.0.smithi033.stdout:1863: finishing copy_from racing read to smithi03339061-35 2021-07-26T16:03:48.173 INFO:tasks.rados.rados.0.smithi033.stdout:1863: done (3 left) 2021-07-26T16:03:48.173 INFO:tasks.rados.rados.0.smithi033.stdout:1864: done (2 left) 2021-07-26T16:03:48.174 INFO:tasks.rados.rados.0.smithi033.stdout:1865: done (1 left) 2021-07-26T16:03:48.174 INFO:tasks.rados.rados.0.smithi033.stdout:1866: done (0 left) 2021-07-26T16:03:48.174 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 181 2021-07-26T16:03:48.174 INFO:tasks.rados.rados.0.smithi033.stdout:1867: seq_num 582 ranges {10297344=155648} 2021-07-26T16:03:48.236 INFO:tasks.rados.rados.0.smithi033.stdout:1867: writing smithi03339061-45 from 10297344 to 10452992 tid 1 2021-07-26T16:03:48.236 INFO:tasks.rados.rados.0.smithi033.stdout:1868: rollback oid 15 current snap is 181 2021-07-26T16:03:48.237 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 15 to 174 2021-07-26T16:03:48.237 INFO:tasks.rados.rados.0.smithi033.stdout:1869: snap_remove snap 176 2021-07-26T16:03:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:48 smithi033 bash[41341]: cluster 2021-07-26T16:03:47.069766+0000 mgr.y (mgr.34104) 295 : cluster [DBG] pgmap v453: 25 pgs: 25 active+clean; 416 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 4.8 MiB/s wr, 19 op/s 2021-07-26T16:03:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:48 smithi033 bash[41341]: cluster 2021-07-26T16:03:47.161601+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e428: 8 total, 8 up, 8 in 2021-07-26T16:03:48.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:48 smithi033 bash[42377]: cluster 2021-07-26T16:03:47.069766+0000 mgr.y (mgr.34104) 295 : cluster [DBG] pgmap v453: 25 pgs: 25 active+clean; 416 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 4.8 MiB/s wr, 19 op/s 2021-07-26T16:03:48.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:48 smithi033 bash[42377]: cluster 2021-07-26T16:03:47.161601+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e428: 8 total, 8 up, 8 in 2021-07-26T16:03:48.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:48 smithi096 bash[33981]: cluster 2021-07-26T16:03:47.069766+0000 mgr.y (mgr.34104) 295 : cluster [DBG] pgmap v453: 25 pgs: 25 active+clean; 416 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 4.8 MiB/s wr, 19 op/s 2021-07-26T16:03:48.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:48 smithi096 bash[33981]: cluster 2021-07-26T16:03:47.161601+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e428: 8 total, 8 up, 8 in 2021-07-26T16:03:49.189 INFO:tasks.rados.rados.0.smithi033.stdout:1868: finishing rollback tid 0 to smithi03339061-15 2021-07-26T16:03:49.190 INFO:tasks.rados.rados.0.smithi033.stdout:1867: finishing write tid 1 to smithi03339061-45 2021-07-26T16:03:49.190 INFO:tasks.rados.rados.0.smithi033.stdout:1868: finishing rollback tid 1 to smithi03339061-15 2021-07-26T16:03:49.190 INFO:tasks.rados.rados.0.smithi033.stdout:1867: finishing write tid 2 to smithi03339061-45 2021-07-26T16:03:49.191 INFO:tasks.rados.rados.0.smithi033.stdout:1868: finishing rollback tid 2 to smithi03339061-15 2021-07-26T16:03:49.191 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 812 (ObjNum 538 snap 167 seq_num 538) dirty exists 2021-07-26T16:03:49.191 INFO:tasks.rados.rados.0.smithi033.stdout:1867: finishing write tid 3 to smithi03339061-45 2021-07-26T16:03:49.191 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1108 (ObjNum 582 snap 181 seq_num 582) dirty exists 2021-07-26T16:03:49.191 INFO:tasks.rados.rados.0.smithi033.stdout:1867: left oid 45 (ObjNum 582 snap 181 seq_num 582) 2021-07-26T16:03:49.192 INFO:tasks.rados.rados.0.smithi033.stdout:1867: done (2 left) 2021-07-26T16:03:49.192 INFO:tasks.rados.rados.0.smithi033.stdout:1868: done (1 left) 2021-07-26T16:03:49.192 INFO:tasks.rados.rados.0.smithi033.stdout:1869: done (0 left) 2021-07-26T16:03:49.192 INFO:tasks.rados.rados.0.smithi033.stdout:1870: read oid 6 snap 162 2021-07-26T16:03:49.193 INFO:tasks.rados.rados.0.smithi033.stdout:1870: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:03:49.193 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 37 current snap is 181 2021-07-26T16:03:49.193 INFO:tasks.rados.rados.0.smithi033.stdout:1871: seq_num 583 ranges {6856704=172032} 2021-07-26T16:03:49.231 INFO:tasks.rados.rados.0.smithi033.stdout:1871: writing smithi03339061-37 from 6856704 to 7028736 tid 1 2021-07-26T16:03:49.232 INFO:tasks.rados.rados.0.smithi033.stdout:1872: snap_remove snap 173 2021-07-26T16:03:49.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:49 smithi033 bash[41341]: cluster 2021-07-26T16:03:48.169750+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e429: 8 total, 8 up, 8 in 2021-07-26T16:03:49.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:49 smithi033 bash[42377]: cluster 2021-07-26T16:03:48.169750+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e429: 8 total, 8 up, 8 in 2021-07-26T16:03:49.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:49 smithi096 bash[33981]: cluster 2021-07-26T16:03:48.169750+0000 mon.a (mon.0) 786 : cluster [DBG] osdmap e429: 8 total, 8 up, 8 in 2021-07-26T16:03:50.199 INFO:tasks.rados.rados.0.smithi033.stdout:1872: done (2 left) 2021-07-26T16:03:50.200 INFO:tasks.rados.rados.0.smithi033.stdout:1873: read oid 44 snap 175 2021-07-26T16:03:50.200 INFO:tasks.rados.rados.0.smithi033.stdout:1873: expect (ObjNum 441 snap 137 seq_num 441) 2021-07-26T16:03:50.200 INFO:tasks.rados.rados.0.smithi033.stdout:1874: copy_from oid 17 from oid 18 current snap is 181 2021-07-26T16:03:50.200 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 181 2021-07-26T16:03:50.201 INFO:tasks.rados.rados.0.smithi033.stdout:1875: seq_num 584 ranges {9863168=188416} 2021-07-26T16:03:50.259 INFO:tasks.rados.rados.0.smithi033.stdout:1875: writing smithi03339061-13 from 9863168 to 10051584 tid 1 2021-07-26T16:03:50.259 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 181 2021-07-26T16:03:50.260 INFO:tasks.rados.rados.0.smithi033.stdout:1876: seq_num 585 ranges {9035776=204800} 2021-07-26T16:03:50.311 INFO:tasks.rados.rados.0.smithi033.stdout:1876: writing smithi03339061-35 from 9035776 to 9240576 tid 1 2021-07-26T16:03:50.311 INFO:tasks.rados.rados.0.smithi033.stdout:1877: copy_from oid 9 from oid 25 current snap is 181 2021-07-26T16:03:50.311 INFO:tasks.rados.rados.0.smithi033.stdout:1870: expect (ObjNum 405 snap 128 seq_num 405) 2021-07-26T16:03:50.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:50 smithi033 bash[41341]: cluster 2021-07-26T16:03:49.070468+0000 mgr.y (mgr.34104) 296 : cluster [DBG] pgmap v456: 25 pgs: 25 active+clean; 409 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2021-07-26T16:03:50.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:50 smithi033 bash[41341]: cluster 2021-07-26T16:03:49.186472+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e430: 8 total, 8 up, 8 in 2021-07-26T16:03:50.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:50 smithi033 bash[42377]: cluster 2021-07-26T16:03:49.070468+0000 mgr.y (mgr.34104) 296 : cluster [DBG] pgmap v456: 25 pgs: 25 active+clean; 409 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2021-07-26T16:03:50.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:50 smithi033 bash[42377]: cluster 2021-07-26T16:03:49.186472+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e430: 8 total, 8 up, 8 in 2021-07-26T16:03:50.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:50 smithi096 bash[33981]: cluster 2021-07-26T16:03:49.070468+0000 mgr.y (mgr.34104) 296 : cluster [DBG] pgmap v456: 25 pgs: 25 active+clean; 409 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 2.7 MiB/s wr, 16 op/s 2021-07-26T16:03:50.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:50 smithi096 bash[33981]: cluster 2021-07-26T16:03:49.186472+0000 mon.a (mon.0) 787 : cluster [DBG] osdmap e430: 8 total, 8 up, 8 in 2021-07-26T16:03:50.500 INFO:tasks.rados.rados.0.smithi033.stdout:1871: finishing write tid 1 to smithi03339061-37 2021-07-26T16:03:50.500 INFO:tasks.rados.rados.0.smithi033.stdout:1871: finishing write tid 2 to smithi03339061-37 2021-07-26T16:03:50.500 INFO:tasks.rados.rados.0.smithi033.stdout:1871: finishing write tid 3 to smithi03339061-37 2021-07-26T16:03:50.501 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 865 (ObjNum 583 snap 181 seq_num 583) dirty exists 2021-07-26T16:03:50.501 INFO:tasks.rados.rados.0.smithi033.stdout:1871: left oid 37 (ObjNum 583 snap 181 seq_num 583) 2021-07-26T16:03:50.501 INFO:tasks.rados.rados.0.smithi033.stdout:1874: finishing copy_from to smithi03339061-17 2021-07-26T16:03:50.501 INFO:tasks.rados.rados.0.smithi033.stdout:1874: got expected ENOENT (src dne) 2021-07-26T16:03:50.502 INFO:tasks.rados.rados.0.smithi033.stdout:1874: finishing copy_from racing read to smithi03339061-17 2021-07-26T16:03:50.502 INFO:tasks.rados.rados.0.smithi033.stdout:1873: expect (ObjNum 441 snap 137 seq_num 441) 2021-07-26T16:03:50.610 INFO:tasks.rados.rados.0.smithi033.stdout:1875: finishing write tid 1 to smithi03339061-13 2021-07-26T16:03:50.610 INFO:tasks.rados.rados.0.smithi033.stdout:1875: finishing write tid 2 to smithi03339061-13 2021-07-26T16:03:50.610 INFO:tasks.rados.rados.0.smithi033.stdout:1875: finishing write tid 3 to smithi03339061-13 2021-07-26T16:03:50.611 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1040 (ObjNum 584 snap 181 seq_num 584) dirty exists 2021-07-26T16:03:50.611 INFO:tasks.rados.rados.0.smithi033.stdout:1875: left oid 13 (ObjNum 584 snap 181 seq_num 584) 2021-07-26T16:03:50.611 INFO:tasks.rados.rados.0.smithi033.stdout:1876: finishing write tid 1 to smithi03339061-35 2021-07-26T16:03:50.612 INFO:tasks.rados.rados.0.smithi033.stdout:1876: finishing write tid 2 to smithi03339061-35 2021-07-26T16:03:50.612 INFO:tasks.rados.rados.0.smithi033.stdout:1876: finishing write tid 3 to smithi03339061-35 2021-07-26T16:03:50.612 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 834 (ObjNum 585 snap 181 seq_num 585) dirty exists 2021-07-26T16:03:50.613 INFO:tasks.rados.rados.0.smithi033.stdout:1876: left oid 35 (ObjNum 585 snap 181 seq_num 585) 2021-07-26T16:03:50.613 INFO:tasks.rados.rados.0.smithi033.stdout:1877: finishing copy_from to smithi03339061-9 2021-07-26T16:03:50.614 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 809 (ObjNum 556 snap 175 seq_num 556) dirty exists 2021-07-26T16:03:50.614 INFO:tasks.rados.rados.0.smithi033.stdout:1877: finishing copy_from racing read to smithi03339061-9 2021-07-26T16:03:50.614 INFO:tasks.rados.rados.0.smithi033.stdout:1870: done (6 left) 2021-07-26T16:03:50.614 INFO:tasks.rados.rados.0.smithi033.stdout:1871: done (5 left) 2021-07-26T16:03:50.614 INFO:tasks.rados.rados.0.smithi033.stdout:1873: done (4 left) 2021-07-26T16:03:50.615 INFO:tasks.rados.rados.0.smithi033.stdout:1874: done (3 left) 2021-07-26T16:03:50.615 INFO:tasks.rados.rados.0.smithi033.stdout:1875: done (2 left) 2021-07-26T16:03:50.615 INFO:tasks.rados.rados.0.smithi033.stdout:1876: done (1 left) 2021-07-26T16:03:50.616 INFO:tasks.rados.rados.0.smithi033.stdout:1877: done (0 left) 2021-07-26T16:03:50.616 INFO:tasks.rados.rados.0.smithi033.stdout:1878: snap_remove snap 175 2021-07-26T16:03:51.082 INFO:tasks.rados.rados.0.smithi033.stdout:1878: done (0 left) 2021-07-26T16:03:51.082 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 181 2021-07-26T16:03:51.082 INFO:tasks.rados.rados.0.smithi033.stdout:1879: seq_num 586 ranges {2007040=221184} 2021-07-26T16:03:51.094 INFO:tasks.rados.rados.0.smithi033.stdout:1879: writing smithi03339061-24 from 2007040 to 2228224 tid 1 2021-07-26T16:03:51.094 INFO:tasks.rados.rados.0.smithi033.stdout:1880: delete oid 22 current snap is 181 2021-07-26T16:03:51.103 INFO:tasks.rados.rados.0.smithi033.stdout:1879: finishing write tid 1 to smithi03339061-24 2021-07-26T16:03:51.103 INFO:tasks.rados.rados.0.smithi033.stdout:1879: finishing write tid 2 to smithi03339061-24 2021-07-26T16:03:51.105 INFO:tasks.rados.rados.0.smithi033.stdout:1879: finishing write tid 3 to smithi03339061-24 2021-07-26T16:03:51.105 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 867 (ObjNum 586 snap 181 seq_num 586) dirty exists 2021-07-26T16:03:51.106 INFO:tasks.rados.rados.0.smithi033.stdout:1879: left oid 24 (ObjNum 586 snap 181 seq_num 586) 2021-07-26T16:03:51.107 INFO:tasks.rados.rados.0.smithi033.stdout:1879: done (1 left) 2021-07-26T16:03:51.107 INFO:tasks.rados.rados.0.smithi033.stdout:1880: done (0 left) 2021-07-26T16:03:51.107 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 181 2021-07-26T16:03:51.108 INFO:tasks.rados.rados.0.smithi033.stdout:1881: seq_num 588 ranges {2433024=253952} 2021-07-26T16:03:51.123 INFO:tasks.rados.rados.0.smithi033.stdout:1881: writing smithi03339061-10 from 2433024 to 2686976 tid 1 2021-07-26T16:03:51.123 INFO:tasks.rados.rados.0.smithi033.stdout:1882: rmattr oid 46 current snap is 181 2021-07-26T16:03:51.123 INFO:tasks.rados.rados.0.smithi033.stdout:1882: done (1 left) 2021-07-26T16:03:51.123 INFO:tasks.rados.rados.0.smithi033.stdout:1883: rollback oid 6 current snap is 181 2021-07-26T16:03:51.124 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 179 2021-07-26T16:03:51.124 INFO:tasks.rados.rados.0.smithi033.stdout:1884: setattr oid 43 current snap is 181 2021-07-26T16:03:51.125 INFO:tasks.rados.rados.0.smithi033.stdout:1885: read oid 26 snap 180 2021-07-26T16:03:51.125 INFO:tasks.rados.rados.0.smithi033.stdout:1885: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:03:51.125 INFO:tasks.rados.rados.0.smithi033.stdout:1886: rollback oid 32 current snap is 181 2021-07-26T16:03:51.125 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 32 to 180 2021-07-26T16:03:51.126 INFO:tasks.rados.rados.0.smithi033.stdout:1887: setattr oid 8 current snap is 181 2021-07-26T16:03:51.128 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 34 current snap is 181 2021-07-26T16:03:51.128 INFO:tasks.rados.rados.0.smithi033.stdout:1888: seq_num 589 ranges {8134656=270336} 2021-07-26T16:03:51.175 INFO:tasks.rados.rados.0.smithi033.stdout:1888: writing smithi03339061-34 from 8134656 to 8404992 tid 1 2021-07-26T16:03:51.175 INFO:tasks.rados.rados.0.smithi033.stdout:1889: snap_create 2021-07-26T16:03:51.176 INFO:tasks.rados.rados.0.smithi033.stdout:1881: finishing write tid 1 to smithi03339061-10 2021-07-26T16:03:51.176 INFO:tasks.rados.rados.0.smithi033.stdout:1881: finishing write tid 2 to smithi03339061-10 2021-07-26T16:03:51.176 INFO:tasks.rados.rados.0.smithi033.stdout:1883: finishing rollback tid 0 to smithi03339061-6 2021-07-26T16:03:51.177 INFO:tasks.rados.rados.0.smithi033.stdout:1883: finishing rollback tid 1 to smithi03339061-6 2021-07-26T16:03:51.177 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 835 (ObjNum 570 snap 177 seq_num 570) dirty exists 2021-07-26T16:03:51.177 INFO:tasks.rados.rados.0.smithi033.stdout:1881: finishing write tid 3 to smithi03339061-10 2021-07-26T16:03:51.177 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 877 (ObjNum 588 snap 181 seq_num 588) dirty exists 2021-07-26T16:03:51.177 INFO:tasks.rados.rados.0.smithi033.stdout:1881: left oid 10 (ObjNum 588 snap 181 seq_num 588) 2021-07-26T16:03:51.178 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 858 (ObjNum 544 snap 169 seq_num 544) dirty exists 2021-07-26T16:03:51.178 INFO:tasks.rados.rados.0.smithi033.stdout:1883: finishing rollback tid 2 to smithi03339061-6 2021-07-26T16:03:51.178 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1138 (ObjNum 571 snap 177 seq_num 571) dirty exists 2021-07-26T16:03:51.178 INFO:tasks.rados.rados.0.smithi033.stdout:1886: finishing rollback tid 0 to smithi03339061-32 2021-07-26T16:03:51.179 INFO:tasks.rados.rados.0.smithi033.stdout:1886: finishing rollback tid 1 to smithi03339061-32 2021-07-26T16:03:51.179 INFO:tasks.rados.rados.0.smithi033.stdout:1886: finishing rollback tid 2 to smithi03339061-32 2021-07-26T16:03:51.179 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 817 (ObjNum 519 snap 162 seq_num 519) dirty exists 2021-07-26T16:03:51.179 INFO:tasks.rados.rados.0.smithi033.stdout:1885: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:03:51.218 INFO:tasks.rados.rados.0.smithi033.stdout:1888: finishing write tid 1 to smithi03339061-34 2021-07-26T16:03:51.218 INFO:tasks.rados.rados.0.smithi033.stdout:1888: finishing write tid 2 to smithi03339061-34 2021-07-26T16:03:51.219 INFO:tasks.rados.rados.0.smithi033.stdout:1888: finishing write tid 3 to smithi03339061-34 2021-07-26T16:03:51.219 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 858 (ObjNum 589 snap 181 seq_num 589) dirty exists 2021-07-26T16:03:51.219 INFO:tasks.rados.rados.0.smithi033.stdout:1888: left oid 34 (ObjNum 589 snap 181 seq_num 589) 2021-07-26T16:03:51.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:51 smithi033 bash[41341]: cluster 2021-07-26T16:03:50.193478+0000 mon.a (mon.0) 788 : cluster [DBG] osdmap e431: 8 total, 8 up, 8 in 2021-07-26T16:03:51.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:51 smithi033 bash[41341]: cluster 2021-07-26T16:03:51.076379+0000 mon.a (mon.0) 789 : cluster [DBG] osdmap e432: 8 total, 8 up, 8 in 2021-07-26T16:03:51.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:51 smithi033 bash[42377]: cluster 2021-07-26T16:03:50.193478+0000 mon.a (mon.0) 788 : cluster [DBG] osdmap e431: 8 total, 8 up, 8 in 2021-07-26T16:03:51.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:51 smithi033 bash[42377]: cluster 2021-07-26T16:03:51.076379+0000 mon.a (mon.0) 789 : cluster [DBG] osdmap e432: 8 total, 8 up, 8 in 2021-07-26T16:03:51.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:51 smithi096 bash[33981]: cluster 2021-07-26T16:03:50.193478+0000 mon.a (mon.0) 788 : cluster [DBG] osdmap e431: 8 total, 8 up, 8 in 2021-07-26T16:03:51.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:51 smithi096 bash[33981]: cluster 2021-07-26T16:03:51.076379+0000 mon.a (mon.0) 789 : cluster [DBG] osdmap e432: 8 total, 8 up, 8 in 2021-07-26T16:03:52.090 INFO:tasks.rados.rados.0.smithi033.stdout:1881: done (7 left) 2021-07-26T16:03:52.090 INFO:tasks.rados.rados.0.smithi033.stdout:1883: done (6 left) 2021-07-26T16:03:52.090 INFO:tasks.rados.rados.0.smithi033.stdout:1884: done (5 left) 2021-07-26T16:03:52.091 INFO:tasks.rados.rados.0.smithi033.stdout:1885: done (4 left) 2021-07-26T16:03:52.091 INFO:tasks.rados.rados.0.smithi033.stdout:1886: done (3 left) 2021-07-26T16:03:52.091 INFO:tasks.rados.rados.0.smithi033.stdout:1887: done (2 left) 2021-07-26T16:03:52.091 INFO:tasks.rados.rados.0.smithi033.stdout:1888: done (1 left) 2021-07-26T16:03:52.091 INFO:tasks.rados.rados.0.smithi033.stdout:1889: done (0 left) 2021-07-26T16:03:52.092 INFO:tasks.rados.rados.0.smithi033.stdout:1890: delete oid 9 current snap is 182 2021-07-26T16:03:52.094 INFO:tasks.rados.rados.0.smithi033.stdout:1890: done (0 left) 2021-07-26T16:03:52.094 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 182 2021-07-26T16:03:52.095 INFO:tasks.rados.rados.0.smithi033.stdout:1891: seq_num 591 ranges {9240576=303104} 2021-07-26T16:03:52.152 INFO:tasks.rados.rados.0.smithi033.stdout:1891: writing smithi03339061-35 from 9240576 to 9543680 tid 1 2021-07-26T16:03:52.152 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 182 2021-07-26T16:03:52.153 INFO:tasks.rados.rados.0.smithi033.stdout:1892: seq_num 592 ranges {12050432=319488} 2021-07-26T16:03:52.224 INFO:tasks.rados.rados.0.smithi033.stdout:1892: writing smithi03339061-6 from 12050432 to 12369920 tid 1 2021-07-26T16:03:52.224 INFO:tasks.rados.rados.0.smithi033.stdout:1893: delete oid 37 current snap is 182 2021-07-26T16:03:52.224 INFO:tasks.rados.rados.0.smithi033.stdout:1891: finishing write tid 1 to smithi03339061-35 2021-07-26T16:03:52.225 INFO:tasks.rados.rados.0.smithi033.stdout:1891: finishing write tid 2 to smithi03339061-35 2021-07-26T16:03:52.225 INFO:tasks.rados.rados.0.smithi033.stdout:1891: finishing write tid 3 to smithi03339061-35 2021-07-26T16:03:52.225 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 838 (ObjNum 591 snap 182 seq_num 591) dirty exists 2021-07-26T16:03:52.225 INFO:tasks.rados.rados.0.smithi033.stdout:1891: left oid 35 (ObjNum 591 snap 182 seq_num 591) 2021-07-26T16:03:52.228 INFO:tasks.rados.rados.0.smithi033.stdout:1892: finishing write tid 1 to smithi03339061-6 2021-07-26T16:03:52.228 INFO:tasks.rados.rados.0.smithi033.stdout:1892: finishing write tid 2 to smithi03339061-6 2021-07-26T16:03:52.229 INFO:tasks.rados.rados.0.smithi033.stdout:1891: done (2 left) 2021-07-26T16:03:52.230 INFO:tasks.rados.rados.0.smithi033.stdout:1893: done (1 left) 2021-07-26T16:03:52.230 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 182 2021-07-26T16:03:52.230 INFO:tasks.rados.rados.0.smithi033.stdout:1894: seq_num 594 ranges {0=352256} 2021-07-26T16:03:52.233 INFO:tasks.rados.rados.0.smithi033.stdout:1894: writing smithi03339061-40 from 0 to 352256 tid 1 2021-07-26T16:03:52.234 INFO:tasks.rados.rados.0.smithi033.stdout:1895: copy_from oid 31 from oid 21 current snap is 182 2021-07-26T16:03:52.234 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 182 2021-07-26T16:03:52.234 INFO:tasks.rados.rados.0.smithi033.stdout:1896: seq_num 595 ranges {6201344=368640} 2021-07-26T16:03:52.269 INFO:tasks.rados.rados.0.smithi033.stdout:1896: writing smithi03339061-14 from 6201344 to 6569984 tid 1 2021-07-26T16:03:52.269 INFO:tasks.rados.rados.0.smithi033.stdout:1897: copy_from oid 28 from oid 25 current snap is 182 2021-07-26T16:03:52.269 INFO:tasks.rados.rados.0.smithi033.stdout:1892: finishing write tid 3 to smithi03339061-6 2021-07-26T16:03:52.270 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1141 (ObjNum 592 snap 182 seq_num 592) dirty exists 2021-07-26T16:03:52.270 INFO:tasks.rados.rados.0.smithi033.stdout:1892: left oid 6 (ObjNum 592 snap 182 seq_num 592) 2021-07-26T16:03:52.270 INFO:tasks.rados.rados.0.smithi033.stdout:1892: done (4 left) 2021-07-26T16:03:52.270 INFO:tasks.rados.rados.0.smithi033.stdout:1898: delete oid 12 current snap is 182 2021-07-26T16:03:52.270 INFO:tasks.rados.rados.0.smithi033.stdout:1894: finishing write tid 1 to smithi03339061-40 2021-07-26T16:03:52.271 INFO:tasks.rados.rados.0.smithi033.stdout:1894: finishing write tid 2 to smithi03339061-40 2021-07-26T16:03:52.272 INFO:tasks.rados.rados.0.smithi033.stdout:1894: finishing write tid 3 to smithi03339061-40 2021-07-26T16:03:52.272 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 504 (ObjNum 594 snap 182 seq_num 594) dirty exists 2021-07-26T16:03:52.272 INFO:tasks.rados.rados.0.smithi033.stdout:1894: left oid 40 (ObjNum 594 snap 182 seq_num 594) 2021-07-26T16:03:52.273 INFO:tasks.rados.rados.0.smithi033.stdout:1894: done (4 left) 2021-07-26T16:03:52.274 INFO:tasks.rados.rados.0.smithi033.stdout:1898: done (3 left) 2021-07-26T16:03:52.274 INFO:tasks.rados.rados.0.smithi033.stdout:1899: snap_remove snap 162 2021-07-26T16:03:52.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:52 smithi033 bash[41341]: cluster 2021-07-26T16:03:51.071407+0000 mgr.y (mgr.34104) 297 : cluster [DBG] pgmap v459: 25 pgs: 25 active+clean; 420 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 6.6 MiB/s wr, 13 op/s 2021-07-26T16:03:52.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:52 smithi033 bash[41341]: cluster 2021-07-26T16:03:52.086018+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e433: 8 total, 8 up, 8 in 2021-07-26T16:03:52.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:52 smithi033 bash[42377]: cluster 2021-07-26T16:03:51.071407+0000 mgr.y (mgr.34104) 297 : cluster [DBG] pgmap v459: 25 pgs: 25 active+clean; 420 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 6.6 MiB/s wr, 13 op/s 2021-07-26T16:03:52.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:52 smithi033 bash[42377]: cluster 2021-07-26T16:03:52.086018+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e433: 8 total, 8 up, 8 in 2021-07-26T16:03:52.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:52 smithi096 bash[33981]: cluster 2021-07-26T16:03:51.071407+0000 mgr.y (mgr.34104) 297 : cluster [DBG] pgmap v459: 25 pgs: 25 active+clean; 420 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 6.6 MiB/s wr, 13 op/s 2021-07-26T16:03:52.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:52 smithi096 bash[33981]: cluster 2021-07-26T16:03:52.086018+0000 mon.a (mon.0) 790 : cluster [DBG] osdmap e433: 8 total, 8 up, 8 in 2021-07-26T16:03:53.206 INFO:tasks.rados.rados.0.smithi033.stdout:1899: done (3 left) 2021-07-26T16:03:53.207 INFO:tasks.rados.rados.0.smithi033.stdout:1900: snap_remove snap 172 2021-07-26T16:03:54.221 INFO:tasks.rados.rados.0.smithi033.stdout:1900: done (3 left) 2021-07-26T16:03:54.221 INFO:tasks.rados.rados.0.smithi033.stdout:1901: copy_from oid 43 from oid 5 current snap is 182 2021-07-26T16:03:54.222 INFO:tasks.rados.rados.0.smithi033.stdout:1902: read oid 1 snap -1 2021-07-26T16:03:54.222 INFO:tasks.rados.rados.0.smithi033.stdout:1902: expect (ObjNum 532 snap 163 seq_num 532) 2021-07-26T16:03:54.222 INFO:tasks.rados.rados.0.smithi033.stdout:1903: setattr oid 20 current snap is 182 2021-07-26T16:03:54.222 INFO:tasks.rados.rados.0.smithi033.stdout:1904: snap_remove snap 180 2021-07-26T16:03:54.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:54 smithi033 bash[41341]: cluster 2021-07-26T16:03:53.072161+0000 mgr.y (mgr.34104) 298 : cluster [DBG] pgmap v462: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 426 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 13 op/s 2021-07-26T16:03:54.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:54 smithi033 bash[41341]: cluster 2021-07-26T16:03:53.199565+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e434: 8 total, 8 up, 8 in 2021-07-26T16:03:54.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:54 smithi033 bash[42377]: cluster 2021-07-26T16:03:53.072161+0000 mgr.y (mgr.34104) 298 : cluster [DBG] pgmap v462: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 426 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 13 op/s 2021-07-26T16:03:54.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:54 smithi033 bash[42377]: cluster 2021-07-26T16:03:53.199565+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e434: 8 total, 8 up, 8 in 2021-07-26T16:03:54.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:54 smithi096 bash[33981]: cluster 2021-07-26T16:03:53.072161+0000 mgr.y (mgr.34104) 298 : cluster [DBG] pgmap v462: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 426 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 7.9 MiB/s wr, 13 op/s 2021-07-26T16:03:54.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:54 smithi096 bash[33981]: cluster 2021-07-26T16:03:53.199565+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e434: 8 total, 8 up, 8 in 2021-07-26T16:03:55.233 INFO:tasks.rados.rados.0.smithi033.stdout:1904: done (6 left) 2021-07-26T16:03:55.233 INFO:tasks.rados.rados.0.smithi033.stdout:1905: read oid 36 snap 181 2021-07-26T16:03:55.234 INFO:tasks.rados.rados.0.smithi033.stdout:1905: expect (ObjNum 567 snap 177 seq_num 567) 2021-07-26T16:03:55.234 INFO:tasks.rados.rados.0.smithi033.stdout:1906: rmattr oid 33 current snap is 182 2021-07-26T16:03:55.234 INFO:tasks.rados.rados.0.smithi033.stdout:1906: done (7 left) 2021-07-26T16:03:55.234 INFO:tasks.rados.rados.0.smithi033.stdout:1907: read oid 47 snap -1 2021-07-26T16:03:55.235 INFO:tasks.rados.rados.0.smithi033.stdout:1907: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:03:55.235 INFO:tasks.rados.rados.0.smithi033.stdout:1908: rollback oid 2 current snap is 182 2021-07-26T16:03:55.235 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 2 to 179 2021-07-26T16:03:55.235 INFO:tasks.rados.rados.0.smithi033.stdout:1909: rollback oid 34 current snap is 182 2021-07-26T16:03:55.235 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 34 to 174 2021-07-26T16:03:55.236 INFO:tasks.rados.rados.0.smithi033.stdout:1910: snap_create 2021-07-26T16:03:55.236 INFO:tasks.rados.rados.0.smithi033.stdout:1896: finishing write tid 1 to smithi03339061-14 2021-07-26T16:03:55.236 INFO:tasks.rados.rados.0.smithi033.stdout:1896: finishing write tid 2 to smithi03339061-14 2021-07-26T16:03:55.236 INFO:tasks.rados.rados.0.smithi033.stdout:1896: finishing write tid 3 to smithi03339061-14 2021-07-26T16:03:55.236 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1042 (ObjNum 595 snap 182 seq_num 595) dirty exists 2021-07-26T16:03:55.237 INFO:tasks.rados.rados.0.smithi033.stdout:1896: left oid 14 (ObjNum 595 snap 182 seq_num 595) 2021-07-26T16:03:55.237 INFO:tasks.rados.rados.0.smithi033.stdout:1895: finishing copy_from to smithi03339061-31 2021-07-26T16:03:55.237 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1038 (ObjNum 575 snap 178 seq_num 575) dirty exists 2021-07-26T16:03:55.237 INFO:tasks.rados.rados.0.smithi033.stdout:1895: finishing copy_from racing read to smithi03339061-31 2021-07-26T16:03:55.238 INFO:tasks.rados.rados.0.smithi033.stdout:1897: finishing copy_from to smithi03339061-28 2021-07-26T16:03:55.238 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 809 (ObjNum 556 snap 175 seq_num 556) dirty exists 2021-07-26T16:03:55.238 INFO:tasks.rados.rados.0.smithi033.stdout:1897: finishing copy_from racing read to smithi03339061-28 2021-07-26T16:03:55.238 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1043 (ObjNum 537 snap 165 seq_num 537) dirty exists 2021-07-26T16:03:55.238 INFO:tasks.rados.rados.0.smithi033.stdout:1902: expect (ObjNum 532 snap 163 seq_num 532) 2021-07-26T16:03:55.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:55 smithi096 bash[33981]: cluster 2021-07-26T16:03:54.212366+0000 mon.a (mon.0) 792 : cluster [DBG] osdmap e435: 8 total, 8 up, 8 in 2021-07-26T16:03:55.543 INFO:tasks.rados.rados.0.smithi033.stdout:1901: finishing copy_from to smithi03339061-43 2021-07-26T16:03:55.543 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 804 (ObjNum 488 snap 152 seq_num 488) dirty exists 2021-07-26T16:03:55.543 INFO:tasks.rados.rados.0.smithi033.stdout:1901: finishing copy_from racing read to smithi03339061-43 2021-07-26T16:03:55.543 INFO:tasks.rados.rados.0.smithi033.stdout:1908: finishing rollback tid 0 to smithi03339061-2 2021-07-26T16:03:55.544 INFO:tasks.rados.rados.0.smithi033.stdout:1905: expect (ObjNum 567 snap 177 seq_num 567) 2021-07-26T16:03:55.602 INFO:tasks.rados.rados.0.smithi033.stdout:1909: finishing rollback tid 0 to smithi03339061-34 2021-07-26T16:03:55.602 INFO:tasks.rados.rados.0.smithi033.stdout:1908: finishing rollback tid 1 to smithi03339061-2 2021-07-26T16:03:55.602 INFO:tasks.rados.rados.0.smithi033.stdout:1908: finishing rollback tid 2 to smithi03339061-2 2021-07-26T16:03:55.602 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 839 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:03:55.603 INFO:tasks.rados.rados.0.smithi033.stdout:1909: finishing rollback tid 1 to smithi03339061-34 2021-07-26T16:03:55.603 INFO:tasks.rados.rados.0.smithi033.stdout:1909: finishing rollback tid 2 to smithi03339061-34 2021-07-26T16:03:55.603 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 861 (ObjNum 476 snap 148 seq_num 476) dirty exists 2021-07-26T16:03:55.603 INFO:tasks.rados.rados.0.smithi033.stdout:1907: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:03:55.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:55 smithi033 bash[41341]: cluster 2021-07-26T16:03:54.212366+0000 mon.a (mon.0) 792 : cluster [DBG] osdmap e435: 8 total, 8 up, 8 in 2021-07-26T16:03:55.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:55 smithi033 bash[42377]: cluster 2021-07-26T16:03:54.212366+0000 mon.a (mon.0) 792 : cluster [DBG] osdmap e435: 8 total, 8 up, 8 in 2021-07-26T16:03:56.171 INFO:tasks.rados.rados.0.smithi033.stdout:1895: done (10 left) 2021-07-26T16:03:56.171 INFO:tasks.rados.rados.0.smithi033.stdout:1896: done (9 left) 2021-07-26T16:03:56.172 INFO:tasks.rados.rados.0.smithi033.stdout:1897: done (8 left) 2021-07-26T16:03:56.172 INFO:tasks.rados.rados.0.smithi033.stdout:1901: done (7 left) 2021-07-26T16:03:56.172 INFO:tasks.rados.rados.0.smithi033.stdout:1902: done (6 left) 2021-07-26T16:03:56.172 INFO:tasks.rados.rados.0.smithi033.stdout:1903: done (5 left) 2021-07-26T16:03:56.173 INFO:tasks.rados.rados.0.smithi033.stdout:1905: done (4 left) 2021-07-26T16:03:56.173 INFO:tasks.rados.rados.0.smithi033.stdout:1907: done (3 left) 2021-07-26T16:03:56.173 INFO:tasks.rados.rados.0.smithi033.stdout:1908: done (2 left) 2021-07-26T16:03:56.173 INFO:tasks.rados.rados.0.smithi033.stdout:1909: done (1 left) 2021-07-26T16:03:56.174 INFO:tasks.rados.rados.0.smithi033.stdout:1910: done (0 left) 2021-07-26T16:03:56.174 INFO:tasks.rados.rados.0.smithi033.stdout:1911: read oid 42 snap 179 2021-07-26T16:03:56.174 INFO:tasks.rados.rados.0.smithi033.stdout:1911: expect deleted 2021-07-26T16:03:56.174 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 183 2021-07-26T16:03:56.175 INFO:tasks.rados.rados.0.smithi033.stdout:1912: seq_num 597 ranges {0=401408} 2021-07-26T16:03:56.175 INFO:tasks.rados.rados.0.smithi033.stdout:1912: writing smithi03339061-12 from 0 to 401408 tid 1 2021-07-26T16:03:56.176 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 183 2021-07-26T16:03:56.176 INFO:tasks.rados.rados.0.smithi033.stdout:1913: seq_num 598 ranges {0=417792} 2021-07-26T16:03:56.178 INFO:tasks.rados.rados.0.smithi033.stdout:1913: writing smithi03339061-22 from 0 to 417792 tid 1 2021-07-26T16:03:56.178 INFO:tasks.rados.rados.0.smithi033.stdout:1914: rollback oid 35 current snap is 183 2021-07-26T16:03:56.178 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 181 2021-07-26T16:03:56.179 INFO:tasks.rados.rados.0.smithi033.stdout:1911: done (3 left) 2021-07-26T16:03:56.179 INFO:tasks.rados.rados.0.smithi033.stdout:1915: rollback oid 21 current snap is 183 2021-07-26T16:03:56.179 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 21 to 179 2021-07-26T16:03:56.179 INFO:tasks.rados.rados.0.smithi033.stdout:1916: read oid 24 snap -1 2021-07-26T16:03:56.179 INFO:tasks.rados.rados.0.smithi033.stdout:1916: expect (ObjNum 586 snap 181 seq_num 586) 2021-07-26T16:03:56.180 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 183 2021-07-26T16:03:56.180 INFO:tasks.rados.rados.0.smithi033.stdout:1917: seq_num 599 ranges {10297344=434176} 2021-07-26T16:03:56.239 INFO:tasks.rados.rados.0.smithi033.stdout:1917: writing smithi03339061-49 from 10297344 to 10731520 tid 1 2021-07-26T16:03:56.239 INFO:tasks.rados.rados.0.smithi033.stdout:1918: read oid 50 snap -1 2021-07-26T16:03:56.239 INFO:tasks.rados.rados.0.smithi033.stdout:1918: expect (ObjNum 579 snap 179 seq_num 579) 2021-07-26T16:03:56.240 INFO:tasks.rados.rados.0.smithi033.stdout:1919: setattr oid 38 current snap is 183 2021-07-26T16:03:56.240 INFO:tasks.rados.rados.0.smithi033.stdout:1914: finishing rollback tid 0 to smithi03339061-35 2021-07-26T16:03:56.240 INFO:tasks.rados.rados.0.smithi033.stdout:1914: finishing rollback tid 1 to smithi03339061-35 2021-07-26T16:03:56.240 INFO:tasks.rados.rados.0.smithi033.stdout:1914: finishing rollback tid 2 to smithi03339061-35 2021-07-26T16:03:56.241 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 841 (ObjNum 585 snap 181 seq_num 585) dirty exists 2021-07-26T16:03:56.241 INFO:tasks.rados.rados.0.smithi033.stdout:1912: finishing write tid 1 to smithi03339061-12 2021-07-26T16:03:56.241 INFO:tasks.rados.rados.0.smithi033.stdout:1912: finishing write tid 2 to smithi03339061-12 2021-07-26T16:03:56.241 INFO:tasks.rados.rados.0.smithi033.stdout:1913: finishing write tid 1 to smithi03339061-22 2021-07-26T16:03:56.241 INFO:tasks.rados.rados.0.smithi033.stdout:1915: finishing rollback tid 0 to smithi03339061-21 2021-07-26T16:03:56.242 INFO:tasks.rados.rados.0.smithi033.stdout:1913: finishing write tid 2 to smithi03339061-22 2021-07-26T16:03:56.242 INFO:tasks.rados.rados.0.smithi033.stdout:1912: finishing write tid 3 to smithi03339061-12 2021-07-26T16:03:56.242 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 841 (ObjNum 597 snap 183 seq_num 597) dirty exists 2021-07-26T16:03:56.242 INFO:tasks.rados.rados.0.smithi033.stdout:1912: left oid 12 (ObjNum 597 snap 183 seq_num 597) 2021-07-26T16:03:56.242 INFO:tasks.rados.rados.0.smithi033.stdout:1915: finishing rollback tid 1 to smithi03339061-21 2021-07-26T16:03:56.243 INFO:tasks.rados.rados.0.smithi033.stdout:1915: finishing rollback tid 2 to smithi03339061-21 2021-07-26T16:03:56.243 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1041 (ObjNum 575 snap 178 seq_num 575) dirty exists 2021-07-26T16:03:56.243 INFO:tasks.rados.rados.0.smithi033.stdout:1916: expect (ObjNum 586 snap 181 seq_num 586) 2021-07-26T16:03:56.348 INFO:tasks.rados.rados.0.smithi033.stdout:1913: finishing write tid 3 to smithi03339061-22 2021-07-26T16:03:56.348 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1169 (ObjNum 598 snap 183 seq_num 598) dirty exists 2021-07-26T16:03:56.348 INFO:tasks.rados.rados.0.smithi033.stdout:1913: left oid 22 (ObjNum 598 snap 183 seq_num 598) 2021-07-26T16:03:56.348 INFO:tasks.rados.rados.0.smithi033.stdout:1917: finishing write tid 1 to smithi03339061-49 2021-07-26T16:03:56.349 INFO:tasks.rados.rados.0.smithi033.stdout:1917: finishing write tid 2 to smithi03339061-49 2021-07-26T16:03:56.349 INFO:tasks.rados.rados.0.smithi033.stdout:1917: finishing write tid 3 to smithi03339061-49 2021-07-26T16:03:56.349 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 814 (ObjNum 599 snap 183 seq_num 599) dirty exists 2021-07-26T16:03:56.349 INFO:tasks.rados.rados.0.smithi033.stdout:1917: left oid 49 (ObjNum 599 snap 183 seq_num 599) 2021-07-26T16:03:56.349 INFO:tasks.rados.rados.0.smithi033.stdout:1918: expect (ObjNum 579 snap 179 seq_num 579) 2021-07-26T16:03:56.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:56 smithi096 bash[33981]: cluster 2021-07-26T16:03:55.072896+0000 mgr.y (mgr.34104) 299 : cluster [DBG] pgmap v465: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 414 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 15 op/s 2021-07-26T16:03:56.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:56 smithi096 bash[33981]: cluster 2021-07-26T16:03:55.221532+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e436: 8 total, 8 up, 8 in 2021-07-26T16:03:56.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:56 smithi096 bash[33981]: cluster 2021-07-26T16:03:56.078986+0000 mon.a (mon.0) 794 : cluster [DBG] osdmap e437: 8 total, 8 up, 8 in 2021-07-26T16:03:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:56 smithi033 bash[41341]: cluster 2021-07-26T16:03:55.072896+0000 mgr.y (mgr.34104) 299 : cluster [DBG] pgmap v465: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 414 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 15 op/s 2021-07-26T16:03:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:56 smithi033 bash[41341]: cluster 2021-07-26T16:03:55.221532+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e436: 8 total, 8 up, 8 in 2021-07-26T16:03:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:56 smithi033 bash[41341]: cluster 2021-07-26T16:03:56.078986+0000 mon.a (mon.0) 794 : cluster [DBG] osdmap e437: 8 total, 8 up, 8 in 2021-07-26T16:03:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:56 smithi033 bash[42377]: cluster 2021-07-26T16:03:55.072896+0000 mgr.y (mgr.34104) 299 : cluster [DBG] pgmap v465: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 414 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.9 MiB/s rd, 7.6 MiB/s wr, 15 op/s 2021-07-26T16:03:56.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:56 smithi033 bash[42377]: cluster 2021-07-26T16:03:55.221532+0000 mon.a (mon.0) 793 : cluster [DBG] osdmap e436: 8 total, 8 up, 8 in 2021-07-26T16:03:56.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:56 smithi033 bash[42377]: cluster 2021-07-26T16:03:56.078986+0000 mon.a (mon.0) 794 : cluster [DBG] osdmap e437: 8 total, 8 up, 8 in 2021-07-26T16:03:57.412 INFO:tasks.rados.rados.0.smithi033.stdout:1912: done (7 left) 2021-07-26T16:03:57.412 INFO:tasks.rados.rados.0.smithi033.stdout:1913: done (6 left) 2021-07-26T16:03:57.412 INFO:tasks.rados.rados.0.smithi033.stdout:1914: done (5 left) 2021-07-26T16:03:57.413 INFO:tasks.rados.rados.0.smithi033.stdout:1915: done (4 left) 2021-07-26T16:03:57.413 INFO:tasks.rados.rados.0.smithi033.stdout:1916: done (3 left) 2021-07-26T16:03:57.413 INFO:tasks.rados.rados.0.smithi033.stdout:1917: done (2 left) 2021-07-26T16:03:57.413 INFO:tasks.rados.rados.0.smithi033.stdout:1918: done (1 left) 2021-07-26T16:03:57.414 INFO:tasks.rados.rados.0.smithi033.stdout:1920: copy_from oid 26 from oid 29 current snap is 183 2021-07-26T16:03:57.414 INFO:tasks.rados.rados.0.smithi033.stdout:1921: copy_from oid 46 from oid 41 current snap is 183 2021-07-26T16:03:57.414 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 183 2021-07-26T16:03:57.414 INFO:tasks.rados.rados.0.smithi033.stdout:1922: seq_num 600 ranges {8372224=450560} 2021-07-26T16:03:57.470 INFO:tasks.rados.rados.0.smithi033.stdout:1922: writing smithi03339061-27 from 8372224 to 8822784 tid 1 2021-07-26T16:03:57.470 INFO:tasks.rados.rados.0.smithi033.stdout:1923: read oid 11 snap -1 2021-07-26T16:03:57.471 INFO:tasks.rados.rados.0.smithi033.stdout:1923: expect (ObjNum 578 snap 178 seq_num 578) 2021-07-26T16:03:57.471 INFO:tasks.rados.rados.0.smithi033.stdout:1924: rollback oid 25 current snap is 183 2021-07-26T16:03:57.471 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 25 to 181 2021-07-26T16:03:57.471 INFO:tasks.rados.rados.0.smithi033.stdout:1920: finishing copy_from to smithi03339061-26 2021-07-26T16:03:57.471 INFO:tasks.rados.rados.0.smithi033.stdout:1920: got expected ENOENT (src dne) 2021-07-26T16:03:57.472 INFO:tasks.rados.rados.0.smithi033.stdout:1920: finishing copy_from racing read to smithi03339061-26 2021-07-26T16:03:57.472 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 705 (ObjNum 580 snap 179 seq_num 580) dirty exists 2021-07-26T16:03:57.472 INFO:tasks.rados.rados.0.smithi033.stdout:1919: done (5 left) 2021-07-26T16:03:57.472 INFO:tasks.rados.rados.0.smithi033.stdout:1920: done (4 left) 2021-07-26T16:03:57.473 INFO:tasks.rados.rados.0.smithi033.stdout:1925: delete oid 14 current snap is 183 2021-07-26T16:03:57.473 INFO:tasks.rados.rados.0.smithi033.stdout:1921: finishing copy_from to smithi03339061-46 2021-07-26T16:03:57.473 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 621 (ObjNum 451 snap 139 seq_num 451) dirty exists 2021-07-26T16:03:57.474 INFO:tasks.rados.rados.0.smithi033.stdout:1921: finishing copy_from racing read to smithi03339061-46 2021-07-26T16:03:57.475 INFO:tasks.rados.rados.0.smithi033.stdout:1921: done (4 left) 2021-07-26T16:03:57.475 INFO:tasks.rados.rados.0.smithi033.stdout:1925: done (3 left) 2021-07-26T16:03:57.476 INFO:tasks.rados.rados.0.smithi033.stdout:1926: snap_create 2021-07-26T16:03:57.477 INFO:tasks.rados.rados.0.smithi033.stdout:1924: finishing rollback tid 0 to smithi03339061-25 2021-07-26T16:03:57.479 INFO:tasks.rados.rados.0.smithi033.stdout:1922: finishing write tid 1 to smithi03339061-27 2021-07-26T16:03:57.479 INFO:tasks.rados.rados.0.smithi033.stdout:1924: finishing rollback tid 1 to smithi03339061-25 2021-07-26T16:03:57.480 INFO:tasks.rados.rados.0.smithi033.stdout:1924: finishing rollback tid 2 to smithi03339061-25 2021-07-26T16:03:57.481 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 820 (ObjNum 556 snap 175 seq_num 556) dirty exists 2021-07-26T16:03:57.481 INFO:tasks.rados.rados.0.smithi033.stdout:1922: finishing write tid 2 to smithi03339061-27 2021-07-26T16:03:57.482 INFO:tasks.rados.rados.0.smithi033.stdout:1922: finishing write tid 3 to smithi03339061-27 2021-07-26T16:03:57.483 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1043 (ObjNum 600 snap 183 seq_num 600) dirty exists 2021-07-26T16:03:57.483 INFO:tasks.rados.rados.0.smithi033.stdout:1922: left oid 27 (ObjNum 600 snap 183 seq_num 600) 2021-07-26T16:03:57.487 INFO:tasks.rados.rados.0.smithi033.stdout:1923: expect (ObjNum 578 snap 178 seq_num 578) 2021-07-26T16:03:58.238 INFO:tasks.rados.rados.0.smithi033.stdout:1922: done (3 left) 2021-07-26T16:03:58.239 INFO:tasks.rados.rados.0.smithi033.stdout:1923: done (2 left) 2021-07-26T16:03:58.239 INFO:tasks.rados.rados.0.smithi033.stdout:1924: done (1 left) 2021-07-26T16:03:58.239 INFO:tasks.rados.rados.0.smithi033.stdout:1926: done (0 left) 2021-07-26T16:03:58.239 INFO:tasks.rados.rados.0.smithi033.stdout:1927: snap_create 2021-07-26T16:03:58.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:58 smithi096 bash[33981]: cluster 2021-07-26T16:03:57.073579+0000 mgr.y (mgr.34104) 300 : cluster [DBG] pgmap v468: 25 pgs: 25 active+clean; 400 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 7.6 MiB/s wr, 22 op/s 2021-07-26T16:03:58.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:58 smithi033 bash[41341]: cluster 2021-07-26T16:03:57.073579+0000 mgr.y (mgr.34104) 300 : cluster [DBG] pgmap v468: 25 pgs: 25 active+clean; 400 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 7.6 MiB/s wr, 22 op/s 2021-07-26T16:03:58.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:58 smithi033 bash[42377]: cluster 2021-07-26T16:03:57.073579+0000 mgr.y (mgr.34104) 300 : cluster [DBG] pgmap v468: 25 pgs: 25 active+clean; 400 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 7.6 MiB/s wr, 22 op/s 2021-07-26T16:03:59.242 INFO:tasks.rados.rados.0.smithi033.stdout:1927: done (0 left) 2021-07-26T16:03:59.243 INFO:tasks.rados.rados.0.smithi033.stdout:1928: rmattr oid 40 current snap is 185 2021-07-26T16:03:59.243 INFO:tasks.rados.rados.0.smithi033.stdout:1928: done (0 left) 2021-07-26T16:03:59.243 INFO:tasks.rados.rados.0.smithi033.stdout:1929: rmattr oid 32 current snap is 185 2021-07-26T16:03:59.243 INFO:tasks.rados.rados.0.smithi033.stdout:1930: rollback oid 27 current snap is 185 2021-07-26T16:03:59.244 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 27 to 183 2021-07-26T16:03:59.244 INFO:tasks.rados.rados.0.smithi033.stdout:1931: snap_create 2021-07-26T16:03:59.253 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 821 (ObjNum 519 snap 162 seq_num 519) dirty exists 2021-07-26T16:03:59.253 INFO:tasks.rados.rados.0.smithi033.stdout:1930: finishing rollback tid 0 to smithi03339061-27 2021-07-26T16:03:59.254 INFO:tasks.rados.rados.0.smithi033.stdout:1930: finishing rollback tid 1 to smithi03339061-27 2021-07-26T16:03:59.255 INFO:tasks.rados.rados.0.smithi033.stdout:1930: finishing rollback tid 2 to smithi03339061-27 2021-07-26T16:03:59.255 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1046 (ObjNum 600 snap 183 seq_num 600) dirty exists 2021-07-26T16:03:59.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:03:59 smithi033 bash[41341]: cluster 2021-07-26T16:03:58.233797+0000 mon.a (mon.0) 795 : cluster [DBG] osdmap e438: 8 total, 8 up, 8 in 2021-07-26T16:03:59.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:03:59 smithi033 bash[42377]: cluster 2021-07-26T16:03:58.233797+0000 mon.a (mon.0) 795 : cluster [DBG] osdmap e438: 8 total, 8 up, 8 in 2021-07-26T16:03:59.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:03:59 smithi096 bash[33981]: cluster 2021-07-26T16:03:58.233797+0000 mon.a (mon.0) 795 : cluster [DBG] osdmap e438: 8 total, 8 up, 8 in 2021-07-26T16:04:00.260 INFO:tasks.rados.rados.0.smithi033.stdout:1929: done (2 left) 2021-07-26T16:04:00.261 INFO:tasks.rados.rados.0.smithi033.stdout:1930: done (1 left) 2021-07-26T16:04:00.261 INFO:tasks.rados.rados.0.smithi033.stdout:1931: done (0 left) 2021-07-26T16:04:00.261 INFO:tasks.rados.rados.0.smithi033.stdout:1932: rollback oid 31 current snap is 186 2021-07-26T16:04:00.261 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 31 to 181 2021-07-26T16:04:00.261 INFO:tasks.rados.rados.0.smithi033.stdout:1933: snap_remove snap 174 2021-07-26T16:04:00.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:00 smithi033 bash[41341]: cluster 2021-07-26T16:03:59.074263+0000 mgr.y (mgr.34104) 301 : cluster [DBG] pgmap v470: 25 pgs: 25 active+clean; 383 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 4.4 MiB/s wr, 21 op/s 2021-07-26T16:04:00.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:00 smithi033 bash[41341]: cluster 2021-07-26T16:03:59.238728+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e439: 8 total, 8 up, 8 in 2021-07-26T16:04:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:00 smithi033 bash[42377]: cluster 2021-07-26T16:03:59.074263+0000 mgr.y (mgr.34104) 301 : cluster [DBG] pgmap v470: 25 pgs: 25 active+clean; 383 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 4.4 MiB/s wr, 21 op/s 2021-07-26T16:04:00.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:00 smithi033 bash[42377]: cluster 2021-07-26T16:03:59.238728+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e439: 8 total, 8 up, 8 in 2021-07-26T16:04:00.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:00 smithi096 bash[33981]: cluster 2021-07-26T16:03:59.074263+0000 mgr.y (mgr.34104) 301 : cluster [DBG] pgmap v470: 25 pgs: 25 active+clean; 383 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 4.4 MiB/s wr, 21 op/s 2021-07-26T16:04:00.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:00 smithi096 bash[33981]: cluster 2021-07-26T16:03:59.238728+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e439: 8 total, 8 up, 8 in 2021-07-26T16:04:01.087 INFO:tasks.rados.rados.0.smithi033.stdout:1933: done (1 left) 2021-07-26T16:04:01.088 INFO:tasks.rados.rados.0.smithi033.stdout:1934: rmattr oid 21 current snap is 186 2021-07-26T16:04:01.088 INFO:tasks.rados.rados.0.smithi033.stdout:1932: finishing rollback tid 0 to smithi03339061-31 2021-07-26T16:04:01.088 INFO:tasks.rados.rados.0.smithi033.stdout:1932: finishing rollback tid 1 to smithi03339061-31 2021-07-26T16:04:01.089 INFO:tasks.rados.rados.0.smithi033.stdout:1932: finishing rollback tid 2 to smithi03339061-31 2021-07-26T16:04:01.090 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1041 (ObjNum 442 snap 137 seq_num 442) dirty exists 2021-07-26T16:04:01.091 INFO:tasks.rados.rados.0.smithi033.stdout:1932: done (1 left) 2021-07-26T16:04:01.092 INFO:tasks.rados.rados.0.smithi033.stdout:1935: snap_remove snap 181 2021-07-26T16:04:01.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:01 smithi033 bash[41341]: cluster 2021-07-26T16:04:00.257488+0000 mon.a (mon.0) 797 : cluster [DBG] osdmap e440: 8 total, 8 up, 8 in 2021-07-26T16:04:01.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:01 smithi033 bash[41341]: cluster 2021-07-26T16:04:01.080030+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e441: 8 total, 8 up, 8 in 2021-07-26T16:04:01.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:01 smithi033 bash[42377]: cluster 2021-07-26T16:04:00.257488+0000 mon.a (mon.0) 797 : cluster [DBG] osdmap e440: 8 total, 8 up, 8 in 2021-07-26T16:04:01.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:01 smithi033 bash[42377]: cluster 2021-07-26T16:04:01.080030+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e441: 8 total, 8 up, 8 in 2021-07-26T16:04:01.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:01 smithi096 bash[33981]: cluster 2021-07-26T16:04:00.257488+0000 mon.a (mon.0) 797 : cluster [DBG] osdmap e440: 8 total, 8 up, 8 in 2021-07-26T16:04:01.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:01 smithi096 bash[33981]: cluster 2021-07-26T16:04:01.080030+0000 mon.a (mon.0) 798 : cluster [DBG] osdmap e441: 8 total, 8 up, 8 in 2021-07-26T16:04:02.109 INFO:tasks.rados.rados.0.smithi033.stdout:1935: done (1 left) 2021-07-26T16:04:02.109 INFO:tasks.rados.rados.0.smithi033.stdout:1936: rollback oid 12 current snap is 186 2021-07-26T16:04:02.109 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1047 (ObjNum 575 snap 178 seq_num 575) dirty exists 2021-07-26T16:04:02.110 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 12 to 183 2021-07-26T16:04:02.110 INFO:tasks.rados.rados.0.smithi033.stdout:1934: done (1 left) 2021-07-26T16:04:02.110 INFO:tasks.rados.rados.0.smithi033.stdout:1937: read oid 11 snap -1 2021-07-26T16:04:02.110 INFO:tasks.rados.rados.0.smithi033.stdout:1937: expect (ObjNum 578 snap 178 seq_num 578) 2021-07-26T16:04:02.111 INFO:tasks.rados.rados.0.smithi033.stdout:1938: snap_create 2021-07-26T16:04:02.120 INFO:tasks.rados.rados.0.smithi033.stdout:1936: finishing rollback tid 0 to smithi03339061-12 2021-07-26T16:04:02.121 INFO:tasks.rados.rados.0.smithi033.stdout:1936: finishing rollback tid 1 to smithi03339061-12 2021-07-26T16:04:02.124 INFO:tasks.rados.rados.0.smithi033.stdout:1936: finishing rollback tid 2 to smithi03339061-12 2021-07-26T16:04:02.124 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 844 (ObjNum 597 snap 183 seq_num 597) dirty exists 2021-07-26T16:04:02.133 INFO:tasks.rados.rados.0.smithi033.stdout:1937: expect (ObjNum 578 snap 178 seq_num 578) 2021-07-26T16:04:02.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:02 smithi033 bash[41341]: cluster 2021-07-26T16:04:01.075053+0000 mgr.y (mgr.34104) 302 : cluster [DBG] pgmap v473: 25 pgs: 25 active+clean; 387 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2021-07-26T16:04:02.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:02 smithi033 bash[41341]: cluster 2021-07-26T16:04:02.100170+0000 mon.a (mon.0) 799 : cluster [DBG] osdmap e442: 8 total, 8 up, 8 in 2021-07-26T16:04:02.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:02 smithi033 bash[42377]: cluster 2021-07-26T16:04:01.075053+0000 mgr.y (mgr.34104) 302 : cluster [DBG] pgmap v473: 25 pgs: 25 active+clean; 387 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2021-07-26T16:04:02.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:02 smithi033 bash[42377]: cluster 2021-07-26T16:04:02.100170+0000 mon.a (mon.0) 799 : cluster [DBG] osdmap e442: 8 total, 8 up, 8 in 2021-07-26T16:04:02.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:02 smithi096 bash[33981]: cluster 2021-07-26T16:04:01.075053+0000 mgr.y (mgr.34104) 302 : cluster [DBG] pgmap v473: 25 pgs: 25 active+clean; 387 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2021-07-26T16:04:02.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:02 smithi096 bash[33981]: cluster 2021-07-26T16:04:02.100170+0000 mon.a (mon.0) 799 : cluster [DBG] osdmap e442: 8 total, 8 up, 8 in 2021-07-26T16:04:03.105 INFO:tasks.rados.rados.0.smithi033.stdout:1936: done (2 left) 2021-07-26T16:04:03.106 INFO:tasks.rados.rados.0.smithi033.stdout:1937: done (1 left) 2021-07-26T16:04:03.106 INFO:tasks.rados.rados.0.smithi033.stdout:1938: done (0 left) 2021-07-26T16:04:03.106 INFO:tasks.rados.rados.0.smithi033.stdout:1939: copy_from oid 21 from oid 50 current snap is 187 2021-07-26T16:04:03.107 INFO:tasks.rados.rados.0.smithi033.stdout:1940: read oid 7 snap -1 2021-07-26T16:04:03.107 INFO:tasks.rados.rados.0.smithi033.stdout:1940: expect (ObjNum 476 snap 148 seq_num 476) 2021-07-26T16:04:03.107 INFO:tasks.rados.rados.0.smithi033.stdout:1941: read oid 37 snap -1 2021-07-26T16:04:03.107 INFO:tasks.rados.rados.0.smithi033.stdout:1941: expect deleted 2021-07-26T16:04:03.108 INFO:tasks.rados.rados.0.smithi033.stdout:1942: snap_create 2021-07-26T16:04:03.141 INFO:tasks.rados.rados.0.smithi033.stdout:1940: expect (ObjNum 476 snap 148 seq_num 476) 2021-07-26T16:04:03.541 INFO:tasks.rados.rados.0.smithi033.stdout:1939: finishing copy_from to smithi03339061-21 2021-07-26T16:04:03.541 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 814 (ObjNum 579 snap 179 seq_num 579) dirty exists 2021-07-26T16:04:03.542 INFO:tasks.rados.rados.0.smithi033.stdout:1939: finishing copy_from racing read to smithi03339061-21 2021-07-26T16:04:04.109 INFO:tasks.rados.rados.0.smithi033.stdout:1939: done (3 left) 2021-07-26T16:04:04.110 INFO:tasks.rados.rados.0.smithi033.stdout:1940: done (2 left) 2021-07-26T16:04:04.110 INFO:tasks.rados.rados.0.smithi033.stdout:1941: done (1 left) 2021-07-26T16:04:04.110 INFO:tasks.rados.rados.0.smithi033.stdout:1942: done (0 left) 2021-07-26T16:04:04.111 INFO:tasks.rados.rados.0.smithi033.stdout:1943: rollback oid 37 current snap is 188 2021-07-26T16:04:04.111 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 37 to 187 2021-07-26T16:04:04.112 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 188 2021-07-26T16:04:04.112 INFO:tasks.rados.rados.0.smithi033.stdout:1944: seq_num 602 ranges {0=491520} 2021-07-26T16:04:04.115 INFO:tasks.rados.rados.0.smithi033.stdout:1944: writing smithi03339061-48 from 0 to 491520 tid 1 2021-07-26T16:04:04.115 INFO:tasks.rados.rados.0.smithi033.stdout:1945: snap_create 2021-07-26T16:04:04.117 INFO:tasks.rados.rados.0.smithi033.stdout:1943: finishing rollback tid 1 to smithi03339061-37 2021-07-26T16:04:04.118 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 879 (ObjNum 2006026688 snap 22002 seq_num 0) dirty dne 2021-07-26T16:04:04.125 INFO:tasks.rados.rados.0.smithi033.stdout:1944: finishing write tid 1 to smithi03339061-48 2021-07-26T16:04:04.125 INFO:tasks.rados.rados.0.smithi033.stdout:1944: finishing write tid 2 to smithi03339061-48 2021-07-26T16:04:04.127 INFO:tasks.rados.rados.0.smithi033.stdout:1944: finishing write tid 3 to smithi03339061-48 2021-07-26T16:04:04.127 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 860 (ObjNum 602 snap 188 seq_num 602) dirty exists 2021-07-26T16:04:04.128 INFO:tasks.rados.rados.0.smithi033.stdout:1944: left oid 48 (ObjNum 602 snap 188 seq_num 602) 2021-07-26T16:04:04.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:04 smithi033 bash[41341]: cluster 2021-07-26T16:04:03.075822+0000 mgr.y (mgr.34104) 303 : cluster [DBG] pgmap v476: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 330 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2021-07-26T16:04:04.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:04 smithi033 bash[41341]: cluster 2021-07-26T16:04:03.101432+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e443: 8 total, 8 up, 8 in 2021-07-26T16:04:04.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:04 smithi033 bash[42377]: cluster 2021-07-26T16:04:03.075822+0000 mgr.y (mgr.34104) 303 : cluster [DBG] pgmap v476: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 330 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2021-07-26T16:04:04.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:04 smithi033 bash[42377]: cluster 2021-07-26T16:04:03.101432+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e443: 8 total, 8 up, 8 in 2021-07-26T16:04:04.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:04 smithi096 bash[33981]: cluster 2021-07-26T16:04:03.075822+0000 mgr.y (mgr.34104) 303 : cluster [DBG] pgmap v476: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 330 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.2 MiB/s wr, 13 op/s 2021-07-26T16:04:04.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:04 smithi096 bash[33981]: cluster 2021-07-26T16:04:03.101432+0000 mon.a (mon.0) 800 : cluster [DBG] osdmap e443: 8 total, 8 up, 8 in 2021-07-26T16:04:05.125 INFO:tasks.rados.rados.0.smithi033.stdout:1943: done (2 left) 2021-07-26T16:04:05.125 INFO:tasks.rados.rados.0.smithi033.stdout:1944: done (1 left) 2021-07-26T16:04:05.126 INFO:tasks.rados.rados.0.smithi033.stdout:1945: done (0 left) 2021-07-26T16:04:05.126 INFO:tasks.rados.rados.0.smithi033.stdout:1946: read oid 21 snap -1 2021-07-26T16:04:05.126 INFO:tasks.rados.rados.0.smithi033.stdout:1946: expect (ObjNum 579 snap 179 seq_num 579) 2021-07-26T16:04:05.126 INFO:tasks.rados.rados.0.smithi033.stdout:1947: delete oid 13 current snap is 189 2021-07-26T16:04:05.131 INFO:tasks.rados.rados.0.smithi033.stdout:1947: done (1 left) 2021-07-26T16:04:05.132 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 189 2021-07-26T16:04:05.132 INFO:tasks.rados.rados.0.smithi033.stdout:1948: seq_num 604 ranges {958464=524288} 2021-07-26T16:04:05.143 INFO:tasks.rados.rados.0.smithi033.stdout:1948: writing smithi03339061-41 from 958464 to 1482752 tid 1 2021-07-26T16:04:05.143 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 189 2021-07-26T16:04:05.143 INFO:tasks.rados.rados.0.smithi033.stdout:1949: seq_num 605 ranges {1802240=540672} 2021-07-26T16:04:05.157 INFO:tasks.rados.rados.0.smithi033.stdout:1949: writing smithi03339061-20 from 1802240 to 2342912 tid 1 2021-07-26T16:04:05.157 INFO:tasks.rados.rados.0.smithi033.stdout:1950: setattr oid 19 current snap is 189 2021-07-26T16:04:05.158 INFO:tasks.rados.rados.0.smithi033.stdout:1948: finishing write tid 1 to smithi03339061-41 2021-07-26T16:04:05.158 INFO:tasks.rados.rados.0.smithi033.stdout:1948: finishing write tid 2 to smithi03339061-41 2021-07-26T16:04:05.158 INFO:tasks.rados.rados.0.smithi033.stdout:1948: finishing write tid 3 to smithi03339061-41 2021-07-26T16:04:05.158 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 862 (ObjNum 604 snap 189 seq_num 604) dirty exists 2021-07-26T16:04:05.159 INFO:tasks.rados.rados.0.smithi033.stdout:1948: left oid 41 (ObjNum 604 snap 189 seq_num 604) 2021-07-26T16:04:05.159 INFO:tasks.rados.rados.0.smithi033.stdout:1948: done (3 left) 2021-07-26T16:04:05.159 INFO:tasks.rados.rados.0.smithi033.stdout:1951: delete oid 38 current snap is 189 2021-07-26T16:04:05.163 INFO:tasks.rados.rados.0.smithi033.stdout:1949: finishing write tid 1 to smithi03339061-20 2021-07-26T16:04:05.163 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 842 (ObjNum 2007394096 snap 22002 seq_num 2006316528) dirty exists 2021-07-26T16:04:05.164 INFO:tasks.rados.rados.0.smithi033.stdout:1949: finishing write tid 2 to smithi03339061-20 2021-07-26T16:04:05.165 INFO:tasks.rados.rados.0.smithi033.stdout:1949: finishing write tid 3 to smithi03339061-20 2021-07-26T16:04:05.165 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1047 (ObjNum 605 snap 189 seq_num 605) dirty exists 2021-07-26T16:04:05.166 INFO:tasks.rados.rados.0.smithi033.stdout:1949: left oid 20 (ObjNum 605 snap 189 seq_num 605) 2021-07-26T16:04:05.171 INFO:tasks.rados.rados.0.smithi033.stdout:1946: expect (ObjNum 579 snap 179 seq_num 579) 2021-07-26T16:04:05.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:05 smithi033 bash[41341]: cluster 2021-07-26T16:04:04.104878+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e444: 8 total, 8 up, 8 in 2021-07-26T16:04:05.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:05 smithi033 bash[42377]: cluster 2021-07-26T16:04:04.104878+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e444: 8 total, 8 up, 8 in 2021-07-26T16:04:05.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:05 smithi096 bash[33981]: cluster 2021-07-26T16:04:04.104878+0000 mon.a (mon.0) 801 : cluster [DBG] osdmap e444: 8 total, 8 up, 8 in 2021-07-26T16:04:06.244 INFO:tasks.rados.rados.0.smithi033.stdout:1946: done (3 left) 2021-07-26T16:04:06.244 INFO:tasks.rados.rados.0.smithi033.stdout:1949: done (2 left) 2021-07-26T16:04:06.244 INFO:tasks.rados.rados.0.smithi033.stdout:1950: done (1 left) 2021-07-26T16:04:06.244 INFO:tasks.rados.rados.0.smithi033.stdout:1951: done (0 left) 2021-07-26T16:04:06.245 INFO:tasks.rados.rados.0.smithi033.stdout:1952: read oid 13 snap -1 2021-07-26T16:04:06.245 INFO:tasks.rados.rados.0.smithi033.stdout:1952: expect deleted 2021-07-26T16:04:06.245 INFO:tasks.rados.rados.0.smithi033.stdout:1953: read oid 46 snap 184 2021-07-26T16:04:06.245 INFO:tasks.rados.rados.0.smithi033.stdout:1953: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:04:06.246 INFO:tasks.rados.rados.0.smithi033.stdout:1954: rmattr oid 39 current snap is 189 2021-07-26T16:04:06.246 INFO:tasks.rados.rados.0.smithi033.stdout:1955: snap_create 2021-07-26T16:04:06.254 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1048 (ObjNum 517 snap 161 seq_num 517) dirty exists 2021-07-26T16:04:06.255 INFO:tasks.rados.rados.0.smithi033.stdout:1953: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:04:06.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:06 smithi033 bash[42377]: cluster 2021-07-26T16:04:05.076502+0000 mgr.y (mgr.34104) 304 : cluster [DBG] pgmap v479: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 320 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 226 KiB/s wr, 10 op/s 2021-07-26T16:04:06.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:06 smithi033 bash[42377]: cluster 2021-07-26T16:04:05.121624+0000 mon.a (mon.0) 802 : cluster [DBG] osdmap e445: 8 total, 8 up, 8 in 2021-07-26T16:04:06.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:06 smithi033 bash[42377]: cluster 2021-07-26T16:04:06.083812+0000 mon.a (mon.0) 803 : cluster [DBG] osdmap e446: 8 total, 8 up, 8 in 2021-07-26T16:04:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:06 smithi033 bash[41341]: cluster 2021-07-26T16:04:05.076502+0000 mgr.y (mgr.34104) 304 : cluster [DBG] pgmap v479: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 320 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 226 KiB/s wr, 10 op/s 2021-07-26T16:04:06.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:06 smithi033 bash[41341]: cluster 2021-07-26T16:04:05.121624+0000 mon.a (mon.0) 802 : cluster [DBG] osdmap e445: 8 total, 8 up, 8 in 2021-07-26T16:04:06.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:06 smithi033 bash[41341]: cluster 2021-07-26T16:04:06.083812+0000 mon.a (mon.0) 803 : cluster [DBG] osdmap e446: 8 total, 8 up, 8 in 2021-07-26T16:04:06.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:06 smithi096 bash[33981]: cluster 2021-07-26T16:04:05.076502+0000 mgr.y (mgr.34104) 304 : cluster [DBG] pgmap v479: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 320 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 226 KiB/s wr, 10 op/s 2021-07-26T16:04:06.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:06 smithi096 bash[33981]: cluster 2021-07-26T16:04:05.121624+0000 mon.a (mon.0) 802 : cluster [DBG] osdmap e445: 8 total, 8 up, 8 in 2021-07-26T16:04:06.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:06 smithi096 bash[33981]: cluster 2021-07-26T16:04:06.083812+0000 mon.a (mon.0) 803 : cluster [DBG] osdmap e446: 8 total, 8 up, 8 in 2021-07-26T16:04:07.140 INFO:tasks.rados.rados.0.smithi033.stdout:1952: done (3 left) 2021-07-26T16:04:07.141 INFO:tasks.rados.rados.0.smithi033.stdout:1953: done (2 left) 2021-07-26T16:04:07.141 INFO:tasks.rados.rados.0.smithi033.stdout:1954: done (1 left) 2021-07-26T16:04:07.141 INFO:tasks.rados.rados.0.smithi033.stdout:1955: done (0 left) 2021-07-26T16:04:07.141 INFO:tasks.rados.rados.0.smithi033.stdout:1956: read oid 32 snap 179 2021-07-26T16:04:07.142 INFO:tasks.rados.rados.0.smithi033.stdout:1956: expect (ObjNum 519 snap 162 seq_num 519) 2021-07-26T16:04:07.142 INFO:tasks.rados.rados.0.smithi033.stdout:1957: setattr oid 36 current snap is 190 2021-07-26T16:04:07.144 INFO:tasks.rados.rados.0.smithi033.stdout:1958: snap_create 2021-07-26T16:04:07.155 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 862 (ObjNum 567 snap 177 seq_num 567) dirty exists 2021-07-26T16:04:07.201 INFO:tasks.rados.rados.0.smithi033.stdout:1956: expect (ObjNum 519 snap 162 seq_num 519) 2021-07-26T16:04:08.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:08 smithi033 bash[41341]: cluster 2021-07-26T16:04:07.077255+0000 mgr.y (mgr.34104) 305 : cluster [DBG] pgmap v482: 25 pgs: 25 active+clean; 307 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 252 KiB/s wr, 8 op/s 2021-07-26T16:04:08.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:08 smithi033 bash[41341]: cluster 2021-07-26T16:04:07.137671+0000 mon.a (mon.0) 804 : cluster [DBG] osdmap e447: 8 total, 8 up, 8 in 2021-07-26T16:04:08.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:08 smithi033 bash[42377]: cluster 2021-07-26T16:04:07.077255+0000 mgr.y (mgr.34104) 305 : cluster [DBG] pgmap v482: 25 pgs: 25 active+clean; 307 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 252 KiB/s wr, 8 op/s 2021-07-26T16:04:08.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:08 smithi033 bash[42377]: cluster 2021-07-26T16:04:07.137671+0000 mon.a (mon.0) 804 : cluster [DBG] osdmap e447: 8 total, 8 up, 8 in 2021-07-26T16:04:08.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:08 smithi096 bash[33981]: cluster 2021-07-26T16:04:07.077255+0000 mgr.y (mgr.34104) 305 : cluster [DBG] pgmap v482: 25 pgs: 25 active+clean; 307 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 1.8 MiB/s rd, 252 KiB/s wr, 8 op/s 2021-07-26T16:04:08.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:08 smithi096 bash[33981]: cluster 2021-07-26T16:04:07.137671+0000 mon.a (mon.0) 804 : cluster [DBG] osdmap e447: 8 total, 8 up, 8 in 2021-07-26T16:04:08.757 INFO:tasks.rados.rados.0.smithi033.stdout:1956: done (2 left) 2021-07-26T16:04:08.758 INFO:tasks.rados.rados.0.smithi033.stdout:1957: done (1 left) 2021-07-26T16:04:08.758 INFO:tasks.rados.rados.0.smithi033.stdout:1958: done (0 left) 2021-07-26T16:04:08.758 INFO:tasks.rados.rados.0.smithi033.stdout:1959: delete oid 49 current snap is 191 2021-07-26T16:04:08.762 INFO:tasks.rados.rados.0.smithi033.stdout:1959: done (0 left) 2021-07-26T16:04:08.762 INFO:tasks.rados.rados.0.smithi033.stdout:1960: read oid 3 snap 188 2021-07-26T16:04:08.763 INFO:tasks.rados.rados.0.smithi033.stdout:1960: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:04:08.763 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 191 2021-07-26T16:04:08.763 INFO:tasks.rados.rados.0.smithi033.stdout:1961: seq_num 608 ranges {2686976=589824} 2021-07-26T16:04:08.788 INFO:tasks.rados.rados.0.smithi033.stdout:1961: writing smithi03339061-10 from 2686976 to 3276800 tid 1 2021-07-26T16:04:08.788 INFO:tasks.rados.rados.0.smithi033.stdout:1962: snap_create 2021-07-26T16:04:08.788 INFO:tasks.rados.rados.0.smithi033.stdout:1960: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:04:08.859 INFO:tasks.rados.rados.0.smithi033.stdout:1961: finishing write tid 1 to smithi03339061-10 2021-07-26T16:04:08.859 INFO:tasks.rados.rados.0.smithi033.stdout:1961: finishing write tid 2 to smithi03339061-10 2021-07-26T16:04:08.859 INFO:tasks.rados.rados.0.smithi033.stdout:1961: finishing write tid 3 to smithi03339061-10 2021-07-26T16:04:08.860 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 919 (ObjNum 608 snap 191 seq_num 608) dirty exists 2021-07-26T16:04:08.861 INFO:tasks.rados.rados.0.smithi033.stdout:1961: left oid 10 (ObjNum 608 snap 191 seq_num 608) 2021-07-26T16:04:09.158 INFO:tasks.rados.rados.0.smithi033.stdout:1960: done (2 left) 2021-07-26T16:04:09.158 INFO:tasks.rados.rados.0.smithi033.stdout:1961: done (1 left) 2021-07-26T16:04:09.159 INFO:tasks.rados.rados.0.smithi033.stdout:1962: done (0 left) 2021-07-26T16:04:09.159 INFO:tasks.rados.rados.0.smithi033.stdout:1963: copy_from oid 45 from oid 2 current snap is 192 2021-07-26T16:04:09.159 INFO:tasks.rados.rados.0.smithi033.stdout:1964: read oid 19 snap 188 2021-07-26T16:04:09.159 INFO:tasks.rados.rados.0.smithi033.stdout:1964: expect deleted 2021-07-26T16:04:09.159 INFO:tasks.rados.rados.0.smithi033.stdout:1965: setattr oid 40 current snap is 192 2021-07-26T16:04:09.161 INFO:tasks.rados.rados.0.smithi033.stdout:1964: done (2 left) 2021-07-26T16:04:09.161 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 37 current snap is 192 2021-07-26T16:04:09.161 INFO:tasks.rados.rados.0.smithi033.stdout:1966: seq_num 609 ranges {0=606208} 2021-07-26T16:04:09.166 INFO:tasks.rados.rados.0.smithi033.stdout:1966: writing smithi03339061-37 from 0 to 606208 tid 1 2021-07-26T16:04:09.166 INFO:tasks.rados.rados.0.smithi033.stdout:1967: rmattr oid 17 current snap is 192 2021-07-26T16:04:09.166 INFO:tasks.rados.rados.0.smithi033.stdout:1968: rmattr oid 15 current snap is 192 2021-07-26T16:04:09.166 INFO:tasks.rados.rados.0.smithi033.stdout:1969: delete oid 11 current snap is 192 2021-07-26T16:04:09.169 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 505 (ObjNum 594 snap 182 seq_num 594) dirty exists 2021-07-26T16:04:09.172 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 506 (ObjNum 444 snap 137 seq_num 444) dirty exists 2021-07-26T16:04:09.173 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 816 (ObjNum 538 snap 167 seq_num 538) dirty exists 2021-07-26T16:04:09.173 INFO:tasks.rados.rados.0.smithi033.stdout:1966: finishing write tid 1 to smithi03339061-37 2021-07-26T16:04:09.174 INFO:tasks.rados.rados.0.smithi033.stdout:1966: finishing write tid 2 to smithi03339061-37 2021-07-26T16:04:09.175 INFO:tasks.rados.rados.0.smithi033.stdout:1966: finishing write tid 3 to smithi03339061-37 2021-07-26T16:04:09.176 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 921 (ObjNum 609 snap 192 seq_num 609) dirty exists 2021-07-26T16:04:09.176 INFO:tasks.rados.rados.0.smithi033.stdout:1966: left oid 37 (ObjNum 609 snap 192 seq_num 609) 2021-07-26T16:04:09.178 INFO:tasks.rados.rados.0.smithi033.stdout:1965: done (5 left) 2021-07-26T16:04:09.179 INFO:tasks.rados.rados.0.smithi033.stdout:1966: done (4 left) 2021-07-26T16:04:09.179 INFO:tasks.rados.rados.0.smithi033.stdout:1967: done (3 left) 2021-07-26T16:04:09.180 INFO:tasks.rados.rados.0.smithi033.stdout:1968: done (2 left) 2021-07-26T16:04:09.180 INFO:tasks.rados.rados.0.smithi033.stdout:1969: done (1 left) 2021-07-26T16:04:09.180 INFO:tasks.rados.rados.0.smithi033.stdout:1970: rmattr oid 5 current snap is 192 2021-07-26T16:04:09.181 INFO:tasks.rados.rados.0.smithi033.stdout:1971: read oid 46 snap 184 2021-07-26T16:04:09.181 INFO:tasks.rados.rados.0.smithi033.stdout:1971: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:04:09.182 INFO:tasks.rados.rados.0.smithi033.stdout:1972: rollback oid 16 current snap is 192 2021-07-26T16:04:09.183 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 16 to 189 2021-07-26T16:04:09.183 INFO:tasks.rados.rados.0.smithi033.stdout:1973: setattr oid 8 current snap is 192 2021-07-26T16:04:09.184 INFO:tasks.rados.rados.0.smithi033.stdout:1974: read oid 10 snap -1 2021-07-26T16:04:09.185 INFO:tasks.rados.rados.0.smithi033.stdout:1974: expect (ObjNum 608 snap 191 seq_num 608) 2021-07-26T16:04:09.185 INFO:tasks.rados.rados.0.smithi033.stdout:1975: snap_remove snap 182 2021-07-26T16:04:09.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:09 smithi033 bash[41341]: cluster 2021-07-26T16:04:08.137628+0000 mon.a (mon.0) 805 : cluster [DBG] osdmap e448: 8 total, 8 up, 8 in 2021-07-26T16:04:09.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:09 smithi033 bash[42377]: cluster 2021-07-26T16:04:08.137628+0000 mon.a (mon.0) 805 : cluster [DBG] osdmap e448: 8 total, 8 up, 8 in 2021-07-26T16:04:09.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:09 smithi096 bash[33981]: cluster 2021-07-26T16:04:08.137628+0000 mon.a (mon.0) 805 : cluster [DBG] osdmap e448: 8 total, 8 up, 8 in 2021-07-26T16:04:10.167 INFO:tasks.rados.rados.0.smithi033.stdout:1975: done (6 left) 2021-07-26T16:04:10.168 INFO:tasks.rados.rados.0.smithi033.stdout:1976: copy_from oid 25 from oid 18 current snap is 192 2021-07-26T16:04:10.168 INFO:tasks.rados.rados.0.smithi033.stdout:1977: delete oid 34 current snap is 192 2021-07-26T16:04:10.168 INFO:tasks.rados.rados.0.smithi033.stdout:1971: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:04:10.212 INFO:tasks.rados.rados.0.smithi033.stdout:1972: finishing rollback tid 0 to smithi03339061-16 2021-07-26T16:04:10.213 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 843 (ObjNum 570 snap 177 seq_num 570) dirty exists 2021-07-26T16:04:10.213 INFO:tasks.rados.rados.0.smithi033.stdout:1972: finishing rollback tid 1 to smithi03339061-16 2021-07-26T16:04:10.213 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 863 (ObjNum 488 snap 152 seq_num 488) dirty exists 2021-07-26T16:04:10.213 INFO:tasks.rados.rados.0.smithi033.stdout:1972: finishing rollback tid 2 to smithi03339061-16 2021-07-26T16:04:10.213 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 824 (ObjNum 538 snap 167 seq_num 538) dirty exists 2021-07-26T16:04:10.214 INFO:tasks.rados.rados.0.smithi033.stdout:1970: done (7 left) 2021-07-26T16:04:10.214 INFO:tasks.rados.rados.0.smithi033.stdout:1971: done (6 left) 2021-07-26T16:04:10.214 INFO:tasks.rados.rados.0.smithi033.stdout:1972: done (5 left) 2021-07-26T16:04:10.214 INFO:tasks.rados.rados.0.smithi033.stdout:1973: done (4 left) 2021-07-26T16:04:10.215 INFO:tasks.rados.rados.0.smithi033.stdout:1977: done (3 left) 2021-07-26T16:04:10.215 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 192 2021-07-26T16:04:10.215 INFO:tasks.rados.rados.0.smithi033.stdout:1974: expect (ObjNum 608 snap 191 seq_num 608) 2021-07-26T16:04:10.396 INFO:tasks.rados.rados.0.smithi033.stdout:1963: finishing copy_from to smithi03339061-45 2021-07-26T16:04:10.397 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 839 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:04:10.397 INFO:tasks.rados.rados.0.smithi033.stdout:1963: finishing copy_from racing read to smithi03339061-45 2021-07-26T16:04:10.397 INFO:tasks.rados.rados.0.smithi033.stdout:1978: seq_num 612 ranges {9928704=655360} 2021-07-26T16:04:10.456 INFO:tasks.rados.rados.0.smithi033.stdout:1978: writing smithi03339061-21 from 9928704 to 10584064 tid 1 2021-07-26T16:04:10.457 INFO:tasks.rados.rados.0.smithi033.stdout:1963: done (3 left) 2021-07-26T16:04:10.457 INFO:tasks.rados.rados.0.smithi033.stdout:1974: done (2 left) 2021-07-26T16:04:10.457 INFO:tasks.rados.rados.0.smithi033.stdout:1979: snap_remove snap 185 2021-07-26T16:04:10.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[41341]: cluster 2021-07-26T16:04:09.077941+0000 mgr.y (mgr.34104) 306 : cluster [DBG] pgmap v485: 25 pgs: 25 active+clean; 316 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2021-07-26T16:04:10.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[41341]: cluster 2021-07-26T16:04:09.155458+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e449: 8 total, 8 up, 8 in 2021-07-26T16:04:10.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[41341]: audit 2021-07-26T16:04:09.225305+0000 mon.c (mon.1) 241 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:04:10.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[41341]: audit 2021-07-26T16:04:09.225879+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:04:10.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[41341]: audit 2021-07-26T16:04:09.231066+0000 mon.c (mon.1) 242 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:04:10.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[41341]: audit 2021-07-26T16:04:09.231634+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:04:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[42377]: cluster 2021-07-26T16:04:09.077941+0000 mgr.y (mgr.34104) 306 : cluster [DBG] pgmap v485: 25 pgs: 25 active+clean; 316 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2021-07-26T16:04:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[42377]: cluster 2021-07-26T16:04:09.155458+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e449: 8 total, 8 up, 8 in 2021-07-26T16:04:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[42377]: audit 2021-07-26T16:04:09.225305+0000 mon.c (mon.1) 241 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:04:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[42377]: audit 2021-07-26T16:04:09.225879+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:04:10.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[42377]: audit 2021-07-26T16:04:09.231066+0000 mon.c (mon.1) 242 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:04:10.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:10 smithi033 bash[42377]: audit 2021-07-26T16:04:09.231634+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:04:10.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:10 smithi096 bash[33981]: cluster 2021-07-26T16:04:09.077941+0000 mgr.y (mgr.34104) 306 : cluster [DBG] pgmap v485: 25 pgs: 25 active+clean; 316 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2021-07-26T16:04:10.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:10 smithi096 bash[33981]: cluster 2021-07-26T16:04:09.155458+0000 mon.a (mon.0) 806 : cluster [DBG] osdmap e449: 8 total, 8 up, 8 in 2021-07-26T16:04:10.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:10 smithi096 bash[33981]: audit 2021-07-26T16:04:09.225305+0000 mon.c (mon.1) 241 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:04:10.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:10 smithi096 bash[33981]: audit 2021-07-26T16:04:09.225879+0000 mon.a (mon.0) 807 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:04:10.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:10 smithi096 bash[33981]: audit 2021-07-26T16:04:09.231066+0000 mon.c (mon.1) 242 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:04:10.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:10 smithi096 bash[33981]: audit 2021-07-26T16:04:09.231634+0000 mon.a (mon.0) 808 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:04:11.094 INFO:tasks.rados.rados.0.smithi033.stdout:1979: done (2 left) 2021-07-26T16:04:11.094 INFO:tasks.rados.rados.0.smithi033.stdout:1980: delete oid 44 current snap is 192 2021-07-26T16:04:11.094 INFO:tasks.rados.rados.0.smithi033.stdout:1976: finishing copy_from to smithi03339061-25 2021-07-26T16:04:11.094 INFO:tasks.rados.rados.0.smithi033.stdout:1976: got expected ENOENT (src dne) 2021-07-26T16:04:11.095 INFO:tasks.rados.rados.0.smithi033.stdout:1976: finishing copy_from racing read to smithi03339061-25 2021-07-26T16:04:11.095 INFO:tasks.rados.rados.0.smithi033.stdout:1978: finishing write tid 1 to smithi03339061-21 2021-07-26T16:04:11.095 INFO:tasks.rados.rados.0.smithi033.stdout:1978: finishing write tid 2 to smithi03339061-21 2021-07-26T16:04:11.095 INFO:tasks.rados.rados.0.smithi033.stdout:1978: finishing write tid 3 to smithi03339061-21 2021-07-26T16:04:11.096 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1050 (ObjNum 612 snap 192 seq_num 612) dirty exists 2021-07-26T16:04:11.096 INFO:tasks.rados.rados.0.smithi033.stdout:1978: left oid 21 (ObjNum 612 snap 192 seq_num 612) 2021-07-26T16:04:11.103 INFO:tasks.rados.rados.0.smithi033.stdout:1976: done (2 left) 2021-07-26T16:04:11.103 INFO:tasks.rados.rados.0.smithi033.stdout:1978: done (1 left) 2021-07-26T16:04:11.103 INFO:tasks.rados.rados.0.smithi033.stdout:1980: done (0 left) 2021-07-26T16:04:11.103 INFO:tasks.rados.rados.0.smithi033.stdout:1981: setattr oid 22 current snap is 192 2021-07-26T16:04:11.105 INFO:tasks.rados.rados.0.smithi033.stdout:1982: snap_create 2021-07-26T16:04:11.109 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1189 (ObjNum 598 snap 183 seq_num 598) dirty exists 2021-07-26T16:04:11.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:11 smithi033 bash[41341]: cluster 2021-07-26T16:04:10.163699+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e450: 8 total, 8 up, 8 in 2021-07-26T16:04:11.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:11 smithi033 bash[41341]: cluster 2021-07-26T16:04:11.083616+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e451: 8 total, 8 up, 8 in 2021-07-26T16:04:11.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:11 smithi033 bash[42377]: cluster 2021-07-26T16:04:10.163699+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e450: 8 total, 8 up, 8 in 2021-07-26T16:04:11.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:11 smithi033 bash[42377]: cluster 2021-07-26T16:04:11.083616+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e451: 8 total, 8 up, 8 in 2021-07-26T16:04:11.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:11 smithi096 bash[33981]: cluster 2021-07-26T16:04:10.163699+0000 mon.a (mon.0) 809 : cluster [DBG] osdmap e450: 8 total, 8 up, 8 in 2021-07-26T16:04:11.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:11 smithi096 bash[33981]: cluster 2021-07-26T16:04:11.083616+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e451: 8 total, 8 up, 8 in 2021-07-26T16:04:12.110 INFO:tasks.rados.rados.0.smithi033.stdout:1981: done (1 left) 2021-07-26T16:04:12.111 INFO:tasks.rados.rados.0.smithi033.stdout:1982: done (0 left) 2021-07-26T16:04:12.111 INFO:tasks.rados.rados.0.smithi033.stdout:1983: snap_remove snap 184 2021-07-26T16:04:12.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:12 smithi033 bash[41341]: cluster 2021-07-26T16:04:11.078805+0000 mgr.y (mgr.34104) 307 : cluster [DBG] pgmap v488: 25 pgs: 25 active+clean; 316 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 17 op/s 2021-07-26T16:04:12.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:12 smithi033 bash[41341]: cluster 2021-07-26T16:04:12.107249+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e452: 8 total, 8 up, 8 in 2021-07-26T16:04:12.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:12 smithi033 bash[42377]: cluster 2021-07-26T16:04:11.078805+0000 mgr.y (mgr.34104) 307 : cluster [DBG] pgmap v488: 25 pgs: 25 active+clean; 316 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 17 op/s 2021-07-26T16:04:12.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:12 smithi033 bash[42377]: cluster 2021-07-26T16:04:12.107249+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e452: 8 total, 8 up, 8 in 2021-07-26T16:04:12.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:12 smithi096 bash[33981]: cluster 2021-07-26T16:04:11.078805+0000 mgr.y (mgr.34104) 307 : cluster [DBG] pgmap v488: 25 pgs: 25 active+clean; 316 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 17 op/s 2021-07-26T16:04:12.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:12 smithi096 bash[33981]: cluster 2021-07-26T16:04:12.107249+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e452: 8 total, 8 up, 8 in 2021-07-26T16:04:13.115 INFO:tasks.rados.rados.0.smithi033.stdout:1983: done (0 left) 2021-07-26T16:04:13.115 INFO:tasks.rados.rados.0.smithi033.stdout:1984: read oid 8 snap -1 2021-07-26T16:04:13.116 INFO:tasks.rados.rados.0.smithi033.stdout:1984: expect (ObjNum 570 snap 177 seq_num 570) 2021-07-26T16:04:13.116 INFO:tasks.rados.rados.0.smithi033.stdout:1985: rmattr oid 41 current snap is 193 2021-07-26T16:04:13.116 INFO:tasks.rados.rados.0.smithi033.stdout:1985: done (1 left) 2021-07-26T16:04:13.116 INFO:tasks.rados.rados.0.smithi033.stdout:1986: delete oid 6 current snap is 193 2021-07-26T16:04:13.125 INFO:tasks.rados.rados.0.smithi033.stdout:1986: done (1 left) 2021-07-26T16:04:13.125 INFO:tasks.rados.rados.0.smithi033.stdout:1987: copy_from oid 27 from oid 4 current snap is 193 2021-07-26T16:04:13.126 INFO:tasks.rados.rados.0.smithi033.stdout:1988: rollback oid 44 current snap is 193 2021-07-26T16:04:13.126 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 192 2021-07-26T16:04:13.126 INFO:tasks.rados.rados.0.smithi033.stdout:1989: copy_from oid 5 from oid 3 current snap is 193 2021-07-26T16:04:13.126 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 193 2021-07-26T16:04:13.127 INFO:tasks.rados.rados.0.smithi033.stdout:1990: seq_num 615 ranges {8372224=704512} 2021-07-26T16:04:13.177 INFO:tasks.rados.rados.0.smithi033.stdout:1990: writing smithi03339061-31 from 8372224 to 9076736 tid 1 2021-07-26T16:04:13.177 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 193 2021-07-26T16:04:13.178 INFO:tasks.rados.rados.0.smithi033.stdout:1987: finishing copy_from to smithi03339061-27 2021-07-26T16:04:13.178 INFO:tasks.rados.rados.0.smithi033.stdout:1987: got expected ENOENT (src dne) 2021-07-26T16:04:13.179 INFO:tasks.rados.rados.0.smithi033.stdout:1991: seq_num 616 ranges {352256=720896} 2021-07-26T16:04:13.183 INFO:tasks.rados.rados.0.smithi033.stdout:1991: writing smithi03339061-40 from 352256 to 1073152 tid 1 2021-07-26T16:04:13.184 INFO:tasks.rados.rados.0.smithi033.stdout:1992: read oid 46 snap -1 2021-07-26T16:04:13.184 INFO:tasks.rados.rados.0.smithi033.stdout:1992: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:04:13.184 INFO:tasks.rados.rados.0.smithi033.stdout:1993: rmattr oid 6 current snap is 193 2021-07-26T16:04:13.184 INFO:tasks.rados.rados.0.smithi033.stdout:1987: finishing copy_from racing read to smithi03339061-27 2021-07-26T16:04:13.185 INFO:tasks.rados.rados.0.smithi033.stdout:1987: done (7 left) 2021-07-26T16:04:13.185 INFO:tasks.rados.rados.0.smithi033.stdout:1993: done (6 left) 2021-07-26T16:04:13.185 INFO:tasks.rados.rados.0.smithi033.stdout:1994: snap_create 2021-07-26T16:04:13.185 INFO:tasks.rados.rados.0.smithi033.stdout:1988: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:04:13.185 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1048 (ObjNum 1953066355 snap 858810728 seq_num 809055027) dirty dne 2021-07-26T16:04:13.186 INFO:tasks.rados.rados.0.smithi033.stdout:1989: finishing copy_from to smithi03339061-5 2021-07-26T16:04:13.186 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 301 (ObjNum 569 snap 177 seq_num 569) dirty exists 2021-07-26T16:04:13.186 INFO:tasks.rados.rados.0.smithi033.stdout:1989: finishing copy_from racing read to smithi03339061-5 2021-07-26T16:04:13.186 INFO:tasks.rados.rados.0.smithi033.stdout:1984: expect (ObjNum 570 snap 177 seq_num 570) 2021-07-26T16:04:13.263 INFO:tasks.rados.rados.0.smithi033.stdout:1990: finishing write tid 1 to smithi03339061-31 2021-07-26T16:04:13.263 INFO:tasks.rados.rados.0.smithi033.stdout:1990: finishing write tid 2 to smithi03339061-31 2021-07-26T16:04:13.263 INFO:tasks.rados.rados.0.smithi033.stdout:1990: finishing write tid 3 to smithi03339061-31 2021-07-26T16:04:13.264 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1043 (ObjNum 615 snap 193 seq_num 615) dirty exists 2021-07-26T16:04:13.264 INFO:tasks.rados.rados.0.smithi033.stdout:1990: left oid 31 (ObjNum 615 snap 193 seq_num 615) 2021-07-26T16:04:13.264 INFO:tasks.rados.rados.0.smithi033.stdout:1991: finishing write tid 1 to smithi03339061-40 2021-07-26T16:04:13.264 INFO:tasks.rados.rados.0.smithi033.stdout:1991: finishing write tid 2 to smithi03339061-40 2021-07-26T16:04:13.265 INFO:tasks.rados.rados.0.smithi033.stdout:1992: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:04:13.298 INFO:tasks.rados.rados.0.smithi033.stdout:1991: finishing write tid 3 to smithi03339061-40 2021-07-26T16:04:13.298 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 508 (ObjNum 616 snap 193 seq_num 616) dirty exists 2021-07-26T16:04:13.298 INFO:tasks.rados.rados.0.smithi033.stdout:1991: left oid 40 (ObjNum 616 snap 193 seq_num 616) 2021-07-26T16:04:13.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:13.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:04:13.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:13.508Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:04:13.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:13.508Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:04:14.189 INFO:tasks.rados.rados.0.smithi033.stdout:1984: done (6 left) 2021-07-26T16:04:14.189 INFO:tasks.rados.rados.0.smithi033.stdout:1988: done (5 left) 2021-07-26T16:04:14.189 INFO:tasks.rados.rados.0.smithi033.stdout:1989: done (4 left) 2021-07-26T16:04:14.189 INFO:tasks.rados.rados.0.smithi033.stdout:1990: done (3 left) 2021-07-26T16:04:14.190 INFO:tasks.rados.rados.0.smithi033.stdout:1991: done (2 left) 2021-07-26T16:04:14.190 INFO:tasks.rados.rados.0.smithi033.stdout:1992: done (1 left) 2021-07-26T16:04:14.190 INFO:tasks.rados.rados.0.smithi033.stdout:1994: done (0 left) 2021-07-26T16:04:14.190 INFO:tasks.rados.rados.0.smithi033.stdout:1995: read oid 44 snap 192 2021-07-26T16:04:14.191 INFO:tasks.rados.rados.0.smithi033.stdout:1995: expect deleted 2021-07-26T16:04:14.191 INFO:tasks.rados.rados.0.smithi033.stdout:1996: delete oid 39 current snap is 194 2021-07-26T16:04:14.194 INFO:tasks.rados.rados.0.smithi033.stdout:1995: done (1 left) 2021-07-26T16:04:14.194 INFO:tasks.rados.rados.0.smithi033.stdout:1996: done (0 left) 2021-07-26T16:04:14.194 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 194 2021-07-26T16:04:14.194 INFO:tasks.rados.rados.0.smithi033.stdout:1997: seq_num 618 ranges {6045696=753664} 2021-07-26T16:04:14.238 INFO:tasks.rados.rados.0.smithi033.stdout:1997: writing smithi03339061-7 from 6045696 to 6799360 tid 1 2021-07-26T16:04:14.238 INFO:tasks.rados.rados.0.smithi033.stdout:1998: snap_remove snap 189 2021-07-26T16:04:14.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:14 smithi033 bash[41341]: cluster 2021-07-26T16:04:13.079694+0000 mgr.y (mgr.34104) 308 : cluster [DBG] pgmap v491: 25 pgs: 25 active+clean; 326 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2021-07-26T16:04:14.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:14 smithi033 bash[41341]: cluster 2021-07-26T16:04:13.111885+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e453: 8 total, 8 up, 8 in 2021-07-26T16:04:14.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:14 smithi033 bash[42377]: cluster 2021-07-26T16:04:13.079694+0000 mgr.y (mgr.34104) 308 : cluster [DBG] pgmap v491: 25 pgs: 25 active+clean; 326 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2021-07-26T16:04:14.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:14 smithi033 bash[42377]: cluster 2021-07-26T16:04:13.111885+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e453: 8 total, 8 up, 8 in 2021-07-26T16:04:14.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:14 smithi096 bash[33981]: cluster 2021-07-26T16:04:13.079694+0000 mgr.y (mgr.34104) 308 : cluster [DBG] pgmap v491: 25 pgs: 25 active+clean; 326 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.7 MiB/s wr, 33 op/s 2021-07-26T16:04:14.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:14 smithi096 bash[33981]: cluster 2021-07-26T16:04:13.111885+0000 mon.a (mon.0) 812 : cluster [DBG] osdmap e453: 8 total, 8 up, 8 in 2021-07-26T16:04:15.202 INFO:tasks.rados.rados.0.smithi033.stdout:1998: done (1 left) 2021-07-26T16:04:15.203 INFO:tasks.rados.rados.0.smithi033.stdout:1999: read oid 48 snap -1 2021-07-26T16:04:15.203 INFO:tasks.rados.rados.0.smithi033.stdout:1999: expect (ObjNum 602 snap 188 seq_num 602) 2021-07-26T16:04:15.203 INFO:tasks.rados.rados.0.smithi033.stdout:2000: delete oid 43 current snap is 194 2021-07-26T16:04:15.203 INFO:tasks.rados.rados.0.smithi033.stdout:1997: finishing write tid 1 to smithi03339061-7 2021-07-26T16:04:15.204 INFO:tasks.rados.rados.0.smithi033.stdout:1997: finishing write tid 2 to smithi03339061-7 2021-07-26T16:04:15.204 INFO:tasks.rados.rados.0.smithi033.stdout:1997: finishing write tid 3 to smithi03339061-7 2021-07-26T16:04:15.204 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1053 (ObjNum 618 snap 194 seq_num 618) dirty exists 2021-07-26T16:04:15.204 INFO:tasks.rados.rados.0.smithi033.stdout:1997: left oid 7 (ObjNum 618 snap 194 seq_num 618) 2021-07-26T16:04:15.217 INFO:tasks.rados.rados.0.smithi033.stdout:1997: done (2 left) 2021-07-26T16:04:15.217 INFO:tasks.rados.rados.0.smithi033.stdout:2000: done (1 left) 2021-07-26T16:04:15.218 INFO:tasks.rados.rados.0.smithi033.stdout:2001: read oid 9 snap 188 2021-07-26T16:04:15.218 INFO:tasks.rados.rados.0.smithi033.stdout:2001: expect deleted 2021-07-26T16:04:15.218 INFO:tasks.rados.rados.0.smithi033.stdout:2002: rollback oid 18 current snap is 194 2021-07-26T16:04:15.218 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 18 to 187 2021-07-26T16:04:15.219 INFO:tasks.rados.rados.0.smithi033.stdout:2003: setattr oid 3 current snap is 194 2021-07-26T16:04:15.219 INFO:tasks.rados.rados.0.smithi033.stdout:1999: expect (ObjNum 602 snap 188 seq_num 602) 2021-07-26T16:04:15.231 INFO:tasks.rados.rados.0.smithi033.stdout:2002: finishing rollback tid 1 to smithi03339061-18 2021-07-26T16:04:15.231 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 0 (ObjNum 0 snap 32561 seq_num 2006085280) dirty dne 2021-07-26T16:04:15.231 INFO:tasks.rados.rados.0.smithi033.stdout:1999: done (3 left) 2021-07-26T16:04:15.232 INFO:tasks.rados.rados.0.smithi033.stdout:2001: done (2 left) 2021-07-26T16:04:15.232 INFO:tasks.rados.rados.0.smithi033.stdout:2002: done (1 left) 2021-07-26T16:04:15.232 INFO:tasks.rados.rados.0.smithi033.stdout:2004: read oid 35 snap -1 2021-07-26T16:04:15.232 INFO:tasks.rados.rados.0.smithi033.stdout:2004: expect (ObjNum 585 snap 181 seq_num 585) 2021-07-26T16:04:15.233 INFO:tasks.rados.rados.0.smithi033.stdout:2005: snap_remove snap 191 2021-07-26T16:04:15.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:15 smithi033 bash[41341]: cluster 2021-07-26T16:04:14.185607+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e454: 8 total, 8 up, 8 in 2021-07-26T16:04:15.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:15 smithi033 bash[42377]: cluster 2021-07-26T16:04:14.185607+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e454: 8 total, 8 up, 8 in 2021-07-26T16:04:15.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:15 smithi096 bash[33981]: cluster 2021-07-26T16:04:14.185607+0000 mon.a (mon.0) 813 : cluster [DBG] osdmap e454: 8 total, 8 up, 8 in 2021-07-26T16:04:16.091 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 317 (ObjNum 569 snap 177 seq_num 569) dirty exists 2021-07-26T16:04:16.091 INFO:tasks.rados.rados.0.smithi033.stdout:2004: expect (ObjNum 585 snap 181 seq_num 585) 2021-07-26T16:04:16.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:16 smithi033 bash[41341]: cluster 2021-07-26T16:04:15.080571+0000 mgr.y (mgr.34104) 309 : cluster [DBG] pgmap v494: 25 pgs: 25 active+clean; 329 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2021-07-26T16:04:16.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:16 smithi033 bash[41341]: cluster 2021-07-26T16:04:15.195987+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e455: 8 total, 8 up, 8 in 2021-07-26T16:04:16.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:16 smithi033 bash[41341]: cluster 2021-07-26T16:04:16.086928+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e456: 8 total, 8 up, 8 in 2021-07-26T16:04:16.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:16 smithi033 bash[42377]: cluster 2021-07-26T16:04:15.080571+0000 mgr.y (mgr.34104) 309 : cluster [DBG] pgmap v494: 25 pgs: 25 active+clean; 329 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2021-07-26T16:04:16.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:16 smithi033 bash[42377]: cluster 2021-07-26T16:04:15.195987+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e455: 8 total, 8 up, 8 in 2021-07-26T16:04:16.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:16 smithi033 bash[42377]: cluster 2021-07-26T16:04:16.086928+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e456: 8 total, 8 up, 8 in 2021-07-26T16:04:16.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:16 smithi096 bash[33981]: cluster 2021-07-26T16:04:15.080571+0000 mgr.y (mgr.34104) 309 : cluster [DBG] pgmap v494: 25 pgs: 25 active+clean; 329 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 3.3 MiB/s wr, 24 op/s 2021-07-26T16:04:16.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:16 smithi096 bash[33981]: cluster 2021-07-26T16:04:15.195987+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e455: 8 total, 8 up, 8 in 2021-07-26T16:04:16.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:16 smithi096 bash[33981]: cluster 2021-07-26T16:04:16.086928+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e456: 8 total, 8 up, 8 in 2021-07-26T16:04:16.824 INFO:tasks.rados.rados.0.smithi033.stdout:2003: done (2 left) 2021-07-26T16:04:16.824 INFO:tasks.rados.rados.0.smithi033.stdout:2004: done (1 left) 2021-07-26T16:04:16.825 INFO:tasks.rados.rados.0.smithi033.stdout:2005: done (0 left) 2021-07-26T16:04:16.825 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 194 2021-07-26T16:04:16.825 INFO:tasks.rados.rados.0.smithi033.stdout:2006: seq_num 620 ranges {6799360=794624} 2021-07-26T16:04:16.875 INFO:tasks.rados.rados.0.smithi033.stdout:2006: writing smithi03339061-7 from 6799360 to 7593984 tid 1 2021-07-26T16:04:16.875 INFO:tasks.rados.rados.0.smithi033.stdout:2007: delete oid 25 current snap is 194 2021-07-26T16:04:16.881 INFO:tasks.rados.rados.0.smithi033.stdout:2007: done (1 left) 2021-07-26T16:04:16.882 INFO:tasks.rados.rados.0.smithi033.stdout:2008: setattr oid 45 current snap is 194 2021-07-26T16:04:16.882 INFO:tasks.rados.rados.0.smithi033.stdout:2006: finishing write tid 1 to smithi03339061-7 2021-07-26T16:04:16.883 INFO:tasks.rados.rados.0.smithi033.stdout:2006: finishing write tid 2 to smithi03339061-7 2021-07-26T16:04:16.883 INFO:tasks.rados.rados.0.smithi033.stdout:2009: read oid 2 snap -1 2021-07-26T16:04:16.883 INFO:tasks.rados.rados.0.smithi033.stdout:2009: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:04:16.884 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 16 current snap is 194 2021-07-26T16:04:16.884 INFO:tasks.rados.rados.0.smithi033.stdout:2010: seq_num 622 ranges {9830400=425984,10256384=401408} 2021-07-26T16:04:16.943 INFO:tasks.rados.rados.0.smithi033.stdout:2010: writing smithi03339061-16 from 9830400 to 10256384 tid 1 2021-07-26T16:04:16.946 INFO:tasks.rados.rados.0.smithi033.stdout:2010: writing smithi03339061-16 from 10256384 to 10657792 tid 2 2021-07-26T16:04:16.946 INFO:tasks.rados.rados.0.smithi033.stdout:2011: snap_create 2021-07-26T16:04:16.946 INFO:tasks.rados.rados.0.smithi033.stdout:2006: finishing write tid 3 to smithi03339061-7 2021-07-26T16:04:16.946 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1055 (ObjNum 620 snap 194 seq_num 620) dirty exists 2021-07-26T16:04:16.947 INFO:tasks.rados.rados.0.smithi033.stdout:2006: left oid 7 (ObjNum 620 snap 194 seq_num 620) 2021-07-26T16:04:16.947 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1209 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:04:16.947 INFO:tasks.rados.rados.0.smithi033.stdout:2009: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:04:17.521 INFO:tasks.rados.rados.0.smithi033.stdout:2010: finishing write tid 1 to smithi03339061-16 2021-07-26T16:04:17.521 INFO:tasks.rados.rados.0.smithi033.stdout:2010: finishing write tid 2 to smithi03339061-16 2021-07-26T16:04:17.521 INFO:tasks.rados.rados.0.smithi033.stdout:2010: finishing write tid 3 to smithi03339061-16 2021-07-26T16:04:17.522 INFO:tasks.rados.rados.0.smithi033.stdout:2010: finishing write tid 4 to smithi03339061-16 2021-07-26T16:04:17.522 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 828 (ObjNum 622 snap 194 seq_num 622) dirty exists 2021-07-26T16:04:17.523 INFO:tasks.rados.rados.0.smithi033.stdout:2010: left oid 16 (ObjNum 622 snap 194 seq_num 622) 2021-07-26T16:04:17.523 INFO:tasks.rados.rados.0.smithi033.stdout:2006: done (4 left) 2021-07-26T16:04:17.524 INFO:tasks.rados.rados.0.smithi033.stdout:2008: done (3 left) 2021-07-26T16:04:17.524 INFO:tasks.rados.rados.0.smithi033.stdout:2009: done (2 left) 2021-07-26T16:04:17.524 INFO:tasks.rados.rados.0.smithi033.stdout:2010: done (1 left) 2021-07-26T16:04:17.525 INFO:tasks.rados.rados.0.smithi033.stdout:2011: done (0 left) 2021-07-26T16:04:17.525 INFO:tasks.rados.rados.0.smithi033.stdout:2012: delete oid 41 current snap is 195 2021-07-26T16:04:17.529 INFO:tasks.rados.rados.0.smithi033.stdout:2012: done (0 left) 2021-07-26T16:04:17.529 INFO:tasks.rados.rados.0.smithi033.stdout:2013: setattr oid 48 current snap is 195 2021-07-26T16:04:17.533 INFO:tasks.rados.rados.0.smithi033.stdout:2014: read oid 33 snap -1 2021-07-26T16:04:17.533 INFO:tasks.rados.rados.0.smithi033.stdout:2014: expect (ObjNum 478 snap 149 seq_num 478) 2021-07-26T16:04:17.534 INFO:tasks.rados.rados.0.smithi033.stdout:2015: delete oid 39 current snap is 195 2021-07-26T16:04:17.536 INFO:tasks.rados.rados.0.smithi033.stdout:2015: done (2 left) 2021-07-26T16:04:17.536 INFO:tasks.rados.rados.0.smithi033.stdout:2016: rollback oid 19 current snap is 195 2021-07-26T16:04:17.537 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 19 to 183 2021-07-26T16:04:17.537 INFO:tasks.rados.rados.0.smithi033.stdout:2017: snap_create 2021-07-26T16:04:17.537 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 866 (ObjNum 602 snap 188 seq_num 602) dirty exists 2021-07-26T16:04:17.540 INFO:tasks.rados.rados.0.smithi033.stdout:2014: expect (ObjNum 478 snap 149 seq_num 478) 2021-07-26T16:04:17.567 INFO:tasks.rados.rados.0.smithi033.stdout:2016: finishing rollback tid 0 to smithi03339061-19 2021-07-26T16:04:17.567 INFO:tasks.rados.rados.0.smithi033.stdout:2016: finishing rollback tid 1 to smithi03339061-19 2021-07-26T16:04:17.567 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 845 (ObjNum 2006450704 snap 22002 seq_num 2007424944) dirty dne 2021-07-26T16:04:18.211 INFO:tasks.rados.rados.0.smithi033.stdout:2013: done (3 left) 2021-07-26T16:04:18.212 INFO:tasks.rados.rados.0.smithi033.stdout:2014: done (2 left) 2021-07-26T16:04:18.212 INFO:tasks.rados.rados.0.smithi033.stdout:2016: done (1 left) 2021-07-26T16:04:18.212 INFO:tasks.rados.rados.0.smithi033.stdout:2017: done (0 left) 2021-07-26T16:04:18.213 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 196 2021-07-26T16:04:18.213 INFO:tasks.rados.rados.0.smithi033.stdout:2018: seq_num 625 ranges {2342912=475136,2818048=401408} 2021-07-26T16:04:18.229 INFO:tasks.rados.rados.0.smithi033.stdout:2018: writing smithi03339061-20 from 2342912 to 2818048 tid 1 2021-07-26T16:04:18.232 INFO:tasks.rados.rados.0.smithi033.stdout:2018: writing smithi03339061-20 from 2818048 to 3219456 tid 2 2021-07-26T16:04:18.232 INFO:tasks.rados.rados.0.smithi033.stdout:2019: delete oid 11 current snap is 196 2021-07-26T16:04:18.239 INFO:tasks.rados.rados.0.smithi033.stdout:2018: finishing write tid 1 to smithi03339061-20 2021-07-26T16:04:18.239 INFO:tasks.rados.rados.0.smithi033.stdout:2018: finishing write tid 2 to smithi03339061-20 2021-07-26T16:04:18.240 INFO:tasks.rados.rados.0.smithi033.stdout:2019: done (1 left) 2021-07-26T16:04:18.240 INFO:tasks.rados.rados.0.smithi033.stdout:2020: snap_remove snap 193 2021-07-26T16:04:18.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:18 smithi096 bash[33981]: cluster 2021-07-26T16:04:17.081104+0000 mgr.y (mgr.34104) 310 : cluster [DBG] pgmap v497: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 331 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2021-07-26T16:04:18.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:18 smithi096 bash[33981]: cluster 2021-07-26T16:04:17.202905+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e457: 8 total, 8 up, 8 in 2021-07-26T16:04:18.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:18 smithi033 bash[41341]: cluster 2021-07-26T16:04:17.081104+0000 mgr.y (mgr.34104) 310 : cluster [DBG] pgmap v497: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 331 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2021-07-26T16:04:18.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:18 smithi033 bash[41341]: cluster 2021-07-26T16:04:17.202905+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e457: 8 total, 8 up, 8 in 2021-07-26T16:04:18.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:18 smithi033 bash[42377]: cluster 2021-07-26T16:04:17.081104+0000 mgr.y (mgr.34104) 310 : cluster [DBG] pgmap v497: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 331 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 9.0 MiB/s rd, 1.1 MiB/s wr, 14 op/s 2021-07-26T16:04:18.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:18 smithi033 bash[42377]: cluster 2021-07-26T16:04:17.202905+0000 mon.a (mon.0) 816 : cluster [DBG] osdmap e457: 8 total, 8 up, 8 in 2021-07-26T16:04:19.230 INFO:tasks.rados.rados.0.smithi033.stdout:2020: done (1 left) 2021-07-26T16:04:19.231 INFO:tasks.rados.rados.0.smithi033.stdout:2021: read oid 18 snap 192 2021-07-26T16:04:19.231 INFO:tasks.rados.rados.0.smithi033.stdout:2021: expect deleted 2021-07-26T16:04:19.232 INFO:tasks.rados.rados.0.smithi033.stdout:2022: delete oid 42 current snap is 196 2021-07-26T16:04:19.232 INFO:tasks.rados.rados.0.smithi033.stdout:2018: finishing write tid 3 to smithi03339061-20 2021-07-26T16:04:19.233 INFO:tasks.rados.rados.0.smithi033.stdout:2018: finishing write tid 4 to smithi03339061-20 2021-07-26T16:04:19.233 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1051 (ObjNum 625 snap 196 seq_num 625) dirty exists 2021-07-26T16:04:19.234 INFO:tasks.rados.rados.0.smithi033.stdout:2018: left oid 20 (ObjNum 625 snap 196 seq_num 625) 2021-07-26T16:04:19.245 INFO:tasks.rados.rados.0.smithi033.stdout:2018: done (2 left) 2021-07-26T16:04:19.245 INFO:tasks.rados.rados.0.smithi033.stdout:2021: done (1 left) 2021-07-26T16:04:19.245 INFO:tasks.rados.rados.0.smithi033.stdout:2022: done (0 left) 2021-07-26T16:04:19.245 INFO:tasks.rados.rados.0.smithi033.stdout:2023: read oid 7 snap -1 2021-07-26T16:04:19.246 INFO:tasks.rados.rados.0.smithi033.stdout:2023: expect (ObjNum 620 snap 194 seq_num 620) 2021-07-26T16:04:19.246 INFO:tasks.rados.rados.0.smithi033.stdout:2024: snap_create 2021-07-26T16:04:19.271 INFO:tasks.rados.rados.0.smithi033.stdout:2023: expect (ObjNum 620 snap 194 seq_num 620) 2021-07-26T16:04:19.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:19 smithi096 bash[33981]: cluster 2021-07-26T16:04:18.207929+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e458: 8 total, 8 up, 8 in 2021-07-26T16:04:19.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:19 smithi033 bash[41341]: cluster 2021-07-26T16:04:18.207929+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e458: 8 total, 8 up, 8 in 2021-07-26T16:04:19.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:19 smithi033 bash[42377]: cluster 2021-07-26T16:04:18.207929+0000 mon.a (mon.0) 817 : cluster [DBG] osdmap e458: 8 total, 8 up, 8 in 2021-07-26T16:04:20.238 INFO:tasks.rados.rados.0.smithi033.stdout:2023: done (1 left) 2021-07-26T16:04:20.238 INFO:tasks.rados.rados.0.smithi033.stdout:2024: done (0 left) 2021-07-26T16:04:20.238 INFO:tasks.rados.rados.0.smithi033.stdout:2025: read oid 46 snap 196 2021-07-26T16:04:20.239 INFO:tasks.rados.rados.0.smithi033.stdout:2025: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:04:20.239 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 197 2021-07-26T16:04:20.239 INFO:tasks.rados.rados.0.smithi033.stdout:2026: seq_num 628 ranges {14442496=524288,14966784=401408} 2021-07-26T16:04:20.326 INFO:tasks.rados.rados.0.smithi033.stdout:2026: writing smithi03339061-32 from 14442496 to 14966784 tid 1 2021-07-26T16:04:20.328 INFO:tasks.rados.rados.0.smithi033.stdout:2026: writing smithi03339061-32 from 14966784 to 15368192 tid 2 2021-07-26T16:04:20.328 INFO:tasks.rados.rados.0.smithi033.stdout:2027: read oid 31 snap -1 2021-07-26T16:04:20.329 INFO:tasks.rados.rados.0.smithi033.stdout:2027: expect (ObjNum 615 snap 193 seq_num 615) 2021-07-26T16:04:20.329 INFO:tasks.rados.rados.0.smithi033.stdout:2028: snap_create 2021-07-26T16:04:20.329 INFO:tasks.rados.rados.0.smithi033.stdout:2025: expect (ObjNum 451 snap 139 seq_num 451) 2021-07-26T16:04:20.372 INFO:tasks.rados.rados.0.smithi033.stdout:2026: finishing write tid 1 to smithi03339061-32 2021-07-26T16:04:20.373 INFO:tasks.rados.rados.0.smithi033.stdout:2026: finishing write tid 2 to smithi03339061-32 2021-07-26T16:04:20.373 INFO:tasks.rados.rados.0.smithi033.stdout:2026: finishing write tid 3 to smithi03339061-32 2021-07-26T16:04:20.373 INFO:tasks.rados.rados.0.smithi033.stdout:2026: finishing write tid 4 to smithi03339061-32 2021-07-26T16:04:20.374 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 831 (ObjNum 628 snap 197 seq_num 628) dirty exists 2021-07-26T16:04:20.374 INFO:tasks.rados.rados.0.smithi033.stdout:2026: left oid 32 (ObjNum 628 snap 197 seq_num 628) 2021-07-26T16:04:20.375 INFO:tasks.rados.rados.0.smithi033.stdout:2027: expect (ObjNum 615 snap 193 seq_num 615) 2021-07-26T16:04:20.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:20 smithi096 bash[33981]: cluster 2021-07-26T16:04:19.081662+0000 mgr.y (mgr.34104) 311 : cluster [DBG] pgmap v500: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 332 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.9 MiB/s rd, 756 KiB/s wr, 18 op/s 2021-07-26T16:04:20.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:20 smithi096 bash[33981]: cluster 2021-07-26T16:04:19.225565+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e459: 8 total, 8 up, 8 in 2021-07-26T16:04:20.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:20 smithi096 bash[33981]: audit 2021-07-26T16:04:19.974623+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:04:20.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:20 smithi096 bash[33981]: audit 2021-07-26T16:04:19.977496+0000 mon.c (mon.1) 244 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:04:20.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:20 smithi096 bash[33981]: audit 2021-07-26T16:04:19.979473+0000 mon.c (mon.1) 245 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:04:20.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:20 smithi033 bash[41341]: cluster 2021-07-26T16:04:19.081662+0000 mgr.y (mgr.34104) 311 : cluster [DBG] pgmap v500: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 332 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.9 MiB/s rd, 756 KiB/s wr, 18 op/s 2021-07-26T16:04:20.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:20 smithi033 bash[41341]: cluster 2021-07-26T16:04:19.225565+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e459: 8 total, 8 up, 8 in 2021-07-26T16:04:20.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:20 smithi033 bash[41341]: audit 2021-07-26T16:04:19.974623+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:04:20.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:20 smithi033 bash[41341]: audit 2021-07-26T16:04:19.977496+0000 mon.c (mon.1) 244 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:04:20.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:20 smithi033 bash[41341]: audit 2021-07-26T16:04:19.979473+0000 mon.c (mon.1) 245 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:04:20.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:20 smithi033 bash[42377]: cluster 2021-07-26T16:04:19.081662+0000 mgr.y (mgr.34104) 311 : cluster [DBG] pgmap v500: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 332 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 8.9 MiB/s rd, 756 KiB/s wr, 18 op/s 2021-07-26T16:04:20.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:20 smithi033 bash[42377]: cluster 2021-07-26T16:04:19.225565+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e459: 8 total, 8 up, 8 in 2021-07-26T16:04:20.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:20 smithi033 bash[42377]: audit 2021-07-26T16:04:19.974623+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:04:20.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:20 smithi033 bash[42377]: audit 2021-07-26T16:04:19.977496+0000 mon.c (mon.1) 244 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:04:20.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:20 smithi033 bash[42377]: audit 2021-07-26T16:04:19.979473+0000 mon.c (mon.1) 245 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:04:21.228 INFO:tasks.rados.rados.0.smithi033.stdout:2025: done (3 left) 2021-07-26T16:04:21.228 INFO:tasks.rados.rados.0.smithi033.stdout:2026: done (2 left) 2021-07-26T16:04:21.229 INFO:tasks.rados.rados.0.smithi033.stdout:2027: done (1 left) 2021-07-26T16:04:21.229 INFO:tasks.rados.rados.0.smithi033.stdout:2028: done (0 left) 2021-07-26T16:04:21.229 INFO:tasks.rados.rados.0.smithi033.stdout:2029: snap_create 2021-07-26T16:04:21.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:21 smithi033 bash[42377]: cluster 2021-07-26T16:04:20.234697+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e460: 8 total, 8 up, 8 in 2021-07-26T16:04:21.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:21 smithi033 bash[42377]: audit 2021-07-26T16:04:20.258733+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:04:21.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:21 smithi033 bash[42377]: cluster 2021-07-26T16:04:21.088265+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e461: 8 total, 8 up, 8 in 2021-07-26T16:04:21.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:21 smithi033 bash[41341]: cluster 2021-07-26T16:04:20.234697+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e460: 8 total, 8 up, 8 in 2021-07-26T16:04:21.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:21 smithi033 bash[41341]: audit 2021-07-26T16:04:20.258733+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:04:21.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:21 smithi033 bash[41341]: cluster 2021-07-26T16:04:21.088265+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e461: 8 total, 8 up, 8 in 2021-07-26T16:04:21.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:21 smithi096 bash[33981]: cluster 2021-07-26T16:04:20.234697+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e460: 8 total, 8 up, 8 in 2021-07-26T16:04:21.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:21 smithi096 bash[33981]: audit 2021-07-26T16:04:20.258733+0000 mon.a (mon.0) 820 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:04:21.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:21 smithi096 bash[33981]: cluster 2021-07-26T16:04:21.088265+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e461: 8 total, 8 up, 8 in 2021-07-26T16:04:22.108 INFO:tasks.rados.rados.0.smithi033.stdout:2029: done (0 left) 2021-07-26T16:04:22.108 INFO:tasks.rados.rados.0.smithi033.stdout:2030: setattr oid 22 current snap is 199 2021-07-26T16:04:22.112 INFO:tasks.rados.rados.0.smithi033.stdout:2031: snap_remove snap 192 2021-07-26T16:04:22.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:22 smithi033 bash[42377]: cluster 2021-07-26T16:04:21.082434+0000 mgr.y (mgr.34104) 312 : cluster [DBG] pgmap v503: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 333 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 592 KiB/s wr, 17 op/s 2021-07-26T16:04:22.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:22 smithi033 bash[42377]: cluster 2021-07-26T16:04:22.105034+0000 mon.a (mon.0) 822 : cluster [DBG] osdmap e462: 8 total, 8 up, 8 in 2021-07-26T16:04:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:22 smithi033 bash[41341]: cluster 2021-07-26T16:04:21.082434+0000 mgr.y (mgr.34104) 312 : cluster [DBG] pgmap v503: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 333 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 592 KiB/s wr, 17 op/s 2021-07-26T16:04:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:22 smithi033 bash[41341]: cluster 2021-07-26T16:04:22.105034+0000 mon.a (mon.0) 822 : cluster [DBG] osdmap e462: 8 total, 8 up, 8 in 2021-07-26T16:04:22.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:22 smithi096 bash[33981]: cluster 2021-07-26T16:04:21.082434+0000 mgr.y (mgr.34104) 312 : cluster [DBG] pgmap v503: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 333 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.4 MiB/s rd, 592 KiB/s wr, 17 op/s 2021-07-26T16:04:22.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:22 smithi096 bash[33981]: cluster 2021-07-26T16:04:22.105034+0000 mon.a (mon.0) 822 : cluster [DBG] osdmap e462: 8 total, 8 up, 8 in 2021-07-26T16:04:23.115 INFO:tasks.rados.rados.0.smithi033.stdout:2031: done (1 left) 2021-07-26T16:04:23.116 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 199 2021-07-26T16:04:23.116 INFO:tasks.rados.rados.0.smithi033.stdout:2032: seq_num 629 ranges {0=540672,540672=401408} 2021-07-26T16:04:23.119 INFO:tasks.rados.rados.0.smithi033.stdout:2032: writing smithi03339061-11 from 0 to 540672 tid 1 2021-07-26T16:04:23.122 INFO:tasks.rados.rados.0.smithi033.stdout:2032: writing smithi03339061-11 from 540672 to 942080 tid 2 2021-07-26T16:04:23.123 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 199 2021-07-26T16:04:23.123 INFO:tasks.rados.rados.0.smithi033.stdout:2033: seq_num 630 ranges {958464=557056,1515520=401408} 2021-07-26T16:04:23.132 INFO:tasks.rados.rados.0.smithi033.stdout:2033: writing smithi03339061-26 from 958464 to 1515520 tid 1 2021-07-26T16:04:23.135 INFO:tasks.rados.rados.0.smithi033.stdout:2033: writing smithi03339061-26 from 1515520 to 1916928 tid 2 2021-07-26T16:04:23.135 INFO:tasks.rados.rados.0.smithi033.stdout:2034: setattr oid 21 current snap is 199 2021-07-26T16:04:23.135 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1213 (ObjNum 598 snap 183 seq_num 598) dirty exists 2021-07-26T16:04:23.136 INFO:tasks.rados.rados.0.smithi033.stdout:2032: finishing write tid 1 to smithi03339061-11 2021-07-26T16:04:23.136 INFO:tasks.rados.rados.0.smithi033.stdout:2032: finishing write tid 2 to smithi03339061-11 2021-07-26T16:04:23.136 INFO:tasks.rados.rados.0.smithi033.stdout:2032: finishing write tid 3 to smithi03339061-11 2021-07-26T16:04:23.136 INFO:tasks.rados.rados.0.smithi033.stdout:2032: finishing write tid 4 to smithi03339061-11 2021-07-26T16:04:23.137 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 867 (ObjNum 629 snap 199 seq_num 629) dirty exists 2021-07-26T16:04:23.137 INFO:tasks.rados.rados.0.smithi033.stdout:2032: left oid 11 (ObjNum 629 snap 199 seq_num 629) 2021-07-26T16:04:23.137 INFO:tasks.rados.rados.0.smithi033.stdout:2030: done (3 left) 2021-07-26T16:04:23.138 INFO:tasks.rados.rados.0.smithi033.stdout:2032: done (2 left) 2021-07-26T16:04:23.138 INFO:tasks.rados.rados.0.smithi033.stdout:2035: snap_remove snap 187 2021-07-26T16:04:23.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:23.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:04:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:23.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:04:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:23.509Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:04:24.121 INFO:tasks.rados.rados.0.smithi033.stdout:2033: finishing write tid 1 to smithi03339061-26 2021-07-26T16:04:24.122 INFO:tasks.rados.rados.0.smithi033.stdout:2033: finishing write tid 2 to smithi03339061-26 2021-07-26T16:04:24.122 INFO:tasks.rados.rados.0.smithi033.stdout:2033: finishing write tid 3 to smithi03339061-26 2021-07-26T16:04:24.122 INFO:tasks.rados.rados.0.smithi033.stdout:2033: finishing write tid 4 to smithi03339061-26 2021-07-26T16:04:24.122 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 1223 (ObjNum 630 snap 199 seq_num 630) dirty exists 2021-07-26T16:04:24.122 INFO:tasks.rados.rados.0.smithi033.stdout:2033: left oid 26 (ObjNum 630 snap 199 seq_num 630) 2021-07-26T16:04:24.123 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1056 (ObjNum 612 snap 192 seq_num 612) dirty exists 2021-07-26T16:04:24.123 INFO:tasks.rados.rados.0.smithi033.stdout:2033: done (2 left) 2021-07-26T16:04:24.123 INFO:tasks.rados.rados.0.smithi033.stdout:2034: done (1 left) 2021-07-26T16:04:24.123 INFO:tasks.rados.rados.0.smithi033.stdout:2035: done (0 left) 2021-07-26T16:04:24.124 INFO:tasks.rados.rados.0.smithi033.stdout:2036: read oid 24 snap -1 2021-07-26T16:04:24.124 INFO:tasks.rados.rados.0.smithi033.stdout:2036: expect (ObjNum 586 snap 181 seq_num 586) 2021-07-26T16:04:24.124 INFO:tasks.rados.rados.0.smithi033.stdout:2037: rmattr oid 2 current snap is 199 2021-07-26T16:04:24.124 INFO:tasks.rados.rados.0.smithi033.stdout:2038: copy_from oid 6 from oid 26 current snap is 199 2021-07-26T16:04:24.124 INFO:tasks.rados.rados.0.smithi033.stdout:2039: snap_create 2021-07-26T16:04:24.137 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 845 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:04:24.139 INFO:tasks.rados.rados.0.smithi033.stdout:2036: expect (ObjNum 586 snap 181 seq_num 586) 2021-07-26T16:04:24.241 INFO:tasks.rados.rados.0.smithi033.stdout:2038: finishing copy_from to smithi03339061-6 2021-07-26T16:04:24.241 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1223 (ObjNum 630 snap 199 seq_num 630) dirty exists 2021-07-26T16:04:24.241 INFO:tasks.rados.rados.0.smithi033.stdout:2038: finishing copy_from racing read to smithi03339061-6 2021-07-26T16:04:24.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:24 smithi033 bash[42377]: cluster 2021-07-26T16:04:23.083209+0000 mgr.y (mgr.34104) 313 : cluster [DBG] pgmap v506: 25 pgs: 25 active+clean; 334 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 440 KiB/s wr, 16 op/s 2021-07-26T16:04:24.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:24 smithi033 bash[42377]: cluster 2021-07-26T16:04:23.107924+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e463: 8 total, 8 up, 8 in 2021-07-26T16:04:24.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:24 smithi033 bash[41341]: cluster 2021-07-26T16:04:23.083209+0000 mgr.y (mgr.34104) 313 : cluster [DBG] pgmap v506: 25 pgs: 25 active+clean; 334 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 440 KiB/s wr, 16 op/s 2021-07-26T16:04:24.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:24 smithi033 bash[41341]: cluster 2021-07-26T16:04:23.107924+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e463: 8 total, 8 up, 8 in 2021-07-26T16:04:24.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:24 smithi096 bash[33981]: cluster 2021-07-26T16:04:23.083209+0000 mgr.y (mgr.34104) 313 : cluster [DBG] pgmap v506: 25 pgs: 25 active+clean; 334 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 440 KiB/s wr, 16 op/s 2021-07-26T16:04:24.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:24 smithi096 bash[33981]: cluster 2021-07-26T16:04:23.107924+0000 mon.a (mon.0) 823 : cluster [DBG] osdmap e463: 8 total, 8 up, 8 in 2021-07-26T16:04:25.143 INFO:tasks.rados.rados.0.smithi033.stdout:2036: done (3 left) 2021-07-26T16:04:25.145 INFO:tasks.rados.rados.0.smithi033.stdout:2037: done (2 left) 2021-07-26T16:04:25.145 INFO:tasks.rados.rados.0.smithi033.stdout:2038: done (1 left) 2021-07-26T16:04:25.145 INFO:tasks.rados.rados.0.smithi033.stdout:2039: done (0 left) 2021-07-26T16:04:25.146 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 200 2021-07-26T16:04:25.146 INFO:tasks.rados.rados.0.smithi033.stdout:2040: seq_num 631 ranges {1073152=573440,1646592=401408} 2021-07-26T16:04:25.157 INFO:tasks.rados.rados.0.smithi033.stdout:2040: writing smithi03339061-40 from 1073152 to 1646592 tid 1 2021-07-26T16:04:25.160 INFO:tasks.rados.rados.0.smithi033.stdout:2040: writing smithi03339061-40 from 1646592 to 2048000 tid 2 2021-07-26T16:04:25.160 INFO:tasks.rados.rados.0.smithi033.stdout:2041: setattr oid 23 current snap is 200 2021-07-26T16:04:25.162 INFO:tasks.rados.rados.0.smithi033.stdout:2042: delete oid 21 current snap is 200 2021-07-26T16:04:25.167 INFO:tasks.rados.rados.0.smithi033.stdout:2040: finishing write tid 1 to smithi03339061-40 2021-07-26T16:04:25.168 INFO:tasks.rados.rados.0.smithi033.stdout:2040: finishing write tid 2 to smithi03339061-40 2021-07-26T16:04:25.168 INFO:tasks.rados.rados.0.smithi033.stdout:2040: finishing write tid 3 to smithi03339061-40 2021-07-26T16:04:25.170 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1057 (ObjNum 451 snap 139 seq_num 451) dirty exists 2021-07-26T16:04:25.172 INFO:tasks.rados.rados.0.smithi033.stdout:2041: done (2 left) 2021-07-26T16:04:25.172 INFO:tasks.rados.rados.0.smithi033.stdout:2042: done (1 left) 2021-07-26T16:04:25.172 INFO:tasks.rados.rados.0.smithi033.stdout:2043: read oid 18 snap -1 2021-07-26T16:04:25.173 INFO:tasks.rados.rados.0.smithi033.stdout:2043: expect deleted 2021-07-26T16:04:25.173 INFO:tasks.rados.rados.0.smithi033.stdout:2044: rollback oid 44 current snap is 200 2021-07-26T16:04:25.173 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 197 2021-07-26T16:04:25.173 INFO:tasks.rados.rados.0.smithi033.stdout:2040: finishing write tid 4 to smithi03339061-40 2021-07-26T16:04:25.174 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 511 (ObjNum 631 snap 200 seq_num 631) dirty exists 2021-07-26T16:04:25.174 INFO:tasks.rados.rados.0.smithi033.stdout:2040: left oid 40 (ObjNum 631 snap 200 seq_num 631) 2021-07-26T16:04:25.174 INFO:tasks.rados.rados.0.smithi033.stdout:2040: done (2 left) 2021-07-26T16:04:25.174 INFO:tasks.rados.rados.0.smithi033.stdout:2045: setattr oid 30 current snap is 200 2021-07-26T16:04:25.175 INFO:tasks.rados.rados.0.smithi033.stdout:2044: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:04:25.175 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1048 (ObjNum 2006530688 snap 22002 seq_num 2006912480) dirty dne 2021-07-26T16:04:25.177 INFO:tasks.rados.rados.0.smithi033.stdout:2043: done (2 left) 2021-07-26T16:04:25.177 INFO:tasks.rados.rados.0.smithi033.stdout:2044: done (1 left) 2021-07-26T16:04:25.177 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 200 2021-07-26T16:04:25.177 INFO:tasks.rados.rados.0.smithi033.stdout:2046: seq_num 633 ranges {9076736=606208,9682944=401408} 2021-07-26T16:04:25.237 INFO:tasks.rados.rados.0.smithi033.stdout:2046: writing smithi03339061-31 from 9076736 to 9682944 tid 1 2021-07-26T16:04:25.239 INFO:tasks.rados.rados.0.smithi033.stdout:2046: writing smithi03339061-31 from 9682944 to 10084352 tid 2 2021-07-26T16:04:25.239 INFO:tasks.rados.rados.0.smithi033.stdout:2047: copy_from oid 4 from oid 9 current snap is 200 2021-07-26T16:04:25.239 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 932 (ObjNum 1599364967 snap 1567124062 seq_num 1902990185) dirty exists 2021-07-26T16:04:25.239 INFO:tasks.rados.rados.0.smithi033.stdout:2045: done (2 left) 2021-07-26T16:04:25.240 INFO:tasks.rados.rados.0.smithi033.stdout:2048: snap_remove snap 188 2021-07-26T16:04:25.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:25 smithi033 bash[41341]: cluster 2021-07-26T16:04:24.116164+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e464: 8 total, 8 up, 8 in 2021-07-26T16:04:25.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:25 smithi033 bash[42377]: cluster 2021-07-26T16:04:24.116164+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e464: 8 total, 8 up, 8 in 2021-07-26T16:04:25.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:25 smithi096 bash[33981]: cluster 2021-07-26T16:04:24.116164+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e464: 8 total, 8 up, 8 in 2021-07-26T16:04:26.096 INFO:tasks.rados.rados.0.smithi033.stdout:2048: done (2 left) 2021-07-26T16:04:26.096 INFO:tasks.rados.rados.0.smithi033.stdout:2049: snap_create 2021-07-26T16:04:26.096 INFO:tasks.rados.rados.0.smithi033.stdout:2047: finishing copy_from to smithi03339061-4 2021-07-26T16:04:26.097 INFO:tasks.rados.rados.0.smithi033.stdout:2047: got expected ENOENT (src dne) 2021-07-26T16:04:26.097 INFO:tasks.rados.rados.0.smithi033.stdout:2047: finishing copy_from racing read to smithi03339061-4 2021-07-26T16:04:26.097 INFO:tasks.rados.rados.0.smithi033.stdout:2046: finishing write tid 1 to smithi03339061-31 2021-07-26T16:04:26.097 INFO:tasks.rados.rados.0.smithi033.stdout:2046: finishing write tid 2 to smithi03339061-31 2021-07-26T16:04:26.098 INFO:tasks.rados.rados.0.smithi033.stdout:2046: finishing write tid 3 to smithi03339061-31 2021-07-26T16:04:26.098 INFO:tasks.rados.rados.0.smithi033.stdout:2046: finishing write tid 4 to smithi03339061-31 2021-07-26T16:04:26.098 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1046 (ObjNum 633 snap 200 seq_num 633) dirty exists 2021-07-26T16:04:26.098 INFO:tasks.rados.rados.0.smithi033.stdout:2046: left oid 31 (ObjNum 633 snap 200 seq_num 633) 2021-07-26T16:04:26.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:26 smithi033 bash[41341]: cluster 2021-07-26T16:04:25.083977+0000 mgr.y (mgr.34104) 314 : cluster [DBG] pgmap v509: 25 pgs: 25 active+clean; 335 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 456 KiB/s wr, 11 op/s 2021-07-26T16:04:26.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:26 smithi033 bash[41341]: cluster 2021-07-26T16:04:25.137513+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e465: 8 total, 8 up, 8 in 2021-07-26T16:04:26.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:26 smithi033 bash[41341]: cluster 2021-07-26T16:04:26.091364+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2021-07-26T16:04:26.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:26 smithi033 bash[42377]: cluster 2021-07-26T16:04:25.083977+0000 mgr.y (mgr.34104) 314 : cluster [DBG] pgmap v509: 25 pgs: 25 active+clean; 335 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 456 KiB/s wr, 11 op/s 2021-07-26T16:04:26.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:26 smithi033 bash[42377]: cluster 2021-07-26T16:04:25.137513+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e465: 8 total, 8 up, 8 in 2021-07-26T16:04:26.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:26 smithi033 bash[42377]: cluster 2021-07-26T16:04:26.091364+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2021-07-26T16:04:26.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:26 smithi096 bash[33981]: cluster 2021-07-26T16:04:25.083977+0000 mgr.y (mgr.34104) 314 : cluster [DBG] pgmap v509: 25 pgs: 25 active+clean; 335 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 456 KiB/s wr, 11 op/s 2021-07-26T16:04:26.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:26 smithi096 bash[33981]: cluster 2021-07-26T16:04:25.137513+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e465: 8 total, 8 up, 8 in 2021-07-26T16:04:26.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:26 smithi096 bash[33981]: cluster 2021-07-26T16:04:26.091364+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e466: 8 total, 8 up, 8 in 2021-07-26T16:04:27.097 INFO:tasks.rados.rados.0.smithi033.stdout:2046: done (2 left) 2021-07-26T16:04:27.097 INFO:tasks.rados.rados.0.smithi033.stdout:2047: done (1 left) 2021-07-26T16:04:27.098 INFO:tasks.rados.rados.0.smithi033.stdout:2049: done (0 left) 2021-07-26T16:04:27.098 INFO:tasks.rados.rados.0.smithi033.stdout:2050: rollback oid 29 current snap is 201 2021-07-26T16:04:27.098 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 199 2021-07-26T16:04:27.098 INFO:tasks.rados.rados.0.smithi033.stdout:2051: snap_remove snap 200 2021-07-26T16:04:28.100 INFO:tasks.rados.rados.0.smithi033.stdout:2050: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:04:28.101 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 0 (ObjNum 2006020256 snap 22002 seq_num 2006229680) dirty dne 2021-07-26T16:04:28.101 INFO:tasks.rados.rados.0.smithi033.stdout:2050: done (1 left) 2021-07-26T16:04:28.101 INFO:tasks.rados.rados.0.smithi033.stdout:2051: done (0 left) 2021-07-26T16:04:28.101 INFO:tasks.rados.rados.0.smithi033.stdout:2052: rollback oid 44 current snap is 201 2021-07-26T16:04:28.102 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 196 2021-07-26T16:04:28.102 INFO:tasks.rados.rados.0.smithi033.stdout:2053: delete oid 11 current snap is 201 2021-07-26T16:04:28.104 INFO:tasks.rados.rados.0.smithi033.stdout:2052: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:04:28.104 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1048 (ObjNum 1058726304 snap 32561 seq_num 1058726304) dirty dne 2021-07-26T16:04:28.110 INFO:tasks.rados.rados.0.smithi033.stdout:2052: done (1 left) 2021-07-26T16:04:28.110 INFO:tasks.rados.rados.0.smithi033.stdout:2053: done (0 left) 2021-07-26T16:04:28.110 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 34 current snap is 201 2021-07-26T16:04:28.110 INFO:tasks.rados.rados.0.smithi033.stdout:2054: seq_num 635 ranges {0=638976,638976=401408} 2021-07-26T16:04:28.113 INFO:tasks.rados.rados.0.smithi033.stdout:2054: writing smithi03339061-34 from 0 to 638976 tid 1 2021-07-26T16:04:28.116 INFO:tasks.rados.rados.0.smithi033.stdout:2054: writing smithi03339061-34 from 638976 to 1040384 tid 2 2021-07-26T16:04:28.116 INFO:tasks.rados.rados.0.smithi033.stdout:2055: rmattr oid 44 current snap is 201 2021-07-26T16:04:28.117 INFO:tasks.rados.rados.0.smithi033.stdout:2055: done (1 left) 2021-07-26T16:04:28.117 INFO:tasks.rados.rados.0.smithi033.stdout:2056: rmattr oid 48 current snap is 201 2021-07-26T16:04:28.117 INFO:tasks.rados.rados.0.smithi033.stdout:2057: copy_from oid 23 from oid 37 current snap is 201 2021-07-26T16:04:28.117 INFO:tasks.rados.rados.0.smithi033.stdout:2058: copy_from oid 11 from oid 50 current snap is 201 2021-07-26T16:04:28.117 INFO:tasks.rados.rados.0.smithi033.stdout:2059: snap_remove snap 197 2021-07-26T16:04:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:28 smithi033 bash[41341]: cluster 2021-07-26T16:04:27.084720+0000 mgr.y (mgr.34104) 315 : cluster [DBG] pgmap v512: 25 pgs: 25 active+clean; 336 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 468 KiB/s wr, 5 op/s 2021-07-26T16:04:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:28 smithi033 bash[41341]: cluster 2021-07-26T16:04:27.093097+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2021-07-26T16:04:28.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:28 smithi033 bash[42377]: cluster 2021-07-26T16:04:27.084720+0000 mgr.y (mgr.34104) 315 : cluster [DBG] pgmap v512: 25 pgs: 25 active+clean; 336 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 468 KiB/s wr, 5 op/s 2021-07-26T16:04:28.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:28 smithi033 bash[42377]: cluster 2021-07-26T16:04:27.093097+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2021-07-26T16:04:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:28 smithi096 bash[33981]: cluster 2021-07-26T16:04:27.084720+0000 mgr.y (mgr.34104) 315 : cluster [DBG] pgmap v512: 25 pgs: 25 active+clean; 336 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 7.2 MiB/s rd, 468 KiB/s wr, 5 op/s 2021-07-26T16:04:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:28 smithi096 bash[33981]: cluster 2021-07-26T16:04:27.093097+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e467: 8 total, 8 up, 8 in 2021-07-26T16:04:29.123 INFO:tasks.rados.rados.0.smithi033.stdout:2059: done (4 left) 2021-07-26T16:04:29.124 INFO:tasks.rados.rados.0.smithi033.stdout:2060: rollback oid 1 current snap is 201 2021-07-26T16:04:29.124 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 1 to 186 2021-07-26T16:04:29.124 INFO:tasks.rados.rados.0.smithi033.stdout:2054: finishing write tid 1 to smithi03339061-34 2021-07-26T16:04:29.124 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 867 (ObjNum 602 snap 188 seq_num 602) dirty exists 2021-07-26T16:04:29.125 INFO:tasks.rados.rados.0.smithi033.stdout:2054: finishing write tid 2 to smithi03339061-34 2021-07-26T16:04:29.125 INFO:tasks.rados.rados.0.smithi033.stdout:2054: finishing write tid 3 to smithi03339061-34 2021-07-26T16:04:29.125 INFO:tasks.rados.rados.0.smithi033.stdout:2054: finishing write tid 4 to smithi03339061-34 2021-07-26T16:04:29.125 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 871 (ObjNum 635 snap 201 seq_num 635) dirty exists 2021-07-26T16:04:29.127 INFO:tasks.rados.rados.0.smithi033.stdout:2054: left oid 34 (ObjNum 635 snap 201 seq_num 635) 2021-07-26T16:04:29.127 INFO:tasks.rados.rados.0.smithi033.stdout:2057: finishing copy_from to smithi03339061-23 2021-07-26T16:04:29.127 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 921 (ObjNum 609 snap 192 seq_num 609) dirty exists 2021-07-26T16:04:29.127 INFO:tasks.rados.rados.0.smithi033.stdout:2057: finishing copy_from racing read to smithi03339061-23 2021-07-26T16:04:29.128 INFO:tasks.rados.rados.0.smithi033.stdout:2058: finishing copy_from to smithi03339061-11 2021-07-26T16:04:29.128 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 814 (ObjNum 579 snap 179 seq_num 579) dirty exists 2021-07-26T16:04:29.128 INFO:tasks.rados.rados.0.smithi033.stdout:2058: finishing copy_from racing read to smithi03339061-11 2021-07-26T16:04:29.128 INFO:tasks.rados.rados.0.smithi033.stdout:2054: done (4 left) 2021-07-26T16:04:29.129 INFO:tasks.rados.rados.0.smithi033.stdout:2056: done (3 left) 2021-07-26T16:04:29.129 INFO:tasks.rados.rados.0.smithi033.stdout:2057: done (2 left) 2021-07-26T16:04:29.129 INFO:tasks.rados.rados.0.smithi033.stdout:2058: done (1 left) 2021-07-26T16:04:29.129 INFO:tasks.rados.rados.0.smithi033.stdout:2061: rollback oid 9 current snap is 201 2021-07-26T16:04:29.129 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 9 to 183 2021-07-26T16:04:29.130 INFO:tasks.rados.rados.0.smithi033.stdout:2062: read oid 48 snap -1 2021-07-26T16:04:29.130 INFO:tasks.rados.rados.0.smithi033.stdout:2062: expect (ObjNum 602 snap 188 seq_num 602) 2021-07-26T16:04:29.130 INFO:tasks.rados.rados.0.smithi033.stdout:2063: snap_remove snap 199 2021-07-26T16:04:29.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:29 smithi033 bash[41341]: cluster 2021-07-26T16:04:28.096413+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2021-07-26T16:04:29.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:29 smithi033 bash[42377]: cluster 2021-07-26T16:04:28.096413+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2021-07-26T16:04:29.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:29 smithi096 bash[33981]: cluster 2021-07-26T16:04:28.096413+0000 mon.a (mon.0) 828 : cluster [DBG] osdmap e468: 8 total, 8 up, 8 in 2021-07-26T16:04:30.130 INFO:tasks.rados.rados.0.smithi033.stdout:2063: done (3 left) 2021-07-26T16:04:30.131 INFO:tasks.rados.rados.0.smithi033.stdout:2064: snap_create 2021-07-26T16:04:30.131 INFO:tasks.rados.rados.0.smithi033.stdout:2061: finishing rollback tid 1 to smithi03339061-9 2021-07-26T16:04:30.131 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 836 (ObjNum 1566663515 snap 1700554581 seq_num 1634954080) dirty dne 2021-07-26T16:04:30.132 INFO:tasks.rados.rados.0.smithi033.stdout:2060: finishing rollback tid 0 to smithi03339061-1 2021-07-26T16:04:30.132 INFO:tasks.rados.rados.0.smithi033.stdout:2060: finishing rollback tid 1 to smithi03339061-1 2021-07-26T16:04:30.132 INFO:tasks.rados.rados.0.smithi033.stdout:2060: finishing rollback tid 2 to smithi03339061-1 2021-07-26T16:04:30.132 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 114 (ObjNum 532 snap 163 seq_num 532) dirty exists 2021-07-26T16:04:30.132 INFO:tasks.rados.rados.0.smithi033.stdout:2062: expect (ObjNum 602 snap 188 seq_num 602) 2021-07-26T16:04:30.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:30 smithi033 bash[41341]: cluster 2021-07-26T16:04:29.085437+0000 mgr.y (mgr.34104) 316 : cluster [DBG] pgmap v515: 25 pgs: 25 active+clean; 339 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.6 MiB/s rd, 940 KiB/s wr, 18 op/s 2021-07-26T16:04:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:30 smithi033 bash[41341]: cluster 2021-07-26T16:04:29.116966+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2021-07-26T16:04:30.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:30 smithi033 bash[42377]: cluster 2021-07-26T16:04:29.085437+0000 mgr.y (mgr.34104) 316 : cluster [DBG] pgmap v515: 25 pgs: 25 active+clean; 339 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.6 MiB/s rd, 940 KiB/s wr, 18 op/s 2021-07-26T16:04:30.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:30 smithi033 bash[42377]: cluster 2021-07-26T16:04:29.116966+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2021-07-26T16:04:30.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:30 smithi096 bash[33981]: cluster 2021-07-26T16:04:29.085437+0000 mgr.y (mgr.34104) 316 : cluster [DBG] pgmap v515: 25 pgs: 25 active+clean; 339 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 1.6 MiB/s rd, 940 KiB/s wr, 18 op/s 2021-07-26T16:04:30.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:30 smithi096 bash[33981]: cluster 2021-07-26T16:04:29.116966+0000 mon.a (mon.0) 829 : cluster [DBG] osdmap e469: 8 total, 8 up, 8 in 2021-07-26T16:04:31.097 INFO:tasks.rados.rados.0.smithi033.stdout:2060: done (3 left) 2021-07-26T16:04:31.098 INFO:tasks.rados.rados.0.smithi033.stdout:2061: done (2 left) 2021-07-26T16:04:31.098 INFO:tasks.rados.rados.0.smithi033.stdout:2062: done (1 left) 2021-07-26T16:04:31.098 INFO:tasks.rados.rados.0.smithi033.stdout:2064: done (0 left) 2021-07-26T16:04:31.099 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 202 2021-07-26T16:04:31.099 INFO:tasks.rados.rados.0.smithi033.stdout:2065: seq_num 636 ranges {2048000=655360,2703360=401408} 2021-07-26T16:04:31.115 INFO:tasks.rados.rados.0.smithi033.stdout:2065: writing smithi03339061-40 from 2048000 to 2703360 tid 1 2021-07-26T16:04:31.117 INFO:tasks.rados.rados.0.smithi033.stdout:2065: writing smithi03339061-40 from 2703360 to 3104768 tid 2 2021-07-26T16:04:31.117 INFO:tasks.rados.rados.0.smithi033.stdout:2066: setattr oid 18 current snap is 202 2021-07-26T16:04:31.118 INFO:tasks.rados.rados.0.smithi033.stdout:2067: setattr oid 7 current snap is 202 2021-07-26T16:04:31.120 INFO:tasks.rados.rados.0.smithi033.stdout:2068: rollback oid 12 current snap is 202 2021-07-26T16:04:31.120 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 12 to 196 2021-07-26T16:04:31.121 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 202 2021-07-26T16:04:31.121 INFO:tasks.rados.rados.0.smithi033.stdout:2069: seq_num 637 ranges {0=671744,671744=401408} 2021-07-26T16:04:31.125 INFO:tasks.rados.rados.0.smithi033.stdout:2069: writing smithi03339061-4 from 0 to 671744 tid 1 2021-07-26T16:04:31.128 INFO:tasks.rados.rados.0.smithi033.stdout:2069: writing smithi03339061-4 from 671744 to 1073152 tid 2 2021-07-26T16:04:31.129 INFO:tasks.rados.rados.0.smithi033.stdout:2070: read oid 32 snap 201 2021-07-26T16:04:31.129 INFO:tasks.rados.rados.0.smithi033.stdout:2070: expect (ObjNum 628 snap 197 seq_num 628) 2021-07-26T16:04:31.129 INFO:tasks.rados.rados.0.smithi033.stdout:2071: snap_remove snap 198 2021-07-26T16:04:31.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:31 smithi033 bash[41341]: cluster 2021-07-26T16:04:30.127538+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2021-07-26T16:04:31.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:31 smithi033 bash[41341]: cluster 2021-07-26T16:04:31.093749+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2021-07-26T16:04:31.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:31 smithi033 bash[42377]: cluster 2021-07-26T16:04:30.127538+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2021-07-26T16:04:31.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:31 smithi033 bash[42377]: cluster 2021-07-26T16:04:31.093749+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2021-07-26T16:04:31.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:31 smithi096 bash[33981]: cluster 2021-07-26T16:04:30.127538+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e470: 8 total, 8 up, 8 in 2021-07-26T16:04:31.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:31 smithi096 bash[33981]: cluster 2021-07-26T16:04:31.093749+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e471: 8 total, 8 up, 8 in 2021-07-26T16:04:32.150 INFO:tasks.rados.rados.0.smithi033.stdout:2071: done (6 left) 2021-07-26T16:04:32.151 INFO:tasks.rados.rados.0.smithi033.stdout:2072: snap_remove snap 190 2021-07-26T16:04:32.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:32 smithi033 bash[41341]: cluster 2021-07-26T16:04:31.086236+0000 mgr.y (mgr.34104) 317 : cluster [DBG] pgmap v518: 25 pgs: 25 active+clean; 350 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 22 op/s 2021-07-26T16:04:32.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:32 smithi033 bash[42377]: cluster 2021-07-26T16:04:31.086236+0000 mgr.y (mgr.34104) 317 : cluster [DBG] pgmap v518: 25 pgs: 25 active+clean; 350 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 22 op/s 2021-07-26T16:04:32.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:32 smithi096 bash[33981]: cluster 2021-07-26T16:04:31.086236+0000 mgr.y (mgr.34104) 317 : cluster [DBG] pgmap v518: 25 pgs: 25 active+clean; 350 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 2.0 MiB/s rd, 3.5 MiB/s wr, 22 op/s 2021-07-26T16:04:33.153 INFO:tasks.rados.rados.0.smithi033.stdout:2072: done (6 left) 2021-07-26T16:04:33.153 INFO:tasks.rados.rados.0.smithi033.stdout:2073: setattr oid 39 current snap is 202 2021-07-26T16:04:33.157 INFO:tasks.rados.rados.0.smithi033.stdout:2074: rollback oid 35 current snap is 202 2021-07-26T16:04:33.157 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 194 2021-07-26T16:04:33.158 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 1245 (ObjNum 1 snap 32561 seq_num 2006971184) dirty exists 2021-07-26T16:04:33.158 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1059 (ObjNum 620 snap 194 seq_num 620) dirty exists 2021-07-26T16:04:33.158 INFO:tasks.rados.rados.0.smithi033.stdout:2065: finishing write tid 1 to smithi03339061-40 2021-07-26T16:04:33.158 INFO:tasks.rados.rados.0.smithi033.stdout:2065: finishing write tid 2 to smithi03339061-40 2021-07-26T16:04:33.159 INFO:tasks.rados.rados.0.smithi033.stdout:2065: finishing write tid 3 to smithi03339061-40 2021-07-26T16:04:33.159 INFO:tasks.rados.rados.0.smithi033.stdout:2068: finishing rollback tid 0 to smithi03339061-12 2021-07-26T16:04:33.159 INFO:tasks.rados.rados.0.smithi033.stdout:2065: finishing write tid 4 to smithi03339061-40 2021-07-26T16:04:33.159 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 514 (ObjNum 636 snap 202 seq_num 636) dirty exists 2021-07-26T16:04:33.159 INFO:tasks.rados.rados.0.smithi033.stdout:2065: left oid 40 (ObjNum 636 snap 202 seq_num 636) 2021-07-26T16:04:33.161 INFO:tasks.rados.rados.0.smithi033.stdout:2068: finishing rollback tid 1 to smithi03339061-12 2021-07-26T16:04:33.161 INFO:tasks.rados.rados.0.smithi033.stdout:2069: finishing write tid 1 to smithi03339061-4 2021-07-26T16:04:33.161 INFO:tasks.rados.rados.0.smithi033.stdout:2069: finishing write tid 2 to smithi03339061-4 2021-07-26T16:04:33.162 INFO:tasks.rados.rados.0.smithi033.stdout:2069: finishing write tid 3 to smithi03339061-4 2021-07-26T16:04:33.162 INFO:tasks.rados.rados.0.smithi033.stdout:2068: finishing rollback tid 2 to smithi03339061-12 2021-07-26T16:04:33.162 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 848 (ObjNum 597 snap 183 seq_num 597) dirty exists 2021-07-26T16:04:33.162 INFO:tasks.rados.rados.0.smithi033.stdout:2069: finishing write tid 4 to smithi03339061-4 2021-07-26T16:04:33.163 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1054 (ObjNum 637 snap 202 seq_num 637) dirty exists 2021-07-26T16:04:33.163 INFO:tasks.rados.rados.0.smithi033.stdout:2069: left oid 4 (ObjNum 637 snap 202 seq_num 637) 2021-07-26T16:04:33.163 INFO:tasks.rados.rados.0.smithi033.stdout:2070: expect (ObjNum 628 snap 197 seq_num 628) 2021-07-26T16:04:33.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:33 smithi033 bash[41341]: cluster 2021-07-26T16:04:32.147435+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2021-07-26T16:04:33.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:33 smithi033 bash[42377]: cluster 2021-07-26T16:04:32.147435+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2021-07-26T16:04:33.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:33 smithi096 bash[33981]: cluster 2021-07-26T16:04:32.147435+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e472: 8 total, 8 up, 8 in 2021-07-26T16:04:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:33 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:33.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:04:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:33 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:33.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:04:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:33 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:33.509Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:04:34.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:34 smithi033 bash[41341]: cluster 2021-07-26T16:04:33.087007+0000 mgr.y (mgr.34104) 318 : cluster [DBG] pgmap v521: 25 pgs: 25 active+clean; 351 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.0 MiB/s wr, 16 op/s 2021-07-26T16:04:34.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:34 smithi033 bash[41341]: cluster 2021-07-26T16:04:33.148889+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2021-07-26T16:04:34.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:34 smithi033 bash[42377]: cluster 2021-07-26T16:04:33.087007+0000 mgr.y (mgr.34104) 318 : cluster [DBG] pgmap v521: 25 pgs: 25 active+clean; 351 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.0 MiB/s wr, 16 op/s 2021-07-26T16:04:34.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:34 smithi033 bash[42377]: cluster 2021-07-26T16:04:33.148889+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2021-07-26T16:04:34.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:34 smithi096 bash[33981]: cluster 2021-07-26T16:04:33.087007+0000 mgr.y (mgr.34104) 318 : cluster [DBG] pgmap v521: 25 pgs: 25 active+clean; 351 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.0 MiB/s wr, 16 op/s 2021-07-26T16:04:34.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:34 smithi096 bash[33981]: cluster 2021-07-26T16:04:33.148889+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e473: 8 total, 8 up, 8 in 2021-07-26T16:04:34.979 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1060 (ObjNum 1 snap 32561 seq_num 2007073008) dirty exists 2021-07-26T16:04:34.979 INFO:tasks.rados.rados.0.smithi033.stdout:2074: finishing rollback tid 0 to smithi03339061-35 2021-07-26T16:04:34.979 INFO:tasks.rados.rados.0.smithi033.stdout:2074: finishing rollback tid 1 to smithi03339061-35 2021-07-26T16:04:34.980 INFO:tasks.rados.rados.0.smithi033.stdout:2074: finishing rollback tid 2 to smithi03339061-35 2021-07-26T16:04:34.980 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 848 (ObjNum 585 snap 181 seq_num 585) dirty exists 2021-07-26T16:04:34.980 INFO:tasks.rados.rados.0.smithi033.stdout:2065: done (7 left) 2021-07-26T16:04:34.980 INFO:tasks.rados.rados.0.smithi033.stdout:2066: done (6 left) 2021-07-26T16:04:34.980 INFO:tasks.rados.rados.0.smithi033.stdout:2067: done (5 left) 2021-07-26T16:04:34.981 INFO:tasks.rados.rados.0.smithi033.stdout:2068: done (4 left) 2021-07-26T16:04:34.981 INFO:tasks.rados.rados.0.smithi033.stdout:2069: done (3 left) 2021-07-26T16:04:34.981 INFO:tasks.rados.rados.0.smithi033.stdout:2070: done (2 left) 2021-07-26T16:04:34.982 INFO:tasks.rados.rados.0.smithi033.stdout:2073: done (1 left) 2021-07-26T16:04:34.983 INFO:tasks.rados.rados.0.smithi033.stdout:2074: done (0 left) 2021-07-26T16:04:34.984 INFO:tasks.rados.rados.0.smithi033.stdout:2075: snap_create 2021-07-26T16:04:35.176 INFO:tasks.rados.rados.0.smithi033.stdout:2075: done (0 left) 2021-07-26T16:04:35.177 INFO:tasks.rados.rados.0.smithi033.stdout:2076: read oid 7 snap -1 2021-07-26T16:04:35.177 INFO:tasks.rados.rados.0.smithi033.stdout:2076: expect (ObjNum 620 snap 194 seq_num 620) 2021-07-26T16:04:35.177 INFO:tasks.rados.rados.0.smithi033.stdout:2077: read oid 34 snap -1 2021-07-26T16:04:35.178 INFO:tasks.rados.rados.0.smithi033.stdout:2077: expect (ObjNum 635 snap 201 seq_num 635) 2021-07-26T16:04:35.178 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 203 2021-07-26T16:04:35.178 INFO:tasks.rados.rados.0.smithi033.stdout:2078: seq_num 638 ranges {606208=688128,1294336=401408} 2021-07-26T16:04:35.185 INFO:tasks.rados.rados.0.smithi033.stdout:2078: writing smithi03339061-23 from 606208 to 1294336 tid 1 2021-07-26T16:04:35.188 INFO:tasks.rados.rados.0.smithi033.stdout:2078: writing smithi03339061-23 from 1294336 to 1695744 tid 2 2021-07-26T16:04:35.188 INFO:tasks.rados.rados.0.smithi033.stdout:2079: copy_from oid 1 from oid 39 current snap is 203 2021-07-26T16:04:35.189 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 203 2021-07-26T16:04:35.189 INFO:tasks.rados.rados.0.smithi033.stdout:2080: seq_num 639 ranges {0=704512,704512=401408} 2021-07-26T16:04:35.193 INFO:tasks.rados.rados.0.smithi033.stdout:2080: writing smithi03339061-9 from 0 to 704512 tid 1 2021-07-26T16:04:35.197 INFO:tasks.rados.rados.0.smithi033.stdout:2080: writing smithi03339061-9 from 704512 to 1105920 tid 2 2021-07-26T16:04:35.197 INFO:tasks.rados.rados.0.smithi033.stdout:2081: read oid 10 snap -1 2021-07-26T16:04:35.197 INFO:tasks.rados.rados.0.smithi033.stdout:2081: expect (ObjNum 608 snap 191 seq_num 608) 2021-07-26T16:04:35.197 INFO:tasks.rados.rados.0.smithi033.stdout:2077: expect (ObjNum 635 snap 201 seq_num 635) 2021-07-26T16:04:35.228 INFO:tasks.rados.rados.0.smithi033.stdout:2080: finishing write tid 1 to smithi03339061-9 2021-07-26T16:04:35.229 INFO:tasks.rados.rados.0.smithi033.stdout:2080: finishing write tid 2 to smithi03339061-9 2021-07-26T16:04:35.229 INFO:tasks.rados.rados.0.smithi033.stdout:2080: finishing write tid 3 to smithi03339061-9 2021-07-26T16:04:35.229 INFO:tasks.rados.rados.0.smithi033.stdout:2080: finishing write tid 4 to smithi03339061-9 2021-07-26T16:04:35.230 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 851 (ObjNum 639 snap 203 seq_num 639) dirty exists 2021-07-26T16:04:35.230 INFO:tasks.rados.rados.0.smithi033.stdout:2080: left oid 9 (ObjNum 639 snap 203 seq_num 639) 2021-07-26T16:04:35.230 INFO:tasks.rados.rados.0.smithi033.stdout:2076: expect (ObjNum 620 snap 194 seq_num 620) 2021-07-26T16:04:35.865 INFO:tasks.rados.rados.0.smithi033.stdout:2078: finishing write tid 1 to smithi03339061-23 2021-07-26T16:04:35.865 INFO:tasks.rados.rados.0.smithi033.stdout:2078: finishing write tid 2 to smithi03339061-23 2021-07-26T16:04:35.866 INFO:tasks.rados.rados.0.smithi033.stdout:2078: finishing write tid 3 to smithi03339061-23 2021-07-26T16:04:35.866 INFO:tasks.rados.rados.0.smithi033.stdout:2079: finishing copy_from to smithi03339061-1 2021-07-26T16:04:35.866 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1060 (ObjNum 1 snap 32561 seq_num 2006364720) dirty exists 2021-07-26T16:04:35.866 INFO:tasks.rados.rados.0.smithi033.stdout:2078: finishing write tid 4 to smithi03339061-23 2021-07-26T16:04:35.867 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1063 (ObjNum 638 snap 203 seq_num 638) dirty exists 2021-07-26T16:04:35.867 INFO:tasks.rados.rados.0.smithi033.stdout:2078: left oid 23 (ObjNum 638 snap 203 seq_num 638) 2021-07-26T16:04:35.867 INFO:tasks.rados.rados.0.smithi033.stdout:2079: finishing copy_from racing read to smithi03339061-1 2021-07-26T16:04:35.867 INFO:tasks.rados.rados.0.smithi033.stdout:2076: done (5 left) 2021-07-26T16:04:35.867 INFO:tasks.rados.rados.0.smithi033.stdout:2077: done (4 left) 2021-07-26T16:04:35.868 INFO:tasks.rados.rados.0.smithi033.stdout:2078: done (3 left) 2021-07-26T16:04:35.868 INFO:tasks.rados.rados.0.smithi033.stdout:2079: done (2 left) 2021-07-26T16:04:35.868 INFO:tasks.rados.rados.0.smithi033.stdout:2080: done (1 left) 2021-07-26T16:04:35.868 INFO:tasks.rados.rados.0.smithi033.stdout:2082: read oid 5 snap -1 2021-07-26T16:04:35.868 INFO:tasks.rados.rados.0.smithi033.stdout:2082: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:04:35.869 INFO:tasks.rados.rados.0.smithi033.stdout:2083: copy_from oid 6 from oid 25 current snap is 203 2021-07-26T16:04:35.869 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 203 2021-07-26T16:04:35.869 INFO:tasks.rados.rados.0.smithi033.stdout:2084: seq_num 640 ranges {0=729088,729088=401408} 2021-07-26T16:04:35.877 INFO:tasks.rados.rados.0.smithi033.stdout:2084: writing smithi03339061-21 from 0 to 729088 tid 1 2021-07-26T16:04:35.878 INFO:tasks.rados.rados.0.smithi033.stdout:2084: writing smithi03339061-21 from 729088 to 1130496 tid 2 2021-07-26T16:04:35.878 INFO:tasks.rados.rados.0.smithi033.stdout:2085: snap_create 2021-07-26T16:04:35.878 INFO:tasks.rados.rados.0.smithi033.stdout:2083: finishing copy_from to smithi03339061-6 2021-07-26T16:04:35.879 INFO:tasks.rados.rados.0.smithi033.stdout:2083: got expected ENOENT (src dne) 2021-07-26T16:04:35.879 INFO:tasks.rados.rados.0.smithi033.stdout:2083: finishing copy_from racing read to smithi03339061-6 2021-07-26T16:04:35.879 INFO:tasks.rados.rados.0.smithi033.stdout:2081: expect (ObjNum 608 snap 191 seq_num 608) 2021-07-26T16:04:36.068 INFO:tasks.rados.rados.0.smithi033.stdout:2082: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:04:36.132 INFO:tasks.rados.rados.0.smithi033.stdout:2084: finishing write tid 1 to smithi03339061-21 2021-07-26T16:04:36.132 INFO:tasks.rados.rados.0.smithi033.stdout:2084: finishing write tid 2 to smithi03339061-21 2021-07-26T16:04:36.132 INFO:tasks.rados.rados.0.smithi033.stdout:2084: finishing write tid 3 to smithi03339061-21 2021-07-26T16:04:36.133 INFO:tasks.rados.rados.0.smithi033.stdout:2084: finishing write tid 4 to smithi03339061-21 2021-07-26T16:04:36.133 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1066 (ObjNum 640 snap 203 seq_num 640) dirty exists 2021-07-26T16:04:36.133 INFO:tasks.rados.rados.0.smithi033.stdout:2084: left oid 21 (ObjNum 640 snap 203 seq_num 640) 2021-07-26T16:04:36.133 INFO:tasks.rados.rados.0.smithi033.stdout:2081: done (4 left) 2021-07-26T16:04:36.134 INFO:tasks.rados.rados.0.smithi033.stdout:2082: done (3 left) 2021-07-26T16:04:36.134 INFO:tasks.rados.rados.0.smithi033.stdout:2083: done (2 left) 2021-07-26T16:04:36.134 INFO:tasks.rados.rados.0.smithi033.stdout:2084: done (1 left) 2021-07-26T16:04:36.134 INFO:tasks.rados.rados.0.smithi033.stdout:2085: done (0 left) 2021-07-26T16:04:36.134 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 204 2021-07-26T16:04:36.135 INFO:tasks.rados.rados.0.smithi033.stdout:2086: seq_num 641 ranges {0=745472,745472=401408} 2021-07-26T16:04:36.139 INFO:tasks.rados.rados.0.smithi033.stdout:2086: writing smithi03339061-43 from 0 to 745472 tid 1 2021-07-26T16:04:36.144 INFO:tasks.rados.rados.0.smithi033.stdout:2086: writing smithi03339061-43 from 745472 to 1146880 tid 2 2021-07-26T16:04:36.144 INFO:tasks.rados.rados.0.smithi033.stdout:2087: snap_remove snap 179 2021-07-26T16:04:36.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:36 smithi033 bash[41341]: cluster 2021-07-26T16:04:35.087863+0000 mgr.y (mgr.34104) 319 : cluster [DBG] pgmap v523: 25 pgs: 25 active+clean; 350 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.9 MiB/s rd, 119 KiB/s wr, 10 op/s 2021-07-26T16:04:36.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:36 smithi033 bash[41341]: cluster 2021-07-26T16:04:35.173181+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2021-07-26T16:04:36.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:36 smithi033 bash[41341]: cluster 2021-07-26T16:04:36.095966+0000 mon.a (mon.0) 835 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2021-07-26T16:04:36.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:36 smithi033 bash[42377]: cluster 2021-07-26T16:04:35.087863+0000 mgr.y (mgr.34104) 319 : cluster [DBG] pgmap v523: 25 pgs: 25 active+clean; 350 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.9 MiB/s rd, 119 KiB/s wr, 10 op/s 2021-07-26T16:04:36.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:36 smithi033 bash[42377]: cluster 2021-07-26T16:04:35.173181+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2021-07-26T16:04:36.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:36 smithi033 bash[42377]: cluster 2021-07-26T16:04:36.095966+0000 mon.a (mon.0) 835 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2021-07-26T16:04:36.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:36 smithi096 bash[33981]: cluster 2021-07-26T16:04:35.087863+0000 mgr.y (mgr.34104) 319 : cluster [DBG] pgmap v523: 25 pgs: 25 active+clean; 350 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.9 MiB/s rd, 119 KiB/s wr, 10 op/s 2021-07-26T16:04:36.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:36 smithi096 bash[33981]: cluster 2021-07-26T16:04:35.173181+0000 mon.a (mon.0) 834 : cluster [DBG] osdmap e474: 8 total, 8 up, 8 in 2021-07-26T16:04:36.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:36 smithi096 bash[33981]: cluster 2021-07-26T16:04:36.095966+0000 mon.a (mon.0) 835 : cluster [DBG] osdmap e475: 8 total, 8 up, 8 in 2021-07-26T16:04:37.113 INFO:tasks.rados.rados.0.smithi033.stdout:2087: done (1 left) 2021-07-26T16:04:37.114 INFO:tasks.rados.rados.0.smithi033.stdout:2088: copy_from oid 29 from oid 6 current snap is 204 2021-07-26T16:04:37.114 INFO:tasks.rados.rados.0.smithi033.stdout:2086: finishing write tid 1 to smithi03339061-43 2021-07-26T16:04:37.114 INFO:tasks.rados.rados.0.smithi033.stdout:2086: finishing write tid 2 to smithi03339061-43 2021-07-26T16:04:37.114 INFO:tasks.rados.rados.0.smithi033.stdout:2086: finishing write tid 3 to smithi03339061-43 2021-07-26T16:04:37.114 INFO:tasks.rados.rados.0.smithi033.stdout:2086: finishing write tid 4 to smithi03339061-43 2021-07-26T16:04:37.115 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 870 (ObjNum 641 snap 204 seq_num 641) dirty exists 2021-07-26T16:04:37.115 INFO:tasks.rados.rados.0.smithi033.stdout:2086: left oid 43 (ObjNum 641 snap 204 seq_num 641) 2021-07-26T16:04:37.115 INFO:tasks.rados.rados.0.smithi033.stdout:2086: done (1 left) 2021-07-26T16:04:37.116 INFO:tasks.rados.rados.0.smithi033.stdout:2089: copy_from oid 23 from oid 16 current snap is 204 2021-07-26T16:04:37.117 INFO:tasks.rados.rados.0.smithi033.stdout:2090: delete oid 10 current snap is 204 2021-07-26T16:04:37.137 INFO:tasks.rados.rados.0.smithi033.stdout:2090: done (2 left) 2021-07-26T16:04:37.137 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 204 2021-07-26T16:04:37.137 INFO:tasks.rados.rados.0.smithi033.stdout:2091: seq_num 643 ranges {0=778240,778240=401408} 2021-07-26T16:04:37.142 INFO:tasks.rados.rados.0.smithi033.stdout:2091: writing smithi03339061-19 from 0 to 778240 tid 1 2021-07-26T16:04:37.144 INFO:tasks.rados.rados.0.smithi033.stdout:2091: writing smithi03339061-19 from 778240 to 1179648 tid 2 2021-07-26T16:04:37.145 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 204 2021-07-26T16:04:37.145 INFO:tasks.rados.rados.0.smithi033.stdout:2088: finishing copy_from to smithi03339061-29 2021-07-26T16:04:37.145 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1223 (ObjNum 630 snap 199 seq_num 630) dirty exists 2021-07-26T16:04:37.146 INFO:tasks.rados.rados.0.smithi033.stdout:2088: finishing copy_from racing read to smithi03339061-29 2021-07-26T16:04:37.148 INFO:tasks.rados.rados.0.smithi033.stdout:2091: finishing write tid 1 to smithi03339061-19 2021-07-26T16:04:37.149 INFO:tasks.rados.rados.0.smithi033.stdout:2091: finishing write tid 2 to smithi03339061-19 2021-07-26T16:04:37.149 INFO:tasks.rados.rados.0.smithi033.stdout:2091: finishing write tid 3 to smithi03339061-19 2021-07-26T16:04:37.149 INFO:tasks.rados.rados.0.smithi033.stdout:2092: seq_num 644 ranges {1073152=794624,1867776=401408} 2021-07-26T16:04:37.161 INFO:tasks.rados.rados.0.smithi033.stdout:2092: writing smithi03339061-4 from 1073152 to 1867776 tid 1 2021-07-26T16:04:37.164 INFO:tasks.rados.rados.0.smithi033.stdout:2092: writing smithi03339061-4 from 1867776 to 2269184 tid 2 2021-07-26T16:04:37.165 INFO:tasks.rados.rados.0.smithi033.stdout:2088: done (3 left) 2021-07-26T16:04:37.165 INFO:tasks.rados.rados.0.smithi033.stdout:2093: read oid 18 snap -1 2021-07-26T16:04:37.165 INFO:tasks.rados.rados.0.smithi033.stdout:2093: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:04:37.165 INFO:tasks.rados.rados.0.smithi033.stdout:2094: snap_create 2021-07-26T16:04:37.166 INFO:tasks.rados.rados.0.smithi033.stdout:2091: finishing write tid 4 to smithi03339061-19 2021-07-26T16:04:37.166 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 854 (ObjNum 643 snap 204 seq_num 643) dirty exists 2021-07-26T16:04:37.166 INFO:tasks.rados.rados.0.smithi033.stdout:2091: left oid 19 (ObjNum 643 snap 204 seq_num 643) 2021-07-26T16:04:37.167 INFO:tasks.rados.rados.0.smithi033.stdout:2093: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:04:37.167 INFO:tasks.rados.rados.0.smithi033.stdout:2092: finishing write tid 1 to smithi03339061-4 2021-07-26T16:04:37.167 INFO:tasks.rados.rados.0.smithi033.stdout:2092: finishing write tid 2 to smithi03339061-4 2021-07-26T16:04:37.168 INFO:tasks.rados.rados.0.smithi033.stdout:2092: finishing write tid 3 to smithi03339061-4 2021-07-26T16:04:37.170 INFO:tasks.rados.rados.0.smithi033.stdout:2092: finishing write tid 4 to smithi03339061-4 2021-07-26T16:04:37.170 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1057 (ObjNum 644 snap 204 seq_num 644) dirty exists 2021-07-26T16:04:37.171 INFO:tasks.rados.rados.0.smithi033.stdout:2092: left oid 4 (ObjNum 644 snap 204 seq_num 644) 2021-07-26T16:04:37.189 INFO:tasks.rados.rados.0.smithi033.stdout:2089: finishing copy_from to smithi03339061-23 2021-07-26T16:04:37.189 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 828 (ObjNum 622 snap 194 seq_num 622) dirty exists 2021-07-26T16:04:37.189 INFO:tasks.rados.rados.0.smithi033.stdout:2089: finishing copy_from racing read to smithi03339061-23 2021-07-26T16:04:38.118 INFO:tasks.rados.rados.0.smithi033.stdout:2089: done (4 left) 2021-07-26T16:04:38.118 INFO:tasks.rados.rados.0.smithi033.stdout:2091: done (3 left) 2021-07-26T16:04:38.118 INFO:tasks.rados.rados.0.smithi033.stdout:2092: done (2 left) 2021-07-26T16:04:38.119 INFO:tasks.rados.rados.0.smithi033.stdout:2093: done (1 left) 2021-07-26T16:04:38.119 INFO:tasks.rados.rados.0.smithi033.stdout:2094: done (0 left) 2021-07-26T16:04:38.119 INFO:tasks.rados.rados.0.smithi033.stdout:2095: setattr oid 30 current snap is 205 2021-07-26T16:04:38.121 INFO:tasks.rados.rados.0.smithi033.stdout:2096: read oid 4 snap -1 2021-07-26T16:04:38.121 INFO:tasks.rados.rados.0.smithi033.stdout:2096: expect (ObjNum 644 snap 204 seq_num 644) 2021-07-26T16:04:38.122 INFO:tasks.rados.rados.0.smithi033.stdout:2097: read oid 27 snap 204 2021-07-26T16:04:38.122 INFO:tasks.rados.rados.0.smithi033.stdout:2097: expect (ObjNum 600 snap 183 seq_num 600) 2021-07-26T16:04:38.122 INFO:tasks.rados.rados.0.smithi033.stdout:2098: read oid 49 snap -1 2021-07-26T16:04:38.122 INFO:tasks.rados.rados.0.smithi033.stdout:2098: expect deleted 2021-07-26T16:04:38.123 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 205 2021-07-26T16:04:38.123 INFO:tasks.rados.rados.0.smithi033.stdout:2099: seq_num 645 ranges {9035776=409600,9445376=778240,10223616=24576} 2021-07-26T16:04:38.177 INFO:tasks.rados.rados.0.smithi033.stdout:2099: writing smithi03339061-2 from 9035776 to 9445376 tid 1 2021-07-26T16:04:38.182 INFO:tasks.rados.rados.0.smithi033.stdout:2099: writing smithi03339061-2 from 9445376 to 10223616 tid 2 2021-07-26T16:04:38.183 INFO:tasks.rados.rados.0.smithi033.stdout:2099: writing smithi03339061-2 from 10223616 to 10248192 tid 3 2021-07-26T16:04:38.183 INFO:tasks.rados.rados.0.smithi033.stdout:2100: copy_from oid 7 from oid 23 current snap is 205 2021-07-26T16:04:38.183 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 946 (ObjNum 1716411495 snap 1432572249 seq_num 1566531163) dirty exists 2021-07-26T16:04:38.183 INFO:tasks.rados.rados.0.smithi033.stdout:2095: done (5 left) 2021-07-26T16:04:38.184 INFO:tasks.rados.rados.0.smithi033.stdout:2098: done (4 left) 2021-07-26T16:04:38.184 INFO:tasks.rados.rados.0.smithi033.stdout:2101: read oid 15 snap 183 2021-07-26T16:04:38.184 INFO:tasks.rados.rados.0.smithi033.stdout:2101: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:04:38.184 INFO:tasks.rados.rados.0.smithi033.stdout:2096: expect (ObjNum 644 snap 204 seq_num 644) 2021-07-26T16:04:38.273 INFO:tasks.rados.rados.0.smithi033.stdout:2097: expect (ObjNum 600 snap 183 seq_num 600) 2021-07-26T16:04:38.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:38 smithi033 bash[41341]: cluster 2021-07-26T16:04:37.088621+0000 mgr.y (mgr.34104) 320 : cluster [DBG] pgmap v526: 25 pgs: 25 active+clean; 353 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 621 B/s rd, 759 KiB/s wr, 12 op/s 2021-07-26T16:04:38.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:38 smithi033 bash[41341]: cluster 2021-07-26T16:04:37.108351+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2021-07-26T16:04:38.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:38 smithi033 bash[42377]: cluster 2021-07-26T16:04:37.088621+0000 mgr.y (mgr.34104) 320 : cluster [DBG] pgmap v526: 25 pgs: 25 active+clean; 353 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 621 B/s rd, 759 KiB/s wr, 12 op/s 2021-07-26T16:04:38.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:38 smithi033 bash[42377]: cluster 2021-07-26T16:04:37.108351+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2021-07-26T16:04:38.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:38 smithi096 bash[33981]: cluster 2021-07-26T16:04:37.088621+0000 mgr.y (mgr.34104) 320 : cluster [DBG] pgmap v526: 25 pgs: 25 active+clean; 353 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 621 B/s rd, 759 KiB/s wr, 12 op/s 2021-07-26T16:04:38.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:38 smithi096 bash[33981]: cluster 2021-07-26T16:04:37.108351+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e476: 8 total, 8 up, 8 in 2021-07-26T16:04:39.120 INFO:tasks.rados.rados.0.smithi033.stdout:2099: finishing write tid 1 to smithi03339061-2 2021-07-26T16:04:39.120 INFO:tasks.rados.rados.0.smithi033.stdout:2099: finishing write tid 2 to smithi03339061-2 2021-07-26T16:04:39.120 INFO:tasks.rados.rados.0.smithi033.stdout:2099: finishing write tid 3 to smithi03339061-2 2021-07-26T16:04:39.120 INFO:tasks.rados.rados.0.smithi033.stdout:2099: finishing write tid 4 to smithi03339061-2 2021-07-26T16:04:39.121 INFO:tasks.rados.rados.0.smithi033.stdout:2099: finishing write tid 5 to smithi03339061-2 2021-07-26T16:04:39.121 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 852 (ObjNum 645 snap 205 seq_num 645) dirty exists 2021-07-26T16:04:39.121 INFO:tasks.rados.rados.0.smithi033.stdout:2099: left oid 2 (ObjNum 645 snap 205 seq_num 645) 2021-07-26T16:04:39.121 INFO:tasks.rados.rados.0.smithi033.stdout:2101: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:04:39.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:39 smithi033 bash[41341]: cluster 2021-07-26T16:04:38.111917+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2021-07-26T16:04:39.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:39 smithi033 bash[42377]: cluster 2021-07-26T16:04:38.111917+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2021-07-26T16:04:39.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:39 smithi096 bash[33981]: cluster 2021-07-26T16:04:38.111917+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e477: 8 total, 8 up, 8 in 2021-07-26T16:04:40.021 INFO:tasks.rados.rados.0.smithi033.stdout:2100: finishing copy_from to smithi03339061-7 2021-07-26T16:04:40.021 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 828 (ObjNum 622 snap 194 seq_num 622) dirty exists 2021-07-26T16:04:40.022 INFO:tasks.rados.rados.0.smithi033.stdout:2100: finishing copy_from racing read to smithi03339061-7 2021-07-26T16:04:40.022 INFO:tasks.rados.rados.0.smithi033.stdout:2102: read oid 17 snap -1 2021-07-26T16:04:40.022 INFO:tasks.rados.rados.0.smithi033.stdout:2102: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:04:40.022 INFO:tasks.rados.rados.0.smithi033.stdout:2096: done (5 left) 2021-07-26T16:04:40.023 INFO:tasks.rados.rados.0.smithi033.stdout:2097: done (4 left) 2021-07-26T16:04:40.023 INFO:tasks.rados.rados.0.smithi033.stdout:2099: done (3 left) 2021-07-26T16:04:40.025 INFO:tasks.rados.rados.0.smithi033.stdout:2100: done (2 left) 2021-07-26T16:04:40.025 INFO:tasks.rados.rados.0.smithi033.stdout:2101: done (1 left) 2021-07-26T16:04:40.025 INFO:tasks.rados.rados.0.smithi033.stdout:2103: rollback oid 44 current snap is 205 2021-07-26T16:04:40.025 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 195 2021-07-26T16:04:40.026 INFO:tasks.rados.rados.0.smithi033.stdout:2104: rollback oid 14 current snap is 205 2021-07-26T16:04:40.026 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 14 to 183 2021-07-26T16:04:40.026 INFO:tasks.rados.rados.0.smithi033.stdout:2105: delete oid 31 current snap is 205 2021-07-26T16:04:40.027 INFO:tasks.rados.rados.0.smithi033.stdout:2104: finishing rollback tid 1 to smithi03339061-14 2021-07-26T16:04:40.027 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 0 (ObjNum 1 snap 32561 seq_num 2007322480) dirty dne 2021-07-26T16:04:40.027 INFO:tasks.rados.rados.0.smithi033.stdout:2103: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:04:40.027 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1048 (ObjNum 2006511456 snap 22002 seq_num 603982032) dirty dne 2021-07-26T16:04:40.029 INFO:tasks.rados.rados.0.smithi033.stdout:2103: done (3 left) 2021-07-26T16:04:40.029 INFO:tasks.rados.rados.0.smithi033.stdout:2104: done (2 left) 2021-07-26T16:04:40.029 INFO:tasks.rados.rados.0.smithi033.stdout:2105: done (1 left) 2021-07-26T16:04:40.030 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 205 2021-07-26T16:04:40.030 INFO:tasks.rados.rados.0.smithi033.stdout:2106: seq_num 647 ranges {1916928=442368,2359296=589824,2949120=212992} 2021-07-26T16:04:40.048 INFO:tasks.rados.rados.0.smithi033.stdout:2106: writing smithi03339061-6 from 1916928 to 2359296 tid 1 2021-07-26T16:04:40.052 INFO:tasks.rados.rados.0.smithi033.stdout:2106: writing smithi03339061-6 from 2359296 to 2949120 tid 2 2021-07-26T16:04:40.054 INFO:tasks.rados.rados.0.smithi033.stdout:2106: writing smithi03339061-6 from 2949120 to 3162112 tid 3 2021-07-26T16:04:40.054 INFO:tasks.rados.rados.0.smithi033.stdout:2107: snap_create 2021-07-26T16:04:40.054 INFO:tasks.rados.rados.0.smithi033.stdout:2102: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:04:40.256 INFO:tasks.rados.rados.0.smithi033.stdout:2106: finishing write tid 1 to smithi03339061-6 2021-07-26T16:04:40.256 INFO:tasks.rados.rados.0.smithi033.stdout:2106: finishing write tid 2 to smithi03339061-6 2021-07-26T16:04:40.257 INFO:tasks.rados.rados.0.smithi033.stdout:2106: finishing write tid 3 to smithi03339061-6 2021-07-26T16:04:40.257 INFO:tasks.rados.rados.0.smithi033.stdout:2106: finishing write tid 4 to smithi03339061-6 2021-07-26T16:04:40.258 INFO:tasks.rados.rados.0.smithi033.stdout:2106: finishing write tid 5 to smithi03339061-6 2021-07-26T16:04:40.258 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1270 (ObjNum 647 snap 205 seq_num 647) dirty exists 2021-07-26T16:04:40.258 INFO:tasks.rados.rados.0.smithi033.stdout:2106: left oid 6 (ObjNum 647 snap 205 seq_num 647) 2021-07-26T16:04:40.258 INFO:tasks.rados.rados.0.smithi033.stdout:2102: done (2 left) 2021-07-26T16:04:40.259 INFO:tasks.rados.rados.0.smithi033.stdout:2106: done (1 left) 2021-07-26T16:04:40.259 INFO:tasks.rados.rados.0.smithi033.stdout:2107: done (0 left) 2021-07-26T16:04:40.259 INFO:tasks.rados.rados.0.smithi033.stdout:2108: rmattr oid 36 current snap is 206 2021-07-26T16:04:40.259 INFO:tasks.rados.rados.0.smithi033.stdout:2109: delete oid 14 current snap is 206 2021-07-26T16:04:40.260 INFO:tasks.rados.rados.0.smithi033.stdout:2109: done (1 left) 2021-07-26T16:04:40.261 INFO:tasks.rados.rados.0.smithi033.stdout:2110: read oid 16 snap -1 2021-07-26T16:04:40.261 INFO:tasks.rados.rados.0.smithi033.stdout:2110: expect (ObjNum 622 snap 194 seq_num 622) 2021-07-26T16:04:40.261 INFO:tasks.rados.rados.0.smithi033.stdout:2111: read oid 4 snap -1 2021-07-26T16:04:40.261 INFO:tasks.rados.rados.0.smithi033.stdout:2111: expect (ObjNum 644 snap 204 seq_num 644) 2021-07-26T16:04:40.262 INFO:tasks.rados.rados.0.smithi033.stdout:2112: rmattr oid 38 current snap is 206 2021-07-26T16:04:40.262 INFO:tasks.rados.rados.0.smithi033.stdout:2112: done (3 left) 2021-07-26T16:04:40.262 INFO:tasks.rados.rados.0.smithi033.stdout:2113: read oid 24 snap -1 2021-07-26T16:04:40.262 INFO:tasks.rados.rados.0.smithi033.stdout:2113: expect (ObjNum 586 snap 181 seq_num 586) 2021-07-26T16:04:40.263 INFO:tasks.rados.rados.0.smithi033.stdout:2114: snap_remove snap 205 2021-07-26T16:04:40.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:40 smithi033 bash[41341]: cluster 2021-07-26T16:04:39.089344+0000 mgr.y (mgr.34104) 321 : cluster [DBG] pgmap v529: 25 pgs: 25 active+clean; 346 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 3.8 MiB/s wr, 15 op/s 2021-07-26T16:04:40.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:40 smithi033 bash[42377]: cluster 2021-07-26T16:04:39.089344+0000 mgr.y (mgr.34104) 321 : cluster [DBG] pgmap v529: 25 pgs: 25 active+clean; 346 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 3.8 MiB/s wr, 15 op/s 2021-07-26T16:04:40.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:40 smithi096 bash[33981]: cluster 2021-07-26T16:04:39.089344+0000 mgr.y (mgr.34104) 321 : cluster [DBG] pgmap v529: 25 pgs: 25 active+clean; 346 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.8 MiB/s rd, 3.8 MiB/s wr, 15 op/s 2021-07-26T16:04:41.101 INFO:tasks.rados.rados.0.smithi033.stdout:2114: done (4 left) 2021-07-26T16:04:41.102 INFO:tasks.rados.rados.0.smithi033.stdout:2115: setattr oid 15 current snap is 206 2021-07-26T16:04:41.102 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 872 (ObjNum 567 snap 177 seq_num 567) dirty exists 2021-07-26T16:04:41.102 INFO:tasks.rados.rados.0.smithi033.stdout:2113: expect (ObjNum 586 snap 181 seq_num 586) 2021-07-26T16:04:41.200 INFO:tasks.rados.rados.0.smithi033.stdout:2111: expect (ObjNum 644 snap 204 seq_num 644) 2021-07-26T16:04:41.276 INFO:tasks.rados.rados.0.smithi033.stdout:2110: expect (ObjNum 622 snap 194 seq_num 622) 2021-07-26T16:04:41.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:41 smithi033 bash[41341]: cluster 2021-07-26T16:04:40.133610+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2021-07-26T16:04:41.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:41 smithi033 bash[41341]: cluster 2021-07-26T16:04:41.098163+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2021-07-26T16:04:41.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:41 smithi033 bash[42377]: cluster 2021-07-26T16:04:40.133610+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2021-07-26T16:04:41.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:41 smithi033 bash[42377]: cluster 2021-07-26T16:04:41.098163+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2021-07-26T16:04:41.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:41 smithi096 bash[33981]: cluster 2021-07-26T16:04:40.133610+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e478: 8 total, 8 up, 8 in 2021-07-26T16:04:41.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:41 smithi096 bash[33981]: cluster 2021-07-26T16:04:41.098163+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e479: 8 total, 8 up, 8 in 2021-07-26T16:04:42.365 INFO:tasks.rados.rados.0.smithi033.stdout:2108: done (4 left) 2021-07-26T16:04:42.365 INFO:tasks.rados.rados.0.smithi033.stdout:2110: done (3 left) 2021-07-26T16:04:42.365 INFO:tasks.rados.rados.0.smithi033.stdout:2111: done (2 left) 2021-07-26T16:04:42.366 INFO:tasks.rados.rados.0.smithi033.stdout:2113: done (1 left) 2021-07-26T16:04:42.366 INFO:tasks.rados.rados.0.smithi033.stdout:2116: read oid 28 snap -1 2021-07-26T16:04:42.367 INFO:tasks.rados.rados.0.smithi033.stdout:2116: expect (ObjNum 556 snap 175 seq_num 556) 2021-07-26T16:04:42.367 INFO:tasks.rados.rados.0.smithi033.stdout:2117: rollback oid 29 current snap is 206 2021-07-26T16:04:42.367 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 202 2021-07-26T16:04:42.367 INFO:tasks.rados.rados.0.smithi033.stdout:2118: read oid 3 snap -1 2021-07-26T16:04:42.368 INFO:tasks.rados.rados.0.smithi033.stdout:2118: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:04:42.368 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 206 2021-07-26T16:04:42.368 INFO:tasks.rados.rados.0.smithi033.stdout:2119: seq_num 649 ranges {0=475136,475136=761856,1236992=40960} 2021-07-26T16:04:42.369 INFO:tasks.rados.rados.0.smithi033.stdout:2119: writing smithi03339061-30 from 0 to 475136 tid 1 2021-07-26T16:04:42.373 INFO:tasks.rados.rados.0.smithi033.stdout:2119: writing smithi03339061-30 from 475136 to 1236992 tid 2 2021-07-26T16:04:42.374 INFO:tasks.rados.rados.0.smithi033.stdout:2119: writing smithi03339061-30 from 1236992 to 1277952 tid 3 2021-07-26T16:04:42.375 INFO:tasks.rados.rados.0.smithi033.stdout:2120: read oid 33 snap 183 2021-07-26T16:04:42.375 INFO:tasks.rados.rados.0.smithi033.stdout:2120: expect (ObjNum 478 snap 149 seq_num 478) 2021-07-26T16:04:42.375 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 206 2021-07-26T16:04:42.375 INFO:tasks.rados.rados.0.smithi033.stdout:2121: seq_num 650 ranges {0=491520,491520=647168,1138688=155648} 2021-07-26T16:04:42.378 INFO:tasks.rados.rados.0.smithi033.stdout:2121: writing smithi03339061-13 from 0 to 491520 tid 1 2021-07-26T16:04:42.382 INFO:tasks.rados.rados.0.smithi033.stdout:2121: writing smithi03339061-13 from 491520 to 1138688 tid 2 2021-07-26T16:04:42.384 INFO:tasks.rados.rados.0.smithi033.stdout:2121: writing smithi03339061-13 from 1138688 to 1294336 tid 3 2021-07-26T16:04:42.384 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 817 (ObjNum 538 snap 167 seq_num 538) dirty exists 2021-07-26T16:04:42.384 INFO:tasks.rados.rados.0.smithi033.stdout:2117: finishing rollback tid 0 to smithi03339061-29 2021-07-26T16:04:42.384 INFO:tasks.rados.rados.0.smithi033.stdout:2117: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:04:42.385 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1225 (ObjNum 2006496320 snap 22002 seq_num 0) dirty dne 2021-07-26T16:04:42.385 INFO:tasks.rados.rados.0.smithi033.stdout:2119: finishing write tid 1 to smithi03339061-30 2021-07-26T16:04:42.385 INFO:tasks.rados.rados.0.smithi033.stdout:2121: finishing write tid 1 to smithi03339061-13 2021-07-26T16:04:42.385 INFO:tasks.rados.rados.0.smithi033.stdout:2118: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:04:42.447 INFO:tasks.rados.rados.0.smithi033.stdout:2119: finishing write tid 2 to smithi03339061-30 2021-07-26T16:04:42.448 INFO:tasks.rados.rados.0.smithi033.stdout:2120: expect (ObjNum 478 snap 149 seq_num 478) 2021-07-26T16:04:42.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:42 smithi033 bash[41341]: cluster 2021-07-26T16:04:41.090184+0000 mgr.y (mgr.34104) 322 : cluster [DBG] pgmap v531: 25 pgs: 25 active+clean; 310 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.9 MiB/s wr, 17 op/s 2021-07-26T16:04:42.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:42 smithi033 bash[42377]: cluster 2021-07-26T16:04:41.090184+0000 mgr.y (mgr.34104) 322 : cluster [DBG] pgmap v531: 25 pgs: 25 active+clean; 310 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.9 MiB/s wr, 17 op/s 2021-07-26T16:04:42.469 INFO:tasks.rados.rados.0.smithi033.stdout:2119: finishing write tid 3 to smithi03339061-30 2021-07-26T16:04:42.469 INFO:tasks.rados.rados.0.smithi033.stdout:2119: finishing write tid 4 to smithi03339061-30 2021-07-26T16:04:42.469 INFO:tasks.rados.rados.0.smithi033.stdout:2119: finishing write tid 5 to smithi03339061-30 2021-07-26T16:04:42.470 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 950 (ObjNum 649 snap 206 seq_num 649) dirty exists 2021-07-26T16:04:42.470 INFO:tasks.rados.rados.0.smithi033.stdout:2119: left oid 30 (ObjNum 649 snap 206 seq_num 649) 2021-07-26T16:04:42.470 INFO:tasks.rados.rados.0.smithi033.stdout:2121: finishing write tid 2 to smithi03339061-13 2021-07-26T16:04:42.470 INFO:tasks.rados.rados.0.smithi033.stdout:2121: finishing write tid 3 to smithi03339061-13 2021-07-26T16:04:42.471 INFO:tasks.rados.rados.0.smithi033.stdout:2121: finishing write tid 4 to smithi03339061-13 2021-07-26T16:04:42.471 INFO:tasks.rados.rados.0.smithi033.stdout:2115: done (6 left) 2021-07-26T16:04:42.471 INFO:tasks.rados.rados.0.smithi033.stdout:2117: done (5 left) 2021-07-26T16:04:42.471 INFO:tasks.rados.rados.0.smithi033.stdout:2118: done (4 left) 2021-07-26T16:04:42.472 INFO:tasks.rados.rados.0.smithi033.stdout:2119: done (3 left) 2021-07-26T16:04:42.472 INFO:tasks.rados.rados.0.smithi033.stdout:2120: done (2 left) 2021-07-26T16:04:42.472 INFO:tasks.rados.rados.0.smithi033.stdout:2122: read oid 33 snap 183 2021-07-26T16:04:42.473 INFO:tasks.rados.rados.0.smithi033.stdout:2122: expect (ObjNum 478 snap 149 seq_num 478) 2021-07-26T16:04:42.473 INFO:tasks.rados.rados.0.smithi033.stdout:2121: finishing write tid 5 to smithi03339061-13 2021-07-26T16:04:42.473 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1061 (ObjNum 650 snap 206 seq_num 650) dirty exists 2021-07-26T16:04:42.473 INFO:tasks.rados.rados.0.smithi033.stdout:2121: left oid 13 (ObjNum 650 snap 206 seq_num 650) 2021-07-26T16:04:42.474 INFO:tasks.rados.rados.0.smithi033.stdout:2116: expect (ObjNum 556 snap 175 seq_num 556) 2021-07-26T16:04:42.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:42 smithi096 bash[33981]: cluster 2021-07-26T16:04:41.090184+0000 mgr.y (mgr.34104) 322 : cluster [DBG] pgmap v531: 25 pgs: 25 active+clean; 310 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 11 MiB/s rd, 3.9 MiB/s wr, 17 op/s 2021-07-26T16:04:43.150 INFO:tasks.rados.rados.0.smithi033.stdout:2122: expect (ObjNum 478 snap 149 seq_num 478) 2021-07-26T16:04:43.171 INFO:tasks.rados.rados.0.smithi033.stdout:2123: read oid 18 snap 201 2021-07-26T16:04:43.172 INFO:tasks.rados.rados.0.smithi033.stdout:2123: expect deleted 2021-07-26T16:04:43.172 INFO:tasks.rados.rados.0.smithi033.stdout:2116: done (3 left) 2021-07-26T16:04:43.172 INFO:tasks.rados.rados.0.smithi033.stdout:2121: done (2 left) 2021-07-26T16:04:43.172 INFO:tasks.rados.rados.0.smithi033.stdout:2122: done (1 left) 2021-07-26T16:04:43.172 INFO:tasks.rados.rados.0.smithi033.stdout:2124: delete oid 41 current snap is 206 2021-07-26T16:04:43.175 INFO:tasks.rados.rados.0.smithi033.stdout:2123: done (1 left) 2021-07-26T16:04:43.175 INFO:tasks.rados.rados.0.smithi033.stdout:2124: done (0 left) 2021-07-26T16:04:43.175 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 206 2021-07-26T16:04:43.176 INFO:tasks.rados.rados.0.smithi033.stdout:2125: seq_num 652 ranges {2228224=524288,2752512=409600,3162112=393216} 2021-07-26T16:04:43.198 INFO:tasks.rados.rados.0.smithi033.stdout:2125: writing smithi03339061-24 from 2228224 to 2752512 tid 1 2021-07-26T16:04:43.200 INFO:tasks.rados.rados.0.smithi033.stdout:2125: writing smithi03339061-24 from 2752512 to 3162112 tid 2 2021-07-26T16:04:43.203 INFO:tasks.rados.rados.0.smithi033.stdout:2125: writing smithi03339061-24 from 3162112 to 3555328 tid 3 2021-07-26T16:04:43.203 INFO:tasks.rados.rados.0.smithi033.stdout:2126: delete oid 29 current snap is 206 2021-07-26T16:04:43.206 INFO:tasks.rados.rados.0.smithi033.stdout:2126: done (1 left) 2021-07-26T16:04:43.206 INFO:tasks.rados.rados.0.smithi033.stdout:2127: snap_create 2021-07-26T16:04:43.207 INFO:tasks.rados.rados.0.smithi033.stdout:2125: finishing write tid 1 to smithi03339061-24 2021-07-26T16:04:43.208 INFO:tasks.rados.rados.0.smithi033.stdout:2125: finishing write tid 2 to smithi03339061-24 2021-07-26T16:04:43.208 INFO:tasks.rados.rados.0.smithi033.stdout:2125: finishing write tid 3 to smithi03339061-24 2021-07-26T16:04:43.209 INFO:tasks.rados.rados.0.smithi033.stdout:2125: finishing write tid 4 to smithi03339061-24 2021-07-26T16:04:43.211 INFO:tasks.rados.rados.0.smithi033.stdout:2125: finishing write tid 5 to smithi03339061-24 2021-07-26T16:04:43.211 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 955 (ObjNum 652 snap 206 seq_num 652) dirty exists 2021-07-26T16:04:43.211 INFO:tasks.rados.rados.0.smithi033.stdout:2125: left oid 24 (ObjNum 652 snap 206 seq_num 652) 2021-07-26T16:04:43.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:43 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:43.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:04:43.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:43 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:43.509Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:04:43.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:43 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:43.509Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:04:44.169 INFO:tasks.rados.rados.0.smithi033.stdout:2125: done (1 left) 2021-07-26T16:04:44.170 INFO:tasks.rados.rados.0.smithi033.stdout:2127: done (0 left) 2021-07-26T16:04:44.170 INFO:tasks.rados.rados.0.smithi033.stdout:2128: snap_remove snap 196 2021-07-26T16:04:44.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:44 smithi033 bash[42377]: cluster 2021-07-26T16:04:43.090955+0000 mgr.y (mgr.34104) 323 : cluster [DBG] pgmap v533: 25 pgs: 25 active+clean; 322 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 5.2 MiB/s wr, 23 op/s 2021-07-26T16:04:44.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:44 smithi033 bash[41341]: cluster 2021-07-26T16:04:43.090955+0000 mgr.y (mgr.34104) 323 : cluster [DBG] pgmap v533: 25 pgs: 25 active+clean; 322 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 5.2 MiB/s wr, 23 op/s 2021-07-26T16:04:44.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:44 smithi096 bash[33981]: cluster 2021-07-26T16:04:43.090955+0000 mgr.y (mgr.34104) 323 : cluster [DBG] pgmap v533: 25 pgs: 25 active+clean; 322 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 5.2 MiB/s wr, 23 op/s 2021-07-26T16:04:45.183 INFO:tasks.rados.rados.0.smithi033.stdout:2128: done (0 left) 2021-07-26T16:04:45.186 INFO:tasks.rados.rados.0.smithi033.stdout:2129: copy_from oid 33 from oid 14 current snap is 207 2021-07-26T16:04:45.186 INFO:tasks.rados.rados.0.smithi033.stdout:2130: rmattr oid 20 current snap is 207 2021-07-26T16:04:45.186 INFO:tasks.rados.rados.0.smithi033.stdout:2131: snap_remove snap 195 2021-07-26T16:04:45.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:45 smithi033 bash[41341]: cluster 2021-07-26T16:04:44.165148+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2021-07-26T16:04:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:45 smithi033 bash[42377]: cluster 2021-07-26T16:04:44.165148+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2021-07-26T16:04:45.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:45 smithi096 bash[33981]: cluster 2021-07-26T16:04:44.165148+0000 mon.a (mon.0) 840 : cluster [DBG] osdmap e480: 8 total, 8 up, 8 in 2021-07-26T16:04:46.111 INFO:tasks.rados.rados.0.smithi033.stdout:2131: done (2 left) 2021-07-26T16:04:46.111 INFO:tasks.rados.rados.0.smithi033.stdout:2132: snap_create 2021-07-26T16:04:46.111 INFO:tasks.rados.rados.0.smithi033.stdout:2129: finishing copy_from to smithi03339061-33 2021-07-26T16:04:46.112 INFO:tasks.rados.rados.0.smithi033.stdout:2129: got expected ENOENT (src dne) 2021-07-26T16:04:46.112 INFO:tasks.rados.rados.0.smithi033.stdout:2129: finishing copy_from racing read to smithi03339061-33 2021-07-26T16:04:46.112 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1062 (ObjNum 625 snap 196 seq_num 625) dirty exists 2021-07-26T16:04:46.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:46 smithi033 bash[42377]: cluster 2021-07-26T16:04:45.091707+0000 mgr.y (mgr.34104) 324 : cluster [DBG] pgmap v535: 25 pgs: 25 active+clean; 322 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.2 MiB/s wr, 18 op/s 2021-07-26T16:04:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:46 smithi033 bash[42377]: cluster 2021-07-26T16:04:45.180127+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2021-07-26T16:04:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:46 smithi033 bash[42377]: cluster 2021-07-26T16:04:46.104678+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2021-07-26T16:04:46.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:46 smithi033 bash[41341]: cluster 2021-07-26T16:04:45.091707+0000 mgr.y (mgr.34104) 324 : cluster [DBG] pgmap v535: 25 pgs: 25 active+clean; 322 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.2 MiB/s wr, 18 op/s 2021-07-26T16:04:46.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:46 smithi033 bash[41341]: cluster 2021-07-26T16:04:45.180127+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2021-07-26T16:04:46.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:46 smithi033 bash[41341]: cluster 2021-07-26T16:04:46.104678+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2021-07-26T16:04:46.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:46 smithi096 bash[33981]: cluster 2021-07-26T16:04:45.091707+0000 mgr.y (mgr.34104) 324 : cluster [DBG] pgmap v535: 25 pgs: 25 active+clean; 322 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 26 MiB/s rd, 3.2 MiB/s wr, 18 op/s 2021-07-26T16:04:46.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:46 smithi096 bash[33981]: cluster 2021-07-26T16:04:45.180127+0000 mon.a (mon.0) 841 : cluster [DBG] osdmap e481: 8 total, 8 up, 8 in 2021-07-26T16:04:46.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:46 smithi096 bash[33981]: cluster 2021-07-26T16:04:46.104678+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e482: 8 total, 8 up, 8 in 2021-07-26T16:04:47.129 INFO:tasks.rados.rados.0.smithi033.stdout:2129: done (2 left) 2021-07-26T16:04:47.129 INFO:tasks.rados.rados.0.smithi033.stdout:2130: done (1 left) 2021-07-26T16:04:47.129 INFO:tasks.rados.rados.0.smithi033.stdout:2132: done (0 left) 2021-07-26T16:04:47.129 INFO:tasks.rados.rados.0.smithi033.stdout:2133: read oid 47 snap -1 2021-07-26T16:04:47.130 INFO:tasks.rados.rados.0.smithi033.stdout:2133: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:04:47.130 INFO:tasks.rados.rados.0.smithi033.stdout:2134: rmattr oid 50 current snap is 208 2021-07-26T16:04:47.130 INFO:tasks.rados.rados.0.smithi033.stdout:2135: rollback oid 38 current snap is 208 2021-07-26T16:04:47.130 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 38 to 183 2021-07-26T16:04:47.131 INFO:tasks.rados.rados.0.smithi033.stdout:2136: snap_create 2021-07-26T16:04:47.135 INFO:tasks.rados.rados.0.smithi033.stdout:2135: finishing rollback tid 1 to smithi03339061-38 2021-07-26T16:04:47.136 INFO:tasks.rados.rados.0.smithi033.stdout:2135: finishing rollback tid 2 to smithi03339061-38 2021-07-26T16:04:47.136 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 708 (ObjNum 580 snap 179 seq_num 580) dirty exists 2021-07-26T16:04:47.139 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 832 (ObjNum 579 snap 179 seq_num 579) dirty exists 2021-07-26T16:04:47.163 INFO:tasks.rados.rados.0.smithi033.stdout:2133: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:04:48.134 INFO:tasks.rados.rados.0.smithi033.stdout:2133: done (3 left) 2021-07-26T16:04:48.134 INFO:tasks.rados.rados.0.smithi033.stdout:2134: done (2 left) 2021-07-26T16:04:48.135 INFO:tasks.rados.rados.0.smithi033.stdout:2135: done (1 left) 2021-07-26T16:04:48.135 INFO:tasks.rados.rados.0.smithi033.stdout:2136: done (0 left) 2021-07-26T16:04:48.135 INFO:tasks.rados.rados.0.smithi033.stdout:2137: rmattr oid 32 current snap is 209 2021-07-26T16:04:48.135 INFO:tasks.rados.rados.0.smithi033.stdout:2138: rollback oid 9 current snap is 209 2021-07-26T16:04:48.136 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 9 to 183 2021-07-26T16:04:48.136 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 209 2021-07-26T16:04:48.136 INFO:tasks.rados.rados.0.smithi033.stdout:2139: seq_num 654 ranges {10657792=557056,11214848=630784,11845632=172032} 2021-07-26T16:04:48.199 INFO:tasks.rados.rados.0.smithi033.stdout:2139: writing smithi03339061-7 from 10657792 to 11214848 tid 1 2021-07-26T16:04:48.202 INFO:tasks.rados.rados.0.smithi033.stdout:2139: writing smithi03339061-7 from 11214848 to 11845632 tid 2 2021-07-26T16:04:48.204 INFO:tasks.rados.rados.0.smithi033.stdout:2139: writing smithi03339061-7 from 11845632 to 12017664 tid 3 2021-07-26T16:04:48.204 INFO:tasks.rados.rados.0.smithi033.stdout:2140: snap_create 2021-07-26T16:04:48.204 INFO:tasks.rados.rados.0.smithi033.stdout:2138: finishing rollback tid 0 to smithi03339061-9 2021-07-26T16:04:48.204 INFO:tasks.rados.rados.0.smithi033.stdout:2138: finishing rollback tid 1 to smithi03339061-9 2021-07-26T16:04:48.204 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 856 (ObjNum 1381653081 snap 1919440732 seq_num 1450136936) dirty dne 2021-07-26T16:04:48.205 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 833 (ObjNum 628 snap 197 seq_num 628) dirty exists 2021-07-26T16:04:48.210 INFO:tasks.rados.rados.0.smithi033.stdout:2139: finishing write tid 1 to smithi03339061-7 2021-07-26T16:04:48.211 INFO:tasks.rados.rados.0.smithi033.stdout:2139: finishing write tid 2 to smithi03339061-7 2021-07-26T16:04:48.211 INFO:tasks.rados.rados.0.smithi033.stdout:2139: finishing write tid 3 to smithi03339061-7 2021-07-26T16:04:48.212 INFO:tasks.rados.rados.0.smithi033.stdout:2139: finishing write tid 4 to smithi03339061-7 2021-07-26T16:04:48.214 INFO:tasks.rados.rados.0.smithi033.stdout:2139: finishing write tid 5 to smithi03339061-7 2021-07-26T16:04:48.214 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1070 (ObjNum 654 snap 209 seq_num 654) dirty exists 2021-07-26T16:04:48.215 INFO:tasks.rados.rados.0.smithi033.stdout:2139: left oid 7 (ObjNum 654 snap 209 seq_num 654) 2021-07-26T16:04:48.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:48 smithi033 bash[42377]: cluster 2021-07-26T16:04:47.092513+0000 mgr.y (mgr.34104) 325 : cluster [DBG] pgmap v538: 25 pgs: 25 active+clean; 324 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 2.3 MiB/s wr, 18 op/s 2021-07-26T16:04:48.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:48 smithi033 bash[42377]: cluster 2021-07-26T16:04:47.124612+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2021-07-26T16:04:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:48 smithi033 bash[41341]: cluster 2021-07-26T16:04:47.092513+0000 mgr.y (mgr.34104) 325 : cluster [DBG] pgmap v538: 25 pgs: 25 active+clean; 324 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 2.3 MiB/s wr, 18 op/s 2021-07-26T16:04:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:48 smithi033 bash[41341]: cluster 2021-07-26T16:04:47.124612+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2021-07-26T16:04:48.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:48 smithi096 bash[33981]: cluster 2021-07-26T16:04:47.092513+0000 mgr.y (mgr.34104) 325 : cluster [DBG] pgmap v538: 25 pgs: 25 active+clean; 324 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 23 MiB/s rd, 2.3 MiB/s wr, 18 op/s 2021-07-26T16:04:48.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:48 smithi096 bash[33981]: cluster 2021-07-26T16:04:47.124612+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e483: 8 total, 8 up, 8 in 2021-07-26T16:04:49.150 INFO:tasks.rados.rados.0.smithi033.stdout:2137: done (3 left) 2021-07-26T16:04:49.150 INFO:tasks.rados.rados.0.smithi033.stdout:2138: done (2 left) 2021-07-26T16:04:49.151 INFO:tasks.rados.rados.0.smithi033.stdout:2139: done (1 left) 2021-07-26T16:04:49.151 INFO:tasks.rados.rados.0.smithi033.stdout:2140: done (0 left) 2021-07-26T16:04:49.151 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 210 2021-07-26T16:04:49.151 INFO:tasks.rados.rados.0.smithi033.stdout:2141: seq_num 655 ranges {811008=573440,1384448=516096,1900544=286720} 2021-07-26T16:04:49.159 INFO:tasks.rados.rados.0.smithi033.stdout:2141: writing smithi03339061-33 from 811008 to 1384448 tid 1 2021-07-26T16:04:49.162 INFO:tasks.rados.rados.0.smithi033.stdout:2141: writing smithi03339061-33 from 1384448 to 1900544 tid 2 2021-07-26T16:04:49.164 INFO:tasks.rados.rados.0.smithi033.stdout:2141: writing smithi03339061-33 from 1900544 to 2187264 tid 3 2021-07-26T16:04:49.164 INFO:tasks.rados.rados.0.smithi033.stdout:2142: snap_create 2021-07-26T16:04:49.168 INFO:tasks.rados.rados.0.smithi033.stdout:2141: finishing write tid 1 to smithi03339061-33 2021-07-26T16:04:49.169 INFO:tasks.rados.rados.0.smithi033.stdout:2141: finishing write tid 2 to smithi03339061-33 2021-07-26T16:04:49.171 INFO:tasks.rados.rados.0.smithi033.stdout:2141: finishing write tid 3 to smithi03339061-33 2021-07-26T16:04:49.172 INFO:tasks.rados.rados.0.smithi033.stdout:2141: finishing write tid 4 to smithi03339061-33 2021-07-26T16:04:49.175 INFO:tasks.rados.rados.0.smithi033.stdout:2141: finishing write tid 5 to smithi03339061-33 2021-07-26T16:04:49.175 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 1283 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:04:49.175 INFO:tasks.rados.rados.0.smithi033.stdout:2141: left oid 33 (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:04:49.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:49 smithi033 bash[42377]: cluster 2021-07-26T16:04:48.128187+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2021-07-26T16:04:49.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:49 smithi033 bash[41341]: cluster 2021-07-26T16:04:48.128187+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2021-07-26T16:04:49.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:49 smithi096 bash[33981]: cluster 2021-07-26T16:04:48.128187+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e484: 8 total, 8 up, 8 in 2021-07-26T16:04:50.158 INFO:tasks.rados.rados.0.smithi033.stdout:2141: done (1 left) 2021-07-26T16:04:50.158 INFO:tasks.rados.rados.0.smithi033.stdout:2142: done (0 left) 2021-07-26T16:04:50.159 INFO:tasks.rados.rados.0.smithi033.stdout:2143: delete oid 46 current snap is 211 2021-07-26T16:04:50.165 INFO:tasks.rados.rados.0.smithi033.stdout:2143: done (0 left) 2021-07-26T16:04:50.165 INFO:tasks.rados.rados.0.smithi033.stdout:2144: delete oid 40 current snap is 211 2021-07-26T16:04:50.168 INFO:tasks.rados.rados.0.smithi033.stdout:2144: done (0 left) 2021-07-26T16:04:50.169 INFO:tasks.rados.rados.0.smithi033.stdout:2145: snap_create 2021-07-26T16:04:50.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:50 smithi033 bash[42377]: cluster 2021-07-26T16:04:49.093231+0000 mgr.y (mgr.34104) 326 : cluster [DBG] pgmap v541: 25 pgs: 25 active+clean; 332 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.2 MiB/s rd, 640 KiB/s wr, 11 op/s 2021-07-26T16:04:50.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:50 smithi033 bash[42377]: cluster 2021-07-26T16:04:49.145250+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2021-07-26T16:04:50.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:50 smithi033 bash[41341]: cluster 2021-07-26T16:04:49.093231+0000 mgr.y (mgr.34104) 326 : cluster [DBG] pgmap v541: 25 pgs: 25 active+clean; 332 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.2 MiB/s rd, 640 KiB/s wr, 11 op/s 2021-07-26T16:04:50.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:50 smithi033 bash[41341]: cluster 2021-07-26T16:04:49.145250+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2021-07-26T16:04:50.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:50 smithi096 bash[33981]: cluster 2021-07-26T16:04:49.093231+0000 mgr.y (mgr.34104) 326 : cluster [DBG] pgmap v541: 25 pgs: 25 active+clean; 332 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.2 MiB/s rd, 640 KiB/s wr, 11 op/s 2021-07-26T16:04:50.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:50 smithi096 bash[33981]: cluster 2021-07-26T16:04:49.145250+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e485: 8 total, 8 up, 8 in 2021-07-26T16:04:51.109 INFO:tasks.rados.rados.0.smithi033.stdout:2145: done (0 left) 2021-07-26T16:04:51.110 INFO:tasks.rados.rados.0.smithi033.stdout:2146: read oid 50 snap -1 2021-07-26T16:04:51.110 INFO:tasks.rados.rados.0.smithi033.stdout:2146: expect (ObjNum 579 snap 179 seq_num 579) 2021-07-26T16:04:51.110 INFO:tasks.rados.rados.0.smithi033.stdout:2147: snap_create 2021-07-26T16:04:51.169 INFO:tasks.rados.rados.0.smithi033.stdout:2146: expect (ObjNum 579 snap 179 seq_num 579) 2021-07-26T16:04:51.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:51 smithi033 bash[41341]: cluster 2021-07-26T16:04:50.155886+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2021-07-26T16:04:51.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:51 smithi033 bash[41341]: cluster 2021-07-26T16:04:51.105682+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2021-07-26T16:04:51.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:51 smithi033 bash[42377]: cluster 2021-07-26T16:04:50.155886+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2021-07-26T16:04:51.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:51 smithi033 bash[42377]: cluster 2021-07-26T16:04:51.105682+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2021-07-26T16:04:51.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:51 smithi096 bash[33981]: cluster 2021-07-26T16:04:50.155886+0000 mon.a (mon.0) 846 : cluster [DBG] osdmap e486: 8 total, 8 up, 8 in 2021-07-26T16:04:51.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:51 smithi096 bash[33981]: cluster 2021-07-26T16:04:51.105682+0000 mon.a (mon.0) 847 : cluster [DBG] osdmap e487: 8 total, 8 up, 8 in 2021-07-26T16:04:52.249 INFO:tasks.rados.rados.0.smithi033.stdout:2146: done (1 left) 2021-07-26T16:04:52.250 INFO:tasks.rados.rados.0.smithi033.stdout:2147: done (0 left) 2021-07-26T16:04:52.250 INFO:tasks.rados.rados.0.smithi033.stdout:2148: read oid 15 snap -1 2021-07-26T16:04:52.250 INFO:tasks.rados.rados.0.smithi033.stdout:2148: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:04:52.250 INFO:tasks.rados.rados.0.smithi033.stdout:2149: copy_from oid 4 from oid 19 current snap is 213 2021-07-26T16:04:52.250 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 213 2021-07-26T16:04:52.251 INFO:tasks.rados.rados.0.smithi033.stdout:2150: seq_num 658 ranges {1277952=622592,1900544=565248,2465792=237568} 2021-07-26T16:04:52.268 INFO:tasks.rados.rados.0.smithi033.stdout:2150: writing smithi03339061-30 from 1277952 to 1900544 tid 1 2021-07-26T16:04:52.271 INFO:tasks.rados.rados.0.smithi033.stdout:2150: writing smithi03339061-30 from 1900544 to 2465792 tid 2 2021-07-26T16:04:52.273 INFO:tasks.rados.rados.0.smithi033.stdout:2150: writing smithi03339061-30 from 2465792 to 2703360 tid 3 2021-07-26T16:04:52.274 INFO:tasks.rados.rados.0.smithi033.stdout:2151: copy_from oid 22 from oid 37 current snap is 213 2021-07-26T16:04:52.274 INFO:tasks.rados.rados.0.smithi033.stdout:2149: finishing copy_from to smithi03339061-4 2021-07-26T16:04:52.274 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 854 (ObjNum 643 snap 204 seq_num 643) dirty exists 2021-07-26T16:04:52.274 INFO:tasks.rados.rados.0.smithi033.stdout:2149: finishing copy_from racing read to smithi03339061-4 2021-07-26T16:04:52.275 INFO:tasks.rados.rados.0.smithi033.stdout:2149: done (3 left) 2021-07-26T16:04:52.275 INFO:tasks.rados.rados.0.smithi033.stdout:2152: snap_remove snap 204 2021-07-26T16:04:52.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:52 smithi033 bash[41341]: cluster 2021-07-26T16:04:51.093924+0000 mgr.y (mgr.34104) 327 : cluster [DBG] pgmap v544: 25 pgs: 25 active+clean; 332 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.5 MiB/s rd, 324 KiB/s wr, 3 op/s 2021-07-26T16:04:52.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:52 smithi033 bash[41341]: cluster 2021-07-26T16:04:52.119093+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2021-07-26T16:04:52.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:52 smithi033 bash[42377]: cluster 2021-07-26T16:04:51.093924+0000 mgr.y (mgr.34104) 327 : cluster [DBG] pgmap v544: 25 pgs: 25 active+clean; 332 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.5 MiB/s rd, 324 KiB/s wr, 3 op/s 2021-07-26T16:04:52.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:52 smithi033 bash[42377]: cluster 2021-07-26T16:04:52.119093+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2021-07-26T16:04:52.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:52 smithi096 bash[33981]: cluster 2021-07-26T16:04:51.093924+0000 mgr.y (mgr.34104) 327 : cluster [DBG] pgmap v544: 25 pgs: 25 active+clean; 332 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 6.5 MiB/s rd, 324 KiB/s wr, 3 op/s 2021-07-26T16:04:52.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:52 smithi096 bash[33981]: cluster 2021-07-26T16:04:52.119093+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e488: 8 total, 8 up, 8 in 2021-07-26T16:04:53.197 INFO:tasks.rados.rados.0.smithi033.stdout:2152: done (3 left) 2021-07-26T16:04:53.198 INFO:tasks.rados.rados.0.smithi033.stdout:2153: snap_remove snap 183 2021-07-26T16:04:53.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:53 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:53.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:04:53.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:53 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:53.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:04:53.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:04:53 smithi033 bash[50539]: level=error ts=2021-07-26T16:04:53.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=10 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:04:54.211 INFO:tasks.rados.rados.0.smithi033.stdout:2153: done (3 left) 2021-07-26T16:04:54.212 INFO:tasks.rados.rados.0.smithi033.stdout:2154: read oid 25 snap 201 2021-07-26T16:04:54.212 INFO:tasks.rados.rados.0.smithi033.stdout:2154: expect deleted 2021-07-26T16:04:54.212 INFO:tasks.rados.rados.0.smithi033.stdout:2155: snap_remove snap 208 2021-07-26T16:04:54.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:54 smithi033 bash[41341]: cluster 2021-07-26T16:04:53.094591+0000 mgr.y (mgr.34104) 328 : cluster [DBG] pgmap v547: 25 pgs: 25 active+clean; 336 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2021-07-26T16:04:54.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:54 smithi033 bash[41341]: cluster 2021-07-26T16:04:53.194063+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2021-07-26T16:04:54.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:54 smithi033 bash[42377]: cluster 2021-07-26T16:04:53.094591+0000 mgr.y (mgr.34104) 328 : cluster [DBG] pgmap v547: 25 pgs: 25 active+clean; 336 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2021-07-26T16:04:54.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:54 smithi033 bash[42377]: cluster 2021-07-26T16:04:53.194063+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2021-07-26T16:04:54.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:54 smithi096 bash[33981]: cluster 2021-07-26T16:04:53.094591+0000 mgr.y (mgr.34104) 328 : cluster [DBG] pgmap v547: 25 pgs: 25 active+clean; 336 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2021-07-26T16:04:54.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:54 smithi096 bash[33981]: cluster 2021-07-26T16:04:53.194063+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e489: 8 total, 8 up, 8 in 2021-07-26T16:04:55.218 INFO:tasks.rados.rados.0.smithi033.stdout:2155: done (4 left) 2021-07-26T16:04:55.218 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 213 2021-07-26T16:04:55.218 INFO:tasks.rados.rados.0.smithi033.stdout:2156: seq_num 659 ranges {0=647168,647168=450560,1097728=352256} 2021-07-26T16:04:55.222 INFO:tasks.rados.rados.0.smithi033.stdout:2156: writing smithi03339061-14 from 0 to 647168 tid 1 2021-07-26T16:04:55.225 INFO:tasks.rados.rados.0.smithi033.stdout:2156: writing smithi03339061-14 from 647168 to 1097728 tid 2 2021-07-26T16:04:55.228 INFO:tasks.rados.rados.0.smithi033.stdout:2156: writing smithi03339061-14 from 1097728 to 1449984 tid 3 2021-07-26T16:04:55.229 INFO:tasks.rados.rados.0.smithi033.stdout:2150: finishing write tid 1 to smithi03339061-30 2021-07-26T16:04:55.229 INFO:tasks.rados.rados.0.smithi033.stdout:2150: finishing write tid 2 to smithi03339061-30 2021-07-26T16:04:55.229 INFO:tasks.rados.rados.0.smithi033.stdout:2150: finishing write tid 3 to smithi03339061-30 2021-07-26T16:04:55.229 INFO:tasks.rados.rados.0.smithi033.stdout:2150: finishing write tid 4 to smithi03339061-30 2021-07-26T16:04:55.229 INFO:tasks.rados.rados.0.smithi033.stdout:2150: finishing write tid 5 to smithi03339061-30 2021-07-26T16:04:55.230 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 968 (ObjNum 658 snap 213 seq_num 658) dirty exists 2021-07-26T16:04:55.230 INFO:tasks.rados.rados.0.smithi033.stdout:2150: left oid 30 (ObjNum 658 snap 213 seq_num 658) 2021-07-26T16:04:55.230 INFO:tasks.rados.rados.0.smithi033.stdout:2151: finishing copy_from to smithi03339061-22 2021-07-26T16:04:55.230 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 921 (ObjNum 609 snap 192 seq_num 609) dirty exists 2021-07-26T16:04:55.231 INFO:tasks.rados.rados.0.smithi033.stdout:2151: finishing copy_from racing read to smithi03339061-22 2021-07-26T16:04:55.231 INFO:tasks.rados.rados.0.smithi033.stdout:2148: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:04:55.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:55 smithi096 bash[33981]: cluster 2021-07-26T16:04:54.202883+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2021-07-26T16:04:55.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:55 smithi033 bash[41341]: cluster 2021-07-26T16:04:54.202883+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2021-07-26T16:04:55.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:55 smithi033 bash[42377]: cluster 2021-07-26T16:04:54.202883+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e490: 8 total, 8 up, 8 in 2021-07-26T16:04:56.138 INFO:tasks.rados.rados.0.smithi033.stdout:2156: finishing write tid 1 to smithi03339061-14 2021-07-26T16:04:56.138 INFO:tasks.rados.rados.0.smithi033.stdout:2156: finishing write tid 2 to smithi03339061-14 2021-07-26T16:04:56.138 INFO:tasks.rados.rados.0.smithi033.stdout:2156: finishing write tid 3 to smithi03339061-14 2021-07-26T16:04:56.139 INFO:tasks.rados.rados.0.smithi033.stdout:2156: finishing write tid 4 to smithi03339061-14 2021-07-26T16:04:56.139 INFO:tasks.rados.rados.0.smithi033.stdout:2156: finishing write tid 5 to smithi03339061-14 2021-07-26T16:04:56.139 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1066 (ObjNum 659 snap 213 seq_num 659) dirty exists 2021-07-26T16:04:56.139 INFO:tasks.rados.rados.0.smithi033.stdout:2156: left oid 14 (ObjNum 659 snap 213 seq_num 659) 2021-07-26T16:04:56.140 INFO:tasks.rados.rados.0.smithi033.stdout:2148: done (4 left) 2021-07-26T16:04:56.140 INFO:tasks.rados.rados.0.smithi033.stdout:2150: done (3 left) 2021-07-26T16:04:56.140 INFO:tasks.rados.rados.0.smithi033.stdout:2151: done (2 left) 2021-07-26T16:04:56.140 INFO:tasks.rados.rados.0.smithi033.stdout:2154: done (1 left) 2021-07-26T16:04:56.140 INFO:tasks.rados.rados.0.smithi033.stdout:2156: done (0 left) 2021-07-26T16:04:56.141 INFO:tasks.rados.rados.0.smithi033.stdout:2157: rollback oid 6 current snap is 213 2021-07-26T16:04:56.141 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 203 2021-07-26T16:04:56.141 INFO:tasks.rados.rados.0.smithi033.stdout:2158: read oid 37 snap -1 2021-07-26T16:04:56.141 INFO:tasks.rados.rados.0.smithi033.stdout:2158: expect (ObjNum 609 snap 192 seq_num 609) 2021-07-26T16:04:56.141 INFO:tasks.rados.rados.0.smithi033.stdout:2159: snap_create 2021-07-26T16:04:56.143 INFO:tasks.rados.rados.0.smithi033.stdout:2158: expect (ObjNum 609 snap 192 seq_num 609) 2021-07-26T16:04:56.159 INFO:tasks.rados.rados.0.smithi033.stdout:2157: finishing rollback tid 0 to smithi03339061-6 2021-07-26T16:04:56.160 INFO:tasks.rados.rados.0.smithi033.stdout:2157: finishing rollback tid 1 to smithi03339061-6 2021-07-26T16:04:56.160 INFO:tasks.rados.rados.0.smithi033.stdout:2157: finishing rollback tid 2 to smithi03339061-6 2021-07-26T16:04:56.160 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1309 (ObjNum 630 snap 199 seq_num 630) dirty exists 2021-07-26T16:04:56.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:56 smithi096 bash[33981]: cluster 2021-07-26T16:04:55.095240+0000 mgr.y (mgr.34104) 329 : cluster [DBG] pgmap v550: 25 pgs: 25 active+clean; 325 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2021-07-26T16:04:56.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:56 smithi096 bash[33981]: cluster 2021-07-26T16:04:55.208229+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2021-07-26T16:04:56.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:56 smithi096 bash[33981]: cluster 2021-07-26T16:04:56.105552+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2021-07-26T16:04:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:56 smithi033 bash[41341]: cluster 2021-07-26T16:04:55.095240+0000 mgr.y (mgr.34104) 329 : cluster [DBG] pgmap v550: 25 pgs: 25 active+clean; 325 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2021-07-26T16:04:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:56 smithi033 bash[41341]: cluster 2021-07-26T16:04:55.208229+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2021-07-26T16:04:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:56 smithi033 bash[41341]: cluster 2021-07-26T16:04:56.105552+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2021-07-26T16:04:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:56 smithi033 bash[42377]: cluster 2021-07-26T16:04:55.095240+0000 mgr.y (mgr.34104) 329 : cluster [DBG] pgmap v550: 25 pgs: 25 active+clean; 325 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.1 MiB/s wr, 10 op/s 2021-07-26T16:04:56.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:56 smithi033 bash[42377]: cluster 2021-07-26T16:04:55.208229+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e491: 8 total, 8 up, 8 in 2021-07-26T16:04:56.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:56 smithi033 bash[42377]: cluster 2021-07-26T16:04:56.105552+0000 mon.a (mon.0) 852 : cluster [DBG] osdmap e492: 8 total, 8 up, 8 in 2021-07-26T16:04:57.122 INFO:tasks.rados.rados.0.smithi033.stdout:2157: done (2 left) 2021-07-26T16:04:57.122 INFO:tasks.rados.rados.0.smithi033.stdout:2158: done (1 left) 2021-07-26T16:04:57.123 INFO:tasks.rados.rados.0.smithi033.stdout:2159: done (0 left) 2021-07-26T16:04:57.123 INFO:tasks.rados.rados.0.smithi033.stdout:2160: delete oid 35 current snap is 214 2021-07-26T16:04:57.130 INFO:tasks.rados.rados.0.smithi033.stdout:2160: done (0 left) 2021-07-26T16:04:57.130 INFO:tasks.rados.rados.0.smithi033.stdout:2161: snap_create 2021-07-26T16:04:58.131 INFO:tasks.rados.rados.0.smithi033.stdout:2161: done (0 left) 2021-07-26T16:04:58.132 INFO:tasks.rados.rados.0.smithi033.stdout:2162: copy_from oid 2 from oid 45 current snap is 215 2021-07-26T16:04:58.132 INFO:tasks.rados.rados.0.smithi033.stdout:2163: rmattr oid 23 current snap is 215 2021-07-26T16:04:58.133 INFO:tasks.rados.rados.0.smithi033.stdout:2164: rmattr oid 38 current snap is 215 2021-07-26T16:04:58.133 INFO:tasks.rados.rados.0.smithi033.stdout:2165: delete oid 47 current snap is 215 2021-07-26T16:04:58.137 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 709 (ObjNum 580 snap 179 seq_num 580) dirty exists 2021-07-26T16:04:58.139 INFO:tasks.rados.rados.0.smithi033.stdout:2164: done (3 left) 2021-07-26T16:04:58.139 INFO:tasks.rados.rados.0.smithi033.stdout:2165: done (2 left) 2021-07-26T16:04:58.139 INFO:tasks.rados.rados.0.smithi033.stdout:2166: snap_remove snap 210 2021-07-26T16:04:58.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:58 smithi033 bash[41341]: cluster 2021-07-26T16:04:57.095958+0000 mgr.y (mgr.34104) 330 : cluster [DBG] pgmap v553: 25 pgs: 25 active+clean; 328 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 642 KiB/s wr, 2 op/s 2021-07-26T16:04:58.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:58 smithi033 bash[41341]: cluster 2021-07-26T16:04:57.119020+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2021-07-26T16:04:58.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:58 smithi033 bash[42377]: cluster 2021-07-26T16:04:57.095958+0000 mgr.y (mgr.34104) 330 : cluster [DBG] pgmap v553: 25 pgs: 25 active+clean; 328 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 642 KiB/s wr, 2 op/s 2021-07-26T16:04:58.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:58 smithi033 bash[42377]: cluster 2021-07-26T16:04:57.119020+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2021-07-26T16:04:58.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:58 smithi096 bash[33981]: cluster 2021-07-26T16:04:57.095958+0000 mgr.y (mgr.34104) 330 : cluster [DBG] pgmap v553: 25 pgs: 25 active+clean; 328 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 642 KiB/s wr, 2 op/s 2021-07-26T16:04:58.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:58 smithi096 bash[33981]: cluster 2021-07-26T16:04:57.119020+0000 mon.a (mon.0) 853 : cluster [DBG] osdmap e493: 8 total, 8 up, 8 in 2021-07-26T16:04:59.140 INFO:tasks.rados.rados.0.smithi033.stdout:2166: done (2 left) 2021-07-26T16:04:59.141 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 215 2021-07-26T16:04:59.141 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1071 (ObjNum 622 snap 194 seq_num 622) dirty exists 2021-07-26T16:04:59.141 INFO:tasks.rados.rados.0.smithi033.stdout:2167: seq_num 662 ranges {9928704=696320,10625024=557056,11182080=245760} 2021-07-26T16:04:59.203 INFO:tasks.rados.rados.0.smithi033.stdout:2167: writing smithi03339061-11 from 9928704 to 10625024 tid 1 2021-07-26T16:04:59.204 INFO:tasks.rados.rados.0.smithi033.stdout:2167: writing smithi03339061-11 from 10625024 to 11182080 tid 2 2021-07-26T16:04:59.208 INFO:tasks.rados.rados.0.smithi033.stdout:2167: writing smithi03339061-11 from 11182080 to 11427840 tid 3 2021-07-26T16:04:59.208 INFO:tasks.rados.rados.0.smithi033.stdout:2163: done (2 left) 2021-07-26T16:04:59.208 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 215 2021-07-26T16:04:59.208 INFO:tasks.rados.rados.0.smithi033.stdout:2162: finishing copy_from to smithi03339061-2 2021-07-26T16:04:59.209 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1209 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:04:59.209 INFO:tasks.rados.rados.0.smithi033.stdout:2168: seq_num 663 ranges {0=712704,712704=442368,1155072=360448} 2021-07-26T16:04:59.217 INFO:tasks.rados.rados.0.smithi033.stdout:2168: writing smithi03339061-39 from 0 to 712704 tid 1 2021-07-26T16:04:59.218 INFO:tasks.rados.rados.0.smithi033.stdout:2168: writing smithi03339061-39 from 712704 to 1155072 tid 2 2021-07-26T16:04:59.218 INFO:tasks.rados.rados.0.smithi033.stdout:2168: writing smithi03339061-39 from 1155072 to 1515520 tid 3 2021-07-26T16:04:59.218 INFO:tasks.rados.rados.0.smithi033.stdout:2169: snap_remove snap 213 2021-07-26T16:04:59.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:04:59 smithi033 bash[41341]: cluster 2021-07-26T16:04:58.128297+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2021-07-26T16:04:59.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:04:59 smithi033 bash[42377]: cluster 2021-07-26T16:04:58.128297+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2021-07-26T16:04:59.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:04:59 smithi096 bash[33981]: cluster 2021-07-26T16:04:58.128297+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e494: 8 total, 8 up, 8 in 2021-07-26T16:05:00.151 INFO:tasks.rados.rados.0.smithi033.stdout:2169: done (3 left) 2021-07-26T16:05:00.151 INFO:tasks.rados.rados.0.smithi033.stdout:2170: setattr oid 10 current snap is 215 2021-07-26T16:05:00.151 INFO:tasks.rados.rados.0.smithi033.stdout:2162: finishing copy_from racing read to smithi03339061-2 2021-07-26T16:05:00.152 INFO:tasks.rados.rados.0.smithi033.stdout:2167: finishing write tid 1 to smithi03339061-11 2021-07-26T16:05:00.152 INFO:tasks.rados.rados.0.smithi033.stdout:2167: finishing write tid 2 to smithi03339061-11 2021-07-26T16:05:00.152 INFO:tasks.rados.rados.0.smithi033.stdout:2167: finishing write tid 3 to smithi03339061-11 2021-07-26T16:05:00.152 INFO:tasks.rados.rados.0.smithi033.stdout:2168: finishing write tid 1 to smithi03339061-39 2021-07-26T16:05:00.152 INFO:tasks.rados.rados.0.smithi033.stdout:2167: finishing write tid 4 to smithi03339061-11 2021-07-26T16:05:00.153 INFO:tasks.rados.rados.0.smithi033.stdout:2168: finishing write tid 2 to smithi03339061-39 2021-07-26T16:05:00.153 INFO:tasks.rados.rados.0.smithi033.stdout:2168: finishing write tid 3 to smithi03339061-39 2021-07-26T16:05:00.153 INFO:tasks.rados.rados.0.smithi033.stdout:2168: finishing write tid 4 to smithi03339061-39 2021-07-26T16:05:00.153 INFO:tasks.rados.rados.0.smithi033.stdout:2167: finishing write tid 5 to smithi03339061-11 2021-07-26T16:05:00.154 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 876 (ObjNum 662 snap 215 seq_num 662) dirty exists 2021-07-26T16:05:00.154 INFO:tasks.rados.rados.0.smithi033.stdout:2167: left oid 11 (ObjNum 662 snap 215 seq_num 662) 2021-07-26T16:05:00.154 INFO:tasks.rados.rados.0.smithi033.stdout:2168: finishing write tid 5 to smithi03339061-39 2021-07-26T16:05:00.154 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1075 (ObjNum 663 snap 215 seq_num 663) dirty exists 2021-07-26T16:05:00.154 INFO:tasks.rados.rados.0.smithi033.stdout:2168: left oid 39 (ObjNum 663 snap 215 seq_num 663) 2021-07-26T16:05:00.158 INFO:tasks.rados.rados.0.smithi033.stdout:2162: done (3 left) 2021-07-26T16:05:00.159 INFO:tasks.rados.rados.0.smithi033.stdout:2167: done (2 left) 2021-07-26T16:05:00.159 INFO:tasks.rados.rados.0.smithi033.stdout:2168: done (1 left) 2021-07-26T16:05:00.159 INFO:tasks.rados.rados.0.smithi033.stdout:2171: rmattr oid 39 current snap is 215 2021-07-26T16:05:00.160 INFO:tasks.rados.rados.0.smithi033.stdout:2172: rollback oid 7 current snap is 215 2021-07-26T16:05:00.160 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 7 to 207 2021-07-26T16:05:00.160 INFO:tasks.rados.rados.0.smithi033.stdout:2173: snap_remove snap 212 2021-07-26T16:05:00.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:00 smithi033 bash[41341]: cluster 2021-07-26T16:04:59.096595+0000 mgr.y (mgr.34104) 331 : cluster [DBG] pgmap v556: 25 pgs: 25 active+clean; 328 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 642 KiB/s wr, 4 op/s 2021-07-26T16:05:00.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:00 smithi033 bash[41341]: cluster 2021-07-26T16:04:59.137230+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2021-07-26T16:05:00.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:00 smithi033 bash[42377]: cluster 2021-07-26T16:04:59.096595+0000 mgr.y (mgr.34104) 331 : cluster [DBG] pgmap v556: 25 pgs: 25 active+clean; 328 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 642 KiB/s wr, 4 op/s 2021-07-26T16:05:00.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:00 smithi033 bash[42377]: cluster 2021-07-26T16:04:59.137230+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2021-07-26T16:05:00.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:00 smithi096 bash[33981]: cluster 2021-07-26T16:04:59.096595+0000 mgr.y (mgr.34104) 331 : cluster [DBG] pgmap v556: 25 pgs: 25 active+clean; 328 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.5 MiB/s rd, 642 KiB/s wr, 4 op/s 2021-07-26T16:05:00.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:00 smithi096 bash[33981]: cluster 2021-07-26T16:04:59.137230+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e495: 8 total, 8 up, 8 in 2021-07-26T16:05:01.115 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 985 (ObjNum 0 snap 0 seq_num 2004516880) dirty exists 2021-07-26T16:05:01.116 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1076 (ObjNum 663 snap 215 seq_num 663) dirty exists 2021-07-26T16:05:01.116 INFO:tasks.rados.rados.0.smithi033.stdout:2172: finishing rollback tid 0 to smithi03339061-7 2021-07-26T16:05:01.116 INFO:tasks.rados.rados.0.smithi033.stdout:2172: finishing rollback tid 1 to smithi03339061-7 2021-07-26T16:05:01.116 INFO:tasks.rados.rados.0.smithi033.stdout:2172: finishing rollback tid 2 to smithi03339061-7 2021-07-26T16:05:01.117 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1079 (ObjNum 622 snap 194 seq_num 622) dirty exists 2021-07-26T16:05:01.117 INFO:tasks.rados.rados.0.smithi033.stdout:2170: done (3 left) 2021-07-26T16:05:01.117 INFO:tasks.rados.rados.0.smithi033.stdout:2171: done (2 left) 2021-07-26T16:05:01.117 INFO:tasks.rados.rados.0.smithi033.stdout:2172: done (1 left) 2021-07-26T16:05:01.117 INFO:tasks.rados.rados.0.smithi033.stdout:2173: done (0 left) 2021-07-26T16:05:01.118 INFO:tasks.rados.rados.0.smithi033.stdout:2174: delete oid 23 current snap is 215 2021-07-26T16:05:01.128 INFO:tasks.rados.rados.0.smithi033.stdout:2174: done (0 left) 2021-07-26T16:05:01.129 INFO:tasks.rados.rados.0.smithi033.stdout:2175: read oid 50 snap -1 2021-07-26T16:05:01.129 INFO:tasks.rados.rados.0.smithi033.stdout:2175: expect (ObjNum 579 snap 179 seq_num 579) 2021-07-26T16:05:01.130 INFO:tasks.rados.rados.0.smithi033.stdout:2176: snap_create 2021-07-26T16:05:01.170 INFO:tasks.rados.rados.0.smithi033.stdout:2175: expect (ObjNum 579 snap 179 seq_num 579) 2021-07-26T16:05:01.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:01 smithi033 bash[41341]: cluster 2021-07-26T16:05:00.148284+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2021-07-26T16:05:01.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:01 smithi033 bash[41341]: cluster 2021-07-26T16:05:01.111155+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2021-07-26T16:05:01.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:01 smithi033 bash[42377]: cluster 2021-07-26T16:05:00.148284+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2021-07-26T16:05:01.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:01 smithi033 bash[42377]: cluster 2021-07-26T16:05:01.111155+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2021-07-26T16:05:01.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:01 smithi096 bash[33981]: cluster 2021-07-26T16:05:00.148284+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e496: 8 total, 8 up, 8 in 2021-07-26T16:05:01.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:01 smithi096 bash[33981]: cluster 2021-07-26T16:05:01.111155+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e497: 8 total, 8 up, 8 in 2021-07-26T16:05:02.247 INFO:tasks.rados.rados.0.smithi033.stdout:2175: done (1 left) 2021-07-26T16:05:02.247 INFO:tasks.rados.rados.0.smithi033.stdout:2176: done (0 left) 2021-07-26T16:05:02.247 INFO:tasks.rados.rados.0.smithi033.stdout:2177: read oid 5 snap -1 2021-07-26T16:05:02.248 INFO:tasks.rados.rados.0.smithi033.stdout:2177: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:05:02.248 INFO:tasks.rados.rados.0.smithi033.stdout:2178: read oid 32 snap -1 2021-07-26T16:05:02.248 INFO:tasks.rados.rados.0.smithi033.stdout:2178: expect (ObjNum 628 snap 197 seq_num 628) 2021-07-26T16:05:02.248 INFO:tasks.rados.rados.0.smithi033.stdout:2179: snap_remove snap 203 2021-07-26T16:05:02.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:02 smithi033 bash[42377]: cluster 2021-07-26T16:05:01.097327+0000 mgr.y (mgr.34104) 332 : cluster [DBG] pgmap v559: 25 pgs: 25 active+clean; 338 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 444 KiB/s rd, 2.5 MiB/s wr, 3 op/s 2021-07-26T16:05:02.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:02 smithi033 bash[42377]: cluster 2021-07-26T16:05:02.122701+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2021-07-26T16:05:02.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:02 smithi033 bash[41341]: cluster 2021-07-26T16:05:01.097327+0000 mgr.y (mgr.34104) 332 : cluster [DBG] pgmap v559: 25 pgs: 25 active+clean; 338 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 444 KiB/s rd, 2.5 MiB/s wr, 3 op/s 2021-07-26T16:05:02.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:02 smithi033 bash[41341]: cluster 2021-07-26T16:05:02.122701+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2021-07-26T16:05:02.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:02 smithi096 bash[33981]: cluster 2021-07-26T16:05:01.097327+0000 mgr.y (mgr.34104) 332 : cluster [DBG] pgmap v559: 25 pgs: 25 active+clean; 338 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 444 KiB/s rd, 2.5 MiB/s wr, 3 op/s 2021-07-26T16:05:02.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:02 smithi096 bash[33981]: cluster 2021-07-26T16:05:02.122701+0000 mon.a (mon.0) 858 : cluster [DBG] osdmap e498: 8 total, 8 up, 8 in 2021-07-26T16:05:03.173 INFO:tasks.rados.rados.0.smithi033.stdout:2179: done (2 left) 2021-07-26T16:05:03.174 INFO:tasks.rados.rados.0.smithi033.stdout:2180: snap_create 2021-07-26T16:05:03.174 INFO:tasks.rados.rados.0.smithi033.stdout:2177: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:05:03.241 INFO:tasks.rados.rados.0.smithi033.stdout:2178: expect (ObjNum 628 snap 197 seq_num 628) 2021-07-26T16:05:03.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:03 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:03.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:03 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:03.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:03 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:03.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:05:04.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:04 smithi033 bash[41341]: cluster 2021-07-26T16:05:03.098046+0000 mgr.y (mgr.34104) 333 : cluster [DBG] pgmap v562: 25 pgs: 25 active+clean; 339 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2021-07-26T16:05:04.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:04 smithi033 bash[41341]: cluster 2021-07-26T16:05:03.164385+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2021-07-26T16:05:04.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:04 smithi033 bash[42377]: cluster 2021-07-26T16:05:03.098046+0000 mgr.y (mgr.34104) 333 : cluster [DBG] pgmap v562: 25 pgs: 25 active+clean; 339 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2021-07-26T16:05:04.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:04 smithi033 bash[42377]: cluster 2021-07-26T16:05:03.164385+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2021-07-26T16:05:04.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:04 smithi096 bash[33981]: cluster 2021-07-26T16:05:03.098046+0000 mgr.y (mgr.34104) 333 : cluster [DBG] pgmap v562: 25 pgs: 25 active+clean; 339 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.9 MiB/s wr, 17 op/s 2021-07-26T16:05:04.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:04 smithi096 bash[33981]: cluster 2021-07-26T16:05:03.164385+0000 mon.a (mon.0) 859 : cluster [DBG] osdmap e499: 8 total, 8 up, 8 in 2021-07-26T16:05:05.055 INFO:tasks.rados.rados.0.smithi033.stdout:2177: done (2 left) 2021-07-26T16:05:05.055 INFO:tasks.rados.rados.0.smithi033.stdout:2178: done (1 left) 2021-07-26T16:05:05.056 INFO:tasks.rados.rados.0.smithi033.stdout:2180: done (0 left) 2021-07-26T16:05:05.057 INFO:tasks.rados.rados.0.smithi033.stdout:2181: read oid 40 snap 211 2021-07-26T16:05:05.057 INFO:tasks.rados.rados.0.smithi033.stdout:2181: expect deleted 2021-07-26T16:05:05.057 INFO:tasks.rados.rados.0.smithi033.stdout:2182: read oid 23 snap 207 2021-07-26T16:05:05.057 INFO:tasks.rados.rados.0.smithi033.stdout:2182: expect (ObjNum 622 snap 194 seq_num 622) 2021-07-26T16:05:05.058 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 17 current snap is 217 2021-07-26T16:05:05.058 INFO:tasks.rados.rados.0.smithi033.stdout:2183: seq_num 665 ranges {2727936=745472,3473408=606208,4079616=196608} 2021-07-26T16:05:05.084 INFO:tasks.rados.rados.0.smithi033.stdout:2183: writing smithi03339061-17 from 2727936 to 3473408 tid 1 2021-07-26T16:05:05.088 INFO:tasks.rados.rados.0.smithi033.stdout:2183: writing smithi03339061-17 from 3473408 to 4079616 tid 2 2021-07-26T16:05:05.090 INFO:tasks.rados.rados.0.smithi033.stdout:2183: writing smithi03339061-17 from 4079616 to 4276224 tid 3 2021-07-26T16:05:05.090 INFO:tasks.rados.rados.0.smithi033.stdout:2184: delete oid 2 current snap is 217 2021-07-26T16:05:05.098 INFO:tasks.rados.rados.0.smithi033.stdout:2181: done (3 left) 2021-07-26T16:05:05.098 INFO:tasks.rados.rados.0.smithi033.stdout:2184: done (2 left) 2021-07-26T16:05:05.098 INFO:tasks.rados.rados.0.smithi033.stdout:2185: read oid 18 snap -1 2021-07-26T16:05:05.099 INFO:tasks.rados.rados.0.smithi033.stdout:2185: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:05:05.099 INFO:tasks.rados.rados.0.smithi033.stdout:2186: snap_remove snap 194 2021-07-26T16:05:05.186 INFO:tasks.rados.rados.0.smithi033.stdout:2186: done (3 left) 2021-07-26T16:05:05.187 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 217 2021-07-26T16:05:05.187 INFO:tasks.rados.rados.0.smithi033.stdout:2187: seq_num 667 ranges {7315456=778240,8093696=778240,8871936=24576} 2021-07-26T16:05:05.233 INFO:tasks.rados.rados.0.smithi033.stdout:2187: writing smithi03339061-38 from 7315456 to 8093696 tid 1 2021-07-26T16:05:05.238 INFO:tasks.rados.rados.0.smithi033.stdout:2187: writing smithi03339061-38 from 8093696 to 8871936 tid 2 2021-07-26T16:05:05.238 INFO:tasks.rados.rados.0.smithi033.stdout:2187: writing smithi03339061-38 from 8871936 to 8896512 tid 3 2021-07-26T16:05:05.239 INFO:tasks.rados.rados.0.smithi033.stdout:2188: snap_remove snap 215 2021-07-26T16:05:05.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:05 smithi033 bash[41341]: cluster 2021-07-26T16:05:04.167114+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2021-07-26T16:05:05.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:05 smithi033 bash[42377]: cluster 2021-07-26T16:05:04.167114+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2021-07-26T16:05:05.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:05 smithi096 bash[33981]: cluster 2021-07-26T16:05:04.167114+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e500: 8 total, 8 up, 8 in 2021-07-26T16:05:06.118 INFO:tasks.rados.rados.0.smithi033.stdout:2188: done (4 left) 2021-07-26T16:05:06.119 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 217 2021-07-26T16:05:06.120 INFO:tasks.rados.rados.0.smithi033.stdout:2189: seq_num 668 ranges {1294336=794624,2088960=663552,2752512=139264} 2021-07-26T16:05:06.130 INFO:tasks.rados.rados.0.smithi033.stdout:2189: writing smithi03339061-13 from 1294336 to 2088960 tid 1 2021-07-26T16:05:06.134 INFO:tasks.rados.rados.0.smithi033.stdout:2189: writing smithi03339061-13 from 2088960 to 2752512 tid 2 2021-07-26T16:05:06.135 INFO:tasks.rados.rados.0.smithi033.stdout:2189: writing smithi03339061-13 from 2752512 to 2891776 tid 3 2021-07-26T16:05:06.135 INFO:tasks.rados.rados.0.smithi033.stdout:2190: copy_from oid 35 from oid 12 current snap is 217 2021-07-26T16:05:06.136 INFO:tasks.rados.rados.0.smithi033.stdout:2183: finishing write tid 1 to smithi03339061-17 2021-07-26T16:05:06.136 INFO:tasks.rados.rados.0.smithi033.stdout:2183: finishing write tid 2 to smithi03339061-17 2021-07-26T16:05:06.136 INFO:tasks.rados.rados.0.smithi033.stdout:2183: finishing write tid 3 to smithi03339061-17 2021-07-26T16:05:06.136 INFO:tasks.rados.rados.0.smithi033.stdout:2183: finishing write tid 4 to smithi03339061-17 2021-07-26T16:05:06.136 INFO:tasks.rados.rados.0.smithi033.stdout:2191: rollback oid 41 current snap is 217 2021-07-26T16:05:06.137 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 41 to 186 2021-07-26T16:05:06.137 INFO:tasks.rados.rados.0.smithi033.stdout:2182: expect (ObjNum 622 snap 194 seq_num 622) 2021-07-26T16:05:06.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:06 smithi033 bash[42377]: cluster 2021-07-26T16:05:05.098752+0000 mgr.y (mgr.34104) 334 : cluster [DBG] pgmap v565: 25 pgs: 25 active+clean; 339 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 370 KiB/s wr, 16 op/s 2021-07-26T16:05:06.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:06 smithi033 bash[42377]: cluster 2021-07-26T16:05:05.181348+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2021-07-26T16:05:06.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:06 smithi033 bash[42377]: cluster 2021-07-26T16:05:06.114418+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2021-07-26T16:05:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:06 smithi033 bash[41341]: cluster 2021-07-26T16:05:05.098752+0000 mgr.y (mgr.34104) 334 : cluster [DBG] pgmap v565: 25 pgs: 25 active+clean; 339 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 370 KiB/s wr, 16 op/s 2021-07-26T16:05:06.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:06 smithi033 bash[41341]: cluster 2021-07-26T16:05:05.181348+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2021-07-26T16:05:06.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:06 smithi033 bash[41341]: cluster 2021-07-26T16:05:06.114418+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2021-07-26T16:05:06.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:06 smithi096 bash[33981]: cluster 2021-07-26T16:05:05.098752+0000 mgr.y (mgr.34104) 334 : cluster [DBG] pgmap v565: 25 pgs: 25 active+clean; 339 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 8.8 MiB/s rd, 370 KiB/s wr, 16 op/s 2021-07-26T16:05:06.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:06 smithi096 bash[33981]: cluster 2021-07-26T16:05:05.181348+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e501: 8 total, 8 up, 8 in 2021-07-26T16:05:06.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:06 smithi096 bash[33981]: cluster 2021-07-26T16:05:06.114418+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e502: 8 total, 8 up, 8 in 2021-07-26T16:05:07.232 INFO:tasks.rados.rados.0.smithi033.stdout:2185: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:05:07.234 INFO:tasks.rados.rados.0.smithi033.stdout:2183: finishing write tid 5 to smithi03339061-17 2021-07-26T16:05:07.234 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 519 (ObjNum 665 snap 217 seq_num 665) dirty exists 2021-07-26T16:05:07.234 INFO:tasks.rados.rados.0.smithi033.stdout:2183: left oid 17 (ObjNum 665 snap 217 seq_num 665) 2021-07-26T16:05:07.235 INFO:tasks.rados.rados.0.smithi033.stdout:2187: finishing write tid 1 to smithi03339061-38 2021-07-26T16:05:07.235 INFO:tasks.rados.rados.0.smithi033.stdout:2187: finishing write tid 2 to smithi03339061-38 2021-07-26T16:05:07.235 INFO:tasks.rados.rados.0.smithi033.stdout:2187: finishing write tid 3 to smithi03339061-38 2021-07-26T16:05:07.235 INFO:tasks.rados.rados.0.smithi033.stdout:2187: finishing write tid 4 to smithi03339061-38 2021-07-26T16:05:07.235 INFO:tasks.rados.rados.0.smithi033.stdout:2187: finishing write tid 5 to smithi03339061-38 2021-07-26T16:05:07.236 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 713 (ObjNum 667 snap 217 seq_num 667) dirty exists 2021-07-26T16:05:07.236 INFO:tasks.rados.rados.0.smithi033.stdout:2187: left oid 38 (ObjNum 667 snap 217 seq_num 667) 2021-07-26T16:05:07.237 INFO:tasks.rados.rados.0.smithi033.stdout:2189: finishing write tid 1 to smithi03339061-13 2021-07-26T16:05:07.237 INFO:tasks.rados.rados.0.smithi033.stdout:2189: finishing write tid 2 to smithi03339061-13 2021-07-26T16:05:07.237 INFO:tasks.rados.rados.0.smithi033.stdout:2189: finishing write tid 3 to smithi03339061-13 2021-07-26T16:05:07.237 INFO:tasks.rados.rados.0.smithi033.stdout:2182: done (6 left) 2021-07-26T16:05:07.238 INFO:tasks.rados.rados.0.smithi033.stdout:2183: done (5 left) 2021-07-26T16:05:07.238 INFO:tasks.rados.rados.0.smithi033.stdout:2185: done (4 left) 2021-07-26T16:05:07.238 INFO:tasks.rados.rados.0.smithi033.stdout:2187: done (3 left) 2021-07-26T16:05:07.238 INFO:tasks.rados.rados.0.smithi033.stdout:2192: delete oid 24 current snap is 217 2021-07-26T16:05:07.239 INFO:tasks.rados.rados.0.smithi033.stdout:2189: finishing write tid 4 to smithi03339061-13 2021-07-26T16:05:07.239 INFO:tasks.rados.rados.0.smithi033.stdout:2191: finishing rollback tid 1 to smithi03339061-41 2021-07-26T16:05:07.239 INFO:tasks.rados.rados.0.smithi033.stdout:2191: finishing rollback tid 2 to smithi03339061-41 2021-07-26T16:05:07.239 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 872 (ObjNum 451 snap 139 seq_num 451) dirty exists 2021-07-26T16:05:07.240 INFO:tasks.rados.rados.0.smithi033.stdout:2189: finishing write tid 5 to smithi03339061-13 2021-07-26T16:05:07.240 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1070 (ObjNum 668 snap 217 seq_num 668) dirty exists 2021-07-26T16:05:07.240 INFO:tasks.rados.rados.0.smithi033.stdout:2189: left oid 13 (ObjNum 668 snap 217 seq_num 668) 2021-07-26T16:05:07.240 INFO:tasks.rados.rados.0.smithi033.stdout:2190: finishing copy_from to smithi03339061-35 2021-07-26T16:05:07.240 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 848 (ObjNum 597 snap 183 seq_num 597) dirty exists 2021-07-26T16:05:07.241 INFO:tasks.rados.rados.0.smithi033.stdout:2190: finishing copy_from racing read to smithi03339061-35 2021-07-26T16:05:07.241 INFO:tasks.rados.rados.0.smithi033.stdout:2189: done (3 left) 2021-07-26T16:05:07.242 INFO:tasks.rados.rados.0.smithi033.stdout:2190: done (2 left) 2021-07-26T16:05:07.242 INFO:tasks.rados.rados.0.smithi033.stdout:2191: done (1 left) 2021-07-26T16:05:07.242 INFO:tasks.rados.rados.0.smithi033.stdout:2192: done (0 left) 2021-07-26T16:05:07.242 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 217 2021-07-26T16:05:07.244 INFO:tasks.rados.rados.0.smithi033.stdout:2193: seq_num 670 ranges {0=425984,425984=483328,909312=507904,1417216=212992} 2021-07-26T16:05:07.248 INFO:tasks.rados.rados.0.smithi033.stdout:2193: writing smithi03339061-2 from 0 to 425984 tid 1 2021-07-26T16:05:07.251 INFO:tasks.rados.rados.0.smithi033.stdout:2193: writing smithi03339061-2 from 425984 to 909312 tid 2 2021-07-26T16:05:07.255 INFO:tasks.rados.rados.0.smithi033.stdout:2193: writing smithi03339061-2 from 909312 to 1417216 tid 3 2021-07-26T16:05:07.257 INFO:tasks.rados.rados.0.smithi033.stdout:2193: writing smithi03339061-2 from 1417216 to 1630208 tid 4 2021-07-26T16:05:07.257 INFO:tasks.rados.rados.0.smithi033.stdout:2194: copy_from oid 31 from oid 17 current snap is 217 2021-07-26T16:05:07.257 INFO:tasks.rados.rados.0.smithi033.stdout:2195: snap_remove snap 201 2021-07-26T16:05:08.194 INFO:tasks.rados.rados.0.smithi033.stdout:2195: done (2 left) 2021-07-26T16:05:08.194 INFO:tasks.rados.rados.0.smithi033.stdout:2196: read oid 34 snap -1 2021-07-26T16:05:08.195 INFO:tasks.rados.rados.0.smithi033.stdout:2196: expect (ObjNum 635 snap 201 seq_num 635) 2021-07-26T16:05:08.195 INFO:tasks.rados.rados.0.smithi033.stdout:2197: snap_remove snap 186 2021-07-26T16:05:08.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:08 smithi033 bash[41341]: cluster 2021-07-26T16:05:07.099407+0000 mgr.y (mgr.34104) 335 : cluster [DBG] pgmap v568: 25 pgs: 25 active+clean; 341 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 378 KiB/s wr, 3 op/s 2021-07-26T16:05:08.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:08 smithi033 bash[42377]: cluster 2021-07-26T16:05:07.099407+0000 mgr.y (mgr.34104) 335 : cluster [DBG] pgmap v568: 25 pgs: 25 active+clean; 341 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 378 KiB/s wr, 3 op/s 2021-07-26T16:05:08.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:08 smithi096 bash[33981]: cluster 2021-07-26T16:05:07.099407+0000 mgr.y (mgr.34104) 335 : cluster [DBG] pgmap v568: 25 pgs: 25 active+clean; 341 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 378 KiB/s wr, 3 op/s 2021-07-26T16:05:09.225 INFO:tasks.rados.rados.0.smithi033.stdout:2197: done (3 left) 2021-07-26T16:05:09.225 INFO:tasks.rados.rados.0.smithi033.stdout:2198: read oid 38 snap -1 2021-07-26T16:05:09.225 INFO:tasks.rados.rados.0.smithi033.stdout:2198: expect (ObjNum 667 snap 217 seq_num 667) 2021-07-26T16:05:09.226 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 217 2021-07-26T16:05:09.226 INFO:tasks.rados.rados.0.smithi033.stdout:2199: seq_num 671 ranges {2310144=442368,2752512=761856,3514368=442368} 2021-07-26T16:05:09.236 INFO:tasks.rados.rados.0.smithi033.stdout:2199: writing smithi03339061-36 from 2310144 to 2752512 tid 1 2021-07-26T16:05:09.242 INFO:tasks.rados.rados.0.smithi033.stdout:2199: writing smithi03339061-36 from 2752512 to 3514368 tid 2 2021-07-26T16:05:09.244 INFO:tasks.rados.rados.0.smithi033.stdout:2199: writing smithi03339061-36 from 3514368 to 3956736 tid 3 2021-07-26T16:05:09.253 INFO:tasks.rados.rados.0.smithi033.stdout:2193: finishing write tid 1 to smithi03339061-2 2021-07-26T16:05:09.253 INFO:tasks.rados.rados.0.smithi033.stdout:2193: finishing write tid 2 to smithi03339061-2 2021-07-26T16:05:09.253 INFO:tasks.rados.rados.0.smithi033.stdout:2193: finishing write tid 3 to smithi03339061-2 2021-07-26T16:05:09.253 INFO:tasks.rados.rados.0.smithi033.stdout:2193: finishing write tid 4 to smithi03339061-2 2021-07-26T16:05:09.254 INFO:tasks.rados.rados.0.smithi033.stdout:2193: finishing write tid 5 to smithi03339061-2 2021-07-26T16:05:09.254 INFO:tasks.rados.rados.0.smithi033.stdout:2193: finishing write tid 6 to smithi03339061-2 2021-07-26T16:05:09.254 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1215 (ObjNum 670 snap 217 seq_num 670) dirty exists 2021-07-26T16:05:09.254 INFO:tasks.rados.rados.0.smithi033.stdout:2193: left oid 2 (ObjNum 670 snap 217 seq_num 670) 2021-07-26T16:05:09.254 INFO:tasks.rados.rados.0.smithi033.stdout:2194: finishing copy_from to smithi03339061-31 2021-07-26T16:05:09.255 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 519 (ObjNum 665 snap 217 seq_num 665) dirty exists 2021-07-26T16:05:09.255 INFO:tasks.rados.rados.0.smithi033.stdout:2194: finishing copy_from racing read to smithi03339061-31 2021-07-26T16:05:09.255 INFO:tasks.rados.rados.0.smithi033.stdout:2196: expect (ObjNum 635 snap 201 seq_num 635) 2021-07-26T16:05:09.282 INFO:tasks.rados.rados.0.smithi033.stdout:2199: finishing write tid 1 to smithi03339061-36 2021-07-26T16:05:09.282 INFO:tasks.rados.rados.0.smithi033.stdout:2199: finishing write tid 2 to smithi03339061-36 2021-07-26T16:05:09.282 INFO:tasks.rados.rados.0.smithi033.stdout:2193: done (4 left) 2021-07-26T16:05:09.282 INFO:tasks.rados.rados.0.smithi033.stdout:2194: done (3 left) 2021-07-26T16:05:09.283 INFO:tasks.rados.rados.0.smithi033.stdout:2196: done (2 left) 2021-07-26T16:05:09.283 INFO:tasks.rados.rados.0.smithi033.stdout:2200: snap_create 2021-07-26T16:05:09.283 INFO:tasks.rados.rados.0.smithi033.stdout:2199: finishing write tid 3 to smithi03339061-36 2021-07-26T16:05:09.283 INFO:tasks.rados.rados.0.smithi033.stdout:2199: finishing write tid 4 to smithi03339061-36 2021-07-26T16:05:09.283 INFO:tasks.rados.rados.0.smithi033.stdout:2199: finishing write tid 5 to smithi03339061-36 2021-07-26T16:05:09.284 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 880 (ObjNum 671 snap 217 seq_num 671) dirty exists 2021-07-26T16:05:09.284 INFO:tasks.rados.rados.0.smithi033.stdout:2199: left oid 36 (ObjNum 671 snap 217 seq_num 671) 2021-07-26T16:05:09.284 INFO:tasks.rados.rados.0.smithi033.stdout:2198: expect (ObjNum 667 snap 217 seq_num 667) 2021-07-26T16:05:09.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:09 smithi033 bash[41341]: cluster 2021-07-26T16:05:08.188922+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2021-07-26T16:05:09.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:09 smithi033 bash[42377]: cluster 2021-07-26T16:05:08.188922+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2021-07-26T16:05:09.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:09 smithi096 bash[33981]: cluster 2021-07-26T16:05:08.188922+0000 mon.a (mon.0) 863 : cluster [DBG] osdmap e503: 8 total, 8 up, 8 in 2021-07-26T16:05:10.217 INFO:tasks.rados.rados.0.smithi033.stdout:2198: done (2 left) 2021-07-26T16:05:10.218 INFO:tasks.rados.rados.0.smithi033.stdout:2199: done (1 left) 2021-07-26T16:05:10.218 INFO:tasks.rados.rados.0.smithi033.stdout:2200: done (0 left) 2021-07-26T16:05:10.218 INFO:tasks.rados.rados.0.smithi033.stdout:2201: delete oid 42 current snap is 218 2021-07-26T16:05:10.227 INFO:tasks.rados.rados.0.smithi033.stdout:2201: done (0 left) 2021-07-26T16:05:10.228 INFO:tasks.rados.rados.0.smithi033.stdout:2202: snap_remove snap 217 2021-07-26T16:05:10.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:10 smithi096 bash[33981]: cluster 2021-07-26T16:05:09.100119+0000 mgr.y (mgr.34104) 336 : cluster [DBG] pgmap v570: 25 pgs: 25 active+clean; 331 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 619 KiB/s wr, 5 op/s 2021-07-26T16:05:10.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:10 smithi096 bash[33981]: cluster 2021-07-26T16:05:09.213098+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2021-07-26T16:05:10.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:10 smithi096 bash[33981]: audit 2021-07-26T16:05:09.229952+0000 mon.c (mon.1) 246 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:05:10.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:10 smithi096 bash[33981]: audit 2021-07-26T16:05:09.230717+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:05:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:10 smithi096 bash[33981]: audit 2021-07-26T16:05:09.237926+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:05:10.487 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:10 smithi096 bash[33981]: audit 2021-07-26T16:05:09.238573+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:05:10.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[41341]: cluster 2021-07-26T16:05:09.100119+0000 mgr.y (mgr.34104) 336 : cluster [DBG] pgmap v570: 25 pgs: 25 active+clean; 331 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 619 KiB/s wr, 5 op/s 2021-07-26T16:05:10.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[41341]: cluster 2021-07-26T16:05:09.213098+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2021-07-26T16:05:10.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[41341]: audit 2021-07-26T16:05:09.229952+0000 mon.c (mon.1) 246 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:05:10.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[41341]: audit 2021-07-26T16:05:09.230717+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:05:10.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[41341]: audit 2021-07-26T16:05:09.237926+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:05:10.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[41341]: audit 2021-07-26T16:05:09.238573+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:05:10.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[42377]: cluster 2021-07-26T16:05:09.100119+0000 mgr.y (mgr.34104) 336 : cluster [DBG] pgmap v570: 25 pgs: 25 active+clean; 331 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 619 KiB/s wr, 5 op/s 2021-07-26T16:05:10.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[42377]: cluster 2021-07-26T16:05:09.213098+0000 mon.a (mon.0) 864 : cluster [DBG] osdmap e504: 8 total, 8 up, 8 in 2021-07-26T16:05:10.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[42377]: audit 2021-07-26T16:05:09.229952+0000 mon.c (mon.1) 246 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:05:10.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[42377]: audit 2021-07-26T16:05:09.230717+0000 mon.a (mon.0) 865 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:05:10.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[42377]: audit 2021-07-26T16:05:09.237926+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:05:10.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:10 smithi033 bash[42377]: audit 2021-07-26T16:05:09.238573+0000 mon.a (mon.0) 866 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:05:11.120 INFO:tasks.rados.rados.0.smithi033.stdout:2202: done (0 left) 2021-07-26T16:05:11.120 INFO:tasks.rados.rados.0.smithi033.stdout:2203: read oid 23 snap -1 2021-07-26T16:05:11.120 INFO:tasks.rados.rados.0.smithi033.stdout:2203: expect deleted 2021-07-26T16:05:11.121 INFO:tasks.rados.rados.0.smithi033.stdout:2204: read oid 13 snap -1 2021-07-26T16:05:11.121 INFO:tasks.rados.rados.0.smithi033.stdout:2204: expect (ObjNum 668 snap 217 seq_num 668) 2021-07-26T16:05:11.121 INFO:tasks.rados.rados.0.smithi033.stdout:2205: snap_create 2021-07-26T16:05:11.136 INFO:tasks.rados.rados.0.smithi033.stdout:2204: expect (ObjNum 668 snap 217 seq_num 668) 2021-07-26T16:05:11.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:11 smithi096 bash[33981]: cluster 2021-07-26T16:05:10.214233+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2021-07-26T16:05:11.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:11 smithi096 bash[33981]: cluster 2021-07-26T16:05:11.115913+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2021-07-26T16:05:11.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:11 smithi033 bash[41341]: cluster 2021-07-26T16:05:10.214233+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2021-07-26T16:05:11.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:11 smithi033 bash[41341]: cluster 2021-07-26T16:05:11.115913+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2021-07-26T16:05:11.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:11 smithi033 bash[42377]: cluster 2021-07-26T16:05:10.214233+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e505: 8 total, 8 up, 8 in 2021-07-26T16:05:11.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:11 smithi033 bash[42377]: cluster 2021-07-26T16:05:11.115913+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e506: 8 total, 8 up, 8 in 2021-07-26T16:05:12.131 INFO:tasks.rados.rados.0.smithi033.stdout:2203: done (2 left) 2021-07-26T16:05:12.132 INFO:tasks.rados.rados.0.smithi033.stdout:2204: done (1 left) 2021-07-26T16:05:12.132 INFO:tasks.rados.rados.0.smithi033.stdout:2205: done (0 left) 2021-07-26T16:05:12.132 INFO:tasks.rados.rados.0.smithi033.stdout:2206: copy_from oid 44 from oid 8 current snap is 219 2021-07-26T16:05:12.132 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 219 2021-07-26T16:05:12.133 INFO:tasks.rados.rados.0.smithi033.stdout:2207: seq_num 673 ranges {401408=475136,876544=532480,1409024=671744} 2021-07-26T16:05:12.139 INFO:tasks.rados.rados.0.smithi033.stdout:2207: writing smithi03339061-35 from 401408 to 876544 tid 1 2021-07-26T16:05:12.143 INFO:tasks.rados.rados.0.smithi033.stdout:2207: writing smithi03339061-35 from 876544 to 1409024 tid 2 2021-07-26T16:05:12.148 INFO:tasks.rados.rados.0.smithi033.stdout:2207: writing smithi03339061-35 from 1409024 to 2080768 tid 3 2021-07-26T16:05:12.148 INFO:tasks.rados.rados.0.smithi033.stdout:2208: read oid 11 snap -1 2021-07-26T16:05:12.149 INFO:tasks.rados.rados.0.smithi033.stdout:2208: expect (ObjNum 662 snap 215 seq_num 662) 2021-07-26T16:05:12.149 INFO:tasks.rados.rados.0.smithi033.stdout:2209: snap_create 2021-07-26T16:05:12.149 INFO:tasks.rados.rados.0.smithi033.stdout:2207: finishing write tid 1 to smithi03339061-35 2021-07-26T16:05:12.150 INFO:tasks.rados.rados.0.smithi033.stdout:2206: finishing copy_from to smithi03339061-44 2021-07-26T16:05:12.150 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 843 (ObjNum 570 snap 177 seq_num 570) dirty exists 2021-07-26T16:05:12.151 INFO:tasks.rados.rados.0.smithi033.stdout:2207: finishing write tid 2 to smithi03339061-35 2021-07-26T16:05:12.151 INFO:tasks.rados.rados.0.smithi033.stdout:2206: finishing copy_from racing read to smithi03339061-44 2021-07-26T16:05:12.157 INFO:tasks.rados.rados.0.smithi033.stdout:2207: finishing write tid 3 to smithi03339061-35 2021-07-26T16:05:12.157 INFO:tasks.rados.rados.0.smithi033.stdout:2207: finishing write tid 4 to smithi03339061-35 2021-07-26T16:05:12.159 INFO:tasks.rados.rados.0.smithi033.stdout:2207: finishing write tid 5 to smithi03339061-35 2021-07-26T16:05:12.159 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 861 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:05:12.159 INFO:tasks.rados.rados.0.smithi033.stdout:2207: left oid 35 (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:05:12.214 INFO:tasks.rados.rados.0.smithi033.stdout:2208: expect (ObjNum 662 snap 215 seq_num 662) 2021-07-26T16:05:12.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:12 smithi096 bash[33981]: cluster 2021-07-26T16:05:11.100880+0000 mgr.y (mgr.34104) 337 : cluster [DBG] pgmap v573: 25 pgs: 25 active+clean; 310 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 9 op/s 2021-07-26T16:05:12.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:12 smithi096 bash[33981]: cluster 2021-07-26T16:05:12.127627+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2021-07-26T16:05:12.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:12 smithi033 bash[42377]: cluster 2021-07-26T16:05:11.100880+0000 mgr.y (mgr.34104) 337 : cluster [DBG] pgmap v573: 25 pgs: 25 active+clean; 310 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 9 op/s 2021-07-26T16:05:12.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:12 smithi033 bash[42377]: cluster 2021-07-26T16:05:12.127627+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2021-07-26T16:05:12.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:12 smithi033 bash[41341]: cluster 2021-07-26T16:05:11.100880+0000 mgr.y (mgr.34104) 337 : cluster [DBG] pgmap v573: 25 pgs: 25 active+clean; 310 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 2.1 MiB/s wr, 9 op/s 2021-07-26T16:05:12.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:12 smithi033 bash[41341]: cluster 2021-07-26T16:05:12.127627+0000 mon.a (mon.0) 869 : cluster [DBG] osdmap e507: 8 total, 8 up, 8 in 2021-07-26T16:05:13.497 INFO:tasks.rados.rados.0.smithi033.stdout:2206: done (3 left) 2021-07-26T16:05:13.497 INFO:tasks.rados.rados.0.smithi033.stdout:2207: done (2 left) 2021-07-26T16:05:13.498 INFO:tasks.rados.rados.0.smithi033.stdout:2208: done (1 left) 2021-07-26T16:05:13.498 INFO:tasks.rados.rados.0.smithi033.stdout:2209: done (0 left) 2021-07-26T16:05:13.498 INFO:tasks.rados.rados.0.smithi033.stdout:2210: setattr oid 44 current snap is 220 2021-07-26T16:05:13.501 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 220 2021-07-26T16:05:13.501 INFO:tasks.rados.rados.0.smithi033.stdout:2211: seq_num 674 ranges {15368192=491520,15859712=417792,16277504=483328,16760832=303104} 2021-07-26T16:05:13.595 INFO:tasks.rados.rados.0.smithi033.stdout:2211: writing smithi03339061-32 from 15368192 to 15859712 tid 1 2021-07-26T16:05:13.598 INFO:tasks.rados.rados.0.smithi033.stdout:2211: writing smithi03339061-32 from 15859712 to 16277504 tid 2 2021-07-26T16:05:13.601 INFO:tasks.rados.rados.0.smithi033.stdout:2211: writing smithi03339061-32 from 16277504 to 16760832 tid 3 2021-07-26T16:05:13.603 INFO:tasks.rados.rados.0.smithi033.stdout:2211: writing smithi03339061-32 from 16760832 to 17063936 tid 4 2021-07-26T16:05:13.603 INFO:tasks.rados.rados.0.smithi033.stdout:2212: delete oid 1 current snap is 220 2021-07-26T16:05:13.604 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1071 (ObjNum 570 snap 177 seq_num 570) dirty exists 2021-07-26T16:05:13.606 INFO:tasks.rados.rados.0.smithi033.stdout:2211: finishing write tid 1 to smithi03339061-32 2021-07-26T16:05:13.608 INFO:tasks.rados.rados.0.smithi033.stdout:2211: finishing write tid 2 to smithi03339061-32 2021-07-26T16:05:13.608 INFO:tasks.rados.rados.0.smithi033.stdout:2211: finishing write tid 3 to smithi03339061-32 2021-07-26T16:05:13.609 INFO:tasks.rados.rados.0.smithi033.stdout:2210: done (2 left) 2021-07-26T16:05:13.609 INFO:tasks.rados.rados.0.smithi033.stdout:2212: done (1 left) 2021-07-26T16:05:13.610 INFO:tasks.rados.rados.0.smithi033.stdout:2213: setattr oid 23 current snap is 220 2021-07-26T16:05:13.610 INFO:tasks.rados.rados.0.smithi033.stdout:2211: finishing write tid 4 to smithi03339061-32 2021-07-26T16:05:13.611 INFO:tasks.rados.rados.0.smithi033.stdout:2214: copy_from oid 3 from oid 8 current snap is 220 2021-07-26T16:05:13.611 INFO:tasks.rados.rados.0.smithi033.stdout:2215: read oid 39 snap -1 2021-07-26T16:05:13.612 INFO:tasks.rados.rados.0.smithi033.stdout:2215: expect (ObjNum 663 snap 215 seq_num 663) 2021-07-26T16:05:13.612 INFO:tasks.rados.rados.0.smithi033.stdout:2216: read oid 30 snap 207 2021-07-26T16:05:13.612 INFO:tasks.rados.rados.0.smithi033.stdout:2216: expect (ObjNum 649 snap 206 seq_num 649) 2021-07-26T16:05:13.612 INFO:tasks.rados.rados.0.smithi033.stdout:2217: rmattr oid 45 current snap is 220 2021-07-26T16:05:13.612 INFO:tasks.rados.rados.0.smithi033.stdout:2218: snap_create 2021-07-26T16:05:13.613 INFO:tasks.rados.rados.0.smithi033.stdout:2211: finishing write tid 5 to smithi03339061-32 2021-07-26T16:05:13.615 INFO:tasks.rados.rados.0.smithi033.stdout:2211: finishing write tid 6 to smithi03339061-32 2021-07-26T16:05:13.615 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 838 (ObjNum 674 snap 220 seq_num 674) dirty exists 2021-07-26T16:05:13.615 INFO:tasks.rados.rados.0.smithi033.stdout:2211: left oid 32 (ObjNum 674 snap 220 seq_num 674) 2021-07-26T16:05:13.617 INFO:tasks.rados.rados.0.smithi033.stdout:2216: expect (ObjNum 649 snap 206 seq_num 649) 2021-07-26T16:05:13.659 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1347 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:05:13.660 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1081 (ObjNum 2004939360 snap 22002 seq_num 603982032) dirty exists 2021-07-26T16:05:13.660 INFO:tasks.rados.rados.0.smithi033.stdout:2215: expect (ObjNum 663 snap 215 seq_num 663) 2021-07-26T16:05:13.700 INFO:tasks.rados.rados.0.smithi033.stdout:2214: finishing copy_from to smithi03339061-3 2021-07-26T16:05:13.701 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 843 (ObjNum 570 snap 177 seq_num 570) dirty exists 2021-07-26T16:05:13.701 INFO:tasks.rados.rados.0.smithi033.stdout:2214: finishing copy_from racing read to smithi03339061-3 2021-07-26T16:05:13.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:13.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:13.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:13.510Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:13.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:13.510Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:05:14.244 INFO:tasks.rados.rados.0.smithi033.stdout:2211: done (6 left) 2021-07-26T16:05:14.244 INFO:tasks.rados.rados.0.smithi033.stdout:2213: done (5 left) 2021-07-26T16:05:14.244 INFO:tasks.rados.rados.0.smithi033.stdout:2214: done (4 left) 2021-07-26T16:05:14.244 INFO:tasks.rados.rados.0.smithi033.stdout:2215: done (3 left) 2021-07-26T16:05:14.245 INFO:tasks.rados.rados.0.smithi033.stdout:2216: done (2 left) 2021-07-26T16:05:14.245 INFO:tasks.rados.rados.0.smithi033.stdout:2217: done (1 left) 2021-07-26T16:05:14.245 INFO:tasks.rados.rados.0.smithi033.stdout:2218: done (0 left) 2021-07-26T16:05:14.245 INFO:tasks.rados.rados.0.smithi033.stdout:2219: snap_remove snap 220 2021-07-26T16:05:14.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:14 smithi033 bash[41341]: cluster 2021-07-26T16:05:13.101565+0000 mgr.y (mgr.34104) 338 : cluster [DBG] pgmap v576: 25 pgs: 25 active+clean; 249 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.3 MiB/s wr, 7 op/s 2021-07-26T16:05:14.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:14 smithi033 bash[41341]: cluster 2021-07-26T16:05:13.129343+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2021-07-26T16:05:14.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:14 smithi033 bash[42377]: cluster 2021-07-26T16:05:13.101565+0000 mgr.y (mgr.34104) 338 : cluster [DBG] pgmap v576: 25 pgs: 25 active+clean; 249 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.3 MiB/s wr, 7 op/s 2021-07-26T16:05:14.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:14 smithi033 bash[42377]: cluster 2021-07-26T16:05:13.129343+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2021-07-26T16:05:14.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:14 smithi096 bash[33981]: cluster 2021-07-26T16:05:13.101565+0000 mgr.y (mgr.34104) 338 : cluster [DBG] pgmap v576: 25 pgs: 25 active+clean; 249 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 7.1 MiB/s rd, 2.3 MiB/s wr, 7 op/s 2021-07-26T16:05:14.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:14 smithi096 bash[33981]: cluster 2021-07-26T16:05:13.129343+0000 mon.a (mon.0) 870 : cluster [DBG] osdmap e508: 8 total, 8 up, 8 in 2021-07-26T16:05:15.253 INFO:tasks.rados.rados.0.smithi033.stdout:2219: done (0 left) 2021-07-26T16:05:15.254 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 221 2021-07-26T16:05:15.254 INFO:tasks.rados.rados.0.smithi033.stdout:2220: seq_num 676 ranges {17063936=524288,17588224=589824,18178048=450560,18628608=163840} 2021-07-26T16:05:15.356 INFO:tasks.rados.rados.0.smithi033.stdout:2220: writing smithi03339061-32 from 17063936 to 17588224 tid 1 2021-07-26T16:05:15.359 INFO:tasks.rados.rados.0.smithi033.stdout:2220: writing smithi03339061-32 from 17588224 to 18178048 tid 2 2021-07-26T16:05:15.363 INFO:tasks.rados.rados.0.smithi033.stdout:2220: writing smithi03339061-32 from 18178048 to 18628608 tid 3 2021-07-26T16:05:15.364 INFO:tasks.rados.rados.0.smithi033.stdout:2220: writing smithi03339061-32 from 18628608 to 18792448 tid 4 2021-07-26T16:05:15.364 INFO:tasks.rados.rados.0.smithi033.stdout:2221: snap_remove snap 206 2021-07-26T16:05:15.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:15 smithi033 bash[41341]: cluster 2021-07-26T16:05:14.237993+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2021-07-26T16:05:15.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:15 smithi033 bash[42377]: cluster 2021-07-26T16:05:14.237993+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2021-07-26T16:05:15.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:15 smithi096 bash[33981]: cluster 2021-07-26T16:05:14.237993+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e509: 8 total, 8 up, 8 in 2021-07-26T16:05:16.124 INFO:tasks.rados.rados.0.smithi033.stdout:2220: finishing write tid 1 to smithi03339061-32 2021-07-26T16:05:16.124 INFO:tasks.rados.rados.0.smithi033.stdout:2220: finishing write tid 2 to smithi03339061-32 2021-07-26T16:05:16.124 INFO:tasks.rados.rados.0.smithi033.stdout:2220: finishing write tid 3 to smithi03339061-32 2021-07-26T16:05:16.125 INFO:tasks.rados.rados.0.smithi033.stdout:2220: finishing write tid 4 to smithi03339061-32 2021-07-26T16:05:16.125 INFO:tasks.rados.rados.0.smithi033.stdout:2220: finishing write tid 5 to smithi03339061-32 2021-07-26T16:05:16.125 INFO:tasks.rados.rados.0.smithi033.stdout:2220: finishing write tid 6 to smithi03339061-32 2021-07-26T16:05:16.125 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 843 (ObjNum 676 snap 221 seq_num 676) dirty exists 2021-07-26T16:05:16.126 INFO:tasks.rados.rados.0.smithi033.stdout:2220: left oid 32 (ObjNum 676 snap 221 seq_num 676) 2021-07-26T16:05:16.126 INFO:tasks.rados.rados.0.smithi033.stdout:2220: done (1 left) 2021-07-26T16:05:16.126 INFO:tasks.rados.rados.0.smithi033.stdout:2221: done (0 left) 2021-07-26T16:05:16.126 INFO:tasks.rados.rados.0.smithi033.stdout:2222: copy_from oid 16 from oid 18 current snap is 221 2021-07-26T16:05:16.126 INFO:tasks.rados.rados.0.smithi033.stdout:2223: read oid 42 snap 218 2021-07-26T16:05:16.127 INFO:tasks.rados.rados.0.smithi033.stdout:2223: expect deleted 2021-07-26T16:05:16.127 INFO:tasks.rados.rados.0.smithi033.stdout:2224: copy_from oid 10 from oid 28 current snap is 221 2021-07-26T16:05:16.127 INFO:tasks.rados.rados.0.smithi033.stdout:2225: rmattr oid 37 current snap is 221 2021-07-26T16:05:16.127 INFO:tasks.rados.rados.0.smithi033.stdout:2225: done (3 left) 2021-07-26T16:05:16.128 INFO:tasks.rados.rados.0.smithi033.stdout:2226: rmattr oid 22 current snap is 221 2021-07-26T16:05:16.128 INFO:tasks.rados.rados.0.smithi033.stdout:2226: done (3 left) 2021-07-26T16:05:16.128 INFO:tasks.rados.rados.0.smithi033.stdout:2227: snap_create 2021-07-26T16:05:16.152 INFO:tasks.rados.rados.0.smithi033.stdout:2222: finishing copy_from to smithi03339061-16 2021-07-26T16:05:16.152 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1245 (ObjNum 2007424064 snap 22002 seq_num 1058724992) dirty exists 2021-07-26T16:05:16.153 INFO:tasks.rados.rados.0.smithi033.stdout:2222: finishing copy_from racing read to smithi03339061-16 2021-07-26T16:05:16.183 INFO:tasks.rados.rados.0.smithi033.stdout:2224: finishing copy_from to smithi03339061-10 2021-07-26T16:05:16.184 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 809 (ObjNum 556 snap 175 seq_num 556) dirty exists 2021-07-26T16:05:16.184 INFO:tasks.rados.rados.0.smithi033.stdout:2224: finishing copy_from racing read to smithi03339061-10 2021-07-26T16:05:16.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:16 smithi033 bash[41341]: cluster 2021-07-26T16:05:15.102282+0000 mgr.y (mgr.34104) 339 : cluster [DBG] pgmap v579: 25 pgs: 25 active+clean; 242 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1 op/s 2021-07-26T16:05:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:16 smithi033 bash[41341]: cluster 2021-07-26T16:05:15.250228+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2021-07-26T16:05:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:16 smithi033 bash[41341]: cluster 2021-07-26T16:05:16.118907+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2021-07-26T16:05:16.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:16 smithi033 bash[42377]: cluster 2021-07-26T16:05:15.102282+0000 mgr.y (mgr.34104) 339 : cluster [DBG] pgmap v579: 25 pgs: 25 active+clean; 242 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1 op/s 2021-07-26T16:05:16.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:16 smithi033 bash[42377]: cluster 2021-07-26T16:05:15.250228+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2021-07-26T16:05:16.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:16 smithi033 bash[42377]: cluster 2021-07-26T16:05:16.118907+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2021-07-26T16:05:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:16 smithi096 bash[33981]: cluster 2021-07-26T16:05:15.102282+0000 mgr.y (mgr.34104) 339 : cluster [DBG] pgmap v579: 25 pgs: 25 active+clean; 242 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 15 MiB/s rd, 1 op/s 2021-07-26T16:05:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:16 smithi096 bash[33981]: cluster 2021-07-26T16:05:15.250228+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e510: 8 total, 8 up, 8 in 2021-07-26T16:05:16.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:16 smithi096 bash[33981]: cluster 2021-07-26T16:05:16.118907+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e511: 8 total, 8 up, 8 in 2021-07-26T16:05:17.135 INFO:tasks.rados.rados.0.smithi033.stdout:2222: done (3 left) 2021-07-26T16:05:17.135 INFO:tasks.rados.rados.0.smithi033.stdout:2223: done (2 left) 2021-07-26T16:05:17.136 INFO:tasks.rados.rados.0.smithi033.stdout:2224: done (1 left) 2021-07-26T16:05:17.136 INFO:tasks.rados.rados.0.smithi033.stdout:2227: done (0 left) 2021-07-26T16:05:17.136 INFO:tasks.rados.rados.0.smithi033.stdout:2228: read oid 19 snap -1 2021-07-26T16:05:17.136 INFO:tasks.rados.rados.0.smithi033.stdout:2228: expect (ObjNum 643 snap 204 seq_num 643) 2021-07-26T16:05:17.136 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 222 2021-07-26T16:05:17.137 INFO:tasks.rados.rados.0.smithi033.stdout:2229: seq_num 677 ranges {958464=540672,1499136=516096,2015232=655360,2670592=32768} 2021-07-26T16:05:17.147 INFO:tasks.rados.rados.0.smithi033.stdout:2229: writing smithi03339061-41 from 958464 to 1499136 tid 1 2021-07-26T16:05:17.150 INFO:tasks.rados.rados.0.smithi033.stdout:2229: writing smithi03339061-41 from 1499136 to 2015232 tid 2 2021-07-26T16:05:17.154 INFO:tasks.rados.rados.0.smithi033.stdout:2229: writing smithi03339061-41 from 2015232 to 2670592 tid 3 2021-07-26T16:05:17.155 INFO:tasks.rados.rados.0.smithi033.stdout:2229: writing smithi03339061-41 from 2670592 to 2703360 tid 4 2021-07-26T16:05:17.155 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 222 2021-07-26T16:05:17.155 INFO:tasks.rados.rados.0.smithi033.stdout:2230: seq_num 678 ranges {10657792=565248,11223040=802816,12025856=401408} 2021-07-26T16:05:17.218 INFO:tasks.rados.rados.0.smithi033.stdout:2230: writing smithi03339061-7 from 10657792 to 11223040 tid 1 2021-07-26T16:05:17.222 INFO:tasks.rados.rados.0.smithi033.stdout:2230: writing smithi03339061-7 from 11223040 to 12025856 tid 2 2021-07-26T16:05:17.224 INFO:tasks.rados.rados.0.smithi033.stdout:2230: writing smithi03339061-7 from 12025856 to 12427264 tid 3 2021-07-26T16:05:17.225 INFO:tasks.rados.rados.0.smithi033.stdout:2231: snap_create 2021-07-26T16:05:17.225 INFO:tasks.rados.rados.0.smithi033.stdout:2228: expect (ObjNum 643 snap 204 seq_num 643) 2021-07-26T16:05:17.266 INFO:tasks.rados.rados.0.smithi033.stdout:2229: finishing write tid 1 to smithi03339061-41 2021-07-26T16:05:17.266 INFO:tasks.rados.rados.0.smithi033.stdout:2229: finishing write tid 2 to smithi03339061-41 2021-07-26T16:05:17.267 INFO:tasks.rados.rados.0.smithi033.stdout:2229: finishing write tid 3 to smithi03339061-41 2021-07-26T16:05:17.267 INFO:tasks.rados.rados.0.smithi033.stdout:2229: finishing write tid 4 to smithi03339061-41 2021-07-26T16:05:17.267 INFO:tasks.rados.rados.0.smithi033.stdout:2229: finishing write tid 5 to smithi03339061-41 2021-07-26T16:05:17.267 INFO:tasks.rados.rados.0.smithi033.stdout:2229: finishing write tid 6 to smithi03339061-41 2021-07-26T16:05:17.268 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 877 (ObjNum 677 snap 222 seq_num 677) dirty exists 2021-07-26T16:05:17.268 INFO:tasks.rados.rados.0.smithi033.stdout:2229: left oid 41 (ObjNum 677 snap 222 seq_num 677) 2021-07-26T16:05:17.268 INFO:tasks.rados.rados.0.smithi033.stdout:2230: finishing write tid 1 to smithi03339061-7 2021-07-26T16:05:17.268 INFO:tasks.rados.rados.0.smithi033.stdout:2230: finishing write tid 2 to smithi03339061-7 2021-07-26T16:05:17.269 INFO:tasks.rados.rados.0.smithi033.stdout:2230: finishing write tid 3 to smithi03339061-7 2021-07-26T16:05:17.269 INFO:tasks.rados.rados.0.smithi033.stdout:2230: finishing write tid 4 to smithi03339061-7 2021-07-26T16:05:17.269 INFO:tasks.rados.rados.0.smithi033.stdout:2230: finishing write tid 5 to smithi03339061-7 2021-07-26T16:05:17.269 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1085 (ObjNum 678 snap 222 seq_num 678) dirty exists 2021-07-26T16:05:17.269 INFO:tasks.rados.rados.0.smithi033.stdout:2230: left oid 7 (ObjNum 678 snap 222 seq_num 678) 2021-07-26T16:05:18.144 INFO:tasks.rados.rados.0.smithi033.stdout:2228: done (3 left) 2021-07-26T16:05:18.144 INFO:tasks.rados.rados.0.smithi033.stdout:2229: done (2 left) 2021-07-26T16:05:18.145 INFO:tasks.rados.rados.0.smithi033.stdout:2230: done (1 left) 2021-07-26T16:05:18.145 INFO:tasks.rados.rados.0.smithi033.stdout:2231: done (0 left) 2021-07-26T16:05:18.145 INFO:tasks.rados.rados.0.smithi033.stdout:2232: read oid 29 snap -1 2021-07-26T16:05:18.145 INFO:tasks.rados.rados.0.smithi033.stdout:2232: expect deleted 2021-07-26T16:05:18.146 INFO:tasks.rados.rados.0.smithi033.stdout:2233: snap_create 2021-07-26T16:05:18.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:18 smithi033 bash[41341]: cluster 2021-07-26T16:05:17.103008+0000 mgr.y (mgr.34104) 340 : cluster [DBG] pgmap v582: 25 pgs: 25 active+clean; 252 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2021-07-26T16:05:18.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:18 smithi033 bash[41341]: cluster 2021-07-26T16:05:17.130834+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2021-07-26T16:05:18.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:18 smithi033 bash[42377]: cluster 2021-07-26T16:05:17.103008+0000 mgr.y (mgr.34104) 340 : cluster [DBG] pgmap v582: 25 pgs: 25 active+clean; 252 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2021-07-26T16:05:18.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:18 smithi033 bash[42377]: cluster 2021-07-26T16:05:17.130834+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2021-07-26T16:05:18.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:18 smithi096 bash[33981]: cluster 2021-07-26T16:05:17.103008+0000 mgr.y (mgr.34104) 340 : cluster [DBG] pgmap v582: 25 pgs: 25 active+clean; 252 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.3 MiB/s wr, 12 op/s 2021-07-26T16:05:18.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:18 smithi096 bash[33981]: cluster 2021-07-26T16:05:17.130834+0000 mon.a (mon.0) 874 : cluster [DBG] osdmap e512: 8 total, 8 up, 8 in 2021-07-26T16:05:19.149 INFO:tasks.rados.rados.0.smithi033.stdout:2232: done (1 left) 2021-07-26T16:05:19.149 INFO:tasks.rados.rados.0.smithi033.stdout:2233: done (0 left) 2021-07-26T16:05:19.150 INFO:tasks.rados.rados.0.smithi033.stdout:2234: delete oid 3 current snap is 224 2021-07-26T16:05:19.158 INFO:tasks.rados.rados.0.smithi033.stdout:2234: done (0 left) 2021-07-26T16:05:19.158 INFO:tasks.rados.rados.0.smithi033.stdout:2235: read oid 38 snap -1 2021-07-26T16:05:19.159 INFO:tasks.rados.rados.0.smithi033.stdout:2235: expect (ObjNum 667 snap 217 seq_num 667) 2021-07-26T16:05:19.159 INFO:tasks.rados.rados.0.smithi033.stdout:2236: read oid 30 snap -1 2021-07-26T16:05:19.159 INFO:tasks.rados.rados.0.smithi033.stdout:2236: expect (ObjNum 658 snap 213 seq_num 658) 2021-07-26T16:05:19.159 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 224 2021-07-26T16:05:19.160 INFO:tasks.rados.rados.0.smithi033.stdout:2237: seq_num 680 ranges {9928704=598016,10526720=573440,11100160=434176,11534336=196608} 2021-07-26T16:05:19.223 INFO:tasks.rados.rados.0.smithi033.stdout:2237: writing smithi03339061-50 from 9928704 to 10526720 tid 1 2021-07-26T16:05:19.226 INFO:tasks.rados.rados.0.smithi033.stdout:2237: writing smithi03339061-50 from 10526720 to 11100160 tid 2 2021-07-26T16:05:19.229 INFO:tasks.rados.rados.0.smithi033.stdout:2237: writing smithi03339061-50 from 11100160 to 11534336 tid 3 2021-07-26T16:05:19.230 INFO:tasks.rados.rados.0.smithi033.stdout:2237: writing smithi03339061-50 from 11534336 to 11730944 tid 4 2021-07-26T16:05:19.231 INFO:tasks.rados.rados.0.smithi033.stdout:2238: read oid 3 snap -1 2021-07-26T16:05:19.231 INFO:tasks.rados.rados.0.smithi033.stdout:2238: expect deleted 2021-07-26T16:05:19.231 INFO:tasks.rados.rados.0.smithi033.stdout:2239: snap_create 2021-07-26T16:05:19.231 INFO:tasks.rados.rados.0.smithi033.stdout:2236: expect (ObjNum 658 snap 213 seq_num 658) 2021-07-26T16:05:19.332 INFO:tasks.rados.rados.0.smithi033.stdout:2235: expect (ObjNum 667 snap 217 seq_num 667) 2021-07-26T16:05:19.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:19 smithi033 bash[42377]: cluster 2021-07-26T16:05:18.140887+0000 mon.a (mon.0) 875 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2021-07-26T16:05:19.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:19 smithi033 bash[41341]: cluster 2021-07-26T16:05:18.140887+0000 mon.a (mon.0) 875 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2021-07-26T16:05:19.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:19 smithi096 bash[33981]: cluster 2021-07-26T16:05:18.140887+0000 mon.a (mon.0) 875 : cluster [DBG] osdmap e513: 8 total, 8 up, 8 in 2021-07-26T16:05:20.054 INFO:tasks.rados.rados.0.smithi033.stdout:2237: finishing write tid 1 to smithi03339061-50 2021-07-26T16:05:20.055 INFO:tasks.rados.rados.0.smithi033.stdout:2237: finishing write tid 2 to smithi03339061-50 2021-07-26T16:05:20.055 INFO:tasks.rados.rados.0.smithi033.stdout:2237: finishing write tid 3 to smithi03339061-50 2021-07-26T16:05:20.055 INFO:tasks.rados.rados.0.smithi033.stdout:2237: finishing write tid 4 to smithi03339061-50 2021-07-26T16:05:20.056 INFO:tasks.rados.rados.0.smithi033.stdout:2237: finishing write tid 5 to smithi03339061-50 2021-07-26T16:05:20.056 INFO:tasks.rados.rados.0.smithi033.stdout:2237: finishing write tid 6 to smithi03339061-50 2021-07-26T16:05:20.057 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1250 (ObjNum 680 snap 224 seq_num 680) dirty exists 2021-07-26T16:05:20.057 INFO:tasks.rados.rados.0.smithi033.stdout:2237: left oid 50 (ObjNum 680 snap 224 seq_num 680) 2021-07-26T16:05:20.165 INFO:tasks.rados.rados.0.smithi033.stdout:2235: done (4 left) 2021-07-26T16:05:20.166 INFO:tasks.rados.rados.0.smithi033.stdout:2236: done (3 left) 2021-07-26T16:05:20.166 INFO:tasks.rados.rados.0.smithi033.stdout:2237: done (2 left) 2021-07-26T16:05:20.166 INFO:tasks.rados.rados.0.smithi033.stdout:2238: done (1 left) 2021-07-26T16:05:20.166 INFO:tasks.rados.rados.0.smithi033.stdout:2239: done (0 left) 2021-07-26T16:05:20.167 INFO:tasks.rados.rados.0.smithi033.stdout:2240: rmattr oid 7 current snap is 225 2021-07-26T16:05:20.167 INFO:tasks.rados.rados.0.smithi033.stdout:2241: read oid 45 snap -1 2021-07-26T16:05:20.168 INFO:tasks.rados.rados.0.smithi033.stdout:2241: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:05:20.168 INFO:tasks.rados.rados.0.smithi033.stdout:2242: read oid 15 snap -1 2021-07-26T16:05:20.168 INFO:tasks.rados.rados.0.smithi033.stdout:2242: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:05:20.168 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 225 2021-07-26T16:05:20.168 INFO:tasks.rados.rados.0.smithi033.stdout:2243: seq_num 681 ranges {1146880=614400,1761280=458752,2220032=638976,2859008=106496} 2021-07-26T16:05:20.179 INFO:tasks.rados.rados.0.smithi033.stdout:2243: writing smithi03339061-43 from 1146880 to 1761280 tid 1 2021-07-26T16:05:20.180 INFO:tasks.rados.rados.0.smithi033.stdout:2243: writing smithi03339061-43 from 1761280 to 2220032 tid 2 2021-07-26T16:05:20.184 INFO:tasks.rados.rados.0.smithi033.stdout:2243: writing smithi03339061-43 from 2220032 to 2859008 tid 3 2021-07-26T16:05:20.186 INFO:tasks.rados.rados.0.smithi033.stdout:2243: writing smithi03339061-43 from 2859008 to 2965504 tid 4 2021-07-26T16:05:20.186 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 225 2021-07-26T16:05:20.187 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1086 (ObjNum 678 snap 222 seq_num 678) dirty exists 2021-07-26T16:05:20.187 INFO:tasks.rados.rados.0.smithi033.stdout:2244: seq_num 682 ranges {0=630784,630784=745472,1376256=442368,1818624=16384} 2021-07-26T16:05:20.188 INFO:tasks.rados.rados.0.smithi033.stdout:2244: writing smithi03339061-25 from 0 to 630784 tid 1 2021-07-26T16:05:20.193 INFO:tasks.rados.rados.0.smithi033.stdout:2244: writing smithi03339061-25 from 630784 to 1376256 tid 2 2021-07-26T16:05:20.196 INFO:tasks.rados.rados.0.smithi033.stdout:2244: writing smithi03339061-25 from 1376256 to 1818624 tid 3 2021-07-26T16:05:20.196 INFO:tasks.rados.rados.0.smithi033.stdout:2244: writing smithi03339061-25 from 1818624 to 1835008 tid 4 2021-07-26T16:05:20.197 INFO:tasks.rados.rados.0.smithi033.stdout:2240: done (4 left) 2021-07-26T16:05:20.197 INFO:tasks.rados.rados.0.smithi033.stdout:2245: setattr oid 9 current snap is 225 2021-07-26T16:05:20.197 INFO:tasks.rados.rados.0.smithi033.stdout:2243: finishing write tid 1 to smithi03339061-43 2021-07-26T16:05:20.197 INFO:tasks.rados.rados.0.smithi033.stdout:2243: finishing write tid 2 to smithi03339061-43 2021-07-26T16:05:20.197 INFO:tasks.rados.rados.0.smithi033.stdout:2243: finishing write tid 3 to smithi03339061-43 2021-07-26T16:05:20.198 INFO:tasks.rados.rados.0.smithi033.stdout:2243: finishing write tid 4 to smithi03339061-43 2021-07-26T16:05:20.198 INFO:tasks.rados.rados.0.smithi033.stdout:2243: finishing write tid 5 to smithi03339061-43 2021-07-26T16:05:20.198 INFO:tasks.rados.rados.0.smithi033.stdout:2243: finishing write tid 6 to smithi03339061-43 2021-07-26T16:05:20.198 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 882 (ObjNum 681 snap 225 seq_num 681) dirty exists 2021-07-26T16:05:20.199 INFO:tasks.rados.rados.0.smithi033.stdout:2243: left oid 43 (ObjNum 681 snap 225 seq_num 681) 2021-07-26T16:05:20.200 INFO:tasks.rados.rados.0.smithi033.stdout:2244: finishing write tid 1 to smithi03339061-25 2021-07-26T16:05:20.200 INFO:tasks.rados.rados.0.smithi033.stdout:2243: done (4 left) 2021-07-26T16:05:20.200 INFO:tasks.rados.rados.0.smithi033.stdout:2246: read oid 29 snap -1 2021-07-26T16:05:20.200 INFO:tasks.rados.rados.0.smithi033.stdout:2246: expect deleted 2021-07-26T16:05:20.200 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 225 2021-07-26T16:05:20.201 INFO:tasks.rados.rados.0.smithi033.stdout:2247: seq_num 683 ranges {10297344=647168,10944512=630784,11575296=573440} 2021-07-26T16:05:20.259 INFO:tasks.rados.rados.0.smithi033.stdout:2247: writing smithi03339061-10 from 10297344 to 10944512 tid 1 2021-07-26T16:05:20.262 INFO:tasks.rados.rados.0.smithi033.stdout:2247: writing smithi03339061-10 from 10944512 to 11575296 tid 2 2021-07-26T16:05:20.266 INFO:tasks.rados.rados.0.smithi033.stdout:2247: writing smithi03339061-10 from 11575296 to 12148736 tid 3 2021-07-26T16:05:20.266 INFO:tasks.rados.rados.0.smithi033.stdout:2248: setattr oid 14 current snap is 225 2021-07-26T16:05:20.266 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 862 (ObjNum 288 snap 0 seq_num 273) dirty exists 2021-07-26T16:05:20.267 INFO:tasks.rados.rados.0.smithi033.stdout:2244: finishing write tid 2 to smithi03339061-25 2021-07-26T16:05:20.267 INFO:tasks.rados.rados.0.smithi033.stdout:2244: finishing write tid 3 to smithi03339061-25 2021-07-26T16:05:20.267 INFO:tasks.rados.rados.0.smithi033.stdout:2241: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:05:20.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:20 smithi033 bash[42377]: cluster 2021-07-26T16:05:19.103720+0000 mgr.y (mgr.34104) 341 : cluster [DBG] pgmap v585: 25 pgs: 25 active+clean; 263 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 29 op/s 2021-07-26T16:05:20.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:20 smithi033 bash[42377]: cluster 2021-07-26T16:05:19.144623+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2021-07-26T16:05:20.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:20 smithi033 bash[41341]: cluster 2021-07-26T16:05:19.103720+0000 mgr.y (mgr.34104) 341 : cluster [DBG] pgmap v585: 25 pgs: 25 active+clean; 263 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 29 op/s 2021-07-26T16:05:20.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:20 smithi033 bash[41341]: cluster 2021-07-26T16:05:19.144623+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2021-07-26T16:05:20.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:20 smithi096 bash[33981]: cluster 2021-07-26T16:05:19.103720+0000 mgr.y (mgr.34104) 341 : cluster [DBG] pgmap v585: 25 pgs: 25 active+clean; 263 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 4.1 MiB/s rd, 5.2 MiB/s wr, 29 op/s 2021-07-26T16:05:20.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:20 smithi096 bash[33981]: cluster 2021-07-26T16:05:19.144623+0000 mon.a (mon.0) 876 : cluster [DBG] osdmap e514: 8 total, 8 up, 8 in 2021-07-26T16:05:20.831 INFO:tasks.rados.rados.0.smithi033.stdout:2244: finishing write tid 4 to smithi03339061-25 2021-07-26T16:05:20.832 INFO:tasks.rados.rados.0.smithi033.stdout:2244: finishing write tid 5 to smithi03339061-25 2021-07-26T16:05:20.832 INFO:tasks.rados.rados.0.smithi033.stdout:2244: finishing write tid 6 to smithi03339061-25 2021-07-26T16:05:20.832 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 1255 (ObjNum 682 snap 225 seq_num 682) dirty exists 2021-07-26T16:05:20.832 INFO:tasks.rados.rados.0.smithi033.stdout:2244: left oid 25 (ObjNum 682 snap 225 seq_num 682) 2021-07-26T16:05:20.832 INFO:tasks.rados.rados.0.smithi033.stdout:2242: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:05:21.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[41341]: cluster 2021-07-26T16:05:20.161777+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2021-07-26T16:05:21.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[41341]: audit 2021-07-26T16:05:20.266792+0000 mon.c (mon.1) 248 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:05:21.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[41341]: audit 2021-07-26T16:05:20.269576+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:05:21.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[41341]: audit 2021-07-26T16:05:20.271077+0000 mon.c (mon.1) 250 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:05:21.461 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[41341]: audit 2021-07-26T16:05:20.546981+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:05:21.462 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[41341]: cluster 2021-07-26T16:05:21.116993+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2021-07-26T16:05:21.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[42377]: cluster 2021-07-26T16:05:20.161777+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2021-07-26T16:05:21.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[42377]: audit 2021-07-26T16:05:20.266792+0000 mon.c (mon.1) 248 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:05:21.463 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[42377]: audit 2021-07-26T16:05:20.269576+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:05:21.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[42377]: audit 2021-07-26T16:05:20.271077+0000 mon.c (mon.1) 250 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:05:21.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[42377]: audit 2021-07-26T16:05:20.546981+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:05:21.464 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:21 smithi033 bash[42377]: cluster 2021-07-26T16:05:21.116993+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2021-07-26T16:05:21.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:21 smithi096 bash[33981]: cluster 2021-07-26T16:05:20.161777+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e515: 8 total, 8 up, 8 in 2021-07-26T16:05:21.543 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:21 smithi096 bash[33981]: audit 2021-07-26T16:05:20.266792+0000 mon.c (mon.1) 248 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:05:21.544 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:21 smithi096 bash[33981]: audit 2021-07-26T16:05:20.269576+0000 mon.c (mon.1) 249 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:05:21.544 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:21 smithi096 bash[33981]: audit 2021-07-26T16:05:20.271077+0000 mon.c (mon.1) 250 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:05:21.544 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:21 smithi096 bash[33981]: audit 2021-07-26T16:05:20.546981+0000 mon.a (mon.0) 878 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:05:21.545 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:21 smithi096 bash[33981]: cluster 2021-07-26T16:05:21.116993+0000 mon.a (mon.0) 879 : cluster [DBG] osdmap e516: 8 total, 8 up, 8 in 2021-07-26T16:05:21.735 INFO:tasks.rados.rados.0.smithi033.stdout:2241: done (6 left) 2021-07-26T16:05:21.736 INFO:tasks.rados.rados.0.smithi033.stdout:2242: done (5 left) 2021-07-26T16:05:21.736 INFO:tasks.rados.rados.0.smithi033.stdout:2244: done (4 left) 2021-07-26T16:05:21.736 INFO:tasks.rados.rados.0.smithi033.stdout:2245: done (3 left) 2021-07-26T16:05:21.736 INFO:tasks.rados.rados.0.smithi033.stdout:2246: done (2 left) 2021-07-26T16:05:21.737 INFO:tasks.rados.rados.0.smithi033.stdout:2249: read oid 47 snap 214 2021-07-26T16:05:21.737 INFO:tasks.rados.rados.0.smithi033.stdout:2249: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:05:21.737 INFO:tasks.rados.rados.0.smithi033.stdout:2250: snap_remove snap 219 2021-07-26T16:05:22.561 INFO:tasks.rados.rados.0.smithi033.stdout:2250: done (3 left) 2021-07-26T16:05:22.562 INFO:tasks.rados.rados.0.smithi033.stdout:2251: rollback oid 12 current snap is 225 2021-07-26T16:05:22.562 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 12 to 214 2021-07-26T16:05:22.563 INFO:tasks.rados.rados.0.smithi033.stdout:2252: snap_create 2021-07-26T16:05:22.563 INFO:tasks.rados.rados.0.smithi033.stdout:2247: finishing write tid 1 to smithi03339061-10 2021-07-26T16:05:22.563 INFO:tasks.rados.rados.0.smithi033.stdout:2247: finishing write tid 2 to smithi03339061-10 2021-07-26T16:05:22.563 INFO:tasks.rados.rados.0.smithi033.stdout:2247: finishing write tid 3 to smithi03339061-10 2021-07-26T16:05:22.564 INFO:tasks.rados.rados.0.smithi033.stdout:2247: finishing write tid 4 to smithi03339061-10 2021-07-26T16:05:22.564 INFO:tasks.rados.rados.0.smithi033.stdout:2247: finishing write tid 5 to smithi03339061-10 2021-07-26T16:05:22.564 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1034 (ObjNum 683 snap 225 seq_num 683) dirty exists 2021-07-26T16:05:22.564 INFO:tasks.rados.rados.0.smithi033.stdout:2247: left oid 10 (ObjNum 683 snap 225 seq_num 683) 2021-07-26T16:05:22.564 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1072 (ObjNum 659 snap 213 seq_num 659) dirty exists 2021-07-26T16:05:22.565 INFO:tasks.rados.rados.0.smithi033.stdout:2249: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:05:22.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:22 smithi033 bash[41341]: cluster 2021-07-26T16:05:21.104384+0000 mgr.y (mgr.34104) 342 : cluster [DBG] pgmap v588: 25 pgs: 25 active+clean; 265 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.3 MiB/s wr, 25 op/s 2021-07-26T16:05:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:22 smithi033 bash[42377]: cluster 2021-07-26T16:05:21.104384+0000 mgr.y (mgr.34104) 342 : cluster [DBG] pgmap v588: 25 pgs: 25 active+clean; 265 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.3 MiB/s wr, 25 op/s 2021-07-26T16:05:22.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:22 smithi096 bash[33981]: cluster 2021-07-26T16:05:21.104384+0000 mgr.y (mgr.34104) 342 : cluster [DBG] pgmap v588: 25 pgs: 25 active+clean; 265 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 3.3 MiB/s wr, 25 op/s 2021-07-26T16:05:23.141 INFO:tasks.rados.rados.0.smithi033.stdout:2251: finishing rollback tid 0 to smithi03339061-12 2021-07-26T16:05:23.142 INFO:tasks.rados.rados.0.smithi033.stdout:2251: finishing rollback tid 1 to smithi03339061-12 2021-07-26T16:05:23.142 INFO:tasks.rados.rados.0.smithi033.stdout:2251: finishing rollback tid 2 to smithi03339061-12 2021-07-26T16:05:23.142 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1218 (ObjNum 597 snap 183 seq_num 597) dirty exists 2021-07-26T16:05:23.578 INFO:tasks.rados.rados.0.smithi033.stdout:2247: done (4 left) 2021-07-26T16:05:23.578 INFO:tasks.rados.rados.0.smithi033.stdout:2248: done (3 left) 2021-07-26T16:05:23.579 INFO:tasks.rados.rados.0.smithi033.stdout:2249: done (2 left) 2021-07-26T16:05:23.579 INFO:tasks.rados.rados.0.smithi033.stdout:2251: done (1 left) 2021-07-26T16:05:23.579 INFO:tasks.rados.rados.0.smithi033.stdout:2252: done (0 left) 2021-07-26T16:05:23.579 INFO:tasks.rados.rados.0.smithi033.stdout:2253: snap_remove snap 207 2021-07-26T16:05:23.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:23 smithi033 bash[41341]: cluster 2021-07-26T16:05:22.554350+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2021-07-26T16:05:23.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:23 smithi033 bash[42377]: cluster 2021-07-26T16:05:22.554350+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2021-07-26T16:05:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:23.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:23.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:23.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:23.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:23.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:05:23.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:23 smithi096 bash[33981]: cluster 2021-07-26T16:05:22.554350+0000 mon.a (mon.0) 880 : cluster [DBG] osdmap e517: 8 total, 8 up, 8 in 2021-07-26T16:05:24.601 INFO:tasks.rados.rados.0.smithi033.stdout:2253: done (0 left) 2021-07-26T16:05:24.602 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 226 2021-07-26T16:05:24.602 INFO:tasks.rados.rados.0.smithi033.stdout:2254: seq_num 684 ranges {1630208=663552,2293760=507904,2801664=409600,3211264=286720} 2021-07-26T16:05:24.612 INFO:tasks.rados.rados.0.smithi033.stdout:2254: writing smithi03339061-2 from 1630208 to 2293760 tid 1 2021-07-26T16:05:24.615 INFO:tasks.rados.rados.0.smithi033.stdout:2254: writing smithi03339061-2 from 2293760 to 2801664 tid 2 2021-07-26T16:05:24.618 INFO:tasks.rados.rados.0.smithi033.stdout:2254: writing smithi03339061-2 from 2801664 to 3211264 tid 3 2021-07-26T16:05:24.622 INFO:tasks.rados.rados.0.smithi033.stdout:2254: writing smithi03339061-2 from 3211264 to 3497984 tid 4 2021-07-26T16:05:24.622 INFO:tasks.rados.rados.0.smithi033.stdout:2255: read oid 25 snap -1 2021-07-26T16:05:24.623 INFO:tasks.rados.rados.0.smithi033.stdout:2255: expect (ObjNum 682 snap 225 seq_num 682) 2021-07-26T16:05:24.623 INFO:tasks.rados.rados.0.smithi033.stdout:2256: read oid 48 snap 221 2021-07-26T16:05:24.624 INFO:tasks.rados.rados.0.smithi033.stdout:2256: expect (ObjNum 602 snap 188 seq_num 602) 2021-07-26T16:05:24.624 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 226 2021-07-26T16:05:24.624 INFO:tasks.rados.rados.0.smithi033.stdout:2257: seq_num 685 ranges {0=679936,679936=442368,1122304=622592,1744896=139264} 2021-07-26T16:05:24.625 INFO:tasks.rados.rados.0.smithi033.stdout:2257: writing smithi03339061-46 from 0 to 679936 tid 1 2021-07-26T16:05:24.628 INFO:tasks.rados.rados.0.smithi033.stdout:2257: writing smithi03339061-46 from 679936 to 1122304 tid 2 2021-07-26T16:05:24.633 INFO:tasks.rados.rados.0.smithi033.stdout:2257: writing smithi03339061-46 from 1122304 to 1744896 tid 3 2021-07-26T16:05:24.634 INFO:tasks.rados.rados.0.smithi033.stdout:2257: writing smithi03339061-46 from 1744896 to 1884160 tid 4 2021-07-26T16:05:24.635 INFO:tasks.rados.rados.0.smithi033.stdout:2258: snap_create 2021-07-26T16:05:24.635 INFO:tasks.rados.rados.0.smithi033.stdout:2254: finishing write tid 1 to smithi03339061-2 2021-07-26T16:05:24.636 INFO:tasks.rados.rados.0.smithi033.stdout:2254: finishing write tid 2 to smithi03339061-2 2021-07-26T16:05:24.636 INFO:tasks.rados.rados.0.smithi033.stdout:2254: finishing write tid 3 to smithi03339061-2 2021-07-26T16:05:24.636 INFO:tasks.rados.rados.0.smithi033.stdout:2254: finishing write tid 4 to smithi03339061-2 2021-07-26T16:05:24.637 INFO:tasks.rados.rados.0.smithi033.stdout:2254: finishing write tid 5 to smithi03339061-2 2021-07-26T16:05:24.637 INFO:tasks.rados.rados.0.smithi033.stdout:2256: expect (ObjNum 602 snap 188 seq_num 602) 2021-07-26T16:05:24.651 INFO:tasks.rados.rados.0.smithi033.stdout:2254: finishing write tid 6 to smithi03339061-2 2021-07-26T16:05:24.651 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1223 (ObjNum 684 snap 226 seq_num 684) dirty exists 2021-07-26T16:05:24.652 INFO:tasks.rados.rados.0.smithi033.stdout:2254: left oid 2 (ObjNum 684 snap 226 seq_num 684) 2021-07-26T16:05:24.652 INFO:tasks.rados.rados.0.smithi033.stdout:2257: finishing write tid 1 to smithi03339061-46 2021-07-26T16:05:24.653 INFO:tasks.rados.rados.0.smithi033.stdout:2257: finishing write tid 2 to smithi03339061-46 2021-07-26T16:05:24.653 INFO:tasks.rados.rados.0.smithi033.stdout:2255: expect (ObjNum 682 snap 225 seq_num 682) 2021-07-26T16:05:24.700 INFO:tasks.rados.rados.0.smithi033.stdout:2257: finishing write tid 3 to smithi03339061-46 2021-07-26T16:05:24.700 INFO:tasks.rados.rados.0.smithi033.stdout:2257: finishing write tid 4 to smithi03339061-46 2021-07-26T16:05:24.701 INFO:tasks.rados.rados.0.smithi033.stdout:2257: finishing write tid 5 to smithi03339061-46 2021-07-26T16:05:24.701 INFO:tasks.rados.rados.0.smithi033.stdout:2257: finishing write tid 6 to smithi03339061-46 2021-07-26T16:05:24.701 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1231 (ObjNum 685 snap 226 seq_num 685) dirty exists 2021-07-26T16:05:24.701 INFO:tasks.rados.rados.0.smithi033.stdout:2257: left oid 46 (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:05:24.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:24 smithi033 bash[41341]: cluster 2021-07-26T16:05:23.104798+0000 mgr.y (mgr.34104) 343 : cluster [DBG] pgmap v591: 25 pgs: 25 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 29 MiB/s rd, 1.7 MiB/s wr, 20 op/s 2021-07-26T16:05:24.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:24 smithi033 bash[41341]: cluster 2021-07-26T16:05:23.572465+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2021-07-26T16:05:24.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:24 smithi033 bash[42377]: cluster 2021-07-26T16:05:23.104798+0000 mgr.y (mgr.34104) 343 : cluster [DBG] pgmap v591: 25 pgs: 25 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 29 MiB/s rd, 1.7 MiB/s wr, 20 op/s 2021-07-26T16:05:24.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:24 smithi033 bash[42377]: cluster 2021-07-26T16:05:23.572465+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2021-07-26T16:05:24.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:24 smithi096 bash[33981]: cluster 2021-07-26T16:05:23.104798+0000 mgr.y (mgr.34104) 343 : cluster [DBG] pgmap v591: 25 pgs: 25 active+clean; 270 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 29 MiB/s rd, 1.7 MiB/s wr, 20 op/s 2021-07-26T16:05:24.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:24 smithi096 bash[33981]: cluster 2021-07-26T16:05:23.572465+0000 mon.a (mon.0) 881 : cluster [DBG] osdmap e518: 8 total, 8 up, 8 in 2021-07-26T16:05:25.606 INFO:tasks.rados.rados.0.smithi033.stdout:2254: done (4 left) 2021-07-26T16:05:25.607 INFO:tasks.rados.rados.0.smithi033.stdout:2255: done (3 left) 2021-07-26T16:05:25.607 INFO:tasks.rados.rados.0.smithi033.stdout:2256: done (2 left) 2021-07-26T16:05:25.607 INFO:tasks.rados.rados.0.smithi033.stdout:2257: done (1 left) 2021-07-26T16:05:25.607 INFO:tasks.rados.rados.0.smithi033.stdout:2258: done (0 left) 2021-07-26T16:05:25.608 INFO:tasks.rados.rados.0.smithi033.stdout:2259: read oid 19 snap -1 2021-07-26T16:05:25.609 INFO:tasks.rados.rados.0.smithi033.stdout:2259: expect (ObjNum 643 snap 204 seq_num 643) 2021-07-26T16:05:25.610 INFO:tasks.rados.rados.0.smithi033.stdout:2260: snap_remove snap 202 2021-07-26T16:05:25.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:25 smithi033 bash[41341]: cluster 2021-07-26T16:05:24.591511+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2021-07-26T16:05:25.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:25 smithi033 bash[42377]: cluster 2021-07-26T16:05:24.591511+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2021-07-26T16:05:25.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:25 smithi096 bash[33981]: cluster 2021-07-26T16:05:24.591511+0000 mon.a (mon.0) 882 : cluster [DBG] osdmap e519: 8 total, 8 up, 8 in 2021-07-26T16:05:26.128 INFO:tasks.rados.rados.0.smithi033.stdout:2260: done (1 left) 2021-07-26T16:05:26.128 INFO:tasks.rados.rados.0.smithi033.stdout:2261: snap_create 2021-07-26T16:05:26.129 INFO:tasks.rados.rados.0.smithi033.stdout:2259: expect (ObjNum 643 snap 204 seq_num 643) 2021-07-26T16:05:26.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:26 smithi033 bash[41341]: cluster 2021-07-26T16:05:25.105465+0000 mgr.y (mgr.34104) 344 : cluster [DBG] pgmap v594: 25 pgs: 25 active+clean; 274 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2021-07-26T16:05:26.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:26 smithi033 bash[41341]: cluster 2021-07-26T16:05:25.601460+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2021-07-26T16:05:26.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:26 smithi033 bash[41341]: cluster 2021-07-26T16:05:26.122516+0000 mon.a (mon.0) 884 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2021-07-26T16:05:26.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:26 smithi033 bash[42377]: cluster 2021-07-26T16:05:25.105465+0000 mgr.y (mgr.34104) 344 : cluster [DBG] pgmap v594: 25 pgs: 25 active+clean; 274 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2021-07-26T16:05:26.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:26 smithi033 bash[42377]: cluster 2021-07-26T16:05:25.601460+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2021-07-26T16:05:26.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:26 smithi033 bash[42377]: cluster 2021-07-26T16:05:26.122516+0000 mon.a (mon.0) 884 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2021-07-26T16:05:26.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:26 smithi096 bash[33981]: cluster 2021-07-26T16:05:25.105465+0000 mgr.y (mgr.34104) 344 : cluster [DBG] pgmap v594: 25 pgs: 25 active+clean; 274 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 2.2 MiB/s wr, 15 op/s 2021-07-26T16:05:26.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:26 smithi096 bash[33981]: cluster 2021-07-26T16:05:25.601460+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e520: 8 total, 8 up, 8 in 2021-07-26T16:05:26.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:26 smithi096 bash[33981]: cluster 2021-07-26T16:05:26.122516+0000 mon.a (mon.0) 884 : cluster [DBG] osdmap e521: 8 total, 8 up, 8 in 2021-07-26T16:05:27.153 INFO:tasks.rados.rados.0.smithi033.stdout:2259: done (1 left) 2021-07-26T16:05:27.153 INFO:tasks.rados.rados.0.smithi033.stdout:2261: done (0 left) 2021-07-26T16:05:27.154 INFO:tasks.rados.rados.0.smithi033.stdout:2262: copy_from oid 50 from oid 43 current snap is 228 2021-07-26T16:05:27.154 INFO:tasks.rados.rados.0.smithi033.stdout:2263: snap_create 2021-07-26T16:05:27.184 INFO:tasks.rados.rados.0.smithi033.stdout:2262: finishing copy_from to smithi03339061-50 2021-07-26T16:05:27.184 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 882 (ObjNum 681 snap 225 seq_num 681) dirty exists 2021-07-26T16:05:27.185 INFO:tasks.rados.rados.0.smithi033.stdout:2262: finishing copy_from racing read to smithi03339061-50 2021-07-26T16:05:28.156 INFO:tasks.rados.rados.0.smithi033.stdout:2262: done (1 left) 2021-07-26T16:05:28.157 INFO:tasks.rados.rados.0.smithi033.stdout:2263: done (0 left) 2021-07-26T16:05:28.157 INFO:tasks.rados.rados.0.smithi033.stdout:2264: rollback oid 44 current snap is 229 2021-07-26T16:05:28.157 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 218 2021-07-26T16:05:28.157 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 229 2021-07-26T16:05:28.157 INFO:tasks.rados.rados.0.smithi033.stdout:2265: seq_num 686 ranges {0=696320,696320=729088,1425408=425984,1851392=49152} 2021-07-26T16:05:28.160 INFO:tasks.rados.rados.0.smithi033.stdout:2265: writing smithi03339061-42 from 0 to 696320 tid 1 2021-07-26T16:05:28.166 INFO:tasks.rados.rados.0.smithi033.stdout:2265: writing smithi03339061-42 from 696320 to 1425408 tid 2 2021-07-26T16:05:28.169 INFO:tasks.rados.rados.0.smithi033.stdout:2265: writing smithi03339061-42 from 1425408 to 1851392 tid 3 2021-07-26T16:05:28.171 INFO:tasks.rados.rados.0.smithi033.stdout:2265: writing smithi03339061-42 from 1851392 to 1900544 tid 4 2021-07-26T16:05:28.171 INFO:tasks.rados.rados.0.smithi033.stdout:2266: rollback oid 5 current snap is 229 2021-07-26T16:05:28.171 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 5 to 224 2021-07-26T16:05:28.171 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 229 2021-07-26T16:05:28.171 INFO:tasks.rados.rados.0.smithi033.stdout:2267: seq_num 687 ranges {2965504=712704,3678208=614400,4292608=589824} 2021-07-26T16:05:28.191 INFO:tasks.rados.rados.0.smithi033.stdout:2267: writing smithi03339061-50 from 2965504 to 3678208 tid 1 2021-07-26T16:05:28.194 INFO:tasks.rados.rados.0.smithi033.stdout:2267: writing smithi03339061-50 from 3678208 to 4292608 tid 2 2021-07-26T16:05:28.198 INFO:tasks.rados.rados.0.smithi033.stdout:2267: writing smithi03339061-50 from 4292608 to 4882432 tid 3 2021-07-26T16:05:28.198 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 229 2021-07-26T16:05:28.199 INFO:tasks.rados.rados.0.smithi033.stdout:2264: finishing rollback tid 0 to smithi03339061-44 2021-07-26T16:05:28.199 INFO:tasks.rados.rados.0.smithi033.stdout:2268: seq_num 688 ranges {18792448=729088,19521536=499712,20021248=704512} 2021-07-26T16:05:28.308 INFO:tasks.rados.rados.0.smithi033.stdout:2268: writing smithi03339061-32 from 18792448 to 19521536 tid 1 2021-07-26T16:05:28.311 INFO:tasks.rados.rados.0.smithi033.stdout:2268: writing smithi03339061-32 from 19521536 to 20021248 tid 2 2021-07-26T16:05:28.316 INFO:tasks.rados.rados.0.smithi033.stdout:2268: writing smithi03339061-32 from 20021248 to 20725760 tid 3 2021-07-26T16:05:28.317 INFO:tasks.rados.rados.0.smithi033.stdout:2269: read oid 41 snap -1 2021-07-26T16:05:28.317 INFO:tasks.rados.rados.0.smithi033.stdout:2269: expect (ObjNum 677 snap 222 seq_num 677) 2021-07-26T16:05:28.317 INFO:tasks.rados.rados.0.smithi033.stdout:2270: delete oid 36 current snap is 229 2021-07-26T16:05:28.317 INFO:tasks.rados.rados.0.smithi033.stdout:2265: finishing write tid 1 to smithi03339061-42 2021-07-26T16:05:28.317 INFO:tasks.rados.rados.0.smithi033.stdout:2264: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:05:28.318 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1074 (ObjNum 1953066355 snap 858810728 seq_num 809055027) dirty dne 2021-07-26T16:05:28.318 INFO:tasks.rados.rados.0.smithi033.stdout:2265: finishing write tid 2 to smithi03339061-42 2021-07-26T16:05:28.318 INFO:tasks.rados.rados.0.smithi033.stdout:2265: finishing write tid 3 to smithi03339061-42 2021-07-26T16:05:28.318 INFO:tasks.rados.rados.0.smithi033.stdout:2266: finishing rollback tid 0 to smithi03339061-5 2021-07-26T16:05:28.318 INFO:tasks.rados.rados.0.smithi033.stdout:2265: finishing write tid 4 to smithi03339061-42 2021-07-26T16:05:28.319 INFO:tasks.rados.rados.0.smithi033.stdout:2266: finishing rollback tid 1 to smithi03339061-5 2021-07-26T16:05:28.319 INFO:tasks.rados.rados.0.smithi033.stdout:2265: finishing write tid 5 to smithi03339061-42 2021-07-26T16:05:28.319 INFO:tasks.rados.rados.0.smithi033.stdout:2266: finishing rollback tid 2 to smithi03339061-5 2021-07-26T16:05:28.319 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 885 (ObjNum 569 snap 177 seq_num 569) dirty exists 2021-07-26T16:05:28.320 INFO:tasks.rados.rados.0.smithi033.stdout:2265: finishing write tid 6 to smithi03339061-42 2021-07-26T16:05:28.320 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 849 (ObjNum 686 snap 229 seq_num 686) dirty exists 2021-07-26T16:05:28.320 INFO:tasks.rados.rados.0.smithi033.stdout:2265: left oid 42 (ObjNum 686 snap 229 seq_num 686) 2021-07-26T16:05:28.320 INFO:tasks.rados.rados.0.smithi033.stdout:2267: finishing write tid 1 to smithi03339061-50 2021-07-26T16:05:28.321 INFO:tasks.rados.rados.0.smithi033.stdout:2267: finishing write tid 2 to smithi03339061-50 2021-07-26T16:05:28.321 INFO:tasks.rados.rados.0.smithi033.stdout:2267: finishing write tid 3 to smithi03339061-50 2021-07-26T16:05:28.321 INFO:tasks.rados.rados.0.smithi033.stdout:2267: finishing write tid 4 to smithi03339061-50 2021-07-26T16:05:28.321 INFO:tasks.rados.rados.0.smithi033.stdout:2267: finishing write tid 5 to smithi03339061-50 2021-07-26T16:05:28.321 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1259 (ObjNum 687 snap 229 seq_num 687) dirty exists 2021-07-26T16:05:28.322 INFO:tasks.rados.rados.0.smithi033.stdout:2267: left oid 50 (ObjNum 687 snap 229 seq_num 687) 2021-07-26T16:05:28.322 INFO:tasks.rados.rados.0.smithi033.stdout:2268: finishing write tid 1 to smithi03339061-32 2021-07-26T16:05:28.322 INFO:tasks.rados.rados.0.smithi033.stdout:2268: finishing write tid 2 to smithi03339061-32 2021-07-26T16:05:28.323 INFO:tasks.rados.rados.0.smithi033.stdout:2268: finishing write tid 3 to smithi03339061-32 2021-07-26T16:05:28.324 INFO:tasks.rados.rados.0.smithi033.stdout:2268: finishing write tid 4 to smithi03339061-32 2021-07-26T16:05:28.326 INFO:tasks.rados.rados.0.smithi033.stdout:2268: finishing write tid 5 to smithi03339061-32 2021-07-26T16:05:28.326 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1263 (ObjNum 688 snap 229 seq_num 688) dirty exists 2021-07-26T16:05:28.327 INFO:tasks.rados.rados.0.smithi033.stdout:2268: left oid 32 (ObjNum 688 snap 229 seq_num 688) 2021-07-26T16:05:28.332 INFO:tasks.rados.rados.0.smithi033.stdout:2264: done (6 left) 2021-07-26T16:05:28.332 INFO:tasks.rados.rados.0.smithi033.stdout:2265: done (5 left) 2021-07-26T16:05:28.332 INFO:tasks.rados.rados.0.smithi033.stdout:2266: done (4 left) 2021-07-26T16:05:28.332 INFO:tasks.rados.rados.0.smithi033.stdout:2267: done (3 left) 2021-07-26T16:05:28.333 INFO:tasks.rados.rados.0.smithi033.stdout:2268: done (2 left) 2021-07-26T16:05:28.333 INFO:tasks.rados.rados.0.smithi033.stdout:2270: done (1 left) 2021-07-26T16:05:28.333 INFO:tasks.rados.rados.0.smithi033.stdout:2271: read oid 20 snap -1 2021-07-26T16:05:28.334 INFO:tasks.rados.rados.0.smithi033.stdout:2271: expect (ObjNum 625 snap 196 seq_num 625) 2021-07-26T16:05:28.334 INFO:tasks.rados.rados.0.smithi033.stdout:2272: rollback oid 24 current snap is 229 2021-07-26T16:05:28.334 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 24 to 214 2021-07-26T16:05:28.335 INFO:tasks.rados.rados.0.smithi033.stdout:2273: read oid 17 snap 216 2021-07-26T16:05:28.336 INFO:tasks.rados.rados.0.smithi033.stdout:2273: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:05:28.336 INFO:tasks.rados.rados.0.smithi033.stdout:2274: read oid 29 snap 227 2021-07-26T16:05:28.336 INFO:tasks.rados.rados.0.smithi033.stdout:2274: expect deleted 2021-07-26T16:05:28.336 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 229 2021-07-26T16:05:28.337 INFO:tasks.rados.rados.0.smithi033.stdout:2275: seq_num 690 ranges {401408=761856,1163264=663552,1826816=409600,2236416=131072} 2021-07-26T16:05:28.343 INFO:tasks.rados.rados.0.smithi033.stdout:2275: writing smithi03339061-12 from 401408 to 1163264 tid 1 2021-07-26T16:05:28.349 INFO:tasks.rados.rados.0.smithi033.stdout:2275: writing smithi03339061-12 from 1163264 to 1826816 tid 2 2021-07-26T16:05:28.352 INFO:tasks.rados.rados.0.smithi033.stdout:2275: writing smithi03339061-12 from 1826816 to 2236416 tid 3 2021-07-26T16:05:28.354 INFO:tasks.rados.rados.0.smithi033.stdout:2275: writing smithi03339061-12 from 2236416 to 2367488 tid 4 2021-07-26T16:05:28.354 INFO:tasks.rados.rados.0.smithi033.stdout:2276: delete oid 19 current snap is 229 2021-07-26T16:05:28.354 INFO:tasks.rados.rados.0.smithi033.stdout:2272: finishing rollback tid 1 to smithi03339061-24 2021-07-26T16:05:28.355 INFO:tasks.rados.rados.0.smithi033.stdout:2269: expect (ObjNum 677 snap 222 seq_num 677) 2021-07-26T16:05:28.453 INFO:tasks.rados.rados.0.smithi033.stdout:2272: finishing rollback tid 2 to smithi03339061-24 2021-07-26T16:05:28.454 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1052 (ObjNum 652 snap 206 seq_num 652) dirty exists 2021-07-26T16:05:28.455 INFO:tasks.rados.rados.0.smithi033.stdout:2271: expect (ObjNum 625 snap 196 seq_num 625) 2021-07-26T16:05:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:28 smithi033 bash[42377]: cluster 2021-07-26T16:05:27.106232+0000 mgr.y (mgr.34104) 345 : cluster [DBG] pgmap v597: 25 pgs: 25 active+clean; 267 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 904 KiB/s wr, 9 op/s 2021-07-26T16:05:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:28 smithi033 bash[42377]: cluster 2021-07-26T16:05:27.149798+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2021-07-26T16:05:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:28 smithi033 bash[41341]: cluster 2021-07-26T16:05:27.106232+0000 mgr.y (mgr.34104) 345 : cluster [DBG] pgmap v597: 25 pgs: 25 active+clean; 267 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 904 KiB/s wr, 9 op/s 2021-07-26T16:05:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:28 smithi033 bash[41341]: cluster 2021-07-26T16:05:27.149798+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2021-07-26T16:05:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:28 smithi096 bash[33981]: cluster 2021-07-26T16:05:27.106232+0000 mgr.y (mgr.34104) 345 : cluster [DBG] pgmap v597: 25 pgs: 25 active+clean; 267 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 904 KiB/s wr, 9 op/s 2021-07-26T16:05:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:28 smithi096 bash[33981]: cluster 2021-07-26T16:05:27.149798+0000 mon.a (mon.0) 885 : cluster [DBG] osdmap e522: 8 total, 8 up, 8 in 2021-07-26T16:05:28.609 INFO:tasks.rados.rados.0.smithi033.stdout:2275: finishing write tid 1 to smithi03339061-12 2021-07-26T16:05:28.609 INFO:tasks.rados.rados.0.smithi033.stdout:2273: expect (ObjNum 444 snap 137 seq_num 444) 2021-07-26T16:05:28.800 INFO:tasks.rados.rados.0.smithi033.stdout:2275: finishing write tid 2 to smithi03339061-12 2021-07-26T16:05:28.801 INFO:tasks.rados.rados.0.smithi033.stdout:2275: finishing write tid 3 to smithi03339061-12 2021-07-26T16:05:28.801 INFO:tasks.rados.rados.0.smithi033.stdout:2275: finishing write tid 4 to smithi03339061-12 2021-07-26T16:05:28.801 INFO:tasks.rados.rados.0.smithi033.stdout:2275: finishing write tid 5 to smithi03339061-12 2021-07-26T16:05:28.801 INFO:tasks.rados.rados.0.smithi033.stdout:2275: finishing write tid 6 to smithi03339061-12 2021-07-26T16:05:28.802 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1228 (ObjNum 690 snap 229 seq_num 690) dirty exists 2021-07-26T16:05:28.802 INFO:tasks.rados.rados.0.smithi033.stdout:2275: left oid 12 (ObjNum 690 snap 229 seq_num 690) 2021-07-26T16:05:28.802 INFO:tasks.rados.rados.0.smithi033.stdout:2269: done (6 left) 2021-07-26T16:05:28.802 INFO:tasks.rados.rados.0.smithi033.stdout:2271: done (5 left) 2021-07-26T16:05:28.803 INFO:tasks.rados.rados.0.smithi033.stdout:2272: done (4 left) 2021-07-26T16:05:28.803 INFO:tasks.rados.rados.0.smithi033.stdout:2273: done (3 left) 2021-07-26T16:05:28.803 INFO:tasks.rados.rados.0.smithi033.stdout:2274: done (2 left) 2021-07-26T16:05:28.803 INFO:tasks.rados.rados.0.smithi033.stdout:2275: done (1 left) 2021-07-26T16:05:28.803 INFO:tasks.rados.rados.0.smithi033.stdout:2276: done (0 left) 2021-07-26T16:05:28.804 INFO:tasks.rados.rados.0.smithi033.stdout:2277: rollback oid 33 current snap is 229 2021-07-26T16:05:28.804 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 214 2021-07-26T16:05:28.804 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 229 2021-07-26T16:05:28.804 INFO:tasks.rados.rados.0.smithi033.stdout:2278: seq_num 692 ranges {0=794624,794624=483328,1277952=720896} 2021-07-26T16:05:28.811 INFO:tasks.rados.rados.0.smithi033.stdout:2278: writing smithi03339061-47 from 0 to 794624 tid 1 2021-07-26T16:05:28.817 INFO:tasks.rados.rados.0.smithi033.stdout:2278: writing smithi03339061-47 from 794624 to 1277952 tid 2 2021-07-26T16:05:28.822 INFO:tasks.rados.rados.0.smithi033.stdout:2278: writing smithi03339061-47 from 1277952 to 1998848 tid 3 2021-07-26T16:05:28.823 INFO:tasks.rados.rados.0.smithi033.stdout:2279: read oid 30 snap -1 2021-07-26T16:05:28.823 INFO:tasks.rados.rados.0.smithi033.stdout:2279: expect (ObjNum 658 snap 213 seq_num 658) 2021-07-26T16:05:28.823 INFO:tasks.rados.rados.0.smithi033.stdout:2280: rmattr oid 32 current snap is 229 2021-07-26T16:05:28.823 INFO:tasks.rados.rados.0.smithi033.stdout:2277: finishing rollback tid 0 to smithi03339061-33 2021-07-26T16:05:28.823 INFO:tasks.rados.rados.0.smithi033.stdout:2281: setattr oid 3 current snap is 229 2021-07-26T16:05:28.824 INFO:tasks.rados.rados.0.smithi033.stdout:2277: finishing rollback tid 1 to smithi03339061-33 2021-07-26T16:05:28.824 INFO:tasks.rados.rados.0.smithi033.stdout:2277: finishing rollback tid 2 to smithi03339061-33 2021-07-26T16:05:28.824 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 1377 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:05:28.824 INFO:tasks.rados.rados.0.smithi033.stdout:2278: finishing write tid 1 to smithi03339061-47 2021-07-26T16:05:28.825 INFO:tasks.rados.rados.0.smithi033.stdout:2278: finishing write tid 2 to smithi03339061-47 2021-07-26T16:05:28.825 INFO:tasks.rados.rados.0.smithi033.stdout:2277: done (4 left) 2021-07-26T16:05:28.826 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 229 2021-07-26T16:05:28.826 INFO:tasks.rados.rados.0.smithi033.stdout:2282: seq_num 693 ranges {0=409600,409600=770048,1179648=581632,1761280=253952} 2021-07-26T16:05:28.826 INFO:tasks.rados.rados.0.smithi033.stdout:2282: writing smithi03339061-19 from 0 to 409600 tid 1 2021-07-26T16:05:28.831 INFO:tasks.rados.rados.0.smithi033.stdout:2282: writing smithi03339061-19 from 409600 to 1179648 tid 2 2021-07-26T16:05:28.835 INFO:tasks.rados.rados.0.smithi033.stdout:2282: writing smithi03339061-19 from 1179648 to 1761280 tid 3 2021-07-26T16:05:28.837 INFO:tasks.rados.rados.0.smithi033.stdout:2282: writing smithi03339061-19 from 1761280 to 2015232 tid 4 2021-07-26T16:05:28.837 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 229 2021-07-26T16:05:28.837 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1264 (ObjNum 688 snap 229 seq_num 688) dirty exists 2021-07-26T16:05:28.838 INFO:tasks.rados.rados.0.smithi033.stdout:2283: seq_num 694 ranges {2080768=425984,2506752=655360,3162112=786432,3948544=163840} 2021-07-26T16:05:28.851 INFO:tasks.rados.rados.0.smithi033.stdout:2283: writing smithi03339061-35 from 2080768 to 2506752 tid 1 2021-07-26T16:05:28.855 INFO:tasks.rados.rados.0.smithi033.stdout:2283: writing smithi03339061-35 from 2506752 to 3162112 tid 2 2021-07-26T16:05:28.860 INFO:tasks.rados.rados.0.smithi033.stdout:2283: writing smithi03339061-35 from 3162112 to 3948544 tid 3 2021-07-26T16:05:28.861 INFO:tasks.rados.rados.0.smithi033.stdout:2283: writing smithi03339061-35 from 3948544 to 4112384 tid 4 2021-07-26T16:05:28.861 INFO:tasks.rados.rados.0.smithi033.stdout:2280: done (5 left) 2021-07-26T16:05:28.862 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 229 2021-07-26T16:05:28.862 INFO:tasks.rados.rados.0.smithi033.stdout:2278: finishing write tid 3 to smithi03339061-47 2021-07-26T16:05:28.862 INFO:tasks.rados.rados.0.smithi033.stdout:2284: seq_num 695 ranges {11427840=442368,11870208=540672,12410880=598016,13008896=466944} 2021-07-26T16:05:28.928 INFO:tasks.rados.rados.0.smithi033.stdout:2284: writing smithi03339061-11 from 11427840 to 11870208 tid 1 2021-07-26T16:05:28.931 INFO:tasks.rados.rados.0.smithi033.stdout:2284: writing smithi03339061-11 from 11870208 to 12410880 tid 2 2021-07-26T16:05:28.934 INFO:tasks.rados.rados.0.smithi033.stdout:2284: writing smithi03339061-11 from 12410880 to 13008896 tid 3 2021-07-26T16:05:28.937 INFO:tasks.rados.rados.0.smithi033.stdout:2284: writing smithi03339061-11 from 13008896 to 13475840 tid 4 2021-07-26T16:05:28.937 INFO:tasks.rados.rados.0.smithi033.stdout:2285: rollback oid 29 current snap is 229 2021-07-26T16:05:28.937 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 214 2021-07-26T16:05:28.938 INFO:tasks.rados.rados.0.smithi033.stdout:2278: finishing write tid 4 to smithi03339061-47 2021-07-26T16:05:28.938 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 850 (ObjNum 288 snap 0 seq_num 65) dirty exists 2021-07-26T16:05:28.938 INFO:tasks.rados.rados.0.smithi033.stdout:2282: finishing write tid 1 to smithi03339061-19 2021-07-26T16:05:28.938 INFO:tasks.rados.rados.0.smithi033.stdout:2281: done (6 left) 2021-07-26T16:05:28.939 INFO:tasks.rados.rados.0.smithi033.stdout:2286: delete oid 1 current snap is 229 2021-07-26T16:05:28.939 INFO:tasks.rados.rados.0.smithi033.stdout:2279: expect (ObjNum 658 snap 213 seq_num 658) 2021-07-26T16:05:29.036 INFO:tasks.rados.rados.0.smithi033.stdout:2278: finishing write tid 5 to smithi03339061-47 2021-07-26T16:05:29.037 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1056 (ObjNum 692 snap 229 seq_num 692) dirty exists 2021-07-26T16:05:29.037 INFO:tasks.rados.rados.0.smithi033.stdout:2278: left oid 47 (ObjNum 692 snap 229 seq_num 692) 2021-07-26T16:05:29.037 INFO:tasks.rados.rados.0.smithi033.stdout:2282: finishing write tid 2 to smithi03339061-19 2021-07-26T16:05:29.037 INFO:tasks.rados.rados.0.smithi033.stdout:2282: finishing write tid 3 to smithi03339061-19 2021-07-26T16:05:29.038 INFO:tasks.rados.rados.0.smithi033.stdout:2282: finishing write tid 4 to smithi03339061-19 2021-07-26T16:05:29.038 INFO:tasks.rados.rados.0.smithi033.stdout:2278: done (6 left) 2021-07-26T16:05:29.038 INFO:tasks.rados.rados.0.smithi033.stdout:2279: done (5 left) 2021-07-26T16:05:29.038 INFO:tasks.rados.rados.0.smithi033.stdout:2286: done (4 left) 2021-07-26T16:05:29.039 INFO:tasks.rados.rados.0.smithi033.stdout:2287: snap_create 2021-07-26T16:05:29.039 INFO:tasks.rados.rados.0.smithi033.stdout:2282: finishing write tid 5 to smithi03339061-19 2021-07-26T16:05:29.039 INFO:tasks.rados.rados.0.smithi033.stdout:2282: finishing write tid 6 to smithi03339061-19 2021-07-26T16:05:29.039 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 868 (ObjNum 693 snap 229 seq_num 693) dirty exists 2021-07-26T16:05:29.040 INFO:tasks.rados.rados.0.smithi033.stdout:2282: left oid 19 (ObjNum 693 snap 229 seq_num 693) 2021-07-26T16:05:29.040 INFO:tasks.rados.rados.0.smithi033.stdout:2283: finishing write tid 1 to smithi03339061-35 2021-07-26T16:05:29.040 INFO:tasks.rados.rados.0.smithi033.stdout:2283: finishing write tid 2 to smithi03339061-35 2021-07-26T16:05:29.041 INFO:tasks.rados.rados.0.smithi033.stdout:2283: finishing write tid 3 to smithi03339061-35 2021-07-26T16:05:29.041 INFO:tasks.rados.rados.0.smithi033.stdout:2283: finishing write tid 4 to smithi03339061-35 2021-07-26T16:05:29.041 INFO:tasks.rados.rados.0.smithi033.stdout:2283: finishing write tid 5 to smithi03339061-35 2021-07-26T16:05:29.041 INFO:tasks.rados.rados.0.smithi033.stdout:2283: finishing write tid 6 to smithi03339061-35 2021-07-26T16:05:29.042 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 873 (ObjNum 694 snap 229 seq_num 694) dirty exists 2021-07-26T16:05:29.042 INFO:tasks.rados.rados.0.smithi033.stdout:2283: left oid 35 (ObjNum 694 snap 229 seq_num 694) 2021-07-26T16:05:29.042 INFO:tasks.rados.rados.0.smithi033.stdout:2285: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:05:29.043 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 0 (ObjNum 2006571824 snap 22002 seq_num 2006360544) dirty dne 2021-07-26T16:05:29.043 INFO:tasks.rados.rados.0.smithi033.stdout:2284: finishing write tid 1 to smithi03339061-11 2021-07-26T16:05:29.043 INFO:tasks.rados.rados.0.smithi033.stdout:2284: finishing write tid 2 to smithi03339061-11 2021-07-26T16:05:29.043 INFO:tasks.rados.rados.0.smithi033.stdout:2284: finishing write tid 3 to smithi03339061-11 2021-07-26T16:05:29.043 INFO:tasks.rados.rados.0.smithi033.stdout:2284: finishing write tid 4 to smithi03339061-11 2021-07-26T16:05:29.044 INFO:tasks.rados.rados.0.smithi033.stdout:2284: finishing write tid 5 to smithi03339061-11 2021-07-26T16:05:29.044 INFO:tasks.rados.rados.0.smithi033.stdout:2284: finishing write tid 6 to smithi03339061-11 2021-07-26T16:05:29.044 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 886 (ObjNum 695 snap 229 seq_num 695) dirty exists 2021-07-26T16:05:29.044 INFO:tasks.rados.rados.0.smithi033.stdout:2284: left oid 11 (ObjNum 695 snap 229 seq_num 695) 2021-07-26T16:05:29.174 INFO:tasks.rados.rados.0.smithi033.stdout:2282: done (4 left) 2021-07-26T16:05:29.174 INFO:tasks.rados.rados.0.smithi033.stdout:2283: done (3 left) 2021-07-26T16:05:29.175 INFO:tasks.rados.rados.0.smithi033.stdout:2284: done (2 left) 2021-07-26T16:05:29.175 INFO:tasks.rados.rados.0.smithi033.stdout:2285: done (1 left) 2021-07-26T16:05:29.175 INFO:tasks.rados.rados.0.smithi033.stdout:2287: done (0 left) 2021-07-26T16:05:29.175 INFO:tasks.rados.rados.0.smithi033.stdout:2288: copy_from oid 8 from oid 3 current snap is 230 2021-07-26T16:05:29.175 INFO:tasks.rados.rados.0.smithi033.stdout:2289: setattr oid 13 current snap is 230 2021-07-26T16:05:29.177 INFO:tasks.rados.rados.0.smithi033.stdout:2290: delete oid 23 current snap is 230 2021-07-26T16:05:29.181 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1075 (ObjNum 668 snap 217 seq_num 668) dirty exists 2021-07-26T16:05:29.183 INFO:tasks.rados.rados.0.smithi033.stdout:2288: finishing copy_from to smithi03339061-8 2021-07-26T16:05:29.184 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 850 (ObjNum 2006790208 snap 22002 seq_num 809055027) dirty exists 2021-07-26T16:05:29.184 INFO:tasks.rados.rados.0.smithi033.stdout:2288: finishing copy_from racing read to smithi03339061-8 2021-07-26T16:05:29.185 INFO:tasks.rados.rados.0.smithi033.stdout:2288: done (2 left) 2021-07-26T16:05:29.186 INFO:tasks.rados.rados.0.smithi033.stdout:2289: done (1 left) 2021-07-26T16:05:29.186 INFO:tasks.rados.rados.0.smithi033.stdout:2290: done (0 left) 2021-07-26T16:05:29.187 INFO:tasks.rados.rados.0.smithi033.stdout:2291: copy_from oid 14 from oid 16 current snap is 230 2021-07-26T16:05:29.187 INFO:tasks.rados.rados.0.smithi033.stdout:2292: snap_create 2021-07-26T16:05:29.189 INFO:tasks.rados.rados.0.smithi033.stdout:2291: finishing copy_from to smithi03339061-14 2021-07-26T16:05:29.190 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1245 (ObjNum 2006790944 snap 22002 seq_num 2007408448) dirty exists 2021-07-26T16:05:29.191 INFO:tasks.rados.rados.0.smithi033.stdout:2291: finishing copy_from racing read to smithi03339061-14 2021-07-26T16:05:29.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:29 smithi033 bash[42377]: cluster 2021-07-26T16:05:28.152177+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2021-07-26T16:05:29.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:29 smithi033 bash[41341]: cluster 2021-07-26T16:05:28.152177+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2021-07-26T16:05:29.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:29 smithi096 bash[33981]: cluster 2021-07-26T16:05:28.152177+0000 mon.a (mon.0) 886 : cluster [DBG] osdmap e523: 8 total, 8 up, 8 in 2021-07-26T16:05:30.177 INFO:tasks.rados.rados.0.smithi033.stdout:2291: done (1 left) 2021-07-26T16:05:30.178 INFO:tasks.rados.rados.0.smithi033.stdout:2292: done (0 left) 2021-07-26T16:05:30.178 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 231 2021-07-26T16:05:30.178 INFO:tasks.rados.rados.0.smithi033.stdout:2293: seq_num 698 ranges {2367488=499712,2867200=589824,3457024=770048,4227072=245760} 2021-07-26T16:05:30.194 INFO:tasks.rados.rados.0.smithi033.stdout:2293: writing smithi03339061-12 from 2367488 to 2867200 tid 1 2021-07-26T16:05:30.197 INFO:tasks.rados.rados.0.smithi033.stdout:2293: writing smithi03339061-12 from 2867200 to 3457024 tid 2 2021-07-26T16:05:30.201 INFO:tasks.rados.rados.0.smithi033.stdout:2293: writing smithi03339061-12 from 3457024 to 4227072 tid 3 2021-07-26T16:05:30.204 INFO:tasks.rados.rados.0.smithi033.stdout:2293: writing smithi03339061-12 from 4227072 to 4472832 tid 4 2021-07-26T16:05:30.204 INFO:tasks.rados.rados.0.smithi033.stdout:2294: read oid 33 snap -1 2021-07-26T16:05:30.205 INFO:tasks.rados.rados.0.smithi033.stdout:2294: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:05:30.205 INFO:tasks.rados.rados.0.smithi033.stdout:2295: rmattr oid 38 current snap is 231 2021-07-26T16:05:30.205 INFO:tasks.rados.rados.0.smithi033.stdout:2296: rollback oid 10 current snap is 231 2021-07-26T16:05:30.205 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 10 to 216 2021-07-26T16:05:30.205 INFO:tasks.rados.rados.0.smithi033.stdout:2297: rollback oid 35 current snap is 231 2021-07-26T16:05:30.206 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 223 2021-07-26T16:05:30.206 INFO:tasks.rados.rados.0.smithi033.stdout:2298: rollback oid 2 current snap is 231 2021-07-26T16:05:30.206 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 2 to 228 2021-07-26T16:05:30.206 INFO:tasks.rados.rados.0.smithi033.stdout:2299: read oid 17 snap -1 2021-07-26T16:05:30.207 INFO:tasks.rados.rados.0.smithi033.stdout:2299: expect (ObjNum 665 snap 217 seq_num 665) 2021-07-26T16:05:30.207 INFO:tasks.rados.rados.0.smithi033.stdout:2300: snap_remove snap 218 2021-07-26T16:05:30.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:30 smithi033 bash[41341]: cluster 2021-07-26T16:05:29.106879+0000 mgr.y (mgr.34104) 346 : cluster [DBG] pgmap v600: 25 pgs: 25 active+clean; 256 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 0 B/s wr, 5 op/s 2021-07-26T16:05:30.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:30 smithi033 bash[41341]: cluster 2021-07-26T16:05:29.171160+0000 mon.a (mon.0) 887 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2021-07-26T16:05:30.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:30 smithi033 bash[42377]: cluster 2021-07-26T16:05:29.106879+0000 mgr.y (mgr.34104) 346 : cluster [DBG] pgmap v600: 25 pgs: 25 active+clean; 256 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 0 B/s wr, 5 op/s 2021-07-26T16:05:30.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:30 smithi033 bash[42377]: cluster 2021-07-26T16:05:29.171160+0000 mon.a (mon.0) 887 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2021-07-26T16:05:30.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:30 smithi096 bash[33981]: cluster 2021-07-26T16:05:29.106879+0000 mgr.y (mgr.34104) 346 : cluster [DBG] pgmap v600: 25 pgs: 25 active+clean; 256 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 1.3 MiB/s rd, 0 B/s wr, 5 op/s 2021-07-26T16:05:30.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:30 smithi096 bash[33981]: cluster 2021-07-26T16:05:29.171160+0000 mon.a (mon.0) 887 : cluster [DBG] osdmap e524: 8 total, 8 up, 8 in 2021-07-26T16:05:31.130 INFO:tasks.rados.rados.0.smithi033.stdout:2300: done (7 left) 2021-07-26T16:05:31.131 INFO:tasks.rados.rados.0.smithi033.stdout:2301: read oid 30 snap -1 2021-07-26T16:05:31.131 INFO:tasks.rados.rados.0.smithi033.stdout:2301: expect (ObjNum 658 snap 213 seq_num 658) 2021-07-26T16:05:31.131 INFO:tasks.rados.rados.0.smithi033.stdout:2302: snap_remove snap 230 2021-07-26T16:05:31.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:31 smithi033 bash[41341]: cluster 2021-07-26T16:05:30.174277+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2021-07-26T16:05:31.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:31 smithi033 bash[41341]: cluster 2021-07-26T16:05:31.125651+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2021-07-26T16:05:31.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:31 smithi033 bash[42377]: cluster 2021-07-26T16:05:30.174277+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2021-07-26T16:05:31.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:31 smithi033 bash[42377]: cluster 2021-07-26T16:05:31.125651+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2021-07-26T16:05:31.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:31 smithi096 bash[33981]: cluster 2021-07-26T16:05:30.174277+0000 mon.a (mon.0) 888 : cluster [DBG] osdmap e525: 8 total, 8 up, 8 in 2021-07-26T16:05:31.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:31 smithi096 bash[33981]: cluster 2021-07-26T16:05:31.125651+0000 mon.a (mon.0) 889 : cluster [DBG] osdmap e526: 8 total, 8 up, 8 in 2021-07-26T16:05:32.142 INFO:tasks.rados.rados.0.smithi033.stdout:2302: done (8 left) 2021-07-26T16:05:32.143 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 231 2021-07-26T16:05:32.143 INFO:tasks.rados.rados.0.smithi033.stdout:2303: seq_num 699 ranges {1515520=516096,2031616=475136,2506752=573440,3080192=557056} 2021-07-26T16:05:32.155 INFO:tasks.rados.rados.0.smithi033.stdout:2303: writing smithi03339061-39 from 1515520 to 2031616 tid 1 2021-07-26T16:05:32.159 INFO:tasks.rados.rados.0.smithi033.stdout:2303: writing smithi03339061-39 from 2031616 to 2506752 tid 2 2021-07-26T16:05:32.162 INFO:tasks.rados.rados.0.smithi033.stdout:2303: writing smithi03339061-39 from 2506752 to 3080192 tid 3 2021-07-26T16:05:32.166 INFO:tasks.rados.rados.0.smithi033.stdout:2303: writing smithi03339061-39 from 3080192 to 3637248 tid 4 2021-07-26T16:05:32.167 INFO:tasks.rados.rados.0.smithi033.stdout:2304: read oid 44 snap -1 2021-07-26T16:05:32.167 INFO:tasks.rados.rados.0.smithi033.stdout:2304: expect deleted 2021-07-26T16:05:32.167 INFO:tasks.rados.rados.0.smithi033.stdout:2305: setattr oid 37 current snap is 231 2021-07-26T16:05:32.167 INFO:tasks.rados.rados.0.smithi033.stdout:2293: finishing write tid 1 to smithi03339061-12 2021-07-26T16:05:32.168 INFO:tasks.rados.rados.0.smithi033.stdout:2297: finishing rollback tid 0 to smithi03339061-35 2021-07-26T16:05:32.168 INFO:tasks.rados.rados.0.smithi033.stdout:2297: finishing rollback tid 1 to smithi03339061-35 2021-07-26T16:05:32.168 INFO:tasks.rados.rados.0.smithi033.stdout:2293: finishing write tid 2 to smithi03339061-12 2021-07-26T16:05:32.168 INFO:tasks.rados.rados.0.smithi033.stdout:2297: finishing rollback tid 2 to smithi03339061-35 2021-07-26T16:05:32.168 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 876 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:05:32.169 INFO:tasks.rados.rados.0.smithi033.stdout:2293: finishing write tid 3 to smithi03339061-12 2021-07-26T16:05:32.169 INFO:tasks.rados.rados.0.smithi033.stdout:2293: finishing write tid 4 to smithi03339061-12 2021-07-26T16:05:32.169 INFO:tasks.rados.rados.0.smithi033.stdout:2296: finishing rollback tid 0 to smithi03339061-10 2021-07-26T16:05:32.169 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 714 (ObjNum 667 snap 217 seq_num 667) dirty exists 2021-07-26T16:05:32.169 INFO:tasks.rados.rados.0.smithi033.stdout:2296: finishing rollback tid 1 to smithi03339061-10 2021-07-26T16:05:32.170 INFO:tasks.rados.rados.0.smithi033.stdout:2296: finishing rollback tid 2 to smithi03339061-10 2021-07-26T16:05:32.170 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1060 (ObjNum 288 snap 0 seq_num 273) dirty exists 2021-07-26T16:05:32.170 INFO:tasks.rados.rados.0.smithi033.stdout:2293: finishing write tid 5 to smithi03339061-12 2021-07-26T16:05:32.170 INFO:tasks.rados.rados.0.smithi033.stdout:2293: finishing write tid 6 to smithi03339061-12 2021-07-26T16:05:32.170 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1233 (ObjNum 698 snap 231 seq_num 698) dirty exists 2021-07-26T16:05:32.171 INFO:tasks.rados.rados.0.smithi033.stdout:2293: left oid 12 (ObjNum 698 snap 231 seq_num 698) 2021-07-26T16:05:32.171 INFO:tasks.rados.rados.0.smithi033.stdout:2298: finishing rollback tid 0 to smithi03339061-2 2021-07-26T16:05:32.171 INFO:tasks.rados.rados.0.smithi033.stdout:2298: finishing rollback tid 1 to smithi03339061-2 2021-07-26T16:05:32.171 INFO:tasks.rados.rados.0.smithi033.stdout:2294: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:05:32.244 INFO:tasks.rados.rados.0.smithi033.stdout:2298: finishing rollback tid 2 to smithi03339061-2 2021-07-26T16:05:32.244 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1236 (ObjNum 684 snap 226 seq_num 684) dirty exists 2021-07-26T16:05:32.244 INFO:tasks.rados.rados.0.smithi033.stdout:2299: expect (ObjNum 665 snap 217 seq_num 665) 2021-07-26T16:05:32.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:32 smithi033 bash[42377]: cluster 2021-07-26T16:05:31.107694+0000 mgr.y (mgr.34104) 347 : cluster [DBG] pgmap v603: 25 pgs: 25 active+clean; 256 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2021-07-26T16:05:32.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:32 smithi033 bash[42377]: cluster 2021-07-26T16:05:32.139573+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2021-07-26T16:05:32.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:32 smithi033 bash[41341]: cluster 2021-07-26T16:05:31.107694+0000 mgr.y (mgr.34104) 347 : cluster [DBG] pgmap v603: 25 pgs: 25 active+clean; 256 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2021-07-26T16:05:32.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:32 smithi033 bash[41341]: cluster 2021-07-26T16:05:32.139573+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2021-07-26T16:05:32.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:32 smithi096 bash[33981]: cluster 2021-07-26T16:05:31.107694+0000 mgr.y (mgr.34104) 347 : cluster [DBG] pgmap v603: 25 pgs: 25 active+clean; 256 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 10 MiB/s rd, 2.4 MiB/s wr, 21 op/s 2021-07-26T16:05:32.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:32 smithi096 bash[33981]: cluster 2021-07-26T16:05:32.139573+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e527: 8 total, 8 up, 8 in 2021-07-26T16:05:32.523 INFO:tasks.rados.rados.0.smithi033.stdout:2301: expect (ObjNum 658 snap 213 seq_num 658) 2021-07-26T16:05:32.619 INFO:tasks.rados.rados.0.smithi033.stdout:2303: finishing write tid 1 to smithi03339061-39 2021-07-26T16:05:32.620 INFO:tasks.rados.rados.0.smithi033.stdout:2303: finishing write tid 2 to smithi03339061-39 2021-07-26T16:05:32.620 INFO:tasks.rados.rados.0.smithi033.stdout:2303: finishing write tid 3 to smithi03339061-39 2021-07-26T16:05:32.620 INFO:tasks.rados.rados.0.smithi033.stdout:2303: finishing write tid 4 to smithi03339061-39 2021-07-26T16:05:32.620 INFO:tasks.rados.rados.0.smithi033.stdout:2303: finishing write tid 5 to smithi03339061-39 2021-07-26T16:05:32.621 INFO:tasks.rados.rados.0.smithi033.stdout:2303: finishing write tid 6 to smithi03339061-39 2021-07-26T16:05:32.621 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1098 (ObjNum 699 snap 231 seq_num 699) dirty exists 2021-07-26T16:05:32.621 INFO:tasks.rados.rados.0.smithi033.stdout:2303: left oid 39 (ObjNum 699 snap 231 seq_num 699) 2021-07-26T16:05:32.621 INFO:tasks.rados.rados.0.smithi033.stdout:2293: done (10 left) 2021-07-26T16:05:32.622 INFO:tasks.rados.rados.0.smithi033.stdout:2294: done (9 left) 2021-07-26T16:05:32.622 INFO:tasks.rados.rados.0.smithi033.stdout:2295: done (8 left) 2021-07-26T16:05:32.622 INFO:tasks.rados.rados.0.smithi033.stdout:2296: done (7 left) 2021-07-26T16:05:32.622 INFO:tasks.rados.rados.0.smithi033.stdout:2297: done (6 left) 2021-07-26T16:05:32.622 INFO:tasks.rados.rados.0.smithi033.stdout:2298: done (5 left) 2021-07-26T16:05:32.623 INFO:tasks.rados.rados.0.smithi033.stdout:2299: done (4 left) 2021-07-26T16:05:32.623 INFO:tasks.rados.rados.0.smithi033.stdout:2301: done (3 left) 2021-07-26T16:05:32.623 INFO:tasks.rados.rados.0.smithi033.stdout:2303: done (2 left) 2021-07-26T16:05:32.623 INFO:tasks.rados.rados.0.smithi033.stdout:2304: done (1 left) 2021-07-26T16:05:32.624 INFO:tasks.rados.rados.0.smithi033.stdout:2306: snap_create 2021-07-26T16:05:32.625 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 1066 (ObjNum 609 snap 192 seq_num 609) dirty exists 2021-07-26T16:05:33.206 INFO:tasks.rados.rados.0.smithi033.stdout:2305: done (1 left) 2021-07-26T16:05:33.206 INFO:tasks.rados.rados.0.smithi033.stdout:2306: done (0 left) 2021-07-26T16:05:33.206 INFO:tasks.rados.rados.0.smithi033.stdout:2307: snap_remove snap 227 2021-07-26T16:05:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:33 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:33.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:33 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:33.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:33 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:33.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:05:34.211 INFO:tasks.rados.rados.0.smithi033.stdout:2307: done (0 left) 2021-07-26T16:05:34.212 INFO:tasks.rados.rados.0.smithi033.stdout:2308: read oid 30 snap 225 2021-07-26T16:05:34.212 INFO:tasks.rados.rados.0.smithi033.stdout:2308: expect (ObjNum 658 snap 213 seq_num 658) 2021-07-26T16:05:34.213 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 232 2021-07-26T16:05:34.213 INFO:tasks.rados.rados.0.smithi033.stdout:2309: seq_num 700 ranges {1179648=532480,1712128=409600,2121728=737280,2859008=458752} 2021-07-26T16:05:34.225 INFO:tasks.rados.rados.0.smithi033.stdout:2309: writing smithi03339061-4 from 1179648 to 1712128 tid 1 2021-07-26T16:05:34.228 INFO:tasks.rados.rados.0.smithi033.stdout:2309: writing smithi03339061-4 from 1712128 to 2121728 tid 2 2021-07-26T16:05:34.233 INFO:tasks.rados.rados.0.smithi033.stdout:2309: writing smithi03339061-4 from 2121728 to 2859008 tid 3 2021-07-26T16:05:34.236 INFO:tasks.rados.rados.0.smithi033.stdout:2309: writing smithi03339061-4 from 2859008 to 3317760 tid 4 2021-07-26T16:05:34.237 INFO:tasks.rados.rados.0.smithi033.stdout:2310: snap_remove snap 216 2021-07-26T16:05:34.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:34 smithi096 bash[33981]: cluster 2021-07-26T16:05:33.108382+0000 mgr.y (mgr.34104) 348 : cluster [DBG] pgmap v606: 25 pgs: 25 active+clean; 272 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 5.4 MiB/s wr, 47 op/s 2021-07-26T16:05:34.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:34 smithi096 bash[33981]: cluster 2021-07-26T16:05:33.203304+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2021-07-26T16:05:34.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:34 smithi033 bash[41341]: cluster 2021-07-26T16:05:33.108382+0000 mgr.y (mgr.34104) 348 : cluster [DBG] pgmap v606: 25 pgs: 25 active+clean; 272 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 5.4 MiB/s wr, 47 op/s 2021-07-26T16:05:34.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:34 smithi033 bash[41341]: cluster 2021-07-26T16:05:33.203304+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2021-07-26T16:05:34.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:34 smithi033 bash[42377]: cluster 2021-07-26T16:05:33.108382+0000 mgr.y (mgr.34104) 348 : cluster [DBG] pgmap v606: 25 pgs: 25 active+clean; 272 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 5.4 MiB/s wr, 47 op/s 2021-07-26T16:05:34.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:34 smithi033 bash[42377]: cluster 2021-07-26T16:05:33.203304+0000 mon.a (mon.0) 891 : cluster [DBG] osdmap e528: 8 total, 8 up, 8 in 2021-07-26T16:05:35.234 INFO:tasks.rados.rados.0.smithi033.stdout:2310: done (2 left) 2021-07-26T16:05:35.235 INFO:tasks.rados.rados.0.smithi033.stdout:2311: snap_create 2021-07-26T16:05:35.235 INFO:tasks.rados.rados.0.smithi033.stdout:2308: expect (ObjNum 658 snap 213 seq_num 658) 2021-07-26T16:05:35.339 INFO:tasks.rados.rados.0.smithi033.stdout:2309: finishing write tid 1 to smithi03339061-4 2021-07-26T16:05:35.340 INFO:tasks.rados.rados.0.smithi033.stdout:2309: finishing write tid 2 to smithi03339061-4 2021-07-26T16:05:35.340 INFO:tasks.rados.rados.0.smithi033.stdout:2309: finishing write tid 3 to smithi03339061-4 2021-07-26T16:05:35.340 INFO:tasks.rados.rados.0.smithi033.stdout:2309: finishing write tid 4 to smithi03339061-4 2021-07-26T16:05:35.341 INFO:tasks.rados.rados.0.smithi033.stdout:2309: finishing write tid 5 to smithi03339061-4 2021-07-26T16:05:35.341 INFO:tasks.rados.rados.0.smithi033.stdout:2309: finishing write tid 6 to smithi03339061-4 2021-07-26T16:05:35.341 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1250 (ObjNum 700 snap 232 seq_num 700) dirty exists 2021-07-26T16:05:35.341 INFO:tasks.rados.rados.0.smithi033.stdout:2309: left oid 4 (ObjNum 700 snap 232 seq_num 700) 2021-07-26T16:05:35.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:35 smithi096 bash[33981]: cluster 2021-07-26T16:05:34.208502+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2021-07-26T16:05:35.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:35 smithi033 bash[41341]: cluster 2021-07-26T16:05:34.208502+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2021-07-26T16:05:35.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:35 smithi033 bash[42377]: cluster 2021-07-26T16:05:34.208502+0000 mon.a (mon.0) 892 : cluster [DBG] osdmap e529: 8 total, 8 up, 8 in 2021-07-26T16:05:36.133 INFO:tasks.rados.rados.0.smithi033.stdout:2308: done (2 left) 2021-07-26T16:05:36.133 INFO:tasks.rados.rados.0.smithi033.stdout:2309: done (1 left) 2021-07-26T16:05:36.134 INFO:tasks.rados.rados.0.smithi033.stdout:2311: done (0 left) 2021-07-26T16:05:36.134 INFO:tasks.rados.rados.0.smithi033.stdout:2312: snap_remove snap 229 2021-07-26T16:05:36.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:36 smithi096 bash[33981]: cluster 2021-07-26T16:05:35.109091+0000 mgr.y (mgr.34104) 349 : cluster [DBG] pgmap v609: 25 pgs: 25 active+clean; 274 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 3.6 MiB/s wr, 27 op/s 2021-07-26T16:05:36.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:36 smithi096 bash[33981]: cluster 2021-07-26T16:05:35.228447+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2021-07-26T16:05:36.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:36 smithi096 bash[33981]: cluster 2021-07-26T16:05:36.129845+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2021-07-26T16:05:36.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:36 smithi033 bash[41341]: cluster 2021-07-26T16:05:35.109091+0000 mgr.y (mgr.34104) 349 : cluster [DBG] pgmap v609: 25 pgs: 25 active+clean; 274 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 3.6 MiB/s wr, 27 op/s 2021-07-26T16:05:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:36 smithi033 bash[41341]: cluster 2021-07-26T16:05:35.228447+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2021-07-26T16:05:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:36 smithi033 bash[41341]: cluster 2021-07-26T16:05:36.129845+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2021-07-26T16:05:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:36 smithi033 bash[42377]: cluster 2021-07-26T16:05:35.109091+0000 mgr.y (mgr.34104) 349 : cluster [DBG] pgmap v609: 25 pgs: 25 active+clean; 274 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 5.5 MiB/s rd, 3.6 MiB/s wr, 27 op/s 2021-07-26T16:05:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:36 smithi033 bash[42377]: cluster 2021-07-26T16:05:35.228447+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e530: 8 total, 8 up, 8 in 2021-07-26T16:05:36.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:36 smithi033 bash[42377]: cluster 2021-07-26T16:05:36.129845+0000 mon.a (mon.0) 894 : cluster [DBG] osdmap e531: 8 total, 8 up, 8 in 2021-07-26T16:05:37.147 INFO:tasks.rados.rados.0.smithi033.stdout:2312: done (0 left) 2021-07-26T16:05:37.147 INFO:tasks.rados.rados.0.smithi033.stdout:2313: rollback oid 7 current snap is 233 2021-07-26T16:05:37.147 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 7 to 224 2021-07-26T16:05:37.147 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 233 2021-07-26T16:05:37.148 INFO:tasks.rados.rados.0.smithi033.stdout:2314: seq_num 701 ranges {2015232=548864,2564096=696320,3260416=540672,3801088=368640} 2021-07-26T16:05:37.162 INFO:tasks.rados.rados.0.smithi033.stdout:2314: writing smithi03339061-19 from 2015232 to 2564096 tid 1 2021-07-26T16:05:37.167 INFO:tasks.rados.rados.0.smithi033.stdout:2314: writing smithi03339061-19 from 2564096 to 3260416 tid 2 2021-07-26T16:05:37.170 INFO:tasks.rados.rados.0.smithi033.stdout:2314: writing smithi03339061-19 from 3260416 to 3801088 tid 3 2021-07-26T16:05:37.174 INFO:tasks.rados.rados.0.smithi033.stdout:2314: writing smithi03339061-19 from 3801088 to 4169728 tid 4 2021-07-26T16:05:37.174 INFO:tasks.rados.rados.0.smithi033.stdout:2315: rollback oid 48 current snap is 233 2021-07-26T16:05:37.174 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 48 to 231 2021-07-26T16:05:37.174 INFO:tasks.rados.rados.0.smithi033.stdout:2313: finishing rollback tid 0 to smithi03339061-7 2021-07-26T16:05:37.175 INFO:tasks.rados.rados.0.smithi033.stdout:2313: finishing rollback tid 1 to smithi03339061-7 2021-07-26T16:05:37.175 INFO:tasks.rados.rados.0.smithi033.stdout:2313: finishing rollback tid 2 to smithi03339061-7 2021-07-26T16:05:37.175 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1114 (ObjNum 678 snap 222 seq_num 678) dirty exists 2021-07-26T16:05:37.175 INFO:tasks.rados.rados.0.smithi033.stdout:2313: done (2 left) 2021-07-26T16:05:37.175 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 233 2021-07-26T16:05:37.176 INFO:tasks.rados.rados.0.smithi033.stdout:2314: finishing write tid 1 to smithi03339061-19 2021-07-26T16:05:37.176 INFO:tasks.rados.rados.0.smithi033.stdout:2314: finishing write tid 2 to smithi03339061-19 2021-07-26T16:05:37.176 INFO:tasks.rados.rados.0.smithi033.stdout:2316: seq_num 702 ranges {20725760=565248,21291008=581632,21872640=745472,22618112=278528} 2021-07-26T16:05:37.293 INFO:tasks.rados.rados.0.smithi033.stdout:2316: writing smithi03339061-32 from 20725760 to 21291008 tid 1 2021-07-26T16:05:37.296 INFO:tasks.rados.rados.0.smithi033.stdout:2316: writing smithi03339061-32 from 21291008 to 21872640 tid 2 2021-07-26T16:05:37.300 INFO:tasks.rados.rados.0.smithi033.stdout:2316: writing smithi03339061-32 from 21872640 to 22618112 tid 3 2021-07-26T16:05:37.302 INFO:tasks.rados.rados.0.smithi033.stdout:2316: writing smithi03339061-32 from 22618112 to 22896640 tid 4 2021-07-26T16:05:37.302 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 233 2021-07-26T16:05:37.303 INFO:tasks.rados.rados.0.smithi033.stdout:2314: finishing write tid 3 to smithi03339061-19 2021-07-26T16:05:37.303 INFO:tasks.rados.rados.0.smithi033.stdout:2317: seq_num 703 ranges {2703360=581632,3284992=458752,3743744=557056,4300800=417792,4718592=172032} 2021-07-26T16:05:37.321 INFO:tasks.rados.rados.0.smithi033.stdout:2317: writing smithi03339061-41 from 2703360 to 3284992 tid 1 2021-07-26T16:05:37.323 INFO:tasks.rados.rados.0.smithi033.stdout:2317: writing smithi03339061-41 from 3284992 to 3743744 tid 2 2021-07-26T16:05:37.326 INFO:tasks.rados.rados.0.smithi033.stdout:2317: writing smithi03339061-41 from 3743744 to 4300800 tid 3 2021-07-26T16:05:37.333 INFO:tasks.rados.rados.0.smithi033.stdout:2317: writing smithi03339061-41 from 4300800 to 4718592 tid 4 2021-07-26T16:05:37.333 INFO:tasks.rados.rados.0.smithi033.stdout:2317: writing smithi03339061-41 from 4718592 to 4890624 tid 5 2021-07-26T16:05:37.333 INFO:tasks.rados.rados.0.smithi033.stdout:2318: read oid 37 snap -1 2021-07-26T16:05:37.333 INFO:tasks.rados.rados.0.smithi033.stdout:2318: expect (ObjNum 609 snap 192 seq_num 609) 2021-07-26T16:05:37.334 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 233 2021-07-26T16:05:37.334 INFO:tasks.rados.rados.0.smithi033.stdout:2314: finishing write tid 4 to smithi03339061-19 2021-07-26T16:05:37.335 INFO:tasks.rados.rados.0.smithi033.stdout:2319: seq_num 704 ranges {0=598016,598016=745472,1343488=712704,2056192=147456} 2021-07-26T16:05:37.335 INFO:tasks.rados.rados.0.smithi033.stdout:2319: writing smithi03339061-36 from 0 to 598016 tid 1 2021-07-26T16:05:37.338 INFO:tasks.rados.rados.0.smithi033.stdout:2319: writing smithi03339061-36 from 598016 to 1343488 tid 2 2021-07-26T16:05:37.342 INFO:tasks.rados.rados.0.smithi033.stdout:2319: writing smithi03339061-36 from 1343488 to 2056192 tid 3 2021-07-26T16:05:37.344 INFO:tasks.rados.rados.0.smithi033.stdout:2319: writing smithi03339061-36 from 2056192 to 2203648 tid 4 2021-07-26T16:05:37.344 INFO:tasks.rados.rados.0.smithi033.stdout:2320: copy_from oid 25 from oid 1 current snap is 233 2021-07-26T16:05:37.345 INFO:tasks.rados.rados.0.smithi033.stdout:2314: finishing write tid 5 to smithi03339061-19 2021-07-26T16:05:37.345 INFO:tasks.rados.rados.0.smithi033.stdout:2321: setattr oid 42 current snap is 233 2021-07-26T16:05:37.345 INFO:tasks.rados.rados.0.smithi033.stdout:2314: finishing write tid 6 to smithi03339061-19 2021-07-26T16:05:37.345 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 881 (ObjNum 701 snap 233 seq_num 701) dirty exists 2021-07-26T16:05:37.346 INFO:tasks.rados.rados.0.smithi033.stdout:2314: left oid 19 (ObjNum 701 snap 233 seq_num 701) 2021-07-26T16:05:37.346 INFO:tasks.rados.rados.0.smithi033.stdout:2315: finishing rollback tid 0 to smithi03339061-48 2021-07-26T16:05:37.346 INFO:tasks.rados.rados.0.smithi033.stdout:2315: finishing rollback tid 1 to smithi03339061-48 2021-07-26T16:05:37.346 INFO:tasks.rados.rados.0.smithi033.stdout:2315: finishing rollback tid 2 to smithi03339061-48 2021-07-26T16:05:37.346 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 888 (ObjNum 602 snap 188 seq_num 602) dirty exists 2021-07-26T16:05:37.347 INFO:tasks.rados.rados.0.smithi033.stdout:2316: finishing write tid 1 to smithi03339061-32 2021-07-26T16:05:37.347 INFO:tasks.rados.rados.0.smithi033.stdout:2316: finishing write tid 2 to smithi03339061-32 2021-07-26T16:05:37.347 INFO:tasks.rados.rados.0.smithi033.stdout:2316: finishing write tid 3 to smithi03339061-32 2021-07-26T16:05:37.347 INFO:tasks.rados.rados.0.smithi033.stdout:2316: finishing write tid 4 to smithi03339061-32 2021-07-26T16:05:37.348 INFO:tasks.rados.rados.0.smithi033.stdout:2316: finishing write tid 5 to smithi03339061-32 2021-07-26T16:05:37.348 INFO:tasks.rados.rados.0.smithi033.stdout:2316: finishing write tid 6 to smithi03339061-32 2021-07-26T16:05:37.348 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1269 (ObjNum 702 snap 233 seq_num 702) dirty exists 2021-07-26T16:05:37.348 INFO:tasks.rados.rados.0.smithi033.stdout:2316: left oid 32 (ObjNum 702 snap 233 seq_num 702) 2021-07-26T16:05:37.348 INFO:tasks.rados.rados.0.smithi033.stdout:2317: finishing write tid 1 to smithi03339061-41 2021-07-26T16:05:37.349 INFO:tasks.rados.rados.0.smithi033.stdout:2317: finishing write tid 2 to smithi03339061-41 2021-07-26T16:05:37.349 INFO:tasks.rados.rados.0.smithi033.stdout:2318: expect (ObjNum 609 snap 192 seq_num 609) 2021-07-26T16:05:37.367 INFO:tasks.rados.rados.0.smithi033.stdout:2317: finishing write tid 3 to smithi03339061-41 2021-07-26T16:05:37.368 INFO:tasks.rados.rados.0.smithi033.stdout:2317: finishing write tid 4 to smithi03339061-41 2021-07-26T16:05:37.368 INFO:tasks.rados.rados.0.smithi033.stdout:2319: finishing write tid 1 to smithi03339061-36 2021-07-26T16:05:37.369 INFO:tasks.rados.rados.0.smithi033.stdout:2317: finishing write tid 5 to smithi03339061-41 2021-07-26T16:05:37.369 INFO:tasks.rados.rados.0.smithi033.stdout:2317: finishing write tid 6 to smithi03339061-41 2021-07-26T16:05:37.369 INFO:tasks.rados.rados.0.smithi033.stdout:2319: finishing write tid 2 to smithi03339061-36 2021-07-26T16:05:37.369 INFO:tasks.rados.rados.0.smithi033.stdout:2317: finishing write tid 7 to smithi03339061-41 2021-07-26T16:05:37.370 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 894 (ObjNum 703 snap 233 seq_num 703) dirty exists 2021-07-26T16:05:37.370 INFO:tasks.rados.rados.0.smithi033.stdout:2317: left oid 41 (ObjNum 703 snap 233 seq_num 703) 2021-07-26T16:05:37.370 INFO:tasks.rados.rados.0.smithi033.stdout:2320: finishing copy_from to smithi03339061-25 2021-07-26T16:05:37.370 INFO:tasks.rados.rados.0.smithi033.stdout:2320: got expected ENOENT (src dne) 2021-07-26T16:05:37.370 INFO:tasks.rados.rados.0.smithi033.stdout:2320: finishing copy_from racing read to smithi03339061-25 2021-07-26T16:05:37.371 INFO:tasks.rados.rados.0.smithi033.stdout:2319: finishing write tid 3 to smithi03339061-36 2021-07-26T16:05:37.371 INFO:tasks.rados.rados.0.smithi033.stdout:2319: finishing write tid 4 to smithi03339061-36 2021-07-26T16:05:37.371 INFO:tasks.rados.rados.0.smithi033.stdout:2319: finishing write tid 5 to smithi03339061-36 2021-07-26T16:05:37.371 INFO:tasks.rados.rados.0.smithi033.stdout:2319: finishing write tid 6 to smithi03339061-36 2021-07-26T16:05:37.372 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 891 (ObjNum 704 snap 233 seq_num 704) dirty exists 2021-07-26T16:05:37.372 INFO:tasks.rados.rados.0.smithi033.stdout:2319: left oid 36 (ObjNum 704 snap 233 seq_num 704) 2021-07-26T16:05:37.372 INFO:tasks.rados.rados.0.smithi033.stdout:2314: done (7 left) 2021-07-26T16:05:37.372 INFO:tasks.rados.rados.0.smithi033.stdout:2315: done (6 left) 2021-07-26T16:05:37.372 INFO:tasks.rados.rados.0.smithi033.stdout:2316: done (5 left) 2021-07-26T16:05:37.373 INFO:tasks.rados.rados.0.smithi033.stdout:2317: done (4 left) 2021-07-26T16:05:37.373 INFO:tasks.rados.rados.0.smithi033.stdout:2318: done (3 left) 2021-07-26T16:05:37.374 INFO:tasks.rados.rados.0.smithi033.stdout:2319: done (2 left) 2021-07-26T16:05:37.375 INFO:tasks.rados.rados.0.smithi033.stdout:2320: done (1 left) 2021-07-26T16:05:37.375 INFO:tasks.rados.rados.0.smithi033.stdout:2322: snap_remove snap 225 2021-07-26T16:05:38.251 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 851 (ObjNum 686 snap 229 seq_num 686) dirty exists 2021-07-26T16:05:38.251 INFO:tasks.rados.rados.0.smithi033.stdout:2321: done (1 left) 2021-07-26T16:05:38.251 INFO:tasks.rados.rados.0.smithi033.stdout:2322: done (0 left) 2021-07-26T16:05:38.252 INFO:tasks.rados.rados.0.smithi033.stdout:2323: snap_create 2021-07-26T16:05:38.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:38 smithi033 bash[41341]: cluster 2021-07-26T16:05:37.109807+0000 mgr.y (mgr.34104) 350 : cluster [DBG] pgmap v612: 25 pgs: 25 active+clean; 276 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.0 MiB/s wr, 3 op/s 2021-07-26T16:05:38.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:38 smithi033 bash[41341]: cluster 2021-07-26T16:05:37.140633+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2021-07-26T16:05:38.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:38 smithi033 bash[42377]: cluster 2021-07-26T16:05:37.109807+0000 mgr.y (mgr.34104) 350 : cluster [DBG] pgmap v612: 25 pgs: 25 active+clean; 276 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.0 MiB/s wr, 3 op/s 2021-07-26T16:05:38.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:38 smithi033 bash[42377]: cluster 2021-07-26T16:05:37.140633+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2021-07-26T16:05:38.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:38 smithi096 bash[33981]: cluster 2021-07-26T16:05:37.109807+0000 mgr.y (mgr.34104) 350 : cluster [DBG] pgmap v612: 25 pgs: 25 active+clean; 276 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 511 B/s rd, 1.0 MiB/s wr, 3 op/s 2021-07-26T16:05:38.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:38 smithi096 bash[33981]: cluster 2021-07-26T16:05:37.140633+0000 mon.a (mon.0) 895 : cluster [DBG] osdmap e532: 8 total, 8 up, 8 in 2021-07-26T16:05:39.255 INFO:tasks.rados.rados.0.smithi033.stdout:2323: done (0 left) 2021-07-26T16:05:39.255 INFO:tasks.rados.rados.0.smithi033.stdout:2324: rmattr oid 49 current snap is 234 2021-07-26T16:05:39.255 INFO:tasks.rados.rados.0.smithi033.stdout:2324: done (0 left) 2021-07-26T16:05:39.256 INFO:tasks.rados.rados.0.smithi033.stdout:2325: snap_remove snap 226 2021-07-26T16:05:39.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:39 smithi033 bash[41341]: cluster 2021-07-26T16:05:38.242052+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2021-07-26T16:05:39.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:39 smithi033 bash[42377]: cluster 2021-07-26T16:05:38.242052+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2021-07-26T16:05:39.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:39 smithi096 bash[33981]: cluster 2021-07-26T16:05:38.242052+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e533: 8 total, 8 up, 8 in 2021-07-26T16:05:40.267 INFO:tasks.rados.rados.0.smithi033.stdout:2325: done (0 left) 2021-07-26T16:05:40.267 INFO:tasks.rados.rados.0.smithi033.stdout:2326: rollback oid 11 current snap is 234 2021-07-26T16:05:40.267 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 11 to 232 2021-07-26T16:05:40.267 INFO:tasks.rados.rados.0.smithi033.stdout:2327: delete oid 36 current snap is 234 2021-07-26T16:05:40.284 INFO:tasks.rados.rados.0.smithi033.stdout:2326: finishing rollback tid 0 to smithi03339061-11 2021-07-26T16:05:40.285 INFO:tasks.rados.rados.0.smithi033.stdout:2326: finishing rollback tid 1 to smithi03339061-11 2021-07-26T16:05:40.286 INFO:tasks.rados.rados.0.smithi033.stdout:2326: finishing rollback tid 2 to smithi03339061-11 2021-07-26T16:05:40.287 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 894 (ObjNum 695 snap 229 seq_num 695) dirty exists 2021-07-26T16:05:40.288 INFO:tasks.rados.rados.0.smithi033.stdout:2326: done (1 left) 2021-07-26T16:05:40.288 INFO:tasks.rados.rados.0.smithi033.stdout:2327: done (0 left) 2021-07-26T16:05:40.289 INFO:tasks.rados.rados.0.smithi033.stdout:2328: copy_from oid 45 from oid 47 current snap is 234 2021-07-26T16:05:40.289 INFO:tasks.rados.rados.0.smithi033.stdout:2329: snap_remove snap 222 2021-07-26T16:05:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:40 smithi033 bash[41341]: cluster 2021-07-26T16:05:39.110499+0000 mgr.y (mgr.34104) 351 : cluster [DBG] pgmap v615: 25 pgs: 25 active+clean; 276 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 522 KiB/s wr, 3 op/s 2021-07-26T16:05:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:40 smithi033 bash[41341]: cluster 2021-07-26T16:05:39.252904+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2021-07-26T16:05:40.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:40 smithi033 bash[42377]: cluster 2021-07-26T16:05:39.110499+0000 mgr.y (mgr.34104) 351 : cluster [DBG] pgmap v615: 25 pgs: 25 active+clean; 276 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 522 KiB/s wr, 3 op/s 2021-07-26T16:05:40.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:40 smithi033 bash[42377]: cluster 2021-07-26T16:05:39.252904+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2021-07-26T16:05:40.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:40 smithi096 bash[33981]: cluster 2021-07-26T16:05:39.110499+0000 mgr.y (mgr.34104) 351 : cluster [DBG] pgmap v615: 25 pgs: 25 active+clean; 276 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 522 KiB/s wr, 3 op/s 2021-07-26T16:05:40.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:40 smithi096 bash[33981]: cluster 2021-07-26T16:05:39.252904+0000 mon.a (mon.0) 897 : cluster [DBG] osdmap e534: 8 total, 8 up, 8 in 2021-07-26T16:05:41.135 INFO:tasks.rados.rados.0.smithi033.stdout:2328: finishing copy_from to smithi03339061-45 2021-07-26T16:05:41.135 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1056 (ObjNum 692 snap 229 seq_num 692) dirty exists 2021-07-26T16:05:41.135 INFO:tasks.rados.rados.0.smithi033.stdout:2328: finishing copy_from racing read to smithi03339061-45 2021-07-26T16:05:41.135 INFO:tasks.rados.rados.0.smithi033.stdout:2328: done (1 left) 2021-07-26T16:05:41.136 INFO:tasks.rados.rados.0.smithi033.stdout:2329: done (0 left) 2021-07-26T16:05:41.136 INFO:tasks.rados.rados.0.smithi033.stdout:2330: setattr oid 24 current snap is 234 2021-07-26T16:05:41.137 INFO:tasks.rados.rados.0.smithi033.stdout:2331: snap_create 2021-07-26T16:05:41.151 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1090 (ObjNum 652 snap 206 seq_num 652) dirty exists 2021-07-26T16:05:41.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:41 smithi033 bash[42377]: cluster 2021-07-26T16:05:40.261782+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2021-07-26T16:05:41.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:41 smithi033 bash[42377]: cluster 2021-07-26T16:05:41.130597+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2021-07-26T16:05:41.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:41 smithi033 bash[41341]: cluster 2021-07-26T16:05:40.261782+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2021-07-26T16:05:41.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:41 smithi033 bash[41341]: cluster 2021-07-26T16:05:41.130597+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2021-07-26T16:05:41.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:41 smithi096 bash[33981]: cluster 2021-07-26T16:05:40.261782+0000 mon.a (mon.0) 898 : cluster [DBG] osdmap e535: 8 total, 8 up, 8 in 2021-07-26T16:05:41.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:41 smithi096 bash[33981]: cluster 2021-07-26T16:05:41.130597+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e536: 8 total, 8 up, 8 in 2021-07-26T16:05:42.150 INFO:tasks.rados.rados.0.smithi033.stdout:2330: done (1 left) 2021-07-26T16:05:42.150 INFO:tasks.rados.rados.0.smithi033.stdout:2331: done (0 left) 2021-07-26T16:05:42.150 INFO:tasks.rados.rados.0.smithi033.stdout:2332: snap_remove snap 224 2021-07-26T16:05:42.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:42 smithi033 bash[41341]: cluster 2021-07-26T16:05:41.111197+0000 mgr.y (mgr.34104) 352 : cluster [DBG] pgmap v618: 25 pgs: 25 active+clean; 271 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.6 MiB/s wr, 7 op/s 2021-07-26T16:05:42.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:42 smithi033 bash[41341]: cluster 2021-07-26T16:05:42.144306+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2021-07-26T16:05:42.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:42 smithi033 bash[42377]: cluster 2021-07-26T16:05:41.111197+0000 mgr.y (mgr.34104) 352 : cluster [DBG] pgmap v618: 25 pgs: 25 active+clean; 271 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.6 MiB/s wr, 7 op/s 2021-07-26T16:05:42.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:42 smithi033 bash[42377]: cluster 2021-07-26T16:05:42.144306+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2021-07-26T16:05:42.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:42 smithi096 bash[33981]: cluster 2021-07-26T16:05:41.111197+0000 mgr.y (mgr.34104) 352 : cluster [DBG] pgmap v618: 25 pgs: 25 active+clean; 271 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 2.4 MiB/s rd, 1.6 MiB/s wr, 7 op/s 2021-07-26T16:05:42.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:42 smithi096 bash[33981]: cluster 2021-07-26T16:05:42.144306+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e537: 8 total, 8 up, 8 in 2021-07-26T16:05:43.153 INFO:tasks.rados.rados.0.smithi033.stdout:2332: done (0 left) 2021-07-26T16:05:43.154 INFO:tasks.rados.rados.0.smithi033.stdout:2333: delete oid 29 current snap is 235 2021-07-26T16:05:43.158 INFO:tasks.rados.rados.0.smithi033.stdout:2333: done (0 left) 2021-07-26T16:05:43.158 INFO:tasks.rados.rados.0.smithi033.stdout:2334: copy_from oid 14 from oid 22 current snap is 235 2021-07-26T16:05:43.159 INFO:tasks.rados.rados.0.smithi033.stdout:2335: delete oid 40 current snap is 235 2021-07-26T16:05:43.163 INFO:tasks.rados.rados.0.smithi033.stdout:2335: done (1 left) 2021-07-26T16:05:43.164 INFO:tasks.rados.rados.0.smithi033.stdout:2336: delete oid 21 current snap is 235 2021-07-26T16:05:43.173 INFO:tasks.rados.rados.0.smithi033.stdout:2334: finishing copy_from to smithi03339061-14 2021-07-26T16:05:43.173 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 921 (ObjNum 609 snap 192 seq_num 609) dirty exists 2021-07-26T16:05:43.174 INFO:tasks.rados.rados.0.smithi033.stdout:2334: finishing copy_from racing read to smithi03339061-14 2021-07-26T16:05:43.176 INFO:tasks.rados.rados.0.smithi033.stdout:2334: done (1 left) 2021-07-26T16:05:43.177 INFO:tasks.rados.rados.0.smithi033.stdout:2336: done (0 left) 2021-07-26T16:05:43.177 INFO:tasks.rados.rados.0.smithi033.stdout:2337: rmattr oid 35 current snap is 235 2021-07-26T16:05:43.178 INFO:tasks.rados.rados.0.smithi033.stdout:2337: done (0 left) 2021-07-26T16:05:43.178 INFO:tasks.rados.rados.0.smithi033.stdout:2338: read oid 38 snap 231 2021-07-26T16:05:43.178 INFO:tasks.rados.rados.0.smithi033.stdout:2338: expect (ObjNum 667 snap 217 seq_num 667) 2021-07-26T16:05:43.179 INFO:tasks.rados.rados.0.smithi033.stdout:2339: snap_create 2021-07-26T16:05:43.203 INFO:tasks.rados.rados.0.smithi033.stdout:2338: expect (ObjNum 667 snap 217 seq_num 667) 2021-07-26T16:05:43.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:43 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:43.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:43.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:43 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:43.511Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:43.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:43 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:43.511Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:05:44.153 INFO:tasks.rados.rados.0.smithi033.stdout:2338: done (1 left) 2021-07-26T16:05:44.153 INFO:tasks.rados.rados.0.smithi033.stdout:2339: done (0 left) 2021-07-26T16:05:44.153 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 236 2021-07-26T16:05:44.154 INFO:tasks.rados.rados.0.smithi033.stdout:2340: seq_num 709 ranges {606208=679936,1286144=614400,1900544=499712,2400256=491520} 2021-07-26T16:05:44.160 INFO:tasks.rados.rados.0.smithi033.stdout:2340: writing smithi03339061-22 from 606208 to 1286144 tid 1 2021-07-26T16:05:44.165 INFO:tasks.rados.rados.0.smithi033.stdout:2340: writing smithi03339061-22 from 1286144 to 1900544 tid 2 2021-07-26T16:05:44.169 INFO:tasks.rados.rados.0.smithi033.stdout:2340: writing smithi03339061-22 from 1900544 to 2400256 tid 3 2021-07-26T16:05:44.172 INFO:tasks.rados.rados.0.smithi033.stdout:2340: writing smithi03339061-22 from 2400256 to 2891776 tid 4 2021-07-26T16:05:44.172 INFO:tasks.rados.rados.0.smithi033.stdout:2341: read oid 40 snap -1 2021-07-26T16:05:44.172 INFO:tasks.rados.rados.0.smithi033.stdout:2341: expect deleted 2021-07-26T16:05:44.172 INFO:tasks.rados.rados.0.smithi033.stdout:2342: rollback oid 16 current snap is 236 2021-07-26T16:05:44.173 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 16 to 211 2021-07-26T16:05:44.173 INFO:tasks.rados.rados.0.smithi033.stdout:2343: read oid 15 snap -1 2021-07-26T16:05:44.173 INFO:tasks.rados.rados.0.smithi033.stdout:2343: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:05:44.173 INFO:tasks.rados.rados.0.smithi033.stdout:2344: copy_from oid 31 from oid 19 current snap is 236 2021-07-26T16:05:44.174 INFO:tasks.rados.rados.0.smithi033.stdout:2345: copy_from oid 28 from oid 5 current snap is 236 2021-07-26T16:05:44.174 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 236 2021-07-26T16:05:44.174 INFO:tasks.rados.rados.0.smithi033.stdout:2346: seq_num 710 ranges {4472832=696320,5169152=499712,5668864=712704,6381568=393216} 2021-07-26T16:05:44.202 INFO:tasks.rados.rados.0.smithi033.stdout:2346: writing smithi03339061-12 from 4472832 to 5169152 tid 1 2021-07-26T16:05:44.205 INFO:tasks.rados.rados.0.smithi033.stdout:2346: writing smithi03339061-12 from 5169152 to 5668864 tid 2 2021-07-26T16:05:44.210 INFO:tasks.rados.rados.0.smithi033.stdout:2346: writing smithi03339061-12 from 5668864 to 6381568 tid 3 2021-07-26T16:05:44.213 INFO:tasks.rados.rados.0.smithi033.stdout:2346: writing smithi03339061-12 from 6381568 to 6774784 tid 4 2021-07-26T16:05:44.213 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 3 current snap is 236 2021-07-26T16:05:44.213 INFO:tasks.rados.rados.0.smithi033.stdout:2340: finishing write tid 1 to smithi03339061-22 2021-07-26T16:05:44.213 INFO:tasks.rados.rados.0.smithi033.stdout:2347: seq_num 711 ranges {0=712704,712704=786432,1499136=516096,2015232=303104} 2021-07-26T16:05:44.217 INFO:tasks.rados.rados.0.smithi033.stdout:2347: writing smithi03339061-3 from 0 to 712704 tid 1 2021-07-26T16:05:44.222 INFO:tasks.rados.rados.0.smithi033.stdout:2347: writing smithi03339061-3 from 712704 to 1499136 tid 2 2021-07-26T16:05:44.225 INFO:tasks.rados.rados.0.smithi033.stdout:2347: writing smithi03339061-3 from 1499136 to 2015232 tid 3 2021-07-26T16:05:44.228 INFO:tasks.rados.rados.0.smithi033.stdout:2347: writing smithi03339061-3 from 2015232 to 2318336 tid 4 2021-07-26T16:05:44.229 INFO:tasks.rados.rados.0.smithi033.stdout:2348: read oid 2 snap -1 2021-07-26T16:05:44.229 INFO:tasks.rados.rados.0.smithi033.stdout:2348: expect (ObjNum 684 snap 226 seq_num 684) 2021-07-26T16:05:44.229 INFO:tasks.rados.rados.0.smithi033.stdout:2349: rmattr oid 20 current snap is 236 2021-07-26T16:05:44.229 INFO:tasks.rados.rados.0.smithi033.stdout:2340: finishing write tid 2 to smithi03339061-22 2021-07-26T16:05:44.230 INFO:tasks.rados.rados.0.smithi033.stdout:2342: finishing rollback tid 0 to smithi03339061-16 2021-07-26T16:05:44.230 INFO:tasks.rados.rados.0.smithi033.stdout:2342: finishing rollback tid 1 to smithi03339061-16 2021-07-26T16:05:44.230 INFO:tasks.rados.rados.0.smithi033.stdout:2340: finishing write tid 3 to smithi03339061-22 2021-07-26T16:05:44.230 INFO:tasks.rados.rados.0.smithi033.stdout:2340: finishing write tid 4 to smithi03339061-22 2021-07-26T16:05:44.231 INFO:tasks.rados.rados.0.smithi033.stdout:2342: finishing rollback tid 2 to smithi03339061-16 2021-07-26T16:05:44.231 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1272 (ObjNum 622 snap 194 seq_num 622) dirty exists 2021-07-26T16:05:44.231 INFO:tasks.rados.rados.0.smithi033.stdout:2340: finishing write tid 5 to smithi03339061-22 2021-07-26T16:05:44.231 INFO:tasks.rados.rados.0.smithi033.stdout:2340: finishing write tid 6 to smithi03339061-22 2021-07-26T16:05:44.231 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1407 (ObjNum 709 snap 236 seq_num 709) dirty exists 2021-07-26T16:05:44.232 INFO:tasks.rados.rados.0.smithi033.stdout:2340: left oid 22 (ObjNum 709 snap 236 seq_num 709) 2021-07-26T16:05:44.233 INFO:tasks.rados.rados.0.smithi033.stdout:2345: finishing copy_from to smithi03339061-28 2021-07-26T16:05:44.233 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 885 (ObjNum 569 snap 177 seq_num 569) dirty exists 2021-07-26T16:05:44.233 INFO:tasks.rados.rados.0.smithi033.stdout:2345: finishing copy_from racing read to smithi03339061-28 2021-07-26T16:05:44.234 INFO:tasks.rados.rados.0.smithi033.stdout:2344: finishing copy_from to smithi03339061-31 2021-07-26T16:05:44.234 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 881 (ObjNum 701 snap 233 seq_num 701) dirty exists 2021-07-26T16:05:44.234 INFO:tasks.rados.rados.0.smithi033.stdout:2344: finishing copy_from racing read to smithi03339061-31 2021-07-26T16:05:44.234 INFO:tasks.rados.rados.0.smithi033.stdout:2346: finishing write tid 1 to smithi03339061-12 2021-07-26T16:05:44.234 INFO:tasks.rados.rados.0.smithi033.stdout:2346: finishing write tid 2 to smithi03339061-12 2021-07-26T16:05:44.235 INFO:tasks.rados.rados.0.smithi033.stdout:2346: finishing write tid 3 to smithi03339061-12 2021-07-26T16:05:44.235 INFO:tasks.rados.rados.0.smithi033.stdout:2346: finishing write tid 4 to smithi03339061-12 2021-07-26T16:05:44.235 INFO:tasks.rados.rados.0.smithi033.stdout:2346: finishing write tid 5 to smithi03339061-12 2021-07-26T16:05:44.235 INFO:tasks.rados.rados.0.smithi033.stdout:2346: finishing write tid 6 to smithi03339061-12 2021-07-26T16:05:44.236 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1241 (ObjNum 710 snap 236 seq_num 710) dirty exists 2021-07-26T16:05:44.236 INFO:tasks.rados.rados.0.smithi033.stdout:2346: left oid 12 (ObjNum 710 snap 236 seq_num 710) 2021-07-26T16:05:44.236 INFO:tasks.rados.rados.0.smithi033.stdout:2343: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:05:44.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:44 smithi033 bash[42377]: cluster 2021-07-26T16:05:43.112050+0000 mgr.y (mgr.34104) 353 : cluster [DBG] pgmap v621: 25 pgs: 25 active+clean; 275 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.6 MiB/s wr, 17 op/s 2021-07-26T16:05:44.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:44 smithi033 bash[42377]: cluster 2021-07-26T16:05:43.147564+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2021-07-26T16:05:44.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:44 smithi033 bash[41341]: cluster 2021-07-26T16:05:43.112050+0000 mgr.y (mgr.34104) 353 : cluster [DBG] pgmap v621: 25 pgs: 25 active+clean; 275 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.6 MiB/s wr, 17 op/s 2021-07-26T16:05:44.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:44 smithi033 bash[41341]: cluster 2021-07-26T16:05:43.147564+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2021-07-26T16:05:44.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:44 smithi096 bash[33981]: cluster 2021-07-26T16:05:43.112050+0000 mgr.y (mgr.34104) 353 : cluster [DBG] pgmap v621: 25 pgs: 25 active+clean; 275 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 1023 B/s rd, 2.6 MiB/s wr, 17 op/s 2021-07-26T16:05:44.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:44 smithi096 bash[33981]: cluster 2021-07-26T16:05:43.147564+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e538: 8 total, 8 up, 8 in 2021-07-26T16:05:45.144 INFO:tasks.rados.rados.0.smithi033.stdout:2347: finishing write tid 1 to smithi03339061-3 2021-07-26T16:05:45.144 INFO:tasks.rados.rados.0.smithi033.stdout:2347: finishing write tid 2 to smithi03339061-3 2021-07-26T16:05:45.144 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1251 (ObjNum 625 snap 196 seq_num 625) dirty exists 2021-07-26T16:05:45.144 INFO:tasks.rados.rados.0.smithi033.stdout:2347: finishing write tid 3 to smithi03339061-3 2021-07-26T16:05:45.145 INFO:tasks.rados.rados.0.smithi033.stdout:2347: finishing write tid 4 to smithi03339061-3 2021-07-26T16:05:45.145 INFO:tasks.rados.rados.0.smithi033.stdout:2347: finishing write tid 5 to smithi03339061-3 2021-07-26T16:05:45.145 INFO:tasks.rados.rados.0.smithi033.stdout:2347: finishing write tid 6 to smithi03339061-3 2021-07-26T16:05:45.145 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 856 (ObjNum 711 snap 236 seq_num 711) dirty exists 2021-07-26T16:05:45.145 INFO:tasks.rados.rados.0.smithi033.stdout:2347: left oid 3 (ObjNum 711 snap 236 seq_num 711) 2021-07-26T16:05:45.146 INFO:tasks.rados.rados.0.smithi033.stdout:2340: done (9 left) 2021-07-26T16:05:45.146 INFO:tasks.rados.rados.0.smithi033.stdout:2341: done (8 left) 2021-07-26T16:05:45.146 INFO:tasks.rados.rados.0.smithi033.stdout:2342: done (7 left) 2021-07-26T16:05:45.146 INFO:tasks.rados.rados.0.smithi033.stdout:2343: done (6 left) 2021-07-26T16:05:45.147 INFO:tasks.rados.rados.0.smithi033.stdout:2344: done (5 left) 2021-07-26T16:05:45.147 INFO:tasks.rados.rados.0.smithi033.stdout:2345: done (4 left) 2021-07-26T16:05:45.147 INFO:tasks.rados.rados.0.smithi033.stdout:2346: done (3 left) 2021-07-26T16:05:45.147 INFO:tasks.rados.rados.0.smithi033.stdout:2347: done (2 left) 2021-07-26T16:05:45.147 INFO:tasks.rados.rados.0.smithi033.stdout:2349: done (1 left) 2021-07-26T16:05:45.148 INFO:tasks.rados.rados.0.smithi033.stdout:2350: rollback oid 24 current snap is 236 2021-07-26T16:05:45.148 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 24 to 223 2021-07-26T16:05:45.148 INFO:tasks.rados.rados.0.smithi033.stdout:2348: expect (ObjNum 684 snap 226 seq_num 684) 2021-07-26T16:05:45.263 INFO:tasks.rados.rados.0.smithi033.stdout:2350: finishing rollback tid 0 to smithi03339061-24 2021-07-26T16:05:45.263 INFO:tasks.rados.rados.0.smithi033.stdout:2350: finishing rollback tid 1 to smithi03339061-24 2021-07-26T16:05:45.263 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1101 (ObjNum 2006919776 snap 22002 seq_num 2006747216) dirty dne 2021-07-26T16:05:45.264 INFO:tasks.rados.rados.0.smithi033.stdout:2348: done (1 left) 2021-07-26T16:05:45.264 INFO:tasks.rados.rados.0.smithi033.stdout:2350: done (0 left) 2021-07-26T16:05:45.264 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 236 2021-07-26T16:05:45.264 INFO:tasks.rados.rados.0.smithi033.stdout:2351: seq_num 712 ranges {2891776=729088,3620864=671744,4292608=671744,4964352=262144} 2021-07-26T16:05:45.291 INFO:tasks.rados.rados.0.smithi033.stdout:2351: writing smithi03339061-13 from 2891776 to 3620864 tid 1 2021-07-26T16:05:45.295 INFO:tasks.rados.rados.0.smithi033.stdout:2351: writing smithi03339061-13 from 3620864 to 4292608 tid 2 2021-07-26T16:05:45.299 INFO:tasks.rados.rados.0.smithi033.stdout:2351: writing smithi03339061-13 from 4292608 to 4964352 tid 3 2021-07-26T16:05:45.301 INFO:tasks.rados.rados.0.smithi033.stdout:2351: writing smithi03339061-13 from 4964352 to 5226496 tid 4 2021-07-26T16:05:45.302 INFO:tasks.rados.rados.0.smithi033.stdout:2352: read oid 42 snap -1 2021-07-26T16:05:45.302 INFO:tasks.rados.rados.0.smithi033.stdout:2352: expect (ObjNum 686 snap 229 seq_num 686) 2021-07-26T16:05:45.302 INFO:tasks.rados.rados.0.smithi033.stdout:2353: rmattr oid 8 current snap is 236 2021-07-26T16:05:45.302 INFO:tasks.rados.rados.0.smithi033.stdout:2351: finishing write tid 1 to smithi03339061-13 2021-07-26T16:05:45.303 INFO:tasks.rados.rados.0.smithi033.stdout:2354: read oid 12 snap -1 2021-07-26T16:05:45.303 INFO:tasks.rados.rados.0.smithi033.stdout:2354: expect (ObjNum 710 snap 236 seq_num 710) 2021-07-26T16:05:45.303 INFO:tasks.rados.rados.0.smithi033.stdout:2355: setattr oid 45 current snap is 236 2021-07-26T16:05:45.304 INFO:tasks.rados.rados.0.smithi033.stdout:2356: snap_create 2021-07-26T16:05:45.304 INFO:tasks.rados.rados.0.smithi033.stdout:2351: finishing write tid 2 to smithi03339061-13 2021-07-26T16:05:45.308 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 882 (ObjNum 1902530161 snap 1833918560 seq_num 1381985887) dirty exists 2021-07-26T16:05:45.308 INFO:tasks.rados.rados.0.smithi033.stdout:2351: finishing write tid 3 to smithi03339061-13 2021-07-26T16:05:45.309 INFO:tasks.rados.rados.0.smithi033.stdout:2351: finishing write tid 4 to smithi03339061-13 2021-07-26T16:05:45.310 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1409 (ObjNum 692 snap 229 seq_num 692) dirty exists 2021-07-26T16:05:45.310 INFO:tasks.rados.rados.0.smithi033.stdout:2351: finishing write tid 5 to smithi03339061-13 2021-07-26T16:05:45.312 INFO:tasks.rados.rados.0.smithi033.stdout:2351: finishing write tid 6 to smithi03339061-13 2021-07-26T16:05:45.313 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1256 (ObjNum 712 snap 236 seq_num 712) dirty exists 2021-07-26T16:05:45.313 INFO:tasks.rados.rados.0.smithi033.stdout:2351: left oid 13 (ObjNum 712 snap 236 seq_num 712) 2021-07-26T16:05:45.315 INFO:tasks.rados.rados.0.smithi033.stdout:2352: expect (ObjNum 686 snap 229 seq_num 686) 2021-07-26T16:05:45.374 INFO:tasks.rados.rados.0.smithi033.stdout:2354: expect (ObjNum 710 snap 236 seq_num 710) 2021-07-26T16:05:45.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:45 smithi033 bash[41341]: cluster 2021-07-26T16:05:44.149386+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2021-07-26T16:05:45.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:45 smithi033 bash[42377]: cluster 2021-07-26T16:05:44.149386+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2021-07-26T16:05:45.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:45 smithi096 bash[33981]: cluster 2021-07-26T16:05:44.149386+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e539: 8 total, 8 up, 8 in 2021-07-26T16:05:46.141 INFO:tasks.rados.rados.0.smithi033.stdout:2351: done (5 left) 2021-07-26T16:05:46.142 INFO:tasks.rados.rados.0.smithi033.stdout:2352: done (4 left) 2021-07-26T16:05:46.142 INFO:tasks.rados.rados.0.smithi033.stdout:2353: done (3 left) 2021-07-26T16:05:46.142 INFO:tasks.rados.rados.0.smithi033.stdout:2354: done (2 left) 2021-07-26T16:05:46.142 INFO:tasks.rados.rados.0.smithi033.stdout:2355: done (1 left) 2021-07-26T16:05:46.143 INFO:tasks.rados.rados.0.smithi033.stdout:2356: done (0 left) 2021-07-26T16:05:46.143 INFO:tasks.rados.rados.0.smithi033.stdout:2357: delete oid 23 current snap is 237 2021-07-26T16:05:46.145 INFO:tasks.rados.rados.0.smithi033.stdout:2357: done (0 left) 2021-07-26T16:05:46.145 INFO:tasks.rados.rados.0.smithi033.stdout:2358: read oid 33 snap 223 2021-07-26T16:05:46.145 INFO:tasks.rados.rados.0.smithi033.stdout:2358: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:05:46.146 INFO:tasks.rados.rados.0.smithi033.stdout:2359: rmattr oid 11 current snap is 237 2021-07-26T16:05:46.146 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 237 2021-07-26T16:05:46.146 INFO:tasks.rados.rados.0.smithi033.stdout:2360: seq_num 714 ranges {8822784=761856,9584640=442368,10027008=688128,10715136=475136} 2021-07-26T16:05:46.201 INFO:tasks.rados.rados.0.smithi033.stdout:2360: writing smithi03339061-27 from 8822784 to 9584640 tid 1 2021-07-26T16:05:46.204 INFO:tasks.rados.rados.0.smithi033.stdout:2360: writing smithi03339061-27 from 9584640 to 10027008 tid 2 2021-07-26T16:05:46.207 INFO:tasks.rados.rados.0.smithi033.stdout:2360: writing smithi03339061-27 from 10027008 to 10715136 tid 3 2021-07-26T16:05:46.211 INFO:tasks.rados.rados.0.smithi033.stdout:2360: writing smithi03339061-27 from 10715136 to 11190272 tid 4 2021-07-26T16:05:46.211 INFO:tasks.rados.rados.0.smithi033.stdout:2361: rollback oid 8 current snap is 237 2021-07-26T16:05:46.211 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 8 to 211 2021-07-26T16:05:46.212 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 896 (ObjNum 695 snap 229 seq_num 695) dirty exists 2021-07-26T16:05:46.212 INFO:tasks.rados.rados.0.smithi033.stdout:2358: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:05:46.290 INFO:tasks.rados.rados.0.smithi033.stdout:2360: finishing write tid 1 to smithi03339061-27 2021-07-26T16:05:46.290 INFO:tasks.rados.rados.0.smithi033.stdout:2360: finishing write tid 2 to smithi03339061-27 2021-07-26T16:05:46.290 INFO:tasks.rados.rados.0.smithi033.stdout:2360: finishing write tid 3 to smithi03339061-27 2021-07-26T16:05:46.291 INFO:tasks.rados.rados.0.smithi033.stdout:2361: finishing rollback tid 0 to smithi03339061-8 2021-07-26T16:05:46.291 INFO:tasks.rados.rados.0.smithi033.stdout:2360: finishing write tid 4 to smithi03339061-27 2021-07-26T16:05:46.291 INFO:tasks.rados.rados.0.smithi033.stdout:2361: finishing rollback tid 1 to smithi03339061-8 2021-07-26T16:05:46.291 INFO:tasks.rados.rados.0.smithi033.stdout:2360: finishing write tid 5 to smithi03339061-27 2021-07-26T16:05:46.292 INFO:tasks.rados.rados.0.smithi033.stdout:2361: finishing rollback tid 2 to smithi03339061-8 2021-07-26T16:05:46.292 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 885 (ObjNum 570 snap 177 seq_num 570) dirty exists 2021-07-26T16:05:46.292 INFO:tasks.rados.rados.0.smithi033.stdout:2360: finishing write tid 6 to smithi03339061-27 2021-07-26T16:05:46.292 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1147 (ObjNum 714 snap 237 seq_num 714) dirty exists 2021-07-26T16:05:46.292 INFO:tasks.rados.rados.0.smithi033.stdout:2360: left oid 27 (ObjNum 714 snap 237 seq_num 714) 2021-07-26T16:05:46.293 INFO:tasks.rados.rados.0.smithi033.stdout:2358: done (3 left) 2021-07-26T16:05:46.293 INFO:tasks.rados.rados.0.smithi033.stdout:2359: done (2 left) 2021-07-26T16:05:46.293 INFO:tasks.rados.rados.0.smithi033.stdout:2360: done (1 left) 2021-07-26T16:05:46.293 INFO:tasks.rados.rados.0.smithi033.stdout:2361: done (0 left) 2021-07-26T16:05:46.293 INFO:tasks.rados.rados.0.smithi033.stdout:2362: setattr oid 24 current snap is 237 2021-07-26T16:05:46.294 INFO:tasks.rados.rados.0.smithi033.stdout:2363: rollback oid 30 current snap is 237 2021-07-26T16:05:46.295 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 30 to 211 2021-07-26T16:05:46.295 INFO:tasks.rados.rados.0.smithi033.stdout:2364: snap_create 2021-07-26T16:05:46.300 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1102 (ObjNum 1465801058 snap 1867995495 seq_num 1600351328) dirty exists 2021-07-26T16:05:46.301 INFO:tasks.rados.rados.0.smithi033.stdout:2363: finishing rollback tid 0 to smithi03339061-30 2021-07-26T16:05:46.303 INFO:tasks.rados.rados.0.smithi033.stdout:2363: finishing rollback tid 1 to smithi03339061-30 2021-07-26T16:05:46.303 INFO:tasks.rados.rados.0.smithi033.stdout:2363: finishing rollback tid 2 to smithi03339061-30 2021-07-26T16:05:46.304 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 1106 (ObjNum 649 snap 206 seq_num 649) dirty exists 2021-07-26T16:05:46.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:46 smithi033 bash[41341]: cluster 2021-07-26T16:05:45.112795+0000 mgr.y (mgr.34104) 354 : cluster [DBG] pgmap v624: 25 pgs: 25 active+clean; 279 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 2.0 MiB/s wr, 13 op/s 2021-07-26T16:05:46.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:46 smithi033 bash[41341]: cluster 2021-07-26T16:05:46.136688+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2021-07-26T16:05:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:46 smithi033 bash[42377]: cluster 2021-07-26T16:05:45.112795+0000 mgr.y (mgr.34104) 354 : cluster [DBG] pgmap v624: 25 pgs: 25 active+clean; 279 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 2.0 MiB/s wr, 13 op/s 2021-07-26T16:05:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:46 smithi033 bash[42377]: cluster 2021-07-26T16:05:46.136688+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2021-07-26T16:05:46.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:46 smithi096 bash[33981]: cluster 2021-07-26T16:05:45.112795+0000 mgr.y (mgr.34104) 354 : cluster [DBG] pgmap v624: 25 pgs: 25 active+clean; 279 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 255 B/s rd, 2.0 MiB/s wr, 13 op/s 2021-07-26T16:05:46.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:46 smithi096 bash[33981]: cluster 2021-07-26T16:05:46.136688+0000 mon.a (mon.0) 903 : cluster [DBG] osdmap e540: 8 total, 8 up, 8 in 2021-07-26T16:05:47.179 INFO:tasks.rados.rados.0.smithi033.stdout:2362: done (2 left) 2021-07-26T16:05:47.180 INFO:tasks.rados.rados.0.smithi033.stdout:2363: done (1 left) 2021-07-26T16:05:47.180 INFO:tasks.rados.rados.0.smithi033.stdout:2364: done (0 left) 2021-07-26T16:05:47.180 INFO:tasks.rados.rados.0.smithi033.stdout:2365: rollback oid 14 current snap is 238 2021-07-26T16:05:47.180 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 14 to 237 2021-07-26T16:05:47.181 INFO:tasks.rados.rados.0.smithi033.stdout:2366: snap_create 2021-07-26T16:05:47.185 INFO:tasks.rados.rados.0.smithi033.stdout:2365: finishing rollback tid 0 to smithi03339061-14 2021-07-26T16:05:47.185 INFO:tasks.rados.rados.0.smithi033.stdout:2365: finishing rollback tid 1 to smithi03339061-14 2021-07-26T16:05:47.186 INFO:tasks.rados.rados.0.smithi033.stdout:2365: finishing rollback tid 2 to smithi03339061-14 2021-07-26T16:05:47.186 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1259 (ObjNum 609 snap 192 seq_num 609) dirty exists 2021-07-26T16:05:48.188 INFO:tasks.rados.rados.0.smithi033.stdout:2365: done (1 left) 2021-07-26T16:05:48.189 INFO:tasks.rados.rados.0.smithi033.stdout:2366: done (0 left) 2021-07-26T16:05:48.189 INFO:tasks.rados.rados.0.smithi033.stdout:2367: read oid 49 snap -1 2021-07-26T16:05:48.189 INFO:tasks.rados.rados.0.smithi033.stdout:2367: expect deleted 2021-07-26T16:05:48.190 INFO:tasks.rados.rados.0.smithi033.stdout:2368: rmattr oid 6 current snap is 239 2021-07-26T16:05:48.190 INFO:tasks.rados.rados.0.smithi033.stdout:2368: done (1 left) 2021-07-26T16:05:48.190 INFO:tasks.rados.rados.0.smithi033.stdout:2369: rollback oid 28 current snap is 239 2021-07-26T16:05:48.190 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 28 to 234 2021-07-26T16:05:48.190 INFO:tasks.rados.rados.0.smithi033.stdout:2370: copy_from oid 34 from oid 35 current snap is 239 2021-07-26T16:05:48.191 INFO:tasks.rados.rados.0.smithi033.stdout:2371: delete oid 27 current snap is 239 2021-07-26T16:05:48.196 INFO:tasks.rados.rados.0.smithi033.stdout:2367: done (3 left) 2021-07-26T16:05:48.196 INFO:tasks.rados.rados.0.smithi033.stdout:2371: done (2 left) 2021-07-26T16:05:48.196 INFO:tasks.rados.rados.0.smithi033.stdout:2372: read oid 19 snap 211 2021-07-26T16:05:48.196 INFO:tasks.rados.rados.0.smithi033.stdout:2372: expect (ObjNum 643 snap 204 seq_num 643) 2021-07-26T16:05:48.197 INFO:tasks.rados.rados.0.smithi033.stdout:2373: snap_create 2021-07-26T16:05:48.197 INFO:tasks.rados.rados.0.smithi033.stdout:2369: finishing rollback tid 0 to smithi03339061-28 2021-07-26T16:05:48.199 INFO:tasks.rados.rados.0.smithi033.stdout:2369: finishing rollback tid 1 to smithi03339061-28 2021-07-26T16:05:48.199 INFO:tasks.rados.rados.0.smithi033.stdout:2369: finishing rollback tid 2 to smithi03339061-28 2021-07-26T16:05:48.199 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1244 (ObjNum 556 snap 175 seq_num 556) dirty exists 2021-07-26T16:05:48.203 INFO:tasks.rados.rados.0.smithi033.stdout:2372: expect (ObjNum 643 snap 204 seq_num 643) 2021-07-26T16:05:48.238 INFO:tasks.rados.rados.0.smithi033.stdout:2370: finishing copy_from to smithi03339061-34 2021-07-26T16:05:48.238 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 876 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:05:48.238 INFO:tasks.rados.rados.0.smithi033.stdout:2370: finishing copy_from racing read to smithi03339061-34 2021-07-26T16:05:48.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:48 smithi033 bash[41341]: cluster 2021-07-26T16:05:47.113471+0000 mgr.y (mgr.34104) 355 : cluster [DBG] pgmap v626: 25 pgs: 25 active+clean; 291 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2021-07-26T16:05:48.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:48 smithi033 bash[41341]: cluster 2021-07-26T16:05:47.176385+0000 mon.a (mon.0) 904 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2021-07-26T16:05:48.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:48 smithi033 bash[42377]: cluster 2021-07-26T16:05:47.113471+0000 mgr.y (mgr.34104) 355 : cluster [DBG] pgmap v626: 25 pgs: 25 active+clean; 291 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2021-07-26T16:05:48.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:48 smithi033 bash[42377]: cluster 2021-07-26T16:05:47.176385+0000 mon.a (mon.0) 904 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2021-07-26T16:05:48.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:48 smithi096 bash[33981]: cluster 2021-07-26T16:05:47.113471+0000 mgr.y (mgr.34104) 355 : cluster [DBG] pgmap v626: 25 pgs: 25 active+clean; 291 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 6.8 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2021-07-26T16:05:48.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:48 smithi096 bash[33981]: cluster 2021-07-26T16:05:47.176385+0000 mon.a (mon.0) 904 : cluster [DBG] osdmap e541: 8 total, 8 up, 8 in 2021-07-26T16:05:49.199 INFO:tasks.rados.rados.0.smithi033.stdout:2369: done (3 left) 2021-07-26T16:05:49.199 INFO:tasks.rados.rados.0.smithi033.stdout:2370: done (2 left) 2021-07-26T16:05:49.199 INFO:tasks.rados.rados.0.smithi033.stdout:2372: done (1 left) 2021-07-26T16:05:49.199 INFO:tasks.rados.rados.0.smithi033.stdout:2373: done (0 left) 2021-07-26T16:05:49.200 INFO:tasks.rados.rados.0.smithi033.stdout:2374: rollback oid 18 current snap is 240 2021-07-26T16:05:49.200 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 18 to 236 2021-07-26T16:05:49.200 INFO:tasks.rados.rados.0.smithi033.stdout:2375: copy_from oid 24 from oid 30 current snap is 240 2021-07-26T16:05:49.200 INFO:tasks.rados.rados.0.smithi033.stdout:2376: copy_from oid 10 from oid 22 current snap is 240 2021-07-26T16:05:49.200 INFO:tasks.rados.rados.0.smithi033.stdout:2377: snap_remove snap 233 2021-07-26T16:05:49.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:49 smithi033 bash[41341]: cluster 2021-07-26T16:05:48.184667+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2021-07-26T16:05:49.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:49 smithi033 bash[42377]: cluster 2021-07-26T16:05:48.184667+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2021-07-26T16:05:49.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:49 smithi096 bash[33981]: cluster 2021-07-26T16:05:48.184667+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e542: 8 total, 8 up, 8 in 2021-07-26T16:05:50.204 INFO:tasks.rados.rados.0.smithi033.stdout:2377: done (3 left) 2021-07-26T16:05:50.205 INFO:tasks.rados.rados.0.smithi033.stdout:2378: read oid 16 snap -1 2021-07-26T16:05:50.205 INFO:tasks.rados.rados.0.smithi033.stdout:2378: expect (ObjNum 622 snap 194 seq_num 622) 2021-07-26T16:05:50.205 INFO:tasks.rados.rados.0.smithi033.stdout:2379: setattr oid 21 current snap is 240 2021-07-26T16:05:50.205 INFO:tasks.rados.rados.0.smithi033.stdout:2374: finishing rollback tid 0 to smithi03339061-18 2021-07-26T16:05:50.205 INFO:tasks.rados.rados.0.smithi033.stdout:2374: finishing rollback tid 1 to smithi03339061-18 2021-07-26T16:05:50.206 INFO:tasks.rados.rados.0.smithi033.stdout:2374: finishing rollback tid 2 to smithi03339061-18 2021-07-26T16:05:50.206 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 1413 (ObjNum 1868720754 snap 1515611732 seq_num 1633707624) dirty exists 2021-07-26T16:05:50.206 INFO:tasks.rados.rados.0.smithi033.stdout:2375: finishing copy_from to smithi03339061-24 2021-07-26T16:05:50.206 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1106 (ObjNum 649 snap 206 seq_num 649) dirty exists 2021-07-26T16:05:50.207 INFO:tasks.rados.rados.0.smithi033.stdout:2375: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:05:50.207 INFO:tasks.rados.rados.0.smithi033.stdout:2376: finishing copy_from to smithi03339061-10 2021-07-26T16:05:50.207 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1407 (ObjNum 709 snap 236 seq_num 709) dirty exists 2021-07-26T16:05:50.207 INFO:tasks.rados.rados.0.smithi033.stdout:2376: finishing copy_from racing read to smithi03339061-10 2021-07-26T16:05:50.208 INFO:tasks.rados.rados.0.smithi033.stdout:2374: done (4 left) 2021-07-26T16:05:50.208 INFO:tasks.rados.rados.0.smithi033.stdout:2375: done (3 left) 2021-07-26T16:05:50.208 INFO:tasks.rados.rados.0.smithi033.stdout:2376: done (2 left) 2021-07-26T16:05:50.208 INFO:tasks.rados.rados.0.smithi033.stdout:2380: rmattr oid 7 current snap is 240 2021-07-26T16:05:50.209 INFO:tasks.rados.rados.0.smithi033.stdout:2381: rmattr oid 1 current snap is 240 2021-07-26T16:05:50.209 INFO:tasks.rados.rados.0.smithi033.stdout:2381: done (3 left) 2021-07-26T16:05:50.209 INFO:tasks.rados.rados.0.smithi033.stdout:2382: read oid 2 snap 232 2021-07-26T16:05:50.209 INFO:tasks.rados.rados.0.smithi033.stdout:2382: expect (ObjNum 684 snap 226 seq_num 684) 2021-07-26T16:05:50.210 INFO:tasks.rados.rados.0.smithi033.stdout:2383: read oid 45 snap -1 2021-07-26T16:05:50.210 INFO:tasks.rados.rados.0.smithi033.stdout:2383: expect (ObjNum 692 snap 229 seq_num 692) 2021-07-26T16:05:50.210 INFO:tasks.rados.rados.0.smithi033.stdout:2384: snap_create 2021-07-26T16:05:50.217 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1150 (ObjNum 1750884691 snap 1582195826 seq_num 1651339097) dirty exists 2021-07-26T16:05:50.222 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1152 (ObjNum 678 snap 222 seq_num 678) dirty exists 2021-07-26T16:05:50.230 INFO:tasks.rados.rados.0.smithi033.stdout:2383: expect (ObjNum 692 snap 229 seq_num 692) 2021-07-26T16:05:50.288 INFO:tasks.rados.rados.0.smithi033.stdout:2382: expect (ObjNum 684 snap 226 seq_num 684) 2021-07-26T16:05:50.408 INFO:tasks.rados.rados.0.smithi033.stdout:2378: expect (ObjNum 622 snap 194 seq_num 622) 2021-07-26T16:05:50.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:50 smithi096 bash[33981]: cluster 2021-07-26T16:05:49.114162+0000 mgr.y (mgr.34104) 356 : cluster [DBG] pgmap v629: 25 pgs: 25 active+clean; 295 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.3 MiB/s wr, 18 op/s 2021-07-26T16:05:50.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:50 smithi096 bash[33981]: cluster 2021-07-26T16:05:49.196274+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2021-07-26T16:05:50.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:50 smithi033 bash[41341]: cluster 2021-07-26T16:05:49.114162+0000 mgr.y (mgr.34104) 356 : cluster [DBG] pgmap v629: 25 pgs: 25 active+clean; 295 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.3 MiB/s wr, 18 op/s 2021-07-26T16:05:50.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:50 smithi033 bash[41341]: cluster 2021-07-26T16:05:49.196274+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2021-07-26T16:05:50.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:50 smithi033 bash[42377]: cluster 2021-07-26T16:05:49.114162+0000 mgr.y (mgr.34104) 356 : cluster [DBG] pgmap v629: 25 pgs: 25 active+clean; 295 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 13 MiB/s rd, 2.3 MiB/s wr, 18 op/s 2021-07-26T16:05:50.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:50 smithi033 bash[42377]: cluster 2021-07-26T16:05:49.196274+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e543: 8 total, 8 up, 8 in 2021-07-26T16:05:51.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:51 smithi096 bash[33981]: cluster 2021-07-26T16:05:50.198486+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2021-07-26T16:05:51.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:51 smithi096 bash[33981]: cluster 2021-07-26T16:05:51.134325+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2021-07-26T16:05:51.494 INFO:tasks.rados.rados.0.smithi033.stdout:2378: done (5 left) 2021-07-26T16:05:51.494 INFO:tasks.rados.rados.0.smithi033.stdout:2379: done (4 left) 2021-07-26T16:05:51.494 INFO:tasks.rados.rados.0.smithi033.stdout:2380: done (3 left) 2021-07-26T16:05:51.494 INFO:tasks.rados.rados.0.smithi033.stdout:2382: done (2 left) 2021-07-26T16:05:51.495 INFO:tasks.rados.rados.0.smithi033.stdout:2383: done (1 left) 2021-07-26T16:05:51.495 INFO:tasks.rados.rados.0.smithi033.stdout:2384: done (0 left) 2021-07-26T16:05:51.495 INFO:tasks.rados.rados.0.smithi033.stdout:2385: snap_create 2021-07-26T16:05:51.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:51 smithi033 bash[41341]: cluster 2021-07-26T16:05:50.198486+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2021-07-26T16:05:51.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:51 smithi033 bash[41341]: cluster 2021-07-26T16:05:51.134325+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2021-07-26T16:05:51.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:51 smithi033 bash[42377]: cluster 2021-07-26T16:05:50.198486+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e544: 8 total, 8 up, 8 in 2021-07-26T16:05:51.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:51 smithi033 bash[42377]: cluster 2021-07-26T16:05:51.134325+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e545: 8 total, 8 up, 8 in 2021-07-26T16:05:52.243 INFO:tasks.rados.rados.0.smithi033.stdout:2385: done (0 left) 2021-07-26T16:05:52.247 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 242 2021-07-26T16:05:52.248 INFO:tasks.rados.rados.0.smithi033.stdout:2386: seq_num 716 ranges {22896640=794624,23691264=655360,24346624=704512,25051136=245760} 2021-07-26T16:05:52.381 INFO:tasks.rados.rados.0.smithi033.stdout:2386: writing smithi03339061-32 from 22896640 to 23691264 tid 1 2021-07-26T16:05:52.386 INFO:tasks.rados.rados.0.smithi033.stdout:2386: writing smithi03339061-32 from 23691264 to 24346624 tid 2 2021-07-26T16:05:52.391 INFO:tasks.rados.rados.0.smithi033.stdout:2386: writing smithi03339061-32 from 24346624 to 25051136 tid 3 2021-07-26T16:05:52.392 INFO:tasks.rados.rados.0.smithi033.stdout:2386: writing smithi03339061-32 from 25051136 to 25296896 tid 4 2021-07-26T16:05:52.392 INFO:tasks.rados.rados.0.smithi033.stdout:2387: snap_remove snap 240 2021-07-26T16:05:52.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:52 smithi096 bash[33981]: cluster 2021-07-26T16:05:51.114603+0000 mgr.y (mgr.34104) 357 : cluster [DBG] pgmap v632: 25 pgs: 25 active+clean; 316 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 3.3 MiB/s wr, 28 op/s 2021-07-26T16:05:52.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:52 smithi033 bash[41341]: cluster 2021-07-26T16:05:51.114603+0000 mgr.y (mgr.34104) 357 : cluster [DBG] pgmap v632: 25 pgs: 25 active+clean; 316 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 3.3 MiB/s wr, 28 op/s 2021-07-26T16:05:52.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:52 smithi033 bash[42377]: cluster 2021-07-26T16:05:51.114603+0000 mgr.y (mgr.34104) 357 : cluster [DBG] pgmap v632: 25 pgs: 25 active+clean; 316 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 3.3 MiB/s wr, 28 op/s 2021-07-26T16:05:53.250 INFO:tasks.rados.rados.0.smithi033.stdout:2387: done (1 left) 2021-07-26T16:05:53.250 INFO:tasks.rados.rados.0.smithi033.stdout:2388: rollback oid 6 current snap is 242 2021-07-26T16:05:53.250 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 223 2021-07-26T16:05:53.251 INFO:tasks.rados.rados.0.smithi033.stdout:2386: finishing write tid 1 to smithi03339061-32 2021-07-26T16:05:53.251 INFO:tasks.rados.rados.0.smithi033.stdout:2386: finishing write tid 2 to smithi03339061-32 2021-07-26T16:05:53.251 INFO:tasks.rados.rados.0.smithi033.stdout:2386: finishing write tid 3 to smithi03339061-32 2021-07-26T16:05:53.251 INFO:tasks.rados.rados.0.smithi033.stdout:2386: finishing write tid 4 to smithi03339061-32 2021-07-26T16:05:53.251 INFO:tasks.rados.rados.0.smithi033.stdout:2386: finishing write tid 5 to smithi03339061-32 2021-07-26T16:05:53.252 INFO:tasks.rados.rados.0.smithi033.stdout:2386: finishing write tid 6 to smithi03339061-32 2021-07-26T16:05:53.252 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1277 (ObjNum 716 snap 242 seq_num 716) dirty exists 2021-07-26T16:05:53.252 INFO:tasks.rados.rados.0.smithi033.stdout:2386: left oid 32 (ObjNum 716 snap 242 seq_num 716) 2021-07-26T16:05:53.252 INFO:tasks.rados.rados.0.smithi033.stdout:2386: done (1 left) 2021-07-26T16:05:53.253 INFO:tasks.rados.rados.0.smithi033.stdout:2389: delete oid 5 current snap is 242 2021-07-26T16:05:53.256 INFO:tasks.rados.rados.0.smithi033.stdout:2388: finishing rollback tid 0 to smithi03339061-6 2021-07-26T16:05:53.256 INFO:tasks.rados.rados.0.smithi033.stdout:2388: finishing rollback tid 1 to smithi03339061-6 2021-07-26T16:05:53.256 INFO:tasks.rados.rados.0.smithi033.stdout:2388: finishing rollback tid 2 to smithi03339061-6 2021-07-26T16:05:53.257 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1423 (ObjNum 630 snap 199 seq_num 630) dirty exists 2021-07-26T16:05:53.258 INFO:tasks.rados.rados.0.smithi033.stdout:2388: done (1 left) 2021-07-26T16:05:53.258 INFO:tasks.rados.rados.0.smithi033.stdout:2389: done (0 left) 2021-07-26T16:05:53.259 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 242 2021-07-26T16:05:53.259 INFO:tasks.rados.rados.0.smithi033.stdout:2390: seq_num 718 ranges {3497984=32768} 2021-07-26T16:05:53.278 INFO:tasks.rados.rados.0.smithi033.stdout:2390: writing smithi03339061-2 from 3497984 to 3530752 tid 1 2021-07-26T16:05:53.279 INFO:tasks.rados.rados.0.smithi033.stdout:2391: snap_remove snap 232 2021-07-26T16:05:53.514 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:53 smithi033 bash[41341]: cluster 2021-07-26T16:05:52.238981+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2021-07-26T16:05:53.515 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:53 smithi033 bash[42377]: cluster 2021-07-26T16:05:52.238981+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2021-07-26T16:05:53.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:53 smithi096 bash[33981]: cluster 2021-07-26T16:05:52.238981+0000 mon.a (mon.0) 909 : cluster [DBG] osdmap e546: 8 total, 8 up, 8 in 2021-07-26T16:05:53.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:53 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:53.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:53.960 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:53 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:53.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:05:53.961 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:05:53 smithi033 bash[50539]: level=error ts=2021-07-26T16:05:53.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:05:54.261 INFO:tasks.rados.rados.0.smithi033.stdout:2390: finishing write tid 1 to smithi03339061-2 2021-07-26T16:05:54.261 INFO:tasks.rados.rados.0.smithi033.stdout:2390: finishing write tid 2 to smithi03339061-2 2021-07-26T16:05:54.262 INFO:tasks.rados.rados.0.smithi033.stdout:2390: finishing write tid 3 to smithi03339061-2 2021-07-26T16:05:54.262 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1246 (ObjNum 718 snap 242 seq_num 718) dirty exists 2021-07-26T16:05:54.262 INFO:tasks.rados.rados.0.smithi033.stdout:2390: left oid 2 (ObjNum 718 snap 242 seq_num 718) 2021-07-26T16:05:54.263 INFO:tasks.rados.rados.0.smithi033.stdout:2390: done (1 left) 2021-07-26T16:05:54.263 INFO:tasks.rados.rados.0.smithi033.stdout:2391: done (0 left) 2021-07-26T16:05:54.263 INFO:tasks.rados.rados.0.smithi033.stdout:2392: read oid 32 snap -1 2021-07-26T16:05:54.263 INFO:tasks.rados.rados.0.smithi033.stdout:2392: expect (ObjNum 716 snap 242 seq_num 716) 2021-07-26T16:05:54.263 INFO:tasks.rados.rados.0.smithi033.stdout:2393: rollback oid 7 current snap is 242 2021-07-26T16:05:54.264 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 7 to 236 2021-07-26T16:05:54.264 INFO:tasks.rados.rados.0.smithi033.stdout:2394: copy_from oid 4 from oid 14 current snap is 242 2021-07-26T16:05:54.264 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 242 2021-07-26T16:05:54.264 INFO:tasks.rados.rados.0.smithi033.stdout:2395: seq_num 719 ranges {5226496=49152} 2021-07-26T16:05:54.295 INFO:tasks.rados.rados.0.smithi033.stdout:2395: writing smithi03339061-13 from 5226496 to 5275648 tid 1 2021-07-26T16:05:54.295 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 242 2021-07-26T16:05:54.296 INFO:tasks.rados.rados.0.smithi033.stdout:2393: finishing rollback tid 0 to smithi03339061-7 2021-07-26T16:05:54.296 INFO:tasks.rados.rados.0.smithi033.stdout:2396: seq_num 720 ranges {2891776=65536} 2021-07-26T16:05:54.312 INFO:tasks.rados.rados.0.smithi033.stdout:2396: writing smithi03339061-10 from 2891776 to 2957312 tid 1 2021-07-26T16:05:54.313 INFO:tasks.rados.rados.0.smithi033.stdout:2397: setattr oid 3 current snap is 242 2021-07-26T16:05:54.313 INFO:tasks.rados.rados.0.smithi033.stdout:2393: finishing rollback tid 1 to smithi03339061-7 2021-07-26T16:05:54.313 INFO:tasks.rados.rados.0.smithi033.stdout:2393: finishing rollback tid 2 to smithi03339061-7 2021-07-26T16:05:54.313 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1160 (ObjNum 678 snap 222 seq_num 678) dirty exists 2021-07-26T16:05:54.314 INFO:tasks.rados.rados.0.smithi033.stdout:2394: finishing copy_from to smithi03339061-4 2021-07-26T16:05:54.314 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1259 (ObjNum 609 snap 192 seq_num 609) dirty exists 2021-07-26T16:05:54.314 INFO:tasks.rados.rados.0.smithi033.stdout:2394: finishing copy_from racing read to smithi03339061-4 2021-07-26T16:05:54.314 INFO:tasks.rados.rados.0.smithi033.stdout:2395: finishing write tid 1 to smithi03339061-13 2021-07-26T16:05:54.314 INFO:tasks.rados.rados.0.smithi033.stdout:2395: finishing write tid 2 to smithi03339061-13 2021-07-26T16:05:54.315 INFO:tasks.rados.rados.0.smithi033.stdout:2395: finishing write tid 3 to smithi03339061-13 2021-07-26T16:05:54.315 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1261 (ObjNum 719 snap 242 seq_num 719) dirty exists 2021-07-26T16:05:54.315 INFO:tasks.rados.rados.0.smithi033.stdout:2395: left oid 13 (ObjNum 719 snap 242 seq_num 719) 2021-07-26T16:05:54.316 INFO:tasks.rados.rados.0.smithi033.stdout:2393: done (5 left) 2021-07-26T16:05:54.316 INFO:tasks.rados.rados.0.smithi033.stdout:2394: done (4 left) 2021-07-26T16:05:54.316 INFO:tasks.rados.rados.0.smithi033.stdout:2395: done (3 left) 2021-07-26T16:05:54.317 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 242 2021-07-26T16:05:54.317 INFO:tasks.rados.rados.0.smithi033.stdout:2398: seq_num 721 ranges {606208=81920} 2021-07-26T16:05:54.319 INFO:tasks.rados.rados.0.smithi033.stdout:2398: writing smithi03339061-14 from 606208 to 688128 tid 1 2021-07-26T16:05:54.320 INFO:tasks.rados.rados.0.smithi033.stdout:2399: read oid 33 snap -1 2021-07-26T16:05:54.320 INFO:tasks.rados.rados.0.smithi033.stdout:2399: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:05:54.321 INFO:tasks.rados.rados.0.smithi033.stdout:2400: delete oid 26 current snap is 242 2021-07-26T16:05:54.321 INFO:tasks.rados.rados.0.smithi033.stdout:2396: finishing write tid 1 to smithi03339061-10 2021-07-26T16:05:54.321 INFO:tasks.rados.rados.0.smithi033.stdout:2396: finishing write tid 2 to smithi03339061-10 2021-07-26T16:05:54.321 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 857 (ObjNum 711 snap 236 seq_num 711) dirty exists 2021-07-26T16:05:54.322 INFO:tasks.rados.rados.0.smithi033.stdout:2396: finishing write tid 3 to smithi03339061-10 2021-07-26T16:05:54.322 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1409 (ObjNum 720 snap 242 seq_num 720) dirty exists 2021-07-26T16:05:54.323 INFO:tasks.rados.rados.0.smithi033.stdout:2396: left oid 10 (ObjNum 720 snap 242 seq_num 720) 2021-07-26T16:05:54.323 INFO:tasks.rados.rados.0.smithi033.stdout:2398: finishing write tid 1 to smithi03339061-14 2021-07-26T16:05:54.323 INFO:tasks.rados.rados.0.smithi033.stdout:2398: finishing write tid 2 to smithi03339061-14 2021-07-26T16:05:54.324 INFO:tasks.rados.rados.0.smithi033.stdout:2398: finishing write tid 3 to smithi03339061-14 2021-07-26T16:05:54.325 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1263 (ObjNum 721 snap 242 seq_num 721) dirty exists 2021-07-26T16:05:54.325 INFO:tasks.rados.rados.0.smithi033.stdout:2398: left oid 14 (ObjNum 721 snap 242 seq_num 721) 2021-07-26T16:05:54.345 INFO:tasks.rados.rados.0.smithi033.stdout:2399: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:05:54.420 INFO:tasks.rados.rados.0.smithi033.stdout:2392: expect (ObjNum 716 snap 242 seq_num 716) 2021-07-26T16:05:54.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:54 smithi033 bash[41341]: cluster 2021-07-26T16:05:53.115229+0000 mgr.y (mgr.34104) 358 : cluster [DBG] pgmap v635: 25 pgs: 25 active+clean; 320 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 3.2 MiB/s wr, 24 op/s 2021-07-26T16:05:54.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:54 smithi033 bash[41341]: cluster 2021-07-26T16:05:53.247319+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2021-07-26T16:05:54.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:54 smithi033 bash[42377]: cluster 2021-07-26T16:05:53.115229+0000 mgr.y (mgr.34104) 358 : cluster [DBG] pgmap v635: 25 pgs: 25 active+clean; 320 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 3.2 MiB/s wr, 24 op/s 2021-07-26T16:05:54.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:54 smithi033 bash[42377]: cluster 2021-07-26T16:05:53.247319+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2021-07-26T16:05:54.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:54 smithi096 bash[33981]: cluster 2021-07-26T16:05:53.115229+0000 mgr.y (mgr.34104) 358 : cluster [DBG] pgmap v635: 25 pgs: 25 active+clean; 320 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 3.2 MiB/s wr, 24 op/s 2021-07-26T16:05:54.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:54 smithi096 bash[33981]: cluster 2021-07-26T16:05:53.247319+0000 mon.a (mon.0) 910 : cluster [DBG] osdmap e547: 8 total, 8 up, 8 in 2021-07-26T16:05:55.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:55 smithi033 bash[41341]: cluster 2021-07-26T16:05:54.257203+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2021-07-26T16:05:55.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:55 smithi033 bash[42377]: cluster 2021-07-26T16:05:54.257203+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2021-07-26T16:05:55.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:55 smithi096 bash[33981]: cluster 2021-07-26T16:05:54.257203+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e548: 8 total, 8 up, 8 in 2021-07-26T16:05:56.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:56 smithi033 bash[42377]: cluster 2021-07-26T16:05:55.116003+0000 mgr.y (mgr.34104) 359 : cluster [DBG] pgmap v638: 25 pgs: 25 active+clean; 318 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2021-07-26T16:05:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:56 smithi033 bash[42377]: cluster 2021-07-26T16:05:56.135089+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2021-07-26T16:05:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:56 smithi033 bash[41341]: cluster 2021-07-26T16:05:55.116003+0000 mgr.y (mgr.34104) 359 : cluster [DBG] pgmap v638: 25 pgs: 25 active+clean; 318 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2021-07-26T16:05:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:56 smithi033 bash[41341]: cluster 2021-07-26T16:05:56.135089+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2021-07-26T16:05:56.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:56 smithi096 bash[33981]: cluster 2021-07-26T16:05:55.116003+0000 mgr.y (mgr.34104) 359 : cluster [DBG] pgmap v638: 25 pgs: 25 active+clean; 318 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 12 MiB/s rd, 1.0 MiB/s wr, 14 op/s 2021-07-26T16:05:56.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:56 smithi096 bash[33981]: cluster 2021-07-26T16:05:56.135089+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e549: 8 total, 8 up, 8 in 2021-07-26T16:05:58.038 INFO:tasks.rados.rados.0.smithi033.stdout:2392: done (5 left) 2021-07-26T16:05:58.044 INFO:tasks.rados.rados.0.smithi033.stdout:2396: done (4 left) 2021-07-26T16:05:58.044 INFO:tasks.rados.rados.0.smithi033.stdout:2397: done (3 left) 2021-07-26T16:05:58.044 INFO:tasks.rados.rados.0.smithi033.stdout:2398: done (2 left) 2021-07-26T16:05:58.044 INFO:tasks.rados.rados.0.smithi033.stdout:2399: done (1 left) 2021-07-26T16:05:58.044 INFO:tasks.rados.rados.0.smithi033.stdout:2400: done (0 left) 2021-07-26T16:05:58.045 INFO:tasks.rados.rados.0.smithi033.stdout:2401: read oid 24 snap -1 2021-07-26T16:05:58.045 INFO:tasks.rados.rados.0.smithi033.stdout:2401: expect (ObjNum 649 snap 206 seq_num 649) 2021-07-26T16:05:58.045 INFO:tasks.rados.rados.0.smithi033.stdout:2402: setattr oid 11 current snap is 242 2021-07-26T16:05:58.048 INFO:tasks.rados.rados.0.smithi033.stdout:2403: read oid 49 snap -1 2021-07-26T16:05:58.049 INFO:tasks.rados.rados.0.smithi033.stdout:2403: expect deleted 2021-07-26T16:05:58.050 INFO:tasks.rados.rados.0.smithi033.stdout:2404: rollback oid 25 current snap is 242 2021-07-26T16:05:58.050 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 25 to 228 2021-07-26T16:05:58.050 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 242 2021-07-26T16:05:58.050 INFO:tasks.rados.rados.0.smithi033.stdout:2405: seq_num 723 ranges {2359296=114688} 2021-07-26T16:05:58.069 INFO:tasks.rados.rados.0.smithi033.stdout:2405: writing smithi03339061-8 from 2359296 to 2473984 tid 1 2021-07-26T16:05:58.069 INFO:tasks.rados.rados.0.smithi033.stdout:2406: read oid 50 snap -1 2021-07-26T16:05:58.070 INFO:tasks.rados.rados.0.smithi033.stdout:2406: expect (ObjNum 687 snap 229 seq_num 687) 2021-07-26T16:05:58.070 INFO:tasks.rados.rados.0.smithi033.stdout:2407: snap_remove snap 221 2021-07-26T16:05:58.279 INFO:tasks.rados.rados.0.smithi033.stdout:2407: done (6 left) 2021-07-26T16:05:58.279 INFO:tasks.rados.rados.0.smithi033.stdout:2408: snap_create 2021-07-26T16:05:58.279 INFO:tasks.rados.rados.0.smithi033.stdout:2401: expect (ObjNum 649 snap 206 seq_num 649) 2021-07-26T16:05:58.329 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 897 (ObjNum 695 snap 229 seq_num 695) dirty exists 2021-07-26T16:05:58.329 INFO:tasks.rados.rados.0.smithi033.stdout:2404: finishing rollback tid 0 to smithi03339061-25 2021-07-26T16:05:58.330 INFO:tasks.rados.rados.0.smithi033.stdout:2404: finishing rollback tid 1 to smithi03339061-25 2021-07-26T16:05:58.330 INFO:tasks.rados.rados.0.smithi033.stdout:2404: finishing rollback tid 2 to smithi03339061-25 2021-07-26T16:05:58.330 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 1280 (ObjNum 682 snap 225 seq_num 682) dirty exists 2021-07-26T16:05:58.330 INFO:tasks.rados.rados.0.smithi033.stdout:2405: finishing write tid 1 to smithi03339061-8 2021-07-26T16:05:58.331 INFO:tasks.rados.rados.0.smithi033.stdout:2405: finishing write tid 2 to smithi03339061-8 2021-07-26T16:05:58.331 INFO:tasks.rados.rados.0.smithi033.stdout:2405: finishing write tid 3 to smithi03339061-8 2021-07-26T16:05:58.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 887 (ObjNum 723 snap 242 seq_num 723) dirty exists 2021-07-26T16:05:58.331 INFO:tasks.rados.rados.0.smithi033.stdout:2405: left oid 8 (ObjNum 723 snap 242 seq_num 723) 2021-07-26T16:05:58.331 INFO:tasks.rados.rados.0.smithi033.stdout:2406: expect (ObjNum 687 snap 229 seq_num 687) 2021-07-26T16:05:58.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:58 smithi033 bash[41341]: cluster 2021-07-26T16:05:57.116666+0000 mgr.y (mgr.34104) 360 : cluster [DBG] pgmap v640: 25 pgs: 25 active+clean; 321 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2021-07-26T16:05:58.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:58 smithi033 bash[42377]: cluster 2021-07-26T16:05:57.116666+0000 mgr.y (mgr.34104) 360 : cluster [DBG] pgmap v640: 25 pgs: 25 active+clean; 321 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2021-07-26T16:05:58.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:58 smithi096 bash[33981]: cluster 2021-07-26T16:05:57.116666+0000 mgr.y (mgr.34104) 360 : cluster [DBG] pgmap v640: 25 pgs: 25 active+clean; 321 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 1.4 MiB/s wr, 18 op/s 2021-07-26T16:05:59.301 INFO:tasks.rados.rados.0.smithi033.stdout:2401: done (6 left) 2021-07-26T16:05:59.301 INFO:tasks.rados.rados.0.smithi033.stdout:2402: done (5 left) 2021-07-26T16:05:59.302 INFO:tasks.rados.rados.0.smithi033.stdout:2403: done (4 left) 2021-07-26T16:05:59.302 INFO:tasks.rados.rados.0.smithi033.stdout:2404: done (3 left) 2021-07-26T16:05:59.303 INFO:tasks.rados.rados.0.smithi033.stdout:2405: done (2 left) 2021-07-26T16:05:59.303 INFO:tasks.rados.rados.0.smithi033.stdout:2406: done (1 left) 2021-07-26T16:05:59.303 INFO:tasks.rados.rados.0.smithi033.stdout:2408: done (0 left) 2021-07-26T16:05:59.304 INFO:tasks.rados.rados.0.smithi033.stdout:2409: delete oid 44 current snap is 243 2021-07-26T16:05:59.305 INFO:tasks.rados.rados.0.smithi033.stdout:2409: done (0 left) 2021-07-26T16:05:59.305 INFO:tasks.rados.rados.0.smithi033.stdout:2410: delete oid 20 current snap is 243 2021-07-26T16:05:59.306 INFO:tasks.rados.rados.0.smithi033.stdout:2410: done (0 left) 2021-07-26T16:05:59.307 INFO:tasks.rados.rados.0.smithi033.stdout:2411: rmattr oid 37 current snap is 243 2021-07-26T16:05:59.307 INFO:tasks.rados.rados.0.smithi033.stdout:2412: snap_create 2021-07-26T16:05:59.311 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 1410 (ObjNum 609 snap 192 seq_num 609) dirty exists 2021-07-26T16:05:59.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:05:59 smithi033 bash[41341]: cluster 2021-07-26T16:05:58.274930+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e550: 8 total, 8 up, 8 in 2021-07-26T16:05:59.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:05:59 smithi033 bash[42377]: cluster 2021-07-26T16:05:58.274930+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e550: 8 total, 8 up, 8 in 2021-07-26T16:05:59.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:05:59 smithi096 bash[33981]: cluster 2021-07-26T16:05:58.274930+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e550: 8 total, 8 up, 8 in 2021-07-26T16:06:00.307 INFO:tasks.rados.rados.0.smithi033.stdout:2411: done (1 left) 2021-07-26T16:06:00.307 INFO:tasks.rados.rados.0.smithi033.stdout:2412: done (0 left) 2021-07-26T16:06:00.307 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 244 2021-07-26T16:06:00.307 INFO:tasks.rados.rados.0.smithi033.stdout:2413: seq_num 726 ranges {606208=163840} 2021-07-26T16:06:00.312 INFO:tasks.rados.rados.0.smithi033.stdout:2413: writing smithi03339061-4 from 606208 to 770048 tid 1 2021-07-26T16:06:00.312 INFO:tasks.rados.rados.0.smithi033.stdout:2414: read oid 38 snap -1 2021-07-26T16:06:00.312 INFO:tasks.rados.rados.0.smithi033.stdout:2414: expect (ObjNum 667 snap 217 seq_num 667) 2021-07-26T16:06:00.312 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 244 2021-07-26T16:06:00.313 INFO:tasks.rados.rados.0.smithi033.stdout:2415: seq_num 727 ranges {4169728=180224} 2021-07-26T16:06:00.337 INFO:tasks.rados.rados.0.smithi033.stdout:2415: writing smithi03339061-19 from 4169728 to 4349952 tid 1 2021-07-26T16:06:00.337 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 244 2021-07-26T16:06:00.338 INFO:tasks.rados.rados.0.smithi033.stdout:2413: finishing write tid 1 to smithi03339061-4 2021-07-26T16:06:00.338 INFO:tasks.rados.rados.0.smithi033.stdout:2416: seq_num 728 ranges {0=196608} 2021-07-26T16:06:00.339 INFO:tasks.rados.rados.0.smithi033.stdout:2416: writing smithi03339061-29 from 0 to 196608 tid 1 2021-07-26T16:06:00.339 INFO:tasks.rados.rados.0.smithi033.stdout:2417: snap_create 2021-07-26T16:06:00.339 INFO:tasks.rados.rados.0.smithi033.stdout:2413: finishing write tid 2 to smithi03339061-4 2021-07-26T16:06:00.339 INFO:tasks.rados.rados.0.smithi033.stdout:2413: finishing write tid 3 to smithi03339061-4 2021-07-26T16:06:00.340 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1266 (ObjNum 726 snap 244 seq_num 726) dirty exists 2021-07-26T16:06:00.340 INFO:tasks.rados.rados.0.smithi033.stdout:2413: left oid 4 (ObjNum 726 snap 244 seq_num 726) 2021-07-26T16:06:00.342 INFO:tasks.rados.rados.0.smithi033.stdout:2415: finishing write tid 1 to smithi03339061-19 2021-07-26T16:06:00.343 INFO:tasks.rados.rados.0.smithi033.stdout:2415: finishing write tid 2 to smithi03339061-19 2021-07-26T16:06:00.345 INFO:tasks.rados.rados.0.smithi033.stdout:2415: finishing write tid 3 to smithi03339061-19 2021-07-26T16:06:00.346 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 889 (ObjNum 727 snap 244 seq_num 727) dirty exists 2021-07-26T16:06:00.346 INFO:tasks.rados.rados.0.smithi033.stdout:2415: left oid 19 (ObjNum 727 snap 244 seq_num 727) 2021-07-26T16:06:00.346 INFO:tasks.rados.rados.0.smithi033.stdout:2414: expect (ObjNum 667 snap 217 seq_num 667) 2021-07-26T16:06:00.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:00 smithi033 bash[42377]: cluster 2021-07-26T16:05:59.117344+0000 mgr.y (mgr.34104) 361 : cluster [DBG] pgmap v642: 25 pgs: 25 active+clean; 321 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 538 KiB/s wr, 10 op/s 2021-07-26T16:06:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:00 smithi033 bash[42377]: cluster 2021-07-26T16:05:59.296303+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e551: 8 total, 8 up, 8 in 2021-07-26T16:06:00.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:00 smithi033 bash[41341]: cluster 2021-07-26T16:05:59.117344+0000 mgr.y (mgr.34104) 361 : cluster [DBG] pgmap v642: 25 pgs: 25 active+clean; 321 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 538 KiB/s wr, 10 op/s 2021-07-26T16:06:00.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:00 smithi033 bash[41341]: cluster 2021-07-26T16:05:59.296303+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e551: 8 total, 8 up, 8 in 2021-07-26T16:06:00.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:00 smithi096 bash[33981]: cluster 2021-07-26T16:05:59.117344+0000 mgr.y (mgr.34104) 361 : cluster [DBG] pgmap v642: 25 pgs: 25 active+clean; 321 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 538 KiB/s wr, 10 op/s 2021-07-26T16:06:00.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:00 smithi096 bash[33981]: cluster 2021-07-26T16:05:59.296303+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e551: 8 total, 8 up, 8 in 2021-07-26T16:06:01.081 INFO:tasks.rados.rados.0.smithi033.stdout:2416: finishing write tid 1 to smithi03339061-29 2021-07-26T16:06:01.082 INFO:tasks.rados.rados.0.smithi033.stdout:2416: finishing write tid 2 to smithi03339061-29 2021-07-26T16:06:01.082 INFO:tasks.rados.rados.0.smithi033.stdout:2416: finishing write tid 3 to smithi03339061-29 2021-07-26T16:06:01.082 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1233 (ObjNum 728 snap 244 seq_num 728) dirty exists 2021-07-26T16:06:01.082 INFO:tasks.rados.rados.0.smithi033.stdout:2416: left oid 29 (ObjNum 728 snap 244 seq_num 728) 2021-07-26T16:06:01.142 INFO:tasks.rados.rados.0.smithi033.stdout:2413: done (4 left) 2021-07-26T16:06:01.142 INFO:tasks.rados.rados.0.smithi033.stdout:2414: done (3 left) 2021-07-26T16:06:01.142 INFO:tasks.rados.rados.0.smithi033.stdout:2415: done (2 left) 2021-07-26T16:06:01.143 INFO:tasks.rados.rados.0.smithi033.stdout:2416: done (1 left) 2021-07-26T16:06:01.143 INFO:tasks.rados.rados.0.smithi033.stdout:2417: done (0 left) 2021-07-26T16:06:01.143 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 245 2021-07-26T16:06:01.143 INFO:tasks.rados.rados.0.smithi033.stdout:2418: seq_num 729 ranges {6774784=212992} 2021-07-26T16:06:01.182 INFO:tasks.rados.rados.0.smithi033.stdout:2418: writing smithi03339061-12 from 6774784 to 6987776 tid 1 2021-07-26T16:06:01.183 INFO:tasks.rados.rados.0.smithi033.stdout:2419: rollback oid 47 current snap is 245 2021-07-26T16:06:01.183 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 47 to 211 2021-07-26T16:06:01.183 INFO:tasks.rados.rados.0.smithi033.stdout:2420: snap_create 2021-07-26T16:06:01.187 INFO:tasks.rados.rados.0.smithi033.stdout:2419: finishing rollback tid 0 to smithi03339061-47 2021-07-26T16:06:01.191 INFO:tasks.rados.rados.0.smithi033.stdout:2419: finishing rollback tid 1 to smithi03339061-47 2021-07-26T16:06:01.191 INFO:tasks.rados.rados.0.smithi033.stdout:2419: finishing rollback tid 2 to smithi03339061-47 2021-07-26T16:06:01.191 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1413 (ObjNum 484 snap 149 seq_num 484) dirty exists 2021-07-26T16:06:01.193 INFO:tasks.rados.rados.0.smithi033.stdout:2418: finishing write tid 1 to smithi03339061-12 2021-07-26T16:06:01.193 INFO:tasks.rados.rados.0.smithi033.stdout:2418: finishing write tid 2 to smithi03339061-12 2021-07-26T16:06:01.194 INFO:tasks.rados.rados.0.smithi033.stdout:2418: finishing write tid 3 to smithi03339061-12 2021-07-26T16:06:01.195 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1248 (ObjNum 729 snap 245 seq_num 729) dirty exists 2021-07-26T16:06:01.195 INFO:tasks.rados.rados.0.smithi033.stdout:2418: left oid 12 (ObjNum 729 snap 245 seq_num 729) 2021-07-26T16:06:01.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:01 smithi033 bash[42377]: cluster 2021-07-26T16:06:00.304029+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e552: 8 total, 8 up, 8 in 2021-07-26T16:06:01.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:01 smithi033 bash[42377]: cluster 2021-07-26T16:06:01.137209+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e553: 8 total, 8 up, 8 in 2021-07-26T16:06:01.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:01 smithi033 bash[41341]: cluster 2021-07-26T16:06:00.304029+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e552: 8 total, 8 up, 8 in 2021-07-26T16:06:01.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:01 smithi033 bash[41341]: cluster 2021-07-26T16:06:01.137209+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e553: 8 total, 8 up, 8 in 2021-07-26T16:06:01.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:01 smithi096 bash[33981]: cluster 2021-07-26T16:06:00.304029+0000 mon.a (mon.0) 915 : cluster [DBG] osdmap e552: 8 total, 8 up, 8 in 2021-07-26T16:06:01.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:01 smithi096 bash[33981]: cluster 2021-07-26T16:06:01.137209+0000 mon.a (mon.0) 916 : cluster [DBG] osdmap e553: 8 total, 8 up, 8 in 2021-07-26T16:06:02.154 INFO:tasks.rados.rados.0.smithi033.stdout:2418: done (2 left) 2021-07-26T16:06:02.154 INFO:tasks.rados.rados.0.smithi033.stdout:2419: done (1 left) 2021-07-26T16:06:02.155 INFO:tasks.rados.rados.0.smithi033.stdout:2420: done (0 left) 2021-07-26T16:06:02.155 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 246 2021-07-26T16:06:02.155 INFO:tasks.rados.rados.0.smithi033.stdout:2421: seq_num 730 ranges {0=229376} 2021-07-26T16:06:02.157 INFO:tasks.rados.rados.0.smithi033.stdout:2421: writing smithi03339061-20 from 0 to 229376 tid 1 2021-07-26T16:06:02.157 INFO:tasks.rados.rados.0.smithi033.stdout:2422: read oid 17 snap 241 2021-07-26T16:06:02.158 INFO:tasks.rados.rados.0.smithi033.stdout:2422: expect (ObjNum 665 snap 217 seq_num 665) 2021-07-26T16:06:02.158 INFO:tasks.rados.rados.0.smithi033.stdout:2423: read oid 31 snap -1 2021-07-26T16:06:02.158 INFO:tasks.rados.rados.0.smithi033.stdout:2423: expect (ObjNum 701 snap 233 seq_num 701) 2021-07-26T16:06:02.158 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 246 2021-07-26T16:06:02.158 INFO:tasks.rados.rados.0.smithi033.stdout:2424: seq_num 731 ranges {3637248=245760} 2021-07-26T16:06:02.185 INFO:tasks.rados.rados.0.smithi033.stdout:2424: writing smithi03339061-39 from 3637248 to 3883008 tid 1 2021-07-26T16:06:02.185 INFO:tasks.rados.rados.0.smithi033.stdout:2425: copy_from oid 25 from oid 49 current snap is 246 2021-07-26T16:06:02.186 INFO:tasks.rados.rados.0.smithi033.stdout:2421: finishing write tid 1 to smithi03339061-20 2021-07-26T16:06:02.186 INFO:tasks.rados.rados.0.smithi033.stdout:2421: finishing write tid 2 to smithi03339061-20 2021-07-26T16:06:02.186 INFO:tasks.rados.rados.0.smithi033.stdout:2421: finishing write tid 3 to smithi03339061-20 2021-07-26T16:06:02.186 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1268 (ObjNum 730 snap 246 seq_num 730) dirty exists 2021-07-26T16:06:02.187 INFO:tasks.rados.rados.0.smithi033.stdout:2421: left oid 20 (ObjNum 730 snap 246 seq_num 730) 2021-07-26T16:06:02.187 INFO:tasks.rados.rados.0.smithi033.stdout:2421: done (4 left) 2021-07-26T16:06:02.187 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 246 2021-07-26T16:06:02.187 INFO:tasks.rados.rados.0.smithi033.stdout:2426: seq_num 732 ranges {12427264=262144} 2021-07-26T16:06:02.257 INFO:tasks.rados.rados.0.smithi033.stdout:2426: writing smithi03339061-7 from 12427264 to 12689408 tid 1 2021-07-26T16:06:02.258 INFO:tasks.rados.rados.0.smithi033.stdout:2427: read oid 27 snap -1 2021-07-26T16:06:02.258 INFO:tasks.rados.rados.0.smithi033.stdout:2427: expect deleted 2021-07-26T16:06:02.258 INFO:tasks.rados.rados.0.smithi033.stdout:2428: copy_from oid 37 from oid 46 current snap is 246 2021-07-26T16:06:02.258 INFO:tasks.rados.rados.0.smithi033.stdout:2422: expect (ObjNum 665 snap 217 seq_num 665) 2021-07-26T16:06:02.541 INFO:tasks.rados.rados.0.smithi033.stdout:2425: finishing copy_from to smithi03339061-25 2021-07-26T16:06:02.541 INFO:tasks.rados.rados.0.smithi033.stdout:2425: got expected ENOENT (src dne) 2021-07-26T16:06:02.542 INFO:tasks.rados.rados.0.smithi033.stdout:2425: finishing copy_from racing read to smithi03339061-25 2021-07-26T16:06:02.542 INFO:tasks.rados.rados.0.smithi033.stdout:2423: expect (ObjNum 701 snap 233 seq_num 701) 2021-07-26T16:06:02.682 INFO:tasks.rados.rados.0.smithi033.stdout:2424: finishing write tid 1 to smithi03339061-39 2021-07-26T16:06:02.682 INFO:tasks.rados.rados.0.smithi033.stdout:2424: finishing write tid 2 to smithi03339061-39 2021-07-26T16:06:02.682 INFO:tasks.rados.rados.0.smithi033.stdout:2424: finishing write tid 3 to smithi03339061-39 2021-07-26T16:06:02.682 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1179 (ObjNum 731 snap 246 seq_num 731) dirty exists 2021-07-26T16:06:02.683 INFO:tasks.rados.rados.0.smithi033.stdout:2424: left oid 39 (ObjNum 731 snap 246 seq_num 731) 2021-07-26T16:06:02.683 INFO:tasks.rados.rados.0.smithi033.stdout:2426: finishing write tid 1 to smithi03339061-7 2021-07-26T16:06:02.683 INFO:tasks.rados.rados.0.smithi033.stdout:2422: done (6 left) 2021-07-26T16:06:02.683 INFO:tasks.rados.rados.0.smithi033.stdout:2423: done (5 left) 2021-07-26T16:06:02.684 INFO:tasks.rados.rados.0.smithi033.stdout:2424: done (4 left) 2021-07-26T16:06:02.684 INFO:tasks.rados.rados.0.smithi033.stdout:2425: done (3 left) 2021-07-26T16:06:02.684 INFO:tasks.rados.rados.0.smithi033.stdout:2427: done (2 left) 2021-07-26T16:06:02.684 INFO:tasks.rados.rados.0.smithi033.stdout:2429: read oid 33 snap -1 2021-07-26T16:06:02.685 INFO:tasks.rados.rados.0.smithi033.stdout:2429: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:06:02.685 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 246 2021-07-26T16:06:02.685 INFO:tasks.rados.rados.0.smithi033.stdout:2426: finishing write tid 2 to smithi03339061-7 2021-07-26T16:06:02.685 INFO:tasks.rados.rados.0.smithi033.stdout:2426: finishing write tid 3 to smithi03339061-7 2021-07-26T16:06:02.685 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1182 (ObjNum 732 snap 246 seq_num 732) dirty exists 2021-07-26T16:06:02.686 INFO:tasks.rados.rados.0.smithi033.stdout:2426: left oid 7 (ObjNum 732 snap 246 seq_num 732) 2021-07-26T16:06:02.686 INFO:tasks.rados.rados.0.smithi033.stdout:2428: finishing copy_from to smithi03339061-37 2021-07-26T16:06:02.686 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 1231 (ObjNum 685 snap 226 seq_num 685) dirty exists 2021-07-26T16:06:02.687 INFO:tasks.rados.rados.0.smithi033.stdout:2428: finishing copy_from racing read to smithi03339061-37 2021-07-26T16:06:02.687 INFO:tasks.rados.rados.0.smithi033.stdout:2430: seq_num 733 ranges {2965504=278528} 2021-07-26T16:06:02.707 INFO:tasks.rados.rados.0.smithi033.stdout:2430: writing smithi03339061-43 from 2965504 to 3244032 tid 1 2021-07-26T16:06:02.708 INFO:tasks.rados.rados.0.smithi033.stdout:2426: done (3 left) 2021-07-26T16:06:02.708 INFO:tasks.rados.rados.0.smithi033.stdout:2428: done (2 left) 2021-07-26T16:06:02.708 INFO:tasks.rados.rados.0.smithi033.stdout:2431: setattr oid 45 current snap is 246 2021-07-26T16:06:02.709 INFO:tasks.rados.rados.0.smithi033.stdout:2429: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:06:02.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:02 smithi033 bash[42377]: cluster 2021-07-26T16:06:01.118029+0000 mgr.y (mgr.34104) 362 : cluster [DBG] pgmap v645: 25 pgs: 25 active+clean; 321 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 506 KiB/s wr, 14 op/s 2021-07-26T16:06:02.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:02 smithi033 bash[42377]: cluster 2021-07-26T16:06:02.151977+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e554: 8 total, 8 up, 8 in 2021-07-26T16:06:02.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:02 smithi033 bash[41341]: cluster 2021-07-26T16:06:01.118029+0000 mgr.y (mgr.34104) 362 : cluster [DBG] pgmap v645: 25 pgs: 25 active+clean; 321 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 506 KiB/s wr, 14 op/s 2021-07-26T16:06:02.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:02 smithi033 bash[41341]: cluster 2021-07-26T16:06:02.151977+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e554: 8 total, 8 up, 8 in 2021-07-26T16:06:02.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:02 smithi096 bash[33981]: cluster 2021-07-26T16:06:01.118029+0000 mgr.y (mgr.34104) 362 : cluster [DBG] pgmap v645: 25 pgs: 25 active+clean; 321 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 17 MiB/s rd, 506 KiB/s wr, 14 op/s 2021-07-26T16:06:02.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:02 smithi096 bash[33981]: cluster 2021-07-26T16:06:02.151977+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e554: 8 total, 8 up, 8 in 2021-07-26T16:06:02.786 INFO:tasks.rados.rados.0.smithi033.stdout:2430: finishing write tid 1 to smithi03339061-43 2021-07-26T16:06:02.786 INFO:tasks.rados.rados.0.smithi033.stdout:2430: finishing write tid 2 to smithi03339061-43 2021-07-26T16:06:02.786 INFO:tasks.rados.rados.0.smithi033.stdout:2430: finishing write tid 3 to smithi03339061-43 2021-07-26T16:06:02.787 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 897 (ObjNum 733 snap 246 seq_num 733) dirty exists 2021-07-26T16:06:02.787 INFO:tasks.rados.rados.0.smithi033.stdout:2430: left oid 43 (ObjNum 733 snap 246 seq_num 733) 2021-07-26T16:06:02.787 INFO:tasks.rados.rados.0.smithi033.stdout:2429: done (2 left) 2021-07-26T16:06:02.788 INFO:tasks.rados.rados.0.smithi033.stdout:2430: done (1 left) 2021-07-26T16:06:02.788 INFO:tasks.rados.rados.0.smithi033.stdout:2432: read oid 47 snap -1 2021-07-26T16:06:02.788 INFO:tasks.rados.rados.0.smithi033.stdout:2432: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:06:02.789 INFO:tasks.rados.rados.0.smithi033.stdout:2433: snap_remove snap 245 2021-07-26T16:06:03.329 INFO:tasks.rados.rados.0.smithi033.stdout:2433: done (2 left) 2021-07-26T16:06:03.329 INFO:tasks.rados.rados.0.smithi033.stdout:2434: delete oid 4 current snap is 246 2021-07-26T16:06:03.330 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1447 (ObjNum 692 snap 229 seq_num 692) dirty exists 2021-07-26T16:06:03.330 INFO:tasks.rados.rados.0.smithi033.stdout:2432: expect (ObjNum 484 snap 149 seq_num 484) 2021-07-26T16:06:03.909 INFO:tasks.rados.rados.0.smithi033.stdout:2431: done (2 left) 2021-07-26T16:06:03.910 INFO:tasks.rados.rados.0.smithi033.stdout:2432: done (1 left) 2021-07-26T16:06:03.910 INFO:tasks.rados.rados.0.smithi033.stdout:2434: done (0 left) 2021-07-26T16:06:03.910 INFO:tasks.rados.rados.0.smithi033.stdout:2435: delete oid 21 current snap is 246 2021-07-26T16:06:03.915 INFO:tasks.rados.rados.0.smithi033.stdout:2435: done (0 left) 2021-07-26T16:06:03.915 INFO:tasks.rados.rados.0.smithi033.stdout:2436: copy_from oid 13 from oid 17 current snap is 246 2021-07-26T16:06:03.915 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 246 2021-07-26T16:06:03.915 INFO:tasks.rados.rados.0.smithi033.stdout:2437: seq_num 736 ranges {0=335872} 2021-07-26T16:06:03.919 INFO:tasks.rados.rados.0.smithi033.stdout:2437: writing smithi03339061-26 from 0 to 335872 tid 1 2021-07-26T16:06:03.920 INFO:tasks.rados.rados.0.smithi033.stdout:2438: snap_create 2021-07-26T16:06:03.925 INFO:tasks.rados.rados.0.smithi033.stdout:2437: finishing write tid 1 to smithi03339061-26 2021-07-26T16:06:03.926 INFO:tasks.rados.rados.0.smithi033.stdout:2437: finishing write tid 2 to smithi03339061-26 2021-07-26T16:06:03.928 INFO:tasks.rados.rados.0.smithi033.stdout:2437: finishing write tid 3 to smithi03339061-26 2021-07-26T16:06:03.928 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 1451 (ObjNum 736 snap 246 seq_num 736) dirty exists 2021-07-26T16:06:03.929 INFO:tasks.rados.rados.0.smithi033.stdout:2437: left oid 26 (ObjNum 736 snap 246 seq_num 736) 2021-07-26T16:06:03.953 INFO:tasks.rados.rados.0.smithi033.stdout:2436: finishing copy_from to smithi03339061-13 2021-07-26T16:06:03.953 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 519 (ObjNum 665 snap 217 seq_num 665) dirty exists 2021-07-26T16:06:03.954 INFO:tasks.rados.rados.0.smithi033.stdout:2436: finishing copy_from racing read to smithi03339061-13 2021-07-26T16:06:03.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:03 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:03.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:03.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:03 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:03.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:03.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:03 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:03.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:06:04.337 INFO:tasks.rados.rados.0.smithi033.stdout:2436: done (2 left) 2021-07-26T16:06:04.337 INFO:tasks.rados.rados.0.smithi033.stdout:2437: done (1 left) 2021-07-26T16:06:04.337 INFO:tasks.rados.rados.0.smithi033.stdout:2438: done (0 left) 2021-07-26T16:06:04.338 INFO:tasks.rados.rados.0.smithi033.stdout:2439: copy_from oid 24 from oid 35 current snap is 247 2021-07-26T16:06:04.338 INFO:tasks.rados.rados.0.smithi033.stdout:2440: read oid 32 snap 209 2021-07-26T16:06:04.338 INFO:tasks.rados.rados.0.smithi033.stdout:2440: expect (ObjNum 628 snap 197 seq_num 628) 2021-07-26T16:06:04.338 INFO:tasks.rados.rados.0.smithi033.stdout:2441: delete oid 40 current snap is 247 2021-07-26T16:06:04.340 INFO:tasks.rados.rados.0.smithi033.stdout:2441: done (2 left) 2021-07-26T16:06:04.340 INFO:tasks.rados.rados.0.smithi033.stdout:2442: rollback oid 22 current snap is 247 2021-07-26T16:06:04.340 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 22 to 238 2021-07-26T16:06:04.340 INFO:tasks.rados.rados.0.smithi033.stdout:2443: rollback oid 15 current snap is 247 2021-07-26T16:06:04.341 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 15 to 241 2021-07-26T16:06:04.341 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 247 2021-07-26T16:06:04.341 INFO:tasks.rados.rados.0.smithi033.stdout:2444: seq_num 738 ranges {10297344=368640} 2021-07-26T16:06:04.405 INFO:tasks.rados.rados.0.smithi033.stdout:2444: writing smithi03339061-28 from 10297344 to 10665984 tid 1 2021-07-26T16:06:04.405 INFO:tasks.rados.rados.0.smithi033.stdout:2445: read oid 14 snap -1 2021-07-26T16:06:04.406 INFO:tasks.rados.rados.0.smithi033.stdout:2445: expect (ObjNum 721 snap 242 seq_num 721) 2021-07-26T16:06:04.406 INFO:tasks.rados.rados.0.smithi033.stdout:2446: read oid 34 snap -1 2021-07-26T16:06:04.406 INFO:tasks.rados.rados.0.smithi033.stdout:2446: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:06:04.406 INFO:tasks.rados.rados.0.smithi033.stdout:2447: rollback oid 44 current snap is 247 2021-07-26T16:06:04.407 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 231 2021-07-26T16:06:04.407 INFO:tasks.rados.rados.0.smithi033.stdout:2443: finishing rollback tid 0 to smithi03339061-15 2021-07-26T16:06:04.407 INFO:tasks.rados.rados.0.smithi033.stdout:2448: delete oid 26 current snap is 247 2021-07-26T16:06:04.407 INFO:tasks.rados.rados.0.smithi033.stdout:2442: finishing rollback tid 0 to smithi03339061-22 2021-07-26T16:06:04.407 INFO:tasks.rados.rados.0.smithi033.stdout:2439: finishing copy_from to smithi03339061-24 2021-07-26T16:06:04.408 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 876 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:06:04.408 INFO:tasks.rados.rados.0.smithi033.stdout:2443: finishing rollback tid 1 to smithi03339061-15 2021-07-26T16:06:04.408 INFO:tasks.rados.rados.0.smithi033.stdout:2442: finishing rollback tid 1 to smithi03339061-22 2021-07-26T16:06:04.408 INFO:tasks.rados.rados.0.smithi033.stdout:2442: finishing rollback tid 2 to smithi03339061-22 2021-07-26T16:06:04.409 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1455 (ObjNum 709 snap 236 seq_num 709) dirty exists 2021-07-26T16:06:04.410 INFO:tasks.rados.rados.0.smithi033.stdout:2439: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:06:04.410 INFO:tasks.rados.rados.0.smithi033.stdout:2443: finishing rollback tid 2 to smithi03339061-15 2021-07-26T16:06:04.410 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 820 (ObjNum 538 snap 167 seq_num 538) dirty exists 2021-07-26T16:06:04.410 INFO:tasks.rados.rados.0.smithi033.stdout:2440: expect (ObjNum 628 snap 197 seq_num 628) 2021-07-26T16:06:04.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:04 smithi033 bash[41341]: cluster 2021-07-26T16:06:03.118738+0000 mgr.y (mgr.34104) 363 : cluster [DBG] pgmap v648: 25 pgs: 25 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 612 KiB/s wr, 19 op/s 2021-07-26T16:06:04.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:04 smithi033 bash[41341]: cluster 2021-07-26T16:06:03.322439+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e555: 8 total, 8 up, 8 in 2021-07-26T16:06:04.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:04 smithi033 bash[42377]: cluster 2021-07-26T16:06:03.118738+0000 mgr.y (mgr.34104) 363 : cluster [DBG] pgmap v648: 25 pgs: 25 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 612 KiB/s wr, 19 op/s 2021-07-26T16:06:04.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:04 smithi033 bash[42377]: cluster 2021-07-26T16:06:03.322439+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e555: 8 total, 8 up, 8 in 2021-07-26T16:06:04.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:04 smithi096 bash[33981]: cluster 2021-07-26T16:06:03.118738+0000 mgr.y (mgr.34104) 363 : cluster [DBG] pgmap v648: 25 pgs: 25 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 18 MiB/s rd, 612 KiB/s wr, 19 op/s 2021-07-26T16:06:04.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:04 smithi096 bash[33981]: cluster 2021-07-26T16:06:03.322439+0000 mon.a (mon.0) 918 : cluster [DBG] osdmap e555: 8 total, 8 up, 8 in 2021-07-26T16:06:05.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:05 smithi033 bash[41341]: cluster 2021-07-26T16:06:04.331916+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e556: 8 total, 8 up, 8 in 2021-07-26T16:06:05.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:05 smithi033 bash[42377]: cluster 2021-07-26T16:06:04.331916+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e556: 8 total, 8 up, 8 in 2021-07-26T16:06:05.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:05 smithi096 bash[33981]: cluster 2021-07-26T16:06:04.331916+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e556: 8 total, 8 up, 8 in 2021-07-26T16:06:06.227 INFO:tasks.rados.rados.0.smithi033.stdout:2445: expect (ObjNum 721 snap 242 seq_num 721) 2021-07-26T16:06:06.254 INFO:tasks.rados.rados.0.smithi033.stdout:2447: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:06:06.255 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1074 (ObjNum 2001410032 snap 22002 seq_num 1) dirty dne 2021-07-26T16:06:06.255 INFO:tasks.rados.rados.0.smithi033.stdout:2446: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:06:06.315 INFO:tasks.rados.rados.0.smithi033.stdout:2444: finishing write tid 1 to smithi03339061-28 2021-07-26T16:06:06.315 INFO:tasks.rados.rados.0.smithi033.stdout:2444: finishing write tid 2 to smithi03339061-28 2021-07-26T16:06:06.315 INFO:tasks.rados.rados.0.smithi033.stdout:2444: finishing write tid 3 to smithi03339061-28 2021-07-26T16:06:06.316 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1250 (ObjNum 738 snap 247 seq_num 738) dirty exists 2021-07-26T16:06:06.316 INFO:tasks.rados.rados.0.smithi033.stdout:2444: left oid 28 (ObjNum 738 snap 247 seq_num 738) 2021-07-26T16:06:06.316 INFO:tasks.rados.rados.0.smithi033.stdout:2439: done (8 left) 2021-07-26T16:06:06.316 INFO:tasks.rados.rados.0.smithi033.stdout:2440: done (7 left) 2021-07-26T16:06:06.316 INFO:tasks.rados.rados.0.smithi033.stdout:2442: done (6 left) 2021-07-26T16:06:06.317 INFO:tasks.rados.rados.0.smithi033.stdout:2443: done (5 left) 2021-07-26T16:06:06.317 INFO:tasks.rados.rados.0.smithi033.stdout:2444: done (4 left) 2021-07-26T16:06:06.317 INFO:tasks.rados.rados.0.smithi033.stdout:2445: done (3 left) 2021-07-26T16:06:06.317 INFO:tasks.rados.rados.0.smithi033.stdout:2446: done (2 left) 2021-07-26T16:06:06.318 INFO:tasks.rados.rados.0.smithi033.stdout:2447: done (1 left) 2021-07-26T16:06:06.318 INFO:tasks.rados.rados.0.smithi033.stdout:2448: done (0 left) 2021-07-26T16:06:06.318 INFO:tasks.rados.rados.0.smithi033.stdout:2449: setattr oid 22 current snap is 247 2021-07-26T16:06:06.322 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 247 2021-07-26T16:06:06.322 INFO:tasks.rados.rados.0.smithi033.stdout:2450: seq_num 740 ranges {0=401408} 2021-07-26T16:06:06.329 INFO:tasks.rados.rados.0.smithi033.stdout:2450: writing smithi03339061-36 from 0 to 401408 tid 1 2021-07-26T16:06:06.330 INFO:tasks.rados.rados.0.smithi033.stdout:2451: copy_from oid 7 from oid 37 current snap is 247 2021-07-26T16:06:06.330 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1458 (ObjNum 709 snap 236 seq_num 709) dirty exists 2021-07-26T16:06:06.330 INFO:tasks.rados.rados.0.smithi033.stdout:2449: done (2 left) 2021-07-26T16:06:06.330 INFO:tasks.rados.rados.0.smithi033.stdout:2452: rollback oid 11 current snap is 247 2021-07-26T16:06:06.331 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 11 to 243 2021-07-26T16:06:06.331 INFO:tasks.rados.rados.0.smithi033.stdout:2453: setattr oid 8 current snap is 247 2021-07-26T16:06:06.332 INFO:tasks.rados.rados.0.smithi033.stdout:2454: snap_create 2021-07-26T16:06:06.340 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 890 (ObjNum 723 snap 242 seq_num 723) dirty exists 2021-07-26T16:06:06.344 INFO:tasks.rados.rados.0.smithi033.stdout:2450: finishing write tid 1 to smithi03339061-36 2021-07-26T16:06:06.347 INFO:tasks.rados.rados.0.smithi033.stdout:2451: finishing copy_from to smithi03339061-7 2021-07-26T16:06:06.347 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1231 (ObjNum 685 snap 226 seq_num 685) dirty exists 2021-07-26T16:06:06.347 INFO:tasks.rados.rados.0.smithi033.stdout:2450: finishing write tid 2 to smithi03339061-36 2021-07-26T16:06:06.348 INFO:tasks.rados.rados.0.smithi033.stdout:2451: finishing copy_from racing read to smithi03339061-7 2021-07-26T16:06:06.351 INFO:tasks.rados.rados.0.smithi033.stdout:2452: finishing rollback tid 0 to smithi03339061-11 2021-07-26T16:06:06.352 INFO:tasks.rados.rados.0.smithi033.stdout:2452: finishing rollback tid 1 to smithi03339061-11 2021-07-26T16:06:06.352 INFO:tasks.rados.rados.0.smithi033.stdout:2450: finishing write tid 3 to smithi03339061-36 2021-07-26T16:06:06.353 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 899 (ObjNum 740 snap 247 seq_num 740) dirty exists 2021-07-26T16:06:06.353 INFO:tasks.rados.rados.0.smithi033.stdout:2450: left oid 36 (ObjNum 740 snap 247 seq_num 740) 2021-07-26T16:06:06.353 INFO:tasks.rados.rados.0.smithi033.stdout:2452: finishing rollback tid 2 to smithi03339061-11 2021-07-26T16:06:06.353 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 902 (ObjNum 695 snap 229 seq_num 695) dirty exists 2021-07-26T16:06:06.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:06 smithi033 bash[42377]: cluster 2021-07-26T16:06:05.119419+0000 mgr.y (mgr.34104) 364 : cluster [DBG] pgmap v651: 25 pgs: 25 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 752 KiB/s wr, 17 op/s 2021-07-26T16:06:06.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:06 smithi033 bash[42377]: cluster 2021-07-26T16:06:06.139473+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e557: 8 total, 8 up, 8 in 2021-07-26T16:06:06.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:06 smithi033 bash[41341]: cluster 2021-07-26T16:06:05.119419+0000 mgr.y (mgr.34104) 364 : cluster [DBG] pgmap v651: 25 pgs: 25 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 752 KiB/s wr, 17 op/s 2021-07-26T16:06:06.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:06 smithi033 bash[41341]: cluster 2021-07-26T16:06:06.139473+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e557: 8 total, 8 up, 8 in 2021-07-26T16:06:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:06 smithi096 bash[33981]: cluster 2021-07-26T16:06:05.119419+0000 mgr.y (mgr.34104) 364 : cluster [DBG] pgmap v651: 25 pgs: 25 active+clean; 332 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 22 MiB/s rd, 752 KiB/s wr, 17 op/s 2021-07-26T16:06:06.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:06 smithi096 bash[33981]: cluster 2021-07-26T16:06:06.139473+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e557: 8 total, 8 up, 8 in 2021-07-26T16:06:07.156 INFO:tasks.rados.rados.0.smithi033.stdout:2450: done (4 left) 2021-07-26T16:06:07.157 INFO:tasks.rados.rados.0.smithi033.stdout:2451: done (3 left) 2021-07-26T16:06:07.157 INFO:tasks.rados.rados.0.smithi033.stdout:2452: done (2 left) 2021-07-26T16:06:07.157 INFO:tasks.rados.rados.0.smithi033.stdout:2453: done (1 left) 2021-07-26T16:06:07.157 INFO:tasks.rados.rados.0.smithi033.stdout:2454: done (0 left) 2021-07-26T16:06:07.157 INFO:tasks.rados.rados.0.smithi033.stdout:2455: read oid 18 snap -1 2021-07-26T16:06:07.158 INFO:tasks.rados.rados.0.smithi033.stdout:2455: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:06:07.158 INFO:tasks.rados.rados.0.smithi033.stdout:2456: snap_remove snap 234 2021-07-26T16:06:08.169 INFO:tasks.rados.rados.0.smithi033.stdout:2456: done (1 left) 2021-07-26T16:06:08.170 INFO:tasks.rados.rados.0.smithi033.stdout:2457: setattr oid 1 current snap is 248 2021-07-26T16:06:08.170 INFO:tasks.rados.rados.0.smithi033.stdout:2455: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:06:08.172 INFO:tasks.rados.rados.0.smithi033.stdout:2455: done (1 left) 2021-07-26T16:06:08.173 INFO:tasks.rados.rados.0.smithi033.stdout:2458: read oid 46 snap -1 2021-07-26T16:06:08.173 INFO:tasks.rados.rados.0.smithi033.stdout:2458: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:06:08.173 INFO:tasks.rados.rados.0.smithi033.stdout:2459: rollback oid 20 current snap is 248 2021-07-26T16:06:08.173 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 20 to 236 2021-07-26T16:06:08.174 INFO:tasks.rados.rados.0.smithi033.stdout:2460: delete oid 42 current snap is 248 2021-07-26T16:06:08.182 INFO:tasks.rados.rados.0.smithi033.stdout:2459: finishing rollback tid 0 to smithi03339061-20 2021-07-26T16:06:08.182 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1062 (ObjNum 2001415368 snap 22002 seq_num 2) dirty exists 2021-07-26T16:06:08.183 INFO:tasks.rados.rados.0.smithi033.stdout:2459: finishing rollback tid 1 to smithi03339061-20 2021-07-26T16:06:08.184 INFO:tasks.rados.rados.0.smithi033.stdout:2459: finishing rollback tid 2 to smithi03339061-20 2021-07-26T16:06:08.184 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1272 (ObjNum 625 snap 196 seq_num 625) dirty exists 2021-07-26T16:06:08.184 INFO:tasks.rados.rados.0.smithi033.stdout:2457: done (3 left) 2021-07-26T16:06:08.184 INFO:tasks.rados.rados.0.smithi033.stdout:2459: done (2 left) 2021-07-26T16:06:08.185 INFO:tasks.rados.rados.0.smithi033.stdout:2460: done (1 left) 2021-07-26T16:06:08.185 INFO:tasks.rados.rados.0.smithi033.stdout:2461: rollback oid 47 current snap is 248 2021-07-26T16:06:08.185 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 47 to 244 2021-07-26T16:06:08.185 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 248 2021-07-26T16:06:08.186 INFO:tasks.rados.rados.0.smithi033.stdout:2462: seq_num 742 ranges {25296896=434176} 2021-07-26T16:06:08.329 INFO:tasks.rados.rados.0.smithi033.stdout:2462: writing smithi03339061-32 from 25296896 to 25731072 tid 1 2021-07-26T16:06:08.329 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 248 2021-07-26T16:06:08.330 INFO:tasks.rados.rados.0.smithi033.stdout:2463: seq_num 743 ranges {3883008=450560} 2021-07-26T16:06:08.354 INFO:tasks.rados.rados.0.smithi033.stdout:2463: writing smithi03339061-39 from 3883008 to 4333568 tid 1 2021-07-26T16:06:08.355 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 248 2021-07-26T16:06:08.355 INFO:tasks.rados.rados.0.smithi033.stdout:2464: seq_num 744 ranges {0=466944} 2021-07-26T16:06:08.357 INFO:tasks.rados.rados.0.smithi033.stdout:2464: writing smithi03339061-40 from 0 to 466944 tid 1 2021-07-26T16:06:08.357 INFO:tasks.rados.rados.0.smithi033.stdout:2465: snap_create 2021-07-26T16:06:08.357 INFO:tasks.rados.rados.0.smithi033.stdout:2458: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:06:08.415 INFO:tasks.rados.rados.0.smithi033.stdout:2461: finishing rollback tid 0 to smithi03339061-47 2021-07-26T16:06:08.415 INFO:tasks.rados.rados.0.smithi033.stdout:2461: finishing rollback tid 1 to smithi03339061-47 2021-07-26T16:06:08.415 INFO:tasks.rados.rados.0.smithi033.stdout:2461: finishing rollback tid 2 to smithi03339061-47 2021-07-26T16:06:08.416 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1416 (ObjNum 692 snap 229 seq_num 692) dirty exists 2021-07-26T16:06:08.416 INFO:tasks.rados.rados.0.smithi033.stdout:2462: finishing write tid 1 to smithi03339061-32 2021-07-26T16:06:08.416 INFO:tasks.rados.rados.0.smithi033.stdout:2462: finishing write tid 2 to smithi03339061-32 2021-07-26T16:06:08.416 INFO:tasks.rados.rados.0.smithi033.stdout:2462: finishing write tid 3 to smithi03339061-32 2021-07-26T16:06:08.416 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1282 (ObjNum 742 snap 248 seq_num 742) dirty exists 2021-07-26T16:06:08.417 INFO:tasks.rados.rados.0.smithi033.stdout:2462: left oid 32 (ObjNum 742 snap 248 seq_num 742) 2021-07-26T16:06:08.417 INFO:tasks.rados.rados.0.smithi033.stdout:2463: finishing write tid 1 to smithi03339061-39 2021-07-26T16:06:08.417 INFO:tasks.rados.rados.0.smithi033.stdout:2463: finishing write tid 2 to smithi03339061-39 2021-07-26T16:06:08.418 INFO:tasks.rados.rados.0.smithi033.stdout:2463: finishing write tid 3 to smithi03339061-39 2021-07-26T16:06:08.418 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1233 (ObjNum 743 snap 248 seq_num 743) dirty exists 2021-07-26T16:06:08.418 INFO:tasks.rados.rados.0.smithi033.stdout:2463: left oid 39 (ObjNum 743 snap 248 seq_num 743) 2021-07-26T16:06:08.418 INFO:tasks.rados.rados.0.smithi033.stdout:2464: finishing write tid 1 to smithi03339061-40 2021-07-26T16:06:08.418 INFO:tasks.rados.rados.0.smithi033.stdout:2464: finishing write tid 2 to smithi03339061-40 2021-07-26T16:06:08.419 INFO:tasks.rados.rados.0.smithi033.stdout:2464: finishing write tid 3 to smithi03339061-40 2021-07-26T16:06:08.419 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 521 (ObjNum 744 snap 248 seq_num 744) dirty exists 2021-07-26T16:06:08.419 INFO:tasks.rados.rados.0.smithi033.stdout:2464: left oid 40 (ObjNum 744 snap 248 seq_num 744) 2021-07-26T16:06:08.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:08 smithi033 bash[41341]: cluster 2021-07-26T16:06:07.120171+0000 mgr.y (mgr.34104) 365 : cluster [DBG] pgmap v653: 25 pgs: 25 active+clean; 337 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 27 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2021-07-26T16:06:08.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:08 smithi033 bash[41341]: cluster 2021-07-26T16:06:07.152218+0000 mon.a (mon.0) 921 : cluster [DBG] osdmap e558: 8 total, 8 up, 8 in 2021-07-26T16:06:08.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:08 smithi033 bash[42377]: cluster 2021-07-26T16:06:07.120171+0000 mgr.y (mgr.34104) 365 : cluster [DBG] pgmap v653: 25 pgs: 25 active+clean; 337 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 27 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2021-07-26T16:06:08.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:08 smithi033 bash[42377]: cluster 2021-07-26T16:06:07.152218+0000 mon.a (mon.0) 921 : cluster [DBG] osdmap e558: 8 total, 8 up, 8 in 2021-07-26T16:06:08.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:08 smithi096 bash[33981]: cluster 2021-07-26T16:06:07.120171+0000 mgr.y (mgr.34104) 365 : cluster [DBG] pgmap v653: 25 pgs: 25 active+clean; 337 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 27 MiB/s rd, 1.5 MiB/s wr, 18 op/s 2021-07-26T16:06:08.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:08 smithi096 bash[33981]: cluster 2021-07-26T16:06:07.152218+0000 mon.a (mon.0) 921 : cluster [DBG] osdmap e558: 8 total, 8 up, 8 in 2021-07-26T16:06:09.178 INFO:tasks.rados.rados.0.smithi033.stdout:2458: done (5 left) 2021-07-26T16:06:09.178 INFO:tasks.rados.rados.0.smithi033.stdout:2461: done (4 left) 2021-07-26T16:06:09.178 INFO:tasks.rados.rados.0.smithi033.stdout:2462: done (3 left) 2021-07-26T16:06:09.179 INFO:tasks.rados.rados.0.smithi033.stdout:2463: done (2 left) 2021-07-26T16:06:09.179 INFO:tasks.rados.rados.0.smithi033.stdout:2464: done (1 left) 2021-07-26T16:06:09.179 INFO:tasks.rados.rados.0.smithi033.stdout:2465: done (0 left) 2021-07-26T16:06:09.179 INFO:tasks.rados.rados.0.smithi033.stdout:2466: copy_from oid 48 from oid 43 current snap is 249 2021-07-26T16:06:09.179 INFO:tasks.rados.rados.0.smithi033.stdout:2467: setattr oid 7 current snap is 249 2021-07-26T16:06:09.180 INFO:tasks.rados.rados.0.smithi033.stdout:2468: read oid 36 snap 228 2021-07-26T16:06:09.180 INFO:tasks.rados.rados.0.smithi033.stdout:2468: expect (ObjNum 671 snap 217 seq_num 671) 2021-07-26T16:06:09.181 INFO:tasks.rados.rados.0.smithi033.stdout:2469: read oid 44 snap -1 2021-07-26T16:06:09.181 INFO:tasks.rados.rados.0.smithi033.stdout:2469: expect deleted 2021-07-26T16:06:09.181 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 249 2021-07-26T16:06:09.181 INFO:tasks.rados.rados.0.smithi033.stdout:2470: seq_num 745 ranges {0=483328} 2021-07-26T16:06:09.184 INFO:tasks.rados.rados.0.smithi033.stdout:2470: writing smithi03339061-9 from 0 to 483328 tid 1 2021-07-26T16:06:09.184 INFO:tasks.rados.rados.0.smithi033.stdout:2471: read oid 2 snap 238 2021-07-26T16:06:09.184 INFO:tasks.rados.rados.0.smithi033.stdout:2471: expect (ObjNum 684 snap 226 seq_num 684) 2021-07-26T16:06:09.184 INFO:tasks.rados.rados.0.smithi033.stdout:2472: snap_remove snap 209 2021-07-26T16:06:09.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:09 smithi033 bash[41341]: cluster 2021-07-26T16:06:08.162057+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e559: 8 total, 8 up, 8 in 2021-07-26T16:06:09.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:09 smithi033 bash[42377]: cluster 2021-07-26T16:06:08.162057+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e559: 8 total, 8 up, 8 in 2021-07-26T16:06:09.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:09 smithi096 bash[33981]: cluster 2021-07-26T16:06:08.162057+0000 mon.a (mon.0) 922 : cluster [DBG] osdmap e559: 8 total, 8 up, 8 in 2021-07-26T16:06:10.185 INFO:tasks.rados.rados.0.smithi033.stdout:2472: done (6 left) 2021-07-26T16:06:10.185 INFO:tasks.rados.rados.0.smithi033.stdout:2473: delete oid 42 current snap is 249 2021-07-26T16:06:10.186 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1234 (ObjNum 685 snap 226 seq_num 685) dirty exists 2021-07-26T16:06:10.186 INFO:tasks.rados.rados.0.smithi033.stdout:2470: finishing write tid 1 to smithi03339061-9 2021-07-26T16:06:10.186 INFO:tasks.rados.rados.0.smithi033.stdout:2470: finishing write tid 2 to smithi03339061-9 2021-07-26T16:06:10.187 INFO:tasks.rados.rados.0.smithi033.stdout:2470: finishing write tid 3 to smithi03339061-9 2021-07-26T16:06:10.187 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 892 (ObjNum 745 snap 249 seq_num 745) dirty exists 2021-07-26T16:06:10.187 INFO:tasks.rados.rados.0.smithi033.stdout:2470: left oid 9 (ObjNum 745 snap 249 seq_num 745) 2021-07-26T16:06:10.187 INFO:tasks.rados.rados.0.smithi033.stdout:2468: expect (ObjNum 671 snap 217 seq_num 671) 2021-07-26T16:06:10.342 INFO:tasks.rados.rados.0.smithi033.stdout:2471: expect (ObjNum 684 snap 226 seq_num 684) 2021-07-26T16:06:10.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[41341]: cluster 2021-07-26T16:06:09.120939+0000 mgr.y (mgr.34104) 366 : cluster [DBG] pgmap v656: 25 pgs: 25 active+clean; 341 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2021-07-26T16:06:10.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[41341]: cluster 2021-07-26T16:06:09.172538+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e560: 8 total, 8 up, 8 in 2021-07-26T16:06:10.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[41341]: audit 2021-07-26T16:06:09.235651+0000 mon.c (mon.1) 251 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:06:10.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[41341]: audit 2021-07-26T16:06:09.236487+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:06:10.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[41341]: audit 2021-07-26T16:06:09.245954+0000 mon.c (mon.1) 252 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:06:10.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[41341]: audit 2021-07-26T16:06:09.246728+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:06:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[42377]: cluster 2021-07-26T16:06:09.120939+0000 mgr.y (mgr.34104) 366 : cluster [DBG] pgmap v656: 25 pgs: 25 active+clean; 341 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2021-07-26T16:06:10.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[42377]: cluster 2021-07-26T16:06:09.172538+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e560: 8 total, 8 up, 8 in 2021-07-26T16:06:10.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[42377]: audit 2021-07-26T16:06:09.235651+0000 mon.c (mon.1) 251 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:06:10.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[42377]: audit 2021-07-26T16:06:09.236487+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:06:10.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[42377]: audit 2021-07-26T16:06:09.245954+0000 mon.c (mon.1) 252 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:06:10.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:10 smithi033 bash[42377]: audit 2021-07-26T16:06:09.246728+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:06:10.462 INFO:tasks.rados.rados.0.smithi033.stdout:2466: finishing copy_from to smithi03339061-48 2021-07-26T16:06:10.462 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 897 (ObjNum 733 snap 246 seq_num 733) dirty exists 2021-07-26T16:06:10.463 INFO:tasks.rados.rados.0.smithi033.stdout:2466: finishing copy_from racing read to smithi03339061-48 2021-07-26T16:06:10.463 INFO:tasks.rados.rados.0.smithi033.stdout:2466: done (6 left) 2021-07-26T16:06:10.463 INFO:tasks.rados.rados.0.smithi033.stdout:2467: done (5 left) 2021-07-26T16:06:10.463 INFO:tasks.rados.rados.0.smithi033.stdout:2468: done (4 left) 2021-07-26T16:06:10.464 INFO:tasks.rados.rados.0.smithi033.stdout:2469: done (3 left) 2021-07-26T16:06:10.464 INFO:tasks.rados.rados.0.smithi033.stdout:2470: done (2 left) 2021-07-26T16:06:10.464 INFO:tasks.rados.rados.0.smithi033.stdout:2471: done (1 left) 2021-07-26T16:06:10.465 INFO:tasks.rados.rados.0.smithi033.stdout:2473: done (0 left) 2021-07-26T16:06:10.465 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 44 current snap is 249 2021-07-26T16:06:10.465 INFO:tasks.rados.rados.0.smithi033.stdout:2474: seq_num 747 ranges {0=516096} 2021-07-26T16:06:10.470 INFO:tasks.rados.rados.0.smithi033.stdout:2474: writing smithi03339061-44 from 0 to 516096 tid 1 2021-07-26T16:06:10.470 INFO:tasks.rados.rados.0.smithi033.stdout:2475: snap_create 2021-07-26T16:06:10.476 INFO:tasks.rados.rados.0.smithi033.stdout:2474: finishing write tid 1 to smithi03339061-44 2021-07-26T16:06:10.476 INFO:tasks.rados.rados.0.smithi033.stdout:2474: finishing write tid 2 to smithi03339061-44 2021-07-26T16:06:10.479 INFO:tasks.rados.rados.0.smithi033.stdout:2474: finishing write tid 3 to smithi03339061-44 2021-07-26T16:06:10.479 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1274 (ObjNum 747 snap 249 seq_num 747) dirty exists 2021-07-26T16:06:10.479 INFO:tasks.rados.rados.0.smithi033.stdout:2474: left oid 44 (ObjNum 747 snap 249 seq_num 747) 2021-07-26T16:06:10.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:10 smithi096 bash[33981]: cluster 2021-07-26T16:06:09.120939+0000 mgr.y (mgr.34104) 366 : cluster [DBG] pgmap v656: 25 pgs: 25 active+clean; 341 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 1.9 MiB/s wr, 15 op/s 2021-07-26T16:06:10.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:10 smithi096 bash[33981]: cluster 2021-07-26T16:06:09.172538+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e560: 8 total, 8 up, 8 in 2021-07-26T16:06:10.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:10 smithi096 bash[33981]: audit 2021-07-26T16:06:09.235651+0000 mon.c (mon.1) 251 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:06:10.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:10 smithi096 bash[33981]: audit 2021-07-26T16:06:09.236487+0000 mon.a (mon.0) 924 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:06:10.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:10 smithi096 bash[33981]: audit 2021-07-26T16:06:09.245954+0000 mon.c (mon.1) 252 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:06:10.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:10 smithi096 bash[33981]: audit 2021-07-26T16:06:09.246728+0000 mon.a (mon.0) 925 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:06:11.147 INFO:tasks.rados.rados.0.smithi033.stdout:2474: done (1 left) 2021-07-26T16:06:11.149 INFO:tasks.rados.rados.0.smithi033.stdout:2475: done (0 left) 2021-07-26T16:06:11.149 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 250 2021-07-26T16:06:11.150 INFO:tasks.rados.rados.0.smithi033.stdout:2476: seq_num 748 ranges {4276224=532480} 2021-07-26T16:06:11.176 INFO:tasks.rados.rados.0.smithi033.stdout:2476: writing smithi03339061-13 from 4276224 to 4808704 tid 1 2021-07-26T16:06:11.177 INFO:tasks.rados.rados.0.smithi033.stdout:2477: copy_from oid 41 from oid 46 current snap is 250 2021-07-26T16:06:11.177 INFO:tasks.rados.rados.0.smithi033.stdout:2478: snap_remove snap 211 2021-07-26T16:06:11.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:11 smithi033 bash[41341]: cluster 2021-07-26T16:06:10.175935+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e561: 8 total, 8 up, 8 in 2021-07-26T16:06:11.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:11 smithi033 bash[41341]: cluster 2021-07-26T16:06:11.143550+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e562: 8 total, 8 up, 8 in 2021-07-26T16:06:11.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:11 smithi033 bash[42377]: cluster 2021-07-26T16:06:10.175935+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e561: 8 total, 8 up, 8 in 2021-07-26T16:06:11.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:11 smithi033 bash[42377]: cluster 2021-07-26T16:06:11.143550+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e562: 8 total, 8 up, 8 in 2021-07-26T16:06:11.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:11 smithi096 bash[33981]: cluster 2021-07-26T16:06:10.175935+0000 mon.a (mon.0) 926 : cluster [DBG] osdmap e561: 8 total, 8 up, 8 in 2021-07-26T16:06:11.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:11 smithi096 bash[33981]: cluster 2021-07-26T16:06:11.143550+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e562: 8 total, 8 up, 8 in 2021-07-26T16:06:12.162 INFO:tasks.rados.rados.0.smithi033.stdout:2476: finishing write tid 1 to smithi03339061-13 2021-07-26T16:06:12.163 INFO:tasks.rados.rados.0.smithi033.stdout:2476: finishing write tid 2 to smithi03339061-13 2021-07-26T16:06:12.163 INFO:tasks.rados.rados.0.smithi033.stdout:2476: finishing write tid 3 to smithi03339061-13 2021-07-26T16:06:12.163 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1276 (ObjNum 748 snap 250 seq_num 748) dirty exists 2021-07-26T16:06:12.163 INFO:tasks.rados.rados.0.smithi033.stdout:2476: left oid 13 (ObjNum 748 snap 250 seq_num 748) 2021-07-26T16:06:12.164 INFO:tasks.rados.rados.0.smithi033.stdout:2477: finishing copy_from to smithi03339061-41 2021-07-26T16:06:12.164 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1231 (ObjNum 685 snap 226 seq_num 685) dirty exists 2021-07-26T16:06:12.165 INFO:tasks.rados.rados.0.smithi033.stdout:2477: finishing copy_from racing read to smithi03339061-41 2021-07-26T16:06:12.165 INFO:tasks.rados.rados.0.smithi033.stdout:2476: done (2 left) 2021-07-26T16:06:12.165 INFO:tasks.rados.rados.0.smithi033.stdout:2477: done (1 left) 2021-07-26T16:06:12.165 INFO:tasks.rados.rados.0.smithi033.stdout:2478: done (0 left) 2021-07-26T16:06:12.166 INFO:tasks.rados.rados.0.smithi033.stdout:2479: read oid 34 snap -1 2021-07-26T16:06:12.166 INFO:tasks.rados.rados.0.smithi033.stdout:2479: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:06:12.166 INFO:tasks.rados.rados.0.smithi033.stdout:2480: rollback oid 50 current snap is 250 2021-07-26T16:06:12.166 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 50 to 237 2021-07-26T16:06:12.166 INFO:tasks.rados.rados.0.smithi033.stdout:2481: setattr oid 21 current snap is 250 2021-07-26T16:06:12.167 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 250 2021-07-26T16:06:12.168 INFO:tasks.rados.rados.0.smithi033.stdout:2482: seq_num 749 ranges {0=548864} 2021-07-26T16:06:12.170 INFO:tasks.rados.rados.0.smithi033.stdout:2482: writing smithi03339061-1 from 0 to 548864 tid 1 2021-07-26T16:06:12.171 INFO:tasks.rados.rados.0.smithi033.stdout:2483: snap_remove snap 244 2021-07-26T16:06:12.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:12 smithi033 bash[41341]: cluster 2021-07-26T16:06:11.121705+0000 mgr.y (mgr.34104) 367 : cluster [DBG] pgmap v659: 25 pgs: 25 active+clean; 343 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 1.4 MiB/s wr, 20 op/s 2021-07-26T16:06:12.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:12 smithi033 bash[41341]: cluster 2021-07-26T16:06:12.155362+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e563: 8 total, 8 up, 8 in 2021-07-26T16:06:12.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:12 smithi033 bash[42377]: cluster 2021-07-26T16:06:11.121705+0000 mgr.y (mgr.34104) 367 : cluster [DBG] pgmap v659: 25 pgs: 25 active+clean; 343 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 1.4 MiB/s wr, 20 op/s 2021-07-26T16:06:12.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:12 smithi033 bash[42377]: cluster 2021-07-26T16:06:12.155362+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e563: 8 total, 8 up, 8 in 2021-07-26T16:06:12.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:12 smithi096 bash[33981]: cluster 2021-07-26T16:06:11.121705+0000 mgr.y (mgr.34104) 367 : cluster [DBG] pgmap v659: 25 pgs: 25 active+clean; 343 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 1.4 MiB/s wr, 20 op/s 2021-07-26T16:06:12.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:12 smithi096 bash[33981]: cluster 2021-07-26T16:06:12.155362+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e563: 8 total, 8 up, 8 in 2021-07-26T16:06:13.165 INFO:tasks.rados.rados.0.smithi033.stdout:2479: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:06:13.232 INFO:tasks.rados.rados.0.smithi033.stdout:2482: finishing write tid 1 to smithi03339061-1 2021-07-26T16:06:13.232 INFO:tasks.rados.rados.0.smithi033.stdout:2482: finishing write tid 2 to smithi03339061-1 2021-07-26T16:06:13.232 INFO:tasks.rados.rados.0.smithi033.stdout:2482: finishing write tid 3 to smithi03339061-1 2021-07-26T16:06:13.233 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1064 (ObjNum 749 snap 250 seq_num 749) dirty exists 2021-07-26T16:06:13.233 INFO:tasks.rados.rados.0.smithi033.stdout:2482: left oid 1 (ObjNum 749 snap 250 seq_num 749) 2021-07-26T16:06:13.233 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1235 (ObjNum 0 snap 22002 seq_num 2007797344) dirty exists 2021-07-26T16:06:13.233 INFO:tasks.rados.rados.0.smithi033.stdout:2480: finishing rollback tid 0 to smithi03339061-50 2021-07-26T16:06:13.234 INFO:tasks.rados.rados.0.smithi033.stdout:2480: finishing rollback tid 1 to smithi03339061-50 2021-07-26T16:06:13.234 INFO:tasks.rados.rados.0.smithi033.stdout:2479: done (4 left) 2021-07-26T16:06:13.234 INFO:tasks.rados.rados.0.smithi033.stdout:2481: done (3 left) 2021-07-26T16:06:13.234 INFO:tasks.rados.rados.0.smithi033.stdout:2482: done (2 left) 2021-07-26T16:06:13.234 INFO:tasks.rados.rados.0.smithi033.stdout:2483: done (1 left) 2021-07-26T16:06:13.235 INFO:tasks.rados.rados.0.smithi033.stdout:2484: delete oid 22 current snap is 250 2021-07-26T16:06:13.235 INFO:tasks.rados.rados.0.smithi033.stdout:2480: finishing rollback tid 2 to smithi03339061-50 2021-07-26T16:06:13.235 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1285 (ObjNum 687 snap 229 seq_num 687) dirty exists 2021-07-26T16:06:13.237 INFO:tasks.rados.rados.0.smithi033.stdout:2480: done (1 left) 2021-07-26T16:06:13.238 INFO:tasks.rados.rados.0.smithi033.stdout:2484: done (0 left) 2021-07-26T16:06:13.238 INFO:tasks.rados.rados.0.smithi033.stdout:2485: snap_create 2021-07-26T16:06:13.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:13.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:13.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:13.512Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:13.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:13.512Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:06:14.211 INFO:tasks.rados.rados.0.smithi033.stdout:2485: done (0 left) 2021-07-26T16:06:14.211 INFO:tasks.rados.rados.0.smithi033.stdout:2486: read oid 43 snap 248 2021-07-26T16:06:14.211 INFO:tasks.rados.rados.0.smithi033.stdout:2486: expect (ObjNum 733 snap 246 seq_num 733) 2021-07-26T16:06:14.211 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 251 2021-07-26T16:06:14.212 INFO:tasks.rados.rados.0.smithi033.stdout:2487: seq_num 751 ranges {2473984=581632} 2021-07-26T16:06:14.232 INFO:tasks.rados.rados.0.smithi033.stdout:2487: writing smithi03339061-8 from 2473984 to 3055616 tid 1 2021-07-26T16:06:14.232 INFO:tasks.rados.rados.0.smithi033.stdout:2488: rollback oid 29 current snap is 251 2021-07-26T16:06:14.232 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 214 2021-07-26T16:06:14.232 INFO:tasks.rados.rados.0.smithi033.stdout:2486: expect (ObjNum 733 snap 246 seq_num 733) 2021-07-26T16:06:14.400 INFO:tasks.rados.rados.0.smithi033.stdout:2488: finishing rollback tid 0 to smithi03339061-29 2021-07-26T16:06:14.400 INFO:tasks.rados.rados.0.smithi033.stdout:2488: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:06:14.400 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1235 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T16:06:14.401 INFO:tasks.rados.rados.0.smithi033.stdout:2487: finishing write tid 1 to smithi03339061-8 2021-07-26T16:06:14.401 INFO:tasks.rados.rados.0.smithi033.stdout:2487: finishing write tid 2 to smithi03339061-8 2021-07-26T16:06:14.401 INFO:tasks.rados.rados.0.smithi033.stdout:2487: finishing write tid 3 to smithi03339061-8 2021-07-26T16:06:14.401 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 894 (ObjNum 751 snap 251 seq_num 751) dirty exists 2021-07-26T16:06:14.402 INFO:tasks.rados.rados.0.smithi033.stdout:2487: left oid 8 (ObjNum 751 snap 251 seq_num 751) 2021-07-26T16:06:14.402 INFO:tasks.rados.rados.0.smithi033.stdout:2486: done (2 left) 2021-07-26T16:06:14.402 INFO:tasks.rados.rados.0.smithi033.stdout:2487: done (1 left) 2021-07-26T16:06:14.402 INFO:tasks.rados.rados.0.smithi033.stdout:2488: done (0 left) 2021-07-26T16:06:14.402 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 251 2021-07-26T16:06:14.403 INFO:tasks.rados.rados.0.smithi033.stdout:2489: seq_num 752 ranges {401408=598016} 2021-07-26T16:06:14.414 INFO:tasks.rados.rados.0.smithi033.stdout:2489: writing smithi03339061-36 from 401408 to 999424 tid 1 2021-07-26T16:06:14.414 INFO:tasks.rados.rados.0.smithi033.stdout:2490: delete oid 25 current snap is 251 2021-07-26T16:06:14.423 INFO:tasks.rados.rados.0.smithi033.stdout:2490: done (1 left) 2021-07-26T16:06:14.423 INFO:tasks.rados.rados.0.smithi033.stdout:2491: setattr oid 30 current snap is 251 2021-07-26T16:06:14.423 INFO:tasks.rados.rados.0.smithi033.stdout:2489: finishing write tid 1 to smithi03339061-36 2021-07-26T16:06:14.424 INFO:tasks.rados.rados.0.smithi033.stdout:2489: finishing write tid 2 to smithi03339061-36 2021-07-26T16:06:14.424 INFO:tasks.rados.rados.0.smithi033.stdout:2492: read oid 41 snap -1 2021-07-26T16:06:14.425 INFO:tasks.rados.rados.0.smithi033.stdout:2492: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:06:14.425 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 251 2021-07-26T16:06:14.425 INFO:tasks.rados.rados.0.smithi033.stdout:2493: seq_num 754 ranges {548864=630784} 2021-07-26T16:06:14.434 INFO:tasks.rados.rados.0.smithi033.stdout:2493: writing smithi03339061-1 from 548864 to 1179648 tid 1 2021-07-26T16:06:14.435 INFO:tasks.rados.rados.0.smithi033.stdout:2494: snap_create 2021-07-26T16:06:14.435 INFO:tasks.rados.rados.0.smithi033.stdout:2489: finishing write tid 3 to smithi03339061-36 2021-07-26T16:06:14.435 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 904 (ObjNum 752 snap 251 seq_num 752) dirty exists 2021-07-26T16:06:14.435 INFO:tasks.rados.rados.0.smithi033.stdout:2489: left oid 36 (ObjNum 752 snap 251 seq_num 752) 2021-07-26T16:06:14.436 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 1417 (ObjNum 649 snap 206 seq_num 649) dirty exists 2021-07-26T16:06:14.436 INFO:tasks.rados.rados.0.smithi033.stdout:2492: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:06:14.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:14 smithi033 bash[41341]: cluster 2021-07-26T16:06:13.122410+0000 mgr.y (mgr.34104) 368 : cluster [DBG] pgmap v662: 25 pgs: 25 active+clean; 344 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 636 KiB/s wr, 29 op/s 2021-07-26T16:06:14.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:14 smithi033 bash[41341]: cluster 2021-07-26T16:06:13.158381+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e564: 8 total, 8 up, 8 in 2021-07-26T16:06:14.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:14 smithi033 bash[42377]: cluster 2021-07-26T16:06:13.122410+0000 mgr.y (mgr.34104) 368 : cluster [DBG] pgmap v662: 25 pgs: 25 active+clean; 344 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 636 KiB/s wr, 29 op/s 2021-07-26T16:06:14.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:14 smithi033 bash[42377]: cluster 2021-07-26T16:06:13.158381+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e564: 8 total, 8 up, 8 in 2021-07-26T16:06:14.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:14 smithi096 bash[33981]: cluster 2021-07-26T16:06:13.122410+0000 mgr.y (mgr.34104) 368 : cluster [DBG] pgmap v662: 25 pgs: 25 active+clean; 344 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.7 MiB/s rd, 636 KiB/s wr, 29 op/s 2021-07-26T16:06:14.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:14 smithi096 bash[33981]: cluster 2021-07-26T16:06:13.158381+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e564: 8 total, 8 up, 8 in 2021-07-26T16:06:14.488 INFO:tasks.rados.rados.0.smithi033.stdout:2493: finishing write tid 1 to smithi03339061-1 2021-07-26T16:06:14.489 INFO:tasks.rados.rados.0.smithi033.stdout:2493: finishing write tid 2 to smithi03339061-1 2021-07-26T16:06:14.489 INFO:tasks.rados.rados.0.smithi033.stdout:2493: finishing write tid 3 to smithi03339061-1 2021-07-26T16:06:14.489 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1066 (ObjNum 754 snap 251 seq_num 754) dirty exists 2021-07-26T16:06:14.490 INFO:tasks.rados.rados.0.smithi033.stdout:2493: left oid 1 (ObjNum 754 snap 251 seq_num 754) 2021-07-26T16:06:15.219 INFO:tasks.rados.rados.0.smithi033.stdout:2489: done (4 left) 2021-07-26T16:06:15.219 INFO:tasks.rados.rados.0.smithi033.stdout:2491: done (3 left) 2021-07-26T16:06:15.220 INFO:tasks.rados.rados.0.smithi033.stdout:2492: done (2 left) 2021-07-26T16:06:15.220 INFO:tasks.rados.rados.0.smithi033.stdout:2493: done (1 left) 2021-07-26T16:06:15.220 INFO:tasks.rados.rados.0.smithi033.stdout:2494: done (0 left) 2021-07-26T16:06:15.220 INFO:tasks.rados.rados.0.smithi033.stdout:2495: snap_create 2021-07-26T16:06:15.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:15 smithi096 bash[33981]: cluster 2021-07-26T16:06:14.207371+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e565: 8 total, 8 up, 8 in 2021-07-26T16:06:15.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:15 smithi033 bash[41341]: cluster 2021-07-26T16:06:14.207371+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e565: 8 total, 8 up, 8 in 2021-07-26T16:06:15.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:15 smithi033 bash[42377]: cluster 2021-07-26T16:06:14.207371+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e565: 8 total, 8 up, 8 in 2021-07-26T16:06:16.150 INFO:tasks.rados.rados.0.smithi033.stdout:2495: done (0 left) 2021-07-26T16:06:16.150 INFO:tasks.rados.rados.0.smithi033.stdout:2496: delete oid 14 current snap is 253 2021-07-26T16:06:16.153 INFO:tasks.rados.rados.0.smithi033.stdout:2496: done (0 left) 2021-07-26T16:06:16.153 INFO:tasks.rados.rados.0.smithi033.stdout:2497: snap_create 2021-07-26T16:06:16.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:16 smithi096 bash[33981]: cluster 2021-07-26T16:06:15.123144+0000 mgr.y (mgr.34104) 369 : cluster [DBG] pgmap v665: 25 pgs: 25 active+clean; 349 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 20 op/s 2021-07-26T16:06:16.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:16 smithi096 bash[33981]: cluster 2021-07-26T16:06:15.216037+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e566: 8 total, 8 up, 8 in 2021-07-26T16:06:16.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:16 smithi096 bash[33981]: cluster 2021-07-26T16:06:16.146338+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e567: 8 total, 8 up, 8 in 2021-07-26T16:06:16.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:16 smithi033 bash[41341]: cluster 2021-07-26T16:06:15.123144+0000 mgr.y (mgr.34104) 369 : cluster [DBG] pgmap v665: 25 pgs: 25 active+clean; 349 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 20 op/s 2021-07-26T16:06:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:16 smithi033 bash[41341]: cluster 2021-07-26T16:06:15.216037+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e566: 8 total, 8 up, 8 in 2021-07-26T16:06:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:16 smithi033 bash[41341]: cluster 2021-07-26T16:06:16.146338+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e567: 8 total, 8 up, 8 in 2021-07-26T16:06:16.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:16 smithi033 bash[42377]: cluster 2021-07-26T16:06:15.123144+0000 mgr.y (mgr.34104) 369 : cluster [DBG] pgmap v665: 25 pgs: 25 active+clean; 349 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 20 op/s 2021-07-26T16:06:16.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:16 smithi033 bash[42377]: cluster 2021-07-26T16:06:15.216037+0000 mon.a (mon.0) 931 : cluster [DBG] osdmap e566: 8 total, 8 up, 8 in 2021-07-26T16:06:16.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:16 smithi033 bash[42377]: cluster 2021-07-26T16:06:16.146338+0000 mon.a (mon.0) 932 : cluster [DBG] osdmap e567: 8 total, 8 up, 8 in 2021-07-26T16:06:17.164 INFO:tasks.rados.rados.0.smithi033.stdout:2497: done (0 left) 2021-07-26T16:06:17.165 INFO:tasks.rados.rados.0.smithi033.stdout:2498: copy_from oid 50 from oid 8 current snap is 254 2021-07-26T16:06:17.165 INFO:tasks.rados.rados.0.smithi033.stdout:2499: copy_from oid 29 from oid 43 current snap is 254 2021-07-26T16:06:17.165 INFO:tasks.rados.rados.0.smithi033.stdout:2500: read oid 40 snap -1 2021-07-26T16:06:17.165 INFO:tasks.rados.rados.0.smithi033.stdout:2500: expect (ObjNum 744 snap 248 seq_num 744) 2021-07-26T16:06:17.165 INFO:tasks.rados.rados.0.smithi033.stdout:2501: read oid 20 snap -1 2021-07-26T16:06:17.166 INFO:tasks.rados.rados.0.smithi033.stdout:2501: expect (ObjNum 625 snap 196 seq_num 625) 2021-07-26T16:06:17.166 INFO:tasks.rados.rados.0.smithi033.stdout:2502: copy_from oid 22 from oid 11 current snap is 254 2021-07-26T16:06:17.166 INFO:tasks.rados.rados.0.smithi033.stdout:2503: read oid 44 snap -1 2021-07-26T16:06:17.167 INFO:tasks.rados.rados.0.smithi033.stdout:2503: expect (ObjNum 747 snap 249 seq_num 747) 2021-07-26T16:06:17.167 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 254 2021-07-26T16:06:17.167 INFO:tasks.rados.rados.0.smithi033.stdout:2504: seq_num 756 ranges {6987776=671744} 2021-07-26T16:06:17.212 INFO:tasks.rados.rados.0.smithi033.stdout:2504: writing smithi03339061-12 from 6987776 to 7659520 tid 1 2021-07-26T16:06:17.213 INFO:tasks.rados.rados.0.smithi033.stdout:2505: copy_from oid 4 from oid 1 current snap is 254 2021-07-26T16:06:17.213 INFO:tasks.rados.rados.0.smithi033.stdout:2500: expect (ObjNum 744 snap 248 seq_num 744) 2021-07-26T16:06:17.234 INFO:tasks.rados.rados.0.smithi033.stdout:2501: expect (ObjNum 625 snap 196 seq_num 625) 2021-07-26T16:06:17.390 INFO:tasks.rados.rados.0.smithi033.stdout:2503: expect (ObjNum 747 snap 249 seq_num 747) 2021-07-26T16:06:17.404 INFO:tasks.rados.rados.0.smithi033.stdout:2499: finishing copy_from to smithi03339061-29 2021-07-26T16:06:17.405 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 897 (ObjNum 733 snap 246 seq_num 733) dirty exists 2021-07-26T16:06:17.405 INFO:tasks.rados.rados.0.smithi033.stdout:2499: finishing copy_from racing read to smithi03339061-29 2021-07-26T16:06:17.405 INFO:tasks.rados.rados.0.smithi033.stdout:2498: finishing copy_from to smithi03339061-50 2021-07-26T16:06:17.405 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 894 (ObjNum 751 snap 251 seq_num 751) dirty exists 2021-07-26T16:06:17.406 INFO:tasks.rados.rados.0.smithi033.stdout:2498: finishing copy_from racing read to smithi03339061-50 2021-07-26T16:06:17.406 INFO:tasks.rados.rados.0.smithi033.stdout:2505: finishing copy_from to smithi03339061-4 2021-07-26T16:06:17.406 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1066 (ObjNum 754 snap 251 seq_num 754) dirty exists 2021-07-26T16:06:17.406 INFO:tasks.rados.rados.0.smithi033.stdout:2505: finishing copy_from racing read to smithi03339061-4 2021-07-26T16:06:17.407 INFO:tasks.rados.rados.0.smithi033.stdout:2504: finishing write tid 1 to smithi03339061-12 2021-07-26T16:06:17.407 INFO:tasks.rados.rados.0.smithi033.stdout:2504: finishing write tid 2 to smithi03339061-12 2021-07-26T16:06:17.407 INFO:tasks.rados.rados.0.smithi033.stdout:2504: finishing write tid 3 to smithi03339061-12 2021-07-26T16:06:17.407 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1252 (ObjNum 756 snap 254 seq_num 756) dirty exists 2021-07-26T16:06:17.408 INFO:tasks.rados.rados.0.smithi033.stdout:2504: left oid 12 (ObjNum 756 snap 254 seq_num 756) 2021-07-26T16:06:17.408 INFO:tasks.rados.rados.0.smithi033.stdout:2502: finishing copy_from to smithi03339061-22 2021-07-26T16:06:17.408 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 902 (ObjNum 695 snap 229 seq_num 695) dirty exists 2021-07-26T16:06:17.408 INFO:tasks.rados.rados.0.smithi033.stdout:2502: finishing copy_from racing read to smithi03339061-22 2021-07-26T16:06:17.408 INFO:tasks.rados.rados.0.smithi033.stdout:2498: done (7 left) 2021-07-26T16:06:17.409 INFO:tasks.rados.rados.0.smithi033.stdout:2499: done (6 left) 2021-07-26T16:06:17.409 INFO:tasks.rados.rados.0.smithi033.stdout:2500: done (5 left) 2021-07-26T16:06:17.409 INFO:tasks.rados.rados.0.smithi033.stdout:2501: done (4 left) 2021-07-26T16:06:17.409 INFO:tasks.rados.rados.0.smithi033.stdout:2502: done (3 left) 2021-07-26T16:06:17.410 INFO:tasks.rados.rados.0.smithi033.stdout:2503: done (2 left) 2021-07-26T16:06:17.410 INFO:tasks.rados.rados.0.smithi033.stdout:2504: done (1 left) 2021-07-26T16:06:17.410 INFO:tasks.rados.rados.0.smithi033.stdout:2505: done (0 left) 2021-07-26T16:06:17.410 INFO:tasks.rados.rados.0.smithi033.stdout:2506: read oid 38 snap -1 2021-07-26T16:06:17.410 INFO:tasks.rados.rados.0.smithi033.stdout:2506: expect (ObjNum 667 snap 217 seq_num 667) 2021-07-26T16:06:17.411 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 254 2021-07-26T16:06:17.411 INFO:tasks.rados.rados.0.smithi033.stdout:2507: seq_num 757 ranges {483328=688128} 2021-07-26T16:06:17.419 INFO:tasks.rados.rados.0.smithi033.stdout:2507: writing smithi03339061-9 from 483328 to 1171456 tid 1 2021-07-26T16:06:17.419 INFO:tasks.rados.rados.0.smithi033.stdout:2508: rollback oid 15 current snap is 254 2021-07-26T16:06:17.419 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 15 to 238 2021-07-26T16:06:17.419 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 44 current snap is 254 2021-07-26T16:06:17.420 INFO:tasks.rados.rados.0.smithi033.stdout:2509: seq_num 758 ranges {516096=704512} 2021-07-26T16:06:17.427 INFO:tasks.rados.rados.0.smithi033.stdout:2509: writing smithi03339061-44 from 516096 to 1220608 tid 1 2021-07-26T16:06:17.427 INFO:tasks.rados.rados.0.smithi033.stdout:2510: read oid 50 snap 236 2021-07-26T16:06:17.427 INFO:tasks.rados.rados.0.smithi033.stdout:2510: expect (ObjNum 687 snap 229 seq_num 687) 2021-07-26T16:06:17.427 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 254 2021-07-26T16:06:17.428 INFO:tasks.rados.rados.0.smithi033.stdout:2511: seq_num 759 ranges {3244032=720896} 2021-07-26T16:06:17.452 INFO:tasks.rados.rados.0.smithi033.stdout:2511: writing smithi03339061-43 from 3244032 to 3964928 tid 1 2021-07-26T16:06:17.452 INFO:tasks.rados.rados.0.smithi033.stdout:2512: copy_from oid 49 from oid 8 current snap is 254 2021-07-26T16:06:17.453 INFO:tasks.rados.rados.0.smithi033.stdout:2507: finishing write tid 1 to smithi03339061-9 2021-07-26T16:06:17.453 INFO:tasks.rados.rados.0.smithi033.stdout:2507: finishing write tid 2 to smithi03339061-9 2021-07-26T16:06:17.453 INFO:tasks.rados.rados.0.smithi033.stdout:2513: delete oid 20 current snap is 254 2021-07-26T16:06:17.453 INFO:tasks.rados.rados.0.smithi033.stdout:2508: finishing rollback tid 0 to smithi03339061-15 2021-07-26T16:06:17.454 INFO:tasks.rados.rados.0.smithi033.stdout:2508: finishing rollback tid 1 to smithi03339061-15 2021-07-26T16:06:17.454 INFO:tasks.rados.rados.0.smithi033.stdout:2508: finishing rollback tid 2 to smithi03339061-15 2021-07-26T16:06:17.454 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 823 (ObjNum 538 snap 167 seq_num 538) dirty exists 2021-07-26T16:06:17.455 INFO:tasks.rados.rados.0.smithi033.stdout:2507: finishing write tid 3 to smithi03339061-9 2021-07-26T16:06:17.455 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 896 (ObjNum 757 snap 254 seq_num 757) dirty exists 2021-07-26T16:06:17.455 INFO:tasks.rados.rados.0.smithi033.stdout:2507: left oid 9 (ObjNum 757 snap 254 seq_num 757) 2021-07-26T16:06:17.455 INFO:tasks.rados.rados.0.smithi033.stdout:2509: finishing write tid 1 to smithi03339061-44 2021-07-26T16:06:17.456 INFO:tasks.rados.rados.0.smithi033.stdout:2509: finishing write tid 2 to smithi03339061-44 2021-07-26T16:06:17.456 INFO:tasks.rados.rados.0.smithi033.stdout:2509: finishing write tid 3 to smithi03339061-44 2021-07-26T16:06:17.456 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1279 (ObjNum 758 snap 254 seq_num 758) dirty exists 2021-07-26T16:06:17.456 INFO:tasks.rados.rados.0.smithi033.stdout:2509: left oid 44 (ObjNum 758 snap 254 seq_num 758) 2021-07-26T16:06:17.457 INFO:tasks.rados.rados.0.smithi033.stdout:2506: expect (ObjNum 667 snap 217 seq_num 667) 2021-07-26T16:06:18.195 INFO:tasks.rados.rados.0.smithi033.stdout:2510: expect (ObjNum 687 snap 229 seq_num 687) 2021-07-26T16:06:18.387 INFO:tasks.rados.rados.0.smithi033.stdout:2511: finishing write tid 1 to smithi03339061-43 2021-07-26T16:06:18.388 INFO:tasks.rados.rados.0.smithi033.stdout:2511: finishing write tid 2 to smithi03339061-43 2021-07-26T16:06:18.388 INFO:tasks.rados.rados.0.smithi033.stdout:2511: finishing write tid 3 to smithi03339061-43 2021-07-26T16:06:18.388 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 1233 (ObjNum 759 snap 254 seq_num 759) dirty exists 2021-07-26T16:06:18.388 INFO:tasks.rados.rados.0.smithi033.stdout:2511: left oid 43 (ObjNum 759 snap 254 seq_num 759) 2021-07-26T16:06:18.388 INFO:tasks.rados.rados.0.smithi033.stdout:2512: finishing copy_from to smithi03339061-49 2021-07-26T16:06:18.389 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 894 (ObjNum 751 snap 251 seq_num 751) dirty exists 2021-07-26T16:06:18.389 INFO:tasks.rados.rados.0.smithi033.stdout:2512: finishing copy_from racing read to smithi03339061-49 2021-07-26T16:06:18.389 INFO:tasks.rados.rados.0.smithi033.stdout:2506: done (7 left) 2021-07-26T16:06:18.389 INFO:tasks.rados.rados.0.smithi033.stdout:2507: done (6 left) 2021-07-26T16:06:18.390 INFO:tasks.rados.rados.0.smithi033.stdout:2508: done (5 left) 2021-07-26T16:06:18.390 INFO:tasks.rados.rados.0.smithi033.stdout:2509: done (4 left) 2021-07-26T16:06:18.390 INFO:tasks.rados.rados.0.smithi033.stdout:2510: done (3 left) 2021-07-26T16:06:18.391 INFO:tasks.rados.rados.0.smithi033.stdout:2511: done (2 left) 2021-07-26T16:06:18.391 INFO:tasks.rados.rados.0.smithi033.stdout:2512: done (1 left) 2021-07-26T16:06:18.391 INFO:tasks.rados.rados.0.smithi033.stdout:2513: done (0 left) 2021-07-26T16:06:18.391 INFO:tasks.rados.rados.0.smithi033.stdout:2514: read oid 30 snap -1 2021-07-26T16:06:18.392 INFO:tasks.rados.rados.0.smithi033.stdout:2514: expect (ObjNum 649 snap 206 seq_num 649) 2021-07-26T16:06:18.392 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 254 2021-07-26T16:06:18.392 INFO:tasks.rados.rados.0.smithi033.stdout:2515: seq_num 761 ranges {3055616=753664} 2021-07-26T16:06:18.417 INFO:tasks.rados.rados.0.smithi033.stdout:2515: writing smithi03339061-49 from 3055616 to 3809280 tid 1 2021-07-26T16:06:18.417 INFO:tasks.rados.rados.0.smithi033.stdout:2516: snap_remove snap 251 2021-07-26T16:06:18.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:18 smithi033 bash[41341]: cluster 2021-07-26T16:06:17.123893+0000 mgr.y (mgr.34104) 370 : cluster [DBG] pgmap v668: 25 pgs: 25 active+clean; 340 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 7 op/s 2021-07-26T16:06:18.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:18 smithi033 bash[41341]: cluster 2021-07-26T16:06:17.158978+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2021-07-26T16:06:18.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:18 smithi033 bash[42377]: cluster 2021-07-26T16:06:17.123893+0000 mgr.y (mgr.34104) 370 : cluster [DBG] pgmap v668: 25 pgs: 25 active+clean; 340 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 7 op/s 2021-07-26T16:06:18.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:18 smithi033 bash[42377]: cluster 2021-07-26T16:06:17.158978+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2021-07-26T16:06:18.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:18 smithi096 bash[33981]: cluster 2021-07-26T16:06:17.123893+0000 mgr.y (mgr.34104) 370 : cluster [DBG] pgmap v668: 25 pgs: 25 active+clean; 340 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 1.5 MiB/s rd, 2.0 MiB/s wr, 7 op/s 2021-07-26T16:06:18.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:18 smithi096 bash[33981]: cluster 2021-07-26T16:06:17.158978+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e568: 8 total, 8 up, 8 in 2021-07-26T16:06:19.175 INFO:tasks.rados.rados.0.smithi033.stdout:2516: done (2 left) 2021-07-26T16:06:19.176 INFO:tasks.rados.rados.0.smithi033.stdout:2517: copy_from oid 12 from oid 33 current snap is 254 2021-07-26T16:06:19.176 INFO:tasks.rados.rados.0.smithi033.stdout:2518: delete oid 9 current snap is 254 2021-07-26T16:06:19.176 INFO:tasks.rados.rados.0.smithi033.stdout:2514: expect (ObjNum 649 snap 206 seq_num 649) 2021-07-26T16:06:19.222 INFO:tasks.rados.rados.0.smithi033.stdout:2515: finishing write tid 1 to smithi03339061-49 2021-07-26T16:06:19.223 INFO:tasks.rados.rados.0.smithi033.stdout:2515: finishing write tid 2 to smithi03339061-49 2021-07-26T16:06:19.223 INFO:tasks.rados.rados.0.smithi033.stdout:2515: finishing write tid 3 to smithi03339061-49 2021-07-26T16:06:19.223 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 896 (ObjNum 761 snap 254 seq_num 761) dirty exists 2021-07-26T16:06:19.223 INFO:tasks.rados.rados.0.smithi033.stdout:2515: left oid 49 (ObjNum 761 snap 254 seq_num 761) 2021-07-26T16:06:19.224 INFO:tasks.rados.rados.0.smithi033.stdout:2517: finishing copy_from to smithi03339061-12 2021-07-26T16:06:19.224 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1377 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:06:19.224 INFO:tasks.rados.rados.0.smithi033.stdout:2517: finishing copy_from racing read to smithi03339061-12 2021-07-26T16:06:19.224 INFO:tasks.rados.rados.0.smithi033.stdout:2514: done (3 left) 2021-07-26T16:06:19.224 INFO:tasks.rados.rados.0.smithi033.stdout:2515: done (2 left) 2021-07-26T16:06:19.225 INFO:tasks.rados.rados.0.smithi033.stdout:2517: done (1 left) 2021-07-26T16:06:19.225 INFO:tasks.rados.rados.0.smithi033.stdout:2518: done (0 left) 2021-07-26T16:06:19.225 INFO:tasks.rados.rados.0.smithi033.stdout:2519: copy_from oid 46 from oid 48 current snap is 254 2021-07-26T16:06:19.225 INFO:tasks.rados.rados.0.smithi033.stdout:2520: setattr oid 21 current snap is 254 2021-07-26T16:06:19.226 INFO:tasks.rados.rados.0.smithi033.stdout:2521: rollback oid 49 current snap is 254 2021-07-26T16:06:19.227 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 49 to 223 2021-07-26T16:06:19.227 INFO:tasks.rados.rados.0.smithi033.stdout:2522: rmattr oid 33 current snap is 254 2021-07-26T16:06:19.227 INFO:tasks.rados.rados.0.smithi033.stdout:2522: done (3 left) 2021-07-26T16:06:19.228 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 254 2021-07-26T16:06:19.228 INFO:tasks.rados.rados.0.smithi033.stdout:2523: seq_num 763 ranges {13475840=786432} 2021-07-26T16:06:19.311 INFO:tasks.rados.rados.0.smithi033.stdout:2523: writing smithi03339061-11 from 13475840 to 14262272 tid 1 2021-07-26T16:06:19.311 INFO:tasks.rados.rados.0.smithi033.stdout:2524: delete oid 36 current snap is 254 2021-07-26T16:06:19.312 INFO:tasks.rados.rados.0.smithi033.stdout:2521: finishing rollback tid 0 to smithi03339061-49 2021-07-26T16:06:19.312 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1236 (ObjNum 2008512328 snap 22002 seq_num 0) dirty exists 2021-07-26T16:06:19.313 INFO:tasks.rados.rados.0.smithi033.stdout:2521: finishing rollback tid 1 to smithi03339061-49 2021-07-26T16:06:19.313 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 898 (ObjNum 2006615328 snap 22002 seq_num 2007615472) dirty dne 2021-07-26T16:06:19.313 INFO:tasks.rados.rados.0.smithi033.stdout:2519: finishing copy_from to smithi03339061-46 2021-07-26T16:06:19.314 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 897 (ObjNum 733 snap 246 seq_num 733) dirty exists 2021-07-26T16:06:19.314 INFO:tasks.rados.rados.0.smithi033.stdout:2519: finishing copy_from racing read to smithi03339061-46 2021-07-26T16:06:19.324 INFO:tasks.rados.rados.0.smithi033.stdout:2523: finishing write tid 1 to smithi03339061-11 2021-07-26T16:06:19.325 INFO:tasks.rados.rados.0.smithi033.stdout:2523: finishing write tid 2 to smithi03339061-11 2021-07-26T16:06:19.325 INFO:tasks.rados.rados.0.smithi033.stdout:2519: done (4 left) 2021-07-26T16:06:19.326 INFO:tasks.rados.rados.0.smithi033.stdout:2520: done (3 left) 2021-07-26T16:06:19.326 INFO:tasks.rados.rados.0.smithi033.stdout:2521: done (2 left) 2021-07-26T16:06:19.327 INFO:tasks.rados.rados.0.smithi033.stdout:2524: done (1 left) 2021-07-26T16:06:19.327 INFO:tasks.rados.rados.0.smithi033.stdout:2525: copy_from oid 23 from oid 33 current snap is 254 2021-07-26T16:06:19.328 INFO:tasks.rados.rados.0.smithi033.stdout:2526: delete oid 40 current snap is 254 2021-07-26T16:06:19.331 INFO:tasks.rados.rados.0.smithi033.stdout:2523: finishing write tid 3 to smithi03339061-11 2021-07-26T16:06:19.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 906 (ObjNum 763 snap 254 seq_num 763) dirty exists 2021-07-26T16:06:19.331 INFO:tasks.rados.rados.0.smithi033.stdout:2523: left oid 11 (ObjNum 763 snap 254 seq_num 763) 2021-07-26T16:06:19.331 INFO:tasks.rados.rados.0.smithi033.stdout:2523: done (2 left) 2021-07-26T16:06:19.332 INFO:tasks.rados.rados.0.smithi033.stdout:2526: done (1 left) 2021-07-26T16:06:19.332 INFO:tasks.rados.rados.0.smithi033.stdout:2527: setattr oid 36 current snap is 254 2021-07-26T16:06:19.333 INFO:tasks.rados.rados.0.smithi033.stdout:2528: rollback oid 10 current snap is 254 2021-07-26T16:06:19.334 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 10 to 239 2021-07-26T16:06:19.334 INFO:tasks.rados.rados.0.smithi033.stdout:2529: copy_from oid 46 from oid 49 current snap is 254 2021-07-26T16:06:19.334 INFO:tasks.rados.rados.0.smithi033.stdout:2530: rollback oid 25 current snap is 254 2021-07-26T16:06:19.335 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 25 to 247 2021-07-26T16:06:19.335 INFO:tasks.rados.rados.0.smithi033.stdout:2531: read oid 15 snap -1 2021-07-26T16:06:19.335 INFO:tasks.rados.rados.0.smithi033.stdout:2531: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:06:19.335 INFO:tasks.rados.rados.0.smithi033.stdout:2532: rollback oid 9 current snap is 254 2021-07-26T16:06:19.336 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 9 to 250 2021-07-26T16:06:19.336 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 254 2021-07-26T16:06:19.336 INFO:tasks.rados.rados.0.smithi033.stdout:2533: seq_num 766 ranges {0=434176,434176=401408} 2021-07-26T16:06:19.337 INFO:tasks.rados.rados.0.smithi033.stdout:2533: writing smithi03339061-20 from 0 to 434176 tid 1 2021-07-26T16:06:19.337 INFO:tasks.rados.rados.0.smithi033.stdout:2533: writing smithi03339061-20 from 434176 to 835584 tid 2 2021-07-26T16:06:19.337 INFO:tasks.rados.rados.0.smithi033.stdout:2534: snap_remove snap 253 2021-07-26T16:06:20.185 INFO:tasks.rados.rados.0.smithi033.stdout:2534: done (8 left) 2021-07-26T16:06:20.185 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 254 2021-07-26T16:06:20.186 INFO:tasks.rados.rados.0.smithi033.stdout:2529: finishing copy_from to smithi03339061-46 2021-07-26T16:06:20.186 INFO:tasks.rados.rados.0.smithi033.stdout:2529: got expected ENOENT (src dne) 2021-07-26T16:06:20.186 INFO:tasks.rados.rados.0.smithi033.stdout:2535: seq_num 767 ranges {1884160=450560,2334720=401408} 2021-07-26T16:06:20.200 INFO:tasks.rados.rados.0.smithi033.stdout:2535: writing smithi03339061-41 from 1884160 to 2334720 tid 1 2021-07-26T16:06:20.202 INFO:tasks.rados.rados.0.smithi033.stdout:2535: writing smithi03339061-41 from 2334720 to 2736128 tid 2 2021-07-26T16:06:20.203 INFO:tasks.rados.rados.0.smithi033.stdout:2536: snap_create 2021-07-26T16:06:20.203 INFO:tasks.rados.rados.0.smithi033.stdout:2529: finishing copy_from racing read to smithi03339061-46 2021-07-26T16:06:20.203 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 908 (ObjNum 1 snap 32561 seq_num 2007551376) dirty exists 2021-07-26T16:06:20.203 INFO:tasks.rados.rados.0.smithi033.stdout:2530: finishing rollback tid 1 to smithi03339061-25 2021-07-26T16:06:20.204 INFO:tasks.rados.rados.0.smithi033.stdout:2530: finishing rollback tid 2 to smithi03339061-25 2021-07-26T16:06:20.204 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 1288 (ObjNum 682 snap 225 seq_num 682) dirty exists 2021-07-26T16:06:20.204 INFO:tasks.rados.rados.0.smithi033.stdout:2532: finishing rollback tid 1 to smithi03339061-9 2021-07-26T16:06:20.204 INFO:tasks.rados.rados.0.smithi033.stdout:2533: finishing write tid 1 to smithi03339061-20 2021-07-26T16:06:20.204 INFO:tasks.rados.rados.0.smithi033.stdout:2528: finishing rollback tid 0 to smithi03339061-10 2021-07-26T16:06:20.205 INFO:tasks.rados.rados.0.smithi033.stdout:2532: finishing rollback tid 2 to smithi03339061-9 2021-07-26T16:06:20.205 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 899 (ObjNum 745 snap 249 seq_num 745) dirty exists 2021-07-26T16:06:20.205 INFO:tasks.rados.rados.0.smithi033.stdout:2528: finishing rollback tid 1 to smithi03339061-10 2021-07-26T16:06:20.205 INFO:tasks.rados.rados.0.smithi033.stdout:2528: finishing rollback tid 2 to smithi03339061-10 2021-07-26T16:06:20.206 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1420 (ObjNum 2008417888 snap 22002 seq_num 2006820496) dirty exists 2021-07-26T16:06:20.206 INFO:tasks.rados.rados.0.smithi033.stdout:2533: finishing write tid 2 to smithi03339061-20 2021-07-26T16:06:20.206 INFO:tasks.rados.rados.0.smithi033.stdout:2533: finishing write tid 3 to smithi03339061-20 2021-07-26T16:06:20.206 INFO:tasks.rados.rados.0.smithi033.stdout:2525: finishing copy_from to smithi03339061-23 2021-07-26T16:06:20.206 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1377 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:06:20.207 INFO:tasks.rados.rados.0.smithi033.stdout:2533: finishing write tid 4 to smithi03339061-20 2021-07-26T16:06:20.207 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1283 (ObjNum 766 snap 254 seq_num 766) dirty exists 2021-07-26T16:06:20.207 INFO:tasks.rados.rados.0.smithi033.stdout:2533: left oid 20 (ObjNum 766 snap 254 seq_num 766) 2021-07-26T16:06:20.207 INFO:tasks.rados.rados.0.smithi033.stdout:2525: finishing copy_from racing read to smithi03339061-23 2021-07-26T16:06:20.207 INFO:tasks.rados.rados.0.smithi033.stdout:2531: expect (ObjNum 538 snap 167 seq_num 538) 2021-07-26T16:06:20.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:20 smithi033 bash[41341]: cluster 2021-07-26T16:06:19.124619+0000 mgr.y (mgr.34104) 371 : cluster [DBG] pgmap v670: 25 pgs: 25 active+clean; 353 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 4.3 MiB/s wr, 11 op/s 2021-07-26T16:06:20.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:20 smithi033 bash[41341]: cluster 2021-07-26T16:06:19.169509+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2021-07-26T16:06:20.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:20 smithi033 bash[42377]: cluster 2021-07-26T16:06:19.124619+0000 mgr.y (mgr.34104) 371 : cluster [DBG] pgmap v670: 25 pgs: 25 active+clean; 353 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 4.3 MiB/s wr, 11 op/s 2021-07-26T16:06:20.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:20 smithi033 bash[42377]: cluster 2021-07-26T16:06:19.169509+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2021-07-26T16:06:20.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:20 smithi096 bash[33981]: cluster 2021-07-26T16:06:19.124619+0000 mgr.y (mgr.34104) 371 : cluster [DBG] pgmap v670: 25 pgs: 25 active+clean; 353 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 6.4 MiB/s rd, 4.3 MiB/s wr, 11 op/s 2021-07-26T16:06:20.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:20 smithi096 bash[33981]: cluster 2021-07-26T16:06:19.169509+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e569: 8 total, 8 up, 8 in 2021-07-26T16:06:21.115 INFO:tasks.rados.rados.0.smithi033.stdout:2535: finishing write tid 1 to smithi03339061-41 2021-07-26T16:06:21.115 INFO:tasks.rados.rados.0.smithi033.stdout:2535: finishing write tid 2 to smithi03339061-41 2021-07-26T16:06:21.115 INFO:tasks.rados.rados.0.smithi033.stdout:2535: finishing write tid 3 to smithi03339061-41 2021-07-26T16:06:21.116 INFO:tasks.rados.rados.0.smithi033.stdout:2535: finishing write tid 4 to smithi03339061-41 2021-07-26T16:06:21.116 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1236 (ObjNum 767 snap 254 seq_num 767) dirty exists 2021-07-26T16:06:21.116 INFO:tasks.rados.rados.0.smithi033.stdout:2535: left oid 41 (ObjNum 767 snap 254 seq_num 767) 2021-07-26T16:06:21.152 INFO:tasks.rados.rados.0.smithi033.stdout:2525: done (9 left) 2021-07-26T16:06:21.152 INFO:tasks.rados.rados.0.smithi033.stdout:2527: done (8 left) 2021-07-26T16:06:21.152 INFO:tasks.rados.rados.0.smithi033.stdout:2528: done (7 left) 2021-07-26T16:06:21.152 INFO:tasks.rados.rados.0.smithi033.stdout:2529: done (6 left) 2021-07-26T16:06:21.153 INFO:tasks.rados.rados.0.smithi033.stdout:2530: done (5 left) 2021-07-26T16:06:21.153 INFO:tasks.rados.rados.0.smithi033.stdout:2531: done (4 left) 2021-07-26T16:06:21.153 INFO:tasks.rados.rados.0.smithi033.stdout:2532: done (3 left) 2021-07-26T16:06:21.154 INFO:tasks.rados.rados.0.smithi033.stdout:2533: done (2 left) 2021-07-26T16:06:21.154 INFO:tasks.rados.rados.0.smithi033.stdout:2535: done (1 left) 2021-07-26T16:06:21.154 INFO:tasks.rados.rados.0.smithi033.stdout:2536: done (0 left) 2021-07-26T16:06:21.154 INFO:tasks.rados.rados.0.smithi033.stdout:2537: read oid 30 snap -1 2021-07-26T16:06:21.155 INFO:tasks.rados.rados.0.smithi033.stdout:2537: expect (ObjNum 649 snap 206 seq_num 649) 2021-07-26T16:06:21.155 INFO:tasks.rados.rados.0.smithi033.stdout:2538: rollback oid 29 current snap is 255 2021-07-26T16:06:21.155 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 242 2021-07-26T16:06:21.155 INFO:tasks.rados.rados.0.smithi033.stdout:2539: rollback oid 2 current snap is 255 2021-07-26T16:06:21.155 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 2 to 242 2021-07-26T16:06:21.156 INFO:tasks.rados.rados.0.smithi033.stdout:2540: rollback oid 35 current snap is 255 2021-07-26T16:06:21.156 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 223 2021-07-26T16:06:21.156 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 255 2021-07-26T16:06:21.156 INFO:tasks.rados.rados.0.smithi033.stdout:2541: seq_num 768 ranges {9830400=466944,10297344=401408} 2021-07-26T16:06:21.210 INFO:tasks.rados.rados.0.smithi033.stdout:2541: writing smithi03339061-15 from 9830400 to 10297344 tid 1 2021-07-26T16:06:21.216 INFO:tasks.rados.rados.0.smithi033.stdout:2541: writing smithi03339061-15 from 10297344 to 10698752 tid 2 2021-07-26T16:06:21.216 INFO:tasks.rados.rados.0.smithi033.stdout:2542: read oid 42 snap -1 2021-07-26T16:06:21.216 INFO:tasks.rados.rados.0.smithi033.stdout:2542: expect deleted 2021-07-26T16:06:21.217 INFO:tasks.rados.rados.0.smithi033.stdout:2543: snap_remove snap 247 2021-07-26T16:06:21.217 INFO:tasks.rados.rados.0.smithi033.stdout:2540: finishing rollback tid 0 to smithi03339061-35 2021-07-26T16:06:21.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[41341]: cluster 2021-07-26T16:06:20.179932+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2021-07-26T16:06:21.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[41341]: audit 2021-07-26T16:06:20.556388+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:06:21.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[41341]: audit 2021-07-26T16:06:20.559276+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:06:21.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[41341]: audit 2021-07-26T16:06:20.561431+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:06:21.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[41341]: audit 2021-07-26T16:06:20.843308+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:06:21.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[41341]: cluster 2021-07-26T16:06:21.147943+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2021-07-26T16:06:21.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[42377]: cluster 2021-07-26T16:06:20.179932+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2021-07-26T16:06:21.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[42377]: audit 2021-07-26T16:06:20.556388+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:06:21.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[42377]: audit 2021-07-26T16:06:20.559276+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:06:21.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[42377]: audit 2021-07-26T16:06:20.561431+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:06:21.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[42377]: audit 2021-07-26T16:06:20.843308+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:06:21.462 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:21 smithi033 bash[42377]: cluster 2021-07-26T16:06:21.147943+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2021-07-26T16:06:21.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:21 smithi096 bash[33981]: cluster 2021-07-26T16:06:20.179932+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e570: 8 total, 8 up, 8 in 2021-07-26T16:06:21.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:21 smithi096 bash[33981]: audit 2021-07-26T16:06:20.556388+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:06:21.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:21 smithi096 bash[33981]: audit 2021-07-26T16:06:20.559276+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:06:21.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:21 smithi096 bash[33981]: audit 2021-07-26T16:06:20.561431+0000 mon.c (mon.1) 255 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:06:21.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:21 smithi096 bash[33981]: audit 2021-07-26T16:06:20.843308+0000 mon.a (mon.0) 936 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:06:21.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:21 smithi096 bash[33981]: cluster 2021-07-26T16:06:21.147943+0000 mon.a (mon.0) 937 : cluster [DBG] osdmap e571: 8 total, 8 up, 8 in 2021-07-26T16:06:22.193 INFO:tasks.rados.rados.0.smithi033.stdout:2543: done (6 left) 2021-07-26T16:06:22.193 INFO:tasks.rados.rados.0.smithi033.stdout:2544: delete oid 43 current snap is 255 2021-07-26T16:06:22.194 INFO:tasks.rados.rados.0.smithi033.stdout:2540: finishing rollback tid 1 to smithi03339061-35 2021-07-26T16:06:22.194 INFO:tasks.rados.rados.0.smithi033.stdout:2539: finishing rollback tid 0 to smithi03339061-2 2021-07-26T16:06:22.194 INFO:tasks.rados.rados.0.smithi033.stdout:2540: finishing rollback tid 2 to smithi03339061-35 2021-07-26T16:06:22.194 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 902 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:06:22.195 INFO:tasks.rados.rados.0.smithi033.stdout:2537: expect (ObjNum 649 snap 206 seq_num 649) 2021-07-26T16:06:22.244 INFO:tasks.rados.rados.0.smithi033.stdout:2539: finishing rollback tid 1 to smithi03339061-2 2021-07-26T16:06:22.244 INFO:tasks.rados.rados.0.smithi033.stdout:2539: finishing rollback tid 2 to smithi03339061-2 2021-07-26T16:06:22.244 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1380 (ObjNum 718 snap 242 seq_num 718) dirty exists 2021-07-26T16:06:22.245 INFO:tasks.rados.rados.0.smithi033.stdout:2538: finishing rollback tid 0 to smithi03339061-29 2021-07-26T16:06:22.245 INFO:tasks.rados.rados.0.smithi033.stdout:2537: done (6 left) 2021-07-26T16:06:22.245 INFO:tasks.rados.rados.0.smithi033.stdout:2539: done (5 left) 2021-07-26T16:06:22.246 INFO:tasks.rados.rados.0.smithi033.stdout:2540: done (4 left) 2021-07-26T16:06:22.246 INFO:tasks.rados.rados.0.smithi033.stdout:2544: done (3 left) 2021-07-26T16:06:22.246 INFO:tasks.rados.rados.0.smithi033.stdout:2545: read oid 33 snap -1 2021-07-26T16:06:22.246 INFO:tasks.rados.rados.0.smithi033.stdout:2545: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:06:22.247 INFO:tasks.rados.rados.0.smithi033.stdout:2546: delete oid 26 current snap is 255 2021-07-26T16:06:22.247 INFO:tasks.rados.rados.0.smithi033.stdout:2538: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:06:22.247 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1237 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T16:06:22.247 INFO:tasks.rados.rados.0.smithi033.stdout:2541: finishing write tid 1 to smithi03339061-15 2021-07-26T16:06:22.248 INFO:tasks.rados.rados.0.smithi033.stdout:2541: finishing write tid 2 to smithi03339061-15 2021-07-26T16:06:22.248 INFO:tasks.rados.rados.0.smithi033.stdout:2541: finishing write tid 3 to smithi03339061-15 2021-07-26T16:06:22.248 INFO:tasks.rados.rados.0.smithi033.stdout:2541: finishing write tid 4 to smithi03339061-15 2021-07-26T16:06:22.248 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 901 (ObjNum 768 snap 255 seq_num 768) dirty exists 2021-07-26T16:06:22.249 INFO:tasks.rados.rados.0.smithi033.stdout:2541: left oid 15 (ObjNum 768 snap 255 seq_num 768) 2021-07-26T16:06:22.253 INFO:tasks.rados.rados.0.smithi033.stdout:2545: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:06:22.327 INFO:tasks.rados.rados.0.smithi033.stdout:2538: done (4 left) 2021-07-26T16:06:22.327 INFO:tasks.rados.rados.0.smithi033.stdout:2541: done (3 left) 2021-07-26T16:06:22.327 INFO:tasks.rados.rados.0.smithi033.stdout:2542: done (2 left) 2021-07-26T16:06:22.328 INFO:tasks.rados.rados.0.smithi033.stdout:2545: done (1 left) 2021-07-26T16:06:22.328 INFO:tasks.rados.rados.0.smithi033.stdout:2546: done (0 left) 2021-07-26T16:06:22.328 INFO:tasks.rados.rados.0.smithi033.stdout:2547: read oid 3 snap -1 2021-07-26T16:06:22.328 INFO:tasks.rados.rados.0.smithi033.stdout:2547: expect (ObjNum 711 snap 236 seq_num 711) 2021-07-26T16:06:22.329 INFO:tasks.rados.rados.0.smithi033.stdout:2548: setattr oid 20 current snap is 255 2021-07-26T16:06:22.329 INFO:tasks.rados.rados.0.smithi033.stdout:2549: delete oid 10 current snap is 255 2021-07-26T16:06:22.333 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1284 (ObjNum 766 snap 254 seq_num 766) dirty exists 2021-07-26T16:06:22.334 INFO:tasks.rados.rados.0.smithi033.stdout:2548: done (2 left) 2021-07-26T16:06:22.335 INFO:tasks.rados.rados.0.smithi033.stdout:2549: done (1 left) 2021-07-26T16:06:22.335 INFO:tasks.rados.rados.0.smithi033.stdout:2550: copy_from oid 8 from oid 41 current snap is 255 2021-07-26T16:06:22.335 INFO:tasks.rados.rados.0.smithi033.stdout:2551: snap_remove snap 242 2021-07-26T16:06:22.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:22 smithi033 bash[41341]: cluster 2021-07-26T16:06:21.125315+0000 mgr.y (mgr.34104) 372 : cluster [DBG] pgmap v673: 25 pgs: 25 active+clean; 366 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 6.3 MiB/s wr, 25 op/s 2021-07-26T16:06:22.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:22 smithi033 bash[42377]: cluster 2021-07-26T16:06:21.125315+0000 mgr.y (mgr.34104) 372 : cluster [DBG] pgmap v673: 25 pgs: 25 active+clean; 366 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 6.3 MiB/s wr, 25 op/s 2021-07-26T16:06:22.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:22 smithi096 bash[33981]: cluster 2021-07-26T16:06:21.125315+0000 mgr.y (mgr.34104) 372 : cluster [DBG] pgmap v673: 25 pgs: 25 active+clean; 366 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 16 MiB/s rd, 6.3 MiB/s wr, 25 op/s 2021-07-26T16:06:23.217 INFO:tasks.rados.rados.0.smithi033.stdout:2551: done (2 left) 2021-07-26T16:06:23.217 INFO:tasks.rados.rados.0.smithi033.stdout:2552: rmattr oid 40 current snap is 255 2021-07-26T16:06:23.218 INFO:tasks.rados.rados.0.smithi033.stdout:2552: done (2 left) 2021-07-26T16:06:23.218 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 255 2021-07-26T16:06:23.218 INFO:tasks.rados.rados.0.smithi033.stdout:2553: seq_num 772 ranges {8896512=532480,9428992=401408} 2021-07-26T16:06:23.273 INFO:tasks.rados.rados.0.smithi033.stdout:2553: writing smithi03339061-38 from 8896512 to 9428992 tid 1 2021-07-26T16:06:23.275 INFO:tasks.rados.rados.0.smithi033.stdout:2553: writing smithi03339061-38 from 9428992 to 9830400 tid 2 2021-07-26T16:06:23.276 INFO:tasks.rados.rados.0.smithi033.stdout:2547: expect (ObjNum 711 snap 236 seq_num 711) 2021-07-26T16:06:23.343 INFO:tasks.rados.rados.0.smithi033.stdout:2550: finishing copy_from to smithi03339061-8 2021-07-26T16:06:23.344 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1236 (ObjNum 767 snap 254 seq_num 767) dirty exists 2021-07-26T16:06:23.344 INFO:tasks.rados.rados.0.smithi033.stdout:2550: finishing copy_from racing read to smithi03339061-8 2021-07-26T16:06:23.344 INFO:tasks.rados.rados.0.smithi033.stdout:2553: finishing write tid 1 to smithi03339061-38 2021-07-26T16:06:23.344 INFO:tasks.rados.rados.0.smithi033.stdout:2553: finishing write tid 2 to smithi03339061-38 2021-07-26T16:06:23.344 INFO:tasks.rados.rados.0.smithi033.stdout:2553: finishing write tid 3 to smithi03339061-38 2021-07-26T16:06:23.345 INFO:tasks.rados.rados.0.smithi033.stdout:2553: finishing write tid 4 to smithi03339061-38 2021-07-26T16:06:23.345 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 717 (ObjNum 772 snap 255 seq_num 772) dirty exists 2021-07-26T16:06:23.345 INFO:tasks.rados.rados.0.smithi033.stdout:2553: left oid 38 (ObjNum 772 snap 255 seq_num 772) 2021-07-26T16:06:23.345 INFO:tasks.rados.rados.0.smithi033.stdout:2547: done (2 left) 2021-07-26T16:06:23.346 INFO:tasks.rados.rados.0.smithi033.stdout:2550: done (1 left) 2021-07-26T16:06:23.346 INFO:tasks.rados.rados.0.smithi033.stdout:2553: done (0 left) 2021-07-26T16:06:23.346 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 255 2021-07-26T16:06:23.346 INFO:tasks.rados.rados.0.smithi033.stdout:2554: seq_num 773 ranges {835584=548864,1384448=401408} 2021-07-26T16:06:23.357 INFO:tasks.rados.rados.0.smithi033.stdout:2554: writing smithi03339061-20 from 835584 to 1384448 tid 1 2021-07-26T16:06:23.360 INFO:tasks.rados.rados.0.smithi033.stdout:2554: writing smithi03339061-20 from 1384448 to 1785856 tid 2 2021-07-26T16:06:23.360 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 255 2021-07-26T16:06:23.360 INFO:tasks.rados.rados.0.smithi033.stdout:2555: seq_num 774 ranges {14262272=565248,14827520=401408} 2021-07-26T16:06:23.443 INFO:tasks.rados.rados.0.smithi033.stdout:2555: writing smithi03339061-11 from 14262272 to 14827520 tid 1 2021-07-26T16:06:23.446 INFO:tasks.rados.rados.0.smithi033.stdout:2555: writing smithi03339061-11 from 14827520 to 15228928 tid 2 2021-07-26T16:06:23.446 INFO:tasks.rados.rados.0.smithi033.stdout:2556: copy_from oid 43 from oid 31 current snap is 255 2021-07-26T16:06:23.446 INFO:tasks.rados.rados.0.smithi033.stdout:2554: finishing write tid 1 to smithi03339061-20 2021-07-26T16:06:23.447 INFO:tasks.rados.rados.0.smithi033.stdout:2557: snap_create 2021-07-26T16:06:23.447 INFO:tasks.rados.rados.0.smithi033.stdout:2554: finishing write tid 2 to smithi03339061-20 2021-07-26T16:06:23.447 INFO:tasks.rados.rados.0.smithi033.stdout:2554: finishing write tid 3 to smithi03339061-20 2021-07-26T16:06:23.447 INFO:tasks.rados.rados.0.smithi033.stdout:2554: finishing write tid 4 to smithi03339061-20 2021-07-26T16:06:23.447 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1287 (ObjNum 773 snap 255 seq_num 773) dirty exists 2021-07-26T16:06:23.448 INFO:tasks.rados.rados.0.smithi033.stdout:2554: left oid 20 (ObjNum 773 snap 255 seq_num 773) 2021-07-26T16:06:23.457 INFO:tasks.rados.rados.0.smithi033.stdout:2555: finishing write tid 1 to smithi03339061-11 2021-07-26T16:06:23.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:23 smithi033 bash[41341]: cluster 2021-07-26T16:06:22.185342+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2021-07-26T16:06:23.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:23 smithi033 bash[42377]: cluster 2021-07-26T16:06:22.185342+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2021-07-26T16:06:23.459 INFO:tasks.rados.rados.0.smithi033.stdout:2555: finishing write tid 2 to smithi03339061-11 2021-07-26T16:06:23.459 INFO:tasks.rados.rados.0.smithi033.stdout:2555: finishing write tid 3 to smithi03339061-11 2021-07-26T16:06:23.460 INFO:tasks.rados.rados.0.smithi033.stdout:2555: finishing write tid 4 to smithi03339061-11 2021-07-26T16:06:23.460 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 911 (ObjNum 774 snap 255 seq_num 774) dirty exists 2021-07-26T16:06:23.461 INFO:tasks.rados.rados.0.smithi033.stdout:2555: left oid 11 (ObjNum 774 snap 255 seq_num 774) 2021-07-26T16:06:23.471 INFO:tasks.rados.rados.0.smithi033.stdout:2556: finishing copy_from to smithi03339061-43 2021-07-26T16:06:23.472 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 881 (ObjNum 701 snap 233 seq_num 701) dirty exists 2021-07-26T16:06:23.472 INFO:tasks.rados.rados.0.smithi033.stdout:2556: finishing copy_from racing read to smithi03339061-43 2021-07-26T16:06:23.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:23 smithi096 bash[33981]: cluster 2021-07-26T16:06:22.185342+0000 mon.a (mon.0) 938 : cluster [DBG] osdmap e572: 8 total, 8 up, 8 in 2021-07-26T16:06:23.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:23.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:23.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:23.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:06:24.223 INFO:tasks.rados.rados.0.smithi033.stdout:2554: done (3 left) 2021-07-26T16:06:24.223 INFO:tasks.rados.rados.0.smithi033.stdout:2555: done (2 left) 2021-07-26T16:06:24.223 INFO:tasks.rados.rados.0.smithi033.stdout:2556: done (1 left) 2021-07-26T16:06:24.224 INFO:tasks.rados.rados.0.smithi033.stdout:2557: done (0 left) 2021-07-26T16:06:24.224 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 256 2021-07-26T16:06:24.224 INFO:tasks.rados.rados.0.smithi033.stdout:2558: seq_num 775 ranges {4808704=589824,5398528=401408} 2021-07-26T16:06:24.253 INFO:tasks.rados.rados.0.smithi033.stdout:2558: writing smithi03339061-13 from 4808704 to 5398528 tid 1 2021-07-26T16:06:24.256 INFO:tasks.rados.rados.0.smithi033.stdout:2558: writing smithi03339061-13 from 5398528 to 5799936 tid 2 2021-07-26T16:06:24.256 INFO:tasks.rados.rados.0.smithi033.stdout:2559: rollback oid 43 current snap is 256 2021-07-26T16:06:24.256 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 43 to 246 2021-07-26T16:06:24.256 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 256 2021-07-26T16:06:24.257 INFO:tasks.rados.rados.0.smithi033.stdout:2560: seq_num 776 ranges {1277952=606208,1884160=401408} 2021-07-26T16:06:24.266 INFO:tasks.rados.rados.0.smithi033.stdout:2560: writing smithi03339061-30 from 1277952 to 1884160 tid 1 2021-07-26T16:06:24.269 INFO:tasks.rados.rados.0.smithi033.stdout:2560: writing smithi03339061-30 from 1884160 to 2285568 tid 2 2021-07-26T16:06:24.269 INFO:tasks.rados.rados.0.smithi033.stdout:2561: snap_create 2021-07-26T16:06:24.270 INFO:tasks.rados.rados.0.smithi033.stdout:2558: finishing write tid 1 to smithi03339061-13 2021-07-26T16:06:24.270 INFO:tasks.rados.rados.0.smithi033.stdout:2558: finishing write tid 2 to smithi03339061-13 2021-07-26T16:06:24.270 INFO:tasks.rados.rados.0.smithi033.stdout:2558: finishing write tid 3 to smithi03339061-13 2021-07-26T16:06:24.270 INFO:tasks.rados.rados.0.smithi033.stdout:2558: finishing write tid 4 to smithi03339061-13 2021-07-26T16:06:24.271 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1290 (ObjNum 775 snap 256 seq_num 775) dirty exists 2021-07-26T16:06:24.271 INFO:tasks.rados.rados.0.smithi033.stdout:2558: left oid 13 (ObjNum 775 snap 256 seq_num 775) 2021-07-26T16:06:24.271 INFO:tasks.rados.rados.0.smithi033.stdout:2559: finishing rollback tid 0 to smithi03339061-43 2021-07-26T16:06:24.271 INFO:tasks.rados.rados.0.smithi033.stdout:2559: finishing rollback tid 1 to smithi03339061-43 2021-07-26T16:06:24.272 INFO:tasks.rados.rados.0.smithi033.stdout:2559: finishing rollback tid 2 to smithi03339061-43 2021-07-26T16:06:24.272 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 1240 (ObjNum 733 snap 246 seq_num 733) dirty exists 2021-07-26T16:06:24.275 INFO:tasks.rados.rados.0.smithi033.stdout:2560: finishing write tid 1 to smithi03339061-30 2021-07-26T16:06:24.275 INFO:tasks.rados.rados.0.smithi033.stdout:2560: finishing write tid 2 to smithi03339061-30 2021-07-26T16:06:24.275 INFO:tasks.rados.rados.0.smithi033.stdout:2560: finishing write tid 3 to smithi03339061-30 2021-07-26T16:06:24.277 INFO:tasks.rados.rados.0.smithi033.stdout:2560: finishing write tid 4 to smithi03339061-30 2021-07-26T16:06:24.277 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 1424 (ObjNum 776 snap 256 seq_num 776) dirty exists 2021-07-26T16:06:24.277 INFO:tasks.rados.rados.0.smithi033.stdout:2560: left oid 30 (ObjNum 776 snap 256 seq_num 776) 2021-07-26T16:06:24.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:24 smithi096 bash[33981]: cluster 2021-07-26T16:06:23.126014+0000 mgr.y (mgr.34104) 373 : cluster [DBG] pgmap v676: 25 pgs: 25 active+clean; 372 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 5.6 MiB/s wr, 33 op/s 2021-07-26T16:06:24.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:24 smithi096 bash[33981]: cluster 2021-07-26T16:06:23.209053+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2021-07-26T16:06:24.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:24 smithi033 bash[41341]: cluster 2021-07-26T16:06:23.126014+0000 mgr.y (mgr.34104) 373 : cluster [DBG] pgmap v676: 25 pgs: 25 active+clean; 372 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 5.6 MiB/s wr, 33 op/s 2021-07-26T16:06:24.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:24 smithi033 bash[41341]: cluster 2021-07-26T16:06:23.209053+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2021-07-26T16:06:24.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:24 smithi033 bash[42377]: cluster 2021-07-26T16:06:23.126014+0000 mgr.y (mgr.34104) 373 : cluster [DBG] pgmap v676: 25 pgs: 25 active+clean; 372 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 21 MiB/s rd, 5.6 MiB/s wr, 33 op/s 2021-07-26T16:06:24.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:24 smithi033 bash[42377]: cluster 2021-07-26T16:06:23.209053+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e573: 8 total, 8 up, 8 in 2021-07-26T16:06:25.236 INFO:tasks.rados.rados.0.smithi033.stdout:2558: done (3 left) 2021-07-26T16:06:25.237 INFO:tasks.rados.rados.0.smithi033.stdout:2559: done (2 left) 2021-07-26T16:06:25.237 INFO:tasks.rados.rados.0.smithi033.stdout:2560: done (1 left) 2021-07-26T16:06:25.237 INFO:tasks.rados.rados.0.smithi033.stdout:2561: done (0 left) 2021-07-26T16:06:25.237 INFO:tasks.rados.rados.0.smithi033.stdout:2562: snap_remove snap 252 2021-07-26T16:06:25.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:25 smithi096 bash[33981]: cluster 2021-07-26T16:06:24.220603+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2021-07-26T16:06:25.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:25 smithi033 bash[42377]: cluster 2021-07-26T16:06:24.220603+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2021-07-26T16:06:25.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:25 smithi033 bash[41341]: cluster 2021-07-26T16:06:24.220603+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e574: 8 total, 8 up, 8 in 2021-07-26T16:06:26.156 INFO:tasks.rados.rados.0.smithi033.stdout:2562: done (0 left) 2021-07-26T16:06:26.157 INFO:tasks.rados.rados.0.smithi033.stdout:2563: setattr oid 40 current snap is 257 2021-07-26T16:06:26.158 INFO:tasks.rados.rados.0.smithi033.stdout:2564: read oid 41 snap 228 2021-07-26T16:06:26.158 INFO:tasks.rados.rados.0.smithi033.stdout:2564: expect (ObjNum 677 snap 222 seq_num 677) 2021-07-26T16:06:26.159 INFO:tasks.rados.rados.0.smithi033.stdout:2565: snap_remove snap 238 2021-07-26T16:06:26.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:26 smithi096 bash[33981]: cluster 2021-07-26T16:06:25.126839+0000 mgr.y (mgr.34104) 374 : cluster [DBG] pgmap v679: 25 pgs: 25 active+clean; 378 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 7.0 MiB/s rd, 2.7 MiB/s wr, 14 op/s 2021-07-26T16:06:26.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:26 smithi096 bash[33981]: cluster 2021-07-26T16:06:25.232420+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2021-07-26T16:06:26.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:26 smithi096 bash[33981]: cluster 2021-07-26T16:06:26.151521+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2021-07-26T16:06:26.712 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:26 smithi033 bash[41341]: cluster 2021-07-26T16:06:25.126839+0000 mgr.y (mgr.34104) 374 : cluster [DBG] pgmap v679: 25 pgs: 25 active+clean; 378 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 7.0 MiB/s rd, 2.7 MiB/s wr, 14 op/s 2021-07-26T16:06:26.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:26 smithi033 bash[41341]: cluster 2021-07-26T16:06:25.232420+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2021-07-26T16:06:26.713 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:26 smithi033 bash[41341]: cluster 2021-07-26T16:06:26.151521+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2021-07-26T16:06:26.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:26 smithi033 bash[42377]: cluster 2021-07-26T16:06:25.126839+0000 mgr.y (mgr.34104) 374 : cluster [DBG] pgmap v679: 25 pgs: 25 active+clean; 378 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 7.0 MiB/s rd, 2.7 MiB/s wr, 14 op/s 2021-07-26T16:06:26.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:26 smithi033 bash[42377]: cluster 2021-07-26T16:06:25.232420+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e575: 8 total, 8 up, 8 in 2021-07-26T16:06:26.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:26 smithi033 bash[42377]: cluster 2021-07-26T16:06:26.151521+0000 mon.a (mon.0) 942 : cluster [DBG] osdmap e576: 8 total, 8 up, 8 in 2021-07-26T16:06:27.168 INFO:tasks.rados.rados.0.smithi033.stdout:2565: done (2 left) 2021-07-26T16:06:27.169 INFO:tasks.rados.rados.0.smithi033.stdout:2566: copy_from oid 27 from oid 44 current snap is 257 2021-07-26T16:06:27.169 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 523 (ObjNum 2008506880 snap 22002 seq_num 2004516880) dirty exists 2021-07-26T16:06:27.169 INFO:tasks.rados.rados.0.smithi033.stdout:2564: expect (ObjNum 677 snap 222 seq_num 677) 2021-07-26T16:06:27.278 INFO:tasks.rados.rados.0.smithi033.stdout:2566: finishing copy_from to smithi03339061-27 2021-07-26T16:06:27.279 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1279 (ObjNum 758 snap 254 seq_num 758) dirty exists 2021-07-26T16:06:27.279 INFO:tasks.rados.rados.0.smithi033.stdout:2566: finishing copy_from racing read to smithi03339061-27 2021-07-26T16:06:27.279 INFO:tasks.rados.rados.0.smithi033.stdout:2563: done (2 left) 2021-07-26T16:06:27.280 INFO:tasks.rados.rados.0.smithi033.stdout:2564: done (1 left) 2021-07-26T16:06:27.280 INFO:tasks.rados.rados.0.smithi033.stdout:2566: done (0 left) 2021-07-26T16:06:27.280 INFO:tasks.rados.rados.0.smithi033.stdout:2567: rmattr oid 1 current snap is 257 2021-07-26T16:06:27.280 INFO:tasks.rados.rados.0.smithi033.stdout:2568: rmattr oid 26 current snap is 257 2021-07-26T16:06:27.281 INFO:tasks.rados.rados.0.smithi033.stdout:2568: done (1 left) 2021-07-26T16:06:27.281 INFO:tasks.rados.rados.0.smithi033.stdout:2569: read oid 48 snap 237 2021-07-26T16:06:27.281 INFO:tasks.rados.rados.0.smithi033.stdout:2569: expect (ObjNum 602 snap 188 seq_num 602) 2021-07-26T16:06:27.281 INFO:tasks.rados.rados.0.smithi033.stdout:2570: snap_create 2021-07-26T16:06:27.282 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1067 (ObjNum 754 snap 251 seq_num 754) dirty exists 2021-07-26T16:06:27.286 INFO:tasks.rados.rados.0.smithi033.stdout:2569: expect (ObjNum 602 snap 188 seq_num 602) 2021-07-26T16:06:28.244 INFO:tasks.rados.rados.0.smithi033.stdout:2567: done (2 left) 2021-07-26T16:06:28.244 INFO:tasks.rados.rados.0.smithi033.stdout:2569: done (1 left) 2021-07-26T16:06:28.244 INFO:tasks.rados.rados.0.smithi033.stdout:2570: done (0 left) 2021-07-26T16:06:28.244 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 258 2021-07-26T16:06:28.245 INFO:tasks.rados.rados.0.smithi033.stdout:2571: seq_num 777 ranges {0=622592,622592=401408} 2021-07-26T16:06:28.251 INFO:tasks.rados.rados.0.smithi033.stdout:2571: writing smithi03339061-18 from 0 to 622592 tid 1 2021-07-26T16:06:28.253 INFO:tasks.rados.rados.0.smithi033.stdout:2571: writing smithi03339061-18 from 622592 to 1024000 tid 2 2021-07-26T16:06:28.253 INFO:tasks.rados.rados.0.smithi033.stdout:2572: snap_create 2021-07-26T16:06:28.260 INFO:tasks.rados.rados.0.smithi033.stdout:2571: finishing write tid 1 to smithi03339061-18 2021-07-26T16:06:28.260 INFO:tasks.rados.rados.0.smithi033.stdout:2571: finishing write tid 2 to smithi03339061-18 2021-07-26T16:06:28.261 INFO:tasks.rados.rados.0.smithi033.stdout:2571: finishing write tid 3 to smithi03339061-18 2021-07-26T16:06:28.264 INFO:tasks.rados.rados.0.smithi033.stdout:2571: finishing write tid 4 to smithi03339061-18 2021-07-26T16:06:28.264 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 1520 (ObjNum 777 snap 258 seq_num 777) dirty exists 2021-07-26T16:06:28.264 INFO:tasks.rados.rados.0.smithi033.stdout:2571: left oid 18 (ObjNum 777 snap 258 seq_num 777) 2021-07-26T16:06:28.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:28 smithi033 bash[41341]: cluster 2021-07-26T16:06:27.127613+0000 mgr.y (mgr.34104) 375 : cluster [DBG] pgmap v682: 25 pgs: 25 active+clean; 383 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2021-07-26T16:06:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:28 smithi033 bash[41341]: cluster 2021-07-26T16:06:27.164342+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2021-07-26T16:06:28.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:28 smithi033 bash[42377]: cluster 2021-07-26T16:06:27.127613+0000 mgr.y (mgr.34104) 375 : cluster [DBG] pgmap v682: 25 pgs: 25 active+clean; 383 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2021-07-26T16:06:28.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:28 smithi033 bash[42377]: cluster 2021-07-26T16:06:27.164342+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2021-07-26T16:06:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:28 smithi096 bash[33981]: cluster 2021-07-26T16:06:27.127613+0000 mgr.y (mgr.34104) 375 : cluster [DBG] pgmap v682: 25 pgs: 25 active+clean; 383 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.7 MiB/s wr, 13 op/s 2021-07-26T16:06:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:28 smithi096 bash[33981]: cluster 2021-07-26T16:06:27.164342+0000 mon.a (mon.0) 943 : cluster [DBG] osdmap e577: 8 total, 8 up, 8 in 2021-07-26T16:06:29.255 INFO:tasks.rados.rados.0.smithi033.stdout:2571: done (1 left) 2021-07-26T16:06:29.255 INFO:tasks.rados.rados.0.smithi033.stdout:2572: done (0 left) 2021-07-26T16:06:29.256 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 259 2021-07-26T16:06:29.256 INFO:tasks.rados.rados.0.smithi033.stdout:2573: seq_num 778 ranges {1998848=638976,2637824=401408} 2021-07-26T16:06:29.279 INFO:tasks.rados.rados.0.smithi033.stdout:2573: writing smithi03339061-45 from 1998848 to 2637824 tid 1 2021-07-26T16:06:29.280 INFO:tasks.rados.rados.0.smithi033.stdout:2573: writing smithi03339061-45 from 2637824 to 3039232 tid 2 2021-07-26T16:06:29.280 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 17 current snap is 259 2021-07-26T16:06:29.280 INFO:tasks.rados.rados.0.smithi033.stdout:2574: seq_num 779 ranges {4276224=655360,4931584=401408} 2021-07-26T16:06:29.306 INFO:tasks.rados.rados.0.smithi033.stdout:2574: writing smithi03339061-17 from 4276224 to 4931584 tid 1 2021-07-26T16:06:29.309 INFO:tasks.rados.rados.0.smithi033.stdout:2574: writing smithi03339061-17 from 4931584 to 5332992 tid 2 2021-07-26T16:06:29.309 INFO:tasks.rados.rados.0.smithi033.stdout:2575: snap_create 2021-07-26T16:06:29.309 INFO:tasks.rados.rados.0.smithi033.stdout:2573: finishing write tid 1 to smithi03339061-45 2021-07-26T16:06:29.309 INFO:tasks.rados.rados.0.smithi033.stdout:2573: finishing write tid 2 to smithi03339061-45 2021-07-26T16:06:29.310 INFO:tasks.rados.rados.0.smithi033.stdout:2573: finishing write tid 3 to smithi03339061-45 2021-07-26T16:06:29.310 INFO:tasks.rados.rados.0.smithi033.stdout:2573: finishing write tid 4 to smithi03339061-45 2021-07-26T16:06:29.310 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1524 (ObjNum 778 snap 259 seq_num 778) dirty exists 2021-07-26T16:06:29.310 INFO:tasks.rados.rados.0.smithi033.stdout:2573: left oid 45 (ObjNum 778 snap 259 seq_num 778) 2021-07-26T16:06:29.318 INFO:tasks.rados.rados.0.smithi033.stdout:2574: finishing write tid 1 to smithi03339061-17 2021-07-26T16:06:29.319 INFO:tasks.rados.rados.0.smithi033.stdout:2574: finishing write tid 2 to smithi03339061-17 2021-07-26T16:06:29.319 INFO:tasks.rados.rados.0.smithi033.stdout:2574: finishing write tid 3 to smithi03339061-17 2021-07-26T16:06:29.322 INFO:tasks.rados.rados.0.smithi033.stdout:2574: finishing write tid 4 to smithi03339061-17 2021-07-26T16:06:29.322 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 526 (ObjNum 779 snap 259 seq_num 779) dirty exists 2021-07-26T16:06:29.323 INFO:tasks.rados.rados.0.smithi033.stdout:2574: left oid 17 (ObjNum 779 snap 259 seq_num 779) 2021-07-26T16:06:29.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:29 smithi033 bash[41341]: cluster 2021-07-26T16:06:28.240758+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2021-07-26T16:06:29.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:29 smithi033 bash[42377]: cluster 2021-07-26T16:06:28.240758+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2021-07-26T16:06:29.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:29 smithi096 bash[33981]: cluster 2021-07-26T16:06:28.240758+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e578: 8 total, 8 up, 8 in 2021-07-26T16:06:30.254 INFO:tasks.rados.rados.0.smithi033.stdout:2573: done (2 left) 2021-07-26T16:06:30.255 INFO:tasks.rados.rados.0.smithi033.stdout:2574: done (1 left) 2021-07-26T16:06:30.255 INFO:tasks.rados.rados.0.smithi033.stdout:2575: done (0 left) 2021-07-26T16:06:30.255 INFO:tasks.rados.rados.0.smithi033.stdout:2576: rmattr oid 43 current snap is 260 2021-07-26T16:06:30.255 INFO:tasks.rados.rados.0.smithi033.stdout:2576: done (0 left) 2021-07-26T16:06:30.256 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 260 2021-07-26T16:06:30.256 INFO:tasks.rados.rados.0.smithi033.stdout:2577: seq_num 780 ranges {2285568=671744,2957312=401408} 2021-07-26T16:06:30.274 INFO:tasks.rados.rados.0.smithi033.stdout:2577: writing smithi03339061-30 from 2285568 to 2957312 tid 1 2021-07-26T16:06:30.277 INFO:tasks.rados.rados.0.smithi033.stdout:2577: writing smithi03339061-30 from 2957312 to 3358720 tid 2 2021-07-26T16:06:30.277 INFO:tasks.rados.rados.0.smithi033.stdout:2578: read oid 44 snap -1 2021-07-26T16:06:30.277 INFO:tasks.rados.rados.0.smithi033.stdout:2578: expect (ObjNum 758 snap 254 seq_num 758) 2021-07-26T16:06:30.277 INFO:tasks.rados.rados.0.smithi033.stdout:2579: copy_from oid 31 from oid 28 current snap is 260 2021-07-26T16:06:30.278 INFO:tasks.rados.rados.0.smithi033.stdout:2580: copy_from oid 14 from oid 35 current snap is 260 2021-07-26T16:06:30.278 INFO:tasks.rados.rados.0.smithi033.stdout:2581: snap_remove snap 228 2021-07-26T16:06:30.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:30 smithi033 bash[41341]: cluster 2021-07-26T16:06:29.128299+0000 mgr.y (mgr.34104) 376 : cluster [DBG] pgmap v685: 25 pgs: 25 active+clean; 386 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2021-07-26T16:06:30.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:30 smithi033 bash[41341]: cluster 2021-07-26T16:06:29.251932+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2021-07-26T16:06:30.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:30 smithi033 bash[42377]: cluster 2021-07-26T16:06:29.128299+0000 mgr.y (mgr.34104) 376 : cluster [DBG] pgmap v685: 25 pgs: 25 active+clean; 386 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2021-07-26T16:06:30.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:30 smithi033 bash[42377]: cluster 2021-07-26T16:06:29.251932+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2021-07-26T16:06:30.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:30 smithi096 bash[33981]: cluster 2021-07-26T16:06:29.128299+0000 mgr.y (mgr.34104) 376 : cluster [DBG] pgmap v685: 25 pgs: 25 active+clean; 386 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 12 op/s 2021-07-26T16:06:30.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:30 smithi096 bash[33981]: cluster 2021-07-26T16:06:29.251932+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e579: 8 total, 8 up, 8 in 2021-07-26T16:06:31.161 INFO:tasks.rados.rados.0.smithi033.stdout:2581: done (4 left) 2021-07-26T16:06:31.161 INFO:tasks.rados.rados.0.smithi033.stdout:2582: rmattr oid 1 current snap is 260 2021-07-26T16:06:31.165 INFO:tasks.rados.rados.0.smithi033.stdout:2577: finishing write tid 1 to smithi03339061-30 2021-07-26T16:06:31.165 INFO:tasks.rados.rados.0.smithi033.stdout:2577: finishing write tid 2 to smithi03339061-30 2021-07-26T16:06:31.166 INFO:tasks.rados.rados.0.smithi033.stdout:2577: finishing write tid 3 to smithi03339061-30 2021-07-26T16:06:31.167 INFO:tasks.rados.rados.0.smithi033.stdout:2578: expect (ObjNum 758 snap 254 seq_num 758) 2021-07-26T16:06:31.216 INFO:tasks.rados.rados.0.smithi033.stdout:2577: finishing write tid 4 to smithi03339061-30 2021-07-26T16:06:31.216 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 1427 (ObjNum 780 snap 260 seq_num 780) dirty exists 2021-07-26T16:06:31.216 INFO:tasks.rados.rados.0.smithi033.stdout:2577: left oid 30 (ObjNum 780 snap 260 seq_num 780) 2021-07-26T16:06:31.217 INFO:tasks.rados.rados.0.smithi033.stdout:2580: finishing copy_from to smithi03339061-14 2021-07-26T16:06:31.217 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 902 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:06:31.217 INFO:tasks.rados.rados.0.smithi033.stdout:2580: finishing copy_from racing read to smithi03339061-14 2021-07-26T16:06:31.218 INFO:tasks.rados.rados.0.smithi033.stdout:2579: finishing copy_from to smithi03339061-31 2021-07-26T16:06:31.218 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1250 (ObjNum 738 snap 247 seq_num 738) dirty exists 2021-07-26T16:06:31.219 INFO:tasks.rados.rados.0.smithi033.stdout:2579: finishing copy_from racing read to smithi03339061-31 2021-07-26T16:06:31.219 INFO:tasks.rados.rados.0.smithi033.stdout:2577: done (4 left) 2021-07-26T16:06:31.219 INFO:tasks.rados.rados.0.smithi033.stdout:2578: done (3 left) 2021-07-26T16:06:31.219 INFO:tasks.rados.rados.0.smithi033.stdout:2579: done (2 left) 2021-07-26T16:06:31.220 INFO:tasks.rados.rados.0.smithi033.stdout:2580: done (1 left) 2021-07-26T16:06:31.220 INFO:tasks.rados.rados.0.smithi033.stdout:2583: snap_remove snap 258 2021-07-26T16:06:31.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:31 smithi033 bash[42377]: cluster 2021-07-26T16:06:30.251117+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2021-07-26T16:06:31.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:31 smithi033 bash[42377]: cluster 2021-07-26T16:06:31.155870+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2021-07-26T16:06:31.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:31 smithi033 bash[41341]: cluster 2021-07-26T16:06:30.251117+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2021-07-26T16:06:31.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:31 smithi033 bash[41341]: cluster 2021-07-26T16:06:31.155870+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2021-07-26T16:06:31.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:31 smithi096 bash[33981]: cluster 2021-07-26T16:06:30.251117+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e580: 8 total, 8 up, 8 in 2021-07-26T16:06:31.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:31 smithi096 bash[33981]: cluster 2021-07-26T16:06:31.155870+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e581: 8 total, 8 up, 8 in 2021-07-26T16:06:32.177 INFO:tasks.rados.rados.0.smithi033.stdout:2583: done (1 left) 2021-07-26T16:06:32.177 INFO:tasks.rados.rados.0.smithi033.stdout:2584: rollback oid 44 current snap is 260 2021-07-26T16:06:32.177 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 223 2021-07-26T16:06:32.178 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1068 (ObjNum 754 snap 251 seq_num 754) dirty exists 2021-07-26T16:06:32.178 INFO:tasks.rados.rados.0.smithi033.stdout:2582: done (1 left) 2021-07-26T16:06:32.178 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 260 2021-07-26T16:06:32.178 INFO:tasks.rados.rados.0.smithi033.stdout:2585: seq_num 781 ranges {1179648=688128,1867776=401408} 2021-07-26T16:06:32.189 INFO:tasks.rados.rados.0.smithi033.stdout:2585: writing smithi03339061-4 from 1179648 to 1867776 tid 1 2021-07-26T16:06:32.192 INFO:tasks.rados.rados.0.smithi033.stdout:2585: writing smithi03339061-4 from 1867776 to 2269184 tid 2 2021-07-26T16:06:32.192 INFO:tasks.rados.rados.0.smithi033.stdout:2586: read oid 19 snap -1 2021-07-26T16:06:32.192 INFO:tasks.rados.rados.0.smithi033.stdout:2586: expect (ObjNum 727 snap 244 seq_num 727) 2021-07-26T16:06:32.192 INFO:tasks.rados.rados.0.smithi033.stdout:2587: delete oid 32 current snap is 260 2021-07-26T16:06:32.193 INFO:tasks.rados.rados.0.smithi033.stdout:2584: finishing rollback tid 0 to smithi03339061-44 2021-07-26T16:06:32.193 INFO:tasks.rados.rados.0.smithi033.stdout:2584: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:06:32.194 INFO:tasks.rados.rados.0.smithi033.stdout:2584: finishing rollback tid 2 to smithi03339061-44 2021-07-26T16:06:32.194 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1293 (ObjNum 570 snap 177 seq_num 570) dirty exists 2021-07-26T16:06:32.197 INFO:tasks.rados.rados.0.smithi033.stdout:2585: finishing write tid 1 to smithi03339061-4 2021-07-26T16:06:32.198 INFO:tasks.rados.rados.0.smithi033.stdout:2584: done (3 left) 2021-07-26T16:06:32.198 INFO:tasks.rados.rados.0.smithi033.stdout:2587: done (2 left) 2021-07-26T16:06:32.199 INFO:tasks.rados.rados.0.smithi033.stdout:2588: rollback oid 33 current snap is 260 2021-07-26T16:06:32.199 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 214 2021-07-26T16:06:32.199 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 260 2021-07-26T16:06:32.199 INFO:tasks.rados.rados.0.smithi033.stdout:2589: seq_num 783 ranges {3244032=720896,3964928=401408} 2021-07-26T16:06:32.222 INFO:tasks.rados.rados.0.smithi033.stdout:2589: writing smithi03339061-43 from 3244032 to 3964928 tid 1 2021-07-26T16:06:32.224 INFO:tasks.rados.rados.0.smithi033.stdout:2589: writing smithi03339061-43 from 3964928 to 4366336 tid 2 2021-07-26T16:06:32.224 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 260 2021-07-26T16:06:32.225 INFO:tasks.rados.rados.0.smithi033.stdout:2585: finishing write tid 2 to smithi03339061-4 2021-07-26T16:06:32.225 INFO:tasks.rados.rados.0.smithi033.stdout:2590: seq_num 784 ranges {3530752=737280,4268032=401408} 2021-07-26T16:06:32.249 INFO:tasks.rados.rados.0.smithi033.stdout:2590: writing smithi03339061-2 from 3530752 to 4268032 tid 1 2021-07-26T16:06:32.250 INFO:tasks.rados.rados.0.smithi033.stdout:2590: writing smithi03339061-2 from 4268032 to 4669440 tid 2 2021-07-26T16:06:32.251 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 260 2021-07-26T16:06:32.252 INFO:tasks.rados.rados.0.smithi033.stdout:2591: seq_num 785 ranges {10665984=753664,11419648=401408} 2021-07-26T16:06:32.315 INFO:tasks.rados.rados.0.smithi033.stdout:2591: writing smithi03339061-31 from 10665984 to 11419648 tid 1 2021-07-26T16:06:32.320 INFO:tasks.rados.rados.0.smithi033.stdout:2591: writing smithi03339061-31 from 11419648 to 11821056 tid 2 2021-07-26T16:06:32.320 INFO:tasks.rados.rados.0.smithi033.stdout:2592: read oid 50 snap -1 2021-07-26T16:06:32.321 INFO:tasks.rados.rados.0.smithi033.stdout:2592: expect (ObjNum 751 snap 251 seq_num 751) 2021-07-26T16:06:32.321 INFO:tasks.rados.rados.0.smithi033.stdout:2593: rmattr oid 40 current snap is 260 2021-07-26T16:06:32.323 INFO:tasks.rados.rados.0.smithi033.stdout:2585: finishing write tid 3 to smithi03339061-4 2021-07-26T16:06:32.323 INFO:tasks.rados.rados.0.smithi033.stdout:2594: copy_from oid 3 from oid 6 current snap is 260 2021-07-26T16:06:32.324 INFO:tasks.rados.rados.0.smithi033.stdout:2588: finishing rollback tid 0 to smithi03339061-33 2021-07-26T16:06:32.324 INFO:tasks.rados.rados.0.smithi033.stdout:2588: finishing rollback tid 1 to smithi03339061-33 2021-07-26T16:06:32.324 INFO:tasks.rados.rados.0.smithi033.stdout:2595: read oid 37 snap -1 2021-07-26T16:06:32.325 INFO:tasks.rados.rados.0.smithi033.stdout:2595: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:06:32.325 INFO:tasks.rados.rados.0.smithi033.stdout:2596: copy_from oid 10 from oid 29 current snap is 260 2021-07-26T16:06:32.325 INFO:tasks.rados.rados.0.smithi033.stdout:2588: finishing rollback tid 2 to smithi03339061-33 2021-07-26T16:06:32.326 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 1542 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:06:32.327 INFO:tasks.rados.rados.0.smithi033.stdout:2588: done (10 left) 2021-07-26T16:06:32.328 INFO:tasks.rados.rados.0.smithi033.stdout:2597: copy_from oid 25 from oid 1 current snap is 260 2021-07-26T16:06:32.328 INFO:tasks.rados.rados.0.smithi033.stdout:2585: finishing write tid 4 to smithi03339061-4 2021-07-26T16:06:32.328 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1296 (ObjNum 781 snap 260 seq_num 781) dirty exists 2021-07-26T16:06:32.329 INFO:tasks.rados.rados.0.smithi033.stdout:2585: left oid 4 (ObjNum 781 snap 260 seq_num 781) 2021-07-26T16:06:32.330 INFO:tasks.rados.rados.0.smithi033.stdout:2586: expect (ObjNum 727 snap 244 seq_num 727) 2021-07-26T16:06:32.547 INFO:tasks.rados.rados.0.smithi033.stdout:2589: finishing write tid 1 to smithi03339061-43 2021-07-26T16:06:32.547 INFO:tasks.rados.rados.0.smithi033.stdout:2589: finishing write tid 2 to smithi03339061-43 2021-07-26T16:06:32.548 INFO:tasks.rados.rados.0.smithi033.stdout:2589: finishing write tid 3 to smithi03339061-43 2021-07-26T16:06:32.548 INFO:tasks.rados.rados.0.smithi033.stdout:2589: finishing write tid 4 to smithi03339061-43 2021-07-26T16:06:32.548 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 1243 (ObjNum 783 snap 260 seq_num 783) dirty exists 2021-07-26T16:06:32.548 INFO:tasks.rados.rados.0.smithi033.stdout:2589: left oid 43 (ObjNum 783 snap 260 seq_num 783) 2021-07-26T16:06:32.549 INFO:tasks.rados.rados.0.smithi033.stdout:2590: finishing write tid 1 to smithi03339061-2 2021-07-26T16:06:32.549 INFO:tasks.rados.rados.0.smithi033.stdout:2590: finishing write tid 2 to smithi03339061-2 2021-07-26T16:06:32.549 INFO:tasks.rados.rados.0.smithi033.stdout:2590: finishing write tid 3 to smithi03339061-2 2021-07-26T16:06:32.549 INFO:tasks.rados.rados.0.smithi033.stdout:2590: finishing write tid 4 to smithi03339061-2 2021-07-26T16:06:32.549 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1383 (ObjNum 784 snap 260 seq_num 784) dirty exists 2021-07-26T16:06:32.550 INFO:tasks.rados.rados.0.smithi033.stdout:2590: left oid 2 (ObjNum 784 snap 260 seq_num 784) 2021-07-26T16:06:32.550 INFO:tasks.rados.rados.0.smithi033.stdout:2591: finishing write tid 1 to smithi03339061-31 2021-07-26T16:06:32.550 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 527 (ObjNum 1818847087 snap 1600214106 seq_num 1919965284) dirty exists 2021-07-26T16:06:32.550 INFO:tasks.rados.rados.0.smithi033.stdout:2585: done (10 left) 2021-07-26T16:06:32.551 INFO:tasks.rados.rados.0.smithi033.stdout:2586: done (9 left) 2021-07-26T16:06:32.551 INFO:tasks.rados.rados.0.smithi033.stdout:2589: done (8 left) 2021-07-26T16:06:32.551 INFO:tasks.rados.rados.0.smithi033.stdout:2590: done (7 left) 2021-07-26T16:06:32.552 INFO:tasks.rados.rados.0.smithi033.stdout:2593: done (6 left) 2021-07-26T16:06:32.552 INFO:tasks.rados.rados.0.smithi033.stdout:2598: snap_remove snap 236 2021-07-26T16:06:32.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:32 smithi033 bash[41341]: cluster 2021-07-26T16:06:31.129084+0000 mgr.y (mgr.34104) 377 : cluster [DBG] pgmap v688: 25 pgs: 25 active+clean; 390 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2021-07-26T16:06:32.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:32 smithi033 bash[41341]: cluster 2021-07-26T16:06:32.169297+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2021-07-26T16:06:32.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:32 smithi033 bash[42377]: cluster 2021-07-26T16:06:31.129084+0000 mgr.y (mgr.34104) 377 : cluster [DBG] pgmap v688: 25 pgs: 25 active+clean; 390 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2021-07-26T16:06:32.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:32 smithi033 bash[42377]: cluster 2021-07-26T16:06:32.169297+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2021-07-26T16:06:32.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:32 smithi096 bash[33981]: cluster 2021-07-26T16:06:31.129084+0000 mgr.y (mgr.34104) 377 : cluster [DBG] pgmap v688: 25 pgs: 25 active+clean; 390 MiB data, 1.7 GiB used, 713 GiB / 715 GiB avail; 3.2 MiB/s rd, 1.0 MiB/s wr, 11 op/s 2021-07-26T16:06:32.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:32 smithi096 bash[33981]: cluster 2021-07-26T16:06:32.169297+0000 mon.a (mon.0) 948 : cluster [DBG] osdmap e582: 8 total, 8 up, 8 in 2021-07-26T16:06:33.282 INFO:tasks.rados.rados.0.smithi033.stdout:2598: done (6 left) 2021-07-26T16:06:33.282 INFO:tasks.rados.rados.0.smithi033.stdout:2599: read oid 42 snap -1 2021-07-26T16:06:33.282 INFO:tasks.rados.rados.0.smithi033.stdout:2599: expect deleted 2021-07-26T16:06:33.283 INFO:tasks.rados.rados.0.smithi033.stdout:2600: copy_from oid 19 from oid 36 current snap is 260 2021-07-26T16:06:33.283 INFO:tasks.rados.rados.0.smithi033.stdout:2601: snap_create 2021-07-26T16:06:33.283 INFO:tasks.rados.rados.0.smithi033.stdout:2595: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:06:33.344 INFO:tasks.rados.rados.0.smithi033.stdout:2591: finishing write tid 2 to smithi03339061-31 2021-07-26T16:06:33.345 INFO:tasks.rados.rados.0.smithi033.stdout:2591: finishing write tid 3 to smithi03339061-31 2021-07-26T16:06:33.345 INFO:tasks.rados.rados.0.smithi033.stdout:2596: finishing copy_from to smithi03339061-10 2021-07-26T16:06:33.345 INFO:tasks.rados.rados.0.smithi033.stdout:2596: got expected ENOENT (src dne) 2021-07-26T16:06:33.345 INFO:tasks.rados.rados.0.smithi033.stdout:2596: finishing copy_from racing read to smithi03339061-10 2021-07-26T16:06:33.346 INFO:tasks.rados.rados.0.smithi033.stdout:2591: finishing write tid 4 to smithi03339061-31 2021-07-26T16:06:33.346 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1253 (ObjNum 785 snap 260 seq_num 785) dirty exists 2021-07-26T16:06:33.346 INFO:tasks.rados.rados.0.smithi033.stdout:2591: left oid 31 (ObjNum 785 snap 260 seq_num 785) 2021-07-26T16:06:33.346 INFO:tasks.rados.rados.0.smithi033.stdout:2594: finishing copy_from to smithi03339061-3 2021-07-26T16:06:33.347 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1423 (ObjNum 630 snap 199 seq_num 630) dirty exists 2021-07-26T16:06:33.347 INFO:tasks.rados.rados.0.smithi033.stdout:2594: finishing copy_from racing read to smithi03339061-3 2021-07-26T16:06:33.347 INFO:tasks.rados.rados.0.smithi033.stdout:2592: expect (ObjNum 751 snap 251 seq_num 751) 2021-07-26T16:06:33.513 INFO:tasks.rados.rados.0.smithi033.stdout:2597: finishing copy_from to smithi03339061-25 2021-07-26T16:06:33.514 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 1068 (ObjNum 754 snap 251 seq_num 754) dirty exists 2021-07-26T16:06:33.514 INFO:tasks.rados.rados.0.smithi033.stdout:2597: finishing copy_from racing read to smithi03339061-25 2021-07-26T16:06:33.514 INFO:tasks.rados.rados.0.smithi033.stdout:2600: finishing copy_from to smithi03339061-19 2021-07-26T16:06:33.514 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 908 (ObjNum 1058725200 snap 32561 seq_num 1058725200) dirty exists 2021-07-26T16:06:33.515 INFO:tasks.rados.rados.0.smithi033.stdout:2600: finishing copy_from racing read to smithi03339061-19 2021-07-26T16:06:33.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:33 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:33.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:33 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:33.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:33.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:33 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:33.513Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:06:34.296 INFO:tasks.rados.rados.0.smithi033.stdout:2591: done (8 left) 2021-07-26T16:06:34.297 INFO:tasks.rados.rados.0.smithi033.stdout:2592: done (7 left) 2021-07-26T16:06:34.297 INFO:tasks.rados.rados.0.smithi033.stdout:2594: done (6 left) 2021-07-26T16:06:34.297 INFO:tasks.rados.rados.0.smithi033.stdout:2595: done (5 left) 2021-07-26T16:06:34.297 INFO:tasks.rados.rados.0.smithi033.stdout:2596: done (4 left) 2021-07-26T16:06:34.297 INFO:tasks.rados.rados.0.smithi033.stdout:2597: done (3 left) 2021-07-26T16:06:34.298 INFO:tasks.rados.rados.0.smithi033.stdout:2599: done (2 left) 2021-07-26T16:06:34.298 INFO:tasks.rados.rados.0.smithi033.stdout:2600: done (1 left) 2021-07-26T16:06:34.298 INFO:tasks.rados.rados.0.smithi033.stdout:2601: done (0 left) 2021-07-26T16:06:34.298 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 261 2021-07-26T16:06:34.299 INFO:tasks.rados.rados.0.smithi033.stdout:2602: seq_num 786 ranges {1998848=770048,2768896=401408} 2021-07-26T16:06:34.317 INFO:tasks.rados.rados.0.smithi033.stdout:2602: writing smithi03339061-47 from 1998848 to 2768896 tid 1 2021-07-26T16:06:34.319 INFO:tasks.rados.rados.0.smithi033.stdout:2602: writing smithi03339061-47 from 2768896 to 3170304 tid 2 2021-07-26T16:06:34.320 INFO:tasks.rados.rados.0.smithi033.stdout:2603: snap_remove snap 223 2021-07-26T16:06:34.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:34 smithi033 bash[41341]: cluster 2021-07-26T16:06:33.129797+0000 mgr.y (mgr.34104) 378 : cluster [DBG] pgmap v691: 25 pgs: 25 active+clean; 391 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 1024 KiB/s wr, 16 op/s 2021-07-26T16:06:34.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:34 smithi033 bash[41341]: cluster 2021-07-26T16:06:33.277501+0000 mon.a (mon.0) 949 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2021-07-26T16:06:34.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:34 smithi033 bash[42377]: cluster 2021-07-26T16:06:33.129797+0000 mgr.y (mgr.34104) 378 : cluster [DBG] pgmap v691: 25 pgs: 25 active+clean; 391 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 1024 KiB/s wr, 16 op/s 2021-07-26T16:06:34.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:34 smithi033 bash[42377]: cluster 2021-07-26T16:06:33.277501+0000 mon.a (mon.0) 949 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2021-07-26T16:06:34.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:34 smithi096 bash[33981]: cluster 2021-07-26T16:06:33.129797+0000 mgr.y (mgr.34104) 378 : cluster [DBG] pgmap v691: 25 pgs: 25 active+clean; 391 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.5 MiB/s rd, 1024 KiB/s wr, 16 op/s 2021-07-26T16:06:34.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:34 smithi096 bash[33981]: cluster 2021-07-26T16:06:33.277501+0000 mon.a (mon.0) 949 : cluster [DBG] osdmap e583: 8 total, 8 up, 8 in 2021-07-26T16:06:35.304 INFO:tasks.rados.rados.0.smithi033.stdout:2602: finishing write tid 1 to smithi03339061-47 2021-07-26T16:06:35.305 INFO:tasks.rados.rados.0.smithi033.stdout:2602: finishing write tid 2 to smithi03339061-47 2021-07-26T16:06:35.305 INFO:tasks.rados.rados.0.smithi033.stdout:2602: finishing write tid 3 to smithi03339061-47 2021-07-26T16:06:35.305 INFO:tasks.rados.rados.0.smithi033.stdout:2602: finishing write tid 4 to smithi03339061-47 2021-07-26T16:06:35.305 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1430 (ObjNum 786 snap 261 seq_num 786) dirty exists 2021-07-26T16:06:35.306 INFO:tasks.rados.rados.0.smithi033.stdout:2602: left oid 47 (ObjNum 786 snap 261 seq_num 786) 2021-07-26T16:06:35.306 INFO:tasks.rados.rados.0.smithi033.stdout:2602: done (1 left) 2021-07-26T16:06:35.306 INFO:tasks.rados.rados.0.smithi033.stdout:2603: done (0 left) 2021-07-26T16:06:35.307 INFO:tasks.rados.rados.0.smithi033.stdout:2604: read oid 12 snap -1 2021-07-26T16:06:35.307 INFO:tasks.rados.rados.0.smithi033.stdout:2604: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:06:35.307 INFO:tasks.rados.rados.0.smithi033.stdout:2605: copy_from oid 24 from oid 35 current snap is 261 2021-07-26T16:06:35.307 INFO:tasks.rados.rados.0.smithi033.stdout:2606: delete oid 25 current snap is 261 2021-07-26T16:06:35.317 INFO:tasks.rados.rados.0.smithi033.stdout:2606: done (2 left) 2021-07-26T16:06:35.318 INFO:tasks.rados.rados.0.smithi033.stdout:2607: snap_create 2021-07-26T16:06:35.333 INFO:tasks.rados.rados.0.smithi033.stdout:2604: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:06:35.401 INFO:tasks.rados.rados.0.smithi033.stdout:2605: finishing copy_from to smithi03339061-24 2021-07-26T16:06:35.401 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 902 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:06:35.401 INFO:tasks.rados.rados.0.smithi033.stdout:2605: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:06:35.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:35 smithi033 bash[41341]: cluster 2021-07-26T16:06:34.292361+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2021-07-26T16:06:35.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:35 smithi033 bash[42377]: cluster 2021-07-26T16:06:34.292361+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2021-07-26T16:06:35.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:35 smithi096 bash[33981]: cluster 2021-07-26T16:06:34.292361+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e584: 8 total, 8 up, 8 in 2021-07-26T16:06:36.159 INFO:tasks.rados.rados.0.smithi033.stdout:2604: done (2 left) 2021-07-26T16:06:36.160 INFO:tasks.rados.rados.0.smithi033.stdout:2605: done (1 left) 2021-07-26T16:06:36.160 INFO:tasks.rados.rados.0.smithi033.stdout:2607: done (0 left) 2021-07-26T16:06:36.160 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 262 2021-07-26T16:06:36.160 INFO:tasks.rados.rados.0.smithi033.stdout:2608: seq_num 788 ranges {0=802816,802816=401408} 2021-07-26T16:06:36.165 INFO:tasks.rados.rados.0.smithi033.stdout:2608: writing smithi03339061-29 from 0 to 802816 tid 1 2021-07-26T16:06:36.168 INFO:tasks.rados.rados.0.smithi033.stdout:2608: writing smithi03339061-29 from 802816 to 1204224 tid 2 2021-07-26T16:06:36.168 INFO:tasks.rados.rados.0.smithi033.stdout:2609: read oid 15 snap -1 2021-07-26T16:06:36.168 INFO:tasks.rados.rados.0.smithi033.stdout:2609: expect (ObjNum 768 snap 255 seq_num 768) 2021-07-26T16:06:36.169 INFO:tasks.rados.rados.0.smithi033.stdout:2610: delete oid 38 current snap is 262 2021-07-26T16:06:36.176 INFO:tasks.rados.rados.0.smithi033.stdout:2610: done (2 left) 2021-07-26T16:06:36.176 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 34 current snap is 262 2021-07-26T16:06:36.176 INFO:tasks.rados.rados.0.smithi033.stdout:2611: seq_num 790 ranges {2080768=434176,2514944=548864,3063808=253952} 2021-07-26T16:06:36.190 INFO:tasks.rados.rados.0.smithi033.stdout:2611: writing smithi03339061-34 from 2080768 to 2514944 tid 1 2021-07-26T16:06:36.193 INFO:tasks.rados.rados.0.smithi033.stdout:2611: writing smithi03339061-34 from 2514944 to 3063808 tid 2 2021-07-26T16:06:36.196 INFO:tasks.rados.rados.0.smithi033.stdout:2611: writing smithi03339061-34 from 3063808 to 3317760 tid 3 2021-07-26T16:06:36.196 INFO:tasks.rados.rados.0.smithi033.stdout:2612: read oid 3 snap -1 2021-07-26T16:06:36.196 INFO:tasks.rados.rados.0.smithi033.stdout:2612: expect (ObjNum 630 snap 199 seq_num 630) 2021-07-26T16:06:36.197 INFO:tasks.rados.rados.0.smithi033.stdout:2613: delete oid 22 current snap is 262 2021-07-26T16:06:36.197 INFO:tasks.rados.rados.0.smithi033.stdout:2608: finishing write tid 1 to smithi03339061-29 2021-07-26T16:06:36.197 INFO:tasks.rados.rados.0.smithi033.stdout:2608: finishing write tid 2 to smithi03339061-29 2021-07-26T16:06:36.197 INFO:tasks.rados.rados.0.smithi033.stdout:2608: finishing write tid 3 to smithi03339061-29 2021-07-26T16:06:36.198 INFO:tasks.rados.rados.0.smithi033.stdout:2608: finishing write tid 4 to smithi03339061-29 2021-07-26T16:06:36.198 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1240 (ObjNum 788 snap 262 seq_num 788) dirty exists 2021-07-26T16:06:36.198 INFO:tasks.rados.rados.0.smithi033.stdout:2608: left oid 29 (ObjNum 788 snap 262 seq_num 788) 2021-07-26T16:06:36.221 INFO:tasks.rados.rados.0.smithi033.stdout:2611: finishing write tid 1 to smithi03339061-34 2021-07-26T16:06:36.222 INFO:tasks.rados.rados.0.smithi033.stdout:2611: finishing write tid 2 to smithi03339061-34 2021-07-26T16:06:36.222 INFO:tasks.rados.rados.0.smithi033.stdout:2611: finishing write tid 3 to smithi03339061-34 2021-07-26T16:06:36.223 INFO:tasks.rados.rados.0.smithi033.stdout:2611: finishing write tid 4 to smithi03339061-34 2021-07-26T16:06:36.223 INFO:tasks.rados.rados.0.smithi033.stdout:2611: finishing write tid 5 to smithi03339061-34 2021-07-26T16:06:36.223 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 915 (ObjNum 790 snap 262 seq_num 790) dirty exists 2021-07-26T16:06:36.223 INFO:tasks.rados.rados.0.smithi033.stdout:2611: left oid 34 (ObjNum 790 snap 262 seq_num 790) 2021-07-26T16:06:36.225 INFO:tasks.rados.rados.0.smithi033.stdout:2608: done (4 left) 2021-07-26T16:06:36.225 INFO:tasks.rados.rados.0.smithi033.stdout:2611: done (3 left) 2021-07-26T16:06:36.225 INFO:tasks.rados.rados.0.smithi033.stdout:2613: done (2 left) 2021-07-26T16:06:36.226 INFO:tasks.rados.rados.0.smithi033.stdout:2614: read oid 37 snap -1 2021-07-26T16:06:36.226 INFO:tasks.rados.rados.0.smithi033.stdout:2614: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:06:36.226 INFO:tasks.rados.rados.0.smithi033.stdout:2615: read oid 34 snap -1 2021-07-26T16:06:36.226 INFO:tasks.rados.rados.0.smithi033.stdout:2615: expect (ObjNum 790 snap 262 seq_num 790) 2021-07-26T16:06:36.227 INFO:tasks.rados.rados.0.smithi033.stdout:2616: rollback oid 10 current snap is 262 2021-07-26T16:06:36.227 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 10 to 248 2021-07-26T16:06:36.227 INFO:tasks.rados.rados.0.smithi033.stdout:2617: rmattr oid 36 current snap is 262 2021-07-26T16:06:36.227 INFO:tasks.rados.rados.0.smithi033.stdout:2618: read oid 45 snap -1 2021-07-26T16:06:36.227 INFO:tasks.rados.rados.0.smithi033.stdout:2618: expect (ObjNum 778 snap 259 seq_num 778) 2021-07-26T16:06:36.228 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 262 2021-07-26T16:06:36.228 INFO:tasks.rados.rados.0.smithi033.stdout:2619: seq_num 792 ranges {4333568=466944,4800512=761856,5562368=40960} 2021-07-26T16:06:36.255 INFO:tasks.rados.rados.0.smithi033.stdout:2619: writing smithi03339061-39 from 4333568 to 4800512 tid 1 2021-07-26T16:06:36.260 INFO:tasks.rados.rados.0.smithi033.stdout:2619: writing smithi03339061-39 from 4800512 to 5562368 tid 2 2021-07-26T16:06:36.261 INFO:tasks.rados.rados.0.smithi033.stdout:2619: writing smithi03339061-39 from 5562368 to 5603328 tid 3 2021-07-26T16:06:36.261 INFO:tasks.rados.rados.0.smithi033.stdout:2620: read oid 38 snap -1 2021-07-26T16:06:36.261 INFO:tasks.rados.rados.0.smithi033.stdout:2620: expect deleted 2021-07-26T16:06:36.261 INFO:tasks.rados.rados.0.smithi033.stdout:2621: read oid 8 snap 257 2021-07-26T16:06:36.261 INFO:tasks.rados.rados.0.smithi033.stdout:2621: expect (ObjNum 767 snap 254 seq_num 767) 2021-07-26T16:06:36.262 INFO:tasks.rados.rados.0.smithi033.stdout:2622: read oid 50 snap -1 2021-07-26T16:06:36.262 INFO:tasks.rados.rados.0.smithi033.stdout:2622: expect (ObjNum 751 snap 251 seq_num 751) 2021-07-26T16:06:36.262 INFO:tasks.rados.rados.0.smithi033.stdout:2623: copy_from oid 27 from oid 21 current snap is 262 2021-07-26T16:06:36.262 INFO:tasks.rados.rados.0.smithi033.stdout:2609: expect (ObjNum 768 snap 255 seq_num 768) 2021-07-26T16:06:36.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:36 smithi033 bash[41341]: cluster 2021-07-26T16:06:35.130572+0000 mgr.y (mgr.34104) 379 : cluster [DBG] pgmap v694: 25 pgs: 25 active+clean; 405 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 10 op/s 2021-07-26T16:06:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:36 smithi033 bash[41341]: cluster 2021-07-26T16:06:35.296607+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2021-07-26T16:06:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:36 smithi033 bash[41341]: cluster 2021-07-26T16:06:36.154703+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2021-07-26T16:06:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:36 smithi033 bash[42377]: cluster 2021-07-26T16:06:35.130572+0000 mgr.y (mgr.34104) 379 : cluster [DBG] pgmap v694: 25 pgs: 25 active+clean; 405 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 10 op/s 2021-07-26T16:06:36.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:36 smithi033 bash[42377]: cluster 2021-07-26T16:06:35.296607+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2021-07-26T16:06:36.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:36 smithi033 bash[42377]: cluster 2021-07-26T16:06:36.154703+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2021-07-26T16:06:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:36 smithi096 bash[33981]: cluster 2021-07-26T16:06:35.130572+0000 mgr.y (mgr.34104) 379 : cluster [DBG] pgmap v694: 25 pgs: 25 active+clean; 405 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 1.3 MiB/s rd, 4.1 MiB/s wr, 10 op/s 2021-07-26T16:06:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:36 smithi096 bash[33981]: cluster 2021-07-26T16:06:35.296607+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e585: 8 total, 8 up, 8 in 2021-07-26T16:06:36.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:36 smithi096 bash[33981]: cluster 2021-07-26T16:06:36.154703+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e586: 8 total, 8 up, 8 in 2021-07-26T16:06:37.363 INFO:tasks.rados.rados.0.smithi033.stdout:2612: expect (ObjNum 630 snap 199 seq_num 630) 2021-07-26T16:06:37.438 INFO:tasks.rados.rados.0.smithi033.stdout:2618: expect (ObjNum 778 snap 259 seq_num 778) 2021-07-26T16:06:37.552 INFO:tasks.rados.rados.0.smithi033.stdout:2614: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:06:37.600 INFO:tasks.rados.rados.0.smithi033.stdout:2616: finishing rollback tid 1 to smithi03339061-10 2021-07-26T16:06:37.601 INFO:tasks.rados.rados.0.smithi033.stdout:2616: finishing rollback tid 2 to smithi03339061-10 2021-07-26T16:06:37.601 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1432 (ObjNum 720 snap 242 seq_num 720) dirty exists 2021-07-26T16:06:37.601 INFO:tasks.rados.rados.0.smithi033.stdout:2615: expect (ObjNum 790 snap 262 seq_num 790) 2021-07-26T16:06:37.726 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 916 (ObjNum 1 snap 32561 seq_num 2006614736) dirty exists 2021-07-26T16:06:37.727 INFO:tasks.rados.rados.0.smithi033.stdout:2619: finishing write tid 1 to smithi03339061-39 2021-07-26T16:06:37.727 INFO:tasks.rados.rados.0.smithi033.stdout:2619: finishing write tid 2 to smithi03339061-39 2021-07-26T16:06:37.727 INFO:tasks.rados.rados.0.smithi033.stdout:2619: finishing write tid 3 to smithi03339061-39 2021-07-26T16:06:37.727 INFO:tasks.rados.rados.0.smithi033.stdout:2619: finishing write tid 4 to smithi03339061-39 2021-07-26T16:06:37.728 INFO:tasks.rados.rados.0.smithi033.stdout:2621: expect (ObjNum 767 snap 254 seq_num 767) 2021-07-26T16:06:37.827 INFO:tasks.rados.rados.0.smithi033.stdout:2622: expect (ObjNum 751 snap 251 seq_num 751) 2021-07-26T16:06:37.993 INFO:tasks.rados.rados.0.smithi033.stdout:2619: finishing write tid 5 to smithi03339061-39 2021-07-26T16:06:37.993 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1381 (ObjNum 792 snap 262 seq_num 792) dirty exists 2021-07-26T16:06:37.994 INFO:tasks.rados.rados.0.smithi033.stdout:2619: left oid 39 (ObjNum 792 snap 262 seq_num 792) 2021-07-26T16:06:37.994 INFO:tasks.rados.rados.0.smithi033.stdout:2623: finishing copy_from to smithi03339061-27 2021-07-26T16:06:37.994 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1236 (ObjNum 1 snap 32561 seq_num 2006694376) dirty exists 2021-07-26T16:06:37.994 INFO:tasks.rados.rados.0.smithi033.stdout:2623: finishing copy_from racing read to smithi03339061-27 2021-07-26T16:06:37.995 INFO:tasks.rados.rados.0.smithi033.stdout:2609: done (11 left) 2021-07-26T16:06:37.995 INFO:tasks.rados.rados.0.smithi033.stdout:2612: done (10 left) 2021-07-26T16:06:37.995 INFO:tasks.rados.rados.0.smithi033.stdout:2614: done (9 left) 2021-07-26T16:06:37.995 INFO:tasks.rados.rados.0.smithi033.stdout:2615: done (8 left) 2021-07-26T16:06:37.995 INFO:tasks.rados.rados.0.smithi033.stdout:2616: done (7 left) 2021-07-26T16:06:37.996 INFO:tasks.rados.rados.0.smithi033.stdout:2617: done (6 left) 2021-07-26T16:06:37.996 INFO:tasks.rados.rados.0.smithi033.stdout:2618: done (5 left) 2021-07-26T16:06:37.996 INFO:tasks.rados.rados.0.smithi033.stdout:2619: done (4 left) 2021-07-26T16:06:37.997 INFO:tasks.rados.rados.0.smithi033.stdout:2620: done (3 left) 2021-07-26T16:06:37.997 INFO:tasks.rados.rados.0.smithi033.stdout:2621: done (2 left) 2021-07-26T16:06:37.997 INFO:tasks.rados.rados.0.smithi033.stdout:2622: done (1 left) 2021-07-26T16:06:37.997 INFO:tasks.rados.rados.0.smithi033.stdout:2623: done (0 left) 2021-07-26T16:06:37.998 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 262 2021-07-26T16:06:37.998 INFO:tasks.rados.rados.0.smithi033.stdout:2624: seq_num 793 ranges {1916928=483328,2400256=647168,3047424=155648} 2021-07-26T16:06:38.012 INFO:tasks.rados.rados.0.smithi033.stdout:2624: writing smithi03339061-6 from 1916928 to 2400256 tid 1 2021-07-26T16:06:38.016 INFO:tasks.rados.rados.0.smithi033.stdout:2624: writing smithi03339061-6 from 2400256 to 3047424 tid 2 2021-07-26T16:06:38.017 INFO:tasks.rados.rados.0.smithi033.stdout:2624: writing smithi03339061-6 from 3047424 to 3203072 tid 3 2021-07-26T16:06:38.017 INFO:tasks.rados.rados.0.smithi033.stdout:2625: read oid 34 snap -1 2021-07-26T16:06:38.018 INFO:tasks.rados.rados.0.smithi033.stdout:2625: expect (ObjNum 790 snap 262 seq_num 790) 2021-07-26T16:06:38.018 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 262 2021-07-26T16:06:38.019 INFO:tasks.rados.rados.0.smithi033.stdout:2626: seq_num 794 ranges {10665984=499712,11165696=532480,11698176=270336} 2021-07-26T16:06:38.080 INFO:tasks.rados.rados.0.smithi033.stdout:2626: writing smithi03339061-28 from 10665984 to 11165696 tid 1 2021-07-26T16:06:38.083 INFO:tasks.rados.rados.0.smithi033.stdout:2626: writing smithi03339061-28 from 11165696 to 11698176 tid 2 2021-07-26T16:06:38.085 INFO:tasks.rados.rados.0.smithi033.stdout:2626: writing smithi03339061-28 from 11698176 to 11968512 tid 3 2021-07-26T16:06:38.085 INFO:tasks.rados.rados.0.smithi033.stdout:2627: snap_create 2021-07-26T16:06:38.086 INFO:tasks.rados.rados.0.smithi033.stdout:2624: finishing write tid 1 to smithi03339061-6 2021-07-26T16:06:38.086 INFO:tasks.rados.rados.0.smithi033.stdout:2624: finishing write tid 2 to smithi03339061-6 2021-07-26T16:06:38.086 INFO:tasks.rados.rados.0.smithi033.stdout:2624: finishing write tid 3 to smithi03339061-6 2021-07-26T16:06:38.086 INFO:tasks.rados.rados.0.smithi033.stdout:2624: finishing write tid 4 to smithi03339061-6 2021-07-26T16:06:38.086 INFO:tasks.rados.rados.0.smithi033.stdout:2624: finishing write tid 5 to smithi03339061-6 2021-07-26T16:06:38.087 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1573 (ObjNum 793 snap 262 seq_num 793) dirty exists 2021-07-26T16:06:38.087 INFO:tasks.rados.rados.0.smithi033.stdout:2624: left oid 6 (ObjNum 793 snap 262 seq_num 793) 2021-07-26T16:06:38.087 INFO:tasks.rados.rados.0.smithi033.stdout:2625: expect (ObjNum 790 snap 262 seq_num 790) 2021-07-26T16:06:38.222 INFO:tasks.rados.rados.0.smithi033.stdout:2626: finishing write tid 1 to smithi03339061-28 2021-07-26T16:06:38.222 INFO:tasks.rados.rados.0.smithi033.stdout:2626: finishing write tid 2 to smithi03339061-28 2021-07-26T16:06:38.223 INFO:tasks.rados.rados.0.smithi033.stdout:2626: finishing write tid 3 to smithi03339061-28 2021-07-26T16:06:38.223 INFO:tasks.rados.rados.0.smithi033.stdout:2626: finishing write tid 4 to smithi03339061-28 2021-07-26T16:06:38.223 INFO:tasks.rados.rados.0.smithi033.stdout:2626: finishing write tid 5 to smithi03339061-28 2021-07-26T16:06:38.224 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1387 (ObjNum 794 snap 262 seq_num 794) dirty exists 2021-07-26T16:06:38.224 INFO:tasks.rados.rados.0.smithi033.stdout:2626: left oid 28 (ObjNum 794 snap 262 seq_num 794) 2021-07-26T16:06:38.326 INFO:tasks.rados.rados.0.smithi033.stdout:2624: done (3 left) 2021-07-26T16:06:38.327 INFO:tasks.rados.rados.0.smithi033.stdout:2625: done (2 left) 2021-07-26T16:06:38.327 INFO:tasks.rados.rados.0.smithi033.stdout:2626: done (1 left) 2021-07-26T16:06:38.327 INFO:tasks.rados.rados.0.smithi033.stdout:2627: done (0 left) 2021-07-26T16:06:38.327 INFO:tasks.rados.rados.0.smithi033.stdout:2628: rmattr oid 44 current snap is 263 2021-07-26T16:06:38.328 INFO:tasks.rados.rados.0.smithi033.stdout:2629: rmattr oid 36 current snap is 263 2021-07-26T16:06:38.328 INFO:tasks.rados.rados.0.smithi033.stdout:2630: read oid 23 snap -1 2021-07-26T16:06:38.328 INFO:tasks.rados.rados.0.smithi033.stdout:2630: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:06:38.329 INFO:tasks.rados.rados.0.smithi033.stdout:2631: rmattr oid 5 current snap is 263 2021-07-26T16:06:38.329 INFO:tasks.rados.rados.0.smithi033.stdout:2631: done (3 left) 2021-07-26T16:06:38.329 INFO:tasks.rados.rados.0.smithi033.stdout:2632: snap_create 2021-07-26T16:06:38.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 917 (ObjNum 3 snap 5 seq_num 6) dirty exists 2021-07-26T16:06:38.334 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1297 (ObjNum 570 snap 177 seq_num 570) dirty exists 2021-07-26T16:06:38.336 INFO:tasks.rados.rados.0.smithi033.stdout:2630: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:06:38.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:38 smithi033 bash[41341]: cluster 2021-07-26T16:06:37.131021+0000 mgr.y (mgr.34104) 380 : cluster [DBG] pgmap v697: 25 pgs: 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 23 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 9.0 MiB/s rd, 4.8 MiB/s wr, 12 op/s 2021-07-26T16:06:38.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:38 smithi033 bash[42377]: cluster 2021-07-26T16:06:37.131021+0000 mgr.y (mgr.34104) 380 : cluster [DBG] pgmap v697: 25 pgs: 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 23 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 9.0 MiB/s rd, 4.8 MiB/s wr, 12 op/s 2021-07-26T16:06:38.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:38 smithi096 bash[33981]: cluster 2021-07-26T16:06:37.131021+0000 mgr.y (mgr.34104) 380 : cluster [DBG] pgmap v697: 25 pgs: 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 23 active+clean; 411 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 9.0 MiB/s rd, 4.8 MiB/s wr, 12 op/s 2021-07-26T16:06:39.332 INFO:tasks.rados.rados.0.smithi033.stdout:2628: done (3 left) 2021-07-26T16:06:39.333 INFO:tasks.rados.rados.0.smithi033.stdout:2629: done (2 left) 2021-07-26T16:06:39.333 INFO:tasks.rados.rados.0.smithi033.stdout:2630: done (1 left) 2021-07-26T16:06:39.334 INFO:tasks.rados.rados.0.smithi033.stdout:2632: done (0 left) 2021-07-26T16:06:39.335 INFO:tasks.rados.rados.0.smithi033.stdout:2633: snap_remove snap 256 2021-07-26T16:06:39.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:39 smithi033 bash[41341]: cluster 2021-07-26T16:06:38.322784+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2021-07-26T16:06:39.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:39 smithi033 bash[42377]: cluster 2021-07-26T16:06:38.322784+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2021-07-26T16:06:39.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:39 smithi096 bash[33981]: cluster 2021-07-26T16:06:38.322784+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e587: 8 total, 8 up, 8 in 2021-07-26T16:06:40.348 INFO:tasks.rados.rados.0.smithi033.stdout:2633: done (0 left) 2021-07-26T16:06:40.349 INFO:tasks.rados.rados.0.smithi033.stdout:2634: read oid 1 snap -1 2021-07-26T16:06:40.349 INFO:tasks.rados.rados.0.smithi033.stdout:2634: expect (ObjNum 754 snap 251 seq_num 754) 2021-07-26T16:06:40.349 INFO:tasks.rados.rados.0.smithi033.stdout:2635: snap_create 2021-07-26T16:06:40.365 INFO:tasks.rados.rados.0.smithi033.stdout:2634: expect (ObjNum 754 snap 251 seq_num 754) 2021-07-26T16:06:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:40 smithi033 bash[41341]: cluster 2021-07-26T16:06:39.131791+0000 mgr.y (mgr.34104) 381 : cluster [DBG] pgmap v699: 25 pgs: 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 23 active+clean; 409 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 15 op/s 2021-07-26T16:06:40.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:40 smithi033 bash[41341]: cluster 2021-07-26T16:06:39.327390+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2021-07-26T16:06:40.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:40 smithi033 bash[42377]: cluster 2021-07-26T16:06:39.131791+0000 mgr.y (mgr.34104) 381 : cluster [DBG] pgmap v699: 25 pgs: 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 23 active+clean; 409 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 15 op/s 2021-07-26T16:06:40.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:40 smithi033 bash[42377]: cluster 2021-07-26T16:06:39.327390+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2021-07-26T16:06:40.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:40 smithi096 bash[33981]: cluster 2021-07-26T16:06:39.131791+0000 mgr.y (mgr.34104) 381 : cluster [DBG] pgmap v699: 25 pgs: 1 active+clean+snaptrim_wait, 1 active+clean+snaptrim, 23 active+clean; 409 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 4.7 MiB/s wr, 15 op/s 2021-07-26T16:06:40.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:40 smithi096 bash[33981]: cluster 2021-07-26T16:06:39.327390+0000 mon.a (mon.0) 954 : cluster [DBG] osdmap e588: 8 total, 8 up, 8 in 2021-07-26T16:06:41.162 INFO:tasks.rados.rados.0.smithi033.stdout:2634: done (1 left) 2021-07-26T16:06:41.162 INFO:tasks.rados.rados.0.smithi033.stdout:2635: done (0 left) 2021-07-26T16:06:41.162 INFO:tasks.rados.rados.0.smithi033.stdout:2636: snap_create 2021-07-26T16:06:41.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:41 smithi033 bash[42377]: cluster 2021-07-26T16:06:40.345790+0000 mon.a (mon.0) 955 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2021-07-26T16:06:41.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:41 smithi033 bash[42377]: cluster 2021-07-26T16:06:41.157773+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2021-07-26T16:06:41.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:41 smithi033 bash[41341]: cluster 2021-07-26T16:06:40.345790+0000 mon.a (mon.0) 955 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2021-07-26T16:06:41.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:41 smithi033 bash[41341]: cluster 2021-07-26T16:06:41.157773+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2021-07-26T16:06:41.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:41 smithi096 bash[33981]: cluster 2021-07-26T16:06:40.345790+0000 mon.a (mon.0) 955 : cluster [DBG] osdmap e589: 8 total, 8 up, 8 in 2021-07-26T16:06:41.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:41 smithi096 bash[33981]: cluster 2021-07-26T16:06:41.157773+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e590: 8 total, 8 up, 8 in 2021-07-26T16:06:42.173 INFO:tasks.rados.rados.0.smithi033.stdout:2636: done (0 left) 2021-07-26T16:06:42.173 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 16 current snap is 266 2021-07-26T16:06:42.173 INFO:tasks.rados.rados.0.smithi033.stdout:2637: seq_num 795 ranges {10657792=524288,11182080=417792,11599872=385024} 2021-07-26T16:06:42.236 INFO:tasks.rados.rados.0.smithi033.stdout:2637: writing smithi03339061-16 from 10657792 to 11182080 tid 1 2021-07-26T16:06:42.239 INFO:tasks.rados.rados.0.smithi033.stdout:2637: writing smithi03339061-16 from 11182080 to 11599872 tid 2 2021-07-26T16:06:42.241 INFO:tasks.rados.rados.0.smithi033.stdout:2637: writing smithi03339061-16 from 11599872 to 11984896 tid 3 2021-07-26T16:06:42.241 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 266 2021-07-26T16:06:42.241 INFO:tasks.rados.rados.0.smithi033.stdout:2638: seq_num 796 ranges {3358720=540672,3899392=704512,4603904=98304} 2021-07-26T16:06:42.263 INFO:tasks.rados.rados.0.smithi033.stdout:2638: writing smithi03339061-30 from 3358720 to 3899392 tid 1 2021-07-26T16:06:42.267 INFO:tasks.rados.rados.0.smithi033.stdout:2638: writing smithi03339061-30 from 3899392 to 4603904 tid 2 2021-07-26T16:06:42.267 INFO:tasks.rados.rados.0.smithi033.stdout:2638: writing smithi03339061-30 from 4603904 to 4702208 tid 3 2021-07-26T16:06:42.267 INFO:tasks.rados.rados.0.smithi033.stdout:2639: snap_remove snap 263 2021-07-26T16:06:42.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:42 smithi033 bash[41341]: cluster 2021-07-26T16:06:41.132535+0000 mgr.y (mgr.34104) 382 : cluster [DBG] pgmap v702: 25 pgs: 25 active+clean; 409 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.4 MiB/s wr, 23 op/s 2021-07-26T16:06:42.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:42 smithi033 bash[41341]: cluster 2021-07-26T16:06:42.170007+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2021-07-26T16:06:42.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:42 smithi033 bash[42377]: cluster 2021-07-26T16:06:41.132535+0000 mgr.y (mgr.34104) 382 : cluster [DBG] pgmap v702: 25 pgs: 25 active+clean; 409 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.4 MiB/s wr, 23 op/s 2021-07-26T16:06:42.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:42 smithi033 bash[42377]: cluster 2021-07-26T16:06:42.170007+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2021-07-26T16:06:42.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:42 smithi096 bash[33981]: cluster 2021-07-26T16:06:41.132535+0000 mgr.y (mgr.34104) 382 : cluster [DBG] pgmap v702: 25 pgs: 25 active+clean; 409 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 20 MiB/s rd, 2.4 MiB/s wr, 23 op/s 2021-07-26T16:06:42.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:42 smithi096 bash[33981]: cluster 2021-07-26T16:06:42.170007+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e591: 8 total, 8 up, 8 in 2021-07-26T16:06:43.177 INFO:tasks.rados.rados.0.smithi033.stdout:2639: done (2 left) 2021-07-26T16:06:43.177 INFO:tasks.rados.rados.0.smithi033.stdout:2640: rollback oid 29 current snap is 266 2021-07-26T16:06:43.178 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 254 2021-07-26T16:06:43.178 INFO:tasks.rados.rados.0.smithi033.stdout:2637: finishing write tid 1 to smithi03339061-16 2021-07-26T16:06:43.178 INFO:tasks.rados.rados.0.smithi033.stdout:2637: finishing write tid 2 to smithi03339061-16 2021-07-26T16:06:43.178 INFO:tasks.rados.rados.0.smithi033.stdout:2637: finishing write tid 3 to smithi03339061-16 2021-07-26T16:06:43.179 INFO:tasks.rados.rados.0.smithi033.stdout:2637: finishing write tid 4 to smithi03339061-16 2021-07-26T16:06:43.179 INFO:tasks.rados.rados.0.smithi033.stdout:2637: finishing write tid 5 to smithi03339061-16 2021-07-26T16:06:43.179 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1294 (ObjNum 795 snap 266 seq_num 795) dirty exists 2021-07-26T16:06:43.179 INFO:tasks.rados.rados.0.smithi033.stdout:2637: left oid 16 (ObjNum 795 snap 266 seq_num 795) 2021-07-26T16:06:43.180 INFO:tasks.rados.rados.0.smithi033.stdout:2638: finishing write tid 1 to smithi03339061-30 2021-07-26T16:06:43.180 INFO:tasks.rados.rados.0.smithi033.stdout:2638: finishing write tid 2 to smithi03339061-30 2021-07-26T16:06:43.180 INFO:tasks.rados.rados.0.smithi033.stdout:2638: finishing write tid 3 to smithi03339061-30 2021-07-26T16:06:43.180 INFO:tasks.rados.rados.0.smithi033.stdout:2638: finishing write tid 4 to smithi03339061-30 2021-07-26T16:06:43.180 INFO:tasks.rados.rados.0.smithi033.stdout:2638: finishing write tid 5 to smithi03339061-30 2021-07-26T16:06:43.181 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 1436 (ObjNum 796 snap 266 seq_num 796) dirty exists 2021-07-26T16:06:43.181 INFO:tasks.rados.rados.0.smithi033.stdout:2638: left oid 30 (ObjNum 796 snap 266 seq_num 796) 2021-07-26T16:06:43.181 INFO:tasks.rados.rados.0.smithi033.stdout:2637: done (2 left) 2021-07-26T16:06:43.181 INFO:tasks.rados.rados.0.smithi033.stdout:2638: done (1 left) 2021-07-26T16:06:43.182 INFO:tasks.rados.rados.0.smithi033.stdout:2641: setattr oid 16 current snap is 266 2021-07-26T16:06:43.183 INFO:tasks.rados.rados.0.smithi033.stdout:2642: copy_from oid 45 from oid 35 current snap is 266 2021-07-26T16:06:43.183 INFO:tasks.rados.rados.0.smithi033.stdout:2643: read oid 15 snap -1 2021-07-26T16:06:43.183 INFO:tasks.rados.rados.0.smithi033.stdout:2643: expect (ObjNum 768 snap 255 seq_num 768) 2021-07-26T16:06:43.184 INFO:tasks.rados.rados.0.smithi033.stdout:2644: rollback oid 6 current snap is 266 2021-07-26T16:06:43.184 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 264 2021-07-26T16:06:43.184 INFO:tasks.rados.rados.0.smithi033.stdout:2645: read oid 3 snap -1 2021-07-26T16:06:43.184 INFO:tasks.rados.rados.0.smithi033.stdout:2645: expect (ObjNum 630 snap 199 seq_num 630) 2021-07-26T16:06:43.185 INFO:tasks.rados.rados.0.smithi033.stdout:2646: snap_remove snap 261 2021-07-26T16:06:43.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:43 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:43.513Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:43.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:43 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:43.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:43.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:43 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:43.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:06:44.179 INFO:tasks.rados.rados.0.smithi033.stdout:2646: done (6 left) 2021-07-26T16:06:44.180 INFO:tasks.rados.rados.0.smithi033.stdout:2647: read oid 41 snap -1 2021-07-26T16:06:44.180 INFO:tasks.rados.rados.0.smithi033.stdout:2647: expect (ObjNum 767 snap 254 seq_num 767) 2021-07-26T16:06:44.180 INFO:tasks.rados.rados.0.smithi033.stdout:2648: rollback oid 4 current snap is 266 2021-07-26T16:06:44.181 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 4 to 239 2021-07-26T16:06:44.181 INFO:tasks.rados.rados.0.smithi033.stdout:2640: finishing rollback tid 0 to smithi03339061-29 2021-07-26T16:06:44.181 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1295 (ObjNum 795 snap 266 seq_num 795) dirty exists 2021-07-26T16:06:44.181 INFO:tasks.rados.rados.0.smithi033.stdout:2640: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:06:44.181 INFO:tasks.rados.rados.0.smithi033.stdout:2640: finishing rollback tid 2 to smithi03339061-29 2021-07-26T16:06:44.182 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1243 (ObjNum 733 snap 246 seq_num 733) dirty exists 2021-07-26T16:06:44.182 INFO:tasks.rados.rados.0.smithi033.stdout:2644: finishing rollback tid 0 to smithi03339061-6 2021-07-26T16:06:44.182 INFO:tasks.rados.rados.0.smithi033.stdout:2644: finishing rollback tid 1 to smithi03339061-6 2021-07-26T16:06:44.182 INFO:tasks.rados.rados.0.smithi033.stdout:2644: finishing rollback tid 2 to smithi03339061-6 2021-07-26T16:06:44.183 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1587 (ObjNum 793 snap 262 seq_num 793) dirty exists 2021-07-26T16:06:44.183 INFO:tasks.rados.rados.0.smithi033.stdout:2645: expect (ObjNum 630 snap 199 seq_num 630) 2021-07-26T16:06:44.263 INFO:tasks.rados.rados.0.smithi033.stdout:2642: finishing copy_from to smithi03339061-45 2021-07-26T16:06:44.263 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 902 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:06:44.263 INFO:tasks.rados.rados.0.smithi033.stdout:2642: finishing copy_from racing read to smithi03339061-45 2021-07-26T16:06:44.264 INFO:tasks.rados.rados.0.smithi033.stdout:2643: expect (ObjNum 768 snap 255 seq_num 768) 2021-07-26T16:06:44.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:44 smithi033 bash[41341]: cluster 2021-07-26T16:06:43.133232+0000 mgr.y (mgr.34104) 383 : cluster [DBG] pgmap v705: 25 pgs: 25 active+clean; 410 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 1.2 MiB/s wr, 19 op/s 2021-07-26T16:06:44.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:44 smithi033 bash[41341]: cluster 2021-07-26T16:06:43.172326+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2021-07-26T16:06:44.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:44 smithi033 bash[42377]: cluster 2021-07-26T16:06:43.133232+0000 mgr.y (mgr.34104) 383 : cluster [DBG] pgmap v705: 25 pgs: 25 active+clean; 410 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 1.2 MiB/s wr, 19 op/s 2021-07-26T16:06:44.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:44 smithi033 bash[42377]: cluster 2021-07-26T16:06:43.172326+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2021-07-26T16:06:44.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:44 smithi096 bash[33981]: cluster 2021-07-26T16:06:43.133232+0000 mgr.y (mgr.34104) 383 : cluster [DBG] pgmap v705: 25 pgs: 25 active+clean; 410 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 1.2 MiB/s wr, 19 op/s 2021-07-26T16:06:44.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:44 smithi096 bash[33981]: cluster 2021-07-26T16:06:43.172326+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e592: 8 total, 8 up, 8 in 2021-07-26T16:06:45.351 INFO:tasks.rados.rados.0.smithi033.stdout:2648: finishing rollback tid 0 to smithi03339061-4 2021-07-26T16:06:45.351 INFO:tasks.rados.rados.0.smithi033.stdout:2648: finishing rollback tid 1 to smithi03339061-4 2021-07-26T16:06:45.351 INFO:tasks.rados.rados.0.smithi033.stdout:2648: finishing rollback tid 2 to smithi03339061-4 2021-07-26T16:06:45.352 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1300 (ObjNum 700 snap 232 seq_num 700) dirty exists 2021-07-26T16:06:45.352 INFO:tasks.rados.rados.0.smithi033.stdout:2647: expect (ObjNum 767 snap 254 seq_num 767) 2021-07-26T16:06:45.451 INFO:tasks.rados.rados.0.smithi033.stdout:2640: done (7 left) 2021-07-26T16:06:45.452 INFO:tasks.rados.rados.0.smithi033.stdout:2641: done (6 left) 2021-07-26T16:06:45.452 INFO:tasks.rados.rados.0.smithi033.stdout:2642: done (5 left) 2021-07-26T16:06:45.452 INFO:tasks.rados.rados.0.smithi033.stdout:2643: done (4 left) 2021-07-26T16:06:45.452 INFO:tasks.rados.rados.0.smithi033.stdout:2644: done (3 left) 2021-07-26T16:06:45.453 INFO:tasks.rados.rados.0.smithi033.stdout:2645: done (2 left) 2021-07-26T16:06:45.453 INFO:tasks.rados.rados.0.smithi033.stdout:2647: done (1 left) 2021-07-26T16:06:45.453 INFO:tasks.rados.rados.0.smithi033.stdout:2648: done (0 left) 2021-07-26T16:06:45.453 INFO:tasks.rados.rados.0.smithi033.stdout:2649: snap_remove snap 249 2021-07-26T16:06:45.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:45 smithi033 bash[41341]: cluster 2021-07-26T16:06:44.174897+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2021-07-26T16:06:45.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:45 smithi033 bash[42377]: cluster 2021-07-26T16:06:44.174897+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2021-07-26T16:06:45.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:45 smithi096 bash[33981]: cluster 2021-07-26T16:06:44.174897+0000 mon.a (mon.0) 959 : cluster [DBG] osdmap e593: 8 total, 8 up, 8 in 2021-07-26T16:06:46.165 INFO:tasks.rados.rados.0.smithi033.stdout:2649: done (0 left) 2021-07-26T16:06:46.165 INFO:tasks.rados.rados.0.smithi033.stdout:2650: copy_from oid 36 from oid 44 current snap is 266 2021-07-26T16:06:46.165 INFO:tasks.rados.rados.0.smithi033.stdout:2651: rollback oid 8 current snap is 266 2021-07-26T16:06:46.166 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 8 to 254 2021-07-26T16:06:46.166 INFO:tasks.rados.rados.0.smithi033.stdout:2652: snap_remove snap 246 2021-07-26T16:06:46.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:46 smithi033 bash[41341]: cluster 2021-07-26T16:06:45.133681+0000 mgr.y (mgr.34104) 384 : cluster [DBG] pgmap v708: 25 pgs: 25 active+clean; 413 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.4 MiB/s rd, 328 KiB/s wr, 4 op/s 2021-07-26T16:06:46.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:46 smithi033 bash[41341]: cluster 2021-07-26T16:06:46.161297+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2021-07-26T16:06:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:46 smithi033 bash[42377]: cluster 2021-07-26T16:06:45.133681+0000 mgr.y (mgr.34104) 384 : cluster [DBG] pgmap v708: 25 pgs: 25 active+clean; 413 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.4 MiB/s rd, 328 KiB/s wr, 4 op/s 2021-07-26T16:06:46.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:46 smithi033 bash[42377]: cluster 2021-07-26T16:06:46.161297+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2021-07-26T16:06:46.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:46 smithi096 bash[33981]: cluster 2021-07-26T16:06:45.133681+0000 mgr.y (mgr.34104) 384 : cluster [DBG] pgmap v708: 25 pgs: 25 active+clean; 413 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 4.4 MiB/s rd, 328 KiB/s wr, 4 op/s 2021-07-26T16:06:46.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:46 smithi096 bash[33981]: cluster 2021-07-26T16:06:46.161297+0000 mon.a (mon.0) 960 : cluster [DBG] osdmap e594: 8 total, 8 up, 8 in 2021-07-26T16:06:47.185 INFO:tasks.rados.rados.0.smithi033.stdout:2652: done (2 left) 2021-07-26T16:06:47.186 INFO:tasks.rados.rados.0.smithi033.stdout:2653: delete oid 14 current snap is 266 2021-07-26T16:06:47.186 INFO:tasks.rados.rados.0.smithi033.stdout:2651: finishing rollback tid 0 to smithi03339061-8 2021-07-26T16:06:47.186 INFO:tasks.rados.rados.0.smithi033.stdout:2651: finishing rollback tid 1 to smithi03339061-8 2021-07-26T16:06:47.187 INFO:tasks.rados.rados.0.smithi033.stdout:2651: finishing rollback tid 2 to smithi03339061-8 2021-07-26T16:06:47.187 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1239 (ObjNum 751 snap 251 seq_num 751) dirty exists 2021-07-26T16:06:47.187 INFO:tasks.rados.rados.0.smithi033.stdout:2650: finishing copy_from to smithi03339061-36 2021-07-26T16:06:47.187 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1297 (ObjNum 570 snap 177 seq_num 570) dirty exists 2021-07-26T16:06:47.187 INFO:tasks.rados.rados.0.smithi033.stdout:2650: finishing copy_from racing read to smithi03339061-36 2021-07-26T16:06:47.196 INFO:tasks.rados.rados.0.smithi033.stdout:2650: done (2 left) 2021-07-26T16:06:47.196 INFO:tasks.rados.rados.0.smithi033.stdout:2651: done (1 left) 2021-07-26T16:06:47.196 INFO:tasks.rados.rados.0.smithi033.stdout:2653: done (0 left) 2021-07-26T16:06:47.196 INFO:tasks.rados.rados.0.smithi033.stdout:2654: delete oid 29 current snap is 266 2021-07-26T16:06:47.202 INFO:tasks.rados.rados.0.smithi033.stdout:2654: done (0 left) 2021-07-26T16:06:47.202 INFO:tasks.rados.rados.0.smithi033.stdout:2655: rmattr oid 32 current snap is 266 2021-07-26T16:06:47.202 INFO:tasks.rados.rados.0.smithi033.stdout:2655: done (0 left) 2021-07-26T16:06:47.203 INFO:tasks.rados.rados.0.smithi033.stdout:2656: snap_remove snap 254 2021-07-26T16:06:48.212 INFO:tasks.rados.rados.0.smithi033.stdout:2656: done (0 left) 2021-07-26T16:06:48.213 INFO:tasks.rados.rados.0.smithi033.stdout:2657: read oid 29 snap -1 2021-07-26T16:06:48.213 INFO:tasks.rados.rados.0.smithi033.stdout:2657: expect deleted 2021-07-26T16:06:48.213 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 266 2021-07-26T16:06:48.213 INFO:tasks.rados.rados.0.smithi033.stdout:2658: seq_num 799 ranges {2736128=589824,3325952=802816} 2021-07-26T16:06:48.233 INFO:tasks.rados.rados.0.smithi033.stdout:2658: writing smithi03339061-41 from 2736128 to 3325952 tid 1 2021-07-26T16:06:48.240 INFO:tasks.rados.rados.0.smithi033.stdout:2658: writing smithi03339061-41 from 3325952 to 4128768 tid 2 2021-07-26T16:06:48.240 INFO:tasks.rados.rados.0.smithi033.stdout:2657: done (1 left) 2021-07-26T16:06:48.240 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 266 2021-07-26T16:06:48.240 INFO:tasks.rados.rados.0.smithi033.stdout:2659: seq_num 800 ranges {2957312=606208,3563520=688128,4251648=114688} 2021-07-26T16:06:48.260 INFO:tasks.rados.rados.0.smithi033.stdout:2659: writing smithi03339061-10 from 2957312 to 3563520 tid 1 2021-07-26T16:06:48.264 INFO:tasks.rados.rados.0.smithi033.stdout:2659: writing smithi03339061-10 from 3563520 to 4251648 tid 2 2021-07-26T16:06:48.265 INFO:tasks.rados.rados.0.smithi033.stdout:2659: writing smithi03339061-10 from 4251648 to 4366336 tid 3 2021-07-26T16:06:48.265 INFO:tasks.rados.rados.0.smithi033.stdout:2660: read oid 14 snap -1 2021-07-26T16:06:48.266 INFO:tasks.rados.rados.0.smithi033.stdout:2660: expect deleted 2021-07-26T16:06:48.266 INFO:tasks.rados.rados.0.smithi033.stdout:2661: setattr oid 1 current snap is 266 2021-07-26T16:06:48.266 INFO:tasks.rados.rados.0.smithi033.stdout:2658: finishing write tid 1 to smithi03339061-41 2021-07-26T16:06:48.266 INFO:tasks.rados.rados.0.smithi033.stdout:2658: finishing write tid 2 to smithi03339061-41 2021-07-26T16:06:48.267 INFO:tasks.rados.rados.0.smithi033.stdout:2658: finishing write tid 3 to smithi03339061-41 2021-07-26T16:06:48.267 INFO:tasks.rados.rados.0.smithi033.stdout:2658: finishing write tid 4 to smithi03339061-41 2021-07-26T16:06:48.267 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1246 (ObjNum 799 snap 266 seq_num 799) dirty exists 2021-07-26T16:06:48.267 INFO:tasks.rados.rados.0.smithi033.stdout:2658: left oid 41 (ObjNum 799 snap 266 seq_num 799) 2021-07-26T16:06:48.267 INFO:tasks.rados.rados.0.smithi033.stdout:2659: finishing write tid 1 to smithi03339061-10 2021-07-26T16:06:48.268 INFO:tasks.rados.rados.0.smithi033.stdout:2658: done (3 left) 2021-07-26T16:06:48.268 INFO:tasks.rados.rados.0.smithi033.stdout:2660: done (2 left) 2021-07-26T16:06:48.268 INFO:tasks.rados.rados.0.smithi033.stdout:2662: snap_create 2021-07-26T16:06:48.270 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1069 (ObjNum 754 snap 251 seq_num 754) dirty exists 2021-07-26T16:06:48.271 INFO:tasks.rados.rados.0.smithi033.stdout:2659: finishing write tid 2 to smithi03339061-10 2021-07-26T16:06:48.272 INFO:tasks.rados.rados.0.smithi033.stdout:2659: finishing write tid 3 to smithi03339061-10 2021-07-26T16:06:48.275 INFO:tasks.rados.rados.0.smithi033.stdout:2659: finishing write tid 4 to smithi03339061-10 2021-07-26T16:06:48.277 INFO:tasks.rados.rados.0.smithi033.stdout:2659: finishing write tid 5 to smithi03339061-10 2021-07-26T16:06:48.277 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1440 (ObjNum 800 snap 266 seq_num 800) dirty exists 2021-07-26T16:06:48.277 INFO:tasks.rados.rados.0.smithi033.stdout:2659: left oid 10 (ObjNum 800 snap 266 seq_num 800) 2021-07-26T16:06:48.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:48 smithi033 bash[41341]: cluster 2021-07-26T16:06:47.134343+0000 mgr.y (mgr.34104) 385 : cluster [DBG] pgmap v710: 25 pgs: 25 active+clean; 418 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 525 KiB/s wr, 10 op/s 2021-07-26T16:06:48.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:48 smithi033 bash[41341]: cluster 2021-07-26T16:06:47.181721+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2021-07-26T16:06:48.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:48 smithi033 bash[42377]: cluster 2021-07-26T16:06:47.134343+0000 mgr.y (mgr.34104) 385 : cluster [DBG] pgmap v710: 25 pgs: 25 active+clean; 418 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 525 KiB/s wr, 10 op/s 2021-07-26T16:06:48.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:48 smithi033 bash[42377]: cluster 2021-07-26T16:06:47.181721+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2021-07-26T16:06:48.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:48 smithi096 bash[33981]: cluster 2021-07-26T16:06:47.134343+0000 mgr.y (mgr.34104) 385 : cluster [DBG] pgmap v710: 25 pgs: 25 active+clean; 418 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 525 KiB/s wr, 10 op/s 2021-07-26T16:06:48.486 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:48 smithi096 bash[33981]: cluster 2021-07-26T16:06:47.181721+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e595: 8 total, 8 up, 8 in 2021-07-26T16:06:49.219 INFO:tasks.rados.rados.0.smithi033.stdout:2659: done (2 left) 2021-07-26T16:06:49.219 INFO:tasks.rados.rados.0.smithi033.stdout:2661: done (1 left) 2021-07-26T16:06:49.219 INFO:tasks.rados.rados.0.smithi033.stdout:2662: done (0 left) 2021-07-26T16:06:49.220 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 267 2021-07-26T16:06:49.220 INFO:tasks.rados.rados.0.smithi033.stdout:2663: seq_num 801 ranges {0=622592,622592=573440,1196032=229376} 2021-07-26T16:06:49.224 INFO:tasks.rados.rados.0.smithi033.stdout:2663: writing smithi03339061-14 from 0 to 622592 tid 1 2021-07-26T16:06:49.229 INFO:tasks.rados.rados.0.smithi033.stdout:2663: writing smithi03339061-14 from 622592 to 1196032 tid 2 2021-07-26T16:06:49.231 INFO:tasks.rados.rados.0.smithi033.stdout:2663: writing smithi03339061-14 from 1196032 to 1425408 tid 3 2021-07-26T16:06:49.231 INFO:tasks.rados.rados.0.smithi033.stdout:2664: rollback oid 15 current snap is 267 2021-07-26T16:06:49.232 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 15 to 257 2021-07-26T16:06:49.232 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 267 2021-07-26T16:06:49.232 INFO:tasks.rados.rados.0.smithi033.stdout:2665: seq_num 802 ranges {3244032=638976,3883008=458752,4341760=344064} 2021-07-26T16:06:49.254 INFO:tasks.rados.rados.0.smithi033.stdout:2665: writing smithi03339061-46 from 3244032 to 3883008 tid 1 2021-07-26T16:06:49.256 INFO:tasks.rados.rados.0.smithi033.stdout:2665: writing smithi03339061-46 from 3883008 to 4341760 tid 2 2021-07-26T16:06:49.259 INFO:tasks.rados.rados.0.smithi033.stdout:2665: writing smithi03339061-46 from 4341760 to 4685824 tid 3 2021-07-26T16:06:49.259 INFO:tasks.rados.rados.0.smithi033.stdout:2666: read oid 49 snap 257 2021-07-26T16:06:49.260 INFO:tasks.rados.rados.0.smithi033.stdout:2666: expect deleted 2021-07-26T16:06:49.260 INFO:tasks.rados.rados.0.smithi033.stdout:2667: rmattr oid 8 current snap is 267 2021-07-26T16:06:49.260 INFO:tasks.rados.rados.0.smithi033.stdout:2663: finishing write tid 1 to smithi03339061-14 2021-07-26T16:06:49.260 INFO:tasks.rados.rados.0.smithi033.stdout:2663: finishing write tid 2 to smithi03339061-14 2021-07-26T16:06:49.260 INFO:tasks.rados.rados.0.smithi033.stdout:2663: finishing write tid 3 to smithi03339061-14 2021-07-26T16:06:49.261 INFO:tasks.rados.rados.0.smithi033.stdout:2668: snap_create 2021-07-26T16:06:49.261 INFO:tasks.rados.rados.0.smithi033.stdout:2663: finishing write tid 4 to smithi03339061-14 2021-07-26T16:06:49.261 INFO:tasks.rados.rados.0.smithi033.stdout:2664: finishing rollback tid 0 to smithi03339061-15 2021-07-26T16:06:49.261 INFO:tasks.rados.rados.0.smithi033.stdout:2664: finishing rollback tid 1 to smithi03339061-15 2021-07-26T16:06:49.262 INFO:tasks.rados.rados.0.smithi033.stdout:2663: finishing write tid 5 to smithi03339061-14 2021-07-26T16:06:49.262 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1305 (ObjNum 801 snap 267 seq_num 801) dirty exists 2021-07-26T16:06:49.262 INFO:tasks.rados.rados.0.smithi033.stdout:2663: left oid 14 (ObjNum 801 snap 267 seq_num 801) 2021-07-26T16:06:49.262 INFO:tasks.rados.rados.0.smithi033.stdout:2664: finishing rollback tid 2 to smithi03339061-15 2021-07-26T16:06:49.263 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 904 (ObjNum 768 snap 255 seq_num 768) dirty exists 2021-07-26T16:06:49.265 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1240 (ObjNum 751 snap 251 seq_num 751) dirty exists 2021-07-26T16:06:49.266 INFO:tasks.rados.rados.0.smithi033.stdout:2665: finishing write tid 1 to smithi03339061-46 2021-07-26T16:06:49.267 INFO:tasks.rados.rados.0.smithi033.stdout:2665: finishing write tid 2 to smithi03339061-46 2021-07-26T16:06:49.268 INFO:tasks.rados.rados.0.smithi033.stdout:2665: finishing write tid 3 to smithi03339061-46 2021-07-26T16:06:49.268 INFO:tasks.rados.rados.0.smithi033.stdout:2665: finishing write tid 4 to smithi03339061-46 2021-07-26T16:06:49.271 INFO:tasks.rados.rados.0.smithi033.stdout:2665: finishing write tid 5 to smithi03339061-46 2021-07-26T16:06:49.271 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1248 (ObjNum 802 snap 267 seq_num 802) dirty exists 2021-07-26T16:06:49.271 INFO:tasks.rados.rados.0.smithi033.stdout:2665: left oid 46 (ObjNum 802 snap 267 seq_num 802) 2021-07-26T16:06:49.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:49 smithi096 bash[33981]: cluster 2021-07-26T16:06:48.206507+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2021-07-26T16:06:49.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:49 smithi033 bash[42377]: cluster 2021-07-26T16:06:48.206507+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2021-07-26T16:06:49.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:49 smithi033 bash[41341]: cluster 2021-07-26T16:06:48.206507+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e596: 8 total, 8 up, 8 in 2021-07-26T16:06:50.221 INFO:tasks.rados.rados.0.smithi033.stdout:2663: done (5 left) 2021-07-26T16:06:50.221 INFO:tasks.rados.rados.0.smithi033.stdout:2664: done (4 left) 2021-07-26T16:06:50.221 INFO:tasks.rados.rados.0.smithi033.stdout:2665: done (3 left) 2021-07-26T16:06:50.221 INFO:tasks.rados.rados.0.smithi033.stdout:2666: done (2 left) 2021-07-26T16:06:50.222 INFO:tasks.rados.rados.0.smithi033.stdout:2667: done (1 left) 2021-07-26T16:06:50.222 INFO:tasks.rados.rados.0.smithi033.stdout:2668: done (0 left) 2021-07-26T16:06:50.222 INFO:tasks.rados.rados.0.smithi033.stdout:2669: read oid 5 snap -1 2021-07-26T16:06:50.223 INFO:tasks.rados.rados.0.smithi033.stdout:2669: expect deleted 2021-07-26T16:06:50.223 INFO:tasks.rados.rados.0.smithi033.stdout:2670: read oid 41 snap -1 2021-07-26T16:06:50.223 INFO:tasks.rados.rados.0.smithi033.stdout:2670: expect (ObjNum 799 snap 266 seq_num 799) 2021-07-26T16:06:50.223 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 268 2021-07-26T16:06:50.224 INFO:tasks.rados.rados.0.smithi033.stdout:2671: seq_num 803 ranges {0=655360,655360=745472,1400832=57344} 2021-07-26T16:06:50.227 INFO:tasks.rados.rados.0.smithi033.stdout:2671: writing smithi03339061-27 from 0 to 655360 tid 1 2021-07-26T16:06:50.232 INFO:tasks.rados.rados.0.smithi033.stdout:2671: writing smithi03339061-27 from 655360 to 1400832 tid 2 2021-07-26T16:06:50.233 INFO:tasks.rados.rados.0.smithi033.stdout:2671: writing smithi03339061-27 from 1400832 to 1458176 tid 3 2021-07-26T16:06:50.233 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 268 2021-07-26T16:06:50.233 INFO:tasks.rados.rados.0.smithi033.stdout:2672: seq_num 804 ranges {11968512=671744,12640256=622592,13262848=180224} 2021-07-26T16:06:50.303 INFO:tasks.rados.rados.0.smithi033.stdout:2672: writing smithi03339061-28 from 11968512 to 12640256 tid 1 2021-07-26T16:06:50.307 INFO:tasks.rados.rados.0.smithi033.stdout:2672: writing smithi03339061-28 from 12640256 to 13262848 tid 2 2021-07-26T16:06:50.308 INFO:tasks.rados.rados.0.smithi033.stdout:2672: writing smithi03339061-28 from 13262848 to 13443072 tid 3 2021-07-26T16:06:50.308 INFO:tasks.rados.rados.0.smithi033.stdout:2673: rollback oid 35 current snap is 268 2021-07-26T16:06:50.308 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 243 2021-07-26T16:06:50.309 INFO:tasks.rados.rados.0.smithi033.stdout:2669: done (4 left) 2021-07-26T16:06:50.309 INFO:tasks.rados.rados.0.smithi033.stdout:2674: read oid 43 snap -1 2021-07-26T16:06:50.309 INFO:tasks.rados.rados.0.smithi033.stdout:2674: expect (ObjNum 783 snap 260 seq_num 783) 2021-07-26T16:06:50.309 INFO:tasks.rados.rados.0.smithi033.stdout:2675: read oid 9 snap -1 2021-07-26T16:06:50.309 INFO:tasks.rados.rados.0.smithi033.stdout:2675: expect (ObjNum 745 snap 249 seq_num 745) 2021-07-26T16:06:50.310 INFO:tasks.rados.rados.0.smithi033.stdout:2676: snap_remove snap 259 2021-07-26T16:06:50.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:50 smithi096 bash[33981]: cluster 2021-07-26T16:06:49.135041+0000 mgr.y (mgr.34104) 386 : cluster [DBG] pgmap v713: 25 pgs: 25 active+clean; 410 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 8.9 MiB/s rd, 670 KiB/s wr, 9 op/s 2021-07-26T16:06:50.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:50 smithi096 bash[33981]: cluster 2021-07-26T16:06:49.215480+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2021-07-26T16:06:50.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:50 smithi033 bash[41341]: cluster 2021-07-26T16:06:49.135041+0000 mgr.y (mgr.34104) 386 : cluster [DBG] pgmap v713: 25 pgs: 25 active+clean; 410 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 8.9 MiB/s rd, 670 KiB/s wr, 9 op/s 2021-07-26T16:06:50.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:50 smithi033 bash[41341]: cluster 2021-07-26T16:06:49.215480+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2021-07-26T16:06:50.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:50 smithi033 bash[42377]: cluster 2021-07-26T16:06:49.135041+0000 mgr.y (mgr.34104) 386 : cluster [DBG] pgmap v713: 25 pgs: 25 active+clean; 410 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 8.9 MiB/s rd, 670 KiB/s wr, 9 op/s 2021-07-26T16:06:50.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:50 smithi033 bash[42377]: cluster 2021-07-26T16:06:49.215480+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e597: 8 total, 8 up, 8 in 2021-07-26T16:06:51.166 INFO:tasks.rados.rados.0.smithi033.stdout:2671: finishing write tid 1 to smithi03339061-27 2021-07-26T16:06:51.167 INFO:tasks.rados.rados.0.smithi033.stdout:2671: finishing write tid 2 to smithi03339061-27 2021-07-26T16:06:51.167 INFO:tasks.rados.rados.0.smithi033.stdout:2671: finishing write tid 3 to smithi03339061-27 2021-07-26T16:06:51.167 INFO:tasks.rados.rados.0.smithi033.stdout:2671: finishing write tid 4 to smithi03339061-27 2021-07-26T16:06:51.167 INFO:tasks.rados.rados.0.smithi033.stdout:2671: finishing write tid 5 to smithi03339061-27 2021-07-26T16:06:51.168 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1385 (ObjNum 803 snap 268 seq_num 803) dirty exists 2021-07-26T16:06:51.168 INFO:tasks.rados.rados.0.smithi033.stdout:2671: left oid 27 (ObjNum 803 snap 268 seq_num 803) 2021-07-26T16:06:51.168 INFO:tasks.rados.rados.0.smithi033.stdout:2670: expect (ObjNum 799 snap 266 seq_num 799) 2021-07-26T16:06:51.364 INFO:tasks.rados.rados.0.smithi033.stdout:2670: done (6 left) 2021-07-26T16:06:51.364 INFO:tasks.rados.rados.0.smithi033.stdout:2671: done (5 left) 2021-07-26T16:06:51.365 INFO:tasks.rados.rados.0.smithi033.stdout:2676: done (4 left) 2021-07-26T16:06:51.365 INFO:tasks.rados.rados.0.smithi033.stdout:2677: read oid 46 snap 235 2021-07-26T16:06:51.366 INFO:tasks.rados.rados.0.smithi033.stdout:2677: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:06:51.366 INFO:tasks.rados.rados.0.smithi033.stdout:2678: rollback oid 19 current snap is 268 2021-07-26T16:06:51.366 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 19 to 257 2021-07-26T16:06:51.367 INFO:tasks.rados.rados.0.smithi033.stdout:2673: finishing rollback tid 0 to smithi03339061-35 2021-07-26T16:06:51.367 INFO:tasks.rados.rados.0.smithi033.stdout:2673: finishing rollback tid 1 to smithi03339061-35 2021-07-26T16:06:51.368 INFO:tasks.rados.rados.0.smithi033.stdout:2673: finishing rollback tid 2 to smithi03339061-35 2021-07-26T16:06:51.368 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1243 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:06:51.369 INFO:tasks.rados.rados.0.smithi033.stdout:2675: expect (ObjNum 745 snap 249 seq_num 745) 2021-07-26T16:06:51.379 INFO:tasks.rados.rados.0.smithi033.stdout:2672: finishing write tid 1 to smithi03339061-28 2021-07-26T16:06:51.380 INFO:tasks.rados.rados.0.smithi033.stdout:2673: done (5 left) 2021-07-26T16:06:51.380 INFO:tasks.rados.rados.0.smithi033.stdout:2675: done (4 left) 2021-07-26T16:06:51.381 INFO:tasks.rados.rados.0.smithi033.stdout:2679: read oid 2 snap 248 2021-07-26T16:06:51.381 INFO:tasks.rados.rados.0.smithi033.stdout:2679: expect (ObjNum 718 snap 242 seq_num 718) 2021-07-26T16:06:51.381 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 268 2021-07-26T16:06:51.382 INFO:tasks.rados.rados.0.smithi033.stdout:2672: finishing write tid 2 to smithi03339061-28 2021-07-26T16:06:51.382 INFO:tasks.rados.rados.0.smithi033.stdout:2672: finishing write tid 3 to smithi03339061-28 2021-07-26T16:06:51.383 INFO:tasks.rados.rados.0.smithi033.stdout:2672: finishing write tid 4 to smithi03339061-28 2021-07-26T16:06:51.383 INFO:tasks.rados.rados.0.smithi033.stdout:2674: expect (ObjNum 783 snap 260 seq_num 783) 2021-07-26T16:06:51.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:51 smithi096 bash[33981]: cluster 2021-07-26T16:06:50.217403+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2021-07-26T16:06:51.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:51 smithi096 bash[33981]: cluster 2021-07-26T16:06:51.161650+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2021-07-26T16:06:51.615 INFO:tasks.rados.rados.0.smithi033.stdout:2672: finishing write tid 5 to smithi03339061-28 2021-07-26T16:06:51.616 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1391 (ObjNum 804 snap 268 seq_num 804) dirty exists 2021-07-26T16:06:51.616 INFO:tasks.rados.rados.0.smithi033.stdout:2672: left oid 28 (ObjNum 804 snap 268 seq_num 804) 2021-07-26T16:06:51.616 INFO:tasks.rados.rados.0.smithi033.stdout:2680: seq_num 805 ranges {0=688128,688128=507904,1196032=294912} 2021-07-26T16:06:51.619 INFO:tasks.rados.rados.0.smithi033.stdout:2680: writing smithi03339061-32 from 0 to 688128 tid 1 2021-07-26T16:06:51.622 INFO:tasks.rados.rados.0.smithi033.stdout:2680: writing smithi03339061-32 from 688128 to 1196032 tid 2 2021-07-26T16:06:51.624 INFO:tasks.rados.rados.0.smithi033.stdout:2680: writing smithi03339061-32 from 1196032 to 1490944 tid 3 2021-07-26T16:06:51.624 INFO:tasks.rados.rados.0.smithi033.stdout:2672: done (5 left) 2021-07-26T16:06:51.624 INFO:tasks.rados.rados.0.smithi033.stdout:2674: done (4 left) 2021-07-26T16:06:51.624 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 268 2021-07-26T16:06:51.625 INFO:tasks.rados.rados.0.smithi033.stdout:2678: finishing rollback tid 0 to smithi03339061-19 2021-07-26T16:06:51.625 INFO:tasks.rados.rados.0.smithi033.stdout:2681: seq_num 806 ranges {1458176=704512,2162688=442368,2605056=360448} 2021-07-26T16:06:51.637 INFO:tasks.rados.rados.0.smithi033.stdout:2681: writing smithi03339061-27 from 1458176 to 2162688 tid 1 2021-07-26T16:06:51.639 INFO:tasks.rados.rados.0.smithi033.stdout:2681: writing smithi03339061-27 from 2162688 to 2605056 tid 2 2021-07-26T16:06:51.642 INFO:tasks.rados.rados.0.smithi033.stdout:2681: writing smithi03339061-27 from 2605056 to 2965504 tid 3 2021-07-26T16:06:51.642 INFO:tasks.rados.rados.0.smithi033.stdout:2682: read oid 45 snap -1 2021-07-26T16:06:51.642 INFO:tasks.rados.rados.0.smithi033.stdout:2682: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:06:51.643 INFO:tasks.rados.rados.0.smithi033.stdout:2683: copy_from oid 40 from oid 50 current snap is 268 2021-07-26T16:06:51.643 INFO:tasks.rados.rados.0.smithi033.stdout:2678: finishing rollback tid 1 to smithi03339061-19 2021-07-26T16:06:51.643 INFO:tasks.rados.rados.0.smithi033.stdout:2678: finishing rollback tid 2 to smithi03339061-19 2021-07-26T16:06:51.643 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 1246 (ObjNum 727 snap 244 seq_num 727) dirty exists 2021-07-26T16:06:51.643 INFO:tasks.rados.rados.0.smithi033.stdout:2677: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:06:51.704 INFO:tasks.rados.rados.0.smithi033.stdout:2679: expect (ObjNum 718 snap 242 seq_num 718) 2021-07-26T16:06:51.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:51 smithi033 bash[41341]: cluster 2021-07-26T16:06:50.217403+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2021-07-26T16:06:51.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:51 smithi033 bash[41341]: cluster 2021-07-26T16:06:51.161650+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2021-07-26T16:06:51.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:51 smithi033 bash[42377]: cluster 2021-07-26T16:06:50.217403+0000 mon.a (mon.0) 964 : cluster [DBG] osdmap e598: 8 total, 8 up, 8 in 2021-07-26T16:06:51.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:51 smithi033 bash[42377]: cluster 2021-07-26T16:06:51.161650+0000 mon.a (mon.0) 965 : cluster [DBG] osdmap e599: 8 total, 8 up, 8 in 2021-07-26T16:06:51.884 INFO:tasks.rados.rados.0.smithi033.stdout:2680: finishing write tid 1 to smithi03339061-32 2021-07-26T16:06:51.885 INFO:tasks.rados.rados.0.smithi033.stdout:2680: finishing write tid 2 to smithi03339061-32 2021-07-26T16:06:51.885 INFO:tasks.rados.rados.0.smithi033.stdout:2680: finishing write tid 3 to smithi03339061-32 2021-07-26T16:06:51.885 INFO:tasks.rados.rados.0.smithi033.stdout:2680: finishing write tid 4 to smithi03339061-32 2021-07-26T16:06:51.885 INFO:tasks.rados.rados.0.smithi033.stdout:2680: finishing write tid 5 to smithi03339061-32 2021-07-26T16:06:51.885 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1299 (ObjNum 805 snap 268 seq_num 805) dirty exists 2021-07-26T16:06:51.886 INFO:tasks.rados.rados.0.smithi033.stdout:2680: left oid 32 (ObjNum 805 snap 268 seq_num 805) 2021-07-26T16:06:51.886 INFO:tasks.rados.rados.0.smithi033.stdout:2681: finishing write tid 1 to smithi03339061-27 2021-07-26T16:06:51.886 INFO:tasks.rados.rados.0.smithi033.stdout:2681: finishing write tid 2 to smithi03339061-27 2021-07-26T16:06:51.886 INFO:tasks.rados.rados.0.smithi033.stdout:2681: finishing write tid 3 to smithi03339061-27 2021-07-26T16:06:51.887 INFO:tasks.rados.rados.0.smithi033.stdout:2682: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:06:51.946 INFO:tasks.rados.rados.0.smithi033.stdout:2681: finishing write tid 4 to smithi03339061-27 2021-07-26T16:06:51.947 INFO:tasks.rados.rados.0.smithi033.stdout:2681: finishing write tid 5 to smithi03339061-27 2021-07-26T16:06:51.947 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1389 (ObjNum 806 snap 268 seq_num 806) dirty exists 2021-07-26T16:06:51.947 INFO:tasks.rados.rados.0.smithi033.stdout:2681: left oid 27 (ObjNum 806 snap 268 seq_num 806) 2021-07-26T16:06:51.947 INFO:tasks.rados.rados.0.smithi033.stdout:2683: finishing copy_from to smithi03339061-40 2021-07-26T16:06:51.948 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 894 (ObjNum 751 snap 251 seq_num 751) dirty exists 2021-07-26T16:06:51.948 INFO:tasks.rados.rados.0.smithi033.stdout:2683: finishing copy_from racing read to smithi03339061-40 2021-07-26T16:06:51.948 INFO:tasks.rados.rados.0.smithi033.stdout:2677: done (6 left) 2021-07-26T16:06:51.948 INFO:tasks.rados.rados.0.smithi033.stdout:2678: done (5 left) 2021-07-26T16:06:51.949 INFO:tasks.rados.rados.0.smithi033.stdout:2679: done (4 left) 2021-07-26T16:06:51.949 INFO:tasks.rados.rados.0.smithi033.stdout:2680: done (3 left) 2021-07-26T16:06:51.949 INFO:tasks.rados.rados.0.smithi033.stdout:2681: done (2 left) 2021-07-26T16:06:51.949 INFO:tasks.rados.rados.0.smithi033.stdout:2682: done (1 left) 2021-07-26T16:06:51.950 INFO:tasks.rados.rados.0.smithi033.stdout:2683: done (0 left) 2021-07-26T16:06:51.950 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 268 2021-07-26T16:06:51.950 INFO:tasks.rados.rados.0.smithi033.stdout:2684: seq_num 807 ranges {2187264=720896,2908160=729088,3637248=73728} 2021-07-26T16:06:51.972 INFO:tasks.rados.rados.0.smithi033.stdout:2684: writing smithi03339061-12 from 2187264 to 2908160 tid 1 2021-07-26T16:06:51.976 INFO:tasks.rados.rados.0.smithi033.stdout:2684: writing smithi03339061-12 from 2908160 to 3637248 tid 2 2021-07-26T16:06:51.977 INFO:tasks.rados.rados.0.smithi033.stdout:2684: writing smithi03339061-12 from 3637248 to 3710976 tid 3 2021-07-26T16:06:51.977 INFO:tasks.rados.rados.0.smithi033.stdout:2685: copy_from oid 49 from oid 11 current snap is 268 2021-07-26T16:06:51.978 INFO:tasks.rados.rados.0.smithi033.stdout:2686: snap_remove snap 262 2021-07-26T16:06:52.256 INFO:tasks.rados.rados.0.smithi033.stdout:2686: done (2 left) 2021-07-26T16:06:52.256 INFO:tasks.rados.rados.0.smithi033.stdout:2687: rollback oid 28 current snap is 268 2021-07-26T16:06:52.256 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 28 to 237 2021-07-26T16:06:52.257 INFO:tasks.rados.rados.0.smithi033.stdout:2684: finishing write tid 1 to smithi03339061-12 2021-07-26T16:06:52.257 INFO:tasks.rados.rados.0.smithi033.stdout:2684: finishing write tid 2 to smithi03339061-12 2021-07-26T16:06:52.258 INFO:tasks.rados.rados.0.smithi033.stdout:2684: finishing write tid 3 to smithi03339061-12 2021-07-26T16:06:52.258 INFO:tasks.rados.rados.0.smithi033.stdout:2684: finishing write tid 4 to smithi03339061-12 2021-07-26T16:06:52.258 INFO:tasks.rados.rados.0.smithi033.stdout:2684: finishing write tid 5 to smithi03339061-12 2021-07-26T16:06:52.259 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1395 (ObjNum 807 snap 268 seq_num 807) dirty exists 2021-07-26T16:06:52.259 INFO:tasks.rados.rados.0.smithi033.stdout:2684: left oid 12 (ObjNum 807 snap 268 seq_num 807) 2021-07-26T16:06:52.259 INFO:tasks.rados.rados.0.smithi033.stdout:2685: finishing copy_from to smithi03339061-49 2021-07-26T16:06:52.259 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 911 (ObjNum 774 snap 255 seq_num 774) dirty exists 2021-07-26T16:06:52.260 INFO:tasks.rados.rados.0.smithi033.stdout:2685: finishing copy_from racing read to smithi03339061-49 2021-07-26T16:06:52.260 INFO:tasks.rados.rados.0.smithi033.stdout:2684: done (2 left) 2021-07-26T16:06:52.260 INFO:tasks.rados.rados.0.smithi033.stdout:2685: done (1 left) 2021-07-26T16:06:52.260 INFO:tasks.rados.rados.0.smithi033.stdout:2688: delete oid 8 current snap is 268 2021-07-26T16:06:52.265 INFO:tasks.rados.rados.0.smithi033.stdout:2688: done (1 left) 2021-07-26T16:06:52.266 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 268 2021-07-26T16:06:52.266 INFO:tasks.rados.rados.0.smithi033.stdout:2689: seq_num 809 ranges {3317760=753664,4071424=499712,4571136=303104} 2021-07-26T16:06:52.289 INFO:tasks.rados.rados.0.smithi033.stdout:2689: writing smithi03339061-4 from 3317760 to 4071424 tid 1 2021-07-26T16:06:52.292 INFO:tasks.rados.rados.0.smithi033.stdout:2689: writing smithi03339061-4 from 4071424 to 4571136 tid 2 2021-07-26T16:06:52.294 INFO:tasks.rados.rados.0.smithi033.stdout:2689: writing smithi03339061-4 from 4571136 to 4874240 tid 3 2021-07-26T16:06:52.295 INFO:tasks.rados.rados.0.smithi033.stdout:2690: read oid 6 snap 237 2021-07-26T16:06:52.295 INFO:tasks.rados.rados.0.smithi033.stdout:2690: expect (ObjNum 630 snap 199 seq_num 630) 2021-07-26T16:06:52.295 INFO:tasks.rados.rados.0.smithi033.stdout:2691: copy_from oid 21 from oid 24 current snap is 268 2021-07-26T16:06:52.295 INFO:tasks.rados.rados.0.smithi033.stdout:2687: finishing rollback tid 0 to smithi03339061-28 2021-07-26T16:06:52.296 INFO:tasks.rados.rados.0.smithi033.stdout:2687: finishing rollback tid 1 to smithi03339061-28 2021-07-26T16:06:52.296 INFO:tasks.rados.rados.0.smithi033.stdout:2687: finishing rollback tid 2 to smithi03339061-28 2021-07-26T16:06:52.296 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1398 (ObjNum 569 snap 177 seq_num 569) dirty exists 2021-07-26T16:06:52.296 INFO:tasks.rados.rados.0.smithi033.stdout:2687: done (3 left) 2021-07-26T16:06:52.297 INFO:tasks.rados.rados.0.smithi033.stdout:2692: delete oid 10 current snap is 268 2021-07-26T16:06:52.297 INFO:tasks.rados.rados.0.smithi033.stdout:2689: finishing write tid 1 to smithi03339061-4 2021-07-26T16:06:52.299 INFO:tasks.rados.rados.0.smithi033.stdout:2689: finishing write tid 2 to smithi03339061-4 2021-07-26T16:06:52.299 INFO:tasks.rados.rados.0.smithi033.stdout:2689: finishing write tid 3 to smithi03339061-4 2021-07-26T16:06:52.300 INFO:tasks.rados.rados.0.smithi033.stdout:2689: finishing write tid 4 to smithi03339061-4 2021-07-26T16:06:52.301 INFO:tasks.rados.rados.0.smithi033.stdout:2689: finishing write tid 5 to smithi03339061-4 2021-07-26T16:06:52.302 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1309 (ObjNum 809 snap 268 seq_num 809) dirty exists 2021-07-26T16:06:52.302 INFO:tasks.rados.rados.0.smithi033.stdout:2689: left oid 4 (ObjNum 809 snap 268 seq_num 809) 2021-07-26T16:06:52.304 INFO:tasks.rados.rados.0.smithi033.stdout:2690: expect (ObjNum 630 snap 199 seq_num 630) 2021-07-26T16:06:52.386 INFO:tasks.rados.rados.0.smithi033.stdout:2691: finishing copy_from to smithi03339061-21 2021-07-26T16:06:52.386 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 902 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:06:52.387 INFO:tasks.rados.rados.0.smithi033.stdout:2691: finishing copy_from racing read to smithi03339061-21 2021-07-26T16:06:52.387 INFO:tasks.rados.rados.0.smithi033.stdout:2689: done (3 left) 2021-07-26T16:06:52.387 INFO:tasks.rados.rados.0.smithi033.stdout:2690: done (2 left) 2021-07-26T16:06:52.387 INFO:tasks.rados.rados.0.smithi033.stdout:2691: done (1 left) 2021-07-26T16:06:52.388 INFO:tasks.rados.rados.0.smithi033.stdout:2692: done (0 left) 2021-07-26T16:06:52.388 INFO:tasks.rados.rados.0.smithi033.stdout:2693: snap_remove snap 265 2021-07-26T16:06:52.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:52 smithi096 bash[33981]: cluster 2021-07-26T16:06:51.135895+0000 mgr.y (mgr.34104) 387 : cluster [DBG] pgmap v716: 25 pgs: 25 active+clean; 412 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 2.1 MiB/s wr, 9 op/s 2021-07-26T16:06:52.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:52 smithi033 bash[41341]: cluster 2021-07-26T16:06:51.135895+0000 mgr.y (mgr.34104) 387 : cluster [DBG] pgmap v716: 25 pgs: 25 active+clean; 412 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 2.1 MiB/s wr, 9 op/s 2021-07-26T16:06:52.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:52 smithi033 bash[42377]: cluster 2021-07-26T16:06:51.135895+0000 mgr.y (mgr.34104) 387 : cluster [DBG] pgmap v716: 25 pgs: 25 active+clean; 412 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 2.1 MiB/s wr, 9 op/s 2021-07-26T16:06:53.263 INFO:tasks.rados.rados.0.smithi033.stdout:2693: done (0 left) 2021-07-26T16:06:53.263 INFO:tasks.rados.rados.0.smithi033.stdout:2694: read oid 6 snap 231 2021-07-26T16:06:53.263 INFO:tasks.rados.rados.0.smithi033.stdout:2694: expect (ObjNum 630 snap 199 seq_num 630) 2021-07-26T16:06:53.264 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 268 2021-07-26T16:06:53.264 INFO:tasks.rados.rados.0.smithi033.stdout:2695: seq_num 811 ranges {15228928=786432,16015360=663552,16678912=139264} 2021-07-26T16:06:53.354 INFO:tasks.rados.rados.0.smithi033.stdout:2695: writing smithi03339061-49 from 15228928 to 16015360 tid 1 2021-07-26T16:06:53.358 INFO:tasks.rados.rados.0.smithi033.stdout:2695: writing smithi03339061-49 from 16015360 to 16678912 tid 2 2021-07-26T16:06:53.359 INFO:tasks.rados.rados.0.smithi033.stdout:2695: writing smithi03339061-49 from 16678912 to 16818176 tid 3 2021-07-26T16:06:53.359 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 268 2021-07-26T16:06:53.360 INFO:tasks.rados.rados.0.smithi033.stdout:2696: seq_num 812 ranges {4685824=802816,5488640=548864,6037504=253952} 2021-07-26T16:06:53.390 INFO:tasks.rados.rados.0.smithi033.stdout:2696: writing smithi03339061-46 from 4685824 to 5488640 tid 1 2021-07-26T16:06:53.393 INFO:tasks.rados.rados.0.smithi033.stdout:2696: writing smithi03339061-46 from 5488640 to 6037504 tid 2 2021-07-26T16:06:53.395 INFO:tasks.rados.rados.0.smithi033.stdout:2696: writing smithi03339061-46 from 6037504 to 6291456 tid 3 2021-07-26T16:06:53.395 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 268 2021-07-26T16:06:53.395 INFO:tasks.rados.rados.0.smithi033.stdout:2697: seq_num 813 ranges {5603328=417792,6021120=434176,6455296=442368,6897664=327680} 2021-07-26T16:06:53.428 INFO:tasks.rados.rados.0.smithi033.stdout:2697: writing smithi03339061-39 from 5603328 to 6021120 tid 1 2021-07-26T16:06:53.431 INFO:tasks.rados.rados.0.smithi033.stdout:2697: writing smithi03339061-39 from 6021120 to 6455296 tid 2 2021-07-26T16:06:53.433 INFO:tasks.rados.rados.0.smithi033.stdout:2697: writing smithi03339061-39 from 6455296 to 6897664 tid 3 2021-07-26T16:06:53.436 INFO:tasks.rados.rados.0.smithi033.stdout:2697: writing smithi03339061-39 from 6897664 to 7225344 tid 4 2021-07-26T16:06:53.436 INFO:tasks.rados.rados.0.smithi033.stdout:2698: delete oid 35 current snap is 268 2021-07-26T16:06:53.436 INFO:tasks.rados.rados.0.smithi033.stdout:2694: expect (ObjNum 630 snap 199 seq_num 630) 2021-07-26T16:06:53.517 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:53 smithi033 bash[42377]: cluster 2021-07-26T16:06:52.250589+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2021-07-26T16:06:53.518 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:53 smithi033 bash[41341]: cluster 2021-07-26T16:06:52.250589+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2021-07-26T16:06:53.524 INFO:tasks.rados.rados.0.smithi033.stdout:2695: finishing write tid 1 to smithi03339061-49 2021-07-26T16:06:53.524 INFO:tasks.rados.rados.0.smithi033.stdout:2695: finishing write tid 2 to smithi03339061-49 2021-07-26T16:06:53.525 INFO:tasks.rados.rados.0.smithi033.stdout:2695: finishing write tid 3 to smithi03339061-49 2021-07-26T16:06:53.525 INFO:tasks.rados.rados.0.smithi033.stdout:2695: finishing write tid 4 to smithi03339061-49 2021-07-26T16:06:53.525 INFO:tasks.rados.rados.0.smithi033.stdout:2695: finishing write tid 5 to smithi03339061-49 2021-07-26T16:06:53.525 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 915 (ObjNum 811 snap 268 seq_num 811) dirty exists 2021-07-26T16:06:53.526 INFO:tasks.rados.rados.0.smithi033.stdout:2695: left oid 49 (ObjNum 811 snap 268 seq_num 811) 2021-07-26T16:06:53.526 INFO:tasks.rados.rados.0.smithi033.stdout:2696: finishing write tid 1 to smithi03339061-46 2021-07-26T16:06:53.526 INFO:tasks.rados.rados.0.smithi033.stdout:2696: finishing write tid 2 to smithi03339061-46 2021-07-26T16:06:53.526 INFO:tasks.rados.rados.0.smithi033.stdout:2696: finishing write tid 3 to smithi03339061-46 2021-07-26T16:06:53.526 INFO:tasks.rados.rados.0.smithi033.stdout:2696: finishing write tid 4 to smithi03339061-46 2021-07-26T16:06:53.527 INFO:tasks.rados.rados.0.smithi033.stdout:2694: done (4 left) 2021-07-26T16:06:53.527 INFO:tasks.rados.rados.0.smithi033.stdout:2695: done (3 left) 2021-07-26T16:06:53.527 INFO:tasks.rados.rados.0.smithi033.stdout:2698: done (2 left) 2021-07-26T16:06:53.527 INFO:tasks.rados.rados.0.smithi033.stdout:2699: snap_create 2021-07-26T16:06:53.528 INFO:tasks.rados.rados.0.smithi033.stdout:2696: finishing write tid 5 to smithi03339061-46 2021-07-26T16:06:53.528 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1252 (ObjNum 812 snap 268 seq_num 812) dirty exists 2021-07-26T16:06:53.528 INFO:tasks.rados.rados.0.smithi033.stdout:2696: left oid 46 (ObjNum 812 snap 268 seq_num 812) 2021-07-26T16:06:53.528 INFO:tasks.rados.rados.0.smithi033.stdout:2697: finishing write tid 1 to smithi03339061-39 2021-07-26T16:06:53.528 INFO:tasks.rados.rados.0.smithi033.stdout:2697: finishing write tid 2 to smithi03339061-39 2021-07-26T16:06:53.529 INFO:tasks.rados.rados.0.smithi033.stdout:2697: finishing write tid 3 to smithi03339061-39 2021-07-26T16:06:53.529 INFO:tasks.rados.rados.0.smithi033.stdout:2697: finishing write tid 4 to smithi03339061-39 2021-07-26T16:06:53.529 INFO:tasks.rados.rados.0.smithi033.stdout:2697: finishing write tid 5 to smithi03339061-39 2021-07-26T16:06:53.529 INFO:tasks.rados.rados.0.smithi033.stdout:2697: finishing write tid 6 to smithi03339061-39 2021-07-26T16:06:53.530 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1394 (ObjNum 813 snap 268 seq_num 813) dirty exists 2021-07-26T16:06:53.530 INFO:tasks.rados.rados.0.smithi033.stdout:2697: left oid 39 (ObjNum 813 snap 268 seq_num 813) 2021-07-26T16:06:53.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:53 smithi096 bash[33981]: cluster 2021-07-26T16:06:52.250589+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e600: 8 total, 8 up, 8 in 2021-07-26T16:06:53.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:53 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:53.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:53.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:53 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:53.514Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:06:53.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:06:53 smithi033 bash[50539]: level=error ts=2021-07-26T16:06:53.514Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:06:54.271 INFO:tasks.rados.rados.0.smithi033.stdout:2696: done (2 left) 2021-07-26T16:06:54.271 INFO:tasks.rados.rados.0.smithi033.stdout:2697: done (1 left) 2021-07-26T16:06:54.271 INFO:tasks.rados.rados.0.smithi033.stdout:2699: done (0 left) 2021-07-26T16:06:54.272 INFO:tasks.rados.rados.0.smithi033.stdout:2700: snap_create 2021-07-26T16:06:54.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:54 smithi033 bash[41341]: cluster 2021-07-26T16:06:53.136659+0000 mgr.y (mgr.34104) 388 : cluster [DBG] pgmap v719: 25 pgs: 25 active+clean; 420 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 21 op/s 2021-07-26T16:06:54.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:54 smithi033 bash[41341]: cluster 2021-07-26T16:06:53.257359+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2021-07-26T16:06:54.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:54 smithi033 bash[42377]: cluster 2021-07-26T16:06:53.136659+0000 mgr.y (mgr.34104) 388 : cluster [DBG] pgmap v719: 25 pgs: 25 active+clean; 420 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 21 op/s 2021-07-26T16:06:54.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:54 smithi033 bash[42377]: cluster 2021-07-26T16:06:53.257359+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2021-07-26T16:06:54.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:54 smithi096 bash[33981]: cluster 2021-07-26T16:06:53.136659+0000 mgr.y (mgr.34104) 388 : cluster [DBG] pgmap v719: 25 pgs: 25 active+clean; 420 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 21 op/s 2021-07-26T16:06:54.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:54 smithi096 bash[33981]: cluster 2021-07-26T16:06:53.257359+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e601: 8 total, 8 up, 8 in 2021-07-26T16:06:55.274 INFO:tasks.rados.rados.0.smithi033.stdout:2700: done (0 left) 2021-07-26T16:06:55.275 INFO:tasks.rados.rados.0.smithi033.stdout:2701: snap_create 2021-07-26T16:06:55.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:55 smithi033 bash[41341]: cluster 2021-07-26T16:06:54.268962+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2021-07-26T16:06:55.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:55 smithi033 bash[42377]: cluster 2021-07-26T16:06:54.268962+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2021-07-26T16:06:55.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:55 smithi096 bash[33981]: cluster 2021-07-26T16:06:54.268962+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e602: 8 total, 8 up, 8 in 2021-07-26T16:06:56.170 INFO:tasks.rados.rados.0.smithi033.stdout:2701: done (0 left) 2021-07-26T16:06:56.170 INFO:tasks.rados.rados.0.smithi033.stdout:2702: snap_create 2021-07-26T16:06:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:56 smithi033 bash[41341]: cluster 2021-07-26T16:06:55.137504+0000 mgr.y (mgr.34104) 389 : cluster [DBG] pgmap v722: 25 pgs: 25 active+clean; 425 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.0 MiB/s wr, 21 op/s 2021-07-26T16:06:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:56 smithi033 bash[41341]: cluster 2021-07-26T16:06:55.268443+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2021-07-26T16:06:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:56 smithi033 bash[41341]: cluster 2021-07-26T16:06:56.164713+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2021-07-26T16:06:56.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:56 smithi033 bash[42377]: cluster 2021-07-26T16:06:55.137504+0000 mgr.y (mgr.34104) 389 : cluster [DBG] pgmap v722: 25 pgs: 25 active+clean; 425 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.0 MiB/s wr, 21 op/s 2021-07-26T16:06:56.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:56 smithi033 bash[42377]: cluster 2021-07-26T16:06:55.268443+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2021-07-26T16:06:56.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:56 smithi033 bash[42377]: cluster 2021-07-26T16:06:56.164713+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2021-07-26T16:06:56.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:56 smithi096 bash[33981]: cluster 2021-07-26T16:06:55.137504+0000 mgr.y (mgr.34104) 389 : cluster [DBG] pgmap v722: 25 pgs: 25 active+clean; 425 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 3.0 MiB/s wr, 21 op/s 2021-07-26T16:06:56.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:56 smithi096 bash[33981]: cluster 2021-07-26T16:06:55.268443+0000 mon.a (mon.0) 969 : cluster [DBG] osdmap e603: 8 total, 8 up, 8 in 2021-07-26T16:06:56.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:56 smithi096 bash[33981]: cluster 2021-07-26T16:06:56.164713+0000 mon.a (mon.0) 970 : cluster [DBG] osdmap e604: 8 total, 8 up, 8 in 2021-07-26T16:06:57.182 INFO:tasks.rados.rados.0.smithi033.stdout:2702: done (0 left) 2021-07-26T16:06:57.183 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 17 current snap is 272 2021-07-26T16:06:57.183 INFO:tasks.rados.rados.0.smithi033.stdout:2703: seq_num 815 ranges {5332992=458752,5791744=655360,6447104=409600,6856704=139264} 2021-07-26T16:06:57.217 INFO:tasks.rados.rados.0.smithi033.stdout:2703: writing smithi03339061-17 from 5332992 to 5791744 tid 1 2021-07-26T16:06:57.220 INFO:tasks.rados.rados.0.smithi033.stdout:2703: writing smithi03339061-17 from 5791744 to 6447104 tid 2 2021-07-26T16:06:57.223 INFO:tasks.rados.rados.0.smithi033.stdout:2703: writing smithi03339061-17 from 6447104 to 6856704 tid 3 2021-07-26T16:06:57.224 INFO:tasks.rados.rados.0.smithi033.stdout:2703: writing smithi03339061-17 from 6856704 to 6995968 tid 4 2021-07-26T16:06:57.224 INFO:tasks.rados.rados.0.smithi033.stdout:2704: rollback oid 40 current snap is 272 2021-07-26T16:06:57.224 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 40 to 237 2021-07-26T16:06:57.224 INFO:tasks.rados.rados.0.smithi033.stdout:2705: snap_remove snap 268 2021-07-26T16:06:58.187 INFO:tasks.rados.rados.0.smithi033.stdout:2705: done (2 left) 2021-07-26T16:06:58.187 INFO:tasks.rados.rados.0.smithi033.stdout:2706: read oid 29 snap 237 2021-07-26T16:06:58.187 INFO:tasks.rados.rados.0.smithi033.stdout:2706: expect deleted 2021-07-26T16:06:58.187 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 272 2021-07-26T16:06:58.188 INFO:tasks.rados.rados.0.smithi033.stdout:2703: finishing write tid 1 to smithi03339061-17 2021-07-26T16:06:58.188 INFO:tasks.rados.rados.0.smithi033.stdout:2707: seq_num 816 ranges {4349952=475136,4825088=540672,5365760=614400,5980160=49152} 2021-07-26T16:06:58.214 INFO:tasks.rados.rados.0.smithi033.stdout:2707: writing smithi03339061-19 from 4349952 to 4825088 tid 1 2021-07-26T16:06:58.217 INFO:tasks.rados.rados.0.smithi033.stdout:2707: writing smithi03339061-19 from 4825088 to 5365760 tid 2 2021-07-26T16:06:58.221 INFO:tasks.rados.rados.0.smithi033.stdout:2707: writing smithi03339061-19 from 5365760 to 5980160 tid 3 2021-07-26T16:06:58.222 INFO:tasks.rados.rados.0.smithi033.stdout:2707: writing smithi03339061-19 from 5980160 to 6029312 tid 4 2021-07-26T16:06:58.223 INFO:tasks.rados.rados.0.smithi033.stdout:2708: rollback oid 11 current snap is 272 2021-07-26T16:06:58.223 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 11 to 257 2021-07-26T16:06:58.223 INFO:tasks.rados.rados.0.smithi033.stdout:2703: finishing write tid 2 to smithi03339061-17 2021-07-26T16:06:58.223 INFO:tasks.rados.rados.0.smithi033.stdout:2703: finishing write tid 3 to smithi03339061-17 2021-07-26T16:06:58.224 INFO:tasks.rados.rados.0.smithi033.stdout:2703: finishing write tid 4 to smithi03339061-17 2021-07-26T16:06:58.224 INFO:tasks.rados.rados.0.smithi033.stdout:2703: finishing write tid 5 to smithi03339061-17 2021-07-26T16:06:58.224 INFO:tasks.rados.rados.0.smithi033.stdout:2703: finishing write tid 6 to smithi03339061-17 2021-07-26T16:06:58.224 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 899 (ObjNum 815 snap 272 seq_num 815) dirty exists 2021-07-26T16:06:58.225 INFO:tasks.rados.rados.0.smithi033.stdout:2703: left oid 17 (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:06:58.225 INFO:tasks.rados.rados.0.smithi033.stdout:2703: done (4 left) 2021-07-26T16:06:58.225 INFO:tasks.rados.rados.0.smithi033.stdout:2709: rollback oid 46 current snap is 272 2021-07-26T16:06:58.225 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 46 to 241 2021-07-26T16:06:58.225 INFO:tasks.rados.rados.0.smithi033.stdout:2704: finishing rollback tid 0 to smithi03339061-40 2021-07-26T16:06:58.226 INFO:tasks.rados.rados.0.smithi033.stdout:2704: finishing rollback tid 1 to smithi03339061-40 2021-07-26T16:06:58.226 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 901 (ObjNum 2006692368 snap 22002 seq_num 2007558752) dirty dne 2021-07-26T16:06:58.226 INFO:tasks.rados.rados.0.smithi033.stdout:2704: done (4 left) 2021-07-26T16:06:58.226 INFO:tasks.rados.rados.0.smithi033.stdout:2710: snap_create 2021-07-26T16:06:58.227 INFO:tasks.rados.rados.0.smithi033.stdout:2707: finishing write tid 1 to smithi03339061-19 2021-07-26T16:06:58.227 INFO:tasks.rados.rados.0.smithi033.stdout:2707: finishing write tid 2 to smithi03339061-19 2021-07-26T16:06:58.230 INFO:tasks.rados.rados.0.smithi033.stdout:2707: finishing write tid 3 to smithi03339061-19 2021-07-26T16:06:58.231 INFO:tasks.rados.rados.0.smithi033.stdout:2707: finishing write tid 4 to smithi03339061-19 2021-07-26T16:06:58.232 INFO:tasks.rados.rados.0.smithi033.stdout:2707: finishing write tid 5 to smithi03339061-19 2021-07-26T16:06:58.232 INFO:tasks.rados.rados.0.smithi033.stdout:2709: finishing rollback tid 0 to smithi03339061-46 2021-07-26T16:06:58.232 INFO:tasks.rados.rados.0.smithi033.stdout:2709: finishing rollback tid 1 to smithi03339061-46 2021-07-26T16:06:58.233 INFO:tasks.rados.rados.0.smithi033.stdout:2709: finishing rollback tid 2 to smithi03339061-46 2021-07-26T16:06:58.233 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1255 (ObjNum 685 snap 226 seq_num 685) dirty exists 2021-07-26T16:06:58.234 INFO:tasks.rados.rados.0.smithi033.stdout:2707: finishing write tid 6 to smithi03339061-19 2021-07-26T16:06:58.234 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 1253 (ObjNum 816 snap 272 seq_num 816) dirty exists 2021-07-26T16:06:58.234 INFO:tasks.rados.rados.0.smithi033.stdout:2707: left oid 19 (ObjNum 816 snap 272 seq_num 816) 2021-07-26T16:06:58.235 INFO:tasks.rados.rados.0.smithi033.stdout:2708: finishing rollback tid 0 to smithi03339061-11 2021-07-26T16:06:58.235 INFO:tasks.rados.rados.0.smithi033.stdout:2708: finishing rollback tid 1 to smithi03339061-11 2021-07-26T16:06:58.235 INFO:tasks.rados.rados.0.smithi033.stdout:2708: finishing rollback tid 2 to smithi03339061-11 2021-07-26T16:06:58.236 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1300 (ObjNum 774 snap 255 seq_num 774) dirty exists 2021-07-26T16:06:58.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:58 smithi033 bash[41341]: cluster 2021-07-26T16:06:57.138381+0000 mgr.y (mgr.34104) 390 : cluster [DBG] pgmap v725: 25 pgs: 25 active+clean; 449 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 6.2 MiB/s wr, 14 op/s 2021-07-26T16:06:58.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:58 smithi033 bash[41341]: cluster 2021-07-26T16:06:57.179354+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2021-07-26T16:06:58.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:58 smithi033 bash[42377]: cluster 2021-07-26T16:06:57.138381+0000 mgr.y (mgr.34104) 390 : cluster [DBG] pgmap v725: 25 pgs: 25 active+clean; 449 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 6.2 MiB/s wr, 14 op/s 2021-07-26T16:06:58.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:58 smithi033 bash[42377]: cluster 2021-07-26T16:06:57.179354+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2021-07-26T16:06:58.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:58 smithi096 bash[33981]: cluster 2021-07-26T16:06:57.138381+0000 mgr.y (mgr.34104) 390 : cluster [DBG] pgmap v725: 25 pgs: 25 active+clean; 449 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 6.2 MiB/s wr, 14 op/s 2021-07-26T16:06:58.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:58 smithi096 bash[33981]: cluster 2021-07-26T16:06:57.179354+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e605: 8 total, 8 up, 8 in 2021-07-26T16:06:59.208 INFO:tasks.rados.rados.0.smithi033.stdout:2706: done (4 left) 2021-07-26T16:06:59.208 INFO:tasks.rados.rados.0.smithi033.stdout:2707: done (3 left) 2021-07-26T16:06:59.209 INFO:tasks.rados.rados.0.smithi033.stdout:2708: done (2 left) 2021-07-26T16:06:59.209 INFO:tasks.rados.rados.0.smithi033.stdout:2709: done (1 left) 2021-07-26T16:06:59.209 INFO:tasks.rados.rados.0.smithi033.stdout:2710: done (0 left) 2021-07-26T16:06:59.209 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 273 2021-07-26T16:06:59.209 INFO:tasks.rados.rados.0.smithi033.stdout:2711: seq_num 817 ranges {4702208=491520,5193728=417792,5611520=425984,6037504=360448} 2021-07-26T16:06:59.243 INFO:tasks.rados.rados.0.smithi033.stdout:2711: writing smithi03339061-30 from 4702208 to 5193728 tid 1 2021-07-26T16:06:59.246 INFO:tasks.rados.rados.0.smithi033.stdout:2711: writing smithi03339061-30 from 5193728 to 5611520 tid 2 2021-07-26T16:06:59.249 INFO:tasks.rados.rados.0.smithi033.stdout:2711: writing smithi03339061-30 from 5611520 to 6037504 tid 3 2021-07-26T16:06:59.251 INFO:tasks.rados.rados.0.smithi033.stdout:2711: writing smithi03339061-30 from 6037504 to 6397952 tid 4 2021-07-26T16:06:59.251 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 273 2021-07-26T16:06:59.252 INFO:tasks.rados.rados.0.smithi033.stdout:2712: seq_num 818 ranges {0=507904,507904=704512,1212416=499712} 2021-07-26T16:06:59.254 INFO:tasks.rados.rados.0.smithi033.stdout:2712: writing smithi03339061-38 from 0 to 507904 tid 1 2021-07-26T16:06:59.258 INFO:tasks.rados.rados.0.smithi033.stdout:2712: writing smithi03339061-38 from 507904 to 1212416 tid 2 2021-07-26T16:06:59.262 INFO:tasks.rados.rados.0.smithi033.stdout:2712: writing smithi03339061-38 from 1212416 to 1712128 tid 3 2021-07-26T16:06:59.262 INFO:tasks.rados.rados.0.smithi033.stdout:2713: snap_create 2021-07-26T16:06:59.262 INFO:tasks.rados.rados.0.smithi033.stdout:2711: finishing write tid 1 to smithi03339061-30 2021-07-26T16:06:59.263 INFO:tasks.rados.rados.0.smithi033.stdout:2711: finishing write tid 2 to smithi03339061-30 2021-07-26T16:06:59.263 INFO:tasks.rados.rados.0.smithi033.stdout:2712: finishing write tid 1 to smithi03339061-38 2021-07-26T16:06:59.263 INFO:tasks.rados.rados.0.smithi033.stdout:2711: finishing write tid 3 to smithi03339061-30 2021-07-26T16:06:59.265 INFO:tasks.rados.rados.0.smithi033.stdout:2711: finishing write tid 4 to smithi03339061-30 2021-07-26T16:06:59.265 INFO:tasks.rados.rados.0.smithi033.stdout:2712: finishing write tid 2 to smithi03339061-38 2021-07-26T16:06:59.266 INFO:tasks.rados.rados.0.smithi033.stdout:2711: finishing write tid 5 to smithi03339061-30 2021-07-26T16:06:59.266 INFO:tasks.rados.rados.0.smithi033.stdout:2712: finishing write tid 3 to smithi03339061-38 2021-07-26T16:06:59.267 INFO:tasks.rados.rados.0.smithi033.stdout:2712: finishing write tid 4 to smithi03339061-38 2021-07-26T16:06:59.268 INFO:tasks.rados.rados.0.smithi033.stdout:2711: finishing write tid 6 to smithi03339061-30 2021-07-26T16:06:59.269 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 1446 (ObjNum 817 snap 273 seq_num 817) dirty exists 2021-07-26T16:06:59.269 INFO:tasks.rados.rados.0.smithi033.stdout:2711: left oid 30 (ObjNum 817 snap 273 seq_num 817) 2021-07-26T16:06:59.269 INFO:tasks.rados.rados.0.smithi033.stdout:2712: finishing write tid 5 to smithi03339061-38 2021-07-26T16:06:59.269 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 722 (ObjNum 818 snap 273 seq_num 818) dirty exists 2021-07-26T16:06:59.269 INFO:tasks.rados.rados.0.smithi033.stdout:2712: left oid 38 (ObjNum 818 snap 273 seq_num 818) 2021-07-26T16:06:59.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:06:59 smithi033 bash[42377]: cluster 2021-07-26T16:06:58.183056+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2021-07-26T16:06:59.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:06:59 smithi033 bash[41341]: cluster 2021-07-26T16:06:58.183056+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2021-07-26T16:06:59.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:06:59 smithi096 bash[33981]: cluster 2021-07-26T16:06:58.183056+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e606: 8 total, 8 up, 8 in 2021-07-26T16:07:00.215 INFO:tasks.rados.rados.0.smithi033.stdout:2711: done (2 left) 2021-07-26T16:07:00.215 INFO:tasks.rados.rados.0.smithi033.stdout:2712: done (1 left) 2021-07-26T16:07:00.215 INFO:tasks.rados.rados.0.smithi033.stdout:2713: done (0 left) 2021-07-26T16:07:00.216 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 274 2021-07-26T16:07:00.216 INFO:tasks.rados.rados.0.smithi033.stdout:2714: seq_num 819 ranges {11821056=524288,12345344=589824,12935168=614400} 2021-07-26T16:07:00.288 INFO:tasks.rados.rados.0.smithi033.stdout:2714: writing smithi03339061-31 from 11821056 to 12345344 tid 1 2021-07-26T16:07:00.291 INFO:tasks.rados.rados.0.smithi033.stdout:2714: writing smithi03339061-31 from 12345344 to 12935168 tid 2 2021-07-26T16:07:00.295 INFO:tasks.rados.rados.0.smithi033.stdout:2714: writing smithi03339061-31 from 12935168 to 13549568 tid 3 2021-07-26T16:07:00.295 INFO:tasks.rados.rados.0.smithi033.stdout:2715: rmattr oid 35 current snap is 274 2021-07-26T16:07:00.296 INFO:tasks.rados.rados.0.smithi033.stdout:2715: done (1 left) 2021-07-26T16:07:00.296 INFO:tasks.rados.rados.0.smithi033.stdout:2716: read oid 29 snap 260 2021-07-26T16:07:00.296 INFO:tasks.rados.rados.0.smithi033.stdout:2716: expect deleted 2021-07-26T16:07:00.296 INFO:tasks.rados.rados.0.smithi033.stdout:2717: copy_from oid 11 from oid 13 current snap is 274 2021-07-26T16:07:00.297 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 274 2021-07-26T16:07:00.297 INFO:tasks.rados.rados.0.smithi033.stdout:2718: seq_num 820 ranges {1884160=540672,2424832=475136,2899968=598016,3497984=131072} 2021-07-26T16:07:00.309 INFO:tasks.rados.rados.0.smithi033.stdout:2718: writing smithi03339061-46 from 1884160 to 2424832 tid 1 2021-07-26T16:07:00.311 INFO:tasks.rados.rados.0.smithi033.stdout:2718: writing smithi03339061-46 from 2424832 to 2899968 tid 2 2021-07-26T16:07:00.315 INFO:tasks.rados.rados.0.smithi033.stdout:2718: writing smithi03339061-46 from 2899968 to 3497984 tid 3 2021-07-26T16:07:00.316 INFO:tasks.rados.rados.0.smithi033.stdout:2718: writing smithi03339061-46 from 3497984 to 3629056 tid 4 2021-07-26T16:07:00.317 INFO:tasks.rados.rados.0.smithi033.stdout:2719: delete oid 18 current snap is 274 2021-07-26T16:07:00.317 INFO:tasks.rados.rados.0.smithi033.stdout:2714: finishing write tid 1 to smithi03339061-31 2021-07-26T16:07:00.317 INFO:tasks.rados.rados.0.smithi033.stdout:2714: finishing write tid 2 to smithi03339061-31 2021-07-26T16:07:00.318 INFO:tasks.rados.rados.0.smithi033.stdout:2714: finishing write tid 3 to smithi03339061-31 2021-07-26T16:07:00.318 INFO:tasks.rados.rados.0.smithi033.stdout:2714: finishing write tid 4 to smithi03339061-31 2021-07-26T16:07:00.318 INFO:tasks.rados.rados.0.smithi033.stdout:2714: finishing write tid 5 to smithi03339061-31 2021-07-26T16:07:00.318 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1257 (ObjNum 819 snap 274 seq_num 819) dirty exists 2021-07-26T16:07:00.319 INFO:tasks.rados.rados.0.smithi033.stdout:2714: left oid 31 (ObjNum 819 snap 274 seq_num 819) 2021-07-26T16:07:00.319 INFO:tasks.rados.rados.0.smithi033.stdout:2718: finishing write tid 1 to smithi03339061-46 2021-07-26T16:07:00.319 INFO:tasks.rados.rados.0.smithi033.stdout:2718: finishing write tid 2 to smithi03339061-46 2021-07-26T16:07:00.322 INFO:tasks.rados.rados.0.smithi033.stdout:2714: done (4 left) 2021-07-26T16:07:00.322 INFO:tasks.rados.rados.0.smithi033.stdout:2716: done (3 left) 2021-07-26T16:07:00.322 INFO:tasks.rados.rados.0.smithi033.stdout:2719: done (2 left) 2021-07-26T16:07:00.323 INFO:tasks.rados.rados.0.smithi033.stdout:2720: read oid 4 snap -1 2021-07-26T16:07:00.323 INFO:tasks.rados.rados.0.smithi033.stdout:2720: expect (ObjNum 809 snap 268 seq_num 809) 2021-07-26T16:07:00.323 INFO:tasks.rados.rados.0.smithi033.stdout:2721: copy_from oid 34 from oid 48 current snap is 274 2021-07-26T16:07:00.323 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 3 current snap is 274 2021-07-26T16:07:00.324 INFO:tasks.rados.rados.0.smithi033.stdout:2722: seq_num 822 ranges {1916928=573440,2490368=696320,3186688=507904} 2021-07-26T16:07:00.340 INFO:tasks.rados.rados.0.smithi033.stdout:2722: writing smithi03339061-3 from 1916928 to 2490368 tid 1 2021-07-26T16:07:00.344 INFO:tasks.rados.rados.0.smithi033.stdout:2722: writing smithi03339061-3 from 2490368 to 3186688 tid 2 2021-07-26T16:07:00.347 INFO:tasks.rados.rados.0.smithi033.stdout:2722: writing smithi03339061-3 from 3186688 to 3694592 tid 3 2021-07-26T16:07:00.348 INFO:tasks.rados.rados.0.smithi033.stdout:2723: read oid 42 snap -1 2021-07-26T16:07:00.348 INFO:tasks.rados.rados.0.smithi033.stdout:2723: expect deleted 2021-07-26T16:07:00.348 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 274 2021-07-26T16:07:00.348 INFO:tasks.rados.rados.0.smithi033.stdout:2718: finishing write tid 3 to smithi03339061-46 2021-07-26T16:07:00.349 INFO:tasks.rados.rados.0.smithi033.stdout:2724: seq_num 823 ranges {0=589824,589824=573440,1163264=630784} 2021-07-26T16:07:00.351 INFO:tasks.rados.rados.0.smithi033.stdout:2724: writing smithi03339061-25 from 0 to 589824 tid 1 2021-07-26T16:07:00.354 INFO:tasks.rados.rados.0.smithi033.stdout:2724: writing smithi03339061-25 from 589824 to 1163264 tid 2 2021-07-26T16:07:00.359 INFO:tasks.rados.rados.0.smithi033.stdout:2724: writing smithi03339061-25 from 1163264 to 1794048 tid 3 2021-07-26T16:07:00.359 INFO:tasks.rados.rados.0.smithi033.stdout:2725: read oid 29 snap -1 2021-07-26T16:07:00.359 INFO:tasks.rados.rados.0.smithi033.stdout:2725: expect deleted 2021-07-26T16:07:00.360 INFO:tasks.rados.rados.0.smithi033.stdout:2726: copy_from oid 43 from oid 26 current snap is 274 2021-07-26T16:07:00.360 INFO:tasks.rados.rados.0.smithi033.stdout:2718: finishing write tid 4 to smithi03339061-46 2021-07-26T16:07:00.360 INFO:tasks.rados.rados.0.smithi033.stdout:2718: finishing write tid 5 to smithi03339061-46 2021-07-26T16:07:00.360 INFO:tasks.rados.rados.0.smithi033.stdout:2718: finishing write tid 6 to smithi03339061-46 2021-07-26T16:07:00.361 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1260 (ObjNum 820 snap 274 seq_num 820) dirty exists 2021-07-26T16:07:00.361 INFO:tasks.rados.rados.0.smithi033.stdout:2718: left oid 46 (ObjNum 820 snap 274 seq_num 820) 2021-07-26T16:07:00.361 INFO:tasks.rados.rados.0.smithi033.stdout:2718: done (8 left) 2021-07-26T16:07:00.361 INFO:tasks.rados.rados.0.smithi033.stdout:2727: rollback oid 31 current snap is 274 2021-07-26T16:07:00.361 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 31 to 214 2021-07-26T16:07:00.362 INFO:tasks.rados.rados.0.smithi033.stdout:2720: expect (ObjNum 809 snap 268 seq_num 809) 2021-07-26T16:07:00.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:00 smithi033 bash[41341]: cluster 2021-07-26T16:06:59.139155+0000 mgr.y (mgr.34104) 391 : cluster [DBG] pgmap v728: 25 pgs: 25 active+clean; 451 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 8 op/s 2021-07-26T16:07:00.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:00 smithi033 bash[41341]: cluster 2021-07-26T16:06:59.202864+0000 mon.a (mon.0) 973 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2021-07-26T16:07:00.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:00 smithi033 bash[42377]: cluster 2021-07-26T16:06:59.139155+0000 mgr.y (mgr.34104) 391 : cluster [DBG] pgmap v728: 25 pgs: 25 active+clean; 451 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 8 op/s 2021-07-26T16:07:00.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:00 smithi033 bash[42377]: cluster 2021-07-26T16:06:59.202864+0000 mon.a (mon.0) 973 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2021-07-26T16:07:00.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:00 smithi096 bash[33981]: cluster 2021-07-26T16:06:59.139155+0000 mgr.y (mgr.34104) 391 : cluster [DBG] pgmap v728: 25 pgs: 25 active+clean; 451 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 1.7 MiB/s rd, 5.5 MiB/s wr, 8 op/s 2021-07-26T16:07:00.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:00 smithi096 bash[33981]: cluster 2021-07-26T16:06:59.202864+0000 mon.a (mon.0) 973 : cluster [DBG] osdmap e607: 8 total, 8 up, 8 in 2021-07-26T16:07:00.567 INFO:tasks.rados.rados.0.smithi033.stdout:2717: finishing copy_from to smithi03339061-11 2021-07-26T16:07:00.568 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1290 (ObjNum 775 snap 256 seq_num 775) dirty exists 2021-07-26T16:07:00.568 INFO:tasks.rados.rados.0.smithi033.stdout:2717: finishing copy_from racing read to smithi03339061-11 2021-07-26T16:07:00.568 INFO:tasks.rados.rados.0.smithi033.stdout:2722: finishing write tid 1 to smithi03339061-3 2021-07-26T16:07:00.568 INFO:tasks.rados.rados.0.smithi033.stdout:2722: finishing write tid 2 to smithi03339061-3 2021-07-26T16:07:00.569 INFO:tasks.rados.rados.0.smithi033.stdout:2722: finishing write tid 3 to smithi03339061-3 2021-07-26T16:07:00.569 INFO:tasks.rados.rados.0.smithi033.stdout:2724: finishing write tid 1 to smithi03339061-25 2021-07-26T16:07:00.569 INFO:tasks.rados.rados.0.smithi033.stdout:2722: finishing write tid 4 to smithi03339061-3 2021-07-26T16:07:00.569 INFO:tasks.rados.rados.0.smithi033.stdout:2724: finishing write tid 2 to smithi03339061-25 2021-07-26T16:07:00.569 INFO:tasks.rados.rados.0.smithi033.stdout:2721: finishing copy_from to smithi03339061-34 2021-07-26T16:07:00.570 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 897 (ObjNum 733 snap 246 seq_num 733) dirty exists 2021-07-26T16:07:00.570 INFO:tasks.rados.rados.0.smithi033.stdout:2726: finishing copy_from to smithi03339061-43 2021-07-26T16:07:00.570 INFO:tasks.rados.rados.0.smithi033.stdout:2726: got expected ENOENT (src dne) 2021-07-26T16:07:00.570 INFO:tasks.rados.rados.0.smithi033.stdout:2726: finishing copy_from racing read to smithi03339061-43 2021-07-26T16:07:00.571 INFO:tasks.rados.rados.0.smithi033.stdout:2721: finishing copy_from racing read to smithi03339061-34 2021-07-26T16:07:00.571 INFO:tasks.rados.rados.0.smithi033.stdout:2727: finishing rollback tid 0 to smithi03339061-31 2021-07-26T16:07:00.571 INFO:tasks.rados.rados.0.smithi033.stdout:2727: finishing rollback tid 1 to smithi03339061-31 2021-07-26T16:07:00.571 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1259 (ObjNum 1 snap 22002 seq_num 2007781280) dirty dne 2021-07-26T16:07:00.571 INFO:tasks.rados.rados.0.smithi033.stdout:2724: finishing write tid 3 to smithi03339061-25 2021-07-26T16:07:00.572 INFO:tasks.rados.rados.0.smithi033.stdout:2724: finishing write tid 4 to smithi03339061-25 2021-07-26T16:07:00.572 INFO:tasks.rados.rados.0.smithi033.stdout:2722: finishing write tid 5 to smithi03339061-3 2021-07-26T16:07:00.572 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1427 (ObjNum 822 snap 274 seq_num 822) dirty exists 2021-07-26T16:07:00.572 INFO:tasks.rados.rados.0.smithi033.stdout:2722: left oid 3 (ObjNum 822 snap 274 seq_num 822) 2021-07-26T16:07:00.572 INFO:tasks.rados.rados.0.smithi033.stdout:2724: finishing write tid 5 to smithi03339061-25 2021-07-26T16:07:00.573 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 1303 (ObjNum 823 snap 274 seq_num 823) dirty exists 2021-07-26T16:07:00.573 INFO:tasks.rados.rados.0.smithi033.stdout:2724: left oid 25 (ObjNum 823 snap 274 seq_num 823) 2021-07-26T16:07:00.573 INFO:tasks.rados.rados.0.smithi033.stdout:2717: done (8 left) 2021-07-26T16:07:00.573 INFO:tasks.rados.rados.0.smithi033.stdout:2720: done (7 left) 2021-07-26T16:07:00.573 INFO:tasks.rados.rados.0.smithi033.stdout:2721: done (6 left) 2021-07-26T16:07:00.574 INFO:tasks.rados.rados.0.smithi033.stdout:2722: done (5 left) 2021-07-26T16:07:00.574 INFO:tasks.rados.rados.0.smithi033.stdout:2723: done (4 left) 2021-07-26T16:07:00.574 INFO:tasks.rados.rados.0.smithi033.stdout:2724: done (3 left) 2021-07-26T16:07:00.574 INFO:tasks.rados.rados.0.smithi033.stdout:2725: done (2 left) 2021-07-26T16:07:00.575 INFO:tasks.rados.rados.0.smithi033.stdout:2726: done (1 left) 2021-07-26T16:07:00.575 INFO:tasks.rados.rados.0.smithi033.stdout:2727: done (0 left) 2021-07-26T16:07:00.575 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 274 2021-07-26T16:07:00.576 INFO:tasks.rados.rados.0.smithi033.stdout:2728: seq_num 824 ranges {3055616=606208,3661824=458752,4120576=573440,4694016=172032} 2021-07-26T16:07:00.597 INFO:tasks.rados.rados.0.smithi033.stdout:2728: writing smithi03339061-50 from 3055616 to 3661824 tid 1 2021-07-26T16:07:00.599 INFO:tasks.rados.rados.0.smithi033.stdout:2728: writing smithi03339061-50 from 3661824 to 4120576 tid 2 2021-07-26T16:07:00.603 INFO:tasks.rados.rados.0.smithi033.stdout:2728: writing smithi03339061-50 from 4120576 to 4694016 tid 3 2021-07-26T16:07:00.604 INFO:tasks.rados.rados.0.smithi033.stdout:2728: writing smithi03339061-50 from 4694016 to 4866048 tid 4 2021-07-26T16:07:00.604 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 274 2021-07-26T16:07:00.605 INFO:tasks.rados.rados.0.smithi033.stdout:2729: seq_num 825 ranges {1490944=622592,2113536=745472,2859008=458752} 2021-07-26T16:07:00.617 INFO:tasks.rados.rados.0.smithi033.stdout:2729: writing smithi03339061-32 from 1490944 to 2113536 tid 1 2021-07-26T16:07:00.621 INFO:tasks.rados.rados.0.smithi033.stdout:2729: writing smithi03339061-32 from 2113536 to 2859008 tid 2 2021-07-26T16:07:00.625 INFO:tasks.rados.rados.0.smithi033.stdout:2729: writing smithi03339061-32 from 2859008 to 3317760 tid 3 2021-07-26T16:07:00.625 INFO:tasks.rados.rados.0.smithi033.stdout:2730: copy_from oid 14 from oid 7 current snap is 274 2021-07-26T16:07:00.625 INFO:tasks.rados.rados.0.smithi033.stdout:2728: finishing write tid 1 to smithi03339061-50 2021-07-26T16:07:00.625 INFO:tasks.rados.rados.0.smithi033.stdout:2728: finishing write tid 2 to smithi03339061-50 2021-07-26T16:07:00.626 INFO:tasks.rados.rados.0.smithi033.stdout:2728: finishing write tid 3 to smithi03339061-50 2021-07-26T16:07:00.626 INFO:tasks.rados.rados.0.smithi033.stdout:2728: finishing write tid 4 to smithi03339061-50 2021-07-26T16:07:00.626 INFO:tasks.rados.rados.0.smithi033.stdout:2728: finishing write tid 5 to smithi03339061-50 2021-07-26T16:07:00.626 INFO:tasks.rados.rados.0.smithi033.stdout:2728: finishing write tid 6 to smithi03339061-50 2021-07-26T16:07:00.627 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1308 (ObjNum 824 snap 274 seq_num 824) dirty exists 2021-07-26T16:07:00.627 INFO:tasks.rados.rados.0.smithi033.stdout:2728: left oid 50 (ObjNum 824 snap 274 seq_num 824) 2021-07-26T16:07:00.627 INFO:tasks.rados.rados.0.smithi033.stdout:2729: finishing write tid 1 to smithi03339061-32 2021-07-26T16:07:00.627 INFO:tasks.rados.rados.0.smithi033.stdout:2728: done (2 left) 2021-07-26T16:07:00.627 INFO:tasks.rados.rados.0.smithi033.stdout:2731: copy_from oid 6 from oid 2 current snap is 274 2021-07-26T16:07:00.628 INFO:tasks.rados.rados.0.smithi033.stdout:2732: copy_from oid 40 from oid 39 current snap is 274 2021-07-26T16:07:00.628 INFO:tasks.rados.rados.0.smithi033.stdout:2733: read oid 10 snap -1 2021-07-26T16:07:00.628 INFO:tasks.rados.rados.0.smithi033.stdout:2733: expect deleted 2021-07-26T16:07:00.628 INFO:tasks.rados.rados.0.smithi033.stdout:2734: rollback oid 25 current snap is 274 2021-07-26T16:07:00.628 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 25 to 239 2021-07-26T16:07:00.629 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 44 current snap is 274 2021-07-26T16:07:00.629 INFO:tasks.rados.rados.0.smithi033.stdout:2735: seq_num 826 ranges {2359296=638976,2998272=630784,3629056=573440} 2021-07-26T16:07:00.643 INFO:tasks.rados.rados.0.smithi033.stdout:2735: writing smithi03339061-44 from 2359296 to 2998272 tid 1 2021-07-26T16:07:00.647 INFO:tasks.rados.rados.0.smithi033.stdout:2735: writing smithi03339061-44 from 2998272 to 3629056 tid 2 2021-07-26T16:07:00.652 INFO:tasks.rados.rados.0.smithi033.stdout:2735: writing smithi03339061-44 from 3629056 to 4202496 tid 3 2021-07-26T16:07:00.652 INFO:tasks.rados.rados.0.smithi033.stdout:2736: read oid 31 snap -1 2021-07-26T16:07:00.652 INFO:tasks.rados.rados.0.smithi033.stdout:2736: expect deleted 2021-07-26T16:07:00.652 INFO:tasks.rados.rados.0.smithi033.stdout:2737: delete oid 38 current snap is 274 2021-07-26T16:07:00.653 INFO:tasks.rados.rados.0.smithi033.stdout:2729: finishing write tid 2 to smithi03339061-32 2021-07-26T16:07:00.653 INFO:tasks.rados.rados.0.smithi033.stdout:2729: finishing write tid 3 to smithi03339061-32 2021-07-26T16:07:00.653 INFO:tasks.rados.rados.0.smithi033.stdout:2729: finishing write tid 4 to smithi03339061-32 2021-07-26T16:07:00.653 INFO:tasks.rados.rados.0.smithi033.stdout:2734: finishing rollback tid 0 to smithi03339061-25 2021-07-26T16:07:00.653 INFO:tasks.rados.rados.0.smithi033.stdout:2734: finishing rollback tid 1 to smithi03339061-25 2021-07-26T16:07:00.654 INFO:tasks.rados.rados.0.smithi033.stdout:2729: finishing write tid 5 to smithi03339061-32 2021-07-26T16:07:00.654 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1312 (ObjNum 825 snap 274 seq_num 825) dirty exists 2021-07-26T16:07:00.654 INFO:tasks.rados.rados.0.smithi033.stdout:2729: left oid 32 (ObjNum 825 snap 274 seq_num 825) 2021-07-26T16:07:00.654 INFO:tasks.rados.rados.0.smithi033.stdout:2734: finishing rollback tid 2 to smithi03339061-25 2021-07-26T16:07:00.655 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 1315 (ObjNum 682 snap 225 seq_num 682) dirty exists 2021-07-26T16:07:00.655 INFO:tasks.rados.rados.0.smithi033.stdout:2730: finishing copy_from to smithi03339061-14 2021-07-26T16:07:00.655 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1234 (ObjNum 685 snap 226 seq_num 685) dirty exists 2021-07-26T16:07:00.655 INFO:tasks.rados.rados.0.smithi033.stdout:2730: finishing copy_from racing read to smithi03339061-14 2021-07-26T16:07:00.655 INFO:tasks.rados.rados.0.smithi033.stdout:2735: finishing write tid 1 to smithi03339061-44 2021-07-26T16:07:00.657 INFO:tasks.rados.rados.0.smithi033.stdout:2735: finishing write tid 2 to smithi03339061-44 2021-07-26T16:07:00.657 INFO:tasks.rados.rados.0.smithi033.stdout:2735: finishing write tid 3 to smithi03339061-44 2021-07-26T16:07:00.659 INFO:tasks.rados.rados.0.smithi033.stdout:2735: finishing write tid 4 to smithi03339061-44 2021-07-26T16:07:00.660 INFO:tasks.rados.rados.0.smithi033.stdout:2729: done (8 left) 2021-07-26T16:07:00.661 INFO:tasks.rados.rados.0.smithi033.stdout:2730: done (7 left) 2021-07-26T16:07:00.661 INFO:tasks.rados.rados.0.smithi033.stdout:2733: done (6 left) 2021-07-26T16:07:00.661 INFO:tasks.rados.rados.0.smithi033.stdout:2734: done (5 left) 2021-07-26T16:07:00.661 INFO:tasks.rados.rados.0.smithi033.stdout:2736: done (4 left) 2021-07-26T16:07:00.661 INFO:tasks.rados.rados.0.smithi033.stdout:2737: done (3 left) 2021-07-26T16:07:00.662 INFO:tasks.rados.rados.0.smithi033.stdout:2738: rollback oid 5 current snap is 274 2021-07-26T16:07:00.662 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 5 to 266 2021-07-26T16:07:00.662 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 274 2021-07-26T16:07:00.662 INFO:tasks.rados.rados.0.smithi033.stdout:2739: seq_num 828 ranges {1884160=671744,2555904=802816,3358720=401408} 2021-07-26T16:07:00.676 INFO:tasks.rados.rados.0.smithi033.stdout:2739: writing smithi03339061-14 from 1884160 to 2555904 tid 1 2021-07-26T16:07:00.680 INFO:tasks.rados.rados.0.smithi033.stdout:2739: writing smithi03339061-14 from 2555904 to 3358720 tid 2 2021-07-26T16:07:00.684 INFO:tasks.rados.rados.0.smithi033.stdout:2739: writing smithi03339061-14 from 3358720 to 3760128 tid 3 2021-07-26T16:07:00.685 INFO:tasks.rados.rados.0.smithi033.stdout:2740: snap_create 2021-07-26T16:07:00.685 INFO:tasks.rados.rados.0.smithi033.stdout:2735: finishing write tid 5 to smithi03339061-44 2021-07-26T16:07:00.686 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1313 (ObjNum 826 snap 274 seq_num 826) dirty exists 2021-07-26T16:07:00.686 INFO:tasks.rados.rados.0.smithi033.stdout:2735: left oid 44 (ObjNum 826 snap 274 seq_num 826) 2021-07-26T16:07:00.687 INFO:tasks.rados.rados.0.smithi033.stdout:2738: finishing rollback tid 1 to smithi03339061-5 2021-07-26T16:07:00.687 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 895 (ObjNum 1 snap 32561 seq_num 2006209888) dirty dne 2021-07-26T16:07:00.688 INFO:tasks.rados.rados.0.smithi033.stdout:2731: finishing copy_from to smithi03339061-6 2021-07-26T16:07:00.688 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1383 (ObjNum 784 snap 260 seq_num 784) dirty exists 2021-07-26T16:07:00.689 INFO:tasks.rados.rados.0.smithi033.stdout:2731: finishing copy_from racing read to smithi03339061-6 2021-07-26T16:07:00.689 INFO:tasks.rados.rados.0.smithi033.stdout:2732: finishing copy_from to smithi03339061-40 2021-07-26T16:07:00.690 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 1394 (ObjNum 813 snap 268 seq_num 813) dirty exists 2021-07-26T16:07:00.690 INFO:tasks.rados.rados.0.smithi033.stdout:2732: finishing copy_from racing read to smithi03339061-40 2021-07-26T16:07:00.691 INFO:tasks.rados.rados.0.smithi033.stdout:2739: finishing write tid 1 to smithi03339061-14 2021-07-26T16:07:00.693 INFO:tasks.rados.rados.0.smithi033.stdout:2739: finishing write tid 2 to smithi03339061-14 2021-07-26T16:07:00.693 INFO:tasks.rados.rados.0.smithi033.stdout:2739: finishing write tid 3 to smithi03339061-14 2021-07-26T16:07:00.694 INFO:tasks.rados.rados.0.smithi033.stdout:2739: finishing write tid 4 to smithi03339061-14 2021-07-26T16:07:00.694 INFO:tasks.rados.rados.0.smithi033.stdout:2739: finishing write tid 5 to smithi03339061-14 2021-07-26T16:07:00.695 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1317 (ObjNum 828 snap 274 seq_num 828) dirty exists 2021-07-26T16:07:00.695 INFO:tasks.rados.rados.0.smithi033.stdout:2739: left oid 14 (ObjNum 828 snap 274 seq_num 828) 2021-07-26T16:07:01.171 INFO:tasks.rados.rados.0.smithi033.stdout:2731: done (5 left) 2021-07-26T16:07:01.172 INFO:tasks.rados.rados.0.smithi033.stdout:2732: done (4 left) 2021-07-26T16:07:01.172 INFO:tasks.rados.rados.0.smithi033.stdout:2735: done (3 left) 2021-07-26T16:07:01.172 INFO:tasks.rados.rados.0.smithi033.stdout:2738: done (2 left) 2021-07-26T16:07:01.172 INFO:tasks.rados.rados.0.smithi033.stdout:2739: done (1 left) 2021-07-26T16:07:01.173 INFO:tasks.rados.rados.0.smithi033.stdout:2740: done (0 left) 2021-07-26T16:07:01.173 INFO:tasks.rados.rados.0.smithi033.stdout:2741: rmattr oid 32 current snap is 275 2021-07-26T16:07:01.173 INFO:tasks.rados.rados.0.smithi033.stdout:2741: done (0 left) 2021-07-26T16:07:01.173 INFO:tasks.rados.rados.0.smithi033.stdout:2742: rollback oid 8 current snap is 275 2021-07-26T16:07:01.173 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 8 to 271 2021-07-26T16:07:01.174 INFO:tasks.rados.rados.0.smithi033.stdout:2743: copy_from oid 6 from oid 50 current snap is 275 2021-07-26T16:07:01.174 INFO:tasks.rados.rados.0.smithi033.stdout:2744: read oid 38 snap 267 2021-07-26T16:07:01.174 INFO:tasks.rados.rados.0.smithi033.stdout:2744: expect deleted 2021-07-26T16:07:01.174 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 275 2021-07-26T16:07:01.175 INFO:tasks.rados.rados.0.smithi033.stdout:2745: seq_num 829 ranges {3760128=688128,4448256=729088,5177344=475136} 2021-07-26T16:07:01.197 INFO:tasks.rados.rados.0.smithi033.stdout:2745: writing smithi03339061-14 from 3760128 to 4448256 tid 1 2021-07-26T16:07:01.201 INFO:tasks.rados.rados.0.smithi033.stdout:2745: writing smithi03339061-14 from 4448256 to 5177344 tid 2 2021-07-26T16:07:01.205 INFO:tasks.rados.rados.0.smithi033.stdout:2745: writing smithi03339061-14 from 5177344 to 5652480 tid 3 2021-07-26T16:07:01.205 INFO:tasks.rados.rados.0.smithi033.stdout:2746: delete oid 39 current snap is 275 2021-07-26T16:07:01.205 INFO:tasks.rados.rados.0.smithi033.stdout:2742: finishing rollback tid 1 to smithi03339061-8 2021-07-26T16:07:01.205 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1247 (ObjNum 2006764736 snap 22002 seq_num 738199760) dirty dne 2021-07-26T16:07:01.207 INFO:tasks.rados.rados.0.smithi033.stdout:2745: finishing write tid 1 to smithi03339061-14 2021-07-26T16:07:01.208 INFO:tasks.rados.rados.0.smithi033.stdout:2743: finishing copy_from to smithi03339061-6 2021-07-26T16:07:01.208 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1308 (ObjNum 824 snap 274 seq_num 824) dirty exists 2021-07-26T16:07:01.209 INFO:tasks.rados.rados.0.smithi033.stdout:2743: finishing copy_from racing read to smithi03339061-6 2021-07-26T16:07:01.210 INFO:tasks.rados.rados.0.smithi033.stdout:2745: finishing write tid 2 to smithi03339061-14 2021-07-26T16:07:01.211 INFO:tasks.rados.rados.0.smithi033.stdout:2745: finishing write tid 3 to smithi03339061-14 2021-07-26T16:07:01.212 INFO:tasks.rados.rados.0.smithi033.stdout:2742: done (4 left) 2021-07-26T16:07:01.212 INFO:tasks.rados.rados.0.smithi033.stdout:2743: done (3 left) 2021-07-26T16:07:01.212 INFO:tasks.rados.rados.0.smithi033.stdout:2744: done (2 left) 2021-07-26T16:07:01.213 INFO:tasks.rados.rados.0.smithi033.stdout:2746: done (1 left) 2021-07-26T16:07:01.213 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 275 2021-07-26T16:07:01.213 INFO:tasks.rados.rados.0.smithi033.stdout:2747: seq_num 831 ranges {0=720896,720896=499712,1220608=704512} 2021-07-26T16:07:01.216 INFO:tasks.rados.rados.0.smithi033.stdout:2747: writing smithi03339061-31 from 0 to 720896 tid 1 2021-07-26T16:07:01.219 INFO:tasks.rados.rados.0.smithi033.stdout:2747: writing smithi03339061-31 from 720896 to 1220608 tid 2 2021-07-26T16:07:01.224 INFO:tasks.rados.rados.0.smithi033.stdout:2747: writing smithi03339061-31 from 1220608 to 1925120 tid 3 2021-07-26T16:07:01.224 INFO:tasks.rados.rados.0.smithi033.stdout:2748: snap_create 2021-07-26T16:07:01.224 INFO:tasks.rados.rados.0.smithi033.stdout:2745: finishing write tid 4 to smithi03339061-14 2021-07-26T16:07:01.225 INFO:tasks.rados.rados.0.smithi033.stdout:2745: finishing write tid 5 to smithi03339061-14 2021-07-26T16:07:01.225 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1321 (ObjNum 829 snap 275 seq_num 829) dirty exists 2021-07-26T16:07:01.225 INFO:tasks.rados.rados.0.smithi033.stdout:2745: left oid 14 (ObjNum 829 snap 275 seq_num 829) 2021-07-26T16:07:01.225 INFO:tasks.rados.rados.0.smithi033.stdout:2747: finishing write tid 1 to smithi03339061-31 2021-07-26T16:07:01.227 INFO:tasks.rados.rados.0.smithi033.stdout:2747: finishing write tid 2 to smithi03339061-31 2021-07-26T16:07:01.228 INFO:tasks.rados.rados.0.smithi033.stdout:2747: finishing write tid 3 to smithi03339061-31 2021-07-26T16:07:01.228 INFO:tasks.rados.rados.0.smithi033.stdout:2747: finishing write tid 4 to smithi03339061-31 2021-07-26T16:07:01.231 INFO:tasks.rados.rados.0.smithi033.stdout:2747: finishing write tid 5 to smithi03339061-31 2021-07-26T16:07:01.232 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1263 (ObjNum 831 snap 275 seq_num 831) dirty exists 2021-07-26T16:07:01.232 INFO:tasks.rados.rados.0.smithi033.stdout:2747: left oid 31 (ObjNum 831 snap 275 seq_num 831) 2021-07-26T16:07:01.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:01 smithi096 bash[33981]: cluster 2021-07-26T16:07:00.212707+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2021-07-26T16:07:01.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:01 smithi096 bash[33981]: cluster 2021-07-26T16:07:01.167200+0000 mon.a (mon.0) 975 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2021-07-26T16:07:01.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:01 smithi033 bash[41341]: cluster 2021-07-26T16:07:00.212707+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2021-07-26T16:07:01.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:01 smithi033 bash[41341]: cluster 2021-07-26T16:07:01.167200+0000 mon.a (mon.0) 975 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2021-07-26T16:07:01.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:01 smithi033 bash[42377]: cluster 2021-07-26T16:07:00.212707+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e608: 8 total, 8 up, 8 in 2021-07-26T16:07:01.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:01 smithi033 bash[42377]: cluster 2021-07-26T16:07:01.167200+0000 mon.a (mon.0) 975 : cluster [DBG] osdmap e609: 8 total, 8 up, 8 in 2021-07-26T16:07:02.227 INFO:tasks.rados.rados.0.smithi033.stdout:2745: done (2 left) 2021-07-26T16:07:02.227 INFO:tasks.rados.rados.0.smithi033.stdout:2747: done (1 left) 2021-07-26T16:07:02.227 INFO:tasks.rados.rados.0.smithi033.stdout:2748: done (0 left) 2021-07-26T16:07:02.228 INFO:tasks.rados.rados.0.smithi033.stdout:2749: copy_from oid 40 from oid 20 current snap is 276 2021-07-26T16:07:02.228 INFO:tasks.rados.rados.0.smithi033.stdout:2750: rmattr oid 46 current snap is 276 2021-07-26T16:07:02.228 INFO:tasks.rados.rados.0.smithi033.stdout:2750: done (1 left) 2021-07-26T16:07:02.228 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 276 2021-07-26T16:07:02.229 INFO:tasks.rados.rados.0.smithi033.stdout:2751: seq_num 832 ranges {3244032=737280,3981312=786432,4767744=417792} 2021-07-26T16:07:02.252 INFO:tasks.rados.rados.0.smithi033.stdout:2751: writing smithi03339061-48 from 3244032 to 3981312 tid 1 2021-07-26T16:07:02.256 INFO:tasks.rados.rados.0.smithi033.stdout:2751: writing smithi03339061-48 from 3981312 to 4767744 tid 2 2021-07-26T16:07:02.259 INFO:tasks.rados.rados.0.smithi033.stdout:2751: writing smithi03339061-48 from 4767744 to 5185536 tid 3 2021-07-26T16:07:02.259 INFO:tasks.rados.rados.0.smithi033.stdout:2752: snap_create 2021-07-26T16:07:02.260 INFO:tasks.rados.rados.0.smithi033.stdout:2749: finishing copy_from to smithi03339061-40 2021-07-26T16:07:02.260 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 1287 (ObjNum 773 snap 255 seq_num 773) dirty exists 2021-07-26T16:07:02.260 INFO:tasks.rados.rados.0.smithi033.stdout:2749: finishing copy_from racing read to smithi03339061-40 2021-07-26T16:07:02.261 INFO:tasks.rados.rados.0.smithi033.stdout:2751: finishing write tid 1 to smithi03339061-48 2021-07-26T16:07:02.263 INFO:tasks.rados.rados.0.smithi033.stdout:2751: finishing write tid 2 to smithi03339061-48 2021-07-26T16:07:02.266 INFO:tasks.rados.rados.0.smithi033.stdout:2751: finishing write tid 3 to smithi03339061-48 2021-07-26T16:07:02.267 INFO:tasks.rados.rados.0.smithi033.stdout:2751: finishing write tid 4 to smithi03339061-48 2021-07-26T16:07:02.267 INFO:tasks.rados.rados.0.smithi033.stdout:2751: finishing write tid 5 to smithi03339061-48 2021-07-26T16:07:02.267 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 1250 (ObjNum 832 snap 276 seq_num 832) dirty exists 2021-07-26T16:07:02.268 INFO:tasks.rados.rados.0.smithi033.stdout:2751: left oid 48 (ObjNum 832 snap 276 seq_num 832) 2021-07-26T16:07:02.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:02 smithi096 bash[33981]: cluster 2021-07-26T16:07:01.139977+0000 mgr.y (mgr.34104) 392 : cluster [DBG] pgmap v731: 25 pgs: 25 active+clean; 463 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 7 op/s 2021-07-26T16:07:02.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:02 smithi033 bash[41341]: cluster 2021-07-26T16:07:01.139977+0000 mgr.y (mgr.34104) 392 : cluster [DBG] pgmap v731: 25 pgs: 25 active+clean; 463 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 7 op/s 2021-07-26T16:07:02.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:02 smithi033 bash[42377]: cluster 2021-07-26T16:07:01.139977+0000 mgr.y (mgr.34104) 392 : cluster [DBG] pgmap v731: 25 pgs: 25 active+clean; 463 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 7 op/s 2021-07-26T16:07:03.251 INFO:tasks.rados.rados.0.smithi033.stdout:2749: done (2 left) 2021-07-26T16:07:03.251 INFO:tasks.rados.rados.0.smithi033.stdout:2751: done (1 left) 2021-07-26T16:07:03.251 INFO:tasks.rados.rados.0.smithi033.stdout:2752: done (0 left) 2021-07-26T16:07:03.252 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 277 2021-07-26T16:07:03.252 INFO:tasks.rados.rados.0.smithi033.stdout:2753: seq_num 833 ranges {0=761856,761856=671744,1433600=532480} 2021-07-26T16:07:03.256 INFO:tasks.rados.rados.0.smithi033.stdout:2753: writing smithi03339061-39 from 0 to 761856 tid 1 2021-07-26T16:07:03.263 INFO:tasks.rados.rados.0.smithi033.stdout:2753: writing smithi03339061-39 from 761856 to 1433600 tid 2 2021-07-26T16:07:03.266 INFO:tasks.rados.rados.0.smithi033.stdout:2753: writing smithi03339061-39 from 1433600 to 1966080 tid 3 2021-07-26T16:07:03.267 INFO:tasks.rados.rados.0.smithi033.stdout:2754: read oid 17 snap -1 2021-07-26T16:07:03.267 INFO:tasks.rados.rados.0.smithi033.stdout:2754: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:07:03.267 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 277 2021-07-26T16:07:03.267 INFO:tasks.rados.rados.0.smithi033.stdout:2755: seq_num 834 ranges {0=778240,778240=557056,1335296=548864,1884160=98304} 2021-07-26T16:07:03.270 INFO:tasks.rados.rados.0.smithi033.stdout:2755: writing smithi03339061-29 from 0 to 778240 tid 1 2021-07-26T16:07:03.274 INFO:tasks.rados.rados.0.smithi033.stdout:2755: writing smithi03339061-29 from 778240 to 1335296 tid 2 2021-07-26T16:07:03.277 INFO:tasks.rados.rados.0.smithi033.stdout:2755: writing smithi03339061-29 from 1335296 to 1884160 tid 3 2021-07-26T16:07:03.279 INFO:tasks.rados.rados.0.smithi033.stdout:2755: writing smithi03339061-29 from 1884160 to 1982464 tid 4 2021-07-26T16:07:03.279 INFO:tasks.rados.rados.0.smithi033.stdout:2756: read oid 34 snap -1 2021-07-26T16:07:03.279 INFO:tasks.rados.rados.0.smithi033.stdout:2756: expect (ObjNum 733 snap 246 seq_num 733) 2021-07-26T16:07:03.280 INFO:tasks.rados.rados.0.smithi033.stdout:2757: rollback oid 8 current snap is 277 2021-07-26T16:07:03.280 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 8 to 250 2021-07-26T16:07:03.280 INFO:tasks.rados.rados.0.smithi033.stdout:2753: finishing write tid 1 to smithi03339061-39 2021-07-26T16:07:03.280 INFO:tasks.rados.rados.0.smithi033.stdout:2753: finishing write tid 2 to smithi03339061-39 2021-07-26T16:07:03.281 INFO:tasks.rados.rados.0.smithi033.stdout:2753: finishing write tid 3 to smithi03339061-39 2021-07-26T16:07:03.281 INFO:tasks.rados.rados.0.smithi033.stdout:2758: read oid 46 snap -1 2021-07-26T16:07:03.281 INFO:tasks.rados.rados.0.smithi033.stdout:2758: expect (ObjNum 820 snap 274 seq_num 820) 2021-07-26T16:07:03.281 INFO:tasks.rados.rados.0.smithi033.stdout:2759: rollback oid 41 current snap is 277 2021-07-26T16:07:03.281 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 41 to 260 2021-07-26T16:07:03.282 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 277 2021-07-26T16:07:03.282 INFO:tasks.rados.rados.0.smithi033.stdout:2760: seq_num 835 ranges {1785856=794624,2580480=442368,3022848=712704,3735552=49152} 2021-07-26T16:07:03.294 INFO:tasks.rados.rados.0.smithi033.stdout:2760: writing smithi03339061-20 from 1785856 to 2580480 tid 1 2021-07-26T16:07:03.297 INFO:tasks.rados.rados.0.smithi033.stdout:2760: writing smithi03339061-20 from 2580480 to 3022848 tid 2 2021-07-26T16:07:03.302 INFO:tasks.rados.rados.0.smithi033.stdout:2760: writing smithi03339061-20 from 3022848 to 3735552 tid 3 2021-07-26T16:07:03.302 INFO:tasks.rados.rados.0.smithi033.stdout:2760: writing smithi03339061-20 from 3735552 to 3784704 tid 4 2021-07-26T16:07:03.303 INFO:tasks.rados.rados.0.smithi033.stdout:2761: snap_remove snap 257 2021-07-26T16:07:03.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:03 smithi096 bash[33981]: cluster 2021-07-26T16:07:02.223021+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2021-07-26T16:07:03.519 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:03 smithi033 bash[41341]: cluster 2021-07-26T16:07:02.223021+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2021-07-26T16:07:03.520 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:03 smithi033 bash[42377]: cluster 2021-07-26T16:07:02.223021+0000 mon.a (mon.0) 976 : cluster [DBG] osdmap e610: 8 total, 8 up, 8 in 2021-07-26T16:07:03.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:07:03 smithi033 bash[50539]: level=error ts=2021-07-26T16:07:03.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:07:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:07:03 smithi033 bash[50539]: level=error ts=2021-07-26T16:07:03.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:07:03.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:07:03 smithi033 bash[50539]: level=error ts=2021-07-26T16:07:03.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:07:04.266 INFO:tasks.rados.rados.0.smithi033.stdout:2761: done (8 left) 2021-07-26T16:07:04.267 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 277 2021-07-26T16:07:04.267 INFO:tasks.rados.rados.0.smithi033.stdout:2762: seq_num 836 ranges {483328=409600,892928=720896,1613824=516096,2129920=368640} 2021-07-26T16:07:04.268 INFO:tasks.rados.rados.0.smithi033.stdout:2762: writing smithi03339061-9 from 483328 to 892928 tid 1 2021-07-26T16:07:04.274 INFO:tasks.rados.rados.0.smithi033.stdout:2762: writing smithi03339061-9 from 892928 to 1613824 tid 2 2021-07-26T16:07:04.278 INFO:tasks.rados.rados.0.smithi033.stdout:2762: writing smithi03339061-9 from 1613824 to 2129920 tid 3 2021-07-26T16:07:04.281 INFO:tasks.rados.rados.0.smithi033.stdout:2762: writing smithi03339061-9 from 2129920 to 2498560 tid 4 2021-07-26T16:07:04.282 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 277 2021-07-26T16:07:04.282 INFO:tasks.rados.rados.0.smithi033.stdout:2753: finishing write tid 4 to smithi03339061-39 2021-07-26T16:07:04.282 INFO:tasks.rados.rados.0.smithi033.stdout:2753: finishing write tid 5 to smithi03339061-39 2021-07-26T16:07:04.282 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1399 (ObjNum 833 snap 277 seq_num 833) dirty exists 2021-07-26T16:07:04.283 INFO:tasks.rados.rados.0.smithi033.stdout:2753: left oid 39 (ObjNum 833 snap 277 seq_num 833) 2021-07-26T16:07:04.283 INFO:tasks.rados.rados.0.smithi033.stdout:2757: finishing rollback tid 1 to smithi03339061-8 2021-07-26T16:07:04.283 INFO:tasks.rados.rados.0.smithi033.stdout:2759: finishing rollback tid 0 to smithi03339061-41 2021-07-26T16:07:04.283 INFO:tasks.rados.rados.0.smithi033.stdout:2757: finishing rollback tid 2 to smithi03339061-8 2021-07-26T16:07:04.284 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1255 (ObjNum 723 snap 242 seq_num 723) dirty exists 2021-07-26T16:07:04.284 INFO:tasks.rados.rados.0.smithi033.stdout:2759: finishing rollback tid 1 to smithi03339061-41 2021-07-26T16:07:04.284 INFO:tasks.rados.rados.0.smithi033.stdout:2759: finishing rollback tid 2 to smithi03339061-41 2021-07-26T16:07:04.284 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1253 (ObjNum 767 snap 254 seq_num 767) dirty exists 2021-07-26T16:07:04.284 INFO:tasks.rados.rados.0.smithi033.stdout:2755: finishing write tid 1 to smithi03339061-29 2021-07-26T16:07:04.285 INFO:tasks.rados.rados.0.smithi033.stdout:2760: finishing write tid 1 to smithi03339061-20 2021-07-26T16:07:04.285 INFO:tasks.rados.rados.0.smithi033.stdout:2760: finishing write tid 2 to smithi03339061-20 2021-07-26T16:07:04.285 INFO:tasks.rados.rados.0.smithi033.stdout:2760: finishing write tid 3 to smithi03339061-20 2021-07-26T16:07:04.285 INFO:tasks.rados.rados.0.smithi033.stdout:2760: finishing write tid 4 to smithi03339061-20 2021-07-26T16:07:04.285 INFO:tasks.rados.rados.0.smithi033.stdout:2760: finishing write tid 5 to smithi03339061-20 2021-07-26T16:07:04.286 INFO:tasks.rados.rados.0.smithi033.stdout:2756: expect (ObjNum 733 snap 246 seq_num 733) 2021-07-26T16:07:04.441 INFO:tasks.rados.rados.0.smithi033.stdout:2760: finishing write tid 6 to smithi03339061-20 2021-07-26T16:07:04.441 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1326 (ObjNum 835 snap 277 seq_num 835) dirty exists 2021-07-26T16:07:04.441 INFO:tasks.rados.rados.0.smithi033.stdout:2760: left oid 20 (ObjNum 835 snap 277 seq_num 835) 2021-07-26T16:07:04.442 INFO:tasks.rados.rados.0.smithi033.stdout:2755: finishing write tid 2 to smithi03339061-29 2021-07-26T16:07:04.442 INFO:tasks.rados.rados.0.smithi033.stdout:2755: finishing write tid 3 to smithi03339061-29 2021-07-26T16:07:04.442 INFO:tasks.rados.rados.0.smithi033.stdout:2755: finishing write tid 4 to smithi03339061-29 2021-07-26T16:07:04.442 INFO:tasks.rados.rados.0.smithi033.stdout:2755: finishing write tid 5 to smithi03339061-29 2021-07-26T16:07:04.443 INFO:tasks.rados.rados.0.smithi033.stdout:2754: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:07:04.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:04 smithi033 bash[41341]: cluster 2021-07-26T16:07:03.140697+0000 mgr.y (mgr.34104) 393 : cluster [DBG] pgmap v734: 25 pgs: 25 active+clean; 482 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 7.3 MiB/s wr, 15 op/s 2021-07-26T16:07:04.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:04 smithi033 bash[41341]: cluster 2021-07-26T16:07:03.248857+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2021-07-26T16:07:04.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:04 smithi033 bash[42377]: cluster 2021-07-26T16:07:03.140697+0000 mgr.y (mgr.34104) 393 : cluster [DBG] pgmap v734: 25 pgs: 25 active+clean; 482 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 7.3 MiB/s wr, 15 op/s 2021-07-26T16:07:04.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:04 smithi033 bash[42377]: cluster 2021-07-26T16:07:03.248857+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2021-07-26T16:07:04.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:04 smithi096 bash[33981]: cluster 2021-07-26T16:07:03.140697+0000 mgr.y (mgr.34104) 393 : cluster [DBG] pgmap v734: 25 pgs: 25 active+clean; 482 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 2.0 KiB/s rd, 7.3 MiB/s wr, 15 op/s 2021-07-26T16:07:04.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:04 smithi096 bash[33981]: cluster 2021-07-26T16:07:03.248857+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e611: 8 total, 8 up, 8 in 2021-07-26T16:07:04.944 INFO:tasks.rados.rados.0.smithi033.stdout:2758: expect (ObjNum 820 snap 274 seq_num 820) 2021-07-26T16:07:05.068 INFO:tasks.rados.rados.0.smithi033.stdout:2755: finishing write tid 6 to smithi03339061-29 2021-07-26T16:07:05.068 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1265 (ObjNum 834 snap 277 seq_num 834) dirty exists 2021-07-26T16:07:05.069 INFO:tasks.rados.rados.0.smithi033.stdout:2755: left oid 29 (ObjNum 834 snap 277 seq_num 834) 2021-07-26T16:07:05.069 INFO:tasks.rados.rados.0.smithi033.stdout:2762: finishing write tid 1 to smithi03339061-9 2021-07-26T16:07:05.069 INFO:tasks.rados.rados.0.smithi033.stdout:2762: finishing write tid 2 to smithi03339061-9 2021-07-26T16:07:05.069 INFO:tasks.rados.rados.0.smithi033.stdout:2762: finishing write tid 3 to smithi03339061-9 2021-07-26T16:07:05.069 INFO:tasks.rados.rados.0.smithi033.stdout:2762: finishing write tid 4 to smithi03339061-9 2021-07-26T16:07:05.070 INFO:tasks.rados.rados.0.smithi033.stdout:2762: finishing write tid 5 to smithi03339061-9 2021-07-26T16:07:05.070 INFO:tasks.rados.rados.0.smithi033.stdout:2762: finishing write tid 6 to smithi03339061-9 2021-07-26T16:07:05.070 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 1260 (ObjNum 836 snap 277 seq_num 836) dirty exists 2021-07-26T16:07:05.070 INFO:tasks.rados.rados.0.smithi033.stdout:2762: left oid 9 (ObjNum 836 snap 277 seq_num 836) 2021-07-26T16:07:05.071 INFO:tasks.rados.rados.0.smithi033.stdout:2763: seq_num 837 ranges {4874240=425984,5300224=655360,5955584=729088,6684672=221184} 2021-07-26T16:07:05.106 INFO:tasks.rados.rados.0.smithi033.stdout:2763: writing smithi03339061-4 from 4874240 to 5300224 tid 1 2021-07-26T16:07:05.110 INFO:tasks.rados.rados.0.smithi033.stdout:2763: writing smithi03339061-4 from 5300224 to 5955584 tid 2 2021-07-26T16:07:05.114 INFO:tasks.rados.rados.0.smithi033.stdout:2763: writing smithi03339061-4 from 5955584 to 6684672 tid 3 2021-07-26T16:07:05.116 INFO:tasks.rados.rados.0.smithi033.stdout:2763: writing smithi03339061-4 from 6684672 to 6905856 tid 4 2021-07-26T16:07:05.116 INFO:tasks.rados.rados.0.smithi033.stdout:2753: done (9 left) 2021-07-26T16:07:05.116 INFO:tasks.rados.rados.0.smithi033.stdout:2754: done (8 left) 2021-07-26T16:07:05.117 INFO:tasks.rados.rados.0.smithi033.stdout:2755: done (7 left) 2021-07-26T16:07:05.117 INFO:tasks.rados.rados.0.smithi033.stdout:2756: done (6 left) 2021-07-26T16:07:05.117 INFO:tasks.rados.rados.0.smithi033.stdout:2757: done (5 left) 2021-07-26T16:07:05.117 INFO:tasks.rados.rados.0.smithi033.stdout:2758: done (4 left) 2021-07-26T16:07:05.117 INFO:tasks.rados.rados.0.smithi033.stdout:2759: done (3 left) 2021-07-26T16:07:05.118 INFO:tasks.rados.rados.0.smithi033.stdout:2760: done (2 left) 2021-07-26T16:07:05.118 INFO:tasks.rados.rados.0.smithi033.stdout:2762: done (1 left) 2021-07-26T16:07:05.118 INFO:tasks.rados.rados.0.smithi033.stdout:2764: setattr oid 16 current snap is 277 2021-07-26T16:07:05.118 INFO:tasks.rados.rados.0.smithi033.stdout:2763: finishing write tid 1 to smithi03339061-4 2021-07-26T16:07:05.119 INFO:tasks.rados.rados.0.smithi033.stdout:2765: snap_remove snap 269 2021-07-26T16:07:05.275 INFO:tasks.rados.rados.0.smithi033.stdout:2765: done (2 left) 2021-07-26T16:07:05.276 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 37 current snap is 277 2021-07-26T16:07:05.276 INFO:tasks.rados.rados.0.smithi033.stdout:2763: finishing write tid 2 to smithi03339061-4 2021-07-26T16:07:05.276 INFO:tasks.rados.rados.0.smithi033.stdout:2766: seq_num 838 ranges {1884160=442368,2326528=540672,2867200=532480,3399680=442368,3842048=90112} 2021-07-26T16:07:05.288 INFO:tasks.rados.rados.0.smithi033.stdout:2766: writing smithi03339061-37 from 1884160 to 2326528 tid 1 2021-07-26T16:07:05.292 INFO:tasks.rados.rados.0.smithi033.stdout:2766: writing smithi03339061-37 from 2326528 to 2867200 tid 2 2021-07-26T16:07:05.295 INFO:tasks.rados.rados.0.smithi033.stdout:2766: writing smithi03339061-37 from 2867200 to 3399680 tid 3 2021-07-26T16:07:05.298 INFO:tasks.rados.rados.0.smithi033.stdout:2766: writing smithi03339061-37 from 3399680 to 3842048 tid 4 2021-07-26T16:07:05.299 INFO:tasks.rados.rados.0.smithi033.stdout:2766: writing smithi03339061-37 from 3842048 to 3932160 tid 5 2021-07-26T16:07:05.300 INFO:tasks.rados.rados.0.smithi033.stdout:2767: read oid 10 snap -1 2021-07-26T16:07:05.300 INFO:tasks.rados.rados.0.smithi033.stdout:2767: expect deleted 2021-07-26T16:07:05.300 INFO:tasks.rados.rados.0.smithi033.stdout:2768: setattr oid 42 current snap is 277 2021-07-26T16:07:05.300 INFO:tasks.rados.rados.0.smithi033.stdout:2763: finishing write tid 3 to smithi03339061-4 2021-07-26T16:07:05.301 INFO:tasks.rados.rados.0.smithi033.stdout:2763: finishing write tid 4 to smithi03339061-4 2021-07-26T16:07:05.301 INFO:tasks.rados.rados.0.smithi033.stdout:2763: finishing write tid 5 to smithi03339061-4 2021-07-26T16:07:05.301 INFO:tasks.rados.rados.0.smithi033.stdout:2763: finishing write tid 6 to smithi03339061-4 2021-07-26T16:07:05.301 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1331 (ObjNum 837 snap 277 seq_num 837) dirty exists 2021-07-26T16:07:05.301 INFO:tasks.rados.rados.0.smithi033.stdout:2763: left oid 4 (ObjNum 837 snap 277 seq_num 837) 2021-07-26T16:07:05.302 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1316 (ObjNum 795 snap 266 seq_num 795) dirty exists 2021-07-26T16:07:05.302 INFO:tasks.rados.rados.0.smithi033.stdout:2766: finishing write tid 1 to smithi03339061-37 2021-07-26T16:07:05.302 INFO:tasks.rados.rados.0.smithi033.stdout:2766: finishing write tid 2 to smithi03339061-37 2021-07-26T16:07:05.304 INFO:tasks.rados.rados.0.smithi033.stdout:2763: done (4 left) 2021-07-26T16:07:05.304 INFO:tasks.rados.rados.0.smithi033.stdout:2764: done (3 left) 2021-07-26T16:07:05.304 INFO:tasks.rados.rados.0.smithi033.stdout:2769: setattr oid 49 current snap is 277 2021-07-26T16:07:05.304 INFO:tasks.rados.rados.0.smithi033.stdout:2766: finishing write tid 3 to smithi03339061-37 2021-07-26T16:07:05.304 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 277 2021-07-26T16:07:05.305 INFO:tasks.rados.rados.0.smithi033.stdout:2770: seq_num 839 ranges {2736128=458752,3194880=425984,3620864=688128,4308992=491520} 2021-07-26T16:07:05.319 INFO:tasks.rados.rados.0.smithi033.stdout:2770: writing smithi03339061-41 from 2736128 to 3194880 tid 1 2021-07-26T16:07:05.321 INFO:tasks.rados.rados.0.smithi033.stdout:2770: writing smithi03339061-41 from 3194880 to 3620864 tid 2 2021-07-26T16:07:05.325 INFO:tasks.rados.rados.0.smithi033.stdout:2770: writing smithi03339061-41 from 3620864 to 4308992 tid 3 2021-07-26T16:07:05.328 INFO:tasks.rados.rados.0.smithi033.stdout:2770: writing smithi03339061-41 from 4308992 to 4800512 tid 4 2021-07-26T16:07:05.329 INFO:tasks.rados.rados.0.smithi033.stdout:2771: delete oid 46 current snap is 277 2021-07-26T16:07:05.329 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1428 (ObjNum 1 snap 32561 seq_num 2007951424) dirty exists 2021-07-26T16:07:05.329 INFO:tasks.rados.rados.0.smithi033.stdout:2766: finishing write tid 4 to smithi03339061-37 2021-07-26T16:07:05.329 INFO:tasks.rados.rados.0.smithi033.stdout:2766: finishing write tid 5 to smithi03339061-37 2021-07-26T16:07:05.329 INFO:tasks.rados.rados.0.smithi033.stdout:2766: finishing write tid 6 to smithi03339061-37 2021-07-26T16:07:05.330 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 916 (ObjNum 811 snap 268 seq_num 811) dirty exists 2021-07-26T16:07:05.330 INFO:tasks.rados.rados.0.smithi033.stdout:2766: finishing write tid 7 to smithi03339061-37 2021-07-26T16:07:05.330 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 1452 (ObjNum 838 snap 277 seq_num 838) dirty exists 2021-07-26T16:07:05.330 INFO:tasks.rados.rados.0.smithi033.stdout:2766: left oid 37 (ObjNum 838 snap 277 seq_num 838) 2021-07-26T16:07:05.331 INFO:tasks.rados.rados.0.smithi033.stdout:2770: finishing write tid 1 to smithi03339061-41 2021-07-26T16:07:05.331 INFO:tasks.rados.rados.0.smithi033.stdout:2770: finishing write tid 2 to smithi03339061-41 2021-07-26T16:07:05.333 INFO:tasks.rados.rados.0.smithi033.stdout:2766: done (5 left) 2021-07-26T16:07:05.333 INFO:tasks.rados.rados.0.smithi033.stdout:2767: done (4 left) 2021-07-26T16:07:05.334 INFO:tasks.rados.rados.0.smithi033.stdout:2768: done (3 left) 2021-07-26T16:07:05.334 INFO:tasks.rados.rados.0.smithi033.stdout:2769: done (2 left) 2021-07-26T16:07:05.334 INFO:tasks.rados.rados.0.smithi033.stdout:2771: done (1 left) 2021-07-26T16:07:05.334 INFO:tasks.rados.rados.0.smithi033.stdout:2772: rollback oid 27 current snap is 277 2021-07-26T16:07:05.335 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 27 to 272 2021-07-26T16:07:05.335 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 277 2021-07-26T16:07:05.335 INFO:tasks.rados.rados.0.smithi033.stdout:2773: seq_num 841 ranges {0=491520,491520=598016,1089536=704512,1794048=303104} 2021-07-26T16:07:05.336 INFO:tasks.rados.rados.0.smithi033.stdout:2773: writing smithi03339061-26 from 0 to 491520 tid 1 2021-07-26T16:07:05.340 INFO:tasks.rados.rados.0.smithi033.stdout:2773: writing smithi03339061-26 from 491520 to 1089536 tid 2 2021-07-26T16:07:05.344 INFO:tasks.rados.rados.0.smithi033.stdout:2773: writing smithi03339061-26 from 1089536 to 1794048 tid 3 2021-07-26T16:07:05.347 INFO:tasks.rados.rados.0.smithi033.stdout:2773: writing smithi03339061-26 from 1794048 to 2097152 tid 4 2021-07-26T16:07:05.347 INFO:tasks.rados.rados.0.smithi033.stdout:2774: read oid 8 snap -1 2021-07-26T16:07:05.347 INFO:tasks.rados.rados.0.smithi033.stdout:2774: expect (ObjNum 723 snap 242 seq_num 723) 2021-07-26T16:07:05.348 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 34 current snap is 277 2021-07-26T16:07:05.348 INFO:tasks.rados.rados.0.smithi033.stdout:2770: finishing write tid 3 to smithi03339061-41 2021-07-26T16:07:05.348 INFO:tasks.rados.rados.0.smithi033.stdout:2775: seq_num 842 ranges {3244032=507904,3751936=475136,4227072=516096,4743168=499712,5242880=114688} 2021-07-26T16:07:05.368 INFO:tasks.rados.rados.0.smithi033.stdout:2775: writing smithi03339061-34 from 3244032 to 3751936 tid 1 2021-07-26T16:07:05.370 INFO:tasks.rados.rados.0.smithi033.stdout:2775: writing smithi03339061-34 from 3751936 to 4227072 tid 2 2021-07-26T16:07:05.373 INFO:tasks.rados.rados.0.smithi033.stdout:2775: writing smithi03339061-34 from 4227072 to 4743168 tid 3 2021-07-26T16:07:05.376 INFO:tasks.rados.rados.0.smithi033.stdout:2775: writing smithi03339061-34 from 4743168 to 5242880 tid 4 2021-07-26T16:07:05.377 INFO:tasks.rados.rados.0.smithi033.stdout:2775: writing smithi03339061-34 from 5242880 to 5357568 tid 5 2021-07-26T16:07:05.377 INFO:tasks.rados.rados.0.smithi033.stdout:2776: snap_remove snap 267 2021-07-26T16:07:05.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:05 smithi033 bash[41341]: cluster 2021-07-26T16:07:04.258475+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2021-07-26T16:07:05.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:05 smithi033 bash[42377]: cluster 2021-07-26T16:07:04.258475+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2021-07-26T16:07:05.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:05 smithi096 bash[33981]: cluster 2021-07-26T16:07:04.258475+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e612: 8 total, 8 up, 8 in 2021-07-26T16:07:06.173 INFO:tasks.rados.rados.0.smithi033.stdout:2776: done (5 left) 2021-07-26T16:07:06.173 INFO:tasks.rados.rados.0.smithi033.stdout:2777: read oid 12 snap -1 2021-07-26T16:07:06.173 INFO:tasks.rados.rados.0.smithi033.stdout:2777: expect (ObjNum 807 snap 268 seq_num 807) 2021-07-26T16:07:06.174 INFO:tasks.rados.rados.0.smithi033.stdout:2778: read oid 45 snap -1 2021-07-26T16:07:06.174 INFO:tasks.rados.rados.0.smithi033.stdout:2778: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:06.174 INFO:tasks.rados.rados.0.smithi033.stdout:2770: finishing write tid 4 to smithi03339061-41 2021-07-26T16:07:06.174 INFO:tasks.rados.rados.0.smithi033.stdout:2770: finishing write tid 5 to smithi03339061-41 2021-07-26T16:07:06.174 INFO:tasks.rados.rados.0.smithi033.stdout:2770: finishing write tid 6 to smithi03339061-41 2021-07-26T16:07:06.175 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1258 (ObjNum 839 snap 277 seq_num 839) dirty exists 2021-07-26T16:07:06.175 INFO:tasks.rados.rados.0.smithi033.stdout:2770: left oid 41 (ObjNum 839 snap 277 seq_num 839) 2021-07-26T16:07:06.175 INFO:tasks.rados.rados.0.smithi033.stdout:2773: finishing write tid 1 to smithi03339061-26 2021-07-26T16:07:06.175 INFO:tasks.rados.rados.0.smithi033.stdout:2772: finishing rollback tid 0 to smithi03339061-27 2021-07-26T16:07:06.176 INFO:tasks.rados.rados.0.smithi033.stdout:2772: finishing rollback tid 1 to smithi03339061-27 2021-07-26T16:07:06.176 INFO:tasks.rados.rados.0.smithi033.stdout:2772: finishing rollback tid 2 to smithi03339061-27 2021-07-26T16:07:06.176 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1402 (ObjNum 806 snap 268 seq_num 806) dirty exists 2021-07-26T16:07:06.176 INFO:tasks.rados.rados.0.smithi033.stdout:2773: finishing write tid 2 to smithi03339061-26 2021-07-26T16:07:06.176 INFO:tasks.rados.rados.0.smithi033.stdout:2774: expect (ObjNum 723 snap 242 seq_num 723) 2021-07-26T16:07:06.297 INFO:tasks.rados.rados.0.smithi033.stdout:2773: finishing write tid 3 to smithi03339061-26 2021-07-26T16:07:06.298 INFO:tasks.rados.rados.0.smithi033.stdout:2773: finishing write tid 4 to smithi03339061-26 2021-07-26T16:07:06.298 INFO:tasks.rados.rados.0.smithi033.stdout:2773: finishing write tid 5 to smithi03339061-26 2021-07-26T16:07:06.298 INFO:tasks.rados.rados.0.smithi033.stdout:2773: finishing write tid 6 to smithi03339061-26 2021-07-26T16:07:06.298 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 1668 (ObjNum 841 snap 277 seq_num 841) dirty exists 2021-07-26T16:07:06.298 INFO:tasks.rados.rados.0.smithi033.stdout:2773: left oid 26 (ObjNum 841 snap 277 seq_num 841) 2021-07-26T16:07:06.299 INFO:tasks.rados.rados.0.smithi033.stdout:2775: finishing write tid 1 to smithi03339061-34 2021-07-26T16:07:06.299 INFO:tasks.rados.rados.0.smithi033.stdout:2775: finishing write tid 2 to smithi03339061-34 2021-07-26T16:07:06.299 INFO:tasks.rados.rados.0.smithi033.stdout:2775: finishing write tid 3 to smithi03339061-34 2021-07-26T16:07:06.299 INFO:tasks.rados.rados.0.smithi033.stdout:2775: finishing write tid 4 to smithi03339061-34 2021-07-26T16:07:06.300 INFO:tasks.rados.rados.0.smithi033.stdout:2775: finishing write tid 5 to smithi03339061-34 2021-07-26T16:07:06.300 INFO:tasks.rados.rados.0.smithi033.stdout:2770: done (6 left) 2021-07-26T16:07:06.300 INFO:tasks.rados.rados.0.smithi033.stdout:2772: done (5 left) 2021-07-26T16:07:06.300 INFO:tasks.rados.rados.0.smithi033.stdout:2773: done (4 left) 2021-07-26T16:07:06.300 INFO:tasks.rados.rados.0.smithi033.stdout:2774: done (3 left) 2021-07-26T16:07:06.301 INFO:tasks.rados.rados.0.smithi033.stdout:2779: snap_create 2021-07-26T16:07:06.302 INFO:tasks.rados.rados.0.smithi033.stdout:2775: finishing write tid 6 to smithi03339061-34 2021-07-26T16:07:06.302 INFO:tasks.rados.rados.0.smithi033.stdout:2775: finishing write tid 7 to smithi03339061-34 2021-07-26T16:07:06.302 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1306 (ObjNum 842 snap 277 seq_num 842) dirty exists 2021-07-26T16:07:06.302 INFO:tasks.rados.rados.0.smithi033.stdout:2775: left oid 34 (ObjNum 842 snap 277 seq_num 842) 2021-07-26T16:07:06.303 INFO:tasks.rados.rados.0.smithi033.stdout:2778: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:06.358 INFO:tasks.rados.rados.0.smithi033.stdout:2777: expect (ObjNum 807 snap 268 seq_num 807) 2021-07-26T16:07:06.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:06 smithi033 bash[41341]: cluster 2021-07-26T16:07:05.141353+0000 mgr.y (mgr.34104) 394 : cluster [DBG] pgmap v737: 25 pgs: 25 active+clean; 498 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 4.9 MiB/s rd, 9.2 MiB/s wr, 21 op/s 2021-07-26T16:07:06.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:06 smithi033 bash[41341]: cluster 2021-07-26T16:07:05.272337+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e613: 8 total, 8 up, 8 in 2021-07-26T16:07:06.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:06 smithi033 bash[41341]: cluster 2021-07-26T16:07:06.169234+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e614: 8 total, 8 up, 8 in 2021-07-26T16:07:06.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:06 smithi033 bash[42377]: cluster 2021-07-26T16:07:05.141353+0000 mgr.y (mgr.34104) 394 : cluster [DBG] pgmap v737: 25 pgs: 25 active+clean; 498 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 4.9 MiB/s rd, 9.2 MiB/s wr, 21 op/s 2021-07-26T16:07:06.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:06 smithi033 bash[42377]: cluster 2021-07-26T16:07:05.272337+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e613: 8 total, 8 up, 8 in 2021-07-26T16:07:06.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:06 smithi033 bash[42377]: cluster 2021-07-26T16:07:06.169234+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e614: 8 total, 8 up, 8 in 2021-07-26T16:07:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:06 smithi096 bash[33981]: cluster 2021-07-26T16:07:05.141353+0000 mgr.y (mgr.34104) 394 : cluster [DBG] pgmap v737: 25 pgs: 25 active+clean; 498 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 4.9 MiB/s rd, 9.2 MiB/s wr, 21 op/s 2021-07-26T16:07:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:06 smithi096 bash[33981]: cluster 2021-07-26T16:07:05.272337+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e613: 8 total, 8 up, 8 in 2021-07-26T16:07:06.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:06 smithi096 bash[33981]: cluster 2021-07-26T16:07:06.169234+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e614: 8 total, 8 up, 8 in 2021-07-26T16:07:07.279 INFO:tasks.rados.rados.0.smithi033.stdout:2775: done (3 left) 2021-07-26T16:07:07.279 INFO:tasks.rados.rados.0.smithi033.stdout:2777: done (2 left) 2021-07-26T16:07:07.279 INFO:tasks.rados.rados.0.smithi033.stdout:2778: done (1 left) 2021-07-26T16:07:07.280 INFO:tasks.rados.rados.0.smithi033.stdout:2779: done (0 left) 2021-07-26T16:07:07.280 INFO:tasks.rados.rados.0.smithi033.stdout:2780: read oid 43 snap -1 2021-07-26T16:07:07.280 INFO:tasks.rados.rados.0.smithi033.stdout:2780: expect (ObjNum 783 snap 260 seq_num 783) 2021-07-26T16:07:07.280 INFO:tasks.rados.rados.0.smithi033.stdout:2781: setattr oid 35 current snap is 278 2021-07-26T16:07:07.281 INFO:tasks.rados.rados.0.smithi033.stdout:2782: rmattr oid 6 current snap is 278 2021-07-26T16:07:07.282 INFO:tasks.rados.rados.0.smithi033.stdout:2783: read oid 29 snap 231 2021-07-26T16:07:07.282 INFO:tasks.rados.rados.0.smithi033.stdout:2783: expect deleted 2021-07-26T16:07:07.282 INFO:tasks.rados.rados.0.smithi033.stdout:2784: read oid 8 snap -1 2021-07-26T16:07:07.282 INFO:tasks.rados.rados.0.smithi033.stdout:2784: expect (ObjNum 723 snap 242 seq_num 723) 2021-07-26T16:07:07.283 INFO:tasks.rados.rados.0.smithi033.stdout:2785: snap_remove snap 273 2021-07-26T16:07:08.290 INFO:tasks.rados.rados.0.smithi033.stdout:2785: done (5 left) 2021-07-26T16:07:08.291 INFO:tasks.rados.rados.0.smithi033.stdout:2786: setattr oid 34 current snap is 278 2021-07-26T16:07:08.291 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1674 (ObjNum 824 snap 274 seq_num 824) dirty exists 2021-07-26T16:07:08.292 INFO:tasks.rados.rados.0.smithi033.stdout:2784: expect (ObjNum 723 snap 242 seq_num 723) 2021-07-26T16:07:08.411 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1261 (ObjNum 0 snap 32561 seq_num 2006910816) dirty exists 2021-07-26T16:07:08.411 INFO:tasks.rados.rados.0.smithi033.stdout:2780: expect (ObjNum 783 snap 260 seq_num 783) 2021-07-26T16:07:08.650 INFO:tasks.rados.rados.0.smithi033.stdout:2780: done (5 left) 2021-07-26T16:07:08.650 INFO:tasks.rados.rados.0.smithi033.stdout:2781: done (4 left) 2021-07-26T16:07:08.651 INFO:tasks.rados.rados.0.smithi033.stdout:2782: done (3 left) 2021-07-26T16:07:08.651 INFO:tasks.rados.rados.0.smithi033.stdout:2783: done (2 left) 2021-07-26T16:07:08.651 INFO:tasks.rados.rados.0.smithi033.stdout:2784: done (1 left) 2021-07-26T16:07:08.651 INFO:tasks.rados.rados.0.smithi033.stdout:2787: snap_create 2021-07-26T16:07:08.657 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1307 (ObjNum 842 snap 277 seq_num 842) dirty exists 2021-07-26T16:07:08.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:08 smithi033 bash[41341]: cluster 2021-07-26T16:07:07.142007+0000 mgr.y (mgr.34104) 395 : cluster [DBG] pgmap v740: 25 pgs: 25 active+clean; 515 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 8.0 MiB/s wr, 37 op/s 2021-07-26T16:07:08.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:08 smithi033 bash[41341]: cluster 2021-07-26T16:07:07.275364+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e615: 8 total, 8 up, 8 in 2021-07-26T16:07:08.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:08 smithi033 bash[42377]: cluster 2021-07-26T16:07:07.142007+0000 mgr.y (mgr.34104) 395 : cluster [DBG] pgmap v740: 25 pgs: 25 active+clean; 515 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 8.0 MiB/s wr, 37 op/s 2021-07-26T16:07:08.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:08 smithi033 bash[42377]: cluster 2021-07-26T16:07:07.275364+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e615: 8 total, 8 up, 8 in 2021-07-26T16:07:08.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:08 smithi096 bash[33981]: cluster 2021-07-26T16:07:07.142007+0000 mgr.y (mgr.34104) 395 : cluster [DBG] pgmap v740: 25 pgs: 25 active+clean; 515 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 8.0 MiB/s wr, 37 op/s 2021-07-26T16:07:08.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:08 smithi096 bash[33981]: cluster 2021-07-26T16:07:07.275364+0000 mon.a (mon.0) 981 : cluster [DBG] osdmap e615: 8 total, 8 up, 8 in 2021-07-26T16:07:09.299 INFO:tasks.rados.rados.0.smithi033.stdout:2786: done (1 left) 2021-07-26T16:07:09.299 INFO:tasks.rados.rados.0.smithi033.stdout:2787: done (0 left) 2021-07-26T16:07:09.299 INFO:tasks.rados.rados.0.smithi033.stdout:2788: copy_from oid 34 from oid 8 current snap is 279 2021-07-26T16:07:09.299 INFO:tasks.rados.rados.0.smithi033.stdout:2789: snap_create 2021-07-26T16:07:09.325 INFO:tasks.rados.rados.0.smithi033.stdout:2788: finishing copy_from to smithi03339061-34 2021-07-26T16:07:09.326 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1255 (ObjNum 723 snap 242 seq_num 723) dirty exists 2021-07-26T16:07:09.327 INFO:tasks.rados.rados.0.smithi033.stdout:2788: finishing copy_from racing read to smithi03339061-34 2021-07-26T16:07:09.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:09 smithi033 bash[42377]: cluster 2021-07-26T16:07:08.286614+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e616: 8 total, 8 up, 8 in 2021-07-26T16:07:09.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:09 smithi033 bash[42377]: audit 2021-07-26T16:07:09.241615+0000 mon.c (mon.1) 256 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:07:09.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:09 smithi033 bash[42377]: audit 2021-07-26T16:07:09.242345+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:07:09.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:09 smithi033 bash[42377]: audit 2021-07-26T16:07:09.254805+0000 mon.c (mon.1) 257 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:07:09.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:09 smithi033 bash[42377]: audit 2021-07-26T16:07:09.255564+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:07:09.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:09 smithi033 bash[41341]: cluster 2021-07-26T16:07:08.286614+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e616: 8 total, 8 up, 8 in 2021-07-26T16:07:09.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:09 smithi033 bash[41341]: audit 2021-07-26T16:07:09.241615+0000 mon.c (mon.1) 256 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:07:09.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:09 smithi033 bash[41341]: audit 2021-07-26T16:07:09.242345+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:07:09.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:09 smithi033 bash[41341]: audit 2021-07-26T16:07:09.254805+0000 mon.c (mon.1) 257 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:07:09.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:09 smithi033 bash[41341]: audit 2021-07-26T16:07:09.255564+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:07:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:09 smithi096 bash[33981]: cluster 2021-07-26T16:07:08.286614+0000 mon.a (mon.0) 982 : cluster [DBG] osdmap e616: 8 total, 8 up, 8 in 2021-07-26T16:07:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:09 smithi096 bash[33981]: audit 2021-07-26T16:07:09.241615+0000 mon.c (mon.1) 256 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:07:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:09 smithi096 bash[33981]: audit 2021-07-26T16:07:09.242345+0000 mon.a (mon.0) 983 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:07:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:09 smithi096 bash[33981]: audit 2021-07-26T16:07:09.254805+0000 mon.c (mon.1) 257 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:07:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:09 smithi096 bash[33981]: audit 2021-07-26T16:07:09.255564+0000 mon.a (mon.0) 984 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:07:10.305 INFO:tasks.rados.rados.0.smithi033.stdout:2788: done (1 left) 2021-07-26T16:07:10.305 INFO:tasks.rados.rados.0.smithi033.stdout:2789: done (0 left) 2021-07-26T16:07:10.305 INFO:tasks.rados.rados.0.smithi033.stdout:2790: read oid 38 snap 266 2021-07-26T16:07:10.306 INFO:tasks.rados.rados.0.smithi033.stdout:2790: expect deleted 2021-07-26T16:07:10.306 INFO:tasks.rados.rados.0.smithi033.stdout:2791: delete oid 20 current snap is 280 2021-07-26T16:07:10.309 INFO:tasks.rados.rados.0.smithi033.stdout:2791: done (1 left) 2021-07-26T16:07:10.310 INFO:tasks.rados.rados.0.smithi033.stdout:2792: snap_create 2021-07-26T16:07:10.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:10 smithi033 bash[42377]: cluster 2021-07-26T16:07:09.142660+0000 mgr.y (mgr.34104) 396 : cluster [DBG] pgmap v743: 25 pgs: 25 active+clean; 521 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 5.1 MiB/s wr, 37 op/s 2021-07-26T16:07:10.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:10 smithi033 bash[42377]: cluster 2021-07-26T16:07:09.296244+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e617: 8 total, 8 up, 8 in 2021-07-26T16:07:10.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:10 smithi033 bash[41341]: cluster 2021-07-26T16:07:09.142660+0000 mgr.y (mgr.34104) 396 : cluster [DBG] pgmap v743: 25 pgs: 25 active+clean; 521 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 5.1 MiB/s wr, 37 op/s 2021-07-26T16:07:10.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:10 smithi033 bash[41341]: cluster 2021-07-26T16:07:09.296244+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e617: 8 total, 8 up, 8 in 2021-07-26T16:07:10.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:10 smithi096 bash[33981]: cluster 2021-07-26T16:07:09.142660+0000 mgr.y (mgr.34104) 396 : cluster [DBG] pgmap v743: 25 pgs: 25 active+clean; 521 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 5.1 MiB/s wr, 37 op/s 2021-07-26T16:07:10.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:10 smithi096 bash[33981]: cluster 2021-07-26T16:07:09.296244+0000 mon.a (mon.0) 985 : cluster [DBG] osdmap e617: 8 total, 8 up, 8 in 2021-07-26T16:07:11.329 INFO:tasks.rados.rados.0.smithi033.stdout:2790: done (1 left) 2021-07-26T16:07:11.329 INFO:tasks.rados.rados.0.smithi033.stdout:2792: done (0 left) 2021-07-26T16:07:11.329 INFO:tasks.rados.rados.0.smithi033.stdout:2793: rollback oid 31 current snap is 281 2021-07-26T16:07:11.330 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 31 to 239 2021-07-26T16:07:11.330 INFO:tasks.rados.rados.0.smithi033.stdout:2794: read oid 45 snap -1 2021-07-26T16:07:11.330 INFO:tasks.rados.rados.0.smithi033.stdout:2794: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:11.330 INFO:tasks.rados.rados.0.smithi033.stdout:2795: read oid 1 snap -1 2021-07-26T16:07:11.330 INFO:tasks.rados.rados.0.smithi033.stdout:2795: expect (ObjNum 754 snap 251 seq_num 754) 2021-07-26T16:07:11.331 INFO:tasks.rados.rados.0.smithi033.stdout:2796: copy_from oid 6 from oid 17 current snap is 281 2021-07-26T16:07:11.331 INFO:tasks.rados.rados.0.smithi033.stdout:2797: snap_remove snap 270 2021-07-26T16:07:11.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:11 smithi033 bash[42377]: cluster 2021-07-26T16:07:10.299226+0000 mon.a (mon.0) 986 : cluster [DBG] osdmap e618: 8 total, 8 up, 8 in 2021-07-26T16:07:11.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:11 smithi033 bash[41341]: cluster 2021-07-26T16:07:10.299226+0000 mon.a (mon.0) 986 : cluster [DBG] osdmap e618: 8 total, 8 up, 8 in 2021-07-26T16:07:11.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:11 smithi096 bash[33981]: cluster 2021-07-26T16:07:10.299226+0000 mon.a (mon.0) 986 : cluster [DBG] osdmap e618: 8 total, 8 up, 8 in 2021-07-26T16:07:12.335 INFO:tasks.rados.rados.0.smithi033.stdout:2797: done (4 left) 2021-07-26T16:07:12.335 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 281 2021-07-26T16:07:12.335 INFO:tasks.rados.rados.0.smithi033.stdout:2798: seq_num 844 ranges {5185536=540672,5726208=696320,6422528=475136,6897664=434176} 2021-07-26T16:07:12.370 INFO:tasks.rados.rados.0.smithi033.stdout:2798: writing smithi03339061-48 from 5185536 to 5726208 tid 1 2021-07-26T16:07:12.374 INFO:tasks.rados.rados.0.smithi033.stdout:2798: writing smithi03339061-48 from 5726208 to 6422528 tid 2 2021-07-26T16:07:12.376 INFO:tasks.rados.rados.0.smithi033.stdout:2798: writing smithi03339061-48 from 6422528 to 6897664 tid 3 2021-07-26T16:07:12.379 INFO:tasks.rados.rados.0.smithi033.stdout:2798: writing smithi03339061-48 from 6897664 to 7331840 tid 4 2021-07-26T16:07:12.379 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 281 2021-07-26T16:07:12.379 INFO:tasks.rados.rados.0.smithi033.stdout:2799: seq_num 845 ranges {4800512=557056,5357568=581632,5939200=688128,6627328=335872} 2021-07-26T16:07:12.409 INFO:tasks.rados.rados.0.smithi033.stdout:2799: writing smithi03339061-41 from 4800512 to 5357568 tid 1 2021-07-26T16:07:12.412 INFO:tasks.rados.rados.0.smithi033.stdout:2799: writing smithi03339061-41 from 5357568 to 5939200 tid 2 2021-07-26T16:07:12.416 INFO:tasks.rados.rados.0.smithi033.stdout:2799: writing smithi03339061-41 from 5939200 to 6627328 tid 3 2021-07-26T16:07:12.418 INFO:tasks.rados.rados.0.smithi033.stdout:2799: writing smithi03339061-41 from 6627328 to 6963200 tid 4 2021-07-26T16:07:12.419 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 281 2021-07-26T16:07:12.419 INFO:tasks.rados.rados.0.smithi033.stdout:2800: seq_num 846 ranges {0=573440,573440=466944,1040384=491520,1531904=548864,2080768=98304} 2021-07-26T16:07:12.421 INFO:tasks.rados.rados.0.smithi033.stdout:2800: writing smithi03339061-10 from 0 to 573440 tid 1 2021-07-26T16:07:12.424 INFO:tasks.rados.rados.0.smithi033.stdout:2800: writing smithi03339061-10 from 573440 to 1040384 tid 2 2021-07-26T16:07:12.427 INFO:tasks.rados.rados.0.smithi033.stdout:2800: writing smithi03339061-10 from 1040384 to 1531904 tid 3 2021-07-26T16:07:12.430 INFO:tasks.rados.rados.0.smithi033.stdout:2800: writing smithi03339061-10 from 1531904 to 2080768 tid 4 2021-07-26T16:07:12.431 INFO:tasks.rados.rados.0.smithi033.stdout:2800: writing smithi03339061-10 from 2080768 to 2179072 tid 5 2021-07-26T16:07:12.432 INFO:tasks.rados.rados.0.smithi033.stdout:2801: delete oid 18 current snap is 281 2021-07-26T16:07:12.432 INFO:tasks.rados.rados.0.smithi033.stdout:2793: finishing rollback tid 0 to smithi03339061-31 2021-07-26T16:07:12.432 INFO:tasks.rados.rados.0.smithi033.stdout:2794: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:12.497 INFO:tasks.rados.rados.0.smithi033.stdout:2793: finishing rollback tid 1 to smithi03339061-31 2021-07-26T16:07:12.498 INFO:tasks.rados.rados.0.smithi033.stdout:2795: expect (ObjNum 754 snap 251 seq_num 754) 2021-07-26T16:07:12.540 INFO:tasks.rados.rados.0.smithi033.stdout:2793: finishing rollback tid 2 to smithi03339061-31 2021-07-26T16:07:12.541 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1266 (ObjNum 701 snap 233 seq_num 701) dirty exists 2021-07-26T16:07:12.541 INFO:tasks.rados.rados.0.smithi033.stdout:2796: finishing copy_from to smithi03339061-6 2021-07-26T16:07:12.541 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 899 (ObjNum 815 snap 272 seq_num 815) dirty exists 2021-07-26T16:07:12.541 INFO:tasks.rados.rados.0.smithi033.stdout:2796: finishing copy_from racing read to smithi03339061-6 2021-07-26T16:07:12.542 INFO:tasks.rados.rados.0.smithi033.stdout:2798: finishing write tid 1 to smithi03339061-48 2021-07-26T16:07:12.542 INFO:tasks.rados.rados.0.smithi033.stdout:2798: finishing write tid 2 to smithi03339061-48 2021-07-26T16:07:12.542 INFO:tasks.rados.rados.0.smithi033.stdout:2798: finishing write tid 3 to smithi03339061-48 2021-07-26T16:07:12.542 INFO:tasks.rados.rados.0.smithi033.stdout:2798: finishing write tid 4 to smithi03339061-48 2021-07-26T16:07:12.543 INFO:tasks.rados.rados.0.smithi033.stdout:2798: finishing write tid 5 to smithi03339061-48 2021-07-26T16:07:12.543 INFO:tasks.rados.rados.0.smithi033.stdout:2798: finishing write tid 6 to smithi03339061-48 2021-07-26T16:07:12.543 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 1263 (ObjNum 844 snap 281 seq_num 844) dirty exists 2021-07-26T16:07:12.543 INFO:tasks.rados.rados.0.smithi033.stdout:2798: left oid 48 (ObjNum 844 snap 281 seq_num 844) 2021-07-26T16:07:12.543 INFO:tasks.rados.rados.0.smithi033.stdout:2799: finishing write tid 1 to smithi03339061-41 2021-07-26T16:07:12.544 INFO:tasks.rados.rados.0.smithi033.stdout:2799: finishing write tid 2 to smithi03339061-41 2021-07-26T16:07:12.544 INFO:tasks.rados.rados.0.smithi033.stdout:2793: done (7 left) 2021-07-26T16:07:12.544 INFO:tasks.rados.rados.0.smithi033.stdout:2794: done (6 left) 2021-07-26T16:07:12.544 INFO:tasks.rados.rados.0.smithi033.stdout:2795: done (5 left) 2021-07-26T16:07:12.545 INFO:tasks.rados.rados.0.smithi033.stdout:2796: done (4 left) 2021-07-26T16:07:12.545 INFO:tasks.rados.rados.0.smithi033.stdout:2798: done (3 left) 2021-07-26T16:07:12.545 INFO:tasks.rados.rados.0.smithi033.stdout:2801: done (2 left) 2021-07-26T16:07:12.545 INFO:tasks.rados.rados.0.smithi033.stdout:2802: snap_create 2021-07-26T16:07:12.545 INFO:tasks.rados.rados.0.smithi033.stdout:2799: finishing write tid 3 to smithi03339061-41 2021-07-26T16:07:12.546 INFO:tasks.rados.rados.0.smithi033.stdout:2799: finishing write tid 4 to smithi03339061-41 2021-07-26T16:07:12.546 INFO:tasks.rados.rados.0.smithi033.stdout:2799: finishing write tid 5 to smithi03339061-41 2021-07-26T16:07:12.546 INFO:tasks.rados.rados.0.smithi033.stdout:2799: finishing write tid 6 to smithi03339061-41 2021-07-26T16:07:12.546 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1268 (ObjNum 845 snap 281 seq_num 845) dirty exists 2021-07-26T16:07:12.546 INFO:tasks.rados.rados.0.smithi033.stdout:2799: left oid 41 (ObjNum 845 snap 281 seq_num 845) 2021-07-26T16:07:12.547 INFO:tasks.rados.rados.0.smithi033.stdout:2800: finishing write tid 1 to smithi03339061-10 2021-07-26T16:07:12.547 INFO:tasks.rados.rados.0.smithi033.stdout:2800: finishing write tid 2 to smithi03339061-10 2021-07-26T16:07:12.547 INFO:tasks.rados.rados.0.smithi033.stdout:2800: finishing write tid 3 to smithi03339061-10 2021-07-26T16:07:12.547 INFO:tasks.rados.rados.0.smithi033.stdout:2800: finishing write tid 4 to smithi03339061-10 2021-07-26T16:07:12.547 INFO:tasks.rados.rados.0.smithi033.stdout:2800: finishing write tid 5 to smithi03339061-10 2021-07-26T16:07:12.548 INFO:tasks.rados.rados.0.smithi033.stdout:2800: finishing write tid 6 to smithi03339061-10 2021-07-26T16:07:12.548 INFO:tasks.rados.rados.0.smithi033.stdout:2800: finishing write tid 7 to smithi03339061-10 2021-07-26T16:07:12.548 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1458 (ObjNum 846 snap 281 seq_num 846) dirty exists 2021-07-26T16:07:12.548 INFO:tasks.rados.rados.0.smithi033.stdout:2800: left oid 10 (ObjNum 846 snap 281 seq_num 846) 2021-07-26T16:07:12.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:12 smithi033 bash[41341]: cluster 2021-07-26T16:07:11.143369+0000 mgr.y (mgr.34104) 397 : cluster [DBG] pgmap v746: 25 pgs: 25 active+clean; 527 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 3.0 MiB/s wr, 28 op/s 2021-07-26T16:07:12.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:12 smithi033 bash[41341]: cluster 2021-07-26T16:07:11.325552+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e619: 8 total, 8 up, 8 in 2021-07-26T16:07:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:12 smithi033 bash[42377]: cluster 2021-07-26T16:07:11.143369+0000 mgr.y (mgr.34104) 397 : cluster [DBG] pgmap v746: 25 pgs: 25 active+clean; 527 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 3.0 MiB/s wr, 28 op/s 2021-07-26T16:07:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:12 smithi033 bash[42377]: cluster 2021-07-26T16:07:11.325552+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e619: 8 total, 8 up, 8 in 2021-07-26T16:07:12.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:12 smithi096 bash[33981]: cluster 2021-07-26T16:07:11.143369+0000 mgr.y (mgr.34104) 397 : cluster [DBG] pgmap v746: 25 pgs: 25 active+clean; 527 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 3.0 MiB/s wr, 28 op/s 2021-07-26T16:07:12.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:12 smithi096 bash[33981]: cluster 2021-07-26T16:07:11.325552+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e619: 8 total, 8 up, 8 in 2021-07-26T16:07:13.343 INFO:tasks.rados.rados.0.smithi033.stdout:2799: done (2 left) 2021-07-26T16:07:13.344 INFO:tasks.rados.rados.0.smithi033.stdout:2800: done (1 left) 2021-07-26T16:07:13.344 INFO:tasks.rados.rados.0.smithi033.stdout:2802: done (0 left) 2021-07-26T16:07:13.344 INFO:tasks.rados.rados.0.smithi033.stdout:2803: read oid 21 snap 277 2021-07-26T16:07:13.344 INFO:tasks.rados.rados.0.smithi033.stdout:2803: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:13.345 INFO:tasks.rados.rados.0.smithi033.stdout:2804: delete oid 3 current snap is 282 2021-07-26T16:07:13.352 INFO:tasks.rados.rados.0.smithi033.stdout:2804: done (1 left) 2021-07-26T16:07:13.352 INFO:tasks.rados.rados.0.smithi033.stdout:2805: read oid 16 snap 235 2021-07-26T16:07:13.353 INFO:tasks.rados.rados.0.smithi033.stdout:2805: expect (ObjNum 2006933856 snap 22002 seq_num 2007544336) 2021-07-26T16:07:13.353 INFO:tasks.rados.rados.0.smithi033.stdout:2806: read oid 32 snap -1 2021-07-26T16:07:13.354 INFO:tasks.rados.rados.0.smithi033.stdout:2806: expect (ObjNum 825 snap 274 seq_num 825) 2021-07-26T16:07:13.354 INFO:tasks.rados.rados.0.smithi033.stdout:2807: copy_from oid 11 from oid 13 current snap is 282 2021-07-26T16:07:13.354 INFO:tasks.rados.rados.0.smithi033.stdout:2808: read oid 45 snap -1 2021-07-26T16:07:13.354 INFO:tasks.rados.rados.0.smithi033.stdout:2808: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:13.355 INFO:tasks.rados.rados.0.smithi033.stdout:2809: snap_remove snap 239 2021-07-26T16:07:13.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:13 smithi033 bash[41341]: cluster 2021-07-26T16:07:12.329566+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e620: 8 total, 8 up, 8 in 2021-07-26T16:07:13.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:13 smithi033 bash[42377]: cluster 2021-07-26T16:07:12.329566+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e620: 8 total, 8 up, 8 in 2021-07-26T16:07:13.709 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:07:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:07:13.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:07:13.710 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:07:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:07:13.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:07:13.711 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:07:13 smithi033 bash[50539]: level=error ts=2021-07-26T16:07:13.515Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs; Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" 2021-07-26T16:07:13.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:13 smithi096 bash[33981]: cluster 2021-07-26T16:07:12.329566+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e620: 8 total, 8 up, 8 in 2021-07-26T16:07:14.351 INFO:tasks.rados.rados.0.smithi033.stdout:2809: done (5 left) 2021-07-26T16:07:14.351 INFO:tasks.rados.rados.0.smithi033.stdout:2810: setattr oid 35 current snap is 282 2021-07-26T16:07:14.355 INFO:tasks.rados.rados.0.smithi033.stdout:2803: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:14.430 INFO:tasks.rados.rados.0.smithi033.stdout:2805: expect (ObjNum 2006933856 snap 22002 seq_num 2007544336) 2021-07-26T16:07:14.431 INFO:tasks.rados.rados.0.smithi033.stdout:2808: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:14.493 INFO:tasks.rados.rados.0.smithi033.stdout:2806: expect (ObjNum 825 snap 274 seq_num 825) 2021-07-26T16:07:14.607 INFO:tasks.rados.rados.0.smithi033.stdout:2807: finishing copy_from to smithi03339061-11 2021-07-26T16:07:14.607 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1290 (ObjNum 775 snap 256 seq_num 775) dirty exists 2021-07-26T16:07:14.607 INFO:tasks.rados.rados.0.smithi033.stdout:2807: finishing copy_from racing read to smithi03339061-11 2021-07-26T16:07:14.608 INFO:tasks.rados.rados.0.smithi033.stdout:2803: done (5 left) 2021-07-26T16:07:14.608 INFO:tasks.rados.rados.0.smithi033.stdout:2805: done (4 left) 2021-07-26T16:07:14.608 INFO:tasks.rados.rados.0.smithi033.stdout:2806: done (3 left) 2021-07-26T16:07:14.608 INFO:tasks.rados.rados.0.smithi033.stdout:2807: done (2 left) 2021-07-26T16:07:14.608 INFO:tasks.rados.rados.0.smithi033.stdout:2808: done (1 left) 2021-07-26T16:07:14.609 INFO:tasks.rados.rados.0.smithi033.stdout:2811: copy_from oid 44 from oid 15 current snap is 282 2021-07-26T16:07:14.609 INFO:tasks.rados.rados.0.smithi033.stdout:2812: rollback oid 11 current snap is 282 2021-07-26T16:07:14.609 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 11 to 241 2021-07-26T16:07:14.609 INFO:tasks.rados.rados.0.smithi033.stdout:2813: rollback oid 3 current snap is 282 2021-07-26T16:07:14.610 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 3 to 214 2021-07-26T16:07:14.610 INFO:tasks.rados.rados.0.smithi033.stdout:2814: rmattr oid 31 current snap is 282 2021-07-26T16:07:14.610 INFO:tasks.rados.rados.0.smithi033.stdout:2814: done (4 left) 2021-07-26T16:07:14.610 INFO:tasks.rados.rados.0.smithi033.stdout:2815: read oid 41 snap -1 2021-07-26T16:07:14.611 INFO:tasks.rados.rados.0.smithi033.stdout:2815: expect (ObjNum 845 snap 281 seq_num 845) 2021-07-26T16:07:14.611 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 282 2021-07-26T16:07:14.611 INFO:tasks.rados.rados.0.smithi033.stdout:2816: seq_num 849 ranges {1982464=622592,2605056=516096,3121152=663552,3784704=425984} 2021-07-26T16:07:14.622 INFO:tasks.rados.rados.0.smithi033.stdout:2816: writing smithi03339061-29 from 1982464 to 2605056 tid 1 2021-07-26T16:07:14.626 INFO:tasks.rados.rados.0.smithi033.stdout:2816: writing smithi03339061-29 from 2605056 to 3121152 tid 2 2021-07-26T16:07:14.629 INFO:tasks.rados.rados.0.smithi033.stdout:2816: writing smithi03339061-29 from 3121152 to 3784704 tid 3 2021-07-26T16:07:14.633 INFO:tasks.rados.rados.0.smithi033.stdout:2816: writing smithi03339061-29 from 3784704 to 4210688 tid 4 2021-07-26T16:07:14.633 INFO:tasks.rados.rados.0.smithi033.stdout:2817: copy_from oid 31 from oid 23 current snap is 282 2021-07-26T16:07:14.633 INFO:tasks.rados.rados.0.smithi033.stdout:2813: finishing rollback tid 1 to smithi03339061-3 2021-07-26T16:07:14.633 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1262 (ObjNum 1532785749 snap 1349736029 seq_num 1834116453) dirty exists 2021-07-26T16:07:14.634 INFO:tasks.rados.rados.0.smithi033.stdout:2812: finishing rollback tid 0 to smithi03339061-11 2021-07-26T16:07:14.634 INFO:tasks.rados.rados.0.smithi033.stdout:2812: finishing rollback tid 1 to smithi03339061-11 2021-07-26T16:07:14.634 INFO:tasks.rados.rados.0.smithi033.stdout:2813: finishing rollback tid 2 to smithi03339061-3 2021-07-26T16:07:14.634 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1431 (ObjNum 569 snap 177 seq_num 569) dirty exists 2021-07-26T16:07:14.635 INFO:tasks.rados.rados.0.smithi033.stdout:2812: finishing rollback tid 2 to smithi03339061-11 2021-07-26T16:07:14.635 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1310 (ObjNum 695 snap 229 seq_num 695) dirty exists 2021-07-26T16:07:14.635 INFO:tasks.rados.rados.0.smithi033.stdout:2816: finishing write tid 1 to smithi03339061-29 2021-07-26T16:07:14.635 INFO:tasks.rados.rados.0.smithi033.stdout:2816: finishing write tid 2 to smithi03339061-29 2021-07-26T16:07:14.635 INFO:tasks.rados.rados.0.smithi033.stdout:2810: done (6 left) 2021-07-26T16:07:14.636 INFO:tasks.rados.rados.0.smithi033.stdout:2812: done (5 left) 2021-07-26T16:07:14.636 INFO:tasks.rados.rados.0.smithi033.stdout:2813: done (4 left) 2021-07-26T16:07:14.636 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 282 2021-07-26T16:07:14.636 INFO:tasks.rados.rados.0.smithi033.stdout:2818: seq_num 850 ranges {0=638976,638976=802816,1441792=475136,1916928=327680} 2021-07-26T16:07:14.637 INFO:tasks.rados.rados.0.smithi033.stdout:2818: writing smithi03339061-38 from 0 to 638976 tid 1 2021-07-26T16:07:14.644 INFO:tasks.rados.rados.0.smithi033.stdout:2818: writing smithi03339061-38 from 638976 to 1441792 tid 2 2021-07-26T16:07:14.647 INFO:tasks.rados.rados.0.smithi033.stdout:2818: writing smithi03339061-38 from 1441792 to 1916928 tid 3 2021-07-26T16:07:14.649 INFO:tasks.rados.rados.0.smithi033.stdout:2818: writing smithi03339061-38 from 1916928 to 2244608 tid 4 2021-07-26T16:07:14.650 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 282 2021-07-26T16:07:14.650 INFO:tasks.rados.rados.0.smithi033.stdout:2819: seq_num 851 ranges {4866048=655360,5521408=688128,6209536=679936,6889472=237568} 2021-07-26T16:07:14.681 INFO:tasks.rados.rados.0.smithi033.stdout:2819: writing smithi03339061-50 from 4866048 to 5521408 tid 1 2021-07-26T16:07:14.685 INFO:tasks.rados.rados.0.smithi033.stdout:2819: writing smithi03339061-50 from 5521408 to 6209536 tid 2 2021-07-26T16:07:14.689 INFO:tasks.rados.rados.0.smithi033.stdout:2819: writing smithi03339061-50 from 6209536 to 6889472 tid 3 2021-07-26T16:07:14.691 INFO:tasks.rados.rados.0.smithi033.stdout:2819: writing smithi03339061-50 from 6889472 to 7127040 tid 4 2021-07-26T16:07:14.691 INFO:tasks.rados.rados.0.smithi033.stdout:2820: rollback oid 36 current snap is 282 2021-07-26T16:07:14.692 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 36 to 250 2021-07-26T16:07:14.692 INFO:tasks.rados.rados.0.smithi033.stdout:2816: finishing write tid 3 to smithi03339061-29 2021-07-26T16:07:14.692 INFO:tasks.rados.rados.0.smithi033.stdout:2816: finishing write tid 4 to smithi03339061-29 2021-07-26T16:07:14.692 INFO:tasks.rados.rados.0.smithi033.stdout:2816: finishing write tid 5 to smithi03339061-29 2021-07-26T16:07:14.693 INFO:tasks.rados.rados.0.smithi033.stdout:2816: finishing write tid 6 to smithi03339061-29 2021-07-26T16:07:14.693 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1271 (ObjNum 849 snap 282 seq_num 849) dirty exists 2021-07-26T16:07:14.693 INFO:tasks.rados.rados.0.smithi033.stdout:2816: left oid 29 (ObjNum 849 snap 282 seq_num 849) 2021-07-26T16:07:14.693 INFO:tasks.rados.rados.0.smithi033.stdout:2818: finishing write tid 1 to smithi03339061-38 2021-07-26T16:07:14.693 INFO:tasks.rados.rados.0.smithi033.stdout:2816: done (6 left) 2021-07-26T16:07:14.694 INFO:tasks.rados.rados.0.smithi033.stdout:2821: rmattr oid 26 current snap is 282 2021-07-26T16:07:14.694 INFO:tasks.rados.rados.0.smithi033.stdout:2821: done (6 left) 2021-07-26T16:07:14.694 INFO:tasks.rados.rados.0.smithi033.stdout:2822: setattr oid 20 current snap is 282 2021-07-26T16:07:14.694 INFO:tasks.rados.rados.0.smithi033.stdout:2818: finishing write tid 2 to smithi03339061-38 2021-07-26T16:07:14.695 INFO:tasks.rados.rados.0.smithi033.stdout:2818: finishing write tid 3 to smithi03339061-38 2021-07-26T16:07:14.695 INFO:tasks.rados.rados.0.smithi033.stdout:2817: finishing copy_from to smithi03339061-31 2021-07-26T16:07:14.695 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1377 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:07:14.695 INFO:tasks.rados.rados.0.smithi033.stdout:2818: finishing write tid 4 to smithi03339061-38 2021-07-26T16:07:14.695 INFO:tasks.rados.rados.0.smithi033.stdout:2818: finishing write tid 5 to smithi03339061-38 2021-07-26T16:07:14.696 INFO:tasks.rados.rados.0.smithi033.stdout:2817: finishing copy_from racing read to smithi03339061-31 2021-07-26T16:07:14.696 INFO:tasks.rados.rados.0.smithi033.stdout:2818: finishing write tid 6 to smithi03339061-38 2021-07-26T16:07:14.696 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 728 (ObjNum 850 snap 282 seq_num 850) dirty exists 2021-07-26T16:07:14.696 INFO:tasks.rados.rados.0.smithi033.stdout:2818: left oid 38 (ObjNum 850 snap 282 seq_num 850) 2021-07-26T16:07:14.697 INFO:tasks.rados.rados.0.smithi033.stdout:2815: expect (ObjNum 845 snap 281 seq_num 845) 2021-07-26T16:07:14.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:14 smithi033 bash[42377]: cluster 2021-07-26T16:07:13.144118+0000 mgr.y (mgr.34104) 398 : cluster [DBG] pgmap v749: 25 pgs: 25 active+clean; 534 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 3.8 MiB/s wr, 22 op/s 2021-07-26T16:07:14.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:14 smithi033 bash[42377]: cluster 2021-07-26T16:07:13.341122+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e621: 8 total, 8 up, 8 in 2021-07-26T16:07:14.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:14 smithi033 bash[41341]: cluster 2021-07-26T16:07:13.144118+0000 mgr.y (mgr.34104) 398 : cluster [DBG] pgmap v749: 25 pgs: 25 active+clean; 534 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 3.8 MiB/s wr, 22 op/s 2021-07-26T16:07:14.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:14 smithi033 bash[41341]: cluster 2021-07-26T16:07:13.341122+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e621: 8 total, 8 up, 8 in 2021-07-26T16:07:14.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:14 smithi096 bash[33981]: cluster 2021-07-26T16:07:13.144118+0000 mgr.y (mgr.34104) 398 : cluster [DBG] pgmap v749: 25 pgs: 25 active+clean; 534 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 3.8 MiB/s wr, 22 op/s 2021-07-26T16:07:14.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:14 smithi096 bash[33981]: cluster 2021-07-26T16:07:13.341122+0000 mon.a (mon.0) 989 : cluster [DBG] osdmap e621: 8 total, 8 up, 8 in 2021-07-26T16:07:15.039 INFO:tasks.rados.rados.0.smithi033.stdout:2811: finishing copy_from to smithi03339061-44 2021-07-26T16:07:15.040 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 904 (ObjNum 768 snap 255 seq_num 768) dirty exists 2021-07-26T16:07:15.040 INFO:tasks.rados.rados.0.smithi033.stdout:2811: finishing copy_from racing read to smithi03339061-44 2021-07-26T16:07:15.040 INFO:tasks.rados.rados.0.smithi033.stdout:2819: finishing write tid 1 to smithi03339061-50 2021-07-26T16:07:15.040 INFO:tasks.rados.rados.0.smithi033.stdout:2819: finishing write tid 2 to smithi03339061-50 2021-07-26T16:07:15.041 INFO:tasks.rados.rados.0.smithi033.stdout:2819: finishing write tid 3 to smithi03339061-50 2021-07-26T16:07:15.041 INFO:tasks.rados.rados.0.smithi033.stdout:2819: finishing write tid 4 to smithi03339061-50 2021-07-26T16:07:15.041 INFO:tasks.rados.rados.0.smithi033.stdout:2820: finishing rollback tid 0 to smithi03339061-36 2021-07-26T16:07:15.041 INFO:tasks.rados.rados.0.smithi033.stdout:2819: finishing write tid 5 to smithi03339061-50 2021-07-26T16:07:15.042 INFO:tasks.rados.rados.0.smithi033.stdout:2820: finishing rollback tid 1 to smithi03339061-36 2021-07-26T16:07:15.042 INFO:tasks.rados.rados.0.smithi033.stdout:2820: finishing rollback tid 2 to smithi03339061-36 2021-07-26T16:07:15.042 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1313 (ObjNum 740 snap 247 seq_num 740) dirty exists 2021-07-26T16:07:15.042 INFO:tasks.rados.rados.0.smithi033.stdout:2819: finishing write tid 6 to smithi03339061-50 2021-07-26T16:07:15.042 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1321 (ObjNum 851 snap 282 seq_num 851) dirty exists 2021-07-26T16:07:15.043 INFO:tasks.rados.rados.0.smithi033.stdout:2819: left oid 50 (ObjNum 851 snap 282 seq_num 851) 2021-07-26T16:07:15.043 INFO:tasks.rados.rados.0.smithi033.stdout:2811: done (6 left) 2021-07-26T16:07:15.043 INFO:tasks.rados.rados.0.smithi033.stdout:2815: done (5 left) 2021-07-26T16:07:15.043 INFO:tasks.rados.rados.0.smithi033.stdout:2817: done (4 left) 2021-07-26T16:07:15.044 INFO:tasks.rados.rados.0.smithi033.stdout:2818: done (3 left) 2021-07-26T16:07:15.044 INFO:tasks.rados.rados.0.smithi033.stdout:2819: done (2 left) 2021-07-26T16:07:15.044 INFO:tasks.rados.rados.0.smithi033.stdout:2820: done (1 left) 2021-07-26T16:07:15.044 INFO:tasks.rados.rados.0.smithi033.stdout:2823: snap_create 2021-07-26T16:07:15.045 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1333 (ObjNum 2008387648 snap 22002 seq_num 1058724832) dirty exists 2021-07-26T16:07:15.379 INFO:tasks.rados.rados.0.smithi033.stdout:2822: done (1 left) 2021-07-26T16:07:15.379 INFO:tasks.rados.rados.0.smithi033.stdout:2823: done (0 left) 2021-07-26T16:07:15.379 INFO:tasks.rados.rados.0.smithi033.stdout:2824: delete oid 42 current snap is 283 2021-07-26T16:07:15.384 INFO:tasks.rados.rados.0.smithi033.stdout:2824: done (0 left) 2021-07-26T16:07:15.385 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 283 2021-07-26T16:07:15.385 INFO:tasks.rados.rados.0.smithi033.stdout:2825: seq_num 853 ranges {2097152=696320,2793472=507904,3301376=647168,3948544=450560} 2021-07-26T16:07:15.404 INFO:tasks.rados.rados.0.smithi033.stdout:2825: writing smithi03339061-26 from 2097152 to 2793472 tid 1 2021-07-26T16:07:15.407 INFO:tasks.rados.rados.0.smithi033.stdout:2825: writing smithi03339061-26 from 2793472 to 3301376 tid 2 2021-07-26T16:07:15.411 INFO:tasks.rados.rados.0.smithi033.stdout:2825: writing smithi03339061-26 from 3301376 to 3948544 tid 3 2021-07-26T16:07:15.414 INFO:tasks.rados.rados.0.smithi033.stdout:2825: writing smithi03339061-26 from 3948544 to 4399104 tid 4 2021-07-26T16:07:15.414 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 283 2021-07-26T16:07:15.414 INFO:tasks.rados.rados.0.smithi033.stdout:2826: seq_num 854 ranges {0=712704,712704=794624,1507328=450560,1957888=360448} 2021-07-26T16:07:15.418 INFO:tasks.rados.rados.0.smithi033.stdout:2826: writing smithi03339061-42 from 0 to 712704 tid 1 2021-07-26T16:07:15.423 INFO:tasks.rados.rados.0.smithi033.stdout:2826: writing smithi03339061-42 from 712704 to 1507328 tid 2 2021-07-26T16:07:15.426 INFO:tasks.rados.rados.0.smithi033.stdout:2826: writing smithi03339061-42 from 1507328 to 1957888 tid 3 2021-07-26T16:07:15.429 INFO:tasks.rados.rados.0.smithi033.stdout:2826: writing smithi03339061-42 from 1957888 to 2318336 tid 4 2021-07-26T16:07:15.429 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 283 2021-07-26T16:07:15.429 INFO:tasks.rados.rados.0.smithi033.stdout:2825: finishing write tid 1 to smithi03339061-26 2021-07-26T16:07:15.429 INFO:tasks.rados.rados.0.smithi033.stdout:2825: finishing write tid 2 to smithi03339061-26 2021-07-26T16:07:15.430 INFO:tasks.rados.rados.0.smithi033.stdout:2825: finishing write tid 3 to smithi03339061-26 2021-07-26T16:07:15.430 INFO:tasks.rados.rados.0.smithi033.stdout:2825: finishing write tid 4 to smithi03339061-26 2021-07-26T16:07:15.430 INFO:tasks.rados.rados.0.smithi033.stdout:2827: seq_num 855 ranges {0=729088,729088=671744,1400832=663552,2064384=270336} 2021-07-26T16:07:15.432 INFO:tasks.rados.rados.0.smithi033.stdout:2827: writing smithi03339061-22 from 0 to 729088 tid 1 2021-07-26T16:07:15.437 INFO:tasks.rados.rados.0.smithi033.stdout:2827: writing smithi03339061-22 from 729088 to 1400832 tid 2 2021-07-26T16:07:15.441 INFO:tasks.rados.rados.0.smithi033.stdout:2827: writing smithi03339061-22 from 1400832 to 2064384 tid 3 2021-07-26T16:07:15.443 INFO:tasks.rados.rados.0.smithi033.stdout:2827: writing smithi03339061-22 from 2064384 to 2334720 tid 4 2021-07-26T16:07:15.443 INFO:tasks.rados.rados.0.smithi033.stdout:2828: delete oid 44 current snap is 283 2021-07-26T16:07:15.443 INFO:tasks.rados.rados.0.smithi033.stdout:2825: finishing write tid 5 to smithi03339061-26 2021-07-26T16:07:15.443 INFO:tasks.rados.rados.0.smithi033.stdout:2825: finishing write tid 6 to smithi03339061-26 2021-07-26T16:07:15.444 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 1703 (ObjNum 853 snap 283 seq_num 853) dirty exists 2021-07-26T16:07:15.444 INFO:tasks.rados.rados.0.smithi033.stdout:2825: left oid 26 (ObjNum 853 snap 283 seq_num 853) 2021-07-26T16:07:15.444 INFO:tasks.rados.rados.0.smithi033.stdout:2826: finishing write tid 1 to smithi03339061-42 2021-07-26T16:07:15.444 INFO:tasks.rados.rados.0.smithi033.stdout:2826: finishing write tid 2 to smithi03339061-42 2021-07-26T16:07:15.444 INFO:tasks.rados.rados.0.smithi033.stdout:2826: finishing write tid 3 to smithi03339061-42 2021-07-26T16:07:15.445 INFO:tasks.rados.rados.0.smithi033.stdout:2826: finishing write tid 4 to smithi03339061-42 2021-07-26T16:07:15.445 INFO:tasks.rados.rados.0.smithi033.stdout:2826: finishing write tid 5 to smithi03339061-42 2021-07-26T16:07:15.445 INFO:tasks.rados.rados.0.smithi033.stdout:2827: finishing write tid 1 to smithi03339061-22 2021-07-26T16:07:15.445 INFO:tasks.rados.rados.0.smithi033.stdout:2826: finishing write tid 6 to smithi03339061-42 2021-07-26T16:07:15.446 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1437 (ObjNum 854 snap 283 seq_num 854) dirty exists 2021-07-26T16:07:15.446 INFO:tasks.rados.rados.0.smithi033.stdout:2826: left oid 42 (ObjNum 854 snap 283 seq_num 854) 2021-07-26T16:07:15.446 INFO:tasks.rados.rados.0.smithi033.stdout:2827: finishing write tid 2 to smithi03339061-22 2021-07-26T16:07:15.448 INFO:tasks.rados.rados.0.smithi033.stdout:2825: done (3 left) 2021-07-26T16:07:15.448 INFO:tasks.rados.rados.0.smithi033.stdout:2826: done (2 left) 2021-07-26T16:07:15.448 INFO:tasks.rados.rados.0.smithi033.stdout:2828: done (1 left) 2021-07-26T16:07:15.449 INFO:tasks.rados.rados.0.smithi033.stdout:2829: read oid 18 snap -1 2021-07-26T16:07:15.449 INFO:tasks.rados.rados.0.smithi033.stdout:2829: expect deleted 2021-07-26T16:07:15.449 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 283 2021-07-26T16:07:15.449 INFO:tasks.rados.rados.0.smithi033.stdout:2830: seq_num 857 ranges {0=761856,761856=442368,1204224=630784,1835008=532480} 2021-07-26T16:07:15.453 INFO:tasks.rados.rados.0.smithi033.stdout:2830: writing smithi03339061-46 from 0 to 761856 tid 1 2021-07-26T16:07:15.455 INFO:tasks.rados.rados.0.smithi033.stdout:2830: writing smithi03339061-46 from 761856 to 1204224 tid 2 2021-07-26T16:07:15.459 INFO:tasks.rados.rados.0.smithi033.stdout:2830: writing smithi03339061-46 from 1204224 to 1835008 tid 3 2021-07-26T16:07:15.463 INFO:tasks.rados.rados.0.smithi033.stdout:2830: writing smithi03339061-46 from 1835008 to 2367488 tid 4 2021-07-26T16:07:15.463 INFO:tasks.rados.rados.0.smithi033.stdout:2831: read oid 29 snap -1 2021-07-26T16:07:15.463 INFO:tasks.rados.rados.0.smithi033.stdout:2831: expect (ObjNum 849 snap 282 seq_num 849) 2021-07-26T16:07:15.463 INFO:tasks.rados.rados.0.smithi033.stdout:2832: read oid 34 snap -1 2021-07-26T16:07:15.463 INFO:tasks.rados.rados.0.smithi033.stdout:2832: expect (ObjNum 723 snap 242 seq_num 723) 2021-07-26T16:07:15.464 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 283 2021-07-26T16:07:15.464 INFO:tasks.rados.rados.0.smithi033.stdout:2827: finishing write tid 3 to smithi03339061-22 2021-07-26T16:07:15.464 INFO:tasks.rados.rados.0.smithi033.stdout:2833: seq_num 858 ranges {6905856=778240,7684096=729088,8413184=434176,8847360=442368} 2021-07-26T16:07:15.505 INFO:tasks.rados.rados.0.smithi033.stdout:2833: writing smithi03339061-4 from 6905856 to 7684096 tid 1 2021-07-26T16:07:15.510 INFO:tasks.rados.rados.0.smithi033.stdout:2833: writing smithi03339061-4 from 7684096 to 8413184 tid 2 2021-07-26T16:07:15.512 INFO:tasks.rados.rados.0.smithi033.stdout:2833: writing smithi03339061-4 from 8413184 to 8847360 tid 3 2021-07-26T16:07:15.516 INFO:tasks.rados.rados.0.smithi033.stdout:2833: writing smithi03339061-4 from 8847360 to 9289728 tid 4 2021-07-26T16:07:15.516 INFO:tasks.rados.rados.0.smithi033.stdout:2834: rollback oid 12 current snap is 283 2021-07-26T16:07:15.516 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 12 to 248 2021-07-26T16:07:15.517 INFO:tasks.rados.rados.0.smithi033.stdout:2827: finishing write tid 4 to smithi03339061-22 2021-07-26T16:07:15.517 INFO:tasks.rados.rados.0.smithi033.stdout:2827: finishing write tid 5 to smithi03339061-22 2021-07-26T16:07:15.517 INFO:tasks.rados.rados.0.smithi033.stdout:2827: finishing write tid 6 to smithi03339061-22 2021-07-26T16:07:15.517 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1708 (ObjNum 855 snap 283 seq_num 855) dirty exists 2021-07-26T16:07:15.517 INFO:tasks.rados.rados.0.smithi033.stdout:2827: left oid 22 (ObjNum 855 snap 283 seq_num 855) 2021-07-26T16:07:15.518 INFO:tasks.rados.rados.0.smithi033.stdout:2827: done (6 left) 2021-07-26T16:07:15.518 INFO:tasks.rados.rados.0.smithi033.stdout:2835: delete oid 42 current snap is 283 2021-07-26T16:07:15.518 INFO:tasks.rados.rados.0.smithi033.stdout:2830: finishing write tid 1 to smithi03339061-46 2021-07-26T16:07:15.518 INFO:tasks.rados.rados.0.smithi033.stdout:2830: finishing write tid 2 to smithi03339061-46 2021-07-26T16:07:15.519 INFO:tasks.rados.rados.0.smithi033.stdout:2830: finishing write tid 3 to smithi03339061-46 2021-07-26T16:07:15.519 INFO:tasks.rados.rados.0.smithi033.stdout:2832: expect (ObjNum 723 snap 242 seq_num 723) 2021-07-26T16:07:15.637 INFO:tasks.rados.rados.0.smithi033.stdout:2830: finishing write tid 4 to smithi03339061-46 2021-07-26T16:07:15.637 INFO:tasks.rados.rados.0.smithi033.stdout:2830: finishing write tid 5 to smithi03339061-46 2021-07-26T16:07:15.637 INFO:tasks.rados.rados.0.smithi033.stdout:2831: expect (ObjNum 849 snap 282 seq_num 849) 2021-07-26T16:07:15.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:15 smithi033 bash[42377]: cluster 2021-07-26T16:07:14.347852+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e622: 8 total, 8 up, 8 in 2021-07-26T16:07:15.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:15 smithi033 bash[41341]: cluster 2021-07-26T16:07:14.347852+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e622: 8 total, 8 up, 8 in 2021-07-26T16:07:15.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:15 smithi096 bash[33981]: cluster 2021-07-26T16:07:14.347852+0000 mon.a (mon.0) 990 : cluster [DBG] osdmap e622: 8 total, 8 up, 8 in 2021-07-26T16:07:15.782 INFO:tasks.rados.rados.0.smithi033.stdout:2830: finishing write tid 6 to smithi03339061-46 2021-07-26T16:07:15.782 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1276 (ObjNum 857 snap 283 seq_num 857) dirty exists 2021-07-26T16:07:15.782 INFO:tasks.rados.rados.0.smithi033.stdout:2830: left oid 46 (ObjNum 857 snap 283 seq_num 857) 2021-07-26T16:07:15.783 INFO:tasks.rados.rados.0.smithi033.stdout:2833: finishing write tid 1 to smithi03339061-4 2021-07-26T16:07:15.783 INFO:tasks.rados.rados.0.smithi033.stdout:2833: finishing write tid 2 to smithi03339061-4 2021-07-26T16:07:15.783 INFO:tasks.rados.rados.0.smithi033.stdout:2833: finishing write tid 3 to smithi03339061-4 2021-07-26T16:07:15.783 INFO:tasks.rados.rados.0.smithi033.stdout:2833: finishing write tid 4 to smithi03339061-4 2021-07-26T16:07:15.784 INFO:tasks.rados.rados.0.smithi033.stdout:2834: finishing rollback tid 0 to smithi03339061-12 2021-07-26T16:07:15.784 INFO:tasks.rados.rados.0.smithi033.stdout:2833: finishing write tid 5 to smithi03339061-4 2021-07-26T16:07:15.784 INFO:tasks.rados.rados.0.smithi033.stdout:2834: finishing rollback tid 1 to smithi03339061-12 2021-07-26T16:07:15.785 INFO:tasks.rados.rados.0.smithi033.stdout:2834: finishing rollback tid 2 to smithi03339061-12 2021-07-26T16:07:15.785 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1401 (ObjNum 729 snap 245 seq_num 729) dirty exists 2021-07-26T16:07:15.785 INFO:tasks.rados.rados.0.smithi033.stdout:2833: finishing write tid 6 to smithi03339061-4 2021-07-26T16:07:15.785 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1339 (ObjNum 858 snap 283 seq_num 858) dirty exists 2021-07-26T16:07:15.785 INFO:tasks.rados.rados.0.smithi033.stdout:2833: left oid 4 (ObjNum 858 snap 283 seq_num 858) 2021-07-26T16:07:15.786 INFO:tasks.rados.rados.0.smithi033.stdout:2829: done (6 left) 2021-07-26T16:07:15.786 INFO:tasks.rados.rados.0.smithi033.stdout:2830: done (5 left) 2021-07-26T16:07:15.786 INFO:tasks.rados.rados.0.smithi033.stdout:2831: done (4 left) 2021-07-26T16:07:15.786 INFO:tasks.rados.rados.0.smithi033.stdout:2832: done (3 left) 2021-07-26T16:07:15.787 INFO:tasks.rados.rados.0.smithi033.stdout:2833: done (2 left) 2021-07-26T16:07:15.787 INFO:tasks.rados.rados.0.smithi033.stdout:2834: done (1 left) 2021-07-26T16:07:15.788 INFO:tasks.rados.rados.0.smithi033.stdout:2835: done (0 left) 2021-07-26T16:07:15.788 INFO:tasks.rados.rados.0.smithi033.stdout:2836: copy_from oid 35 from oid 17 current snap is 283 2021-07-26T16:07:15.788 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 283 2021-07-26T16:07:15.788 INFO:tasks.rados.rados.0.smithi033.stdout:2837: seq_num 860 ranges {16818176=8192} 2021-07-26T16:07:15.884 INFO:tasks.rados.rados.0.smithi033.stdout:2837: writing smithi03339061-49 from 16818176 to 16826368 tid 1 2021-07-26T16:07:15.885 INFO:tasks.rados.rados.0.smithi033.stdout:2838: rollback oid 36 current snap is 283 2021-07-26T16:07:15.885 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 36 to 248 2021-07-26T16:07:15.885 INFO:tasks.rados.rados.0.smithi033.stdout:2836: finishing copy_from to smithi03339061-35 2021-07-26T16:07:15.886 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 899 (ObjNum 815 snap 272 seq_num 815) dirty exists 2021-07-26T16:07:15.886 INFO:tasks.rados.rados.0.smithi033.stdout:2839: rollback oid 23 current snap is 283 2021-07-26T16:07:15.886 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 23 to 264 2021-07-26T16:07:15.886 INFO:tasks.rados.rados.0.smithi033.stdout:2836: finishing copy_from racing read to smithi03339061-35 2021-07-26T16:07:15.886 INFO:tasks.rados.rados.0.smithi033.stdout:2836: done (3 left) 2021-07-26T16:07:15.887 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 283 2021-07-26T16:07:15.887 INFO:tasks.rados.rados.0.smithi033.stdout:2840: seq_num 861 ranges {3170304=24576} 2021-07-26T16:07:15.903 INFO:tasks.rados.rados.0.smithi033.stdout:2840: writing smithi03339061-47 from 3170304 to 3194880 tid 1 2021-07-26T16:07:15.903 INFO:tasks.rados.rados.0.smithi033.stdout:2841: delete oid 26 current snap is 283 2021-07-26T16:07:15.903 INFO:tasks.rados.rados.0.smithi033.stdout:2839: finishing rollback tid 0 to smithi03339061-23 2021-07-26T16:07:15.904 INFO:tasks.rados.rados.0.smithi033.stdout:2839: finishing rollback tid 1 to smithi03339061-23 2021-07-26T16:07:15.904 INFO:tasks.rados.rados.0.smithi033.stdout:2838: finishing rollback tid 0 to smithi03339061-36 2021-07-26T16:07:15.904 INFO:tasks.rados.rados.0.smithi033.stdout:2837: finishing write tid 1 to smithi03339061-49 2021-07-26T16:07:15.904 INFO:tasks.rados.rados.0.smithi033.stdout:2839: finishing rollback tid 2 to smithi03339061-23 2021-07-26T16:07:15.905 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1405 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:07:15.905 INFO:tasks.rados.rados.0.smithi033.stdout:2837: finishing write tid 2 to smithi03339061-49 2021-07-26T16:07:15.905 INFO:tasks.rados.rados.0.smithi033.stdout:2838: finishing rollback tid 1 to smithi03339061-36 2021-07-26T16:07:15.905 INFO:tasks.rados.rados.0.smithi033.stdout:2838: finishing rollback tid 2 to smithi03339061-36 2021-07-26T16:07:15.905 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1316 (ObjNum 740 snap 247 seq_num 740) dirty exists 2021-07-26T16:07:15.906 INFO:tasks.rados.rados.0.smithi033.stdout:2837: finishing write tid 3 to smithi03339061-49 2021-07-26T16:07:15.906 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 918 (ObjNum 860 snap 283 seq_num 860) dirty exists 2021-07-26T16:07:15.906 INFO:tasks.rados.rados.0.smithi033.stdout:2837: left oid 49 (ObjNum 860 snap 283 seq_num 860) 2021-07-26T16:07:15.907 INFO:tasks.rados.rados.0.smithi033.stdout:2837: done (4 left) 2021-07-26T16:07:15.907 INFO:tasks.rados.rados.0.smithi033.stdout:2838: done (3 left) 2021-07-26T16:07:15.908 INFO:tasks.rados.rados.0.smithi033.stdout:2839: done (2 left) 2021-07-26T16:07:15.908 INFO:tasks.rados.rados.0.smithi033.stdout:2841: done (1 left) 2021-07-26T16:07:15.908 INFO:tasks.rados.rados.0.smithi033.stdout:2842: read oid 16 snap -1 2021-07-26T16:07:15.908 INFO:tasks.rados.rados.0.smithi033.stdout:2842: expect (ObjNum 795 snap 266 seq_num 795) 2021-07-26T16:07:15.908 INFO:tasks.rados.rados.0.smithi033.stdout:2843: snap_remove snap 279 2021-07-26T16:07:16.177 INFO:tasks.rados.rados.0.smithi033.stdout:2843: done (2 left) 2021-07-26T16:07:16.177 INFO:tasks.rados.rados.0.smithi033.stdout:2844: snap_remove snap 281 2021-07-26T16:07:16.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:16 smithi033 bash[41341]: cluster 2021-07-26T16:07:15.144815+0000 mgr.y (mgr.34104) 399 : cluster [DBG] pgmap v752: 25 pgs: 25 active+clean; 560 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 11 op/s 2021-07-26T16:07:16.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:16 smithi033 bash[41341]: cluster 2021-07-26T16:07:15.376447+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e623: 8 total, 8 up, 8 in 2021-07-26T16:07:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:16 smithi033 bash[41341]: cluster 2021-07-26T16:07:16.173007+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e624: 8 total, 8 up, 8 in 2021-07-26T16:07:16.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:16 smithi033 bash[42377]: cluster 2021-07-26T16:07:15.144815+0000 mgr.y (mgr.34104) 399 : cluster [DBG] pgmap v752: 25 pgs: 25 active+clean; 560 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 11 op/s 2021-07-26T16:07:16.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:16 smithi033 bash[42377]: cluster 2021-07-26T16:07:15.376447+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e623: 8 total, 8 up, 8 in 2021-07-26T16:07:16.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:16 smithi033 bash[42377]: cluster 2021-07-26T16:07:16.173007+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e624: 8 total, 8 up, 8 in 2021-07-26T16:07:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:16 smithi096 bash[33981]: cluster 2021-07-26T16:07:15.144815+0000 mgr.y (mgr.34104) 399 : cluster [DBG] pgmap v752: 25 pgs: 25 active+clean; 560 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 2.3 MiB/s rd, 5.6 MiB/s wr, 11 op/s 2021-07-26T16:07:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:16 smithi096 bash[33981]: cluster 2021-07-26T16:07:15.376447+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e623: 8 total, 8 up, 8 in 2021-07-26T16:07:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:16 smithi096 bash[33981]: cluster 2021-07-26T16:07:16.173007+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e624: 8 total, 8 up, 8 in 2021-07-26T16:07:17.197 INFO:tasks.rados.rados.0.smithi033.stdout:2844: done (2 left) 2021-07-26T16:07:17.198 INFO:tasks.rados.rados.0.smithi033.stdout:2845: copy_from oid 34 from oid 5 current snap is 283 2021-07-26T16:07:17.198 INFO:tasks.rados.rados.0.smithi033.stdout:2840: finishing write tid 1 to smithi03339061-47 2021-07-26T16:07:17.198 INFO:tasks.rados.rados.0.smithi033.stdout:2840: finishing write tid 2 to smithi03339061-47 2021-07-26T16:07:17.198 INFO:tasks.rados.rados.0.smithi033.stdout:2840: finishing write tid 3 to smithi03339061-47 2021-07-26T16:07:17.199 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1460 (ObjNum 861 snap 283 seq_num 861) dirty exists 2021-07-26T16:07:17.199 INFO:tasks.rados.rados.0.smithi033.stdout:2840: left oid 47 (ObjNum 861 snap 283 seq_num 861) 2021-07-26T16:07:17.199 INFO:tasks.rados.rados.0.smithi033.stdout:2842: expect (ObjNum 795 snap 266 seq_num 795) 2021-07-26T16:07:18.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:18 smithi033 bash[42377]: cluster 2021-07-26T16:07:17.145599+0000 mgr.y (mgr.34104) 400 : cluster [DBG] pgmap v755: 25 pgs: 25 active+clean; 574 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 7.1 MiB/s wr, 25 op/s 2021-07-26T16:07:18.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:18 smithi033 bash[42377]: cluster 2021-07-26T16:07:17.193448+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e625: 8 total, 8 up, 8 in 2021-07-26T16:07:18.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:18 smithi033 bash[41341]: cluster 2021-07-26T16:07:17.145599+0000 mgr.y (mgr.34104) 400 : cluster [DBG] pgmap v755: 25 pgs: 25 active+clean; 574 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 7.1 MiB/s wr, 25 op/s 2021-07-26T16:07:18.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:18 smithi033 bash[41341]: cluster 2021-07-26T16:07:17.193448+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e625: 8 total, 8 up, 8 in 2021-07-26T16:07:18.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:18 smithi096 bash[33981]: cluster 2021-07-26T16:07:17.145599+0000 mgr.y (mgr.34104) 400 : cluster [DBG] pgmap v755: 25 pgs: 25 active+clean; 574 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 7.1 MiB/s wr, 25 op/s 2021-07-26T16:07:18.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:18 smithi096 bash[33981]: cluster 2021-07-26T16:07:17.193448+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e625: 8 total, 8 up, 8 in 2021-07-26T16:07:18.503 INFO:tasks.rados.rados.0.smithi033.stdout:2845: finishing copy_from to smithi03339061-34 2021-07-26T16:07:18.504 INFO:tasks.rados.rados.0.smithi033.stdout:2845: got expected ENOENT (src dne) 2021-07-26T16:07:18.504 INFO:tasks.rados.rados.0.smithi033.stdout:2845: finishing copy_from racing read to smithi03339061-34 2021-07-26T16:07:18.504 INFO:tasks.rados.rados.0.smithi033.stdout:2840: done (2 left) 2021-07-26T16:07:18.504 INFO:tasks.rados.rados.0.smithi033.stdout:2842: done (1 left) 2021-07-26T16:07:18.505 INFO:tasks.rados.rados.0.smithi033.stdout:2845: done (0 left) 2021-07-26T16:07:18.505 INFO:tasks.rados.rados.0.smithi033.stdout:2846: setattr oid 32 current snap is 283 2021-07-26T16:07:18.508 INFO:tasks.rados.rados.0.smithi033.stdout:2847: delete oid 7 current snap is 283 2021-07-26T16:07:18.513 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1322 (ObjNum 825 snap 274 seq_num 825) dirty exists 2021-07-26T16:07:18.514 INFO:tasks.rados.rados.0.smithi033.stdout:2846: done (1 left) 2021-07-26T16:07:18.515 INFO:tasks.rados.rados.0.smithi033.stdout:2847: done (0 left) 2021-07-26T16:07:18.515 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 283 2021-07-26T16:07:18.515 INFO:tasks.rados.rados.0.smithi033.stdout:2848: seq_num 864 ranges {6397952=73728} 2021-07-26T16:07:18.552 INFO:tasks.rados.rados.0.smithi033.stdout:2848: writing smithi03339061-30 from 6397952 to 6471680 tid 1 2021-07-26T16:07:18.552 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 283 2021-07-26T16:07:18.552 INFO:tasks.rados.rados.0.smithi033.stdout:2849: seq_num 865 ranges {0=90112} 2021-07-26T16:07:18.553 INFO:tasks.rados.rados.0.smithi033.stdout:2849: writing smithi03339061-7 from 0 to 90112 tid 1 2021-07-26T16:07:18.553 INFO:tasks.rados.rados.0.smithi033.stdout:2850: setattr oid 36 current snap is 283 2021-07-26T16:07:18.554 INFO:tasks.rados.rados.0.smithi033.stdout:2851: rollback oid 18 current snap is 283 2021-07-26T16:07:18.554 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 18 to 255 2021-07-26T16:07:18.555 INFO:tasks.rados.rados.0.smithi033.stdout:2852: setattr oid 5 current snap is 283 2021-07-26T16:07:18.555 INFO:tasks.rados.rados.0.smithi033.stdout:2853: snap_create 2021-07-26T16:07:18.560 INFO:tasks.rados.rados.0.smithi033.stdout:2849: finishing write tid 1 to smithi03339061-7 2021-07-26T16:07:18.560 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1317 (ObjNum 740 snap 247 seq_num 740) dirty exists 2021-07-26T16:07:18.562 INFO:tasks.rados.rados.0.smithi033.stdout:2849: finishing write tid 2 to smithi03339061-7 2021-07-26T16:07:18.563 INFO:tasks.rados.rados.0.smithi033.stdout:2848: finishing write tid 1 to smithi03339061-30 2021-07-26T16:07:18.563 INFO:tasks.rados.rados.0.smithi033.stdout:2848: finishing write tid 2 to smithi03339061-30 2021-07-26T16:07:18.564 INFO:tasks.rados.rados.0.smithi033.stdout:2851: finishing rollback tid 1 to smithi03339061-18 2021-07-26T16:07:18.564 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 1269 (ObjNum 2008700176 snap 22002 seq_num 2008705584) dirty exists 2021-07-26T16:07:18.565 INFO:tasks.rados.rados.0.smithi033.stdout:2851: finishing rollback tid 2 to smithi03339061-18 2021-07-26T16:07:18.565 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 1717 (ObjNum 0 snap 0 seq_num 0) dirty exists 2021-07-26T16:07:18.565 INFO:tasks.rados.rados.0.smithi033.stdout:2849: finishing write tid 3 to smithi03339061-7 2021-07-26T16:07:18.566 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1408 (ObjNum 865 snap 283 seq_num 865) dirty exists 2021-07-26T16:07:18.566 INFO:tasks.rados.rados.0.smithi033.stdout:2849: left oid 7 (ObjNum 865 snap 283 seq_num 865) 2021-07-26T16:07:18.566 INFO:tasks.rados.rados.0.smithi033.stdout:2848: finishing write tid 3 to smithi03339061-30 2021-07-26T16:07:18.567 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 1462 (ObjNum 864 snap 283 seq_num 864) dirty exists 2021-07-26T16:07:18.567 INFO:tasks.rados.rados.0.smithi033.stdout:2848: left oid 30 (ObjNum 864 snap 283 seq_num 864) 2021-07-26T16:07:19.204 INFO:tasks.rados.rados.0.smithi033.stdout:2848: done (5 left) 2021-07-26T16:07:19.205 INFO:tasks.rados.rados.0.smithi033.stdout:2849: done (4 left) 2021-07-26T16:07:19.205 INFO:tasks.rados.rados.0.smithi033.stdout:2850: done (3 left) 2021-07-26T16:07:19.205 INFO:tasks.rados.rados.0.smithi033.stdout:2851: done (2 left) 2021-07-26T16:07:19.206 INFO:tasks.rados.rados.0.smithi033.stdout:2852: done (1 left) 2021-07-26T16:07:19.206 INFO:tasks.rados.rados.0.smithi033.stdout:2853: done (0 left) 2021-07-26T16:07:19.206 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 284 2021-07-26T16:07:19.206 INFO:tasks.rados.rados.0.smithi033.stdout:2854: seq_num 866 ranges {2080768=106496} 2021-07-26T16:07:19.220 INFO:tasks.rados.rados.0.smithi033.stdout:2854: writing smithi03339061-45 from 2080768 to 2187264 tid 1 2021-07-26T16:07:19.220 INFO:tasks.rados.rados.0.smithi033.stdout:2855: read oid 41 snap 237 2021-07-26T16:07:19.221 INFO:tasks.rados.rados.0.smithi033.stdout:2855: expect (ObjNum 703 snap 233 seq_num 703) 2021-07-26T16:07:19.221 INFO:tasks.rados.rados.0.smithi033.stdout:2856: delete oid 6 current snap is 284 2021-07-26T16:07:19.230 INFO:tasks.rados.rados.0.smithi033.stdout:2854: finishing write tid 1 to smithi03339061-45 2021-07-26T16:07:19.232 INFO:tasks.rados.rados.0.smithi033.stdout:2854: finishing write tid 2 to smithi03339061-45 2021-07-26T16:07:19.235 INFO:tasks.rados.rados.0.smithi033.stdout:2854: finishing write tid 3 to smithi03339061-45 2021-07-26T16:07:19.235 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1720 (ObjNum 866 snap 284 seq_num 866) dirty exists 2021-07-26T16:07:19.235 INFO:tasks.rados.rados.0.smithi033.stdout:2854: left oid 45 (ObjNum 866 snap 284 seq_num 866) 2021-07-26T16:07:19.236 INFO:tasks.rados.rados.0.smithi033.stdout:2854: done (2 left) 2021-07-26T16:07:19.236 INFO:tasks.rados.rados.0.smithi033.stdout:2856: done (1 left) 2021-07-26T16:07:19.237 INFO:tasks.rados.rados.0.smithi033.stdout:2857: copy_from oid 29 from oid 8 current snap is 284 2021-07-26T16:07:19.237 INFO:tasks.rados.rados.0.smithi033.stdout:2858: setattr oid 15 current snap is 284 2021-07-26T16:07:19.239 INFO:tasks.rados.rados.0.smithi033.stdout:2859: read oid 38 snap 276 2021-07-26T16:07:19.239 INFO:tasks.rados.rados.0.smithi033.stdout:2859: expect deleted 2021-07-26T16:07:19.239 INFO:tasks.rados.rados.0.smithi033.stdout:2860: setattr oid 19 current snap is 284 2021-07-26T16:07:19.241 INFO:tasks.rados.rados.0.smithi033.stdout:2859: done (4 left) 2021-07-26T16:07:19.242 INFO:tasks.rados.rados.0.smithi033.stdout:2861: read oid 34 snap 277 2021-07-26T16:07:19.242 INFO:tasks.rados.rados.0.smithi033.stdout:2861: expect (ObjNum 842 snap 277 seq_num 842) 2021-07-26T16:07:19.242 INFO:tasks.rados.rados.0.smithi033.stdout:2862: delete oid 44 current snap is 284 2021-07-26T16:07:19.250 INFO:tasks.rados.rados.0.smithi033.stdout:2862: done (5 left) 2021-07-26T16:07:19.250 INFO:tasks.rados.rados.0.smithi033.stdout:2863: read oid 39 snap -1 2021-07-26T16:07:19.251 INFO:tasks.rados.rados.0.smithi033.stdout:2863: expect (ObjNum 833 snap 277 seq_num 833) 2021-07-26T16:07:19.251 INFO:tasks.rados.rados.0.smithi033.stdout:2864: rollback oid 20 current snap is 284 2021-07-26T16:07:19.251 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 20 to 274 2021-07-26T16:07:19.251 INFO:tasks.rados.rados.0.smithi033.stdout:2865: snap_create 2021-07-26T16:07:19.252 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 919 (ObjNum 768 snap 255 seq_num 768) dirty exists 2021-07-26T16:07:19.254 INFO:tasks.rados.rados.0.smithi033.stdout:2855: expect (ObjNum 703 snap 233 seq_num 703) 2021-07-26T16:07:19.460 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 1263 (ObjNum 816 snap 272 seq_num 816) dirty exists 2021-07-26T16:07:19.460 INFO:tasks.rados.rados.0.smithi033.stdout:2864: finishing rollback tid 0 to smithi03339061-20 2021-07-26T16:07:19.461 INFO:tasks.rados.rados.0.smithi033.stdout:2864: finishing rollback tid 1 to smithi03339061-20 2021-07-26T16:07:19.461 INFO:tasks.rados.rados.0.smithi033.stdout:2864: finishing rollback tid 2 to smithi03339061-20 2021-07-26T16:07:19.461 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1342 (ObjNum 773 snap 255 seq_num 773) dirty exists 2021-07-26T16:07:19.461 INFO:tasks.rados.rados.0.smithi033.stdout:2863: expect (ObjNum 833 snap 277 seq_num 833) 2021-07-26T16:07:19.512 INFO:tasks.rados.rados.0.smithi033.stdout:2861: expect (ObjNum 842 snap 277 seq_num 842) 2021-07-26T16:07:19.771 INFO:tasks.rados.rados.0.smithi033.stdout:2857: finishing copy_from to smithi03339061-29 2021-07-26T16:07:19.772 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1255 (ObjNum 723 snap 242 seq_num 723) dirty exists 2021-07-26T16:07:19.772 INFO:tasks.rados.rados.0.smithi033.stdout:2857: finishing copy_from racing read to smithi03339061-29 2021-07-26T16:07:20.207 INFO:tasks.rados.rados.0.smithi033.stdout:2855: done (7 left) 2021-07-26T16:07:20.207 INFO:tasks.rados.rados.0.smithi033.stdout:2857: done (6 left) 2021-07-26T16:07:20.207 INFO:tasks.rados.rados.0.smithi033.stdout:2858: done (5 left) 2021-07-26T16:07:20.208 INFO:tasks.rados.rados.0.smithi033.stdout:2860: done (4 left) 2021-07-26T16:07:20.208 INFO:tasks.rados.rados.0.smithi033.stdout:2861: done (3 left) 2021-07-26T16:07:20.208 INFO:tasks.rados.rados.0.smithi033.stdout:2863: done (2 left) 2021-07-26T16:07:20.208 INFO:tasks.rados.rados.0.smithi033.stdout:2864: done (1 left) 2021-07-26T16:07:20.208 INFO:tasks.rados.rados.0.smithi033.stdout:2865: done (0 left) 2021-07-26T16:07:20.209 INFO:tasks.rados.rados.0.smithi033.stdout:2866: rollback oid 24 current snap is 285 2021-07-26T16:07:20.209 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 24 to 260 2021-07-26T16:07:20.209 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 285 2021-07-26T16:07:20.209 INFO:tasks.rados.rados.0.smithi033.stdout:2867: seq_num 869 ranges {2334720=155648} 2021-07-26T16:07:20.225 INFO:tasks.rados.rados.0.smithi033.stdout:2867: writing smithi03339061-22 from 2334720 to 2490368 tid 1 2021-07-26T16:07:20.225 INFO:tasks.rados.rados.0.smithi033.stdout:2868: delete oid 47 current snap is 285 2021-07-26T16:07:20.225 INFO:tasks.rados.rados.0.smithi033.stdout:2866: finishing rollback tid 0 to smithi03339061-24 2021-07-26T16:07:20.225 INFO:tasks.rados.rados.0.smithi033.stdout:2866: finishing rollback tid 1 to smithi03339061-24 2021-07-26T16:07:20.226 INFO:tasks.rados.rados.0.smithi033.stdout:2866: finishing rollback tid 2 to smithi03339061-24 2021-07-26T16:07:20.226 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1465 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:07:20.229 INFO:tasks.rados.rados.0.smithi033.stdout:2866: done (2 left) 2021-07-26T16:07:20.229 INFO:tasks.rados.rados.0.smithi033.stdout:2868: done (1 left) 2021-07-26T16:07:20.229 INFO:tasks.rados.rados.0.smithi033.stdout:2869: copy_from oid 42 from oid 30 current snap is 285 2021-07-26T16:07:20.229 INFO:tasks.rados.rados.0.smithi033.stdout:2870: setattr oid 16 current snap is 285 2021-07-26T16:07:20.230 INFO:tasks.rados.rados.0.smithi033.stdout:2867: finishing write tid 1 to smithi03339061-22 2021-07-26T16:07:20.230 INFO:tasks.rados.rados.0.smithi033.stdout:2867: finishing write tid 2 to smithi03339061-22 2021-07-26T16:07:20.231 INFO:tasks.rados.rados.0.smithi033.stdout:2871: rollback oid 43 current snap is 285 2021-07-26T16:07:20.232 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 43 to 248 2021-07-26T16:07:20.232 INFO:tasks.rados.rados.0.smithi033.stdout:2872: rmattr oid 25 current snap is 285 2021-07-26T16:07:20.232 INFO:tasks.rados.rados.0.smithi033.stdout:2872: done (4 left) 2021-07-26T16:07:20.232 INFO:tasks.rados.rados.0.smithi033.stdout:2873: rollback oid 15 current snap is 285 2021-07-26T16:07:20.233 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 15 to 283 2021-07-26T16:07:20.233 INFO:tasks.rados.rados.0.smithi033.stdout:2874: copy_from oid 46 from oid 9 current snap is 285 2021-07-26T16:07:20.233 INFO:tasks.rados.rados.0.smithi033.stdout:2875: rollback oid 21 current snap is 285 2021-07-26T16:07:20.233 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 21 to 275 2021-07-26T16:07:20.233 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 285 2021-07-26T16:07:20.234 INFO:tasks.rados.rados.0.smithi033.stdout:2876: seq_num 871 ranges {13475840=188416} 2021-07-26T16:07:20.310 INFO:tasks.rados.rados.0.smithi033.stdout:2876: writing smithi03339061-11 from 13475840 to 13664256 tid 1 2021-07-26T16:07:20.310 INFO:tasks.rados.rados.0.smithi033.stdout:2877: read oid 23 snap 260 2021-07-26T16:07:20.311 INFO:tasks.rados.rados.0.smithi033.stdout:2877: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:07:20.311 INFO:tasks.rados.rados.0.smithi033.stdout:2878: read oid 44 snap -1 2021-07-26T16:07:20.311 INFO:tasks.rados.rados.0.smithi033.stdout:2878: expect deleted 2021-07-26T16:07:20.312 INFO:tasks.rados.rados.0.smithi033.stdout:2879: delete oid 34 current snap is 285 2021-07-26T16:07:20.312 INFO:tasks.rados.rados.0.smithi033.stdout:2867: finishing write tid 3 to smithi03339061-22 2021-07-26T16:07:20.312 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1725 (ObjNum 869 snap 285 seq_num 869) dirty exists 2021-07-26T16:07:20.312 INFO:tasks.rados.rados.0.smithi033.stdout:2867: left oid 22 (ObjNum 869 snap 285 seq_num 869) 2021-07-26T16:07:20.312 INFO:tasks.rados.rados.0.smithi033.stdout:2875: finishing rollback tid 0 to smithi03339061-21 2021-07-26T16:07:20.313 INFO:tasks.rados.rados.0.smithi033.stdout:2873: finishing rollback tid 0 to smithi03339061-15 2021-07-26T16:07:20.313 INFO:tasks.rados.rados.0.smithi033.stdout:2875: finishing rollback tid 1 to smithi03339061-21 2021-07-26T16:07:20.313 INFO:tasks.rados.rados.0.smithi033.stdout:2873: finishing rollback tid 1 to smithi03339061-15 2021-07-26T16:07:20.313 INFO:tasks.rados.rados.0.smithi033.stdout:2871: finishing rollback tid 0 to smithi03339061-43 2021-07-26T16:07:20.314 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1323 (ObjNum 795 snap 266 seq_num 795) dirty exists 2021-07-26T16:07:20.314 INFO:tasks.rados.rados.0.smithi033.stdout:2871: finishing rollback tid 1 to smithi03339061-43 2021-07-26T16:07:20.314 INFO:tasks.rados.rados.0.smithi033.stdout:2873: finishing rollback tid 2 to smithi03339061-15 2021-07-26T16:07:20.314 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 922 (ObjNum 768 snap 255 seq_num 768) dirty exists 2021-07-26T16:07:20.314 INFO:tasks.rados.rados.0.smithi033.stdout:2871: finishing rollback tid 2 to smithi03339061-43 2021-07-26T16:07:20.315 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 1272 (ObjNum 733 snap 246 seq_num 733) dirty exists 2021-07-26T16:07:20.315 INFO:tasks.rados.rados.0.smithi033.stdout:2875: finishing rollback tid 2 to smithi03339061-21 2021-07-26T16:07:20.315 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1411 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:07:20.315 INFO:tasks.rados.rados.0.smithi033.stdout:2874: finishing copy_from to smithi03339061-46 2021-07-26T16:07:20.316 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1260 (ObjNum 836 snap 277 seq_num 836) dirty exists 2021-07-26T16:07:20.316 INFO:tasks.rados.rados.0.smithi033.stdout:2874: finishing copy_from racing read to smithi03339061-46 2021-07-26T16:07:20.316 INFO:tasks.rados.rados.0.smithi033.stdout:2869: finishing copy_from to smithi03339061-42 2021-07-26T16:07:20.316 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1462 (ObjNum 864 snap 283 seq_num 864) dirty exists 2021-07-26T16:07:20.316 INFO:tasks.rados.rados.0.smithi033.stdout:2869: finishing copy_from racing read to smithi03339061-42 2021-07-26T16:07:20.321 INFO:tasks.rados.rados.0.smithi033.stdout:2877: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:07:20.395 INFO:tasks.rados.rados.0.smithi033.stdout:2876: finishing write tid 1 to smithi03339061-11 2021-07-26T16:07:20.396 INFO:tasks.rados.rados.0.smithi033.stdout:2876: finishing write tid 2 to smithi03339061-11 2021-07-26T16:07:20.396 INFO:tasks.rados.rados.0.smithi033.stdout:2876: finishing write tid 3 to smithi03339061-11 2021-07-26T16:07:20.396 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1319 (ObjNum 871 snap 285 seq_num 871) dirty exists 2021-07-26T16:07:20.396 INFO:tasks.rados.rados.0.smithi033.stdout:2876: left oid 11 (ObjNum 871 snap 285 seq_num 871) 2021-07-26T16:07:20.396 INFO:tasks.rados.rados.0.smithi033.stdout:2867: done (10 left) 2021-07-26T16:07:20.397 INFO:tasks.rados.rados.0.smithi033.stdout:2869: done (9 left) 2021-07-26T16:07:20.397 INFO:tasks.rados.rados.0.smithi033.stdout:2870: done (8 left) 2021-07-26T16:07:20.397 INFO:tasks.rados.rados.0.smithi033.stdout:2871: done (7 left) 2021-07-26T16:07:20.397 INFO:tasks.rados.rados.0.smithi033.stdout:2873: done (6 left) 2021-07-26T16:07:20.398 INFO:tasks.rados.rados.0.smithi033.stdout:2874: done (5 left) 2021-07-26T16:07:20.398 INFO:tasks.rados.rados.0.smithi033.stdout:2875: done (4 left) 2021-07-26T16:07:20.398 INFO:tasks.rados.rados.0.smithi033.stdout:2876: done (3 left) 2021-07-26T16:07:20.398 INFO:tasks.rados.rados.0.smithi033.stdout:2877: done (2 left) 2021-07-26T16:07:20.398 INFO:tasks.rados.rados.0.smithi033.stdout:2878: done (1 left) 2021-07-26T16:07:20.399 INFO:tasks.rados.rados.0.smithi033.stdout:2879: done (0 left) 2021-07-26T16:07:20.399 INFO:tasks.rados.rados.0.smithi033.stdout:2880: delete oid 12 current snap is 285 2021-07-26T16:07:20.400 INFO:tasks.rados.rados.0.smithi033.stdout:2880: done (0 left) 2021-07-26T16:07:20.401 INFO:tasks.rados.rados.0.smithi033.stdout:2881: read oid 45 snap -1 2021-07-26T16:07:20.401 INFO:tasks.rados.rados.0.smithi033.stdout:2881: expect (ObjNum 866 snap 284 seq_num 866) 2021-07-26T16:07:20.401 INFO:tasks.rados.rados.0.smithi033.stdout:2882: copy_from oid 44 from oid 31 current snap is 285 2021-07-26T16:07:20.401 INFO:tasks.rados.rados.0.smithi033.stdout:2883: rollback oid 4 current snap is 285 2021-07-26T16:07:20.401 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 4 to 283 2021-07-26T16:07:20.402 INFO:tasks.rados.rados.0.smithi033.stdout:2884: snap_create 2021-07-26T16:07:20.410 INFO:tasks.rados.rados.0.smithi033.stdout:2883: finishing rollback tid 0 to smithi03339061-4 2021-07-26T16:07:20.410 INFO:tasks.rados.rados.0.smithi033.stdout:2883: finishing rollback tid 1 to smithi03339061-4 2021-07-26T16:07:20.411 INFO:tasks.rados.rados.0.smithi033.stdout:2881: expect (ObjNum 866 snap 284 seq_num 866) 2021-07-26T16:07:20.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:20 smithi033 bash[42377]: cluster 2021-07-26T16:07:19.146317+0000 mgr.y (mgr.34104) 401 : cluster [DBG] pgmap v757: 25 pgs: 25 active+clean; 579 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.4 MiB/s wr, 25 op/s 2021-07-26T16:07:20.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:20 smithi033 bash[42377]: cluster 2021-07-26T16:07:19.200214+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e626: 8 total, 8 up, 8 in 2021-07-26T16:07:20.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:20 smithi033 bash[41341]: cluster 2021-07-26T16:07:19.146317+0000 mgr.y (mgr.34104) 401 : cluster [DBG] pgmap v757: 25 pgs: 25 active+clean; 579 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.4 MiB/s wr, 25 op/s 2021-07-26T16:07:20.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:20 smithi033 bash[41341]: cluster 2021-07-26T16:07:19.200214+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e626: 8 total, 8 up, 8 in 2021-07-26T16:07:20.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:20 smithi096 bash[33981]: cluster 2021-07-26T16:07:19.146317+0000 mgr.y (mgr.34104) 401 : cluster [DBG] pgmap v757: 25 pgs: 25 active+clean; 579 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.4 MiB/s wr, 25 op/s 2021-07-26T16:07:20.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:20 smithi096 bash[33981]: cluster 2021-07-26T16:07:19.200214+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e626: 8 total, 8 up, 8 in 2021-07-26T16:07:20.512 INFO:tasks.rados.rados.0.smithi033.stdout:2883: finishing rollback tid 2 to smithi03339061-4 2021-07-26T16:07:20.512 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1345 (ObjNum 858 snap 283 seq_num 858) dirty exists 2021-07-26T16:07:20.512 INFO:tasks.rados.rados.0.smithi033.stdout:2882: finishing copy_from to smithi03339061-44 2021-07-26T16:07:20.512 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1377 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:07:20.513 INFO:tasks.rados.rados.0.smithi033.stdout:2882: finishing copy_from racing read to smithi03339061-44 2021-07-26T16:07:21.184 INFO:tasks.rados.rados.0.smithi033.stdout:2881: done (3 left) 2021-07-26T16:07:21.184 INFO:tasks.rados.rados.0.smithi033.stdout:2882: done (2 left) 2021-07-26T16:07:21.185 INFO:tasks.rados.rados.0.smithi033.stdout:2883: done (1 left) 2021-07-26T16:07:21.185 INFO:tasks.rados.rados.0.smithi033.stdout:2884: done (0 left) 2021-07-26T16:07:21.185 INFO:tasks.rados.rados.0.smithi033.stdout:2885: snap_create 2021-07-26T16:07:21.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:21 smithi096 bash[33981]: cluster 2021-07-26T16:07:20.201977+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e627: 8 total, 8 up, 8 in 2021-07-26T16:07:21.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:21 smithi096 bash[33981]: audit 2021-07-26T16:07:20.852255+0000 mon.c (mon.1) 258 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:07:21.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:21 smithi096 bash[33981]: audit 2021-07-26T16:07:20.855368+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:07:21.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:21 smithi096 bash[33981]: audit 2021-07-26T16:07:20.857654+0000 mon.c (mon.1) 260 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:07:21.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:21 smithi096 bash[33981]: audit 2021-07-26T16:07:21.126323+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:07:21.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:21 smithi096 bash[33981]: cluster 2021-07-26T16:07:21.179516+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e628: 8 total, 8 up, 8 in 2021-07-26T16:07:21.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[42377]: cluster 2021-07-26T16:07:20.201977+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e627: 8 total, 8 up, 8 in 2021-07-26T16:07:21.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[42377]: audit 2021-07-26T16:07:20.852255+0000 mon.c (mon.1) 258 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:07:21.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[42377]: audit 2021-07-26T16:07:20.855368+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:07:21.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[42377]: audit 2021-07-26T16:07:20.857654+0000 mon.c (mon.1) 260 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:07:21.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[42377]: audit 2021-07-26T16:07:21.126323+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:07:21.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[42377]: cluster 2021-07-26T16:07:21.179516+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e628: 8 total, 8 up, 8 in 2021-07-26T16:07:21.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[41341]: cluster 2021-07-26T16:07:20.201977+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e627: 8 total, 8 up, 8 in 2021-07-26T16:07:21.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[41341]: audit 2021-07-26T16:07:20.852255+0000 mon.c (mon.1) 258 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:07:21.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[41341]: audit 2021-07-26T16:07:20.855368+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:07:21.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[41341]: audit 2021-07-26T16:07:20.857654+0000 mon.c (mon.1) 260 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:07:21.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[41341]: audit 2021-07-26T16:07:21.126323+0000 mon.a (mon.0) 996 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:07:21.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:21 smithi033 bash[41341]: cluster 2021-07-26T16:07:21.179516+0000 mon.a (mon.0) 997 : cluster [DBG] osdmap e628: 8 total, 8 up, 8 in 2021-07-26T16:07:22.195 INFO:tasks.rados.rados.0.smithi033.stdout:2885: done (0 left) 2021-07-26T16:07:22.195 INFO:tasks.rados.rados.0.smithi033.stdout:2886: delete oid 22 current snap is 287 2021-07-26T16:07:22.200 INFO:tasks.rados.rados.0.smithi033.stdout:2886: done (0 left) 2021-07-26T16:07:22.200 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 287 2021-07-26T16:07:22.201 INFO:tasks.rados.rados.0.smithi033.stdout:2887: seq_num 875 ranges {0=262144} 2021-07-26T16:07:22.202 INFO:tasks.rados.rados.0.smithi033.stdout:2887: writing smithi03339061-47 from 0 to 262144 tid 1 2021-07-26T16:07:22.203 INFO:tasks.rados.rados.0.smithi033.stdout:2888: setattr oid 7 current snap is 287 2021-07-26T16:07:22.205 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 287 2021-07-26T16:07:22.205 INFO:tasks.rados.rados.0.smithi033.stdout:2889: seq_num 876 ranges {4669440=278528} 2021-07-26T16:07:22.235 INFO:tasks.rados.rados.0.smithi033.stdout:2889: writing smithi03339061-2 from 4669440 to 4947968 tid 1 2021-07-26T16:07:22.235 INFO:tasks.rados.rados.0.smithi033.stdout:2890: rmattr oid 28 current snap is 287 2021-07-26T16:07:22.235 INFO:tasks.rados.rados.0.smithi033.stdout:2890: done (3 left) 2021-07-26T16:07:22.236 INFO:tasks.rados.rados.0.smithi033.stdout:2891: snap_create 2021-07-26T16:07:22.236 INFO:tasks.rados.rados.0.smithi033.stdout:2887: finishing write tid 1 to smithi03339061-47 2021-07-26T16:07:22.236 INFO:tasks.rados.rados.0.smithi033.stdout:2887: finishing write tid 2 to smithi03339061-47 2021-07-26T16:07:22.236 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1412 (ObjNum 865 snap 283 seq_num 865) dirty exists 2021-07-26T16:07:22.236 INFO:tasks.rados.rados.0.smithi033.stdout:2887: finishing write tid 3 to smithi03339061-47 2021-07-26T16:07:22.237 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1468 (ObjNum 875 snap 287 seq_num 875) dirty exists 2021-07-26T16:07:22.237 INFO:tasks.rados.rados.0.smithi033.stdout:2887: left oid 47 (ObjNum 875 snap 287 seq_num 875) 2021-07-26T16:07:22.241 INFO:tasks.rados.rados.0.smithi033.stdout:2889: finishing write tid 1 to smithi03339061-2 2021-07-26T16:07:22.242 INFO:tasks.rados.rados.0.smithi033.stdout:2889: finishing write tid 2 to smithi03339061-2 2021-07-26T16:07:22.244 INFO:tasks.rados.rados.0.smithi033.stdout:2889: finishing write tid 3 to smithi03339061-2 2021-07-26T16:07:22.244 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1404 (ObjNum 876 snap 287 seq_num 876) dirty exists 2021-07-26T16:07:22.245 INFO:tasks.rados.rados.0.smithi033.stdout:2889: left oid 2 (ObjNum 876 snap 287 seq_num 876) 2021-07-26T16:07:22.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:22 smithi033 bash[42377]: cluster 2021-07-26T16:07:21.146971+0000 mgr.y (mgr.34104) 402 : cluster [DBG] pgmap v760: 25 pgs: 25 active+clean; 597 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 4.9 MiB/s wr, 36 op/s 2021-07-26T16:07:22.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:22 smithi033 bash[42377]: audit 2021-07-26T16:07:21.383465+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:07:22.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:22 smithi033 bash[42377]: cluster 2021-07-26T16:07:22.191601+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e629: 8 total, 8 up, 8 in 2021-07-26T16:07:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:22 smithi033 bash[41341]: cluster 2021-07-26T16:07:21.146971+0000 mgr.y (mgr.34104) 402 : cluster [DBG] pgmap v760: 25 pgs: 25 active+clean; 597 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 4.9 MiB/s wr, 36 op/s 2021-07-26T16:07:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:22 smithi033 bash[41341]: audit 2021-07-26T16:07:21.383465+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:07:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:22 smithi033 bash[41341]: cluster 2021-07-26T16:07:22.191601+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e629: 8 total, 8 up, 8 in 2021-07-26T16:07:22.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:22 smithi096 bash[33981]: cluster 2021-07-26T16:07:21.146971+0000 mgr.y (mgr.34104) 402 : cluster [DBG] pgmap v760: 25 pgs: 25 active+clean; 597 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 4.9 MiB/s wr, 36 op/s 2021-07-26T16:07:22.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:22 smithi096 bash[33981]: audit 2021-07-26T16:07:21.383465+0000 mon.a (mon.0) 998 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:07:22.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:22 smithi096 bash[33981]: cluster 2021-07-26T16:07:22.191601+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e629: 8 total, 8 up, 8 in 2021-07-26T16:07:23.198 INFO:tasks.rados.rados.0.smithi033.stdout:2887: done (3 left) 2021-07-26T16:07:23.198 INFO:tasks.rados.rados.0.smithi033.stdout:2888: done (2 left) 2021-07-26T16:07:23.199 INFO:tasks.rados.rados.0.smithi033.stdout:2889: done (1 left) 2021-07-26T16:07:23.199 INFO:tasks.rados.rados.0.smithi033.stdout:2891: done (0 left) 2021-07-26T16:07:23.199 INFO:tasks.rados.rados.0.smithi033.stdout:2892: copy_from oid 26 from oid 49 current snap is 288 2021-07-26T16:07:23.199 INFO:tasks.rados.rados.0.smithi033.stdout:2893: setattr oid 24 current snap is 288 2021-07-26T16:07:23.200 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 16 current snap is 288 2021-07-26T16:07:23.200 INFO:tasks.rados.rados.0.smithi033.stdout:2894: seq_num 877 ranges {11984896=294912} 2021-07-26T16:07:23.273 INFO:tasks.rados.rados.0.smithi033.stdout:2894: writing smithi03339061-16 from 11984896 to 12279808 tid 1 2021-07-26T16:07:23.274 INFO:tasks.rados.rados.0.smithi033.stdout:2895: delete oid 41 current snap is 288 2021-07-26T16:07:23.274 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1469 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:07:23.282 INFO:tasks.rados.rados.0.smithi033.stdout:2893: done (3 left) 2021-07-26T16:07:23.282 INFO:tasks.rados.rados.0.smithi033.stdout:2895: done (2 left) 2021-07-26T16:07:23.282 INFO:tasks.rados.rados.0.smithi033.stdout:2896: rmattr oid 21 current snap is 288 2021-07-26T16:07:23.283 INFO:tasks.rados.rados.0.smithi033.stdout:2896: done (2 left) 2021-07-26T16:07:23.283 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 288 2021-07-26T16:07:23.283 INFO:tasks.rados.rados.0.smithi033.stdout:2897: seq_num 879 ranges {90112=327680} 2021-07-26T16:07:23.285 INFO:tasks.rados.rados.0.smithi033.stdout:2897: writing smithi03339061-7 from 90112 to 417792 tid 1 2021-07-26T16:07:23.286 INFO:tasks.rados.rados.0.smithi033.stdout:2898: snap_create 2021-07-26T16:07:23.286 INFO:tasks.rados.rados.0.smithi033.stdout:2894: finishing write tid 1 to smithi03339061-16 2021-07-26T16:07:23.290 INFO:tasks.rados.rados.0.smithi033.stdout:2894: finishing write tid 2 to smithi03339061-16 2021-07-26T16:07:23.290 INFO:tasks.rados.rados.0.smithi033.stdout:2894: finishing write tid 3 to smithi03339061-16 2021-07-26T16:07:23.290 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1325 (ObjNum 877 snap 288 seq_num 877) dirty exists 2021-07-26T16:07:23.291 INFO:tasks.rados.rados.0.smithi033.stdout:2894: left oid 16 (ObjNum 877 snap 288 seq_num 877) 2021-07-26T16:07:23.295 INFO:tasks.rados.rados.0.smithi033.stdout:2897: finishing write tid 1 to smithi03339061-7 2021-07-26T16:07:23.295 INFO:tasks.rados.rados.0.smithi033.stdout:2897: finishing write tid 2 to smithi03339061-7 2021-07-26T16:07:23.296 INFO:tasks.rados.rados.0.smithi033.stdout:2897: finishing write tid 3 to smithi03339061-7 2021-07-26T16:07:23.296 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1414 (ObjNum 879 snap 288 seq_num 879) dirty exists 2021-07-26T16:07:23.297 INFO:tasks.rados.rados.0.smithi033.stdout:2897: left oid 7 (ObjNum 879 snap 288 seq_num 879) 2021-07-26T16:07:23.302 INFO:tasks.rados.rados.0.smithi033.stdout:2892: finishing copy_from to smithi03339061-26 2021-07-26T16:07:23.302 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 918 (ObjNum 860 snap 283 seq_num 860) dirty exists 2021-07-26T16:07:23.304 INFO:tasks.rados.rados.0.smithi033.stdout:2892: finishing copy_from racing read to smithi03339061-26 2021-07-26T16:07:23.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:07:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:07:23.516Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:07:23.958 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:07:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:07:23.515Z caller=notify.go:372 component=dispatcher msg="Error on notify" err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs" context_err="context deadline exceeded" 2021-07-26T16:07:23.959 INFO:journalctl@ceph.alertmanager.a.smithi033.stdout:Jul 26 16:07:23 smithi033 bash[50539]: level=error ts=2021-07-26T16:07:23.516Z caller=dispatch.go:301 component=dispatcher msg="Notify for alerts failed" num_alerts=11 err="Post https://172.21.15.96:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.96 because it doesn't contain any IP SANs; Post https://172.21.15.33:8443/api/prometheus_receiver: x509: cannot validate certificate for 172.21.15.33 because it doesn't contain any IP SANs" 2021-07-26T16:07:24.207 INFO:tasks.rados.rados.0.smithi033.stdout:2892: done (3 left) 2021-07-26T16:07:24.207 INFO:tasks.rados.rados.0.smithi033.stdout:2894: done (2 left) 2021-07-26T16:07:24.208 INFO:tasks.rados.rados.0.smithi033.stdout:2897: done (1 left) 2021-07-26T16:07:24.208 INFO:tasks.rados.rados.0.smithi033.stdout:2898: done (0 left) 2021-07-26T16:07:24.208 INFO:tasks.rados.rados.0.smithi033.stdout:2899: delete oid 25 current snap is 289 2021-07-26T16:07:24.213 INFO:tasks.rados.rados.0.smithi033.stdout:2899: done (0 left) 2021-07-26T16:07:24.213 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 289 2021-07-26T16:07:24.214 INFO:tasks.rados.rados.0.smithi033.stdout:2900: seq_num 881 ranges {2187264=360448} 2021-07-26T16:07:24.230 INFO:tasks.rados.rados.0.smithi033.stdout:2900: writing smithi03339061-45 from 2187264 to 2547712 tid 1 2021-07-26T16:07:24.231 INFO:tasks.rados.rados.0.smithi033.stdout:2901: read oid 17 snap -1 2021-07-26T16:07:24.231 INFO:tasks.rados.rados.0.smithi033.stdout:2901: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:07:24.231 INFO:tasks.rados.rados.0.smithi033.stdout:2902: snap_create 2021-07-26T16:07:24.240 INFO:tasks.rados.rados.0.smithi033.stdout:2900: finishing write tid 1 to smithi03339061-45 2021-07-26T16:07:24.240 INFO:tasks.rados.rados.0.smithi033.stdout:2900: finishing write tid 2 to smithi03339061-45 2021-07-26T16:07:24.243 INFO:tasks.rados.rados.0.smithi033.stdout:2900: finishing write tid 3 to smithi03339061-45 2021-07-26T16:07:24.243 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1731 (ObjNum 881 snap 289 seq_num 881) dirty exists 2021-07-26T16:07:24.243 INFO:tasks.rados.rados.0.smithi033.stdout:2900: left oid 45 (ObjNum 881 snap 289 seq_num 881) 2021-07-26T16:07:24.267 INFO:tasks.rados.rados.0.smithi033.stdout:2901: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:07:24.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:24 smithi033 bash[42377]: cluster 2021-07-26T16:07:23.147691+0000 mgr.y (mgr.34104) 403 : cluster [DBG] pgmap v763: 25 pgs: 25 active+clean; 606 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 5.1 MiB/s wr, 55 op/s 2021-07-26T16:07:24.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:24 smithi033 bash[42377]: cluster 2021-07-26T16:07:23.195054+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e630: 8 total, 8 up, 8 in 2021-07-26T16:07:24.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:24 smithi033 bash[41341]: cluster 2021-07-26T16:07:23.147691+0000 mgr.y (mgr.34104) 403 : cluster [DBG] pgmap v763: 25 pgs: 25 active+clean; 606 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 5.1 MiB/s wr, 55 op/s 2021-07-26T16:07:24.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:24 smithi033 bash[41341]: cluster 2021-07-26T16:07:23.195054+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e630: 8 total, 8 up, 8 in 2021-07-26T16:07:24.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:24 smithi096 bash[33981]: cluster 2021-07-26T16:07:23.147691+0000 mgr.y (mgr.34104) 403 : cluster [DBG] pgmap v763: 25 pgs: 25 active+clean; 606 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 18 MiB/s rd, 5.1 MiB/s wr, 55 op/s 2021-07-26T16:07:24.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:24 smithi096 bash[33981]: cluster 2021-07-26T16:07:23.195054+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e630: 8 total, 8 up, 8 in 2021-07-26T16:07:25.223 INFO:tasks.rados.rados.0.smithi033.stdout:2900: done (2 left) 2021-07-26T16:07:25.223 INFO:tasks.rados.rados.0.smithi033.stdout:2901: done (1 left) 2021-07-26T16:07:25.223 INFO:tasks.rados.rados.0.smithi033.stdout:2902: done (0 left) 2021-07-26T16:07:25.223 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 290 2021-07-26T16:07:25.224 INFO:tasks.rados.rados.0.smithi033.stdout:2903: seq_num 882 ranges {0=376832} 2021-07-26T16:07:25.225 INFO:tasks.rados.rados.0.smithi033.stdout:2903: writing smithi03339061-12 from 0 to 376832 tid 1 2021-07-26T16:07:25.225 INFO:tasks.rados.rados.0.smithi033.stdout:2904: rollback oid 11 current snap is 290 2021-07-26T16:07:25.225 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 11 to 248 2021-07-26T16:07:25.225 INFO:tasks.rados.rados.0.smithi033.stdout:2905: rollback oid 5 current snap is 290 2021-07-26T16:07:25.226 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 5 to 260 2021-07-26T16:07:25.226 INFO:tasks.rados.rados.0.smithi033.stdout:2906: snap_create 2021-07-26T16:07:25.237 INFO:tasks.rados.rados.0.smithi033.stdout:2905: finishing rollback tid 0 to smithi03339061-5 2021-07-26T16:07:25.238 INFO:tasks.rados.rados.0.smithi033.stdout:2905: finishing rollback tid 1 to smithi03339061-5 2021-07-26T16:07:25.238 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 1275 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T16:07:25.239 INFO:tasks.rados.rados.0.smithi033.stdout:2903: finishing write tid 1 to smithi03339061-12 2021-07-26T16:07:25.239 INFO:tasks.rados.rados.0.smithi033.stdout:2904: finishing rollback tid 0 to smithi03339061-11 2021-07-26T16:07:25.239 INFO:tasks.rados.rados.0.smithi033.stdout:2903: finishing write tid 2 to smithi03339061-12 2021-07-26T16:07:25.240 INFO:tasks.rados.rados.0.smithi033.stdout:2904: finishing rollback tid 1 to smithi03339061-11 2021-07-26T16:07:25.240 INFO:tasks.rados.rados.0.smithi033.stdout:2904: finishing rollback tid 2 to smithi03339061-11 2021-07-26T16:07:25.241 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1323 (ObjNum 695 snap 229 seq_num 695) dirty exists 2021-07-26T16:07:25.241 INFO:tasks.rados.rados.0.smithi033.stdout:2903: finishing write tid 3 to smithi03339061-12 2021-07-26T16:07:25.241 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1406 (ObjNum 882 snap 290 seq_num 882) dirty exists 2021-07-26T16:07:25.242 INFO:tasks.rados.rados.0.smithi033.stdout:2903: left oid 12 (ObjNum 882 snap 290 seq_num 882) 2021-07-26T16:07:25.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:25 smithi096 bash[33981]: cluster 2021-07-26T16:07:24.201404+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e631: 8 total, 8 up, 8 in 2021-07-26T16:07:25.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:25 smithi033 bash[41341]: cluster 2021-07-26T16:07:24.201404+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e631: 8 total, 8 up, 8 in 2021-07-26T16:07:25.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:25 smithi033 bash[42377]: cluster 2021-07-26T16:07:24.201404+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e631: 8 total, 8 up, 8 in 2021-07-26T16:07:26.181 INFO:tasks.rados.rados.0.smithi033.stdout:2903: done (3 left) 2021-07-26T16:07:26.181 INFO:tasks.rados.rados.0.smithi033.stdout:2904: done (2 left) 2021-07-26T16:07:26.182 INFO:tasks.rados.rados.0.smithi033.stdout:2905: done (1 left) 2021-07-26T16:07:26.182 INFO:tasks.rados.rados.0.smithi033.stdout:2906: done (0 left) 2021-07-26T16:07:26.182 INFO:tasks.rados.rados.0.smithi033.stdout:2907: read oid 15 snap -1 2021-07-26T16:07:26.182 INFO:tasks.rados.rados.0.smithi033.stdout:2907: expect (ObjNum 768 snap 255 seq_num 768) 2021-07-26T16:07:26.183 INFO:tasks.rados.rados.0.smithi033.stdout:2908: rmattr oid 16 current snap is 291 2021-07-26T16:07:26.183 INFO:tasks.rados.rados.0.smithi033.stdout:2909: delete oid 1 current snap is 291 2021-07-26T16:07:26.192 INFO:tasks.rados.rados.0.smithi033.stdout:2909: done (2 left) 2021-07-26T16:07:26.193 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 291 2021-07-26T16:07:26.193 INFO:tasks.rados.rados.0.smithi033.stdout:2910: seq_num 884 ranges {6029312=409600} 2021-07-26T16:07:26.232 INFO:tasks.rados.rados.0.smithi033.stdout:2910: writing smithi03339061-19 from 6029312 to 6438912 tid 1 2021-07-26T16:07:26.232 INFO:tasks.rados.rados.0.smithi033.stdout:2911: read oid 32 snap -1 2021-07-26T16:07:26.233 INFO:tasks.rados.rados.0.smithi033.stdout:2911: expect (ObjNum 825 snap 274 seq_num 825) 2021-07-26T16:07:26.233 INFO:tasks.rados.rados.0.smithi033.stdout:2912: copy_from oid 3 from oid 18 current snap is 291 2021-07-26T16:07:26.233 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1327 (ObjNum 877 snap 288 seq_num 877) dirty exists 2021-07-26T16:07:26.233 INFO:tasks.rados.rados.0.smithi033.stdout:2908: done (4 left) 2021-07-26T16:07:26.233 INFO:tasks.rados.rados.0.smithi033.stdout:2913: delete oid 25 current snap is 291 2021-07-26T16:07:26.241 INFO:tasks.rados.rados.0.smithi033.stdout:2910: finishing write tid 1 to smithi03339061-19 2021-07-26T16:07:26.241 INFO:tasks.rados.rados.0.smithi033.stdout:2912: finishing copy_from to smithi03339061-3 2021-07-26T16:07:26.242 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1717 (ObjNum 1 snap 32561 seq_num 2008681752) dirty exists 2021-07-26T16:07:26.242 INFO:tasks.rados.rados.0.smithi033.stdout:2910: finishing write tid 2 to smithi03339061-19 2021-07-26T16:07:26.242 INFO:tasks.rados.rados.0.smithi033.stdout:2912: finishing copy_from racing read to smithi03339061-3 2021-07-26T16:07:26.245 INFO:tasks.rados.rados.0.smithi033.stdout:2907: expect (ObjNum 768 snap 255 seq_num 768) 2021-07-26T16:07:26.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:26 smithi096 bash[33981]: cluster 2021-07-26T16:07:25.148421+0000 mgr.y (mgr.34104) 404 : cluster [DBG] pgmap v766: 25 pgs: 25 active+clean; 612 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2021-07-26T16:07:26.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:26 smithi096 bash[33981]: cluster 2021-07-26T16:07:25.220171+0000 mon.a (mon.0) 1002 : cluster [DBG] osdmap e632: 8 total, 8 up, 8 in 2021-07-26T16:07:26.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:26 smithi096 bash[33981]: cluster 2021-07-26T16:07:26.177851+0000 mon.a (mon.0) 1003 : cluster [DBG] osdmap e633: 8 total, 8 up, 8 in 2021-07-26T16:07:26.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:26 smithi033 bash[42377]: cluster 2021-07-26T16:07:25.148421+0000 mgr.y (mgr.34104) 404 : cluster [DBG] pgmap v766: 25 pgs: 25 active+clean; 612 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2021-07-26T16:07:26.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:26 smithi033 bash[42377]: cluster 2021-07-26T16:07:25.220171+0000 mon.a (mon.0) 1002 : cluster [DBG] osdmap e632: 8 total, 8 up, 8 in 2021-07-26T16:07:26.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:26 smithi033 bash[42377]: cluster 2021-07-26T16:07:26.177851+0000 mon.a (mon.0) 1003 : cluster [DBG] osdmap e633: 8 total, 8 up, 8 in 2021-07-26T16:07:26.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:26 smithi033 bash[41341]: cluster 2021-07-26T16:07:25.148421+0000 mgr.y (mgr.34104) 404 : cluster [DBG] pgmap v766: 25 pgs: 25 active+clean; 612 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.0 MiB/s rd, 2.4 MiB/s wr, 29 op/s 2021-07-26T16:07:26.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:26 smithi033 bash[41341]: cluster 2021-07-26T16:07:25.220171+0000 mon.a (mon.0) 1002 : cluster [DBG] osdmap e632: 8 total, 8 up, 8 in 2021-07-26T16:07:26.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:26 smithi033 bash[41341]: cluster 2021-07-26T16:07:26.177851+0000 mon.a (mon.0) 1003 : cluster [DBG] osdmap e633: 8 total, 8 up, 8 in 2021-07-26T16:07:27.343 INFO:tasks.rados.rados.0.smithi033.stdout:2910: finishing write tid 3 to smithi03339061-19 2021-07-26T16:07:27.343 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 1265 (ObjNum 884 snap 291 seq_num 884) dirty exists 2021-07-26T16:07:27.343 INFO:tasks.rados.rados.0.smithi033.stdout:2910: left oid 19 (ObjNum 884 snap 291 seq_num 884) 2021-07-26T16:07:27.344 INFO:tasks.rados.rados.0.smithi033.stdout:2911: expect (ObjNum 825 snap 274 seq_num 825) 2021-07-26T16:07:27.454 INFO:tasks.rados.rados.0.smithi033.stdout:2907: done (4 left) 2021-07-26T16:07:27.455 INFO:tasks.rados.rados.0.smithi033.stdout:2910: done (3 left) 2021-07-26T16:07:27.455 INFO:tasks.rados.rados.0.smithi033.stdout:2911: done (2 left) 2021-07-26T16:07:27.455 INFO:tasks.rados.rados.0.smithi033.stdout:2912: done (1 left) 2021-07-26T16:07:27.456 INFO:tasks.rados.rados.0.smithi033.stdout:2913: done (0 left) 2021-07-26T16:07:27.456 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 291 2021-07-26T16:07:27.456 INFO:tasks.rados.rados.0.smithi033.stdout:2914: seq_num 886 ranges {417792=442368} 2021-07-26T16:07:27.466 INFO:tasks.rados.rados.0.smithi033.stdout:2914: writing smithi03339061-7 from 417792 to 860160 tid 1 2021-07-26T16:07:27.466 INFO:tasks.rados.rados.0.smithi033.stdout:2915: copy_from oid 36 from oid 21 current snap is 291 2021-07-26T16:07:27.466 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 291 2021-07-26T16:07:27.467 INFO:tasks.rados.rados.0.smithi033.stdout:2916: seq_num 887 ranges {2187264=458752} 2021-07-26T16:07:27.481 INFO:tasks.rados.rados.0.smithi033.stdout:2916: writing smithi03339061-31 from 2187264 to 2646016 tid 1 2021-07-26T16:07:27.482 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 291 2021-07-26T16:07:27.482 INFO:tasks.rados.rados.0.smithi033.stdout:2914: finishing write tid 1 to smithi03339061-7 2021-07-26T16:07:27.482 INFO:tasks.rados.rados.0.smithi033.stdout:2917: seq_num 888 ranges {0=475136} 2021-07-26T16:07:27.484 INFO:tasks.rados.rados.0.smithi033.stdout:2917: writing smithi03339061-18 from 0 to 475136 tid 1 2021-07-26T16:07:27.484 INFO:tasks.rados.rados.0.smithi033.stdout:2918: rmattr oid 33 current snap is 291 2021-07-26T16:07:27.485 INFO:tasks.rados.rados.0.smithi033.stdout:2918: done (4 left) 2021-07-26T16:07:27.485 INFO:tasks.rados.rados.0.smithi033.stdout:2919: snap_create 2021-07-26T16:07:27.485 INFO:tasks.rados.rados.0.smithi033.stdout:2914: finishing write tid 2 to smithi03339061-7 2021-07-26T16:07:27.485 INFO:tasks.rados.rados.0.smithi033.stdout:2914: finishing write tid 3 to smithi03339061-7 2021-07-26T16:07:27.486 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1416 (ObjNum 886 snap 291 seq_num 886) dirty exists 2021-07-26T16:07:27.486 INFO:tasks.rados.rados.0.smithi033.stdout:2914: left oid 7 (ObjNum 886 snap 291 seq_num 886) 2021-07-26T16:07:27.490 INFO:tasks.rados.rados.0.smithi033.stdout:2916: finishing write tid 1 to smithi03339061-31 2021-07-26T16:07:27.491 INFO:tasks.rados.rados.0.smithi033.stdout:2917: finishing write tid 1 to smithi03339061-18 2021-07-26T16:07:27.492 INFO:tasks.rados.rados.0.smithi033.stdout:2915: finishing copy_from to smithi03339061-36 2021-07-26T16:07:27.492 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1411 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:07:27.492 INFO:tasks.rados.rados.0.smithi033.stdout:2916: finishing write tid 2 to smithi03339061-31 2021-07-26T16:07:27.493 INFO:tasks.rados.rados.0.smithi033.stdout:2917: finishing write tid 2 to smithi03339061-18 2021-07-26T16:07:27.493 INFO:tasks.rados.rados.0.smithi033.stdout:2915: finishing copy_from racing read to smithi03339061-36 2021-07-26T16:07:27.494 INFO:tasks.rados.rados.0.smithi033.stdout:2916: finishing write tid 3 to smithi03339061-31 2021-07-26T16:07:27.494 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1379 (ObjNum 887 snap 291 seq_num 887) dirty exists 2021-07-26T16:07:27.495 INFO:tasks.rados.rados.0.smithi033.stdout:2916: left oid 31 (ObjNum 887 snap 291 seq_num 887) 2021-07-26T16:07:27.495 INFO:tasks.rados.rados.0.smithi033.stdout:2917: finishing write tid 3 to smithi03339061-18 2021-07-26T16:07:27.496 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 1734 (ObjNum 888 snap 291 seq_num 888) dirty exists 2021-07-26T16:07:27.496 INFO:tasks.rados.rados.0.smithi033.stdout:2917: left oid 18 (ObjNum 888 snap 291 seq_num 888) 2021-07-26T16:07:28.231 INFO:tasks.rados.rados.0.smithi033.stdout:2914: done (4 left) 2021-07-26T16:07:28.231 INFO:tasks.rados.rados.0.smithi033.stdout:2915: done (3 left) 2021-07-26T16:07:28.231 INFO:tasks.rados.rados.0.smithi033.stdout:2916: done (2 left) 2021-07-26T16:07:28.232 INFO:tasks.rados.rados.0.smithi033.stdout:2917: done (1 left) 2021-07-26T16:07:28.232 INFO:tasks.rados.rados.0.smithi033.stdout:2919: done (0 left) 2021-07-26T16:07:28.232 INFO:tasks.rados.rados.0.smithi033.stdout:2920: delete oid 7 current snap is 292 2021-07-26T16:07:28.236 INFO:tasks.rados.rados.0.smithi033.stdout:2920: done (0 left) 2021-07-26T16:07:28.236 INFO:tasks.rados.rados.0.smithi033.stdout:2921: snap_remove snap 291 2021-07-26T16:07:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:28 smithi096 bash[33981]: cluster 2021-07-26T16:07:27.149069+0000 mgr.y (mgr.34104) 405 : cluster [DBG] pgmap v769: 25 pgs: 25 active+clean; 614 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.3 MiB/s wr, 20 op/s 2021-07-26T16:07:28.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:28 smithi033 bash[41341]: cluster 2021-07-26T16:07:27.149069+0000 mgr.y (mgr.34104) 405 : cluster [DBG] pgmap v769: 25 pgs: 25 active+clean; 614 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.3 MiB/s wr, 20 op/s 2021-07-26T16:07:28.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:28 smithi033 bash[42377]: cluster 2021-07-26T16:07:27.149069+0000 mgr.y (mgr.34104) 405 : cluster [DBG] pgmap v769: 25 pgs: 25 active+clean; 614 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.3 MiB/s wr, 20 op/s 2021-07-26T16:07:29.235 INFO:tasks.rados.rados.0.smithi033.stdout:2921: done (0 left) 2021-07-26T16:07:29.235 INFO:tasks.rados.rados.0.smithi033.stdout:2922: read oid 20 snap -1 2021-07-26T16:07:29.236 INFO:tasks.rados.rados.0.smithi033.stdout:2922: expect (ObjNum 773 snap 255 seq_num 773) 2021-07-26T16:07:29.236 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 292 2021-07-26T16:07:29.236 INFO:tasks.rados.rados.0.smithi033.stdout:2923: seq_num 890 ranges {2473984=507904} 2021-07-26T16:07:29.254 INFO:tasks.rados.rados.0.smithi033.stdout:2923: writing smithi03339061-29 from 2473984 to 2981888 tid 1 2021-07-26T16:07:29.254 INFO:tasks.rados.rados.0.smithi033.stdout:2924: read oid 23 snap 272 2021-07-26T16:07:29.254 INFO:tasks.rados.rados.0.smithi033.stdout:2924: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:07:29.255 INFO:tasks.rados.rados.0.smithi033.stdout:2925: read oid 16 snap -1 2021-07-26T16:07:29.255 INFO:tasks.rados.rados.0.smithi033.stdout:2925: expect (ObjNum 877 snap 288 seq_num 877) 2021-07-26T16:07:29.255 INFO:tasks.rados.rados.0.smithi033.stdout:2926: read oid 30 snap 243 2021-07-26T16:07:29.255 INFO:tasks.rados.rados.0.smithi033.stdout:2926: expect (ObjNum 649 snap 206 seq_num 649) 2021-07-26T16:07:29.256 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 292 2021-07-26T16:07:29.256 INFO:tasks.rados.rados.0.smithi033.stdout:2922: expect (ObjNum 773 snap 255 seq_num 773) 2021-07-26T16:07:29.323 INFO:tasks.rados.rados.0.smithi033.stdout:2926: expect (ObjNum 649 snap 206 seq_num 649) 2021-07-26T16:07:29.363 INFO:tasks.rados.rados.0.smithi033.stdout:2923: finishing write tid 1 to smithi03339061-29 2021-07-26T16:07:29.363 INFO:tasks.rados.rados.0.smithi033.stdout:2923: finishing write tid 2 to smithi03339061-29 2021-07-26T16:07:29.363 INFO:tasks.rados.rados.0.smithi033.stdout:2923: finishing write tid 3 to smithi03339061-29 2021-07-26T16:07:29.363 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1278 (ObjNum 890 snap 292 seq_num 890) dirty exists 2021-07-26T16:07:29.364 INFO:tasks.rados.rados.0.smithi033.stdout:2923: left oid 29 (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:07:29.364 INFO:tasks.rados.rados.0.smithi033.stdout:2924: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:07:29.434 INFO:tasks.rados.rados.0.smithi033.stdout:2925: expect (ObjNum 877 snap 288 seq_num 877) 2021-07-26T16:07:29.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:29 smithi033 bash[41341]: cluster 2021-07-26T16:07:28.228550+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e634: 8 total, 8 up, 8 in 2021-07-26T16:07:29.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:29 smithi033 bash[42377]: cluster 2021-07-26T16:07:28.228550+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e634: 8 total, 8 up, 8 in 2021-07-26T16:07:29.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:29 smithi096 bash[33981]: cluster 2021-07-26T16:07:28.228550+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e634: 8 total, 8 up, 8 in 2021-07-26T16:07:30.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:30 smithi033 bash[41341]: cluster 2021-07-26T16:07:29.149710+0000 mgr.y (mgr.34104) 406 : cluster [DBG] pgmap v771: 25 pgs: 25 active+clean; 632 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.8 MiB/s rd, 4.6 MiB/s wr, 23 op/s 2021-07-26T16:07:30.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:30 smithi033 bash[41341]: cluster 2021-07-26T16:07:29.231550+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e635: 8 total, 8 up, 8 in 2021-07-26T16:07:30.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:30 smithi033 bash[42377]: cluster 2021-07-26T16:07:29.149710+0000 mgr.y (mgr.34104) 406 : cluster [DBG] pgmap v771: 25 pgs: 25 active+clean; 632 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.8 MiB/s rd, 4.6 MiB/s wr, 23 op/s 2021-07-26T16:07:30.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:30 smithi033 bash[42377]: cluster 2021-07-26T16:07:29.231550+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e635: 8 total, 8 up, 8 in 2021-07-26T16:07:30.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:30 smithi096 bash[33981]: cluster 2021-07-26T16:07:29.149710+0000 mgr.y (mgr.34104) 406 : cluster [DBG] pgmap v771: 25 pgs: 25 active+clean; 632 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.8 MiB/s rd, 4.6 MiB/s wr, 23 op/s 2021-07-26T16:07:30.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:30 smithi096 bash[33981]: cluster 2021-07-26T16:07:29.231550+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e635: 8 total, 8 up, 8 in 2021-07-26T16:07:30.932 INFO:tasks.rados.rados.0.smithi033.stdout:2927: seq_num 891 ranges {0=532480} 2021-07-26T16:07:30.941 INFO:tasks.rados.rados.0.smithi033.stdout:2927: writing smithi03339061-6 from 0 to 532480 tid 1 2021-07-26T16:07:30.942 INFO:tasks.rados.rados.0.smithi033.stdout:2922: done (5 left) 2021-07-26T16:07:30.942 INFO:tasks.rados.rados.0.smithi033.stdout:2923: done (4 left) 2021-07-26T16:07:30.942 INFO:tasks.rados.rados.0.smithi033.stdout:2924: done (3 left) 2021-07-26T16:07:30.942 INFO:tasks.rados.rados.0.smithi033.stdout:2925: done (2 left) 2021-07-26T16:07:30.942 INFO:tasks.rados.rados.0.smithi033.stdout:2926: done (1 left) 2021-07-26T16:07:30.943 INFO:tasks.rados.rados.0.smithi033.stdout:2928: setattr oid 40 current snap is 292 2021-07-26T16:07:30.946 INFO:tasks.rados.rados.0.smithi033.stdout:2929: read oid 43 snap -1 2021-07-26T16:07:30.946 INFO:tasks.rados.rados.0.smithi033.stdout:2929: expect (ObjNum 733 snap 246 seq_num 733) 2021-07-26T16:07:30.947 INFO:tasks.rados.rados.0.smithi033.stdout:2930: read oid 50 snap -1 2021-07-26T16:07:30.947 INFO:tasks.rados.rados.0.smithi033.stdout:2930: expect (ObjNum 851 snap 282 seq_num 851) 2021-07-26T16:07:30.947 INFO:tasks.rados.rados.0.smithi033.stdout:2931: copy_from oid 33 from oid 13 current snap is 292 2021-07-26T16:07:30.948 INFO:tasks.rados.rados.0.smithi033.stdout:2932: read oid 16 snap 289 2021-07-26T16:07:30.948 INFO:tasks.rados.rados.0.smithi033.stdout:2932: expect (ObjNum 877 snap 288 seq_num 877) 2021-07-26T16:07:30.948 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 17 current snap is 292 2021-07-26T16:07:30.948 INFO:tasks.rados.rados.0.smithi033.stdout:2933: seq_num 892 ranges {6995968=548864} 2021-07-26T16:07:30.990 INFO:tasks.rados.rados.0.smithi033.stdout:2933: writing smithi03339061-17 from 6995968 to 7544832 tid 1 2021-07-26T16:07:30.990 INFO:tasks.rados.rados.0.smithi033.stdout:2934: read oid 14 snap -1 2021-07-26T16:07:30.991 INFO:tasks.rados.rados.0.smithi033.stdout:2934: expect (ObjNum 829 snap 275 seq_num 829) 2021-07-26T16:07:30.991 INFO:tasks.rados.rados.0.smithi033.stdout:2935: snap_create 2021-07-26T16:07:30.991 INFO:tasks.rados.rados.0.smithi033.stdout:2927: finishing write tid 1 to smithi03339061-6 2021-07-26T16:07:30.991 INFO:tasks.rados.rados.0.smithi033.stdout:2927: finishing write tid 2 to smithi03339061-6 2021-07-26T16:07:30.991 INFO:tasks.rados.rados.0.smithi033.stdout:2927: finishing write tid 3 to smithi03339061-6 2021-07-26T16:07:30.992 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1736 (ObjNum 891 snap 292 seq_num 891) dirty exists 2021-07-26T16:07:30.992 INFO:tasks.rados.rados.0.smithi033.stdout:2927: left oid 6 (ObjNum 891 snap 292 seq_num 891) 2021-07-26T16:07:30.992 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 1395 (ObjNum 773 snap 255 seq_num 773) dirty exists 2021-07-26T16:07:30.992 INFO:tasks.rados.rados.0.smithi033.stdout:2929: expect (ObjNum 733 snap 246 seq_num 733) 2021-07-26T16:07:31.153 INFO:tasks.rados.rados.0.smithi033.stdout:2931: finishing copy_from to smithi03339061-33 2021-07-26T16:07:31.153 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 1290 (ObjNum 775 snap 256 seq_num 775) dirty exists 2021-07-26T16:07:31.154 INFO:tasks.rados.rados.0.smithi033.stdout:2931: finishing copy_from racing read to smithi03339061-33 2021-07-26T16:07:31.154 INFO:tasks.rados.rados.0.smithi033.stdout:2930: expect (ObjNum 851 snap 282 seq_num 851) 2021-07-26T16:07:31.558 INFO:tasks.rados.rados.0.smithi033.stdout:2933: finishing write tid 1 to smithi03339061-17 2021-07-26T16:07:31.558 INFO:tasks.rados.rados.0.smithi033.stdout:2933: finishing write tid 2 to smithi03339061-17 2021-07-26T16:07:31.558 INFO:tasks.rados.rados.0.smithi033.stdout:2933: finishing write tid 3 to smithi03339061-17 2021-07-26T16:07:31.559 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 1397 (ObjNum 892 snap 292 seq_num 892) dirty exists 2021-07-26T16:07:31.559 INFO:tasks.rados.rados.0.smithi033.stdout:2933: left oid 17 (ObjNum 892 snap 292 seq_num 892) 2021-07-26T16:07:31.559 INFO:tasks.rados.rados.0.smithi033.stdout:2934: expect (ObjNum 829 snap 275 seq_num 829) 2021-07-26T16:07:31.798 INFO:tasks.rados.rados.0.smithi033.stdout:2932: expect (ObjNum 877 snap 288 seq_num 877) 2021-07-26T16:07:32.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:32 smithi033 bash[41341]: cluster 2021-07-26T16:07:31.150410+0000 mgr.y (mgr.34104) 407 : cluster [DBG] pgmap v773: 25 pgs: 25 active+clean; 649 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 24 op/s 2021-07-26T16:07:32.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:32 smithi033 bash[41341]: cluster 2021-07-26T16:07:31.248918+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e636: 8 total, 8 up, 8 in 2021-07-26T16:07:32.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:32 smithi033 bash[42377]: cluster 2021-07-26T16:07:31.150410+0000 mgr.y (mgr.34104) 407 : cluster [DBG] pgmap v773: 25 pgs: 25 active+clean; 649 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 24 op/s 2021-07-26T16:07:32.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:32 smithi033 bash[42377]: cluster 2021-07-26T16:07:31.248918+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e636: 8 total, 8 up, 8 in 2021-07-26T16:07:32.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:32 smithi096 bash[33981]: cluster 2021-07-26T16:07:31.150410+0000 mgr.y (mgr.34104) 407 : cluster [DBG] pgmap v773: 25 pgs: 25 active+clean; 649 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 4.1 MiB/s wr, 24 op/s 2021-07-26T16:07:32.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:32 smithi096 bash[33981]: cluster 2021-07-26T16:07:31.248918+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e636: 8 total, 8 up, 8 in 2021-07-26T16:07:33.297 INFO:tasks.rados.rados.0.smithi033.stdout:2927: done (8 left) 2021-07-26T16:07:33.298 INFO:tasks.rados.rados.0.smithi033.stdout:2928: done (7 left) 2021-07-26T16:07:33.298 INFO:tasks.rados.rados.0.smithi033.stdout:2929: done (6 left) 2021-07-26T16:07:33.298 INFO:tasks.rados.rados.0.smithi033.stdout:2930: done (5 left) 2021-07-26T16:07:33.299 INFO:tasks.rados.rados.0.smithi033.stdout:2931: done (4 left) 2021-07-26T16:07:33.299 INFO:tasks.rados.rados.0.smithi033.stdout:2932: done (3 left) 2021-07-26T16:07:33.299 INFO:tasks.rados.rados.0.smithi033.stdout:2933: done (2 left) 2021-07-26T16:07:33.299 INFO:tasks.rados.rados.0.smithi033.stdout:2934: done (1 left) 2021-07-26T16:07:33.299 INFO:tasks.rados.rados.0.smithi033.stdout:2935: done (0 left) 2021-07-26T16:07:33.300 INFO:tasks.rados.rados.0.smithi033.stdout:2936: rmattr oid 35 current snap is 293 2021-07-26T16:07:33.300 INFO:tasks.rados.rados.0.smithi033.stdout:2937: snap_create 2021-07-26T16:07:33.302 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1266 (ObjNum 815 snap 272 seq_num 815) dirty exists 2021-07-26T16:07:34.265 INFO:tasks.rados.rados.0.smithi033.stdout:2936: done (1 left) 2021-07-26T16:07:34.265 INFO:tasks.rados.rados.0.smithi033.stdout:2937: done (0 left) 2021-07-26T16:07:34.266 INFO:tasks.rados.rados.0.smithi033.stdout:2938: read oid 3 snap -1 2021-07-26T16:07:34.266 INFO:tasks.rados.rados.0.smithi033.stdout:2938: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:07:34.266 INFO:tasks.rados.rados.0.smithi033.stdout:2939: delete oid 32 current snap is 294 2021-07-26T16:07:34.269 INFO:tasks.rados.rados.0.smithi033.stdout:2938: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:07:34.272 INFO:tasks.rados.rados.0.smithi033.stdout:2938: done (1 left) 2021-07-26T16:07:34.272 INFO:tasks.rados.rados.0.smithi033.stdout:2939: done (0 left) 2021-07-26T16:07:34.272 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 294 2021-07-26T16:07:34.273 INFO:tasks.rados.rados.0.smithi033.stdout:2940: seq_num 894 ranges {0=581632} 2021-07-26T16:07:34.277 INFO:tasks.rados.rados.0.smithi033.stdout:2940: writing smithi03339061-7 from 0 to 581632 tid 1 2021-07-26T16:07:34.277 INFO:tasks.rados.rados.0.smithi033.stdout:2941: read oid 30 snap -1 2021-07-26T16:07:34.277 INFO:tasks.rados.rados.0.smithi033.stdout:2941: expect (ObjNum 864 snap 283 seq_num 864) 2021-07-26T16:07:34.278 INFO:tasks.rados.rados.0.smithi033.stdout:2942: read oid 12 snap 243 2021-07-26T16:07:34.278 INFO:tasks.rados.rados.0.smithi033.stdout:2942: expect (ObjNum 710 snap 236 seq_num 710) 2021-07-26T16:07:34.278 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 294 2021-07-26T16:07:34.278 INFO:tasks.rados.rados.0.smithi033.stdout:2943: seq_num 895 ranges {1785856=598016} 2021-07-26T16:07:34.293 INFO:tasks.rados.rados.0.smithi033.stdout:2943: writing smithi03339061-20 from 1785856 to 2383872 tid 1 2021-07-26T16:07:34.293 INFO:tasks.rados.rados.0.smithi033.stdout:2944: snap_create 2021-07-26T16:07:34.294 INFO:tasks.rados.rados.0.smithi033.stdout:2940: finishing write tid 1 to smithi03339061-7 2021-07-26T16:07:34.294 INFO:tasks.rados.rados.0.smithi033.stdout:2940: finishing write tid 2 to smithi03339061-7 2021-07-26T16:07:34.302 INFO:tasks.rados.rados.0.smithi033.stdout:2943: finishing write tid 1 to smithi03339061-20 2021-07-26T16:07:34.302 INFO:tasks.rados.rados.0.smithi033.stdout:2943: finishing write tid 2 to smithi03339061-20 2021-07-26T16:07:34.304 INFO:tasks.rados.rados.0.smithi033.stdout:2943: finishing write tid 3 to smithi03339061-20 2021-07-26T16:07:34.304 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1379 (ObjNum 895 snap 294 seq_num 895) dirty exists 2021-07-26T16:07:34.304 INFO:tasks.rados.rados.0.smithi033.stdout:2943: left oid 20 (ObjNum 895 snap 294 seq_num 895) 2021-07-26T16:07:34.305 INFO:tasks.rados.rados.0.smithi033.stdout:2941: expect (ObjNum 864 snap 283 seq_num 864) 2021-07-26T16:07:34.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:34 smithi033 bash[41341]: cluster 2021-07-26T16:07:33.151059+0000 mgr.y (mgr.34104) 408 : cluster [DBG] pgmap v775: 25 pgs: 25 active+clean; 654 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 4.6 MiB/s wr, 18 op/s 2021-07-26T16:07:34.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:34 smithi033 bash[42377]: cluster 2021-07-26T16:07:33.151059+0000 mgr.y (mgr.34104) 408 : cluster [DBG] pgmap v775: 25 pgs: 25 active+clean; 654 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 4.6 MiB/s wr, 18 op/s 2021-07-26T16:07:34.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:34 smithi096 bash[33981]: cluster 2021-07-26T16:07:33.151059+0000 mgr.y (mgr.34104) 408 : cluster [DBG] pgmap v775: 25 pgs: 25 active+clean; 654 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 23 MiB/s rd, 4.6 MiB/s wr, 18 op/s 2021-07-26T16:07:34.775 INFO:tasks.rados.rados.0.smithi033.stdout:2940: finishing write tid 3 to smithi03339061-7 2021-07-26T16:07:34.776 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1419 (ObjNum 894 snap 294 seq_num 894) dirty exists 2021-07-26T16:07:34.776 INFO:tasks.rados.rados.0.smithi033.stdout:2940: left oid 7 (ObjNum 894 snap 294 seq_num 894) 2021-07-26T16:07:34.776 INFO:tasks.rados.rados.0.smithi033.stdout:2942: expect (ObjNum 710 snap 236 seq_num 710) 2021-07-26T16:07:35.282 INFO:tasks.rados.rados.0.smithi033.stdout:2940: done (4 left) 2021-07-26T16:07:35.283 INFO:tasks.rados.rados.0.smithi033.stdout:2941: done (3 left) 2021-07-26T16:07:35.283 INFO:tasks.rados.rados.0.smithi033.stdout:2942: done (2 left) 2021-07-26T16:07:35.283 INFO:tasks.rados.rados.0.smithi033.stdout:2943: done (1 left) 2021-07-26T16:07:35.283 INFO:tasks.rados.rados.0.smithi033.stdout:2944: done (0 left) 2021-07-26T16:07:35.283 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 295 2021-07-26T16:07:35.284 INFO:tasks.rados.rados.0.smithi033.stdout:2945: seq_num 896 ranges {2473984=614400} 2021-07-26T16:07:35.302 INFO:tasks.rados.rados.0.smithi033.stdout:2945: writing smithi03339061-8 from 2473984 to 3088384 tid 1 2021-07-26T16:07:35.302 INFO:tasks.rados.rados.0.smithi033.stdout:2946: rollback oid 37 current snap is 295 2021-07-26T16:07:35.303 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 37 to 237 2021-07-26T16:07:35.303 INFO:tasks.rados.rados.0.smithi033.stdout:2947: snap_create 2021-07-26T16:07:35.308 INFO:tasks.rados.rados.0.smithi033.stdout:2946: finishing rollback tid 0 to smithi03339061-37 2021-07-26T16:07:35.310 INFO:tasks.rados.rados.0.smithi033.stdout:2946: finishing rollback tid 1 to smithi03339061-37 2021-07-26T16:07:35.311 INFO:tasks.rados.rados.0.smithi033.stdout:2946: finishing rollback tid 2 to smithi03339061-37 2021-07-26T16:07:35.311 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 1472 (ObjNum 609 snap 192 seq_num 609) dirty exists 2021-07-26T16:07:35.313 INFO:tasks.rados.rados.0.smithi033.stdout:2945: finishing write tid 1 to smithi03339061-8 2021-07-26T16:07:35.313 INFO:tasks.rados.rados.0.smithi033.stdout:2945: finishing write tid 2 to smithi03339061-8 2021-07-26T16:07:35.315 INFO:tasks.rados.rados.0.smithi033.stdout:2945: finishing write tid 3 to smithi03339061-8 2021-07-26T16:07:35.315 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1268 (ObjNum 896 snap 295 seq_num 896) dirty exists 2021-07-26T16:07:35.316 INFO:tasks.rados.rados.0.smithi033.stdout:2945: left oid 8 (ObjNum 896 snap 295 seq_num 896) 2021-07-26T16:07:35.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:35 smithi033 bash[41341]: cluster 2021-07-26T16:07:34.262786+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e637: 8 total, 8 up, 8 in 2021-07-26T16:07:35.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:35 smithi033 bash[42377]: cluster 2021-07-26T16:07:34.262786+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e637: 8 total, 8 up, 8 in 2021-07-26T16:07:35.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:35 smithi096 bash[33981]: cluster 2021-07-26T16:07:34.262786+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e637: 8 total, 8 up, 8 in 2021-07-26T16:07:36.184 INFO:tasks.rados.rados.0.smithi033.stdout:2945: done (2 left) 2021-07-26T16:07:36.184 INFO:tasks.rados.rados.0.smithi033.stdout:2946: done (1 left) 2021-07-26T16:07:36.184 INFO:tasks.rados.rados.0.smithi033.stdout:2947: done (0 left) 2021-07-26T16:07:36.184 INFO:tasks.rados.rados.0.smithi033.stdout:2948: setattr oid 17 current snap is 296 2021-07-26T16:07:36.186 INFO:tasks.rados.rados.0.smithi033.stdout:2949: snap_create 2021-07-26T16:07:36.192 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 1398 (ObjNum 892 snap 292 seq_num 892) dirty exists 2021-07-26T16:07:36.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:36 smithi033 bash[41341]: cluster 2021-07-26T16:07:35.151769+0000 mgr.y (mgr.34104) 409 : cluster [DBG] pgmap v777: 25 pgs: 25 active+clean; 654 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2021-07-26T16:07:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:36 smithi033 bash[41341]: cluster 2021-07-26T16:07:35.278245+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e638: 8 total, 8 up, 8 in 2021-07-26T16:07:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:36 smithi033 bash[41341]: cluster 2021-07-26T16:07:36.180456+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e639: 8 total, 8 up, 8 in 2021-07-26T16:07:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:36 smithi033 bash[42377]: cluster 2021-07-26T16:07:35.151769+0000 mgr.y (mgr.34104) 409 : cluster [DBG] pgmap v777: 25 pgs: 25 active+clean; 654 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2021-07-26T16:07:36.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:36 smithi033 bash[42377]: cluster 2021-07-26T16:07:35.278245+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e638: 8 total, 8 up, 8 in 2021-07-26T16:07:36.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:36 smithi033 bash[42377]: cluster 2021-07-26T16:07:36.180456+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e639: 8 total, 8 up, 8 in 2021-07-26T16:07:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:36 smithi096 bash[33981]: cluster 2021-07-26T16:07:35.151769+0000 mgr.y (mgr.34104) 409 : cluster [DBG] pgmap v777: 25 pgs: 25 active+clean; 654 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 24 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2021-07-26T16:07:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:36 smithi096 bash[33981]: cluster 2021-07-26T16:07:35.278245+0000 mon.a (mon.0) 1008 : cluster [DBG] osdmap e638: 8 total, 8 up, 8 in 2021-07-26T16:07:36.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:36 smithi096 bash[33981]: cluster 2021-07-26T16:07:36.180456+0000 mon.a (mon.0) 1009 : cluster [DBG] osdmap e639: 8 total, 8 up, 8 in 2021-07-26T16:07:37.197 INFO:tasks.rados.rados.0.smithi033.stdout:2948: done (1 left) 2021-07-26T16:07:37.197 INFO:tasks.rados.rados.0.smithi033.stdout:2949: done (0 left) 2021-07-26T16:07:37.198 INFO:tasks.rados.rados.0.smithi033.stdout:2950: snap_create 2021-07-26T16:07:38.200 INFO:tasks.rados.rados.0.smithi033.stdout:2950: done (0 left) 2021-07-26T16:07:38.200 INFO:tasks.rados.rados.0.smithi033.stdout:2951: read oid 29 snap -1 2021-07-26T16:07:38.201 INFO:tasks.rados.rados.0.smithi033.stdout:2951: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:07:38.201 INFO:tasks.rados.rados.0.smithi033.stdout:2952: copy_from oid 35 from oid 5 current snap is 298 2021-07-26T16:07:38.201 INFO:tasks.rados.rados.0.smithi033.stdout:2953: setattr oid 47 current snap is 298 2021-07-26T16:07:38.202 INFO:tasks.rados.rados.0.smithi033.stdout:2954: snap_create 2021-07-26T16:07:38.208 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1473 (ObjNum 875 snap 287 seq_num 875) dirty exists 2021-07-26T16:07:38.211 INFO:tasks.rados.rados.0.smithi033.stdout:2952: finishing copy_from to smithi03339061-35 2021-07-26T16:07:38.211 INFO:tasks.rados.rados.0.smithi033.stdout:2952: got expected ENOENT (src dne) 2021-07-26T16:07:38.211 INFO:tasks.rados.rados.0.smithi033.stdout:2952: finishing copy_from racing read to smithi03339061-35 2021-07-26T16:07:38.226 INFO:tasks.rados.rados.0.smithi033.stdout:2951: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:07:38.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:38 smithi033 bash[42377]: cluster 2021-07-26T16:07:37.152566+0000 mgr.y (mgr.34104) 410 : cluster [DBG] pgmap v780: 25 pgs: 25 active+clean; 655 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2021-07-26T16:07:38.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:38 smithi033 bash[42377]: cluster 2021-07-26T16:07:37.194789+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e640: 8 total, 8 up, 8 in 2021-07-26T16:07:38.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:38 smithi033 bash[41341]: cluster 2021-07-26T16:07:37.152566+0000 mgr.y (mgr.34104) 410 : cluster [DBG] pgmap v780: 25 pgs: 25 active+clean; 655 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2021-07-26T16:07:38.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:38 smithi033 bash[41341]: cluster 2021-07-26T16:07:37.194789+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e640: 8 total, 8 up, 8 in 2021-07-26T16:07:38.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:38 smithi096 bash[33981]: cluster 2021-07-26T16:07:37.152566+0000 mgr.y (mgr.34104) 410 : cluster [DBG] pgmap v780: 25 pgs: 25 active+clean; 655 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 22 MiB/s rd, 1.1 MiB/s wr, 8 op/s 2021-07-26T16:07:38.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:38 smithi096 bash[33981]: cluster 2021-07-26T16:07:37.194789+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e640: 8 total, 8 up, 8 in 2021-07-26T16:07:39.213 INFO:tasks.rados.rados.0.smithi033.stdout:2951: done (3 left) 2021-07-26T16:07:39.214 INFO:tasks.rados.rados.0.smithi033.stdout:2952: done (2 left) 2021-07-26T16:07:39.215 INFO:tasks.rados.rados.0.smithi033.stdout:2953: done (1 left) 2021-07-26T16:07:39.215 INFO:tasks.rados.rados.0.smithi033.stdout:2954: done (0 left) 2021-07-26T16:07:39.215 INFO:tasks.rados.rados.0.smithi033.stdout:2955: delete oid 34 current snap is 299 2021-07-26T16:07:39.225 INFO:tasks.rados.rados.0.smithi033.stdout:2955: done (0 left) 2021-07-26T16:07:39.225 INFO:tasks.rados.rados.0.smithi033.stdout:2956: rmattr oid 6 current snap is 299 2021-07-26T16:07:39.225 INFO:tasks.rados.rados.0.smithi033.stdout:2956: done (0 left) 2021-07-26T16:07:39.226 INFO:tasks.rados.rados.0.smithi033.stdout:2957: read oid 36 snap -1 2021-07-26T16:07:39.226 INFO:tasks.rados.rados.0.smithi033.stdout:2957: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:39.226 INFO:tasks.rados.rados.0.smithi033.stdout:2958: delete oid 50 current snap is 299 2021-07-26T16:07:39.233 INFO:tasks.rados.rados.0.smithi033.stdout:2958: done (1 left) 2021-07-26T16:07:39.233 INFO:tasks.rados.rados.0.smithi033.stdout:2959: rollback oid 25 current snap is 299 2021-07-26T16:07:39.234 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 25 to 272 2021-07-26T16:07:39.234 INFO:tasks.rados.rados.0.smithi033.stdout:2960: read oid 20 snap 287 2021-07-26T16:07:39.234 INFO:tasks.rados.rados.0.smithi033.stdout:2960: expect (ObjNum 773 snap 255 seq_num 773) 2021-07-26T16:07:39.234 INFO:tasks.rados.rados.0.smithi033.stdout:2961: snap_remove snap 298 2021-07-26T16:07:39.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:39 smithi096 bash[33981]: cluster 2021-07-26T16:07:38.196558+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e641: 8 total, 8 up, 8 in 2021-07-26T16:07:39.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:39 smithi033 bash[41341]: cluster 2021-07-26T16:07:38.196558+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e641: 8 total, 8 up, 8 in 2021-07-26T16:07:39.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:39 smithi033 bash[42377]: cluster 2021-07-26T16:07:38.196558+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e641: 8 total, 8 up, 8 in 2021-07-26T16:07:40.241 INFO:tasks.rados.rados.0.smithi033.stdout:2961: done (3 left) 2021-07-26T16:07:40.241 INFO:tasks.rados.rados.0.smithi033.stdout:2962: rmattr oid 47 current snap is 299 2021-07-26T16:07:40.241 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 299 2021-07-26T16:07:40.242 INFO:tasks.rados.rados.0.smithi033.stdout:2963: seq_num 899 ranges {0=663552} 2021-07-26T16:07:40.244 INFO:tasks.rados.rados.0.smithi033.stdout:2963: writing smithi03339061-5 from 0 to 663552 tid 1 2021-07-26T16:07:40.244 INFO:tasks.rados.rados.0.smithi033.stdout:2964: rollback oid 44 current snap is 299 2021-07-26T16:07:40.245 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 283 2021-07-26T16:07:40.245 INFO:tasks.rados.rados.0.smithi033.stdout:2959: finishing rollback tid 1 to smithi03339061-25 2021-07-26T16:07:40.245 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 1326 (ObjNum 2006579696 snap 22002 seq_num 872417488) dirty dne 2021-07-26T16:07:40.245 INFO:tasks.rados.rados.0.smithi033.stdout:2957: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:40.308 INFO:tasks.rados.rados.0.smithi033.stdout:2960: expect (ObjNum 773 snap 255 seq_num 773) 2021-07-26T16:07:40.370 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1474 (ObjNum 875 snap 287 seq_num 875) dirty exists 2021-07-26T16:07:40.371 INFO:tasks.rados.rados.0.smithi033.stdout:2964: finishing rollback tid 0 to smithi03339061-44 2021-07-26T16:07:40.371 INFO:tasks.rados.rados.0.smithi033.stdout:2964: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:07:40.371 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1381 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T16:07:40.371 INFO:tasks.rados.rados.0.smithi033.stdout:2963: finishing write tid 1 to smithi03339061-5 2021-07-26T16:07:40.372 INFO:tasks.rados.rados.0.smithi033.stdout:2963: finishing write tid 2 to smithi03339061-5 2021-07-26T16:07:40.372 INFO:tasks.rados.rados.0.smithi033.stdout:2963: finishing write tid 3 to smithi03339061-5 2021-07-26T16:07:40.372 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 1277 (ObjNum 899 snap 299 seq_num 899) dirty exists 2021-07-26T16:07:40.372 INFO:tasks.rados.rados.0.smithi033.stdout:2963: left oid 5 (ObjNum 899 snap 299 seq_num 899) 2021-07-26T16:07:40.372 INFO:tasks.rados.rados.0.smithi033.stdout:2957: done (5 left) 2021-07-26T16:07:40.373 INFO:tasks.rados.rados.0.smithi033.stdout:2959: done (4 left) 2021-07-26T16:07:40.373 INFO:tasks.rados.rados.0.smithi033.stdout:2960: done (3 left) 2021-07-26T16:07:40.373 INFO:tasks.rados.rados.0.smithi033.stdout:2962: done (2 left) 2021-07-26T16:07:40.373 INFO:tasks.rados.rados.0.smithi033.stdout:2963: done (1 left) 2021-07-26T16:07:40.373 INFO:tasks.rados.rados.0.smithi033.stdout:2964: done (0 left) 2021-07-26T16:07:40.374 INFO:tasks.rados.rados.0.smithi033.stdout:2965: read oid 47 snap -1 2021-07-26T16:07:40.374 INFO:tasks.rados.rados.0.smithi033.stdout:2965: expect (ObjNum 875 snap 287 seq_num 875) 2021-07-26T16:07:40.374 INFO:tasks.rados.rados.0.smithi033.stdout:2966: snap_remove snap 214 2021-07-26T16:07:40.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:40 smithi096 bash[33981]: cluster 2021-07-26T16:07:39.153272+0000 mgr.y (mgr.34104) 411 : cluster [DBG] pgmap v783: 25 pgs: 25 active+clean; 656 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.8 MiB/s rd, 288 KiB/s wr, 6 op/s 2021-07-26T16:07:40.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:40 smithi096 bash[33981]: cluster 2021-07-26T16:07:39.207281+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e642: 8 total, 8 up, 8 in 2021-07-26T16:07:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:40 smithi033 bash[41341]: cluster 2021-07-26T16:07:39.153272+0000 mgr.y (mgr.34104) 411 : cluster [DBG] pgmap v783: 25 pgs: 25 active+clean; 656 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.8 MiB/s rd, 288 KiB/s wr, 6 op/s 2021-07-26T16:07:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:40 smithi033 bash[41341]: cluster 2021-07-26T16:07:39.207281+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e642: 8 total, 8 up, 8 in 2021-07-26T16:07:40.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:40 smithi033 bash[42377]: cluster 2021-07-26T16:07:39.153272+0000 mgr.y (mgr.34104) 411 : cluster [DBG] pgmap v783: 25 pgs: 25 active+clean; 656 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 8.8 MiB/s rd, 288 KiB/s wr, 6 op/s 2021-07-26T16:07:40.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:40 smithi033 bash[42377]: cluster 2021-07-26T16:07:39.207281+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e642: 8 total, 8 up, 8 in 2021-07-26T16:07:41.243 INFO:tasks.rados.rados.0.smithi033.stdout:2965: expect (ObjNum 875 snap 287 seq_num 875) 2021-07-26T16:07:41.252 INFO:tasks.rados.rados.0.smithi033.stdout:2965: done (1 left) 2021-07-26T16:07:41.253 INFO:tasks.rados.rados.0.smithi033.stdout:2966: done (0 left) 2021-07-26T16:07:41.253 INFO:tasks.rados.rados.0.smithi033.stdout:2967: read oid 50 snap -1 2021-07-26T16:07:41.253 INFO:tasks.rados.rados.0.smithi033.stdout:2967: expect deleted 2021-07-26T16:07:41.253 INFO:tasks.rados.rados.0.smithi033.stdout:2968: copy_from oid 14 from oid 22 current snap is 299 2021-07-26T16:07:41.253 INFO:tasks.rados.rados.0.smithi033.stdout:2969: rollback oid 3 current snap is 299 2021-07-26T16:07:41.254 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 3 to 295 2021-07-26T16:07:41.254 INFO:tasks.rados.rados.0.smithi033.stdout:2970: snap_create 2021-07-26T16:07:41.257 INFO:tasks.rados.rados.0.smithi033.stdout:2969: finishing rollback tid 0 to smithi03339061-3 2021-07-26T16:07:41.257 INFO:tasks.rados.rados.0.smithi033.stdout:2969: finishing rollback tid 1 to smithi03339061-3 2021-07-26T16:07:41.258 INFO:tasks.rados.rados.0.smithi033.stdout:2969: finishing rollback tid 2 to smithi03339061-3 2021-07-26T16:07:41.258 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1720 (ObjNum 0 snap 0 seq_num 0) dirty exists 2021-07-26T16:07:41.259 INFO:tasks.rados.rados.0.smithi033.stdout:2968: finishing copy_from to smithi03339061-14 2021-07-26T16:07:41.260 INFO:tasks.rados.rados.0.smithi033.stdout:2968: got expected ENOENT (src dne) 2021-07-26T16:07:41.260 INFO:tasks.rados.rados.0.smithi033.stdout:2968: finishing copy_from racing read to smithi03339061-14 2021-07-26T16:07:41.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:41 smithi033 bash[41341]: cluster 2021-07-26T16:07:40.232011+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e643: 8 total, 8 up, 8 in 2021-07-26T16:07:41.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:41 smithi033 bash[42377]: cluster 2021-07-26T16:07:40.232011+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e643: 8 total, 8 up, 8 in 2021-07-26T16:07:41.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:41 smithi096 bash[33981]: cluster 2021-07-26T16:07:40.232011+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e643: 8 total, 8 up, 8 in 2021-07-26T16:07:42.266 INFO:tasks.rados.rados.0.smithi033.stdout:2967: done (3 left) 2021-07-26T16:07:42.266 INFO:tasks.rados.rados.0.smithi033.stdout:2968: done (2 left) 2021-07-26T16:07:42.266 INFO:tasks.rados.rados.0.smithi033.stdout:2969: done (1 left) 2021-07-26T16:07:42.266 INFO:tasks.rados.rados.0.smithi033.stdout:2970: done (0 left) 2021-07-26T16:07:42.267 INFO:tasks.rados.rados.0.smithi033.stdout:2971: rollback oid 13 current snap is 300 2021-07-26T16:07:42.267 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 13 to 264 2021-07-26T16:07:42.267 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 300 2021-07-26T16:07:42.267 INFO:tasks.rados.rados.0.smithi033.stdout:2972: seq_num 900 ranges {6471680=679936} 2021-07-26T16:07:42.309 INFO:tasks.rados.rados.0.smithi033.stdout:2972: writing smithi03339061-42 from 6471680 to 7151616 tid 1 2021-07-26T16:07:42.309 INFO:tasks.rados.rados.0.smithi033.stdout:2973: copy_from oid 47 from oid 38 current snap is 300 2021-07-26T16:07:42.310 INFO:tasks.rados.rados.0.smithi033.stdout:2971: finishing rollback tid 0 to smithi03339061-13 2021-07-26T16:07:42.310 INFO:tasks.rados.rados.0.smithi033.stdout:2971: finishing rollback tid 1 to smithi03339061-13 2021-07-26T16:07:42.310 INFO:tasks.rados.rados.0.smithi033.stdout:2971: finishing rollback tid 2 to smithi03339061-13 2021-07-26T16:07:42.310 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1384 (ObjNum 775 snap 256 seq_num 775) dirty exists 2021-07-26T16:07:42.311 INFO:tasks.rados.rados.0.smithi033.stdout:2971: done (2 left) 2021-07-26T16:07:42.311 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 300 2021-07-26T16:07:42.311 INFO:tasks.rados.rados.0.smithi033.stdout:2974: seq_num 901 ranges {532480=696320} 2021-07-26T16:07:42.316 INFO:tasks.rados.rados.0.smithi033.stdout:2974: writing smithi03339061-6 from 532480 to 1228800 tid 1 2021-07-26T16:07:42.316 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 300 2021-07-26T16:07:42.316 INFO:tasks.rados.rados.0.smithi033.stdout:2975: seq_num 902 ranges {376832=712704} 2021-07-26T16:07:42.323 INFO:tasks.rados.rados.0.smithi033.stdout:2975: writing smithi03339061-12 from 376832 to 1089536 tid 1 2021-07-26T16:07:42.324 INFO:tasks.rados.rados.0.smithi033.stdout:2976: snap_create 2021-07-26T16:07:42.324 INFO:tasks.rados.rados.0.smithi033.stdout:2972: finishing write tid 1 to smithi03339061-42 2021-07-26T16:07:42.324 INFO:tasks.rados.rados.0.smithi033.stdout:2972: finishing write tid 2 to smithi03339061-42 2021-07-26T16:07:42.325 INFO:tasks.rados.rados.0.smithi033.stdout:2974: finishing write tid 1 to smithi03339061-6 2021-07-26T16:07:42.326 INFO:tasks.rados.rados.0.smithi033.stdout:2974: finishing write tid 2 to smithi03339061-6 2021-07-26T16:07:42.328 INFO:tasks.rados.rados.0.smithi033.stdout:2974: finishing write tid 3 to smithi03339061-6 2021-07-26T16:07:42.328 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1753 (ObjNum 901 snap 300 seq_num 901) dirty exists 2021-07-26T16:07:42.328 INFO:tasks.rados.rados.0.smithi033.stdout:2974: left oid 6 (ObjNum 901 snap 300 seq_num 901) 2021-07-26T16:07:42.329 INFO:tasks.rados.rados.0.smithi033.stdout:2973: finishing copy_from to smithi03339061-47 2021-07-26T16:07:42.329 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 728 (ObjNum 850 snap 282 seq_num 850) dirty exists 2021-07-26T16:07:42.330 INFO:tasks.rados.rados.0.smithi033.stdout:2973: finishing copy_from racing read to smithi03339061-47 2021-07-26T16:07:42.331 INFO:tasks.rados.rados.0.smithi033.stdout:2972: finishing write tid 3 to smithi03339061-42 2021-07-26T16:07:42.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1722 (ObjNum 900 snap 300 seq_num 900) dirty exists 2021-07-26T16:07:42.332 INFO:tasks.rados.rados.0.smithi033.stdout:2972: left oid 42 (ObjNum 900 snap 300 seq_num 900) 2021-07-26T16:07:42.332 INFO:tasks.rados.rados.0.smithi033.stdout:2975: finishing write tid 1 to smithi03339061-12 2021-07-26T16:07:42.333 INFO:tasks.rados.rados.0.smithi033.stdout:2975: finishing write tid 2 to smithi03339061-12 2021-07-26T16:07:42.333 INFO:tasks.rados.rados.0.smithi033.stdout:2975: finishing write tid 3 to smithi03339061-12 2021-07-26T16:07:42.334 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1408 (ObjNum 902 snap 300 seq_num 902) dirty exists 2021-07-26T16:07:42.334 INFO:tasks.rados.rados.0.smithi033.stdout:2975: left oid 12 (ObjNum 902 snap 300 seq_num 902) 2021-07-26T16:07:42.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:42 smithi033 bash[41341]: cluster 2021-07-26T16:07:41.153997+0000 mgr.y (mgr.34104) 412 : cluster [DBG] pgmap v786: 25 pgs: 25 active+clean; 657 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 292 KiB/s wr, 12 op/s 2021-07-26T16:07:42.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:42 smithi033 bash[41341]: cluster 2021-07-26T16:07:41.234074+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e644: 8 total, 8 up, 8 in 2021-07-26T16:07:42.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:42 smithi033 bash[42377]: cluster 2021-07-26T16:07:41.153997+0000 mgr.y (mgr.34104) 412 : cluster [DBG] pgmap v786: 25 pgs: 25 active+clean; 657 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 292 KiB/s wr, 12 op/s 2021-07-26T16:07:42.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:42 smithi033 bash[42377]: cluster 2021-07-26T16:07:41.234074+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e644: 8 total, 8 up, 8 in 2021-07-26T16:07:42.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:42 smithi096 bash[33981]: cluster 2021-07-26T16:07:41.153997+0000 mgr.y (mgr.34104) 412 : cluster [DBG] pgmap v786: 25 pgs: 25 active+clean; 657 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 14 MiB/s rd, 292 KiB/s wr, 12 op/s 2021-07-26T16:07:42.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:42 smithi096 bash[33981]: cluster 2021-07-26T16:07:41.234074+0000 mon.a (mon.0) 1014 : cluster [DBG] osdmap e644: 8 total, 8 up, 8 in 2021-07-26T16:07:43.275 INFO:tasks.rados.rados.0.smithi033.stdout:2972: done (4 left) 2021-07-26T16:07:43.275 INFO:tasks.rados.rados.0.smithi033.stdout:2973: done (3 left) 2021-07-26T16:07:43.275 INFO:tasks.rados.rados.0.smithi033.stdout:2974: done (2 left) 2021-07-26T16:07:43.275 INFO:tasks.rados.rados.0.smithi033.stdout:2975: done (1 left) 2021-07-26T16:07:43.276 INFO:tasks.rados.rados.0.smithi033.stdout:2976: done (0 left) 2021-07-26T16:07:43.276 INFO:tasks.rados.rados.0.smithi033.stdout:2977: read oid 35 snap 285 2021-07-26T16:07:43.276 INFO:tasks.rados.rados.0.smithi033.stdout:2977: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:07:43.276 INFO:tasks.rados.rados.0.smithi033.stdout:2978: snap_create 2021-07-26T16:07:43.303 INFO:tasks.rados.rados.0.smithi033.stdout:2977: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:07:43.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:43 smithi033 bash[41341]: cluster 2021-07-26T16:07:42.263350+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e645: 8 total, 8 up, 8 in 2021-07-26T16:07:43.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:43 smithi033 bash[42377]: cluster 2021-07-26T16:07:42.263350+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e645: 8 total, 8 up, 8 in 2021-07-26T16:07:43.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:43 smithi096 bash[33981]: cluster 2021-07-26T16:07:42.263350+0000 mon.a (mon.0) 1015 : cluster [DBG] osdmap e645: 8 total, 8 up, 8 in 2021-07-26T16:07:44.277 INFO:tasks.rados.rados.0.smithi033.stdout:2977: done (1 left) 2021-07-26T16:07:44.278 INFO:tasks.rados.rados.0.smithi033.stdout:2978: done (0 left) 2021-07-26T16:07:44.278 INFO:tasks.rados.rados.0.smithi033.stdout:2979: delete oid 19 current snap is 302 2021-07-26T16:07:44.284 INFO:tasks.rados.rados.0.smithi033.stdout:2979: done (0 left) 2021-07-26T16:07:44.284 INFO:tasks.rados.rados.0.smithi033.stdout:2980: rollback oid 4 current snap is 302 2021-07-26T16:07:44.284 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 4 to 297 2021-07-26T16:07:44.284 INFO:tasks.rados.rados.0.smithi033.stdout:2981: read oid 3 snap -1 2021-07-26T16:07:44.285 INFO:tasks.rados.rados.0.smithi033.stdout:2981: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:07:44.285 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 302 2021-07-26T16:07:44.285 INFO:tasks.rados.rados.0.smithi033.stdout:2982: seq_num 904 ranges {7331840=745472} 2021-07-26T16:07:44.330 INFO:tasks.rados.rados.0.smithi033.stdout:2982: writing smithi03339061-48 from 7331840 to 8077312 tid 1 2021-07-26T16:07:44.330 INFO:tasks.rados.rados.0.smithi033.stdout:2983: rmattr oid 19 current snap is 302 2021-07-26T16:07:44.330 INFO:tasks.rados.rados.0.smithi033.stdout:2983: done (3 left) 2021-07-26T16:07:44.331 INFO:tasks.rados.rados.0.smithi033.stdout:2984: rollback oid 27 current snap is 302 2021-07-26T16:07:44.331 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 27 to 284 2021-07-26T16:07:44.331 INFO:tasks.rados.rados.0.smithi033.stdout:2981: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:07:44.333 INFO:tasks.rados.rados.0.smithi033.stdout:2980: finishing rollback tid 0 to smithi03339061-4 2021-07-26T16:07:44.334 INFO:tasks.rados.rados.0.smithi033.stdout:2980: finishing rollback tid 1 to smithi03339061-4 2021-07-26T16:07:44.334 INFO:tasks.rados.rados.0.smithi033.stdout:2980: finishing rollback tid 2 to smithi03339061-4 2021-07-26T16:07:44.334 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1387 (ObjNum 858 snap 283 seq_num 858) dirty exists 2021-07-26T16:07:44.334 INFO:tasks.rados.rados.0.smithi033.stdout:2980: done (3 left) 2021-07-26T16:07:44.335 INFO:tasks.rados.rados.0.smithi033.stdout:2981: done (2 left) 2021-07-26T16:07:44.335 INFO:tasks.rados.rados.0.smithi033.stdout:2985: rmattr oid 12 current snap is 302 2021-07-26T16:07:44.335 INFO:tasks.rados.rados.0.smithi033.stdout:2985: done (2 left) 2021-07-26T16:07:44.335 INFO:tasks.rados.rados.0.smithi033.stdout:2986: rmattr oid 31 current snap is 302 2021-07-26T16:07:44.336 INFO:tasks.rados.rados.0.smithi033.stdout:2986: done (2 left) 2021-07-26T16:07:44.336 INFO:tasks.rados.rados.0.smithi033.stdout:2987: read oid 28 snap -1 2021-07-26T16:07:44.336 INFO:tasks.rados.rados.0.smithi033.stdout:2987: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:07:44.336 INFO:tasks.rados.rados.0.smithi033.stdout:2988: rollback oid 26 current snap is 302 2021-07-26T16:07:44.336 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 26 to 255 2021-07-26T16:07:44.337 INFO:tasks.rados.rados.0.smithi033.stdout:2989: read oid 35 snap -1 2021-07-26T16:07:44.337 INFO:tasks.rados.rados.0.smithi033.stdout:2989: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:07:44.337 INFO:tasks.rados.rados.0.smithi033.stdout:2990: read oid 24 snap -1 2021-07-26T16:07:44.337 INFO:tasks.rados.rados.0.smithi033.stdout:2990: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:44.337 INFO:tasks.rados.rados.0.smithi033.stdout:2991: snap_remove snap 264 2021-07-26T16:07:44.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:44 smithi033 bash[41341]: cluster 2021-07-26T16:07:43.154684+0000 mgr.y (mgr.34104) 413 : cluster [DBG] pgmap v789: 25 pgs: 25 active+clean; 614 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 868 KiB/s wr, 19 op/s 2021-07-26T16:07:44.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:44 smithi033 bash[41341]: cluster 2021-07-26T16:07:43.272422+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e646: 8 total, 8 up, 8 in 2021-07-26T16:07:44.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:44 smithi033 bash[42377]: cluster 2021-07-26T16:07:43.154684+0000 mgr.y (mgr.34104) 413 : cluster [DBG] pgmap v789: 25 pgs: 25 active+clean; 614 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 868 KiB/s wr, 19 op/s 2021-07-26T16:07:44.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:44 smithi033 bash[42377]: cluster 2021-07-26T16:07:43.272422+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e646: 8 total, 8 up, 8 in 2021-07-26T16:07:44.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:44 smithi096 bash[33981]: cluster 2021-07-26T16:07:43.154684+0000 mgr.y (mgr.34104) 413 : cluster [DBG] pgmap v789: 25 pgs: 25 active+clean; 614 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 MiB/s rd, 868 KiB/s wr, 19 op/s 2021-07-26T16:07:44.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:44 smithi096 bash[33981]: cluster 2021-07-26T16:07:43.272422+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e646: 8 total, 8 up, 8 in 2021-07-26T16:07:45.302 INFO:tasks.rados.rados.0.smithi033.stdout:2991: done (6 left) 2021-07-26T16:07:45.303 INFO:tasks.rados.rados.0.smithi033.stdout:2992: rollback oid 41 current snap is 302 2021-07-26T16:07:45.303 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 41 to 248 2021-07-26T16:07:45.303 INFO:tasks.rados.rados.0.smithi033.stdout:2984: finishing rollback tid 0 to smithi03339061-27 2021-07-26T16:07:45.303 INFO:tasks.rados.rados.0.smithi033.stdout:2984: finishing rollback tid 1 to smithi03339061-27 2021-07-26T16:07:45.304 INFO:tasks.rados.rados.0.smithi033.stdout:2988: finishing rollback tid 0 to smithi03339061-26 2021-07-26T16:07:45.304 INFO:tasks.rados.rados.0.smithi033.stdout:2984: finishing rollback tid 2 to smithi03339061-27 2021-07-26T16:07:45.304 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1422 (ObjNum 806 snap 268 seq_num 806) dirty exists 2021-07-26T16:07:45.304 INFO:tasks.rados.rados.0.smithi033.stdout:2990: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:07:45.376 INFO:tasks.rados.rados.0.smithi033.stdout:2988: finishing rollback tid 1 to smithi03339061-26 2021-07-26T16:07:45.376 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 1756 (ObjNum 288 snap 0 seq_num 33) dirty dne 2021-07-26T16:07:45.376 INFO:tasks.rados.rados.0.smithi033.stdout:2987: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:07:45.436 INFO:tasks.rados.rados.0.smithi033.stdout:2982: finishing write tid 1 to smithi03339061-48 2021-07-26T16:07:45.436 INFO:tasks.rados.rados.0.smithi033.stdout:2982: finishing write tid 2 to smithi03339061-48 2021-07-26T16:07:45.437 INFO:tasks.rados.rados.0.smithi033.stdout:2982: finishing write tid 3 to smithi03339061-48 2021-07-26T16:07:45.437 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 1279 (ObjNum 904 snap 302 seq_num 904) dirty exists 2021-07-26T16:07:45.437 INFO:tasks.rados.rados.0.smithi033.stdout:2982: left oid 48 (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:07:45.437 INFO:tasks.rados.rados.0.smithi033.stdout:2989: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:07:45.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:45 smithi033 bash[41341]: cluster 2021-07-26T16:07:44.273202+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e647: 8 total, 8 up, 8 in 2021-07-26T16:07:45.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:45 smithi033 bash[42377]: cluster 2021-07-26T16:07:44.273202+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e647: 8 total, 8 up, 8 in 2021-07-26T16:07:45.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:45 smithi096 bash[33981]: cluster 2021-07-26T16:07:44.273202+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e647: 8 total, 8 up, 8 in 2021-07-26T16:07:45.935 INFO:tasks.rados.rados.0.smithi033.stdout:2992: finishing rollback tid 1 to smithi03339061-41 2021-07-26T16:07:45.936 INFO:tasks.rados.rados.0.smithi033.stdout:2992: finishing rollback tid 2 to smithi03339061-41 2021-07-26T16:07:45.936 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1281 (ObjNum 703 snap 233 seq_num 703) dirty exists 2021-07-26T16:07:45.936 INFO:tasks.rados.rados.0.smithi033.stdout:2982: done (6 left) 2021-07-26T16:07:45.936 INFO:tasks.rados.rados.0.smithi033.stdout:2984: done (5 left) 2021-07-26T16:07:45.937 INFO:tasks.rados.rados.0.smithi033.stdout:2987: done (4 left) 2021-07-26T16:07:45.937 INFO:tasks.rados.rados.0.smithi033.stdout:2988: done (3 left) 2021-07-26T16:07:45.937 INFO:tasks.rados.rados.0.smithi033.stdout:2989: done (2 left) 2021-07-26T16:07:45.937 INFO:tasks.rados.rados.0.smithi033.stdout:2990: done (1 left) 2021-07-26T16:07:45.937 INFO:tasks.rados.rados.0.smithi033.stdout:2992: done (0 left) 2021-07-26T16:07:45.938 INFO:tasks.rados.rados.0.smithi033.stdout:2993: read oid 17 snap 250 2021-07-26T16:07:45.938 INFO:tasks.rados.rados.0.smithi033.stdout:2993: expect (ObjNum 665 snap 217 seq_num 665) 2021-07-26T16:07:45.938 INFO:tasks.rados.rados.0.smithi033.stdout:2994: snap_remove snap 292 2021-07-26T16:07:46.192 INFO:tasks.rados.rados.0.smithi033.stdout:2994: done (1 left) 2021-07-26T16:07:46.193 INFO:tasks.rados.rados.0.smithi033.stdout:2995: rollback oid 22 current snap is 302 2021-07-26T16:07:46.193 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 22 to 287 2021-07-26T16:07:46.193 INFO:tasks.rados.rados.0.smithi033.stdout:2993: expect (ObjNum 665 snap 217 seq_num 665) 2021-07-26T16:07:46.473 INFO:tasks.rados.rados.0.smithi033.stdout:2995: finishing rollback tid 1 to smithi03339061-22 2021-07-26T16:07:46.473 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1727 (ObjNum 2008771056 snap 22002 seq_num 2008861792) dirty dne 2021-07-26T16:07:46.473 INFO:tasks.rados.rados.0.smithi033.stdout:2993: done (1 left) 2021-07-26T16:07:46.474 INFO:tasks.rados.rados.0.smithi033.stdout:2995: done (0 left) 2021-07-26T16:07:46.474 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 302 2021-07-26T16:07:46.474 INFO:tasks.rados.rados.0.smithi033.stdout:2996: seq_num 905 ranges {475136=761856} 2021-07-26T16:07:46.485 INFO:tasks.rados.rados.0.smithi033.stdout:2996: writing smithi03339061-18 from 475136 to 1236992 tid 1 2021-07-26T16:07:46.485 INFO:tasks.rados.rados.0.smithi033.stdout:2997: snap_create 2021-07-26T16:07:46.493 INFO:tasks.rados.rados.0.smithi033.stdout:2996: finishing write tid 1 to smithi03339061-18 2021-07-26T16:07:46.493 INFO:tasks.rados.rados.0.smithi033.stdout:2996: finishing write tid 2 to smithi03339061-18 2021-07-26T16:07:46.496 INFO:tasks.rados.rados.0.smithi033.stdout:2996: finishing write tid 3 to smithi03339061-18 2021-07-26T16:07:46.496 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 1772 (ObjNum 905 snap 302 seq_num 905) dirty exists 2021-07-26T16:07:46.496 INFO:tasks.rados.rados.0.smithi033.stdout:2996: left oid 18 (ObjNum 905 snap 302 seq_num 905) 2021-07-26T16:07:46.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:46 smithi033 bash[41341]: cluster 2021-07-26T16:07:45.155389+0000 mgr.y (mgr.34104) 414 : cluster [DBG] pgmap v792: 25 pgs: 25 active+clean; 604 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 200 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2021-07-26T16:07:46.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:46 smithi033 bash[41341]: cluster 2021-07-26T16:07:45.296432+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e648: 8 total, 8 up, 8 in 2021-07-26T16:07:46.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:46 smithi033 bash[41341]: cluster 2021-07-26T16:07:46.188128+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e649: 8 total, 8 up, 8 in 2021-07-26T16:07:46.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:46 smithi033 bash[42377]: cluster 2021-07-26T16:07:45.155389+0000 mgr.y (mgr.34104) 414 : cluster [DBG] pgmap v792: 25 pgs: 25 active+clean; 604 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 200 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2021-07-26T16:07:46.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:46 smithi033 bash[42377]: cluster 2021-07-26T16:07:45.296432+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e648: 8 total, 8 up, 8 in 2021-07-26T16:07:46.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:46 smithi033 bash[42377]: cluster 2021-07-26T16:07:46.188128+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e649: 8 total, 8 up, 8 in 2021-07-26T16:07:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:46 smithi096 bash[33981]: cluster 2021-07-26T16:07:45.155389+0000 mgr.y (mgr.34104) 414 : cluster [DBG] pgmap v792: 25 pgs: 25 active+clean; 604 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 200 KiB/s rd, 1.0 MiB/s wr, 10 op/s 2021-07-26T16:07:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:46 smithi096 bash[33981]: cluster 2021-07-26T16:07:45.296432+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e648: 8 total, 8 up, 8 in 2021-07-26T16:07:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:46 smithi096 bash[33981]: cluster 2021-07-26T16:07:46.188128+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e649: 8 total, 8 up, 8 in 2021-07-26T16:07:47.308 INFO:tasks.rados.rados.0.smithi033.stdout:2996: done (1 left) 2021-07-26T16:07:47.309 INFO:tasks.rados.rados.0.smithi033.stdout:2997: done (0 left) 2021-07-26T16:07:47.309 INFO:tasks.rados.rados.0.smithi033.stdout:2998: delete oid 13 current snap is 303 2021-07-26T16:07:47.313 INFO:tasks.rados.rados.0.smithi033.stdout:2998: done (0 left) 2021-07-26T16:07:47.314 INFO:tasks.rados.rados.0.smithi033.stdout:2999: delete oid 2 current snap is 303 2021-07-26T16:07:47.320 INFO:tasks.rados.rados.0.smithi033.stdout:2999: done (0 left) 2021-07-26T16:07:47.320 INFO:tasks.rados.rados.0.smithi033.stdout:3000: snap_create 2021-07-26T16:07:48.322 INFO:tasks.rados.rados.0.smithi033.stdout:3000: done (0 left) 2021-07-26T16:07:48.323 INFO:tasks.rados.rados.0.smithi033.stdout:3001: read oid 49 snap -1 2021-07-26T16:07:48.323 INFO:tasks.rados.rados.0.smithi033.stdout:3001: expect (ObjNum 860 snap 283 seq_num 860) 2021-07-26T16:07:48.323 INFO:tasks.rados.rados.0.smithi033.stdout:3002: read oid 43 snap -1 2021-07-26T16:07:48.324 INFO:tasks.rados.rados.0.smithi033.stdout:3002: expect (ObjNum 733 snap 246 seq_num 733) 2021-07-26T16:07:48.324 INFO:tasks.rados.rados.0.smithi033.stdout:3003: read oid 10 snap -1 2021-07-26T16:07:48.324 INFO:tasks.rados.rados.0.smithi033.stdout:3003: expect (ObjNum 846 snap 281 seq_num 846) 2021-07-26T16:07:48.324 INFO:tasks.rados.rados.0.smithi033.stdout:3004: read oid 48 snap -1 2021-07-26T16:07:48.325 INFO:tasks.rados.rados.0.smithi033.stdout:3004: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:07:48.325 INFO:tasks.rados.rados.0.smithi033.stdout:3005: copy_from oid 12 from oid 23 current snap is 304 2021-07-26T16:07:48.325 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 304 2021-07-26T16:07:48.325 INFO:tasks.rados.rados.0.smithi033.stdout:3006: seq_num 908 ranges {0=409600,409600=401408} 2021-07-26T16:07:48.328 INFO:tasks.rados.rados.0.smithi033.stdout:3006: writing smithi03339061-22 from 0 to 409600 tid 1 2021-07-26T16:07:48.328 INFO:tasks.rados.rados.0.smithi033.stdout:3006: writing smithi03339061-22 from 409600 to 811008 tid 2 2021-07-26T16:07:48.328 INFO:tasks.rados.rados.0.smithi033.stdout:3007: snap_create 2021-07-26T16:07:48.337 INFO:tasks.rados.rados.0.smithi033.stdout:3003: expect (ObjNum 846 snap 281 seq_num 846) 2021-07-26T16:07:48.410 INFO:tasks.rados.rados.0.smithi033.stdout:3006: finishing write tid 1 to smithi03339061-22 2021-07-26T16:07:48.410 INFO:tasks.rados.rados.0.smithi033.stdout:3006: finishing write tid 2 to smithi03339061-22 2021-07-26T16:07:48.411 INFO:tasks.rados.rados.0.smithi033.stdout:3006: finishing write tid 3 to smithi03339061-22 2021-07-26T16:07:48.411 INFO:tasks.rados.rados.0.smithi033.stdout:3006: finishing write tid 4 to smithi03339061-22 2021-07-26T16:07:48.411 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1775 (ObjNum 908 snap 304 seq_num 908) dirty exists 2021-07-26T16:07:48.411 INFO:tasks.rados.rados.0.smithi033.stdout:3006: left oid 22 (ObjNum 908 snap 304 seq_num 908) 2021-07-26T16:07:48.411 INFO:tasks.rados.rados.0.smithi033.stdout:3002: expect (ObjNum 733 snap 246 seq_num 733) 2021-07-26T16:07:48.569 INFO:tasks.rados.rados.0.smithi033.stdout:3005: finishing copy_from to smithi03339061-12 2021-07-26T16:07:48.569 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1405 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:07:48.570 INFO:tasks.rados.rados.0.smithi033.stdout:3005: finishing copy_from racing read to smithi03339061-12 2021-07-26T16:07:48.570 INFO:tasks.rados.rados.0.smithi033.stdout:3004: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:07:48.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:48 smithi033 bash[42377]: cluster 2021-07-26T16:07:47.156162+0000 mgr.y (mgr.34104) 415 : cluster [DBG] pgmap v795: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 599 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 502 KiB/s wr, 7 op/s 2021-07-26T16:07:48.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:48 smithi033 bash[42377]: cluster 2021-07-26T16:07:47.306122+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e650: 8 total, 8 up, 8 in 2021-07-26T16:07:48.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:48 smithi033 bash[41341]: cluster 2021-07-26T16:07:47.156162+0000 mgr.y (mgr.34104) 415 : cluster [DBG] pgmap v795: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 599 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 502 KiB/s wr, 7 op/s 2021-07-26T16:07:48.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:48 smithi033 bash[41341]: cluster 2021-07-26T16:07:47.306122+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e650: 8 total, 8 up, 8 in 2021-07-26T16:07:48.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:48 smithi096 bash[33981]: cluster 2021-07-26T16:07:47.156162+0000 mgr.y (mgr.34104) 415 : cluster [DBG] pgmap v795: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 599 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 502 KiB/s wr, 7 op/s 2021-07-26T16:07:48.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:48 smithi096 bash[33981]: cluster 2021-07-26T16:07:47.306122+0000 mon.a (mon.0) 1020 : cluster [DBG] osdmap e650: 8 total, 8 up, 8 in 2021-07-26T16:07:49.101 INFO:tasks.rados.rados.0.smithi033.stdout:3001: expect (ObjNum 860 snap 283 seq_num 860) 2021-07-26T16:07:49.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:49 smithi033 bash[41341]: cluster 2021-07-26T16:07:48.318884+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e651: 8 total, 8 up, 8 in 2021-07-26T16:07:49.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:49 smithi033 bash[42377]: cluster 2021-07-26T16:07:48.318884+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e651: 8 total, 8 up, 8 in 2021-07-26T16:07:49.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:49 smithi096 bash[33981]: cluster 2021-07-26T16:07:48.318884+0000 mon.a (mon.0) 1021 : cluster [DBG] osdmap e651: 8 total, 8 up, 8 in 2021-07-26T16:07:50.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:50 smithi033 bash[42377]: cluster 2021-07-26T16:07:49.156800+0000 mgr.y (mgr.34104) 416 : cluster [DBG] pgmap v798: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 600 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 352 KiB/s wr, 9 op/s 2021-07-26T16:07:50.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:50 smithi033 bash[42377]: cluster 2021-07-26T16:07:49.323382+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e652: 8 total, 8 up, 8 in 2021-07-26T16:07:50.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:50 smithi033 bash[41341]: cluster 2021-07-26T16:07:49.156800+0000 mgr.y (mgr.34104) 416 : cluster [DBG] pgmap v798: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 600 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 352 KiB/s wr, 9 op/s 2021-07-26T16:07:50.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:50 smithi033 bash[41341]: cluster 2021-07-26T16:07:49.323382+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e652: 8 total, 8 up, 8 in 2021-07-26T16:07:50.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:50 smithi096 bash[33981]: cluster 2021-07-26T16:07:49.156800+0000 mgr.y (mgr.34104) 416 : cluster [DBG] pgmap v798: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 600 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 15 MiB/s rd, 352 KiB/s wr, 9 op/s 2021-07-26T16:07:50.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:50 smithi096 bash[33981]: cluster 2021-07-26T16:07:49.323382+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e652: 8 total, 8 up, 8 in 2021-07-26T16:07:51.669 INFO:tasks.rados.rados.0.smithi033.stdout:3001: done (6 left) 2021-07-26T16:07:51.670 INFO:tasks.rados.rados.0.smithi033.stdout:3002: done (5 left) 2021-07-26T16:07:51.672 INFO:tasks.rados.rados.0.smithi033.stdout:3003: done (4 left) 2021-07-26T16:07:51.672 INFO:tasks.rados.rados.0.smithi033.stdout:3004: done (3 left) 2021-07-26T16:07:51.672 INFO:tasks.rados.rados.0.smithi033.stdout:3005: done (2 left) 2021-07-26T16:07:51.672 INFO:tasks.rados.rados.0.smithi033.stdout:3006: done (1 left) 2021-07-26T16:07:51.673 INFO:tasks.rados.rados.0.smithi033.stdout:3007: done (0 left) 2021-07-26T16:07:51.673 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 305 2021-07-26T16:07:51.673 INFO:tasks.rados.rados.0.smithi033.stdout:3008: seq_num 909 ranges {663552=425984,1089536=401408} 2021-07-26T16:07:51.688 INFO:tasks.rados.rados.0.smithi033.stdout:3008: writing smithi03339061-5 from 663552 to 1089536 tid 1 2021-07-26T16:07:51.690 INFO:tasks.rados.rados.0.smithi033.stdout:3008: writing smithi03339061-5 from 1089536 to 1490944 tid 2 2021-07-26T16:07:51.691 INFO:tasks.rados.rados.0.smithi033.stdout:3009: delete oid 35 current snap is 305 2021-07-26T16:07:51.695 INFO:tasks.rados.rados.0.smithi033.stdout:3009: done (1 left) 2021-07-26T16:07:51.696 INFO:tasks.rados.rados.0.smithi033.stdout:3010: rmattr oid 45 current snap is 305 2021-07-26T16:07:51.696 INFO:tasks.rados.rados.0.smithi033.stdout:3010: done (1 left) 2021-07-26T16:07:51.696 INFO:tasks.rados.rados.0.smithi033.stdout:3011: read oid 42 snap -1 2021-07-26T16:07:51.696 INFO:tasks.rados.rados.0.smithi033.stdout:3011: expect (ObjNum 900 snap 300 seq_num 900) 2021-07-26T16:07:51.696 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 305 2021-07-26T16:07:51.697 INFO:tasks.rados.rados.0.smithi033.stdout:3012: seq_num 911 ranges {2080768=466944,2547712=401408} 2021-07-26T16:07:51.714 INFO:tasks.rados.rados.0.smithi033.stdout:3012: writing smithi03339061-24 from 2080768 to 2547712 tid 1 2021-07-26T16:07:51.717 INFO:tasks.rados.rados.0.smithi033.stdout:3012: writing smithi03339061-24 from 2547712 to 2949120 tid 2 2021-07-26T16:07:51.717 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 305 2021-07-26T16:07:51.717 INFO:tasks.rados.rados.0.smithi033.stdout:3008: finishing write tid 1 to smithi03339061-5 2021-07-26T16:07:51.717 INFO:tasks.rados.rados.0.smithi033.stdout:3008: finishing write tid 2 to smithi03339061-5 2021-07-26T16:07:51.718 INFO:tasks.rados.rados.0.smithi033.stdout:3008: finishing write tid 3 to smithi03339061-5 2021-07-26T16:07:51.718 INFO:tasks.rados.rados.0.smithi033.stdout:3008: finishing write tid 4 to smithi03339061-5 2021-07-26T16:07:51.718 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 1284 (ObjNum 909 snap 305 seq_num 909) dirty exists 2021-07-26T16:07:51.718 INFO:tasks.rados.rados.0.smithi033.stdout:3008: left oid 5 (ObjNum 909 snap 305 seq_num 909) 2021-07-26T16:07:51.719 INFO:tasks.rados.rados.0.smithi033.stdout:3013: seq_num 912 ranges {2965504=483328,3448832=401408} 2021-07-26T16:07:51.737 INFO:tasks.rados.rados.0.smithi033.stdout:3013: writing smithi03339061-27 from 2965504 to 3448832 tid 1 2021-07-26T16:07:51.740 INFO:tasks.rados.rados.0.smithi033.stdout:3013: writing smithi03339061-27 from 3448832 to 3850240 tid 2 2021-07-26T16:07:51.741 INFO:tasks.rados.rados.0.smithi033.stdout:3008: done (3 left) 2021-07-26T16:07:51.741 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 305 2021-07-26T16:07:51.741 INFO:tasks.rados.rados.0.smithi033.stdout:3014: seq_num 913 ranges {581632=499712,1081344=401408} 2021-07-26T16:07:51.747 INFO:tasks.rados.rados.0.smithi033.stdout:3014: writing smithi03339061-7 from 581632 to 1081344 tid 1 2021-07-26T16:07:51.750 INFO:tasks.rados.rados.0.smithi033.stdout:3014: writing smithi03339061-7 from 1081344 to 1482752 tid 2 2021-07-26T16:07:51.750 INFO:tasks.rados.rados.0.smithi033.stdout:3015: delete oid 44 current snap is 305 2021-07-26T16:07:51.751 INFO:tasks.rados.rados.0.smithi033.stdout:3012: finishing write tid 1 to smithi03339061-24 2021-07-26T16:07:51.751 INFO:tasks.rados.rados.0.smithi033.stdout:3012: finishing write tid 2 to smithi03339061-24 2021-07-26T16:07:51.751 INFO:tasks.rados.rados.0.smithi033.stdout:3012: finishing write tid 3 to smithi03339061-24 2021-07-26T16:07:51.751 INFO:tasks.rados.rados.0.smithi033.stdout:3012: finishing write tid 4 to smithi03339061-24 2021-07-26T16:07:51.751 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1477 (ObjNum 911 snap 305 seq_num 911) dirty exists 2021-07-26T16:07:51.752 INFO:tasks.rados.rados.0.smithi033.stdout:3012: left oid 24 (ObjNum 911 snap 305 seq_num 911) 2021-07-26T16:07:51.752 INFO:tasks.rados.rados.0.smithi033.stdout:3011: expect (ObjNum 900 snap 300 seq_num 900) 2021-07-26T16:07:52.350 INFO:tasks.rados.rados.0.smithi033.stdout:3013: finishing write tid 1 to smithi03339061-27 2021-07-26T16:07:52.351 INFO:tasks.rados.rados.0.smithi033.stdout:3013: finishing write tid 2 to smithi03339061-27 2021-07-26T16:07:52.351 INFO:tasks.rados.rados.0.smithi033.stdout:3013: finishing write tid 3 to smithi03339061-27 2021-07-26T16:07:52.351 INFO:tasks.rados.rados.0.smithi033.stdout:3013: finishing write tid 4 to smithi03339061-27 2021-07-26T16:07:52.351 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1425 (ObjNum 912 snap 305 seq_num 912) dirty exists 2021-07-26T16:07:52.352 INFO:tasks.rados.rados.0.smithi033.stdout:3013: left oid 27 (ObjNum 912 snap 305 seq_num 912) 2021-07-26T16:07:52.352 INFO:tasks.rados.rados.0.smithi033.stdout:3014: finishing write tid 1 to smithi03339061-7 2021-07-26T16:07:52.352 INFO:tasks.rados.rados.0.smithi033.stdout:3014: finishing write tid 2 to smithi03339061-7 2021-07-26T16:07:52.352 INFO:tasks.rados.rados.0.smithi033.stdout:3014: finishing write tid 3 to smithi03339061-7 2021-07-26T16:07:52.353 INFO:tasks.rados.rados.0.smithi033.stdout:3014: finishing write tid 4 to smithi03339061-7 2021-07-26T16:07:52.353 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1428 (ObjNum 913 snap 305 seq_num 913) dirty exists 2021-07-26T16:07:52.353 INFO:tasks.rados.rados.0.smithi033.stdout:3014: left oid 7 (ObjNum 913 snap 305 seq_num 913) 2021-07-26T16:07:52.353 INFO:tasks.rados.rados.0.smithi033.stdout:3011: done (4 left) 2021-07-26T16:07:52.353 INFO:tasks.rados.rados.0.smithi033.stdout:3012: done (3 left) 2021-07-26T16:07:52.354 INFO:tasks.rados.rados.0.smithi033.stdout:3013: done (2 left) 2021-07-26T16:07:52.354 INFO:tasks.rados.rados.0.smithi033.stdout:3014: done (1 left) 2021-07-26T16:07:52.354 INFO:tasks.rados.rados.0.smithi033.stdout:3015: done (0 left) 2021-07-26T16:07:52.354 INFO:tasks.rados.rados.0.smithi033.stdout:3016: read oid 38 snap 276 2021-07-26T16:07:52.354 INFO:tasks.rados.rados.0.smithi033.stdout:3016: expect deleted 2021-07-26T16:07:52.355 INFO:tasks.rados.rados.0.smithi033.stdout:3017: delete oid 19 current snap is 305 2021-07-26T16:07:52.355 INFO:tasks.rados.rados.0.smithi033.stdout:3016: done (1 left) 2021-07-26T16:07:52.356 INFO:tasks.rados.rados.0.smithi033.stdout:3017: done (0 left) 2021-07-26T16:07:52.356 INFO:tasks.rados.rados.0.smithi033.stdout:3018: rollback oid 1 current snap is 305 2021-07-26T16:07:52.356 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 1 to 235 2021-07-26T16:07:52.356 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 305 2021-07-26T16:07:52.357 INFO:tasks.rados.rados.0.smithi033.stdout:3019: seq_num 916 ranges {2080768=548864,2629632=401408} 2021-07-26T16:07:52.375 INFO:tasks.rados.rados.0.smithi033.stdout:3019: writing smithi03339061-21 from 2080768 to 2629632 tid 1 2021-07-26T16:07:52.378 INFO:tasks.rados.rados.0.smithi033.stdout:3019: writing smithi03339061-21 from 2629632 to 3031040 tid 2 2021-07-26T16:07:52.378 INFO:tasks.rados.rados.0.smithi033.stdout:3020: snap_create 2021-07-26T16:07:52.378 INFO:tasks.rados.rados.0.smithi033.stdout:3018: finishing rollback tid 1 to smithi03339061-1 2021-07-26T16:07:52.378 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1070 (ObjNum 1431394405 snap 1683123539 seq_num 1700550480) dirty dne 2021-07-26T16:07:52.385 INFO:tasks.rados.rados.0.smithi033.stdout:3019: finishing write tid 1 to smithi03339061-21 2021-07-26T16:07:52.386 INFO:tasks.rados.rados.0.smithi033.stdout:3019: finishing write tid 2 to smithi03339061-21 2021-07-26T16:07:52.387 INFO:tasks.rados.rados.0.smithi033.stdout:3019: finishing write tid 3 to smithi03339061-21 2021-07-26T16:07:52.389 INFO:tasks.rados.rados.0.smithi033.stdout:3019: finishing write tid 4 to smithi03339061-21 2021-07-26T16:07:52.389 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1432 (ObjNum 916 snap 305 seq_num 916) dirty exists 2021-07-26T16:07:52.390 INFO:tasks.rados.rados.0.smithi033.stdout:3019: left oid 21 (ObjNum 916 snap 305 seq_num 916) 2021-07-26T16:07:52.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:52 smithi033 bash[41341]: cluster 2021-07-26T16:07:51.157496+0000 mgr.y (mgr.34104) 417 : cluster [DBG] pgmap v800: 25 pgs: 25 active+clean; 606 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 859 KiB/s wr, 8 op/s 2021-07-26T16:07:52.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:52 smithi033 bash[41341]: cluster 2021-07-26T16:07:51.189012+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e653: 8 total, 8 up, 8 in 2021-07-26T16:07:52.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:52 smithi033 bash[42377]: cluster 2021-07-26T16:07:51.157496+0000 mgr.y (mgr.34104) 417 : cluster [DBG] pgmap v800: 25 pgs: 25 active+clean; 606 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 859 KiB/s wr, 8 op/s 2021-07-26T16:07:52.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:52 smithi033 bash[42377]: cluster 2021-07-26T16:07:51.189012+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e653: 8 total, 8 up, 8 in 2021-07-26T16:07:52.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:52 smithi096 bash[33981]: cluster 2021-07-26T16:07:51.157496+0000 mgr.y (mgr.34104) 417 : cluster [DBG] pgmap v800: 25 pgs: 25 active+clean; 606 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 MiB/s rd, 859 KiB/s wr, 8 op/s 2021-07-26T16:07:52.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:52 smithi096 bash[33981]: cluster 2021-07-26T16:07:51.189012+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e653: 8 total, 8 up, 8 in 2021-07-26T16:07:53.200 INFO:tasks.rados.rados.0.smithi033.stdout:3018: done (2 left) 2021-07-26T16:07:53.200 INFO:tasks.rados.rados.0.smithi033.stdout:3019: done (1 left) 2021-07-26T16:07:53.201 INFO:tasks.rados.rados.0.smithi033.stdout:3020: done (0 left) 2021-07-26T16:07:53.201 INFO:tasks.rados.rados.0.smithi033.stdout:3021: rollback oid 16 current snap is 306 2021-07-26T16:07:53.201 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 16 to 288 2021-07-26T16:07:53.201 INFO:tasks.rados.rados.0.smithi033.stdout:3022: setattr oid 43 current snap is 306 2021-07-26T16:07:53.202 INFO:tasks.rados.rados.0.smithi033.stdout:3023: delete oid 40 current snap is 306 2021-07-26T16:07:53.211 INFO:tasks.rados.rados.0.smithi033.stdout:3023: done (2 left) 2021-07-26T16:07:53.211 INFO:tasks.rados.rados.0.smithi033.stdout:3024: copy_from oid 13 from oid 49 current snap is 306 2021-07-26T16:07:53.211 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 1285 (ObjNum 733 snap 246 seq_num 733) dirty exists 2021-07-26T16:07:53.211 INFO:tasks.rados.rados.0.smithi033.stdout:3022: done (2 left) 2021-07-26T16:07:53.212 INFO:tasks.rados.rados.0.smithi033.stdout:3025: setattr oid 41 current snap is 306 2021-07-26T16:07:53.213 INFO:tasks.rados.rados.0.smithi033.stdout:3026: copy_from oid 9 from oid 6 current snap is 306 2021-07-26T16:07:53.213 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 30 current snap is 306 2021-07-26T16:07:53.216 INFO:tasks.rados.rados.0.smithi033.stdout:3027: seq_num 918 ranges {6471680=581632,7053312=401408} 2021-07-26T16:07:53.256 INFO:tasks.rados.rados.0.smithi033.stdout:3027: writing smithi03339061-30 from 6471680 to 7053312 tid 1 2021-07-26T16:07:53.259 INFO:tasks.rados.rados.0.smithi033.stdout:3027: writing smithi03339061-30 from 7053312 to 7454720 tid 2 2021-07-26T16:07:53.259 INFO:tasks.rados.rados.0.smithi033.stdout:3028: snap_create 2021-07-26T16:07:53.259 INFO:tasks.rados.rados.0.smithi033.stdout:3021: finishing rollback tid 0 to smithi03339061-16 2021-07-26T16:07:53.259 INFO:tasks.rados.rados.0.smithi033.stdout:3021: finishing rollback tid 1 to smithi03339061-16 2021-07-26T16:07:53.260 INFO:tasks.rados.rados.0.smithi033.stdout:3021: finishing rollback tid 2 to smithi03339061-16 2021-07-26T16:07:53.260 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1332 (ObjNum 877 snap 288 seq_num 877) dirty exists 2021-07-26T16:07:53.260 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1286 (ObjNum 703 snap 233 seq_num 703) dirty exists 2021-07-26T16:07:53.260 INFO:tasks.rados.rados.0.smithi033.stdout:3026: finishing copy_from to smithi03339061-9 2021-07-26T16:07:53.261 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 1753 (ObjNum 901 snap 300 seq_num 901) dirty exists 2021-07-26T16:07:53.261 INFO:tasks.rados.rados.0.smithi033.stdout:3026: finishing copy_from racing read to smithi03339061-9 2021-07-26T16:07:53.266 INFO:tasks.rados.rados.0.smithi033.stdout:3027: finishing write tid 1 to smithi03339061-30 2021-07-26T16:07:53.267 INFO:tasks.rados.rados.0.smithi033.stdout:3027: finishing write tid 2 to smithi03339061-30 2021-07-26T16:07:53.267 INFO:tasks.rados.rados.0.smithi033.stdout:3027: finishing write tid 3 to smithi03339061-30 2021-07-26T16:07:53.270 INFO:tasks.rados.rados.0.smithi033.stdout:3027: finishing write tid 4 to smithi03339061-30 2021-07-26T16:07:53.270 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 1480 (ObjNum 918 snap 306 seq_num 918) dirty exists 2021-07-26T16:07:53.270 INFO:tasks.rados.rados.0.smithi033.stdout:3027: left oid 30 (ObjNum 918 snap 306 seq_num 918) 2021-07-26T16:07:53.296 INFO:tasks.rados.rados.0.smithi033.stdout:3024: finishing copy_from to smithi03339061-13 2021-07-26T16:07:53.296 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 918 (ObjNum 860 snap 283 seq_num 860) dirty exists 2021-07-26T16:07:53.297 INFO:tasks.rados.rados.0.smithi033.stdout:3024: finishing copy_from racing read to smithi03339061-13 2021-07-26T16:07:54.212 INFO:tasks.rados.rados.0.smithi033.stdout:3021: done (5 left) 2021-07-26T16:07:54.212 INFO:tasks.rados.rados.0.smithi033.stdout:3024: done (4 left) 2021-07-26T16:07:54.213 INFO:tasks.rados.rados.0.smithi033.stdout:3025: done (3 left) 2021-07-26T16:07:54.213 INFO:tasks.rados.rados.0.smithi033.stdout:3026: done (2 left) 2021-07-26T16:07:54.213 INFO:tasks.rados.rados.0.smithi033.stdout:3027: done (1 left) 2021-07-26T16:07:54.213 INFO:tasks.rados.rados.0.smithi033.stdout:3028: done (0 left) 2021-07-26T16:07:54.214 INFO:tasks.rados.rados.0.smithi033.stdout:3029: read oid 10 snap -1 2021-07-26T16:07:54.214 INFO:tasks.rados.rados.0.smithi033.stdout:3029: expect (ObjNum 846 snap 281 seq_num 846) 2021-07-26T16:07:54.214 INFO:tasks.rados.rados.0.smithi033.stdout:3030: snap_create 2021-07-26T16:07:54.221 INFO:tasks.rados.rados.0.smithi033.stdout:3029: expect (ObjNum 846 snap 281 seq_num 846) 2021-07-26T16:07:54.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:54 smithi033 bash[41341]: cluster 2021-07-26T16:07:53.158240+0000 mgr.y (mgr.34104) 418 : cluster [DBG] pgmap v802: 25 pgs: 25 active+clean; 611 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2021-07-26T16:07:54.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:54 smithi033 bash[41341]: cluster 2021-07-26T16:07:53.196514+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e654: 8 total, 8 up, 8 in 2021-07-26T16:07:54.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:54 smithi033 bash[42377]: cluster 2021-07-26T16:07:53.158240+0000 mgr.y (mgr.34104) 418 : cluster [DBG] pgmap v802: 25 pgs: 25 active+clean; 611 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2021-07-26T16:07:54.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:54 smithi033 bash[42377]: cluster 2021-07-26T16:07:53.196514+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e654: 8 total, 8 up, 8 in 2021-07-26T16:07:54.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:54 smithi096 bash[33981]: cluster 2021-07-26T16:07:53.158240+0000 mgr.y (mgr.34104) 418 : cluster [DBG] pgmap v802: 25 pgs: 25 active+clean; 611 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 21 MiB/s rd, 1.3 MiB/s wr, 10 op/s 2021-07-26T16:07:54.489 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:54 smithi096 bash[33981]: cluster 2021-07-26T16:07:53.196514+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e654: 8 total, 8 up, 8 in 2021-07-26T16:07:55.220 INFO:tasks.rados.rados.0.smithi033.stdout:3029: done (1 left) 2021-07-26T16:07:55.221 INFO:tasks.rados.rados.0.smithi033.stdout:3030: done (0 left) 2021-07-26T16:07:55.221 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 308 2021-07-26T16:07:55.221 INFO:tasks.rados.rados.0.smithi033.stdout:3031: seq_num 919 ranges {7151616=598016,7749632=401408} 2021-07-26T16:07:55.267 INFO:tasks.rados.rados.0.smithi033.stdout:3031: writing smithi03339061-42 from 7151616 to 7749632 tid 1 2021-07-26T16:07:55.269 INFO:tasks.rados.rados.0.smithi033.stdout:3031: writing smithi03339061-42 from 7749632 to 8151040 tid 2 2021-07-26T16:07:55.269 INFO:tasks.rados.rados.0.smithi033.stdout:3032: setattr oid 12 current snap is 308 2021-07-26T16:07:55.270 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 308 2021-07-26T16:07:55.270 INFO:tasks.rados.rados.0.smithi033.stdout:3033: seq_num 920 ranges {0=614400,614400=401408} 2021-07-26T16:07:55.274 INFO:tasks.rados.rados.0.smithi033.stdout:3033: writing smithi03339061-25 from 0 to 614400 tid 1 2021-07-26T16:07:55.277 INFO:tasks.rados.rados.0.smithi033.stdout:3033: writing smithi03339061-25 from 614400 to 1015808 tid 2 2021-07-26T16:07:55.277 INFO:tasks.rados.rados.0.smithi033.stdout:3034: read oid 23 snap -1 2021-07-26T16:07:55.277 INFO:tasks.rados.rados.0.smithi033.stdout:3034: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:07:55.277 INFO:tasks.rados.rados.0.smithi033.stdout:3035: delete oid 17 current snap is 308 2021-07-26T16:07:55.281 INFO:tasks.rados.rados.0.smithi033.stdout:3031: finishing write tid 1 to smithi03339061-42 2021-07-26T16:07:55.283 INFO:tasks.rados.rados.0.smithi033.stdout:3031: finishing write tid 2 to smithi03339061-42 2021-07-26T16:07:55.286 INFO:tasks.rados.rados.0.smithi033.stdout:3035: done (4 left) 2021-07-26T16:07:55.287 INFO:tasks.rados.rados.0.smithi033.stdout:3036: setattr oid 30 current snap is 308 2021-07-26T16:07:55.287 INFO:tasks.rados.rados.0.smithi033.stdout:3033: finishing write tid 1 to smithi03339061-25 2021-07-26T16:07:55.287 INFO:tasks.rados.rados.0.smithi033.stdout:3031: finishing write tid 3 to smithi03339061-42 2021-07-26T16:07:55.288 INFO:tasks.rados.rados.0.smithi033.stdout:3033: finishing write tid 2 to smithi03339061-25 2021-07-26T16:07:55.288 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1410 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:07:55.288 INFO:tasks.rados.rados.0.smithi033.stdout:3033: finishing write tid 3 to smithi03339061-25 2021-07-26T16:07:55.288 INFO:tasks.rados.rados.0.smithi033.stdout:3031: finishing write tid 4 to smithi03339061-42 2021-07-26T16:07:55.288 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1725 (ObjNum 919 snap 308 seq_num 919) dirty exists 2021-07-26T16:07:55.289 INFO:tasks.rados.rados.0.smithi033.stdout:3031: left oid 42 (ObjNum 919 snap 308 seq_num 919) 2021-07-26T16:07:55.289 INFO:tasks.rados.rados.0.smithi033.stdout:3031: done (4 left) 2021-07-26T16:07:55.289 INFO:tasks.rados.rados.0.smithi033.stdout:3032: done (3 left) 2021-07-26T16:07:55.289 INFO:tasks.rados.rados.0.smithi033.stdout:3037: delete oid 34 current snap is 308 2021-07-26T16:07:55.290 INFO:tasks.rados.rados.0.smithi033.stdout:3033: finishing write tid 4 to smithi03339061-25 2021-07-26T16:07:55.290 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 1335 (ObjNum 920 snap 308 seq_num 920) dirty exists 2021-07-26T16:07:55.291 INFO:tasks.rados.rados.0.smithi033.stdout:3033: left oid 25 (ObjNum 920 snap 308 seq_num 920) 2021-07-26T16:07:55.291 INFO:tasks.rados.rados.0.smithi033.stdout:3033: done (3 left) 2021-07-26T16:07:55.291 INFO:tasks.rados.rados.0.smithi033.stdout:3037: done (2 left) 2021-07-26T16:07:55.291 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 34 current snap is 308 2021-07-26T16:07:55.292 INFO:tasks.rados.rados.0.smithi033.stdout:3038: seq_num 923 ranges {0=663552,663552=401408} 2021-07-26T16:07:55.294 INFO:tasks.rados.rados.0.smithi033.stdout:3038: writing smithi03339061-34 from 0 to 663552 tid 1 2021-07-26T16:07:55.296 INFO:tasks.rados.rados.0.smithi033.stdout:3038: writing smithi03339061-34 from 663552 to 1064960 tid 2 2021-07-26T16:07:55.297 INFO:tasks.rados.rados.0.smithi033.stdout:3039: snap_remove snap 294 2021-07-26T16:07:55.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:55 smithi096 bash[33981]: cluster 2021-07-26T16:07:54.209749+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e655: 8 total, 8 up, 8 in 2021-07-26T16:07:55.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:55 smithi033 bash[41341]: cluster 2021-07-26T16:07:54.209749+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e655: 8 total, 8 up, 8 in 2021-07-26T16:07:55.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:55 smithi033 bash[42377]: cluster 2021-07-26T16:07:54.209749+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e655: 8 total, 8 up, 8 in 2021-07-26T16:07:56.193 INFO:tasks.rados.rados.0.smithi033.stdout:3039: done (3 left) 2021-07-26T16:07:56.193 INFO:tasks.rados.rados.0.smithi033.stdout:3040: copy_from oid 42 from oid 7 current snap is 308 2021-07-26T16:07:56.194 INFO:tasks.rados.rados.0.smithi033.stdout:3034: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:07:56.277 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 1481 (ObjNum 918 snap 306 seq_num 918) dirty exists 2021-07-26T16:07:56.277 INFO:tasks.rados.rados.0.smithi033.stdout:3038: finishing write tid 1 to smithi03339061-34 2021-07-26T16:07:56.277 INFO:tasks.rados.rados.0.smithi033.stdout:3038: finishing write tid 2 to smithi03339061-34 2021-07-26T16:07:56.277 INFO:tasks.rados.rados.0.smithi033.stdout:3038: finishing write tid 3 to smithi03339061-34 2021-07-26T16:07:56.278 INFO:tasks.rados.rados.0.smithi033.stdout:3038: finishing write tid 4 to smithi03339061-34 2021-07-26T16:07:56.278 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1414 (ObjNum 923 snap 308 seq_num 923) dirty exists 2021-07-26T16:07:56.278 INFO:tasks.rados.rados.0.smithi033.stdout:3038: left oid 34 (ObjNum 923 snap 308 seq_num 923) 2021-07-26T16:07:56.278 INFO:tasks.rados.rados.0.smithi033.stdout:3040: finishing copy_from to smithi03339061-42 2021-07-26T16:07:56.278 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1428 (ObjNum 913 snap 305 seq_num 913) dirty exists 2021-07-26T16:07:56.279 INFO:tasks.rados.rados.0.smithi033.stdout:3040: finishing copy_from racing read to smithi03339061-42 2021-07-26T16:07:56.279 INFO:tasks.rados.rados.0.smithi033.stdout:3034: done (3 left) 2021-07-26T16:07:56.279 INFO:tasks.rados.rados.0.smithi033.stdout:3036: done (2 left) 2021-07-26T16:07:56.279 INFO:tasks.rados.rados.0.smithi033.stdout:3038: done (1 left) 2021-07-26T16:07:56.280 INFO:tasks.rados.rados.0.smithi033.stdout:3040: done (0 left) 2021-07-26T16:07:56.280 INFO:tasks.rados.rados.0.smithi033.stdout:3041: rollback oid 35 current snap is 308 2021-07-26T16:07:56.280 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 299 2021-07-26T16:07:56.282 INFO:tasks.rados.rados.0.smithi033.stdout:3042: snap_create 2021-07-26T16:07:56.283 INFO:tasks.rados.rados.0.smithi033.stdout:3041: finishing rollback tid 1 to smithi03339061-35 2021-07-26T16:07:56.283 INFO:tasks.rados.rados.0.smithi033.stdout:3041: finishing rollback tid 2 to smithi03339061-35 2021-07-26T16:07:56.283 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1755 (ObjNum 815 snap 272 seq_num 815) dirty exists 2021-07-26T16:07:56.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:56 smithi096 bash[33981]: cluster 2021-07-26T16:07:55.159012+0000 mgr.y (mgr.34104) 419 : cluster [DBG] pgmap v805: 25 pgs: 25 active+clean; 611 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 877 KiB/s wr, 13 op/s 2021-07-26T16:07:56.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:56 smithi096 bash[33981]: cluster 2021-07-26T16:07:55.217420+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e656: 8 total, 8 up, 8 in 2021-07-26T16:07:56.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:56 smithi096 bash[33981]: cluster 2021-07-26T16:07:56.188790+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e657: 8 total, 8 up, 8 in 2021-07-26T16:07:56.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:56 smithi033 bash[42377]: cluster 2021-07-26T16:07:55.159012+0000 mgr.y (mgr.34104) 419 : cluster [DBG] pgmap v805: 25 pgs: 25 active+clean; 611 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 877 KiB/s wr, 13 op/s 2021-07-26T16:07:56.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:56 smithi033 bash[42377]: cluster 2021-07-26T16:07:55.217420+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e656: 8 total, 8 up, 8 in 2021-07-26T16:07:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:56 smithi033 bash[42377]: cluster 2021-07-26T16:07:56.188790+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e657: 8 total, 8 up, 8 in 2021-07-26T16:07:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:56 smithi033 bash[41341]: cluster 2021-07-26T16:07:55.159012+0000 mgr.y (mgr.34104) 419 : cluster [DBG] pgmap v805: 25 pgs: 25 active+clean; 611 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 877 KiB/s wr, 13 op/s 2021-07-26T16:07:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:56 smithi033 bash[41341]: cluster 2021-07-26T16:07:55.217420+0000 mon.a (mon.0) 1026 : cluster [DBG] osdmap e656: 8 total, 8 up, 8 in 2021-07-26T16:07:56.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:56 smithi033 bash[41341]: cluster 2021-07-26T16:07:56.188790+0000 mon.a (mon.0) 1027 : cluster [DBG] osdmap e657: 8 total, 8 up, 8 in 2021-07-26T16:07:57.230 INFO:tasks.rados.rados.0.smithi033.stdout:3041: done (1 left) 2021-07-26T16:07:57.231 INFO:tasks.rados.rados.0.smithi033.stdout:3042: done (0 left) 2021-07-26T16:07:57.231 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 309 2021-07-26T16:07:57.231 INFO:tasks.rados.rados.0.smithi033.stdout:3043: seq_num 924 ranges {9289728=679936,9969664=401408} 2021-07-26T16:07:57.286 INFO:tasks.rados.rados.0.smithi033.stdout:3043: writing smithi03339061-4 from 9289728 to 9969664 tid 1 2021-07-26T16:07:57.288 INFO:tasks.rados.rados.0.smithi033.stdout:3043: writing smithi03339061-4 from 9969664 to 10371072 tid 2 2021-07-26T16:07:57.288 INFO:tasks.rados.rados.0.smithi033.stdout:3044: snap_remove snap 274 2021-07-26T16:07:58.242 INFO:tasks.rados.rados.0.smithi033.stdout:3044: done (1 left) 2021-07-26T16:07:58.242 INFO:tasks.rados.rados.0.smithi033.stdout:3045: snap_remove snap 297 2021-07-26T16:07:58.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:58 smithi033 bash[42377]: cluster 2021-07-26T16:07:57.159851+0000 mgr.y (mgr.34104) 420 : cluster [DBG] pgmap v808: 25 pgs: 25 active+clean; 631 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 5.3 MiB/s wr, 16 op/s 2021-07-26T16:07:58.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:58 smithi033 bash[42377]: cluster 2021-07-26T16:07:57.227922+0000 mon.a (mon.0) 1028 : cluster [DBG] osdmap e658: 8 total, 8 up, 8 in 2021-07-26T16:07:58.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:58 smithi033 bash[41341]: cluster 2021-07-26T16:07:57.159851+0000 mgr.y (mgr.34104) 420 : cluster [DBG] pgmap v808: 25 pgs: 25 active+clean; 631 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 5.3 MiB/s wr, 16 op/s 2021-07-26T16:07:58.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:58 smithi033 bash[41341]: cluster 2021-07-26T16:07:57.227922+0000 mon.a (mon.0) 1028 : cluster [DBG] osdmap e658: 8 total, 8 up, 8 in 2021-07-26T16:07:58.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:58 smithi096 bash[33981]: cluster 2021-07-26T16:07:57.159851+0000 mgr.y (mgr.34104) 420 : cluster [DBG] pgmap v808: 25 pgs: 25 active+clean; 631 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 5.3 MiB/s wr, 16 op/s 2021-07-26T16:07:58.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:58 smithi096 bash[33981]: cluster 2021-07-26T16:07:57.227922+0000 mon.a (mon.0) 1028 : cluster [DBG] osdmap e658: 8 total, 8 up, 8 in 2021-07-26T16:07:59.263 INFO:tasks.rados.rados.0.smithi033.stdout:3045: done (1 left) 2021-07-26T16:07:59.264 INFO:tasks.rados.rados.0.smithi033.stdout:3046: delete oid 26 current snap is 309 2021-07-26T16:07:59.264 INFO:tasks.rados.rados.0.smithi033.stdout:3043: finishing write tid 1 to smithi03339061-4 2021-07-26T16:07:59.264 INFO:tasks.rados.rados.0.smithi033.stdout:3043: finishing write tid 2 to smithi03339061-4 2021-07-26T16:07:59.265 INFO:tasks.rados.rados.0.smithi033.stdout:3043: finishing write tid 3 to smithi03339061-4 2021-07-26T16:07:59.265 INFO:tasks.rados.rados.0.smithi033.stdout:3043: finishing write tid 4 to smithi03339061-4 2021-07-26T16:07:59.266 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1391 (ObjNum 924 snap 309 seq_num 924) dirty exists 2021-07-26T16:07:59.266 INFO:tasks.rados.rados.0.smithi033.stdout:3043: left oid 4 (ObjNum 924 snap 309 seq_num 924) 2021-07-26T16:07:59.274 INFO:tasks.rados.rados.0.smithi033.stdout:3043: done (1 left) 2021-07-26T16:07:59.275 INFO:tasks.rados.rados.0.smithi033.stdout:3046: done (0 left) 2021-07-26T16:07:59.275 INFO:tasks.rados.rados.0.smithi033.stdout:3047: snap_remove snap 305 2021-07-26T16:07:59.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:07:59 smithi033 bash[42377]: cluster 2021-07-26T16:07:58.234636+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e659: 8 total, 8 up, 8 in 2021-07-26T16:07:59.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:07:59 smithi033 bash[41341]: cluster 2021-07-26T16:07:58.234636+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e659: 8 total, 8 up, 8 in 2021-07-26T16:07:59.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:07:59 smithi096 bash[33981]: cluster 2021-07-26T16:07:58.234636+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e659: 8 total, 8 up, 8 in 2021-07-26T16:08:00.277 INFO:tasks.rados.rados.0.smithi033.stdout:3047: done (0 left) 2021-07-26T16:08:00.277 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 309 2021-07-26T16:08:00.278 INFO:tasks.rados.rados.0.smithi033.stdout:3048: seq_num 926 ranges {0=712704,712704=401408} 2021-07-26T16:08:00.280 INFO:tasks.rados.rados.0.smithi033.stdout:3048: writing smithi03339061-50 from 0 to 712704 tid 1 2021-07-26T16:08:00.282 INFO:tasks.rados.rados.0.smithi033.stdout:3048: writing smithi03339061-50 from 712704 to 1114112 tid 2 2021-07-26T16:08:00.282 INFO:tasks.rados.rados.0.smithi033.stdout:3049: delete oid 42 current snap is 309 2021-07-26T16:08:00.286 INFO:tasks.rados.rados.0.smithi033.stdout:3049: done (1 left) 2021-07-26T16:08:00.287 INFO:tasks.rados.rados.0.smithi033.stdout:3050: snap_create 2021-07-26T16:08:00.287 INFO:tasks.rados.rados.0.smithi033.stdout:3048: finishing write tid 1 to smithi03339061-50 2021-07-26T16:08:00.288 INFO:tasks.rados.rados.0.smithi033.stdout:3048: finishing write tid 2 to smithi03339061-50 2021-07-26T16:08:00.288 INFO:tasks.rados.rados.0.smithi033.stdout:3048: finishing write tid 3 to smithi03339061-50 2021-07-26T16:08:00.289 INFO:tasks.rados.rados.0.smithi033.stdout:3048: finishing write tid 4 to smithi03339061-50 2021-07-26T16:08:00.289 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1338 (ObjNum 926 snap 309 seq_num 926) dirty exists 2021-07-26T16:08:00.290 INFO:tasks.rados.rados.0.smithi033.stdout:3048: left oid 50 (ObjNum 926 snap 309 seq_num 926) 2021-07-26T16:08:00.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:00 smithi033 bash[41341]: cluster 2021-07-26T16:07:59.160515+0000 mgr.y (mgr.34104) 421 : cluster [DBG] pgmap v811: 25 pgs: 25 active+clean; 632 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 13 op/s 2021-07-26T16:08:00.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:00 smithi033 bash[41341]: cluster 2021-07-26T16:07:59.257887+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e660: 8 total, 8 up, 8 in 2021-07-26T16:08:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:00 smithi033 bash[42377]: cluster 2021-07-26T16:07:59.160515+0000 mgr.y (mgr.34104) 421 : cluster [DBG] pgmap v811: 25 pgs: 25 active+clean; 632 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 13 op/s 2021-07-26T16:08:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:00 smithi033 bash[42377]: cluster 2021-07-26T16:07:59.257887+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e660: 8 total, 8 up, 8 in 2021-07-26T16:08:00.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:00 smithi096 bash[33981]: cluster 2021-07-26T16:07:59.160515+0000 mgr.y (mgr.34104) 421 : cluster [DBG] pgmap v811: 25 pgs: 25 active+clean; 632 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 5.4 MiB/s wr, 13 op/s 2021-07-26T16:08:00.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:00 smithi096 bash[33981]: cluster 2021-07-26T16:07:59.257887+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e660: 8 total, 8 up, 8 in 2021-07-26T16:08:01.277 INFO:tasks.rados.rados.0.smithi033.stdout:3048: done (1 left) 2021-07-26T16:08:01.277 INFO:tasks.rados.rados.0.smithi033.stdout:3050: done (0 left) 2021-07-26T16:08:01.277 INFO:tasks.rados.rados.0.smithi033.stdout:3051: snap_create 2021-07-26T16:08:01.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:01 smithi033 bash[41341]: cluster 2021-07-26T16:08:00.270185+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e661: 8 total, 8 up, 8 in 2021-07-26T16:08:01.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:01 smithi033 bash[42377]: cluster 2021-07-26T16:08:00.270185+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e661: 8 total, 8 up, 8 in 2021-07-26T16:08:01.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:01 smithi096 bash[33981]: cluster 2021-07-26T16:08:00.270185+0000 mon.a (mon.0) 1031 : cluster [DBG] osdmap e661: 8 total, 8 up, 8 in 2021-07-26T16:08:02.297 INFO:tasks.rados.rados.0.smithi033.stdout:3051: done (0 left) 2021-07-26T16:08:02.298 INFO:tasks.rados.rados.0.smithi033.stdout:3052: rollback oid 11 current snap is 311 2021-07-26T16:08:02.298 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 11 to 276 2021-07-26T16:08:02.298 INFO:tasks.rados.rados.0.smithi033.stdout:3053: rollback oid 32 current snap is 311 2021-07-26T16:08:02.298 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 32 to 283 2021-07-26T16:08:02.299 INFO:tasks.rados.rados.0.smithi033.stdout:3054: delete oid 15 current snap is 311 2021-07-26T16:08:02.305 INFO:tasks.rados.rados.0.smithi033.stdout:3053: finishing rollback tid 1 to smithi03339061-32 2021-07-26T16:08:02.305 INFO:tasks.rados.rados.0.smithi033.stdout:3054: done (2 left) 2021-07-26T16:08:02.306 INFO:tasks.rados.rados.0.smithi033.stdout:3055: rollback oid 41 current snap is 311 2021-07-26T16:08:02.306 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 41 to 285 2021-07-26T16:08:02.306 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 311 2021-07-26T16:08:02.306 INFO:tasks.rados.rados.0.smithi033.stdout:3056: seq_num 929 ranges {2498560=761856,3260416=401408} 2021-07-26T16:08:02.326 INFO:tasks.rados.rados.0.smithi033.stdout:3056: writing smithi03339061-46 from 2498560 to 3260416 tid 1 2021-07-26T16:08:02.328 INFO:tasks.rados.rados.0.smithi033.stdout:3056: writing smithi03339061-46 from 3260416 to 3661824 tid 2 2021-07-26T16:08:02.329 INFO:tasks.rados.rados.0.smithi033.stdout:3057: snap_create 2021-07-26T16:08:02.329 INFO:tasks.rados.rados.0.smithi033.stdout:3053: finishing rollback tid 2 to smithi03339061-32 2021-07-26T16:08:02.329 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1340 (ObjNum 825 snap 274 seq_num 825) dirty exists 2021-07-26T16:08:02.329 INFO:tasks.rados.rados.0.smithi033.stdout:3052: finishing rollback tid 0 to smithi03339061-11 2021-07-26T16:08:02.329 INFO:tasks.rados.rados.0.smithi033.stdout:3052: finishing rollback tid 1 to smithi03339061-11 2021-07-26T16:08:02.330 INFO:tasks.rados.rados.0.smithi033.stdout:3052: finishing rollback tid 2 to smithi03339061-11 2021-07-26T16:08:02.330 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1417 (ObjNum 775 snap 256 seq_num 775) dirty exists 2021-07-26T16:08:02.330 INFO:tasks.rados.rados.0.smithi033.stdout:3055: finishing rollback tid 0 to smithi03339061-41 2021-07-26T16:08:02.330 INFO:tasks.rados.rados.0.smithi033.stdout:3055: finishing rollback tid 1 to smithi03339061-41 2021-07-26T16:08:02.331 INFO:tasks.rados.rados.0.smithi033.stdout:3055: finishing rollback tid 2 to smithi03339061-41 2021-07-26T16:08:02.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1289 (ObjNum 845 snap 281 seq_num 845) dirty exists 2021-07-26T16:08:02.334 INFO:tasks.rados.rados.0.smithi033.stdout:3056: finishing write tid 1 to smithi03339061-46 2021-07-26T16:08:02.334 INFO:tasks.rados.rados.0.smithi033.stdout:3056: finishing write tid 2 to smithi03339061-46 2021-07-26T16:08:02.335 INFO:tasks.rados.rados.0.smithi033.stdout:3056: finishing write tid 3 to smithi03339061-46 2021-07-26T16:08:02.337 INFO:tasks.rados.rados.0.smithi033.stdout:3056: finishing write tid 4 to smithi03339061-46 2021-07-26T16:08:02.337 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1281 (ObjNum 929 snap 311 seq_num 929) dirty exists 2021-07-26T16:08:02.337 INFO:tasks.rados.rados.0.smithi033.stdout:3056: left oid 46 (ObjNum 929 snap 311 seq_num 929) 2021-07-26T16:08:02.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:02 smithi033 bash[41341]: cluster 2021-07-26T16:08:01.161225+0000 mgr.y (mgr.34104) 422 : cluster [DBG] pgmap v814: 25 pgs: 25 active+clean; 641 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 764 KiB/s wr, 15 op/s 2021-07-26T16:08:02.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:02 smithi033 bash[41341]: cluster 2021-07-26T16:08:01.272211+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e662: 8 total, 8 up, 8 in 2021-07-26T16:08:02.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:02 smithi033 bash[42377]: cluster 2021-07-26T16:08:01.161225+0000 mgr.y (mgr.34104) 422 : cluster [DBG] pgmap v814: 25 pgs: 25 active+clean; 641 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 764 KiB/s wr, 15 op/s 2021-07-26T16:08:02.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:02 smithi033 bash[42377]: cluster 2021-07-26T16:08:01.272211+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e662: 8 total, 8 up, 8 in 2021-07-26T16:08:02.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:02 smithi096 bash[33981]: cluster 2021-07-26T16:08:01.161225+0000 mgr.y (mgr.34104) 422 : cluster [DBG] pgmap v814: 25 pgs: 25 active+clean; 641 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.1 MiB/s rd, 764 KiB/s wr, 15 op/s 2021-07-26T16:08:02.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:02 smithi096 bash[33981]: cluster 2021-07-26T16:08:01.272211+0000 mon.a (mon.0) 1032 : cluster [DBG] osdmap e662: 8 total, 8 up, 8 in 2021-07-26T16:08:03.307 INFO:tasks.rados.rados.0.smithi033.stdout:3052: done (4 left) 2021-07-26T16:08:03.307 INFO:tasks.rados.rados.0.smithi033.stdout:3053: done (3 left) 2021-07-26T16:08:03.307 INFO:tasks.rados.rados.0.smithi033.stdout:3055: done (2 left) 2021-07-26T16:08:03.307 INFO:tasks.rados.rados.0.smithi033.stdout:3056: done (1 left) 2021-07-26T16:08:03.308 INFO:tasks.rados.rados.0.smithi033.stdout:3057: done (0 left) 2021-07-26T16:08:03.308 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 312 2021-07-26T16:08:03.308 INFO:tasks.rados.rados.0.smithi033.stdout:3058: seq_num 930 ranges {16826368=786432,17612800=401408} 2021-07-26T16:08:03.408 INFO:tasks.rados.rados.0.smithi033.stdout:3058: writing smithi03339061-13 from 16826368 to 17612800 tid 1 2021-07-26T16:08:03.410 INFO:tasks.rados.rados.0.smithi033.stdout:3058: writing smithi03339061-13 from 17612800 to 18014208 tid 2 2021-07-26T16:08:03.411 INFO:tasks.rados.rados.0.smithi033.stdout:3059: rollback oid 30 current snap is 312 2021-07-26T16:08:03.411 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 30 to 235 2021-07-26T16:08:03.411 INFO:tasks.rados.rados.0.smithi033.stdout:3060: snap_create 2021-07-26T16:08:03.424 INFO:tasks.rados.rados.0.smithi033.stdout:3058: finishing write tid 1 to smithi03339061-13 2021-07-26T16:08:03.424 INFO:tasks.rados.rados.0.smithi033.stdout:3059: finishing rollback tid 0 to smithi03339061-30 2021-07-26T16:08:03.424 INFO:tasks.rados.rados.0.smithi033.stdout:3058: finishing write tid 2 to smithi03339061-13 2021-07-26T16:08:03.425 INFO:tasks.rados.rados.0.smithi033.stdout:3059: finishing rollback tid 1 to smithi03339061-30 2021-07-26T16:08:03.425 INFO:tasks.rados.rados.0.smithi033.stdout:3058: finishing write tid 3 to smithi03339061-13 2021-07-26T16:08:03.426 INFO:tasks.rados.rados.0.smithi033.stdout:3059: finishing rollback tid 2 to smithi03339061-30 2021-07-26T16:08:03.426 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 1484 (ObjNum 658 snap 213 seq_num 658) dirty exists 2021-07-26T16:08:03.427 INFO:tasks.rados.rados.0.smithi033.stdout:3058: finishing write tid 4 to smithi03339061-13 2021-07-26T16:08:03.427 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1394 (ObjNum 930 snap 312 seq_num 930) dirty exists 2021-07-26T16:08:03.427 INFO:tasks.rados.rados.0.smithi033.stdout:3058: left oid 13 (ObjNum 930 snap 312 seq_num 930) 2021-07-26T16:08:03.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:03 smithi033 bash[41341]: cluster 2021-07-26T16:08:02.294969+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e663: 8 total, 8 up, 8 in 2021-07-26T16:08:03.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:03 smithi033 bash[42377]: cluster 2021-07-26T16:08:02.294969+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e663: 8 total, 8 up, 8 in 2021-07-26T16:08:03.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:03 smithi096 bash[33981]: cluster 2021-07-26T16:08:02.294969+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e663: 8 total, 8 up, 8 in 2021-07-26T16:08:04.310 INFO:tasks.rados.rados.0.smithi033.stdout:3058: done (2 left) 2021-07-26T16:08:04.311 INFO:tasks.rados.rados.0.smithi033.stdout:3059: done (1 left) 2021-07-26T16:08:04.311 INFO:tasks.rados.rados.0.smithi033.stdout:3060: done (0 left) 2021-07-26T16:08:04.311 INFO:tasks.rados.rados.0.smithi033.stdout:3061: read oid 41 snap -1 2021-07-26T16:08:04.311 INFO:tasks.rados.rados.0.smithi033.stdout:3061: expect (ObjNum 845 snap 281 seq_num 845) 2021-07-26T16:08:04.312 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 313 2021-07-26T16:08:04.312 INFO:tasks.rados.rados.0.smithi033.stdout:3062: seq_num 931 ranges {3088384=802816,3891200=401408} 2021-07-26T16:08:04.337 INFO:tasks.rados.rados.0.smithi033.stdout:3062: writing smithi03339061-8 from 3088384 to 3891200 tid 1 2021-07-26T16:08:04.339 INFO:tasks.rados.rados.0.smithi033.stdout:3062: writing smithi03339061-8 from 3891200 to 4292608 tid 2 2021-07-26T16:08:04.339 INFO:tasks.rados.rados.0.smithi033.stdout:3063: snap_create 2021-07-26T16:08:04.348 INFO:tasks.rados.rados.0.smithi033.stdout:3062: finishing write tid 1 to smithi03339061-8 2021-07-26T16:08:04.348 INFO:tasks.rados.rados.0.smithi033.stdout:3062: finishing write tid 2 to smithi03339061-8 2021-07-26T16:08:04.350 INFO:tasks.rados.rados.0.smithi033.stdout:3062: finishing write tid 3 to smithi03339061-8 2021-07-26T16:08:04.351 INFO:tasks.rados.rados.0.smithi033.stdout:3062: finishing write tid 4 to smithi03339061-8 2021-07-26T16:08:04.352 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1758 (ObjNum 931 snap 313 seq_num 931) dirty exists 2021-07-26T16:08:04.352 INFO:tasks.rados.rados.0.smithi033.stdout:3062: left oid 8 (ObjNum 931 snap 313 seq_num 931) 2021-07-26T16:08:04.359 INFO:tasks.rados.rados.0.smithi033.stdout:3061: expect (ObjNum 845 snap 281 seq_num 845) 2021-07-26T16:08:04.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:04 smithi033 bash[41341]: cluster 2021-07-26T16:08:03.161932+0000 mgr.y (mgr.34104) 423 : cluster [DBG] pgmap v817: 25 pgs: 25 active+clean; 637 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 796 KiB/s wr, 8 op/s 2021-07-26T16:08:04.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:04 smithi033 bash[41341]: cluster 2021-07-26T16:08:03.303978+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e664: 8 total, 8 up, 8 in 2021-07-26T16:08:04.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:04 smithi033 bash[42377]: cluster 2021-07-26T16:08:03.161932+0000 mgr.y (mgr.34104) 423 : cluster [DBG] pgmap v817: 25 pgs: 25 active+clean; 637 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 796 KiB/s wr, 8 op/s 2021-07-26T16:08:04.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:04 smithi033 bash[42377]: cluster 2021-07-26T16:08:03.303978+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e664: 8 total, 8 up, 8 in 2021-07-26T16:08:04.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:04 smithi096 bash[33981]: cluster 2021-07-26T16:08:03.161932+0000 mgr.y (mgr.34104) 423 : cluster [DBG] pgmap v817: 25 pgs: 25 active+clean; 637 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 767 B/s rd, 796 KiB/s wr, 8 op/s 2021-07-26T16:08:04.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:04 smithi096 bash[33981]: cluster 2021-07-26T16:08:03.303978+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e664: 8 total, 8 up, 8 in 2021-07-26T16:08:05.328 INFO:tasks.rados.rados.0.smithi033.stdout:3061: done (2 left) 2021-07-26T16:08:05.328 INFO:tasks.rados.rados.0.smithi033.stdout:3062: done (1 left) 2021-07-26T16:08:05.328 INFO:tasks.rados.rados.0.smithi033.stdout:3063: done (0 left) 2021-07-26T16:08:05.329 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 314 2021-07-26T16:08:05.329 INFO:tasks.rados.rados.0.smithi033.stdout:3064: seq_num 932 ranges {10371072=417792,10788864=663552,11452416=139264} 2021-07-26T16:08:05.389 INFO:tasks.rados.rados.0.smithi033.stdout:3064: writing smithi03339061-4 from 10371072 to 10788864 tid 1 2021-07-26T16:08:05.392 INFO:tasks.rados.rados.0.smithi033.stdout:3064: writing smithi03339061-4 from 10788864 to 11452416 tid 2 2021-07-26T16:08:05.393 INFO:tasks.rados.rados.0.smithi033.stdout:3064: writing smithi03339061-4 from 11452416 to 11591680 tid 3 2021-07-26T16:08:05.394 INFO:tasks.rados.rados.0.smithi033.stdout:3065: copy_from oid 41 from oid 13 current snap is 314 2021-07-26T16:08:05.394 INFO:tasks.rados.rados.0.smithi033.stdout:3066: setattr oid 47 current snap is 314 2021-07-26T16:08:05.395 INFO:tasks.rados.rados.0.smithi033.stdout:3067: delete oid 37 current snap is 314 2021-07-26T16:08:05.403 INFO:tasks.rados.rados.0.smithi033.stdout:3064: finishing write tid 1 to smithi03339061-4 2021-07-26T16:08:05.403 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1485 (ObjNum 850 snap 282 seq_num 850) dirty exists 2021-07-26T16:08:05.404 INFO:tasks.rados.rados.0.smithi033.stdout:3064: finishing write tid 2 to smithi03339061-4 2021-07-26T16:08:05.404 INFO:tasks.rados.rados.0.smithi033.stdout:3066: done (3 left) 2021-07-26T16:08:05.404 INFO:tasks.rados.rados.0.smithi033.stdout:3067: done (2 left) 2021-07-26T16:08:05.405 INFO:tasks.rados.rados.0.smithi033.stdout:3068: delete oid 2 current snap is 314 2021-07-26T16:08:05.405 INFO:tasks.rados.rados.0.smithi033.stdout:3064: finishing write tid 3 to smithi03339061-4 2021-07-26T16:08:05.405 INFO:tasks.rados.rados.0.smithi033.stdout:3064: finishing write tid 4 to smithi03339061-4 2021-07-26T16:08:05.406 INFO:tasks.rados.rados.0.smithi033.stdout:3068: done (2 left) 2021-07-26T16:08:05.406 INFO:tasks.rados.rados.0.smithi033.stdout:3069: snap_remove snap 308 2021-07-26T16:08:05.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:05 smithi033 bash[41341]: cluster 2021-07-26T16:08:04.307135+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e665: 8 total, 8 up, 8 in 2021-07-26T16:08:05.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:05 smithi033 bash[42377]: cluster 2021-07-26T16:08:04.307135+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e665: 8 total, 8 up, 8 in 2021-07-26T16:08:05.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:05 smithi096 bash[33981]: cluster 2021-07-26T16:08:04.307135+0000 mon.a (mon.0) 1035 : cluster [DBG] osdmap e665: 8 total, 8 up, 8 in 2021-07-26T16:08:06.209 INFO:tasks.rados.rados.0.smithi033.stdout:3064: finishing write tid 5 to smithi03339061-4 2021-07-26T16:08:06.209 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1398 (ObjNum 932 snap 314 seq_num 932) dirty exists 2021-07-26T16:08:06.209 INFO:tasks.rados.rados.0.smithi033.stdout:3064: left oid 4 (ObjNum 932 snap 314 seq_num 932) 2021-07-26T16:08:06.210 INFO:tasks.rados.rados.0.smithi033.stdout:3065: finishing copy_from to smithi03339061-41 2021-07-26T16:08:06.210 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1394 (ObjNum 930 snap 312 seq_num 930) dirty exists 2021-07-26T16:08:06.210 INFO:tasks.rados.rados.0.smithi033.stdout:3065: finishing copy_from racing read to smithi03339061-41 2021-07-26T16:08:06.210 INFO:tasks.rados.rados.0.smithi033.stdout:3064: done (2 left) 2021-07-26T16:08:06.211 INFO:tasks.rados.rados.0.smithi033.stdout:3065: done (1 left) 2021-07-26T16:08:06.211 INFO:tasks.rados.rados.0.smithi033.stdout:3069: done (0 left) 2021-07-26T16:08:06.211 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 314 2021-07-26T16:08:06.211 INFO:tasks.rados.rados.0.smithi033.stdout:3070: seq_num 935 ranges {18014208=466944,18481152=720896,19202048=81920} 2021-07-26T16:08:06.308 INFO:tasks.rados.rados.0.smithi033.stdout:3070: writing smithi03339061-41 from 18014208 to 18481152 tid 1 2021-07-26T16:08:06.312 INFO:tasks.rados.rados.0.smithi033.stdout:3070: writing smithi03339061-41 from 18481152 to 19202048 tid 2 2021-07-26T16:08:06.313 INFO:tasks.rados.rados.0.smithi033.stdout:3070: writing smithi03339061-41 from 19202048 to 19283968 tid 3 2021-07-26T16:08:06.313 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 27 current snap is 314 2021-07-26T16:08:06.313 INFO:tasks.rados.rados.0.smithi033.stdout:3071: seq_num 936 ranges {3850240=483328,4333568=655360,4988928=147456} 2021-07-26T16:08:06.338 INFO:tasks.rados.rados.0.smithi033.stdout:3071: writing smithi03339061-27 from 3850240 to 4333568 tid 1 2021-07-26T16:08:06.342 INFO:tasks.rados.rados.0.smithi033.stdout:3071: writing smithi03339061-27 from 4333568 to 4988928 tid 2 2021-07-26T16:08:06.344 INFO:tasks.rados.rados.0.smithi033.stdout:3071: writing smithi03339061-27 from 4988928 to 5136384 tid 3 2021-07-26T16:08:06.344 INFO:tasks.rados.rados.0.smithi033.stdout:3072: read oid 3 snap -1 2021-07-26T16:08:06.344 INFO:tasks.rados.rados.0.smithi033.stdout:3072: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:08:06.345 INFO:tasks.rados.rados.0.smithi033.stdout:3073: read oid 1 snap 287 2021-07-26T16:08:06.345 INFO:tasks.rados.rados.0.smithi033.stdout:3073: expect (ObjNum 754 snap 251 seq_num 754) 2021-07-26T16:08:06.345 INFO:tasks.rados.rados.0.smithi033.stdout:3074: read oid 38 snap -1 2021-07-26T16:08:06.345 INFO:tasks.rados.rados.0.smithi033.stdout:3074: expect (ObjNum 850 snap 282 seq_num 850) 2021-07-26T16:08:06.346 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 314 2021-07-26T16:08:06.346 INFO:tasks.rados.rados.0.smithi033.stdout:3070: finishing write tid 1 to smithi03339061-41 2021-07-26T16:08:06.346 INFO:tasks.rados.rados.0.smithi033.stdout:3075: seq_num 937 ranges {2179072=499712,2678784=532480,3211264=270336} 2021-07-26T16:08:06.358 INFO:tasks.rados.rados.0.smithi033.stdout:3075: writing smithi03339061-10 from 2179072 to 2678784 tid 1 2021-07-26T16:08:06.361 INFO:tasks.rados.rados.0.smithi033.stdout:3075: writing smithi03339061-10 from 2678784 to 3211264 tid 2 2021-07-26T16:08:06.364 INFO:tasks.rados.rados.0.smithi033.stdout:3075: writing smithi03339061-10 from 3211264 to 3481600 tid 3 2021-07-26T16:08:06.364 INFO:tasks.rados.rados.0.smithi033.stdout:3076: read oid 32 snap -1 2021-07-26T16:08:06.364 INFO:tasks.rados.rados.0.smithi033.stdout:3076: expect (ObjNum 825 snap 274 seq_num 825) 2021-07-26T16:08:06.365 INFO:tasks.rados.rados.0.smithi033.stdout:3077: rmattr oid 21 current snap is 314 2021-07-26T16:08:06.365 INFO:tasks.rados.rados.0.smithi033.stdout:3077: done (7 left) 2021-07-26T16:08:06.365 INFO:tasks.rados.rados.0.smithi033.stdout:3078: copy_from oid 35 from oid 39 current snap is 314 2021-07-26T16:08:06.365 INFO:tasks.rados.rados.0.smithi033.stdout:3070: finishing write tid 2 to smithi03339061-41 2021-07-26T16:08:06.366 INFO:tasks.rados.rados.0.smithi033.stdout:3070: finishing write tid 3 to smithi03339061-41 2021-07-26T16:08:06.366 INFO:tasks.rados.rados.0.smithi033.stdout:3070: finishing write tid 4 to smithi03339061-41 2021-07-26T16:08:06.366 INFO:tasks.rados.rados.0.smithi033.stdout:3070: finishing write tid 5 to smithi03339061-41 2021-07-26T16:08:06.366 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1398 (ObjNum 935 snap 314 seq_num 935) dirty exists 2021-07-26T16:08:06.366 INFO:tasks.rados.rados.0.smithi033.stdout:3070: left oid 41 (ObjNum 935 snap 314 seq_num 935) 2021-07-26T16:08:06.367 INFO:tasks.rados.rados.0.smithi033.stdout:3071: finishing write tid 1 to smithi03339061-27 2021-07-26T16:08:06.367 INFO:tasks.rados.rados.0.smithi033.stdout:3072: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:08:06.368 INFO:tasks.rados.rados.0.smithi033.stdout:3070: done (7 left) 2021-07-26T16:08:06.368 INFO:tasks.rados.rados.0.smithi033.stdout:3072: done (6 left) 2021-07-26T16:08:06.368 INFO:tasks.rados.rados.0.smithi033.stdout:3079: read oid 2 snap -1 2021-07-26T16:08:06.369 INFO:tasks.rados.rados.0.smithi033.stdout:3079: expect deleted 2021-07-26T16:08:06.369 INFO:tasks.rados.rados.0.smithi033.stdout:3080: snap_create 2021-07-26T16:08:06.369 INFO:tasks.rados.rados.0.smithi033.stdout:3071: finishing write tid 2 to smithi03339061-27 2021-07-26T16:08:06.369 INFO:tasks.rados.rados.0.smithi033.stdout:3071: finishing write tid 3 to smithi03339061-27 2021-07-26T16:08:06.369 INFO:tasks.rados.rados.0.smithi033.stdout:3073: expect (ObjNum 754 snap 251 seq_num 754) 2021-07-26T16:08:06.414 INFO:tasks.rados.rados.0.smithi033.stdout:3071: finishing write tid 4 to smithi03339061-27 2021-07-26T16:08:06.414 INFO:tasks.rados.rados.0.smithi033.stdout:3074: expect (ObjNum 850 snap 282 seq_num 850) 2021-07-26T16:08:06.474 INFO:tasks.rados.rados.0.smithi033.stdout:3071: finishing write tid 5 to smithi03339061-27 2021-07-26T16:08:06.475 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1459 (ObjNum 936 snap 314 seq_num 936) dirty exists 2021-07-26T16:08:06.475 INFO:tasks.rados.rados.0.smithi033.stdout:3071: left oid 27 (ObjNum 936 snap 314 seq_num 936) 2021-07-26T16:08:06.475 INFO:tasks.rados.rados.0.smithi033.stdout:3075: finishing write tid 1 to smithi03339061-10 2021-07-26T16:08:06.475 INFO:tasks.rados.rados.0.smithi033.stdout:3075: finishing write tid 2 to smithi03339061-10 2021-07-26T16:08:06.476 INFO:tasks.rados.rados.0.smithi033.stdout:3075: finishing write tid 3 to smithi03339061-10 2021-07-26T16:08:06.476 INFO:tasks.rados.rados.0.smithi033.stdout:3075: finishing write tid 4 to smithi03339061-10 2021-07-26T16:08:06.476 INFO:tasks.rados.rados.0.smithi033.stdout:3078: finishing copy_from to smithi03339061-35 2021-07-26T16:08:06.476 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1399 (ObjNum 833 snap 277 seq_num 833) dirty exists 2021-07-26T16:08:06.477 INFO:tasks.rados.rados.0.smithi033.stdout:3078: finishing copy_from racing read to smithi03339061-35 2021-07-26T16:08:06.477 INFO:tasks.rados.rados.0.smithi033.stdout:3076: expect (ObjNum 825 snap 274 seq_num 825) 2021-07-26T16:08:06.589 INFO:tasks.rados.rados.0.smithi033.stdout:3075: finishing write tid 5 to smithi03339061-10 2021-07-26T16:08:06.589 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1490 (ObjNum 937 snap 314 seq_num 937) dirty exists 2021-07-26T16:08:06.589 INFO:tasks.rados.rados.0.smithi033.stdout:3075: left oid 10 (ObjNum 937 snap 314 seq_num 937) 2021-07-26T16:08:06.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:06 smithi033 bash[41341]: cluster 2021-07-26T16:08:05.162635+0000 mgr.y (mgr.34104) 424 : cluster [DBG] pgmap v820: 25 pgs: 25 active+clean; 651 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 556 KiB/s wr, 3 op/s 2021-07-26T16:08:06.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:06 smithi033 bash[41341]: cluster 2021-07-26T16:08:05.325647+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e666: 8 total, 8 up, 8 in 2021-07-26T16:08:06.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:06 smithi033 bash[41341]: cluster 2021-07-26T16:08:06.199116+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e667: 8 total, 8 up, 8 in 2021-07-26T16:08:06.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:06 smithi033 bash[42377]: cluster 2021-07-26T16:08:05.162635+0000 mgr.y (mgr.34104) 424 : cluster [DBG] pgmap v820: 25 pgs: 25 active+clean; 651 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 556 KiB/s wr, 3 op/s 2021-07-26T16:08:06.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:06 smithi033 bash[42377]: cluster 2021-07-26T16:08:05.325647+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e666: 8 total, 8 up, 8 in 2021-07-26T16:08:06.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:06 smithi033 bash[42377]: cluster 2021-07-26T16:08:06.199116+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e667: 8 total, 8 up, 8 in 2021-07-26T16:08:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:06 smithi096 bash[33981]: cluster 2021-07-26T16:08:05.162635+0000 mgr.y (mgr.34104) 424 : cluster [DBG] pgmap v820: 25 pgs: 25 active+clean; 651 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 511 B/s rd, 556 KiB/s wr, 3 op/s 2021-07-26T16:08:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:06 smithi096 bash[33981]: cluster 2021-07-26T16:08:05.325647+0000 mon.a (mon.0) 1036 : cluster [DBG] osdmap e666: 8 total, 8 up, 8 in 2021-07-26T16:08:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:06 smithi096 bash[33981]: cluster 2021-07-26T16:08:06.199116+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e667: 8 total, 8 up, 8 in 2021-07-26T16:08:07.340 INFO:tasks.rados.rados.0.smithi033.stdout:3071: done (7 left) 2021-07-26T16:08:07.340 INFO:tasks.rados.rados.0.smithi033.stdout:3073: done (6 left) 2021-07-26T16:08:07.340 INFO:tasks.rados.rados.0.smithi033.stdout:3074: done (5 left) 2021-07-26T16:08:07.340 INFO:tasks.rados.rados.0.smithi033.stdout:3075: done (4 left) 2021-07-26T16:08:07.341 INFO:tasks.rados.rados.0.smithi033.stdout:3076: done (3 left) 2021-07-26T16:08:07.341 INFO:tasks.rados.rados.0.smithi033.stdout:3078: done (2 left) 2021-07-26T16:08:07.341 INFO:tasks.rados.rados.0.smithi033.stdout:3079: done (1 left) 2021-07-26T16:08:07.341 INFO:tasks.rados.rados.0.smithi033.stdout:3080: done (0 left) 2021-07-26T16:08:07.342 INFO:tasks.rados.rados.0.smithi033.stdout:3081: rollback oid 45 current snap is 315 2021-07-26T16:08:07.342 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 45 to 286 2021-07-26T16:08:07.342 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 315 2021-07-26T16:08:07.342 INFO:tasks.rados.rados.0.smithi033.stdout:3082: seq_num 938 ranges {3661824=516096,4177920=417792,4595712=385024} 2021-07-26T16:08:07.364 INFO:tasks.rados.rados.0.smithi033.stdout:3082: writing smithi03339061-46 from 3661824 to 4177920 tid 1 2021-07-26T16:08:07.366 INFO:tasks.rados.rados.0.smithi033.stdout:3082: writing smithi03339061-46 from 4177920 to 4595712 tid 2 2021-07-26T16:08:07.369 INFO:tasks.rados.rados.0.smithi033.stdout:3082: writing smithi03339061-46 from 4595712 to 4980736 tid 3 2021-07-26T16:08:07.369 INFO:tasks.rados.rados.0.smithi033.stdout:3083: rollback oid 12 current snap is 315 2021-07-26T16:08:07.369 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 12 to 304 2021-07-26T16:08:07.369 INFO:tasks.rados.rados.0.smithi033.stdout:3081: finishing rollback tid 0 to smithi03339061-45 2021-07-26T16:08:07.370 INFO:tasks.rados.rados.0.smithi033.stdout:3081: finishing rollback tid 1 to smithi03339061-45 2021-07-26T16:08:07.370 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 315 2021-07-26T16:08:07.370 INFO:tasks.rados.rados.0.smithi033.stdout:3081: finishing rollback tid 2 to smithi03339061-45 2021-07-26T16:08:07.370 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1798 (ObjNum 866 snap 284 seq_num 866) dirty exists 2021-07-26T16:08:07.371 INFO:tasks.rados.rados.0.smithi033.stdout:3084: seq_num 939 ranges {811008=532480,1343488=704512,2048000=98304} 2021-07-26T16:08:07.377 INFO:tasks.rados.rados.0.smithi033.stdout:3084: writing smithi03339061-22 from 811008 to 1343488 tid 1 2021-07-26T16:08:07.381 INFO:tasks.rados.rados.0.smithi033.stdout:3084: writing smithi03339061-22 from 1343488 to 2048000 tid 2 2021-07-26T16:08:07.382 INFO:tasks.rados.rados.0.smithi033.stdout:3084: writing smithi03339061-22 from 2048000 to 2146304 tid 3 2021-07-26T16:08:07.383 INFO:tasks.rados.rados.0.smithi033.stdout:3081: done (3 left) 2021-07-26T16:08:07.383 INFO:tasks.rados.rados.0.smithi033.stdout:3085: snap_create 2021-07-26T16:08:07.383 INFO:tasks.rados.rados.0.smithi033.stdout:3082: finishing write tid 1 to smithi03339061-46 2021-07-26T16:08:07.383 INFO:tasks.rados.rados.0.smithi033.stdout:3082: finishing write tid 2 to smithi03339061-46 2021-07-26T16:08:07.384 INFO:tasks.rados.rados.0.smithi033.stdout:3083: finishing rollback tid 0 to smithi03339061-12 2021-07-26T16:08:07.384 INFO:tasks.rados.rados.0.smithi033.stdout:3083: finishing rollback tid 1 to smithi03339061-12 2021-07-26T16:08:07.384 INFO:tasks.rados.rados.0.smithi033.stdout:3083: finishing rollback tid 2 to smithi03339061-12 2021-07-26T16:08:07.384 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1413 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:08:07.384 INFO:tasks.rados.rados.0.smithi033.stdout:3082: finishing write tid 3 to smithi03339061-46 2021-07-26T16:08:07.385 INFO:tasks.rados.rados.0.smithi033.stdout:3082: finishing write tid 4 to smithi03339061-46 2021-07-26T16:08:07.385 INFO:tasks.rados.rados.0.smithi033.stdout:3084: finishing write tid 1 to smithi03339061-22 2021-07-26T16:08:07.386 INFO:tasks.rados.rados.0.smithi033.stdout:3082: finishing write tid 5 to smithi03339061-46 2021-07-26T16:08:07.386 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1285 (ObjNum 938 snap 315 seq_num 938) dirty exists 2021-07-26T16:08:07.386 INFO:tasks.rados.rados.0.smithi033.stdout:3082: left oid 46 (ObjNum 938 snap 315 seq_num 938) 2021-07-26T16:08:07.388 INFO:tasks.rados.rados.0.smithi033.stdout:3084: finishing write tid 2 to smithi03339061-22 2021-07-26T16:08:07.389 INFO:tasks.rados.rados.0.smithi033.stdout:3084: finishing write tid 3 to smithi03339061-22 2021-07-26T16:08:07.389 INFO:tasks.rados.rados.0.smithi033.stdout:3084: finishing write tid 4 to smithi03339061-22 2021-07-26T16:08:07.391 INFO:tasks.rados.rados.0.smithi033.stdout:3084: finishing write tid 5 to smithi03339061-22 2021-07-26T16:08:07.392 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1803 (ObjNum 939 snap 315 seq_num 939) dirty exists 2021-07-26T16:08:07.392 INFO:tasks.rados.rados.0.smithi033.stdout:3084: left oid 22 (ObjNum 939 snap 315 seq_num 939) 2021-07-26T16:08:08.353 INFO:tasks.rados.rados.0.smithi033.stdout:3082: done (3 left) 2021-07-26T16:08:08.353 INFO:tasks.rados.rados.0.smithi033.stdout:3083: done (2 left) 2021-07-26T16:08:08.354 INFO:tasks.rados.rados.0.smithi033.stdout:3084: done (1 left) 2021-07-26T16:08:08.354 INFO:tasks.rados.rados.0.smithi033.stdout:3085: done (0 left) 2021-07-26T16:08:08.354 INFO:tasks.rados.rados.0.smithi033.stdout:3086: delete oid 49 current snap is 316 2021-07-26T16:08:08.361 INFO:tasks.rados.rados.0.smithi033.stdout:3086: done (0 left) 2021-07-26T16:08:08.362 INFO:tasks.rados.rados.0.smithi033.stdout:3087: snap_remove snap 303 2021-07-26T16:08:08.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:08 smithi033 bash[41341]: cluster 2021-07-26T16:08:07.163315+0000 mgr.y (mgr.34104) 425 : cluster [DBG] pgmap v823: 25 pgs: 25 active+clean; 655 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 868 KiB/s wr, 7 op/s 2021-07-26T16:08:08.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:08 smithi033 bash[41341]: cluster 2021-07-26T16:08:07.336642+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e668: 8 total, 8 up, 8 in 2021-07-26T16:08:08.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:08 smithi033 bash[42377]: cluster 2021-07-26T16:08:07.163315+0000 mgr.y (mgr.34104) 425 : cluster [DBG] pgmap v823: 25 pgs: 25 active+clean; 655 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 868 KiB/s wr, 7 op/s 2021-07-26T16:08:08.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:08 smithi033 bash[42377]: cluster 2021-07-26T16:08:07.336642+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e668: 8 total, 8 up, 8 in 2021-07-26T16:08:08.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:08 smithi096 bash[33981]: cluster 2021-07-26T16:08:07.163315+0000 mgr.y (mgr.34104) 425 : cluster [DBG] pgmap v823: 25 pgs: 25 active+clean; 655 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 868 KiB/s wr, 7 op/s 2021-07-26T16:08:08.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:08 smithi096 bash[33981]: cluster 2021-07-26T16:08:07.336642+0000 mon.a (mon.0) 1038 : cluster [DBG] osdmap e668: 8 total, 8 up, 8 in 2021-07-26T16:08:09.363 INFO:tasks.rados.rados.0.smithi033.stdout:3087: done (0 left) 2021-07-26T16:08:09.363 INFO:tasks.rados.rados.0.smithi033.stdout:3088: rollback oid 20 current snap is 316 2021-07-26T16:08:09.363 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 20 to 278 2021-07-26T16:08:09.364 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 316 2021-07-26T16:08:09.364 INFO:tasks.rados.rados.0.smithi033.stdout:3089: seq_num 941 ranges {3481600=565248,4046848=475136,4521984=327680} 2021-07-26T16:08:09.389 INFO:tasks.rados.rados.0.smithi033.stdout:3089: writing smithi03339061-10 from 3481600 to 4046848 tid 1 2021-07-26T16:08:09.391 INFO:tasks.rados.rados.0.smithi033.stdout:3089: writing smithi03339061-10 from 4046848 to 4521984 tid 2 2021-07-26T16:08:09.395 INFO:tasks.rados.rados.0.smithi033.stdout:3089: writing smithi03339061-10 from 4521984 to 4849664 tid 3 2021-07-26T16:08:09.395 INFO:tasks.rados.rados.0.smithi033.stdout:3090: copy_from oid 24 from oid 49 current snap is 316 2021-07-26T16:08:09.396 INFO:tasks.rados.rados.0.smithi033.stdout:3088: finishing rollback tid 0 to smithi03339061-20 2021-07-26T16:08:09.396 INFO:tasks.rados.rados.0.smithi033.stdout:3088: finishing rollback tid 1 to smithi03339061-20 2021-07-26T16:08:09.397 INFO:tasks.rados.rados.0.smithi033.stdout:3088: finishing rollback tid 2 to smithi03339061-20 2021-07-26T16:08:09.397 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1401 (ObjNum 835 snap 277 seq_num 835) dirty exists 2021-07-26T16:08:09.398 INFO:tasks.rados.rados.0.smithi033.stdout:3088: done (2 left) 2021-07-26T16:08:09.398 INFO:tasks.rados.rados.0.smithi033.stdout:3091: rollback oid 22 current snap is 316 2021-07-26T16:08:09.399 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 22 to 306 2021-07-26T16:08:09.399 INFO:tasks.rados.rados.0.smithi033.stdout:3092: snap_remove snap 304 2021-07-26T16:08:09.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:09 smithi033 bash[41341]: cluster 2021-07-26T16:08:08.350889+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e669: 8 total, 8 up, 8 in 2021-07-26T16:08:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:09 smithi033 bash[41341]: audit 2021-07-26T16:08:09.247422+0000 mon.c (mon.1) 261 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:08:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:09 smithi033 bash[41341]: audit 2021-07-26T16:08:09.248217+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:08:09.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:09 smithi033 bash[41341]: audit 2021-07-26T16:08:09.263099+0000 mon.c (mon.1) 262 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:08:09.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:09 smithi033 bash[41341]: audit 2021-07-26T16:08:09.263852+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:08:09.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:09 smithi033 bash[42377]: cluster 2021-07-26T16:08:08.350889+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e669: 8 total, 8 up, 8 in 2021-07-26T16:08:09.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:09 smithi033 bash[42377]: audit 2021-07-26T16:08:09.247422+0000 mon.c (mon.1) 261 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:08:09.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:09 smithi033 bash[42377]: audit 2021-07-26T16:08:09.248217+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:08:09.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:09 smithi033 bash[42377]: audit 2021-07-26T16:08:09.263099+0000 mon.c (mon.1) 262 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:08:09.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:09 smithi033 bash[42377]: audit 2021-07-26T16:08:09.263852+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:08:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:09 smithi096 bash[33981]: cluster 2021-07-26T16:08:08.350889+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e669: 8 total, 8 up, 8 in 2021-07-26T16:08:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:09 smithi096 bash[33981]: audit 2021-07-26T16:08:09.247422+0000 mon.c (mon.1) 261 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:08:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:09 smithi096 bash[33981]: audit 2021-07-26T16:08:09.248217+0000 mon.a (mon.0) 1040 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:08:09.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:09 smithi096 bash[33981]: audit 2021-07-26T16:08:09.263099+0000 mon.c (mon.1) 262 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:08:09.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:09 smithi096 bash[33981]: audit 2021-07-26T16:08:09.263852+0000 mon.a (mon.0) 1041 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:08:10.372 INFO:tasks.rados.rados.0.smithi033.stdout:3089: finishing write tid 1 to smithi03339061-10 2021-07-26T16:08:10.373 INFO:tasks.rados.rados.0.smithi033.stdout:3089: finishing write tid 2 to smithi03339061-10 2021-07-26T16:08:10.373 INFO:tasks.rados.rados.0.smithi033.stdout:3091: finishing rollback tid 0 to smithi03339061-22 2021-07-26T16:08:10.373 INFO:tasks.rados.rados.0.smithi033.stdout:3091: finishing rollback tid 1 to smithi03339061-22 2021-07-26T16:08:10.373 INFO:tasks.rados.rados.0.smithi033.stdout:3091: finishing rollback tid 2 to smithi03339061-22 2021-07-26T16:08:10.374 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1809 (ObjNum 908 snap 304 seq_num 908) dirty exists 2021-07-26T16:08:10.374 INFO:tasks.rados.rados.0.smithi033.stdout:3089: finishing write tid 3 to smithi03339061-10 2021-07-26T16:08:10.374 INFO:tasks.rados.rados.0.smithi033.stdout:3089: finishing write tid 4 to smithi03339061-10 2021-07-26T16:08:10.374 INFO:tasks.rados.rados.0.smithi033.stdout:3090: finishing copy_from to smithi03339061-24 2021-07-26T16:08:10.375 INFO:tasks.rados.rados.0.smithi033.stdout:3090: got expected ENOENT (src dne) 2021-07-26T16:08:10.375 INFO:tasks.rados.rados.0.smithi033.stdout:3090: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:08:10.375 INFO:tasks.rados.rados.0.smithi033.stdout:3089: finishing write tid 5 to smithi03339061-10 2021-07-26T16:08:10.375 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1494 (ObjNum 941 snap 316 seq_num 941) dirty exists 2021-07-26T16:08:10.376 INFO:tasks.rados.rados.0.smithi033.stdout:3089: left oid 10 (ObjNum 941 snap 316 seq_num 941) 2021-07-26T16:08:10.376 INFO:tasks.rados.rados.0.smithi033.stdout:3089: done (3 left) 2021-07-26T16:08:10.376 INFO:tasks.rados.rados.0.smithi033.stdout:3090: done (2 left) 2021-07-26T16:08:10.376 INFO:tasks.rados.rados.0.smithi033.stdout:3091: done (1 left) 2021-07-26T16:08:10.376 INFO:tasks.rados.rados.0.smithi033.stdout:3092: done (0 left) 2021-07-26T16:08:10.377 INFO:tasks.rados.rados.0.smithi033.stdout:3093: delete oid 8 current snap is 316 2021-07-26T16:08:10.383 INFO:tasks.rados.rados.0.smithi033.stdout:3093: done (0 left) 2021-07-26T16:08:10.384 INFO:tasks.rados.rados.0.smithi033.stdout:3094: read oid 27 snap -1 2021-07-26T16:08:10.384 INFO:tasks.rados.rados.0.smithi033.stdout:3094: expect (ObjNum 936 snap 314 seq_num 936) 2021-07-26T16:08:10.384 INFO:tasks.rados.rados.0.smithi033.stdout:3095: read oid 38 snap -1 2021-07-26T16:08:10.385 INFO:tasks.rados.rados.0.smithi033.stdout:3095: expect (ObjNum 850 snap 282 seq_num 850) 2021-07-26T16:08:10.385 INFO:tasks.rados.rados.0.smithi033.stdout:3096: snap_create 2021-07-26T16:08:10.397 INFO:tasks.rados.rados.0.smithi033.stdout:3095: expect (ObjNum 850 snap 282 seq_num 850) 2021-07-26T16:08:10.461 INFO:tasks.rados.rados.0.smithi033.stdout:3094: expect (ObjNum 936 snap 314 seq_num 936) 2021-07-26T16:08:10.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:10 smithi033 bash[41341]: cluster 2021-07-26T16:08:09.163966+0000 mgr.y (mgr.34104) 426 : cluster [DBG] pgmap v826: 25 pgs: 25 active+clean; 660 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.9 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2021-07-26T16:08:10.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:10 smithi033 bash[41341]: cluster 2021-07-26T16:08:09.359186+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e670: 8 total, 8 up, 8 in 2021-07-26T16:08:10.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:10 smithi033 bash[42377]: cluster 2021-07-26T16:08:09.163966+0000 mgr.y (mgr.34104) 426 : cluster [DBG] pgmap v826: 25 pgs: 25 active+clean; 660 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.9 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2021-07-26T16:08:10.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:10 smithi033 bash[42377]: cluster 2021-07-26T16:08:09.359186+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e670: 8 total, 8 up, 8 in 2021-07-26T16:08:10.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:10 smithi096 bash[33981]: cluster 2021-07-26T16:08:09.163966+0000 mgr.y (mgr.34104) 426 : cluster [DBG] pgmap v826: 25 pgs: 25 active+clean; 660 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.9 MiB/s rd, 1.5 MiB/s wr, 16 op/s 2021-07-26T16:08:10.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:10 smithi096 bash[33981]: cluster 2021-07-26T16:08:09.359186+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e670: 8 total, 8 up, 8 in 2021-07-26T16:08:11.380 INFO:tasks.rados.rados.0.smithi033.stdout:3094: done (2 left) 2021-07-26T16:08:11.381 INFO:tasks.rados.rados.0.smithi033.stdout:3095: done (1 left) 2021-07-26T16:08:11.381 INFO:tasks.rados.rados.0.smithi033.stdout:3096: done (0 left) 2021-07-26T16:08:11.381 INFO:tasks.rados.rados.0.smithi033.stdout:3097: read oid 26 snap -1 2021-07-26T16:08:11.382 INFO:tasks.rados.rados.0.smithi033.stdout:3097: expect deleted 2021-07-26T16:08:11.382 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 317 2021-07-26T16:08:11.382 INFO:tasks.rados.rados.0.smithi033.stdout:3098: seq_num 943 ranges {2342912=598016,2940928=688128,3629056=114688} 2021-07-26T16:08:11.401 INFO:tasks.rados.rados.0.smithi033.stdout:3098: writing smithi03339061-28 from 2342912 to 2940928 tid 1 2021-07-26T16:08:11.405 INFO:tasks.rados.rados.0.smithi033.stdout:3098: writing smithi03339061-28 from 2940928 to 3629056 tid 2 2021-07-26T16:08:11.406 INFO:tasks.rados.rados.0.smithi033.stdout:3098: writing smithi03339061-28 from 3629056 to 3743744 tid 3 2021-07-26T16:08:11.406 INFO:tasks.rados.rados.0.smithi033.stdout:3099: rmattr oid 25 current snap is 317 2021-07-26T16:08:11.406 INFO:tasks.rados.rados.0.smithi033.stdout:3099: done (2 left) 2021-07-26T16:08:11.406 INFO:tasks.rados.rados.0.smithi033.stdout:3100: delete oid 47 current snap is 317 2021-07-26T16:08:11.412 INFO:tasks.rados.rados.0.smithi033.stdout:3097: done (2 left) 2021-07-26T16:08:11.412 INFO:tasks.rados.rados.0.smithi033.stdout:3100: done (1 left) 2021-07-26T16:08:11.412 INFO:tasks.rados.rados.0.smithi033.stdout:3101: rmattr oid 3 current snap is 317 2021-07-26T16:08:11.413 INFO:tasks.rados.rados.0.smithi033.stdout:3102: copy_from oid 11 from oid 12 current snap is 317 2021-07-26T16:08:11.413 INFO:tasks.rados.rados.0.smithi033.stdout:3103: rollback oid 16 current snap is 317 2021-07-26T16:08:11.413 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 16 to 306 2021-07-26T16:08:11.414 INFO:tasks.rados.rados.0.smithi033.stdout:3104: delete oid 22 current snap is 317 2021-07-26T16:08:11.417 INFO:tasks.rados.rados.0.smithi033.stdout:3098: finishing write tid 1 to smithi03339061-28 2021-07-26T16:08:11.418 INFO:tasks.rados.rados.0.smithi033.stdout:3104: done (4 left) 2021-07-26T16:08:11.418 INFO:tasks.rados.rados.0.smithi033.stdout:3105: read oid 5 snap 312 2021-07-26T16:08:11.418 INFO:tasks.rados.rados.0.smithi033.stdout:3105: expect (ObjNum 909 snap 305 seq_num 909) 2021-07-26T16:08:11.418 INFO:tasks.rados.rados.0.smithi033.stdout:3106: setattr oid 29 current snap is 317 2021-07-26T16:08:11.419 INFO:tasks.rados.rados.0.smithi033.stdout:3107: snap_create 2021-07-26T16:08:11.419 INFO:tasks.rados.rados.0.smithi033.stdout:3098: finishing write tid 2 to smithi03339061-28 2021-07-26T16:08:11.423 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1727 (ObjNum 1802200682 snap 1600214886 seq_num 1432968303) dirty exists 2021-07-26T16:08:11.424 INFO:tasks.rados.rados.0.smithi033.stdout:3103: finishing rollback tid 0 to smithi03339061-16 2021-07-26T16:08:11.425 INFO:tasks.rados.rados.0.smithi033.stdout:3103: finishing rollback tid 1 to smithi03339061-16 2021-07-26T16:08:11.427 INFO:tasks.rados.rados.0.smithi033.stdout:3103: finishing rollback tid 2 to smithi03339061-16 2021-07-26T16:08:11.427 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1343 (ObjNum 877 snap 288 seq_num 877) dirty exists 2021-07-26T16:08:11.428 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1286 (ObjNum 890 snap 292 seq_num 890) dirty exists 2021-07-26T16:08:11.429 INFO:tasks.rados.rados.0.smithi033.stdout:3098: finishing write tid 3 to smithi03339061-28 2021-07-26T16:08:11.430 INFO:tasks.rados.rados.0.smithi033.stdout:3098: finishing write tid 4 to smithi03339061-28 2021-07-26T16:08:11.432 INFO:tasks.rados.rados.0.smithi033.stdout:3105: expect (ObjNum 909 snap 305 seq_num 909) 2021-07-26T16:08:11.484 INFO:tasks.rados.rados.0.smithi033.stdout:3098: finishing write tid 5 to smithi03339061-28 2021-07-26T16:08:11.484 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1417 (ObjNum 943 snap 317 seq_num 943) dirty exists 2021-07-26T16:08:11.484 INFO:tasks.rados.rados.0.smithi033.stdout:3098: left oid 28 (ObjNum 943 snap 317 seq_num 943) 2021-07-26T16:08:11.485 INFO:tasks.rados.rados.0.smithi033.stdout:3102: finishing copy_from to smithi03339061-11 2021-07-26T16:08:11.485 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1413 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:08:11.485 INFO:tasks.rados.rados.0.smithi033.stdout:3102: finishing copy_from racing read to smithi03339061-11 2021-07-26T16:08:11.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:11 smithi033 bash[41341]: cluster 2021-07-26T16:08:10.369296+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e671: 8 total, 8 up, 8 in 2021-07-26T16:08:11.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:11 smithi033 bash[42377]: cluster 2021-07-26T16:08:10.369296+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e671: 8 total, 8 up, 8 in 2021-07-26T16:08:11.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:11 smithi096 bash[33981]: cluster 2021-07-26T16:08:10.369296+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e671: 8 total, 8 up, 8 in 2021-07-26T16:08:12.384 INFO:tasks.rados.rados.0.smithi033.stdout:3098: done (6 left) 2021-07-26T16:08:12.384 INFO:tasks.rados.rados.0.smithi033.stdout:3101: done (5 left) 2021-07-26T16:08:12.385 INFO:tasks.rados.rados.0.smithi033.stdout:3102: done (4 left) 2021-07-26T16:08:12.385 INFO:tasks.rados.rados.0.smithi033.stdout:3103: done (3 left) 2021-07-26T16:08:12.385 INFO:tasks.rados.rados.0.smithi033.stdout:3105: done (2 left) 2021-07-26T16:08:12.385 INFO:tasks.rados.rados.0.smithi033.stdout:3106: done (1 left) 2021-07-26T16:08:12.385 INFO:tasks.rados.rados.0.smithi033.stdout:3107: done (0 left) 2021-07-26T16:08:12.386 INFO:tasks.rados.rados.0.smithi033.stdout:3108: rmattr oid 41 current snap is 318 2021-07-26T16:08:12.386 INFO:tasks.rados.rados.0.smithi033.stdout:3109: read oid 24 snap -1 2021-07-26T16:08:12.386 INFO:tasks.rados.rados.0.smithi033.stdout:3109: expect (ObjNum 911 snap 305 seq_num 911) 2021-07-26T16:08:12.386 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 318 2021-07-26T16:08:12.387 INFO:tasks.rados.rados.0.smithi033.stdout:3110: seq_num 946 ranges {2981888=647168,3629056=745472,4374528=57344} 2021-07-26T16:08:12.406 INFO:tasks.rados.rados.0.smithi033.stdout:3110: writing smithi03339061-29 from 2981888 to 3629056 tid 1 2021-07-26T16:08:12.410 INFO:tasks.rados.rados.0.smithi033.stdout:3110: writing smithi03339061-29 from 3629056 to 4374528 tid 2 2021-07-26T16:08:12.411 INFO:tasks.rados.rados.0.smithi033.stdout:3110: writing smithi03339061-29 from 4374528 to 4431872 tid 3 2021-07-26T16:08:12.411 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 318 2021-07-26T16:08:12.412 INFO:tasks.rados.rados.0.smithi033.stdout:3111: seq_num 947 ranges {1490944=663552,2154496=630784,2785280=172032} 2021-07-26T16:08:12.423 INFO:tasks.rados.rados.0.smithi033.stdout:3111: writing smithi03339061-5 from 1490944 to 2154496 tid 1 2021-07-26T16:08:12.427 INFO:tasks.rados.rados.0.smithi033.stdout:3111: writing smithi03339061-5 from 2154496 to 2785280 tid 2 2021-07-26T16:08:12.428 INFO:tasks.rados.rados.0.smithi033.stdout:3111: writing smithi03339061-5 from 2785280 to 2957312 tid 3 2021-07-26T16:08:12.428 INFO:tasks.rados.rados.0.smithi033.stdout:3112: rollback oid 22 current snap is 318 2021-07-26T16:08:12.429 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 22 to 287 2021-07-26T16:08:12.429 INFO:tasks.rados.rados.0.smithi033.stdout:3109: expect (ObjNum 911 snap 305 seq_num 911) 2021-07-26T16:08:12.558 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1399 (ObjNum 935 snap 314 seq_num 935) dirty exists 2021-07-26T16:08:12.559 INFO:tasks.rados.rados.0.smithi033.stdout:3110: finishing write tid 1 to smithi03339061-29 2021-07-26T16:08:12.559 INFO:tasks.rados.rados.0.smithi033.stdout:3110: finishing write tid 2 to smithi03339061-29 2021-07-26T16:08:12.559 INFO:tasks.rados.rados.0.smithi033.stdout:3110: finishing write tid 3 to smithi03339061-29 2021-07-26T16:08:12.559 INFO:tasks.rados.rados.0.smithi033.stdout:3110: finishing write tid 4 to smithi03339061-29 2021-07-26T16:08:12.560 INFO:tasks.rados.rados.0.smithi033.stdout:3110: finishing write tid 5 to smithi03339061-29 2021-07-26T16:08:12.560 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1290 (ObjNum 946 snap 318 seq_num 946) dirty exists 2021-07-26T16:08:12.560 INFO:tasks.rados.rados.0.smithi033.stdout:3110: left oid 29 (ObjNum 946 snap 318 seq_num 946) 2021-07-26T16:08:12.560 INFO:tasks.rados.rados.0.smithi033.stdout:3111: finishing write tid 1 to smithi03339061-5 2021-07-26T16:08:12.561 INFO:tasks.rados.rados.0.smithi033.stdout:3111: finishing write tid 2 to smithi03339061-5 2021-07-26T16:08:12.561 INFO:tasks.rados.rados.0.smithi033.stdout:3108: done (4 left) 2021-07-26T16:08:12.561 INFO:tasks.rados.rados.0.smithi033.stdout:3109: done (3 left) 2021-07-26T16:08:12.561 INFO:tasks.rados.rados.0.smithi033.stdout:3110: done (2 left) 2021-07-26T16:08:12.561 INFO:tasks.rados.rados.0.smithi033.stdout:3113: snap_create 2021-07-26T16:08:12.562 INFO:tasks.rados.rados.0.smithi033.stdout:3112: finishing rollback tid 1 to smithi03339061-22 2021-07-26T16:08:12.562 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1815 (ObjNum 2008335936 snap 22002 seq_num 2006022224) dirty dne 2021-07-26T16:08:12.562 INFO:tasks.rados.rados.0.smithi033.stdout:3111: finishing write tid 3 to smithi03339061-5 2021-07-26T16:08:12.562 INFO:tasks.rados.rados.0.smithi033.stdout:3111: finishing write tid 4 to smithi03339061-5 2021-07-26T16:08:12.563 INFO:tasks.rados.rados.0.smithi033.stdout:3111: finishing write tid 5 to smithi03339061-5 2021-07-26T16:08:12.563 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 1403 (ObjNum 947 snap 318 seq_num 947) dirty exists 2021-07-26T16:08:12.563 INFO:tasks.rados.rados.0.smithi033.stdout:3111: left oid 5 (ObjNum 947 snap 318 seq_num 947) 2021-07-26T16:08:12.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:12 smithi033 bash[41341]: cluster 2021-07-26T16:08:11.164620+0000 mgr.y (mgr.34104) 427 : cluster [DBG] pgmap v829: 25 pgs: 25 active+clean; 686 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.6 MiB/s wr, 18 op/s 2021-07-26T16:08:12.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:12 smithi033 bash[41341]: cluster 2021-07-26T16:08:11.378151+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e672: 8 total, 8 up, 8 in 2021-07-26T16:08:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:12 smithi033 bash[42377]: cluster 2021-07-26T16:08:11.164620+0000 mgr.y (mgr.34104) 427 : cluster [DBG] pgmap v829: 25 pgs: 25 active+clean; 686 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.6 MiB/s wr, 18 op/s 2021-07-26T16:08:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:12 smithi033 bash[42377]: cluster 2021-07-26T16:08:11.378151+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e672: 8 total, 8 up, 8 in 2021-07-26T16:08:12.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:12 smithi096 bash[33981]: cluster 2021-07-26T16:08:11.164620+0000 mgr.y (mgr.34104) 427 : cluster [DBG] pgmap v829: 25 pgs: 25 active+clean; 686 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 6.6 MiB/s rd, 6.6 MiB/s wr, 18 op/s 2021-07-26T16:08:12.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:12 smithi096 bash[33981]: cluster 2021-07-26T16:08:11.378151+0000 mon.a (mon.0) 1044 : cluster [DBG] osdmap e672: 8 total, 8 up, 8 in 2021-07-26T16:08:13.402 INFO:tasks.rados.rados.0.smithi033.stdout:3111: done (2 left) 2021-07-26T16:08:13.403 INFO:tasks.rados.rados.0.smithi033.stdout:3112: done (1 left) 2021-07-26T16:08:13.403 INFO:tasks.rados.rados.0.smithi033.stdout:3113: done (0 left) 2021-07-26T16:08:13.403 INFO:tasks.rados.rados.0.smithi033.stdout:3114: rollback oid 6 current snap is 319 2021-07-26T16:08:13.403 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 293 2021-07-26T16:08:13.404 INFO:tasks.rados.rados.0.smithi033.stdout:3115: read oid 16 snap -1 2021-07-26T16:08:13.404 INFO:tasks.rados.rados.0.smithi033.stdout:3115: expect (ObjNum 877 snap 288 seq_num 877) 2021-07-26T16:08:13.404 INFO:tasks.rados.rados.0.smithi033.stdout:3116: read oid 28 snap -1 2021-07-26T16:08:13.404 INFO:tasks.rados.rados.0.smithi033.stdout:3116: expect (ObjNum 943 snap 317 seq_num 943) 2021-07-26T16:08:13.404 INFO:tasks.rados.rados.0.smithi033.stdout:3117: read oid 1 snap -1 2021-07-26T16:08:13.405 INFO:tasks.rados.rados.0.smithi033.stdout:3117: expect deleted 2021-07-26T16:08:13.405 INFO:tasks.rados.rados.0.smithi033.stdout:3118: snap_create 2021-07-26T16:08:13.411 INFO:tasks.rados.rados.0.smithi033.stdout:3114: finishing rollback tid 0 to smithi03339061-6 2021-07-26T16:08:13.413 INFO:tasks.rados.rados.0.smithi033.stdout:3114: finishing rollback tid 1 to smithi03339061-6 2021-07-26T16:08:13.413 INFO:tasks.rados.rados.0.smithi033.stdout:3114: finishing rollback tid 2 to smithi03339061-6 2021-07-26T16:08:13.413 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1820 (ObjNum 891 snap 292 seq_num 891) dirty exists 2021-07-26T16:08:13.435 INFO:tasks.rados.rados.0.smithi033.stdout:3116: expect (ObjNum 943 snap 317 seq_num 943) 2021-07-26T16:08:13.582 INFO:tasks.rados.rados.0.smithi033.stdout:3115: expect (ObjNum 877 snap 288 seq_num 877) 2021-07-26T16:08:13.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:13 smithi033 bash[42377]: cluster 2021-07-26T16:08:12.380043+0000 mon.a (mon.0) 1045 : cluster [DBG] osdmap e673: 8 total, 8 up, 8 in 2021-07-26T16:08:13.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:13 smithi033 bash[41341]: cluster 2021-07-26T16:08:12.380043+0000 mon.a (mon.0) 1045 : cluster [DBG] osdmap e673: 8 total, 8 up, 8 in 2021-07-26T16:08:13.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:13 smithi096 bash[33981]: cluster 2021-07-26T16:08:12.380043+0000 mon.a (mon.0) 1045 : cluster [DBG] osdmap e673: 8 total, 8 up, 8 in 2021-07-26T16:08:14.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:14 smithi033 bash[42377]: cluster 2021-07-26T16:08:13.165331+0000 mgr.y (mgr.34104) 428 : cluster [DBG] pgmap v832: 25 pgs: 25 active+clean; 687 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 14 op/s 2021-07-26T16:08:14.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:14 smithi033 bash[42377]: cluster 2021-07-26T16:08:13.399082+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e674: 8 total, 8 up, 8 in 2021-07-26T16:08:14.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:14 smithi033 bash[41341]: cluster 2021-07-26T16:08:13.165331+0000 mgr.y (mgr.34104) 428 : cluster [DBG] pgmap v832: 25 pgs: 25 active+clean; 687 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 14 op/s 2021-07-26T16:08:14.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:14 smithi033 bash[41341]: cluster 2021-07-26T16:08:13.399082+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e674: 8 total, 8 up, 8 in 2021-07-26T16:08:14.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:14 smithi096 bash[33981]: cluster 2021-07-26T16:08:13.165331+0000 mgr.y (mgr.34104) 428 : cluster [DBG] pgmap v832: 25 pgs: 25 active+clean; 687 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 MiB/s rd, 6.0 MiB/s wr, 14 op/s 2021-07-26T16:08:14.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:14 smithi096 bash[33981]: cluster 2021-07-26T16:08:13.399082+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e674: 8 total, 8 up, 8 in 2021-07-26T16:08:15.086 INFO:tasks.rados.rados.0.smithi033.stdout:3114: done (4 left) 2021-07-26T16:08:15.086 INFO:tasks.rados.rados.0.smithi033.stdout:3115: done (3 left) 2021-07-26T16:08:15.086 INFO:tasks.rados.rados.0.smithi033.stdout:3116: done (2 left) 2021-07-26T16:08:15.086 INFO:tasks.rados.rados.0.smithi033.stdout:3117: done (1 left) 2021-07-26T16:08:15.087 INFO:tasks.rados.rados.0.smithi033.stdout:3118: done (0 left) 2021-07-26T16:08:15.087 INFO:tasks.rados.rados.0.smithi033.stdout:3119: setattr oid 4 current snap is 320 2021-07-26T16:08:15.087 INFO:tasks.rados.rados.0.smithi033.stdout:3120: setattr oid 39 current snap is 320 2021-07-26T16:08:15.089 INFO:tasks.rados.rados.0.smithi033.stdout:3121: snap_create 2021-07-26T16:08:15.096 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1402 (ObjNum 932 snap 314 seq_num 932) dirty exists 2021-07-26T16:08:15.099 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1473 (ObjNum 833 snap 277 seq_num 833) dirty exists 2021-07-26T16:08:15.431 INFO:tasks.rados.rados.0.smithi033.stdout:3119: done (2 left) 2021-07-26T16:08:15.432 INFO:tasks.rados.rados.0.smithi033.stdout:3120: done (1 left) 2021-07-26T16:08:15.432 INFO:tasks.rados.rados.0.smithi033.stdout:3121: done (0 left) 2021-07-26T16:08:15.432 INFO:tasks.rados.rados.0.smithi033.stdout:3122: rollback oid 29 current snap is 321 2021-07-26T16:08:15.432 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 296 2021-07-26T16:08:15.433 INFO:tasks.rados.rados.0.smithi033.stdout:3123: rollback oid 14 current snap is 321 2021-07-26T16:08:15.433 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 14 to 318 2021-07-26T16:08:15.433 INFO:tasks.rados.rados.0.smithi033.stdout:3124: snap_remove snap 317 2021-07-26T16:08:15.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:15 smithi033 bash[41341]: cluster 2021-07-26T16:08:14.405961+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e675: 8 total, 8 up, 8 in 2021-07-26T16:08:15.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:15 smithi033 bash[42377]: cluster 2021-07-26T16:08:14.405961+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e675: 8 total, 8 up, 8 in 2021-07-26T16:08:15.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:15 smithi096 bash[33981]: cluster 2021-07-26T16:08:14.405961+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e675: 8 total, 8 up, 8 in 2021-07-26T16:08:16.203 INFO:tasks.rados.rados.0.smithi033.stdout:3124: done (2 left) 2021-07-26T16:08:16.204 INFO:tasks.rados.rados.0.smithi033.stdout:3125: rmattr oid 43 current snap is 321 2021-07-26T16:08:16.204 INFO:tasks.rados.rados.0.smithi033.stdout:3123: finishing rollback tid 0 to smithi03339061-14 2021-07-26T16:08:16.204 INFO:tasks.rados.rados.0.smithi033.stdout:3123: finishing rollback tid 1 to smithi03339061-14 2021-07-26T16:08:16.204 INFO:tasks.rados.rados.0.smithi033.stdout:3123: finishing rollback tid 2 to smithi03339061-14 2021-07-26T16:08:16.205 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1405 (ObjNum 829 snap 275 seq_num 829) dirty exists 2021-07-26T16:08:16.205 INFO:tasks.rados.rados.0.smithi033.stdout:3122: finishing rollback tid 0 to smithi03339061-29 2021-07-26T16:08:16.205 INFO:tasks.rados.rados.0.smithi033.stdout:3122: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:08:16.205 INFO:tasks.rados.rados.0.smithi033.stdout:3122: finishing rollback tid 2 to smithi03339061-29 2021-07-26T16:08:16.205 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1293 (ObjNum 890 snap 292 seq_num 890) dirty exists 2021-07-26T16:08:16.206 INFO:tasks.rados.rados.0.smithi033.stdout:3122: done (2 left) 2021-07-26T16:08:16.206 INFO:tasks.rados.rados.0.smithi033.stdout:3123: done (1 left) 2021-07-26T16:08:16.206 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 321 2021-07-26T16:08:16.206 INFO:tasks.rados.rados.0.smithi033.stdout:3126: seq_num 948 ranges {11591680=679936,12271616=516096,12787712=286720} 2021-07-26T16:08:16.272 INFO:tasks.rados.rados.0.smithi033.stdout:3126: writing smithi03339061-4 from 11591680 to 12271616 tid 1 2021-07-26T16:08:16.274 INFO:tasks.rados.rados.0.smithi033.stdout:3126: writing smithi03339061-4 from 12271616 to 12787712 tid 2 2021-07-26T16:08:16.277 INFO:tasks.rados.rados.0.smithi033.stdout:3126: writing smithi03339061-4 from 12787712 to 13074432 tid 3 2021-07-26T16:08:16.277 INFO:tasks.rados.rados.0.smithi033.stdout:3127: read oid 23 snap -1 2021-07-26T16:08:16.277 INFO:tasks.rados.rados.0.smithi033.stdout:3127: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:08:16.277 INFO:tasks.rados.rados.0.smithi033.stdout:3128: copy_from oid 11 from oid 36 current snap is 321 2021-07-26T16:08:16.278 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 1404 (ObjNum 733 snap 246 seq_num 733) dirty exists 2021-07-26T16:08:16.278 INFO:tasks.rados.rados.0.smithi033.stdout:3125: done (3 left) 2021-07-26T16:08:16.278 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 321 2021-07-26T16:08:16.278 INFO:tasks.rados.rados.0.smithi033.stdout:3129: seq_num 949 ranges {4849664=704512,5554176=794624,6348800=8192} 2021-07-26T16:08:16.308 INFO:tasks.rados.rados.0.smithi033.stdout:3129: writing smithi03339061-10 from 4849664 to 5554176 tid 1 2021-07-26T16:08:16.313 INFO:tasks.rados.rados.0.smithi033.stdout:3129: writing smithi03339061-10 from 5554176 to 6348800 tid 2 2021-07-26T16:08:16.313 INFO:tasks.rados.rados.0.smithi033.stdout:3129: writing smithi03339061-10 from 6348800 to 6356992 tid 3 2021-07-26T16:08:16.314 INFO:tasks.rados.rados.0.smithi033.stdout:3130: copy_from oid 35 from oid 38 current snap is 321 2021-07-26T16:08:16.314 INFO:tasks.rados.rados.0.smithi033.stdout:3126: finishing write tid 1 to smithi03339061-4 2021-07-26T16:08:16.314 INFO:tasks.rados.rados.0.smithi033.stdout:3126: finishing write tid 2 to smithi03339061-4 2021-07-26T16:08:16.314 INFO:tasks.rados.rados.0.smithi033.stdout:3126: finishing write tid 3 to smithi03339061-4 2021-07-26T16:08:16.315 INFO:tasks.rados.rados.0.smithi033.stdout:3126: finishing write tid 4 to smithi03339061-4 2021-07-26T16:08:16.315 INFO:tasks.rados.rados.0.smithi033.stdout:3127: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:08:16.392 INFO:tasks.rados.rados.0.smithi033.stdout:3126: finishing write tid 5 to smithi03339061-4 2021-07-26T16:08:16.393 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1409 (ObjNum 948 snap 321 seq_num 948) dirty exists 2021-07-26T16:08:16.393 INFO:tasks.rados.rados.0.smithi033.stdout:3126: left oid 4 (ObjNum 948 snap 321 seq_num 948) 2021-07-26T16:08:16.393 INFO:tasks.rados.rados.0.smithi033.stdout:3128: finishing copy_from to smithi03339061-11 2021-07-26T16:08:16.394 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1411 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:08:16.394 INFO:tasks.rados.rados.0.smithi033.stdout:3128: finishing copy_from racing read to smithi03339061-11 2021-07-26T16:08:16.394 INFO:tasks.rados.rados.0.smithi033.stdout:3129: finishing write tid 1 to smithi03339061-10 2021-07-26T16:08:16.394 INFO:tasks.rados.rados.0.smithi033.stdout:3129: finishing write tid 2 to smithi03339061-10 2021-07-26T16:08:16.394 INFO:tasks.rados.rados.0.smithi033.stdout:3129: finishing write tid 3 to smithi03339061-10 2021-07-26T16:08:16.395 INFO:tasks.rados.rados.0.smithi033.stdout:3129: finishing write tid 4 to smithi03339061-10 2021-07-26T16:08:16.395 INFO:tasks.rados.rados.0.smithi033.stdout:3126: done (4 left) 2021-07-26T16:08:16.395 INFO:tasks.rados.rados.0.smithi033.stdout:3127: done (3 left) 2021-07-26T16:08:16.395 INFO:tasks.rados.rados.0.smithi033.stdout:3128: done (2 left) 2021-07-26T16:08:16.395 INFO:tasks.rados.rados.0.smithi033.stdout:3131: read oid 45 snap -1 2021-07-26T16:08:16.396 INFO:tasks.rados.rados.0.smithi033.stdout:3131: expect (ObjNum 866 snap 284 seq_num 866) 2021-07-26T16:08:16.396 INFO:tasks.rados.rados.0.smithi033.stdout:3132: setattr oid 40 current snap is 321 2021-07-26T16:08:16.396 INFO:tasks.rados.rados.0.smithi033.stdout:3129: finishing write tid 5 to smithi03339061-10 2021-07-26T16:08:16.396 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1502 (ObjNum 949 snap 321 seq_num 949) dirty exists 2021-07-26T16:08:16.396 INFO:tasks.rados.rados.0.smithi033.stdout:3129: left oid 10 (ObjNum 949 snap 321 seq_num 949) 2021-07-26T16:08:16.397 INFO:tasks.rados.rados.0.smithi033.stdout:3130: finishing copy_from to smithi03339061-35 2021-07-26T16:08:16.397 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 728 (ObjNum 850 snap 282 seq_num 850) dirty exists 2021-07-26T16:08:16.397 INFO:tasks.rados.rados.0.smithi033.stdout:3130: finishing copy_from racing read to smithi03339061-35 2021-07-26T16:08:16.398 INFO:tasks.rados.rados.0.smithi033.stdout:3129: done (3 left) 2021-07-26T16:08:16.398 INFO:tasks.rados.rados.0.smithi033.stdout:3130: done (2 left) 2021-07-26T16:08:16.398 INFO:tasks.rados.rados.0.smithi033.stdout:3133: delete oid 7 current snap is 321 2021-07-26T16:08:16.400 INFO:tasks.rados.rados.0.smithi033.stdout:3133: done (2 left) 2021-07-26T16:08:16.400 INFO:tasks.rados.rados.0.smithi033.stdout:3134: read oid 39 snap -1 2021-07-26T16:08:16.401 INFO:tasks.rados.rados.0.smithi033.stdout:3134: expect (ObjNum 833 snap 277 seq_num 833) 2021-07-26T16:08:16.401 INFO:tasks.rados.rados.0.smithi033.stdout:3135: rollback oid 44 current snap is 321 2021-07-26T16:08:16.401 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 282 2021-07-26T16:08:16.401 INFO:tasks.rados.rados.0.smithi033.stdout:3136: copy_from oid 5 from oid 30 current snap is 321 2021-07-26T16:08:16.401 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 321 2021-07-26T16:08:16.402 INFO:tasks.rados.rados.0.smithi033.stdout:3137: seq_num 951 ranges {3031040=737280,3768320=614400,4382720=188416} 2021-07-26T16:08:16.424 INFO:tasks.rados.rados.0.smithi033.stdout:3137: writing smithi03339061-21 from 3031040 to 3768320 tid 1 2021-07-26T16:08:16.431 INFO:tasks.rados.rados.0.smithi033.stdout:3137: writing smithi03339061-21 from 3768320 to 4382720 tid 2 2021-07-26T16:08:16.431 INFO:tasks.rados.rados.0.smithi033.stdout:3137: writing smithi03339061-21 from 4382720 to 4571136 tid 3 2021-07-26T16:08:16.432 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 321 2021-07-26T16:08:16.432 INFO:tasks.rados.rados.0.smithi033.stdout:3138: seq_num 952 ranges {1228800=753664,1982464=499712,2482176=303104} 2021-07-26T16:08:16.440 INFO:tasks.rados.rados.0.smithi033.stdout:3138: writing smithi03339061-9 from 1228800 to 1982464 tid 1 2021-07-26T16:08:16.443 INFO:tasks.rados.rados.0.smithi033.stdout:3138: writing smithi03339061-9 from 1982464 to 2482176 tid 2 2021-07-26T16:08:16.444 INFO:tasks.rados.rados.0.smithi033.stdout:3138: writing smithi03339061-9 from 2482176 to 2785280 tid 3 2021-07-26T16:08:16.445 INFO:tasks.rados.rados.0.smithi033.stdout:3139: rmattr oid 19 current snap is 321 2021-07-26T16:08:16.445 INFO:tasks.rados.rados.0.smithi033.stdout:3139: done (7 left) 2021-07-26T16:08:16.445 INFO:tasks.rados.rados.0.smithi033.stdout:3140: snap_remove snap 277 2021-07-26T16:08:16.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:16 smithi033 bash[41341]: cluster 2021-07-26T16:08:15.166030+0000 mgr.y (mgr.34104) 429 : cluster [DBG] pgmap v835: 25 pgs: 25 active+clean; 694 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.9 MiB/s wr, 23 op/s 2021-07-26T16:08:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:16 smithi033 bash[41341]: cluster 2021-07-26T16:08:15.429162+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e676: 8 total, 8 up, 8 in 2021-07-26T16:08:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:16 smithi033 bash[41341]: cluster 2021-07-26T16:08:16.199774+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e677: 8 total, 8 up, 8 in 2021-07-26T16:08:16.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:16 smithi033 bash[42377]: cluster 2021-07-26T16:08:15.166030+0000 mgr.y (mgr.34104) 429 : cluster [DBG] pgmap v835: 25 pgs: 25 active+clean; 694 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.9 MiB/s wr, 23 op/s 2021-07-26T16:08:16.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:16 smithi033 bash[42377]: cluster 2021-07-26T16:08:15.429162+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e676: 8 total, 8 up, 8 in 2021-07-26T16:08:16.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:16 smithi033 bash[42377]: cluster 2021-07-26T16:08:16.199774+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e677: 8 total, 8 up, 8 in 2021-07-26T16:08:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:16 smithi096 bash[33981]: cluster 2021-07-26T16:08:15.166030+0000 mgr.y (mgr.34104) 429 : cluster [DBG] pgmap v835: 25 pgs: 25 active+clean; 694 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 11 MiB/s rd, 1.9 MiB/s wr, 23 op/s 2021-07-26T16:08:16.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:16 smithi096 bash[33981]: cluster 2021-07-26T16:08:15.429162+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e676: 8 total, 8 up, 8 in 2021-07-26T16:08:16.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:16 smithi096 bash[33981]: cluster 2021-07-26T16:08:16.199774+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e677: 8 total, 8 up, 8 in 2021-07-26T16:08:17.443 INFO:tasks.rados.rados.0.smithi033.stdout:3140: done (7 left) 2021-07-26T16:08:17.444 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 321 2021-07-26T16:08:17.444 INFO:tasks.rados.rados.0.smithi033.stdout:3141: seq_num 953 ranges {0=770048,770048=786432,1556480=16384} 2021-07-26T16:08:17.449 INFO:tasks.rados.rados.0.smithi033.stdout:3141: writing smithi03339061-15 from 0 to 770048 tid 1 2021-07-26T16:08:17.455 INFO:tasks.rados.rados.0.smithi033.stdout:3141: writing smithi03339061-15 from 770048 to 1556480 tid 2 2021-07-26T16:08:17.455 INFO:tasks.rados.rados.0.smithi033.stdout:3141: writing smithi03339061-15 from 1556480 to 1572864 tid 3 2021-07-26T16:08:17.455 INFO:tasks.rados.rados.0.smithi033.stdout:3142: snap_remove snap 260 2021-07-26T16:08:18.461 INFO:tasks.rados.rados.0.smithi033.stdout:3142: done (8 left) 2021-07-26T16:08:18.461 INFO:tasks.rados.rados.0.smithi033.stdout:3143: delete oid 38 current snap is 321 2021-07-26T16:08:18.462 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 1401 (ObjNum 1953066355 snap 858810728 seq_num 809055027) dirty exists 2021-07-26T16:08:18.462 INFO:tasks.rados.rados.0.smithi033.stdout:3131: expect (ObjNum 866 snap 284 seq_num 866) 2021-07-26T16:08:18.574 INFO:tasks.rados.rados.0.smithi033.stdout:3135: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:08:18.574 INFO:tasks.rados.rados.0.smithi033.stdout:3135: finishing rollback tid 2 to smithi03339061-44 2021-07-26T16:08:18.575 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1411 (ObjNum 768 snap 255 seq_num 768) dirty exists 2021-07-26T16:08:18.575 INFO:tasks.rados.rados.0.smithi033.stdout:3131: done (8 left) 2021-07-26T16:08:18.575 INFO:tasks.rados.rados.0.smithi033.stdout:3132: done (7 left) 2021-07-26T16:08:18.575 INFO:tasks.rados.rados.0.smithi033.stdout:3135: done (6 left) 2021-07-26T16:08:18.576 INFO:tasks.rados.rados.0.smithi033.stdout:3143: done (5 left) 2021-07-26T16:08:18.576 INFO:tasks.rados.rados.0.smithi033.stdout:3144: rollback oid 44 current snap is 321 2021-07-26T16:08:18.576 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 248 2021-07-26T16:08:18.576 INFO:tasks.rados.rados.0.smithi033.stdout:3134: expect (ObjNum 833 snap 277 seq_num 833) 2021-07-26T16:08:18.631 INFO:tasks.rados.rados.0.smithi033.stdout:3136: finishing copy_from to smithi03339061-5 2021-07-26T16:08:18.631 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 1484 (ObjNum 658 snap 213 seq_num 658) dirty exists 2021-07-26T16:08:18.632 INFO:tasks.rados.rados.0.smithi033.stdout:3136: finishing copy_from racing read to smithi03339061-5 2021-07-26T16:08:18.632 INFO:tasks.rados.rados.0.smithi033.stdout:3137: finishing write tid 1 to smithi03339061-21 2021-07-26T16:08:18.632 INFO:tasks.rados.rados.0.smithi033.stdout:3137: finishing write tid 2 to smithi03339061-21 2021-07-26T16:08:18.633 INFO:tasks.rados.rados.0.smithi033.stdout:3137: finishing write tid 3 to smithi03339061-21 2021-07-26T16:08:18.633 INFO:tasks.rados.rados.0.smithi033.stdout:3137: finishing write tid 4 to smithi03339061-21 2021-07-26T16:08:18.633 INFO:tasks.rados.rados.0.smithi033.stdout:3137: finishing write tid 5 to smithi03339061-21 2021-07-26T16:08:18.633 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1482 (ObjNum 951 snap 321 seq_num 951) dirty exists 2021-07-26T16:08:18.634 INFO:tasks.rados.rados.0.smithi033.stdout:3137: left oid 21 (ObjNum 951 snap 321 seq_num 951) 2021-07-26T16:08:18.634 INFO:tasks.rados.rados.0.smithi033.stdout:3138: finishing write tid 1 to smithi03339061-9 2021-07-26T16:08:18.634 INFO:tasks.rados.rados.0.smithi033.stdout:3138: finishing write tid 2 to smithi03339061-9 2021-07-26T16:08:18.634 INFO:tasks.rados.rados.0.smithi033.stdout:3138: finishing write tid 3 to smithi03339061-9 2021-07-26T16:08:18.634 INFO:tasks.rados.rados.0.smithi033.stdout:3138: finishing write tid 4 to smithi03339061-9 2021-07-26T16:08:18.635 INFO:tasks.rados.rados.0.smithi033.stdout:3138: finishing write tid 5 to smithi03339061-9 2021-07-26T16:08:18.635 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 1763 (ObjNum 952 snap 321 seq_num 952) dirty exists 2021-07-26T16:08:18.635 INFO:tasks.rados.rados.0.smithi033.stdout:3138: left oid 9 (ObjNum 952 snap 321 seq_num 952) 2021-07-26T16:08:18.635 INFO:tasks.rados.rados.0.smithi033.stdout:3134: done (5 left) 2021-07-26T16:08:18.636 INFO:tasks.rados.rados.0.smithi033.stdout:3136: done (4 left) 2021-07-26T16:08:18.636 INFO:tasks.rados.rados.0.smithi033.stdout:3137: done (3 left) 2021-07-26T16:08:18.636 INFO:tasks.rados.rados.0.smithi033.stdout:3138: done (2 left) 2021-07-26T16:08:18.636 INFO:tasks.rados.rados.0.smithi033.stdout:3145: read oid 31 snap -1 2021-07-26T16:08:18.636 INFO:tasks.rados.rados.0.smithi033.stdout:3145: expect (ObjNum 887 snap 291 seq_num 887) 2021-07-26T16:08:18.637 INFO:tasks.rados.rados.0.smithi033.stdout:3146: delete oid 11 current snap is 321 2021-07-26T16:08:18.637 INFO:tasks.rados.rados.0.smithi033.stdout:3141: finishing write tid 1 to smithi03339061-15 2021-07-26T16:08:18.637 INFO:tasks.rados.rados.0.smithi033.stdout:3141: finishing write tid 2 to smithi03339061-15 2021-07-26T16:08:18.637 INFO:tasks.rados.rados.0.smithi033.stdout:3141: finishing write tid 3 to smithi03339061-15 2021-07-26T16:08:18.638 INFO:tasks.rados.rados.0.smithi033.stdout:3141: finishing write tid 4 to smithi03339061-15 2021-07-26T16:08:18.638 INFO:tasks.rados.rados.0.smithi033.stdout:3141: finishing write tid 5 to smithi03339061-15 2021-07-26T16:08:18.638 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 928 (ObjNum 953 snap 321 seq_num 953) dirty exists 2021-07-26T16:08:18.638 INFO:tasks.rados.rados.0.smithi033.stdout:3141: left oid 15 (ObjNum 953 snap 321 seq_num 953) 2021-07-26T16:08:18.638 INFO:tasks.rados.rados.0.smithi033.stdout:3144: finishing rollback tid 0 to smithi03339061-44 2021-07-26T16:08:18.639 INFO:tasks.rados.rados.0.smithi033.stdout:3144: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:08:18.639 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1413 (ObjNum 2007968752 snap 22002 seq_num 2006651520) dirty dne 2021-07-26T16:08:18.639 INFO:tasks.rados.rados.0.smithi033.stdout:3141: done (3 left) 2021-07-26T16:08:18.640 INFO:tasks.rados.rados.0.smithi033.stdout:3144: done (2 left) 2021-07-26T16:08:18.640 INFO:tasks.rados.rados.0.smithi033.stdout:3146: done (1 left) 2021-07-26T16:08:18.640 INFO:tasks.rados.rados.0.smithi033.stdout:3147: snap_remove snap 289 2021-07-26T16:08:18.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:18 smithi033 bash[42377]: cluster 2021-07-26T16:08:17.166717+0000 mgr.y (mgr.34104) 430 : cluster [DBG] pgmap v838: 25 pgs: 25 active+clean; 694 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2021-07-26T16:08:18.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:18 smithi033 bash[42377]: cluster 2021-07-26T16:08:17.438071+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e678: 8 total, 8 up, 8 in 2021-07-26T16:08:18.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:18 smithi033 bash[41341]: cluster 2021-07-26T16:08:17.166717+0000 mgr.y (mgr.34104) 430 : cluster [DBG] pgmap v838: 25 pgs: 25 active+clean; 694 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2021-07-26T16:08:18.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:18 smithi033 bash[41341]: cluster 2021-07-26T16:08:17.438071+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e678: 8 total, 8 up, 8 in 2021-07-26T16:08:18.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:18 smithi096 bash[33981]: cluster 2021-07-26T16:08:17.166717+0000 mgr.y (mgr.34104) 430 : cluster [DBG] pgmap v838: 25 pgs: 25 active+clean; 694 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 1.6 MiB/s wr, 22 op/s 2021-07-26T16:08:18.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:18 smithi096 bash[33981]: cluster 2021-07-26T16:08:17.438071+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e678: 8 total, 8 up, 8 in 2021-07-26T16:08:19.468 INFO:tasks.rados.rados.0.smithi033.stdout:3147: done (1 left) 2021-07-26T16:08:19.468 INFO:tasks.rados.rados.0.smithi033.stdout:3148: rollback oid 26 current snap is 321 2021-07-26T16:08:19.468 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 26 to 302 2021-07-26T16:08:19.468 INFO:tasks.rados.rados.0.smithi033.stdout:3149: rollback oid 36 current snap is 321 2021-07-26T16:08:19.469 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 36 to 311 2021-07-26T16:08:19.469 INFO:tasks.rados.rados.0.smithi033.stdout:3145: expect (ObjNum 887 snap 291 seq_num 887) 2021-07-26T16:08:19.602 INFO:tasks.rados.rados.0.smithi033.stdout:3148: finishing rollback tid 1 to smithi03339061-26 2021-07-26T16:08:19.603 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 1756 (ObjNum 0 snap 32561 seq_num 2023143792) dirty dne 2021-07-26T16:08:19.603 INFO:tasks.rados.rados.0.smithi033.stdout:3149: finishing rollback tid 0 to smithi03339061-36 2021-07-26T16:08:19.603 INFO:tasks.rados.rados.0.smithi033.stdout:3149: finishing rollback tid 1 to smithi03339061-36 2021-07-26T16:08:19.603 INFO:tasks.rados.rados.0.smithi033.stdout:3149: finishing rollback tid 2 to smithi03339061-36 2021-07-26T16:08:19.604 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1421 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:08:19.604 INFO:tasks.rados.rados.0.smithi033.stdout:3145: done (2 left) 2021-07-26T16:08:19.604 INFO:tasks.rados.rados.0.smithi033.stdout:3148: done (1 left) 2021-07-26T16:08:19.604 INFO:tasks.rados.rados.0.smithi033.stdout:3149: done (0 left) 2021-07-26T16:08:19.605 INFO:tasks.rados.rados.0.smithi033.stdout:3150: rollback oid 20 current snap is 321 2021-07-26T16:08:19.605 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 20 to 276 2021-07-26T16:08:19.605 INFO:tasks.rados.rados.0.smithi033.stdout:3151: delete oid 40 current snap is 321 2021-07-26T16:08:19.607 INFO:tasks.rados.rados.0.smithi033.stdout:3151: done (1 left) 2021-07-26T16:08:19.607 INFO:tasks.rados.rados.0.smithi033.stdout:3152: delete oid 28 current snap is 321 2021-07-26T16:08:19.609 INFO:tasks.rados.rados.0.smithi033.stdout:3150: finishing rollback tid 0 to smithi03339061-20 2021-07-26T16:08:19.610 INFO:tasks.rados.rados.0.smithi033.stdout:3150: finishing rollback tid 1 to smithi03339061-20 2021-07-26T16:08:19.611 INFO:tasks.rados.rados.0.smithi033.stdout:3150: finishing rollback tid 2 to smithi03339061-20 2021-07-26T16:08:19.611 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1416 (ObjNum 773 snap 255 seq_num 773) dirty exists 2021-07-26T16:08:19.612 INFO:tasks.rados.rados.0.smithi033.stdout:3150: done (1 left) 2021-07-26T16:08:19.612 INFO:tasks.rados.rados.0.smithi033.stdout:3152: done (0 left) 2021-07-26T16:08:19.613 INFO:tasks.rados.rados.0.smithi033.stdout:3153: rmattr oid 44 current snap is 321 2021-07-26T16:08:19.613 INFO:tasks.rados.rados.0.smithi033.stdout:3153: done (0 left) 2021-07-26T16:08:19.613 INFO:tasks.rados.rados.0.smithi033.stdout:3154: read oid 7 snap -1 2021-07-26T16:08:19.613 INFO:tasks.rados.rados.0.smithi033.stdout:3154: expect deleted 2021-07-26T16:08:19.614 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 321 2021-07-26T16:08:19.614 INFO:tasks.rados.rados.0.smithi033.stdout:3155: seq_num 958 ranges {4980736=450560,5431296=655360,6086656=548864} 2021-07-26T16:08:19.646 INFO:tasks.rados.rados.0.smithi033.stdout:3155: writing smithi03339061-46 from 4980736 to 5431296 tid 1 2021-07-26T16:08:19.650 INFO:tasks.rados.rados.0.smithi033.stdout:3155: writing smithi03339061-46 from 5431296 to 6086656 tid 2 2021-07-26T16:08:19.654 INFO:tasks.rados.rados.0.smithi033.stdout:3155: writing smithi03339061-46 from 6086656 to 6635520 tid 3 2021-07-26T16:08:19.654 INFO:tasks.rados.rados.0.smithi033.stdout:3156: copy_from oid 36 from oid 4 current snap is 321 2021-07-26T16:08:19.654 INFO:tasks.rados.rados.0.smithi033.stdout:3154: done (2 left) 2021-07-26T16:08:19.655 INFO:tasks.rados.rados.0.smithi033.stdout:3157: read oid 12 snap -1 2021-07-26T16:08:19.655 INFO:tasks.rados.rados.0.smithi033.stdout:3157: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:08:19.655 INFO:tasks.rados.rados.0.smithi033.stdout:3158: read oid 8 snap -1 2021-07-26T16:08:19.655 INFO:tasks.rados.rados.0.smithi033.stdout:3158: expect deleted 2021-07-26T16:08:19.656 INFO:tasks.rados.rados.0.smithi033.stdout:3159: copy_from oid 9 from oid 14 current snap is 321 2021-07-26T16:08:19.656 INFO:tasks.rados.rados.0.smithi033.stdout:3160: delete oid 30 current snap is 321 2021-07-26T16:08:19.658 INFO:tasks.rados.rados.0.smithi033.stdout:3155: finishing write tid 1 to smithi03339061-46 2021-07-26T16:08:19.662 INFO:tasks.rados.rados.0.smithi033.stdout:3158: done (5 left) 2021-07-26T16:08:19.662 INFO:tasks.rados.rados.0.smithi033.stdout:3160: done (4 left) 2021-07-26T16:08:19.662 INFO:tasks.rados.rados.0.smithi033.stdout:3161: snap_create 2021-07-26T16:08:19.663 INFO:tasks.rados.rados.0.smithi033.stdout:3155: finishing write tid 2 to smithi03339061-46 2021-07-26T16:08:19.666 INFO:tasks.rados.rados.0.smithi033.stdout:3155: finishing write tid 3 to smithi03339061-46 2021-07-26T16:08:19.667 INFO:tasks.rados.rados.0.smithi033.stdout:3155: finishing write tid 4 to smithi03339061-46 2021-07-26T16:08:19.668 INFO:tasks.rados.rados.0.smithi033.stdout:3155: finishing write tid 5 to smithi03339061-46 2021-07-26T16:08:19.668 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1297 (ObjNum 958 snap 321 seq_num 958) dirty exists 2021-07-26T16:08:19.669 INFO:tasks.rados.rados.0.smithi033.stdout:3155: left oid 46 (ObjNum 958 snap 321 seq_num 958) 2021-07-26T16:08:19.669 INFO:tasks.rados.rados.0.smithi033.stdout:3157: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:08:19.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:19 smithi096 bash[33981]: cluster 2021-07-26T16:08:18.456179+0000 mon.a (mon.0) 1051 : cluster [DBG] osdmap e679: 8 total, 8 up, 8 in 2021-07-26T16:08:19.744 INFO:tasks.rados.rados.0.smithi033.stdout:3159: finishing copy_from to smithi03339061-9 2021-07-26T16:08:19.745 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 1405 (ObjNum 829 snap 275 seq_num 829) dirty exists 2021-07-26T16:08:19.745 INFO:tasks.rados.rados.0.smithi033.stdout:3159: finishing copy_from racing read to smithi03339061-9 2021-07-26T16:08:19.745 INFO:tasks.rados.rados.0.smithi033.stdout:3156: finishing copy_from to smithi03339061-36 2021-07-26T16:08:19.745 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1409 (ObjNum 948 snap 321 seq_num 948) dirty exists 2021-07-26T16:08:19.747 INFO:tasks.rados.rados.0.smithi033.stdout:3156: finishing copy_from racing read to smithi03339061-36 2021-07-26T16:08:19.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:19 smithi033 bash[41341]: cluster 2021-07-26T16:08:18.456179+0000 mon.a (mon.0) 1051 : cluster [DBG] osdmap e679: 8 total, 8 up, 8 in 2021-07-26T16:08:19.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:19 smithi033 bash[42377]: cluster 2021-07-26T16:08:18.456179+0000 mon.a (mon.0) 1051 : cluster [DBG] osdmap e679: 8 total, 8 up, 8 in 2021-07-26T16:08:20.468 INFO:tasks.rados.rados.0.smithi033.stdout:3155: done (4 left) 2021-07-26T16:08:20.468 INFO:tasks.rados.rados.0.smithi033.stdout:3156: done (3 left) 2021-07-26T16:08:20.468 INFO:tasks.rados.rados.0.smithi033.stdout:3157: done (2 left) 2021-07-26T16:08:20.468 INFO:tasks.rados.rados.0.smithi033.stdout:3159: done (1 left) 2021-07-26T16:08:20.469 INFO:tasks.rados.rados.0.smithi033.stdout:3161: done (0 left) 2021-07-26T16:08:20.469 INFO:tasks.rados.rados.0.smithi033.stdout:3162: read oid 47 snap 237 2021-07-26T16:08:20.469 INFO:tasks.rados.rados.0.smithi033.stdout:3162: expect (ObjNum 692 snap 229 seq_num 692) 2021-07-26T16:08:20.469 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 322 2021-07-26T16:08:20.470 INFO:tasks.rados.rados.0.smithi033.stdout:3163: seq_num 960 ranges {13074432=483328,13557760=425984,13983744=761856,14745600=16384} 2021-07-26T16:08:20.546 INFO:tasks.rados.rados.0.smithi033.stdout:3163: writing smithi03339061-36 from 13074432 to 13557760 tid 1 2021-07-26T16:08:20.549 INFO:tasks.rados.rados.0.smithi033.stdout:3163: writing smithi03339061-36 from 13557760 to 13983744 tid 2 2021-07-26T16:08:20.553 INFO:tasks.rados.rados.0.smithi033.stdout:3163: writing smithi03339061-36 from 13983744 to 14745600 tid 3 2021-07-26T16:08:20.553 INFO:tasks.rados.rados.0.smithi033.stdout:3163: writing smithi03339061-36 from 14745600 to 14761984 tid 4 2021-07-26T16:08:20.554 INFO:tasks.rados.rados.0.smithi033.stdout:3162: expect (ObjNum 692 snap 229 seq_num 692) 2021-07-26T16:08:20.616 INFO:tasks.rados.rados.0.smithi033.stdout:3163: finishing write tid 1 to smithi03339061-36 2021-07-26T16:08:20.617 INFO:tasks.rados.rados.0.smithi033.stdout:3163: finishing write tid 2 to smithi03339061-36 2021-07-26T16:08:20.617 INFO:tasks.rados.rados.0.smithi033.stdout:3163: finishing write tid 3 to smithi03339061-36 2021-07-26T16:08:20.617 INFO:tasks.rados.rados.0.smithi033.stdout:3163: finishing write tid 4 to smithi03339061-36 2021-07-26T16:08:20.617 INFO:tasks.rados.rados.0.smithi033.stdout:3163: finishing write tid 5 to smithi03339061-36 2021-07-26T16:08:20.618 INFO:tasks.rados.rados.0.smithi033.stdout:3163: finishing write tid 6 to smithi03339061-36 2021-07-26T16:08:20.618 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1426 (ObjNum 960 snap 322 seq_num 960) dirty exists 2021-07-26T16:08:20.618 INFO:tasks.rados.rados.0.smithi033.stdout:3163: left oid 36 (ObjNum 960 snap 322 seq_num 960) 2021-07-26T16:08:20.618 INFO:tasks.rados.rados.0.smithi033.stdout:3162: done (1 left) 2021-07-26T16:08:20.619 INFO:tasks.rados.rados.0.smithi033.stdout:3163: done (0 left) 2021-07-26T16:08:20.619 INFO:tasks.rados.rados.0.smithi033.stdout:3164: snap_remove snap 314 2021-07-26T16:08:20.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:20 smithi096 bash[33981]: cluster 2021-07-26T16:08:19.167520+0000 mgr.y (mgr.34104) 431 : cluster [DBG] pgmap v841: 25 pgs: 25 active+clean; 696 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 744 KiB/s wr, 17 op/s 2021-07-26T16:08:20.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:20 smithi096 bash[33981]: cluster 2021-07-26T16:08:19.464255+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e680: 8 total, 8 up, 8 in 2021-07-26T16:08:20.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:20 smithi033 bash[42377]: cluster 2021-07-26T16:08:19.167520+0000 mgr.y (mgr.34104) 431 : cluster [DBG] pgmap v841: 25 pgs: 25 active+clean; 696 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 744 KiB/s wr, 17 op/s 2021-07-26T16:08:20.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:20 smithi033 bash[42377]: cluster 2021-07-26T16:08:19.464255+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e680: 8 total, 8 up, 8 in 2021-07-26T16:08:20.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:20 smithi033 bash[41341]: cluster 2021-07-26T16:08:19.167520+0000 mgr.y (mgr.34104) 431 : cluster [DBG] pgmap v841: 25 pgs: 25 active+clean; 696 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 744 KiB/s wr, 17 op/s 2021-07-26T16:08:20.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:20 smithi033 bash[41341]: cluster 2021-07-26T16:08:19.464255+0000 mon.a (mon.0) 1052 : cluster [DBG] osdmap e680: 8 total, 8 up, 8 in 2021-07-26T16:08:21.209 INFO:tasks.rados.rados.0.smithi033.stdout:3164: done (0 left) 2021-07-26T16:08:21.209 INFO:tasks.rados.rados.0.smithi033.stdout:3165: delete oid 20 current snap is 322 2021-07-26T16:08:21.218 INFO:tasks.rados.rados.0.smithi033.stdout:3165: done (0 left) 2021-07-26T16:08:21.218 INFO:tasks.rados.rados.0.smithi033.stdout:3166: setattr oid 47 current snap is 322 2021-07-26T16:08:21.220 INFO:tasks.rados.rados.0.smithi033.stdout:3167: read oid 49 snap -1 2021-07-26T16:08:21.221 INFO:tasks.rados.rados.0.smithi033.stdout:3167: expect deleted 2021-07-26T16:08:21.221 INFO:tasks.rados.rados.0.smithi033.stdout:3168: copy_from oid 8 from oid 22 current snap is 322 2021-07-26T16:08:21.221 INFO:tasks.rados.rados.0.smithi033.stdout:3169: read oid 14 snap -1 2021-07-26T16:08:21.221 INFO:tasks.rados.rados.0.smithi033.stdout:3169: expect (ObjNum 829 snap 275 seq_num 829) 2021-07-26T16:08:21.222 INFO:tasks.rados.rados.0.smithi033.stdout:3170: read oid 29 snap -1 2021-07-26T16:08:21.222 INFO:tasks.rados.rados.0.smithi033.stdout:3170: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:08:21.223 INFO:tasks.rados.rados.0.smithi033.stdout:3171: snap_create 2021-07-26T16:08:21.237 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1535 (ObjNum 1432446049 snap 1901158258 seq_num 1651136354) dirty exists 2021-07-26T16:08:21.239 INFO:tasks.rados.rados.0.smithi033.stdout:3168: finishing copy_from to smithi03339061-8 2021-07-26T16:08:21.239 INFO:tasks.rados.rados.0.smithi033.stdout:3168: got expected ENOENT (src dne) 2021-07-26T16:08:21.240 INFO:tasks.rados.rados.0.smithi033.stdout:3168: finishing copy_from racing read to smithi03339061-8 2021-07-26T16:08:21.240 INFO:tasks.rados.rados.0.smithi033.stdout:3170: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:08:21.413 INFO:tasks.rados.rados.0.smithi033.stdout:3169: expect (ObjNum 829 snap 275 seq_num 829) 2021-07-26T16:08:21.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:21 smithi096 bash[33981]: cluster 2021-07-26T16:08:20.464047+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e681: 8 total, 8 up, 8 in 2021-07-26T16:08:21.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:21 smithi096 bash[33981]: cluster 2021-07-26T16:08:21.202764+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e682: 8 total, 8 up, 8 in 2021-07-26T16:08:21.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:21 smithi096 bash[33981]: audit 2021-07-26T16:08:21.390746+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:08:21.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:21 smithi096 bash[33981]: audit 2021-07-26T16:08:21.393553+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:08:21.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:21 smithi096 bash[33981]: audit 2021-07-26T16:08:21.395609+0000 mon.c (mon.1) 265 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:08:21.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:21 smithi033 bash[42377]: cluster 2021-07-26T16:08:20.464047+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e681: 8 total, 8 up, 8 in 2021-07-26T16:08:21.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:21 smithi033 bash[42377]: cluster 2021-07-26T16:08:21.202764+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e682: 8 total, 8 up, 8 in 2021-07-26T16:08:21.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:21 smithi033 bash[42377]: audit 2021-07-26T16:08:21.390746+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:08:21.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:21 smithi033 bash[42377]: audit 2021-07-26T16:08:21.393553+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:08:21.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:21 smithi033 bash[42377]: audit 2021-07-26T16:08:21.395609+0000 mon.c (mon.1) 265 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:08:21.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:21 smithi033 bash[41341]: cluster 2021-07-26T16:08:20.464047+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e681: 8 total, 8 up, 8 in 2021-07-26T16:08:21.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:21 smithi033 bash[41341]: cluster 2021-07-26T16:08:21.202764+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e682: 8 total, 8 up, 8 in 2021-07-26T16:08:21.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:21 smithi033 bash[41341]: audit 2021-07-26T16:08:21.390746+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:08:21.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:21 smithi033 bash[41341]: audit 2021-07-26T16:08:21.393553+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:08:21.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:21 smithi033 bash[41341]: audit 2021-07-26T16:08:21.395609+0000 mon.c (mon.1) 265 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:08:22.223 INFO:tasks.rados.rados.0.smithi033.stdout:3166: done (5 left) 2021-07-26T16:08:22.223 INFO:tasks.rados.rados.0.smithi033.stdout:3167: done (4 left) 2021-07-26T16:08:22.224 INFO:tasks.rados.rados.0.smithi033.stdout:3168: done (3 left) 2021-07-26T16:08:22.224 INFO:tasks.rados.rados.0.smithi033.stdout:3169: done (2 left) 2021-07-26T16:08:22.224 INFO:tasks.rados.rados.0.smithi033.stdout:3170: done (1 left) 2021-07-26T16:08:22.224 INFO:tasks.rados.rados.0.smithi033.stdout:3171: done (0 left) 2021-07-26T16:08:22.225 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 323 2021-07-26T16:08:22.225 INFO:tasks.rados.rados.0.smithi033.stdout:3172: seq_num 962 ranges {0=516096,516096=589824,1105920=614400} 2021-07-26T16:08:22.227 INFO:tasks.rados.rados.0.smithi033.stdout:3172: writing smithi03339061-1 from 0 to 516096 tid 1 2021-07-26T16:08:22.230 INFO:tasks.rados.rados.0.smithi033.stdout:3172: writing smithi03339061-1 from 516096 to 1105920 tid 2 2021-07-26T16:08:22.234 INFO:tasks.rados.rados.0.smithi033.stdout:3172: writing smithi03339061-1 from 1105920 to 1720320 tid 3 2021-07-26T16:08:22.234 INFO:tasks.rados.rados.0.smithi033.stdout:3173: snap_create 2021-07-26T16:08:22.235 INFO:tasks.rados.rados.0.smithi033.stdout:3172: finishing write tid 1 to smithi03339061-1 2021-07-26T16:08:22.238 INFO:tasks.rados.rados.0.smithi033.stdout:3172: finishing write tid 2 to smithi03339061-1 2021-07-26T16:08:22.239 INFO:tasks.rados.rados.0.smithi033.stdout:3172: finishing write tid 3 to smithi03339061-1 2021-07-26T16:08:22.240 INFO:tasks.rados.rados.0.smithi033.stdout:3172: finishing write tid 4 to smithi03339061-1 2021-07-26T16:08:22.243 INFO:tasks.rados.rados.0.smithi033.stdout:3172: finishing write tid 5 to smithi03339061-1 2021-07-26T16:08:22.243 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1074 (ObjNum 962 snap 323 seq_num 962) dirty exists 2021-07-26T16:08:22.243 INFO:tasks.rados.rados.0.smithi033.stdout:3172: left oid 1 (ObjNum 962 snap 323 seq_num 962) 2021-07-26T16:08:22.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:22 smithi033 bash[42377]: cluster 2021-07-26T16:08:21.168278+0000 mgr.y (mgr.34104) 432 : cluster [DBG] pgmap v844: 25 pgs: 25 active+clean; 722 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 8.4 MiB/s wr, 30 op/s 2021-07-26T16:08:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:22 smithi033 bash[42377]: audit 2021-07-26T16:08:21.657053+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:08:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:22 smithi033 bash[42377]: audit 2021-07-26T16:08:21.927988+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:08:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:22 smithi033 bash[42377]: cluster 2021-07-26T16:08:22.217702+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e683: 8 total, 8 up, 8 in 2021-07-26T16:08:22.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:22 smithi033 bash[41341]: cluster 2021-07-26T16:08:21.168278+0000 mgr.y (mgr.34104) 432 : cluster [DBG] pgmap v844: 25 pgs: 25 active+clean; 722 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 8.4 MiB/s wr, 30 op/s 2021-07-26T16:08:22.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:22 smithi033 bash[41341]: audit 2021-07-26T16:08:21.657053+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:08:22.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:22 smithi033 bash[41341]: audit 2021-07-26T16:08:21.927988+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:08:22.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:22 smithi033 bash[41341]: cluster 2021-07-26T16:08:22.217702+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e683: 8 total, 8 up, 8 in 2021-07-26T16:08:22.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:22 smithi096 bash[33981]: cluster 2021-07-26T16:08:21.168278+0000 mgr.y (mgr.34104) 432 : cluster [DBG] pgmap v844: 25 pgs: 25 active+clean; 722 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 6.5 MiB/s rd, 8.4 MiB/s wr, 30 op/s 2021-07-26T16:08:22.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:22 smithi096 bash[33981]: audit 2021-07-26T16:08:21.657053+0000 mon.a (mon.0) 1055 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:08:22.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:22 smithi096 bash[33981]: audit 2021-07-26T16:08:21.927988+0000 mon.a (mon.0) 1056 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:08:22.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:22 smithi096 bash[33981]: cluster 2021-07-26T16:08:22.217702+0000 mon.a (mon.0) 1057 : cluster [DBG] osdmap e683: 8 total, 8 up, 8 in 2021-07-26T16:08:23.227 INFO:tasks.rados.rados.0.smithi033.stdout:3172: done (1 left) 2021-07-26T16:08:23.227 INFO:tasks.rados.rados.0.smithi033.stdout:3173: done (0 left) 2021-07-26T16:08:23.228 INFO:tasks.rados.rados.0.smithi033.stdout:3174: copy_from oid 7 from oid 49 current snap is 324 2021-07-26T16:08:23.228 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 37 current snap is 324 2021-07-26T16:08:23.228 INFO:tasks.rados.rados.0.smithi033.stdout:3175: seq_num 963 ranges {0=532480,532480=475136,1007616=532480,1540096=196608} 2021-07-26T16:08:23.232 INFO:tasks.rados.rados.0.smithi033.stdout:3175: writing smithi03339061-37 from 0 to 532480 tid 1 2021-07-26T16:08:23.236 INFO:tasks.rados.rados.0.smithi033.stdout:3175: writing smithi03339061-37 from 532480 to 1007616 tid 2 2021-07-26T16:08:23.240 INFO:tasks.rados.rados.0.smithi033.stdout:3175: writing smithi03339061-37 from 1007616 to 1540096 tid 3 2021-07-26T16:08:23.242 INFO:tasks.rados.rados.0.smithi033.stdout:3175: writing smithi03339061-37 from 1540096 to 1736704 tid 4 2021-07-26T16:08:23.242 INFO:tasks.rados.rados.0.smithi033.stdout:3176: copy_from oid 5 from oid 6 current snap is 324 2021-07-26T16:08:23.243 INFO:tasks.rados.rados.0.smithi033.stdout:3174: finishing copy_from to smithi03339061-7 2021-07-26T16:08:23.243 INFO:tasks.rados.rados.0.smithi033.stdout:3174: got expected ENOENT (src dne) 2021-07-26T16:08:23.243 INFO:tasks.rados.rados.0.smithi033.stdout:3174: finishing copy_from racing read to smithi03339061-7 2021-07-26T16:08:23.243 INFO:tasks.rados.rados.0.smithi033.stdout:3175: finishing write tid 1 to smithi03339061-37 2021-07-26T16:08:23.244 INFO:tasks.rados.rados.0.smithi033.stdout:3174: done (2 left) 2021-07-26T16:08:23.244 INFO:tasks.rados.rados.0.smithi033.stdout:3177: rollback oid 46 current snap is 324 2021-07-26T16:08:23.244 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 46 to 237 2021-07-26T16:08:23.244 INFO:tasks.rados.rados.0.smithi033.stdout:3178: rollback oid 33 current snap is 324 2021-07-26T16:08:23.244 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 272 2021-07-26T16:08:23.245 INFO:tasks.rados.rados.0.smithi033.stdout:3179: copy_from oid 34 from oid 48 current snap is 324 2021-07-26T16:08:23.245 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 324 2021-07-26T16:08:23.245 INFO:tasks.rados.rados.0.smithi033.stdout:3180: seq_num 964 ranges {0=548864,548864=761856,1310720=442368} 2021-07-26T16:08:23.246 INFO:tasks.rados.rados.0.smithi033.stdout:3180: writing smithi03339061-26 from 0 to 548864 tid 1 2021-07-26T16:08:23.250 INFO:tasks.rados.rados.0.smithi033.stdout:3180: writing smithi03339061-26 from 548864 to 1310720 tid 2 2021-07-26T16:08:23.253 INFO:tasks.rados.rados.0.smithi033.stdout:3180: writing smithi03339061-26 from 1310720 to 1753088 tid 3 2021-07-26T16:08:23.254 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 324 2021-07-26T16:08:23.254 INFO:tasks.rados.rados.0.smithi033.stdout:3175: finishing write tid 2 to smithi03339061-37 2021-07-26T16:08:23.254 INFO:tasks.rados.rados.0.smithi033.stdout:3181: seq_num 965 ranges {3244032=565248,3809280=647168,4456448=548864,5005312=8192} 2021-07-26T16:08:23.275 INFO:tasks.rados.rados.0.smithi033.stdout:3181: writing smithi03339061-43 from 3244032 to 3809280 tid 1 2021-07-26T16:08:23.279 INFO:tasks.rados.rados.0.smithi033.stdout:3181: writing smithi03339061-43 from 3809280 to 4456448 tid 2 2021-07-26T16:08:23.283 INFO:tasks.rados.rados.0.smithi033.stdout:3181: writing smithi03339061-43 from 4456448 to 5005312 tid 3 2021-07-26T16:08:23.283 INFO:tasks.rados.rados.0.smithi033.stdout:3181: writing smithi03339061-43 from 5005312 to 5013504 tid 4 2021-07-26T16:08:23.284 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 44 current snap is 324 2021-07-26T16:08:23.284 INFO:tasks.rados.rados.0.smithi033.stdout:3175: finishing write tid 3 to smithi03339061-37 2021-07-26T16:08:23.284 INFO:tasks.rados.rados.0.smithi033.stdout:3182: seq_num 966 ranges {0=581632,581632=581632,1163264=622592} 2021-07-26T16:08:23.286 INFO:tasks.rados.rados.0.smithi033.stdout:3182: writing smithi03339061-44 from 0 to 581632 tid 1 2021-07-26T16:08:23.290 INFO:tasks.rados.rados.0.smithi033.stdout:3182: writing smithi03339061-44 from 581632 to 1163264 tid 2 2021-07-26T16:08:23.294 INFO:tasks.rados.rados.0.smithi033.stdout:3182: writing smithi03339061-44 from 1163264 to 1785856 tid 3 2021-07-26T16:08:23.294 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 324 2021-07-26T16:08:23.294 INFO:tasks.rados.rados.0.smithi033.stdout:3175: finishing write tid 4 to smithi03339061-37 2021-07-26T16:08:23.295 INFO:tasks.rados.rados.0.smithi033.stdout:3183: seq_num 967 ranges {0=598016,598016=466944,1064960=516096,1581056=221184} 2021-07-26T16:08:23.297 INFO:tasks.rados.rados.0.smithi033.stdout:3183: writing smithi03339061-2 from 0 to 598016 tid 1 2021-07-26T16:08:23.300 INFO:tasks.rados.rados.0.smithi033.stdout:3183: writing smithi03339061-2 from 598016 to 1064960 tid 2 2021-07-26T16:08:23.303 INFO:tasks.rados.rados.0.smithi033.stdout:3183: writing smithi03339061-2 from 1064960 to 1581056 tid 3 2021-07-26T16:08:23.305 INFO:tasks.rados.rados.0.smithi033.stdout:3183: writing smithi03339061-2 from 1581056 to 1802240 tid 4 2021-07-26T16:08:23.306 INFO:tasks.rados.rados.0.smithi033.stdout:3184: read oid 11 snap -1 2021-07-26T16:08:23.306 INFO:tasks.rados.rados.0.smithi033.stdout:3184: expect deleted 2021-07-26T16:08:23.306 INFO:tasks.rados.rados.0.smithi033.stdout:3185: copy_from oid 27 from oid 21 current snap is 324 2021-07-26T16:08:23.306 INFO:tasks.rados.rados.0.smithi033.stdout:3175: finishing write tid 5 to smithi03339061-37 2021-07-26T16:08:23.307 INFO:tasks.rados.rados.0.smithi033.stdout:3177: finishing rollback tid 0 to smithi03339061-46 2021-07-26T16:08:23.307 INFO:tasks.rados.rados.0.smithi033.stdout:3177: finishing rollback tid 1 to smithi03339061-46 2021-07-26T16:08:23.307 INFO:tasks.rados.rados.0.smithi033.stdout:3177: finishing rollback tid 2 to smithi03339061-46 2021-07-26T16:08:23.307 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1300 (ObjNum 685 snap 226 seq_num 685) dirty exists 2021-07-26T16:08:23.308 INFO:tasks.rados.rados.0.smithi033.stdout:3178: finishing rollback tid 0 to smithi03339061-33 2021-07-26T16:08:23.308 INFO:tasks.rados.rados.0.smithi033.stdout:3177: done (10 left) 2021-07-26T16:08:23.308 INFO:tasks.rados.rados.0.smithi033.stdout:3186: snap_remove snap 299 2021-07-26T16:08:24.233 INFO:tasks.rados.rados.0.smithi033.stdout:3186: done (10 left) 2021-07-26T16:08:24.234 INFO:tasks.rados.rados.0.smithi033.stdout:3187: copy_from oid 24 from oid 38 current snap is 324 2021-07-26T16:08:24.234 INFO:tasks.rados.rados.0.smithi033.stdout:3175: finishing write tid 6 to smithi03339061-37 2021-07-26T16:08:24.234 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 1542 (ObjNum 963 snap 324 seq_num 963) dirty exists 2021-07-26T16:08:24.235 INFO:tasks.rados.rados.0.smithi033.stdout:3175: left oid 37 (ObjNum 963 snap 324 seq_num 963) 2021-07-26T16:08:24.235 INFO:tasks.rados.rados.0.smithi033.stdout:3178: finishing rollback tid 1 to smithi03339061-33 2021-07-26T16:08:24.235 INFO:tasks.rados.rados.0.smithi033.stdout:3178: finishing rollback tid 2 to smithi03339061-33 2021-07-26T16:08:24.235 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 1859 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:08:24.236 INFO:tasks.rados.rados.0.smithi033.stdout:3180: finishing write tid 1 to smithi03339061-26 2021-07-26T16:08:24.236 INFO:tasks.rados.rados.0.smithi033.stdout:3180: finishing write tid 2 to smithi03339061-26 2021-07-26T16:08:24.236 INFO:tasks.rados.rados.0.smithi033.stdout:3180: finishing write tid 3 to smithi03339061-26 2021-07-26T16:08:24.236 INFO:tasks.rados.rados.0.smithi033.stdout:3180: finishing write tid 4 to smithi03339061-26 2021-07-26T16:08:24.236 INFO:tasks.rados.rados.0.smithi033.stdout:3180: finishing write tid 5 to smithi03339061-26 2021-07-26T16:08:24.237 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 1863 (ObjNum 964 snap 324 seq_num 964) dirty exists 2021-07-26T16:08:24.237 INFO:tasks.rados.rados.0.smithi033.stdout:3180: left oid 26 (ObjNum 964 snap 324 seq_num 964) 2021-07-26T16:08:24.237 INFO:tasks.rados.rados.0.smithi033.stdout:3176: finishing copy_from to smithi03339061-5 2021-07-26T16:08:24.237 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 1820 (ObjNum 891 snap 292 seq_num 891) dirty exists 2021-07-26T16:08:24.238 INFO:tasks.rados.rados.0.smithi033.stdout:3176: finishing copy_from racing read to smithi03339061-5 2021-07-26T16:08:24.238 INFO:tasks.rados.rados.0.smithi033.stdout:3179: finishing copy_from to smithi03339061-34 2021-07-26T16:08:24.238 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1279 (ObjNum 904 snap 302 seq_num 904) dirty exists 2021-07-26T16:08:24.238 INFO:tasks.rados.rados.0.smithi033.stdout:3181: finishing write tid 1 to smithi03339061-43 2021-07-26T16:08:24.238 INFO:tasks.rados.rados.0.smithi033.stdout:3181: finishing write tid 2 to smithi03339061-43 2021-07-26T16:08:24.239 INFO:tasks.rados.rados.0.smithi033.stdout:3181: finishing write tid 3 to smithi03339061-43 2021-07-26T16:08:24.239 INFO:tasks.rados.rados.0.smithi033.stdout:3179: finishing copy_from racing read to smithi03339061-34 2021-07-26T16:08:24.239 INFO:tasks.rados.rados.0.smithi033.stdout:3181: finishing write tid 4 to smithi03339061-43 2021-07-26T16:08:24.239 INFO:tasks.rados.rados.0.smithi033.stdout:3181: finishing write tid 5 to smithi03339061-43 2021-07-26T16:08:24.239 INFO:tasks.rados.rados.0.smithi033.stdout:3182: finishing write tid 1 to smithi03339061-44 2021-07-26T16:08:24.240 INFO:tasks.rados.rados.0.smithi033.stdout:3182: finishing write tid 2 to smithi03339061-44 2021-07-26T16:08:24.240 INFO:tasks.rados.rados.0.smithi033.stdout:3181: finishing write tid 6 to smithi03339061-43 2021-07-26T16:08:24.240 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 1825 (ObjNum 965 snap 324 seq_num 965) dirty exists 2021-07-26T16:08:24.240 INFO:tasks.rados.rados.0.smithi033.stdout:3181: left oid 43 (ObjNum 965 snap 324 seq_num 965) 2021-07-26T16:08:24.241 INFO:tasks.rados.rados.0.smithi033.stdout:3182: finishing write tid 3 to smithi03339061-44 2021-07-26T16:08:24.241 INFO:tasks.rados.rados.0.smithi033.stdout:3182: finishing write tid 4 to smithi03339061-44 2021-07-26T16:08:24.241 INFO:tasks.rados.rados.0.smithi033.stdout:3183: finishing write tid 1 to smithi03339061-2 2021-07-26T16:08:24.241 INFO:tasks.rados.rados.0.smithi033.stdout:3182: finishing write tid 5 to smithi03339061-44 2021-07-26T16:08:24.241 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1421 (ObjNum 966 snap 324 seq_num 966) dirty exists 2021-07-26T16:08:24.242 INFO:tasks.rados.rados.0.smithi033.stdout:3182: left oid 44 (ObjNum 966 snap 324 seq_num 966) 2021-07-26T16:08:24.242 INFO:tasks.rados.rados.0.smithi033.stdout:3183: finishing write tid 2 to smithi03339061-2 2021-07-26T16:08:24.242 INFO:tasks.rados.rados.0.smithi033.stdout:3183: finishing write tid 3 to smithi03339061-2 2021-07-26T16:08:24.242 INFO:tasks.rados.rados.0.smithi033.stdout:3183: finishing write tid 4 to smithi03339061-2 2021-07-26T16:08:24.242 INFO:tasks.rados.rados.0.smithi033.stdout:3183: finishing write tid 5 to smithi03339061-2 2021-07-26T16:08:24.243 INFO:tasks.rados.rados.0.smithi033.stdout:3183: finishing write tid 6 to smithi03339061-2 2021-07-26T16:08:24.243 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1423 (ObjNum 967 snap 324 seq_num 967) dirty exists 2021-07-26T16:08:24.243 INFO:tasks.rados.rados.0.smithi033.stdout:3183: left oid 2 (ObjNum 967 snap 324 seq_num 967) 2021-07-26T16:08:24.243 INFO:tasks.rados.rados.0.smithi033.stdout:3185: finishing copy_from to smithi03339061-27 2021-07-26T16:08:24.244 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1482 (ObjNum 951 snap 321 seq_num 951) dirty exists 2021-07-26T16:08:24.244 INFO:tasks.rados.rados.0.smithi033.stdout:3185: finishing copy_from racing read to smithi03339061-27 2021-07-26T16:08:24.244 INFO:tasks.rados.rados.0.smithi033.stdout:3175: done (10 left) 2021-07-26T16:08:24.244 INFO:tasks.rados.rados.0.smithi033.stdout:3176: done (9 left) 2021-07-26T16:08:24.244 INFO:tasks.rados.rados.0.smithi033.stdout:3178: done (8 left) 2021-07-26T16:08:24.245 INFO:tasks.rados.rados.0.smithi033.stdout:3179: done (7 left) 2021-07-26T16:08:24.245 INFO:tasks.rados.rados.0.smithi033.stdout:3180: done (6 left) 2021-07-26T16:08:24.245 INFO:tasks.rados.rados.0.smithi033.stdout:3181: done (5 left) 2021-07-26T16:08:24.245 INFO:tasks.rados.rados.0.smithi033.stdout:3182: done (4 left) 2021-07-26T16:08:24.246 INFO:tasks.rados.rados.0.smithi033.stdout:3183: done (3 left) 2021-07-26T16:08:24.246 INFO:tasks.rados.rados.0.smithi033.stdout:3184: done (2 left) 2021-07-26T16:08:24.246 INFO:tasks.rados.rados.0.smithi033.stdout:3185: done (1 left) 2021-07-26T16:08:24.246 INFO:tasks.rados.rados.0.smithi033.stdout:3188: rollback oid 35 current snap is 324 2021-07-26T16:08:24.247 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 271 2021-07-26T16:08:24.247 INFO:tasks.rados.rados.0.smithi033.stdout:3189: copy_from oid 11 from oid 42 current snap is 324 2021-07-26T16:08:24.247 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 324 2021-07-26T16:08:24.249 INFO:tasks.rados.rados.0.smithi033.stdout:3190: seq_num 968 ranges {5652480=614400,6266880=745472,7012352=458752} 2021-07-26T16:08:24.271 INFO:tasks.rados.rados.0.smithi033.stdout:3190: writing smithi03339061-14 from 5652480 to 6266880 tid 1 2021-07-26T16:08:24.276 INFO:tasks.rados.rados.0.smithi033.stdout:3190: writing smithi03339061-14 from 6266880 to 7012352 tid 2 2021-07-26T16:08:24.280 INFO:tasks.rados.rados.0.smithi033.stdout:3190: writing smithi03339061-14 from 7012352 to 7471104 tid 3 2021-07-26T16:08:24.280 INFO:tasks.rados.rados.0.smithi033.stdout:3191: copy_from oid 32 from oid 5 current snap is 324 2021-07-26T16:08:24.280 INFO:tasks.rados.rados.0.smithi033.stdout:3189: finishing copy_from to smithi03339061-11 2021-07-26T16:08:24.280 INFO:tasks.rados.rados.0.smithi033.stdout:3189: got expected ENOENT (src dne) 2021-07-26T16:08:24.281 INFO:tasks.rados.rados.0.smithi033.stdout:3189: finishing copy_from racing read to smithi03339061-11 2021-07-26T16:08:24.281 INFO:tasks.rados.rados.0.smithi033.stdout:3187: finishing copy_from to smithi03339061-24 2021-07-26T16:08:24.281 INFO:tasks.rados.rados.0.smithi033.stdout:3187: got expected ENOENT (src dne) 2021-07-26T16:08:24.281 INFO:tasks.rados.rados.0.smithi033.stdout:3187: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:08:24.282 INFO:tasks.rados.rados.0.smithi033.stdout:3188: finishing rollback tid 0 to smithi03339061-35 2021-07-26T16:08:24.282 INFO:tasks.rados.rados.0.smithi033.stdout:3188: finishing rollback tid 1 to smithi03339061-35 2021-07-26T16:08:24.282 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1765 (ObjNum 1953066355 snap 858810728 seq_num 809055027) dirty dne 2021-07-26T16:08:24.282 INFO:tasks.rados.rados.0.smithi033.stdout:3190: finishing write tid 1 to smithi03339061-14 2021-07-26T16:08:24.283 INFO:tasks.rados.rados.0.smithi033.stdout:3187: done (4 left) 2021-07-26T16:08:24.283 INFO:tasks.rados.rados.0.smithi033.stdout:3188: done (3 left) 2021-07-26T16:08:24.283 INFO:tasks.rados.rados.0.smithi033.stdout:3189: done (2 left) 2021-07-26T16:08:24.283 INFO:tasks.rados.rados.0.smithi033.stdout:3192: snap_remove snap 241 2021-07-26T16:08:24.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:24 smithi033 bash[42377]: cluster 2021-07-26T16:08:23.169129+0000 mgr.y (mgr.34104) 433 : cluster [DBG] pgmap v847: 25 pgs: 25 active+clean; 719 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 25 op/s 2021-07-26T16:08:24.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:24 smithi033 bash[42377]: cluster 2021-07-26T16:08:23.222458+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e684: 8 total, 8 up, 8 in 2021-07-26T16:08:24.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:24 smithi033 bash[41341]: cluster 2021-07-26T16:08:23.169129+0000 mgr.y (mgr.34104) 433 : cluster [DBG] pgmap v847: 25 pgs: 25 active+clean; 719 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 25 op/s 2021-07-26T16:08:24.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:24 smithi033 bash[41341]: cluster 2021-07-26T16:08:23.222458+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e684: 8 total, 8 up, 8 in 2021-07-26T16:08:24.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:24 smithi096 bash[33981]: cluster 2021-07-26T16:08:23.169129+0000 mgr.y (mgr.34104) 433 : cluster [DBG] pgmap v847: 25 pgs: 25 active+clean; 719 MiB data, 2.6 GiB used, 713 GiB / 715 GiB avail; 3.3 MiB/s rd, 7.6 MiB/s wr, 25 op/s 2021-07-26T16:08:24.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:24 smithi096 bash[33981]: cluster 2021-07-26T16:08:23.222458+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e684: 8 total, 8 up, 8 in 2021-07-26T16:08:25.261 INFO:tasks.rados.rados.0.smithi033.stdout:3192: done (2 left) 2021-07-26T16:08:25.261 INFO:tasks.rados.rados.0.smithi033.stdout:3193: snap_create 2021-07-26T16:08:25.261 INFO:tasks.rados.rados.0.smithi033.stdout:3190: finishing write tid 2 to smithi03339061-14 2021-07-26T16:08:25.261 INFO:tasks.rados.rados.0.smithi033.stdout:3190: finishing write tid 3 to smithi03339061-14 2021-07-26T16:08:25.262 INFO:tasks.rados.rados.0.smithi033.stdout:3190: finishing write tid 4 to smithi03339061-14 2021-07-26T16:08:25.262 INFO:tasks.rados.rados.0.smithi033.stdout:3190: finishing write tid 5 to smithi03339061-14 2021-07-26T16:08:25.262 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1433 (ObjNum 968 snap 324 seq_num 968) dirty exists 2021-07-26T16:08:25.262 INFO:tasks.rados.rados.0.smithi033.stdout:3190: left oid 14 (ObjNum 968 snap 324 seq_num 968) 2021-07-26T16:08:25.263 INFO:tasks.rados.rados.0.smithi033.stdout:3191: finishing copy_from to smithi03339061-32 2021-07-26T16:08:25.263 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1820 (ObjNum 891 snap 292 seq_num 891) dirty exists 2021-07-26T16:08:25.263 INFO:tasks.rados.rados.0.smithi033.stdout:3191: finishing copy_from racing read to smithi03339061-32 2021-07-26T16:08:25.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:25 smithi033 bash[42377]: cluster 2021-07-26T16:08:24.225120+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e685: 8 total, 8 up, 8 in 2021-07-26T16:08:25.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:25 smithi033 bash[41341]: cluster 2021-07-26T16:08:24.225120+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e685: 8 total, 8 up, 8 in 2021-07-26T16:08:25.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:25 smithi096 bash[33981]: cluster 2021-07-26T16:08:24.225120+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e685: 8 total, 8 up, 8 in 2021-07-26T16:08:26.208 INFO:tasks.rados.rados.0.smithi033.stdout:3190: done (2 left) 2021-07-26T16:08:26.208 INFO:tasks.rados.rados.0.smithi033.stdout:3191: done (1 left) 2021-07-26T16:08:26.209 INFO:tasks.rados.rados.0.smithi033.stdout:3193: done (0 left) 2021-07-26T16:08:26.209 INFO:tasks.rados.rados.0.smithi033.stdout:3194: rollback oid 42 current snap is 325 2021-07-26T16:08:26.209 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 42 to 278 2021-07-26T16:08:26.209 INFO:tasks.rados.rados.0.smithi033.stdout:3195: read oid 27 snap -1 2021-07-26T16:08:26.210 INFO:tasks.rados.rados.0.smithi033.stdout:3195: expect (ObjNum 951 snap 321 seq_num 951) 2021-07-26T16:08:26.210 INFO:tasks.rados.rados.0.smithi033.stdout:3196: read oid 29 snap -1 2021-07-26T16:08:26.210 INFO:tasks.rados.rados.0.smithi033.stdout:3196: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:08:26.210 INFO:tasks.rados.rados.0.smithi033.stdout:3197: snap_remove snap 243 2021-07-26T16:08:26.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:26 smithi033 bash[42377]: cluster 2021-07-26T16:08:25.169887+0000 mgr.y (mgr.34104) 434 : cluster [DBG] pgmap v850: 25 pgs: 25 active+clean; 734 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.2 MiB/s rd, 3.3 MiB/s wr, 14 op/s 2021-07-26T16:08:26.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:26 smithi033 bash[42377]: cluster 2021-07-26T16:08:25.254634+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e686: 8 total, 8 up, 8 in 2021-07-26T16:08:26.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:26 smithi033 bash[42377]: cluster 2021-07-26T16:08:26.204091+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e687: 8 total, 8 up, 8 in 2021-07-26T16:08:26.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:26 smithi033 bash[41341]: cluster 2021-07-26T16:08:25.169887+0000 mgr.y (mgr.34104) 434 : cluster [DBG] pgmap v850: 25 pgs: 25 active+clean; 734 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.2 MiB/s rd, 3.3 MiB/s wr, 14 op/s 2021-07-26T16:08:26.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:26 smithi033 bash[41341]: cluster 2021-07-26T16:08:25.254634+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e686: 8 total, 8 up, 8 in 2021-07-26T16:08:26.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:26 smithi033 bash[41341]: cluster 2021-07-26T16:08:26.204091+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e687: 8 total, 8 up, 8 in 2021-07-26T16:08:26.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:26 smithi096 bash[33981]: cluster 2021-07-26T16:08:25.169887+0000 mgr.y (mgr.34104) 434 : cluster [DBG] pgmap v850: 25 pgs: 25 active+clean; 734 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 5.2 MiB/s rd, 3.3 MiB/s wr, 14 op/s 2021-07-26T16:08:26.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:26 smithi096 bash[33981]: cluster 2021-07-26T16:08:25.254634+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e686: 8 total, 8 up, 8 in 2021-07-26T16:08:26.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:26 smithi096 bash[33981]: cluster 2021-07-26T16:08:26.204091+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e687: 8 total, 8 up, 8 in 2021-07-26T16:08:27.220 INFO:tasks.rados.rados.0.smithi033.stdout:3197: done (3 left) 2021-07-26T16:08:27.221 INFO:tasks.rados.rados.0.smithi033.stdout:3198: read oid 9 snap 321 2021-07-26T16:08:27.221 INFO:tasks.rados.rados.0.smithi033.stdout:3198: expect (ObjNum 829 snap 275 seq_num 829) 2021-07-26T16:08:27.221 INFO:tasks.rados.rados.0.smithi033.stdout:3199: copy_from oid 8 from oid 25 current snap is 325 2021-07-26T16:08:27.222 INFO:tasks.rados.rados.0.smithi033.stdout:3194: finishing rollback tid 1 to smithi03339061-42 2021-07-26T16:08:27.222 INFO:tasks.rados.rados.0.smithi033.stdout:3200: read oid 48 snap -1 2021-07-26T16:08:27.222 INFO:tasks.rados.rados.0.smithi033.stdout:3200: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:08:27.222 INFO:tasks.rados.rados.0.smithi033.stdout:3201: snap_remove snap 282 2021-07-26T16:08:28.237 INFO:tasks.rados.rados.0.smithi033.stdout:3194: finishing rollback tid 2 to smithi03339061-42 2021-07-26T16:08:28.237 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1729 (ObjNum 1416785002 snap 1314808676 seq_num 1516135259) dirty exists 2021-07-26T16:08:28.237 INFO:tasks.rados.rados.0.smithi033.stdout:3196: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:08:28.410 INFO:tasks.rados.rados.0.smithi033.stdout:3195: expect (ObjNum 951 snap 321 seq_num 951) 2021-07-26T16:08:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:28 smithi096 bash[33981]: cluster 2021-07-26T16:08:27.170624+0000 mgr.y (mgr.34104) 435 : cluster [DBG] pgmap v853: 25 pgs: 25 active+clean; 740 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 4.7 MiB/s wr, 14 op/s 2021-07-26T16:08:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:28 smithi096 bash[33981]: cluster 2021-07-26T16:08:27.215458+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e688: 8 total, 8 up, 8 in 2021-07-26T16:08:28.621 INFO:tasks.rados.rados.0.smithi033.stdout:3198: expect (ObjNum 829 snap 275 seq_num 829) 2021-07-26T16:08:28.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:28 smithi033 bash[41341]: cluster 2021-07-26T16:08:27.170624+0000 mgr.y (mgr.34104) 435 : cluster [DBG] pgmap v853: 25 pgs: 25 active+clean; 740 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 4.7 MiB/s wr, 14 op/s 2021-07-26T16:08:28.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:28 smithi033 bash[41341]: cluster 2021-07-26T16:08:27.215458+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e688: 8 total, 8 up, 8 in 2021-07-26T16:08:28.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:28 smithi033 bash[42377]: cluster 2021-07-26T16:08:27.170624+0000 mgr.y (mgr.34104) 435 : cluster [DBG] pgmap v853: 25 pgs: 25 active+clean; 740 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.8 MiB/s rd, 4.7 MiB/s wr, 14 op/s 2021-07-26T16:08:28.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:28 smithi033 bash[42377]: cluster 2021-07-26T16:08:27.215458+0000 mon.a (mon.0) 1062 : cluster [DBG] osdmap e688: 8 total, 8 up, 8 in 2021-07-26T16:08:28.860 INFO:tasks.rados.rados.0.smithi033.stdout:3199: finishing copy_from to smithi03339061-8 2021-07-26T16:08:28.860 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1335 (ObjNum 920 snap 308 seq_num 920) dirty exists 2021-07-26T16:08:28.861 INFO:tasks.rados.rados.0.smithi033.stdout:3199: finishing copy_from racing read to smithi03339061-8 2021-07-26T16:08:28.861 INFO:tasks.rados.rados.0.smithi033.stdout:3200: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:08:29.394 INFO:tasks.rados.rados.0.smithi033.stdout:3194: done (6 left) 2021-07-26T16:08:29.394 INFO:tasks.rados.rados.0.smithi033.stdout:3195: done (5 left) 2021-07-26T16:08:29.395 INFO:tasks.rados.rados.0.smithi033.stdout:3196: done (4 left) 2021-07-26T16:08:29.395 INFO:tasks.rados.rados.0.smithi033.stdout:3198: done (3 left) 2021-07-26T16:08:29.395 INFO:tasks.rados.rados.0.smithi033.stdout:3199: done (2 left) 2021-07-26T16:08:29.395 INFO:tasks.rados.rados.0.smithi033.stdout:3200: done (1 left) 2021-07-26T16:08:29.395 INFO:tasks.rados.rados.0.smithi033.stdout:3201: done (0 left) 2021-07-26T16:08:29.396 INFO:tasks.rados.rados.0.smithi033.stdout:3202: rollback oid 33 current snap is 325 2021-07-26T16:08:29.396 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 300 2021-07-26T16:08:29.396 INFO:tasks.rados.rados.0.smithi033.stdout:3203: rollback oid 21 current snap is 325 2021-07-26T16:08:29.396 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 21 to 323 2021-07-26T16:08:29.397 INFO:tasks.rados.rados.0.smithi033.stdout:3204: copy_from oid 3 from oid 8 current snap is 325 2021-07-26T16:08:29.397 INFO:tasks.rados.rados.0.smithi033.stdout:3205: setattr oid 26 current snap is 325 2021-07-26T16:08:29.402 INFO:tasks.rados.rados.0.smithi033.stdout:3203: finishing rollback tid 0 to smithi03339061-21 2021-07-26T16:08:29.402 INFO:tasks.rados.rados.0.smithi033.stdout:3203: finishing rollback tid 1 to smithi03339061-21 2021-07-26T16:08:29.403 INFO:tasks.rados.rados.0.smithi033.stdout:3203: finishing rollback tid 2 to smithi03339061-21 2021-07-26T16:08:29.403 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1552 (ObjNum 951 snap 321 seq_num 951) dirty exists 2021-07-26T16:08:29.404 INFO:tasks.rados.rados.0.smithi033.stdout:3203: done (3 left) 2021-07-26T16:08:29.404 INFO:tasks.rados.rados.0.smithi033.stdout:3206: rollback oid 27 current snap is 325 2021-07-26T16:08:29.404 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 27 to 271 2021-07-26T16:08:29.404 INFO:tasks.rados.rados.0.smithi033.stdout:3207: read oid 15 snap -1 2021-07-26T16:08:29.404 INFO:tasks.rados.rados.0.smithi033.stdout:3207: expect (ObjNum 953 snap 321 seq_num 953) 2021-07-26T16:08:29.405 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 325 2021-07-26T16:08:29.405 INFO:tasks.rados.rados.0.smithi033.stdout:3208: seq_num 969 ranges {0=638976,638976=630784,1269760=532480,1802240=40960} 2021-07-26T16:08:29.410 INFO:tasks.rados.rados.0.smithi033.stdout:3208: writing smithi03339061-49 from 0 to 638976 tid 1 2021-07-26T16:08:29.414 INFO:tasks.rados.rados.0.smithi033.stdout:3208: writing smithi03339061-49 from 638976 to 1269760 tid 2 2021-07-26T16:08:29.417 INFO:tasks.rados.rados.0.smithi033.stdout:3208: writing smithi03339061-49 from 1269760 to 1802240 tid 3 2021-07-26T16:08:29.418 INFO:tasks.rados.rados.0.smithi033.stdout:3208: writing smithi03339061-49 from 1802240 to 1843200 tid 4 2021-07-26T16:08:29.418 INFO:tasks.rados.rados.0.smithi033.stdout:3209: read oid 48 snap -1 2021-07-26T16:08:29.419 INFO:tasks.rados.rados.0.smithi033.stdout:3209: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:08:29.419 INFO:tasks.rados.rados.0.smithi033.stdout:3210: snap_remove snap 324 2021-07-26T16:08:29.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:29 smithi033 bash[41341]: cluster 2021-07-26T16:08:28.223535+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e689: 8 total, 8 up, 8 in 2021-07-26T16:08:29.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:29 smithi033 bash[42377]: cluster 2021-07-26T16:08:28.223535+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e689: 8 total, 8 up, 8 in 2021-07-26T16:08:29.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:29 smithi096 bash[33981]: cluster 2021-07-26T16:08:28.223535+0000 mon.a (mon.0) 1063 : cluster [DBG] osdmap e689: 8 total, 8 up, 8 in 2021-07-26T16:08:30.245 INFO:tasks.rados.rados.0.smithi033.stdout:3210: done (7 left) 2021-07-26T16:08:30.245 INFO:tasks.rados.rados.0.smithi033.stdout:3211: copy_from oid 24 from oid 43 current snap is 325 2021-07-26T16:08:30.246 INFO:tasks.rados.rados.0.smithi033.stdout:3202: finishing rollback tid 0 to smithi03339061-33 2021-07-26T16:08:30.246 INFO:tasks.rados.rados.0.smithi033.stdout:3202: finishing rollback tid 1 to smithi03339061-33 2021-07-26T16:08:30.246 INFO:tasks.rados.rados.0.smithi033.stdout:3206: finishing rollback tid 0 to smithi03339061-27 2021-07-26T16:08:30.246 INFO:tasks.rados.rados.0.smithi033.stdout:3206: finishing rollback tid 1 to smithi03339061-27 2021-07-26T16:08:30.247 INFO:tasks.rados.rados.0.smithi033.stdout:3206: finishing rollback tid 2 to smithi03339061-27 2021-07-26T16:08:30.247 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1556 (ObjNum 806 snap 268 seq_num 806) dirty exists 2021-07-26T16:08:30.247 INFO:tasks.rados.rados.0.smithi033.stdout:3204: finishing copy_from to smithi03339061-3 2021-07-26T16:08:30.247 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1335 (ObjNum 920 snap 308 seq_num 920) dirty exists 2021-07-26T16:08:30.248 INFO:tasks.rados.rados.0.smithi033.stdout:3204: finishing copy_from racing read to smithi03339061-3 2021-07-26T16:08:30.248 INFO:tasks.rados.rados.0.smithi033.stdout:3202: finishing rollback tid 2 to smithi03339061-33 2021-07-26T16:08:30.248 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 1907 (ObjNum 775 snap 256 seq_num 775) dirty exists 2021-07-26T16:08:30.248 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 1909 (ObjNum 964 snap 324 seq_num 964) dirty exists 2021-07-26T16:08:30.248 INFO:tasks.rados.rados.0.smithi033.stdout:3207: expect (ObjNum 953 snap 321 seq_num 953) 2021-07-26T16:08:30.293 INFO:tasks.rados.rados.0.smithi033.stdout:3208: finishing write tid 1 to smithi03339061-49 2021-07-26T16:08:30.293 INFO:tasks.rados.rados.0.smithi033.stdout:3208: finishing write tid 2 to smithi03339061-49 2021-07-26T16:08:30.294 INFO:tasks.rados.rados.0.smithi033.stdout:3202: done (7 left) 2021-07-26T16:08:30.294 INFO:tasks.rados.rados.0.smithi033.stdout:3204: done (6 left) 2021-07-26T16:08:30.294 INFO:tasks.rados.rados.0.smithi033.stdout:3205: done (5 left) 2021-07-26T16:08:30.294 INFO:tasks.rados.rados.0.smithi033.stdout:3206: done (4 left) 2021-07-26T16:08:30.294 INFO:tasks.rados.rados.0.smithi033.stdout:3207: done (3 left) 2021-07-26T16:08:30.295 INFO:tasks.rados.rados.0.smithi033.stdout:3212: setattr oid 7 current snap is 325 2021-07-26T16:08:30.295 INFO:tasks.rados.rados.0.smithi033.stdout:3208: finishing write tid 3 to smithi03339061-49 2021-07-26T16:08:30.295 INFO:tasks.rados.rados.0.smithi033.stdout:3208: finishing write tid 4 to smithi03339061-49 2021-07-26T16:08:30.295 INFO:tasks.rados.rados.0.smithi033.stdout:3208: finishing write tid 5 to smithi03339061-49 2021-07-26T16:08:30.296 INFO:tasks.rados.rados.0.smithi033.stdout:3208: finishing write tid 6 to smithi03339061-49 2021-07-26T16:08:30.296 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 933 (ObjNum 969 snap 325 seq_num 969) dirty exists 2021-07-26T16:08:30.296 INFO:tasks.rados.rados.0.smithi033.stdout:3208: left oid 49 (ObjNum 969 snap 325 seq_num 969) 2021-07-26T16:08:30.296 INFO:tasks.rados.rados.0.smithi033.stdout:3209: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:08:30.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:30 smithi033 bash[41341]: cluster 2021-07-26T16:08:29.171240+0000 mgr.y (mgr.34104) 436 : cluster [DBG] pgmap v856: 25 pgs: 25 active+clean; 748 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.3 MiB/s rd, 3.3 MiB/s wr, 11 op/s 2021-07-26T16:08:30.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:30 smithi033 bash[42377]: cluster 2021-07-26T16:08:29.171240+0000 mgr.y (mgr.34104) 436 : cluster [DBG] pgmap v856: 25 pgs: 25 active+clean; 748 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.3 MiB/s rd, 3.3 MiB/s wr, 11 op/s 2021-07-26T16:08:30.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:30 smithi096 bash[33981]: cluster 2021-07-26T16:08:29.171240+0000 mgr.y (mgr.34104) 436 : cluster [DBG] pgmap v856: 25 pgs: 25 active+clean; 748 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 7.3 MiB/s rd, 3.3 MiB/s wr, 11 op/s 2021-07-26T16:08:30.832 INFO:tasks.rados.rados.0.smithi033.stdout:3211: finishing copy_from to smithi03339061-24 2021-07-26T16:08:30.833 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1825 (ObjNum 965 snap 324 seq_num 965) dirty exists 2021-07-26T16:08:30.833 INFO:tasks.rados.rados.0.smithi033.stdout:3211: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:08:30.833 INFO:tasks.rados.rados.0.smithi033.stdout:3208: done (3 left) 2021-07-26T16:08:30.833 INFO:tasks.rados.rados.0.smithi033.stdout:3209: done (2 left) 2021-07-26T16:08:30.834 INFO:tasks.rados.rados.0.smithi033.stdout:3211: done (1 left) 2021-07-26T16:08:30.834 INFO:tasks.rados.rados.0.smithi033.stdout:3213: read oid 31 snap 320 2021-07-26T16:08:30.834 INFO:tasks.rados.rados.0.smithi033.stdout:3213: expect (ObjNum 887 snap 291 seq_num 887) 2021-07-26T16:08:30.834 INFO:tasks.rados.rados.0.smithi033.stdout:3214: snap_remove snap 285 2021-07-26T16:08:31.217 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1561 (ObjNum 1516333152 snap 1884772455 seq_num 1700221275) dirty exists 2021-07-26T16:08:31.217 INFO:tasks.rados.rados.0.smithi033.stdout:3213: expect (ObjNum 887 snap 291 seq_num 887) 2021-07-26T16:08:31.341 INFO:tasks.rados.rados.0.smithi033.stdout:3212: done (2 left) 2021-07-26T16:08:31.342 INFO:tasks.rados.rados.0.smithi033.stdout:3213: done (1 left) 2021-07-26T16:08:31.342 INFO:tasks.rados.rados.0.smithi033.stdout:3214: done (0 left) 2021-07-26T16:08:31.342 INFO:tasks.rados.rados.0.smithi033.stdout:3215: read oid 13 snap 313 2021-07-26T16:08:31.342 INFO:tasks.rados.rados.0.smithi033.stdout:3215: expect (ObjNum 930 snap 312 seq_num 930) 2021-07-26T16:08:31.343 INFO:tasks.rados.rados.0.smithi033.stdout:3216: delete oid 12 current snap is 325 2021-07-26T16:08:31.349 INFO:tasks.rados.rados.0.smithi033.stdout:3216: done (1 left) 2021-07-26T16:08:31.349 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 325 2021-07-26T16:08:31.350 INFO:tasks.rados.rados.0.smithi033.stdout:3217: seq_num 971 ranges {0=671744,671744=802816,1474560=401408} 2021-07-26T16:08:31.356 INFO:tasks.rados.rados.0.smithi033.stdout:3217: writing smithi03339061-38 from 0 to 671744 tid 1 2021-07-26T16:08:31.364 INFO:tasks.rados.rados.0.smithi033.stdout:3217: writing smithi03339061-38 from 671744 to 1474560 tid 2 2021-07-26T16:08:31.367 INFO:tasks.rados.rados.0.smithi033.stdout:3217: writing smithi03339061-38 from 1474560 to 1875968 tid 3 2021-07-26T16:08:31.367 INFO:tasks.rados.rados.0.smithi033.stdout:3218: rollback oid 22 current snap is 325 2021-07-26T16:08:31.368 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 22 to 313 2021-07-26T16:08:31.368 INFO:tasks.rados.rados.0.smithi033.stdout:3217: finishing write tid 1 to smithi03339061-38 2021-07-26T16:08:31.368 INFO:tasks.rados.rados.0.smithi033.stdout:3219: read oid 40 snap -1 2021-07-26T16:08:31.368 INFO:tasks.rados.rados.0.smithi033.stdout:3219: expect deleted 2021-07-26T16:08:31.369 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 325 2021-07-26T16:08:31.369 INFO:tasks.rados.rados.0.smithi033.stdout:3220: seq_num 972 ranges {5799936=688128,6488064=688128,7176192=516096} 2021-07-26T16:08:31.405 INFO:tasks.rados.rados.0.smithi033.stdout:3220: writing smithi03339061-33 from 5799936 to 6488064 tid 1 2021-07-26T16:08:31.410 INFO:tasks.rados.rados.0.smithi033.stdout:3220: writing smithi03339061-33 from 6488064 to 7176192 tid 2 2021-07-26T16:08:31.414 INFO:tasks.rados.rados.0.smithi033.stdout:3220: writing smithi03339061-33 from 7176192 to 7692288 tid 3 2021-07-26T16:08:31.414 INFO:tasks.rados.rados.0.smithi033.stdout:3221: rollback oid 11 current snap is 325 2021-07-26T16:08:31.415 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 11 to 300 2021-07-26T16:08:31.415 INFO:tasks.rados.rados.0.smithi033.stdout:3218: finishing rollback tid 1 to smithi03339061-22 2021-07-26T16:08:31.415 INFO:tasks.rados.rados.0.smithi033.stdout:3218: finishing rollback tid 2 to smithi03339061-22 2021-07-26T16:08:31.415 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1923 (ObjNum 908 snap 304 seq_num 908) dirty exists 2021-07-26T16:08:31.416 INFO:tasks.rados.rados.0.smithi033.stdout:3217: finishing write tid 2 to smithi03339061-38 2021-07-26T16:08:31.416 INFO:tasks.rados.rados.0.smithi033.stdout:3217: finishing write tid 3 to smithi03339061-38 2021-07-26T16:08:31.416 INFO:tasks.rados.rados.0.smithi033.stdout:3217: finishing write tid 4 to smithi03339061-38 2021-07-26T16:08:31.416 INFO:tasks.rados.rados.0.smithi033.stdout:3217: finishing write tid 5 to smithi03339061-38 2021-07-26T16:08:31.416 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 733 (ObjNum 971 snap 325 seq_num 971) dirty exists 2021-07-26T16:08:31.417 INFO:tasks.rados.rados.0.smithi033.stdout:3217: left oid 38 (ObjNum 971 snap 325 seq_num 971) 2021-07-26T16:08:31.417 INFO:tasks.rados.rados.0.smithi033.stdout:3220: finishing write tid 1 to smithi03339061-33 2021-07-26T16:08:31.417 INFO:tasks.rados.rados.0.smithi033.stdout:3217: done (5 left) 2021-07-26T16:08:31.417 INFO:tasks.rados.rados.0.smithi033.stdout:3218: done (4 left) 2021-07-26T16:08:31.418 INFO:tasks.rados.rados.0.smithi033.stdout:3219: done (3 left) 2021-07-26T16:08:31.418 INFO:tasks.rados.rados.0.smithi033.stdout:3222: copy_from oid 29 from oid 25 current snap is 325 2021-07-26T16:08:31.418 INFO:tasks.rados.rados.0.smithi033.stdout:3223: read oid 31 snap -1 2021-07-26T16:08:31.418 INFO:tasks.rados.rados.0.smithi033.stdout:3223: expect (ObjNum 887 snap 291 seq_num 887) 2021-07-26T16:08:31.418 INFO:tasks.rados.rados.0.smithi033.stdout:3224: copy_from oid 48 from oid 47 current snap is 325 2021-07-26T16:08:31.419 INFO:tasks.rados.rados.0.smithi033.stdout:3225: snap_remove snap 280 2021-07-26T16:08:31.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:31 smithi033 bash[42377]: cluster 2021-07-26T16:08:30.238756+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e690: 8 total, 8 up, 8 in 2021-07-26T16:08:31.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:31 smithi033 bash[42377]: cluster 2021-07-26T16:08:31.206916+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e691: 8 total, 8 up, 8 in 2021-07-26T16:08:31.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:31 smithi033 bash[41341]: cluster 2021-07-26T16:08:30.238756+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e690: 8 total, 8 up, 8 in 2021-07-26T16:08:31.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:31 smithi033 bash[41341]: cluster 2021-07-26T16:08:31.206916+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e691: 8 total, 8 up, 8 in 2021-07-26T16:08:31.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:31 smithi096 bash[33981]: cluster 2021-07-26T16:08:30.238756+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e690: 8 total, 8 up, 8 in 2021-07-26T16:08:31.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:31 smithi096 bash[33981]: cluster 2021-07-26T16:08:31.206916+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e691: 8 total, 8 up, 8 in 2021-07-26T16:08:32.269 INFO:tasks.rados.rados.0.smithi033.stdout:3215: expect (ObjNum 930 snap 312 seq_num 930) 2021-07-26T16:08:32.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:32 smithi033 bash[41341]: cluster 2021-07-26T16:08:31.171993+0000 mgr.y (mgr.34104) 437 : cluster [DBG] pgmap v858: 25 pgs: 25 active+clean; 740 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2021-07-26T16:08:32.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:32 smithi033 bash[42377]: cluster 2021-07-26T16:08:31.171993+0000 mgr.y (mgr.34104) 437 : cluster [DBG] pgmap v858: 25 pgs: 25 active+clean; 740 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2021-07-26T16:08:32.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:32 smithi096 bash[33981]: cluster 2021-07-26T16:08:31.171993+0000 mgr.y (mgr.34104) 437 : cluster [DBG] pgmap v858: 25 pgs: 25 active+clean; 740 MiB data, 2.7 GiB used, 713 GiB / 715 GiB avail; 13 MiB/s rd, 2.5 MiB/s wr, 10 op/s 2021-07-26T16:08:33.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:33 smithi033 bash[42377]: cluster 2021-07-26T16:08:32.261781+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e692: 8 total, 8 up, 8 in 2021-07-26T16:08:33.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:33 smithi033 bash[41341]: cluster 2021-07-26T16:08:32.261781+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e692: 8 total, 8 up, 8 in 2021-07-26T16:08:33.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:33 smithi096 bash[33981]: cluster 2021-07-26T16:08:32.261781+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e692: 8 total, 8 up, 8 in 2021-07-26T16:08:34.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:34 smithi033 bash[42377]: cluster 2021-07-26T16:08:33.172638+0000 mgr.y (mgr.34104) 438 : cluster [DBG] pgmap v861: 25 pgs: 25 active+clean; 752 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2021-07-26T16:08:34.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:34 smithi033 bash[41341]: cluster 2021-07-26T16:08:33.172638+0000 mgr.y (mgr.34104) 438 : cluster [DBG] pgmap v861: 25 pgs: 25 active+clean; 752 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2021-07-26T16:08:34.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:34 smithi096 bash[33981]: cluster 2021-07-26T16:08:33.172638+0000 mgr.y (mgr.34104) 438 : cluster [DBG] pgmap v861: 25 pgs: 25 active+clean; 752 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2021-07-26T16:08:35.147 INFO:tasks.rados.rados.0.smithi033.stdout:3220: finishing write tid 2 to smithi03339061-33 2021-07-26T16:08:35.148 INFO:tasks.rados.rados.0.smithi033.stdout:3220: finishing write tid 3 to smithi03339061-33 2021-07-26T16:08:35.148 INFO:tasks.rados.rados.0.smithi033.stdout:3220: finishing write tid 4 to smithi03339061-33 2021-07-26T16:08:35.148 INFO:tasks.rados.rados.0.smithi033.stdout:3220: finishing write tid 5 to smithi03339061-33 2021-07-26T16:08:35.148 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 1927 (ObjNum 972 snap 325 seq_num 972) dirty exists 2021-07-26T16:08:35.149 INFO:tasks.rados.rados.0.smithi033.stdout:3220: left oid 33 (ObjNum 972 snap 325 seq_num 972) 2021-07-26T16:08:35.149 INFO:tasks.rados.rados.0.smithi033.stdout:3224: finishing copy_from to smithi03339061-48 2021-07-26T16:08:35.149 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 1535 (ObjNum 1 snap 32561 seq_num 2008531688) dirty exists 2021-07-26T16:08:35.149 INFO:tasks.rados.rados.0.smithi033.stdout:3221: finishing rollback tid 1 to smithi03339061-11 2021-07-26T16:08:35.150 INFO:tasks.rados.rados.0.smithi033.stdout:3215: done (6 left) 2021-07-26T16:08:35.150 INFO:tasks.rados.rados.0.smithi033.stdout:3220: done (5 left) 2021-07-26T16:08:35.150 INFO:tasks.rados.rados.0.smithi033.stdout:3225: done (4 left) 2021-07-26T16:08:35.150 INFO:tasks.rados.rados.0.smithi033.stdout:3226: rollback oid 8 current snap is 325 2021-07-26T16:08:35.151 INFO:tasks.rados.rados.0.smithi033.stdout:3221: finishing rollback tid 2 to smithi03339061-11 2021-07-26T16:08:35.151 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1428 (ObjNum 695 snap 229 seq_num 695) dirty exists 2021-07-26T16:08:35.151 INFO:tasks.rados.rados.0.smithi033.stdout:3224: finishing copy_from racing read to smithi03339061-48 2021-07-26T16:08:35.151 INFO:tasks.rados.rados.0.smithi033.stdout:3223: expect (ObjNum 887 snap 291 seq_num 887) 2021-07-26T16:08:35.264 INFO:tasks.rados.rados.0.smithi033.stdout:3222: finishing copy_from to smithi03339061-29 2021-07-26T16:08:35.264 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1335 (ObjNum 920 snap 308 seq_num 920) dirty exists 2021-07-26T16:08:35.265 INFO:tasks.rados.rados.0.smithi033.stdout:3222: finishing copy_from racing read to smithi03339061-29 2021-07-26T16:08:35.265 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 8 to 302 2021-07-26T16:08:35.265 INFO:tasks.rados.rados.0.smithi033.stdout:3221: done (4 left) 2021-07-26T16:08:35.266 INFO:tasks.rados.rados.0.smithi033.stdout:3222: done (3 left) 2021-07-26T16:08:35.266 INFO:tasks.rados.rados.0.smithi033.stdout:3223: done (2 left) 2021-07-26T16:08:35.266 INFO:tasks.rados.rados.0.smithi033.stdout:3224: done (1 left) 2021-07-26T16:08:35.266 INFO:tasks.rados.rados.0.smithi033.stdout:3227: copy_from oid 25 from oid 12 current snap is 325 2021-07-26T16:08:35.267 INFO:tasks.rados.rados.0.smithi033.stdout:3228: snap_remove snap 309 2021-07-26T16:08:35.303 INFO:tasks.rados.rados.0.smithi033.stdout:3228: done (2 left) 2021-07-26T16:08:35.303 INFO:tasks.rados.rados.0.smithi033.stdout:3229: rmattr oid 27 current snap is 325 2021-07-26T16:08:35.303 INFO:tasks.rados.rados.0.smithi033.stdout:3227: finishing copy_from to smithi03339061-25 2021-07-26T16:08:35.304 INFO:tasks.rados.rados.0.smithi033.stdout:3227: got expected ENOENT (src dne) 2021-07-26T16:08:35.304 INFO:tasks.rados.rados.0.smithi033.stdout:3227: finishing copy_from racing read to smithi03339061-25 2021-07-26T16:08:35.304 INFO:tasks.rados.rados.0.smithi033.stdout:3226: finishing rollback tid 0 to smithi03339061-8 2021-07-26T16:08:35.304 INFO:tasks.rados.rados.0.smithi033.stdout:3226: finishing rollback tid 1 to smithi03339061-8 2021-07-26T16:08:35.305 INFO:tasks.rados.rados.0.smithi033.stdout:3226: finishing rollback tid 2 to smithi03339061-8 2021-07-26T16:08:35.305 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1768 (ObjNum 896 snap 295 seq_num 896) dirty exists 2021-07-26T16:08:35.305 INFO:tasks.rados.rados.0.smithi033.stdout:3226: done (2 left) 2021-07-26T16:08:35.305 INFO:tasks.rados.rados.0.smithi033.stdout:3227: done (1 left) 2021-07-26T16:08:35.305 INFO:tasks.rados.rados.0.smithi033.stdout:3230: read oid 25 snap -1 2021-07-26T16:08:35.306 INFO:tasks.rados.rados.0.smithi033.stdout:3230: expect (ObjNum 920 snap 308 seq_num 920) 2021-07-26T16:08:35.306 INFO:tasks.rados.rados.0.smithi033.stdout:3231: read oid 8 snap -1 2021-07-26T16:08:35.306 INFO:tasks.rados.rados.0.smithi033.stdout:3231: expect (ObjNum 896 snap 295 seq_num 896) 2021-07-26T16:08:35.306 INFO:tasks.rados.rados.0.smithi033.stdout:3232: snap_create 2021-07-26T16:08:35.314 INFO:tasks.rados.rados.0.smithi033.stdout:3230: expect (ObjNum 920 snap 308 seq_num 920) 2021-07-26T16:08:35.350 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 27 v 1584 (ObjNum 806 snap 268 seq_num 806) dirty exists 2021-07-26T16:08:35.350 INFO:tasks.rados.rados.0.smithi033.stdout:3231: expect (ObjNum 896 snap 295 seq_num 896) 2021-07-26T16:08:36.213 INFO:tasks.rados.rados.0.smithi033.stdout:3229: done (3 left) 2021-07-26T16:08:36.213 INFO:tasks.rados.rados.0.smithi033.stdout:3230: done (2 left) 2021-07-26T16:08:36.214 INFO:tasks.rados.rados.0.smithi033.stdout:3231: done (1 left) 2021-07-26T16:08:36.214 INFO:tasks.rados.rados.0.smithi033.stdout:3232: done (0 left) 2021-07-26T16:08:36.214 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 326 2021-07-26T16:08:36.214 INFO:tasks.rados.rados.0.smithi033.stdout:3233: seq_num 973 ranges {811008=704512,1515520=573440,2088960=507904,2596864=122880} 2021-07-26T16:08:36.222 INFO:tasks.rados.rados.0.smithi033.stdout:3233: writing smithi03339061-22 from 811008 to 1515520 tid 1 2021-07-26T16:08:36.225 INFO:tasks.rados.rados.0.smithi033.stdout:3233: writing smithi03339061-22 from 1515520 to 2088960 tid 2 2021-07-26T16:08:36.229 INFO:tasks.rados.rados.0.smithi033.stdout:3233: writing smithi03339061-22 from 2088960 to 2596864 tid 3 2021-07-26T16:08:36.232 INFO:tasks.rados.rados.0.smithi033.stdout:3233: writing smithi03339061-22 from 2596864 to 2719744 tid 4 2021-07-26T16:08:36.232 INFO:tasks.rados.rados.0.smithi033.stdout:3234: rollback oid 33 current snap is 326 2021-07-26T16:08:36.232 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 306 2021-07-26T16:08:36.232 INFO:tasks.rados.rados.0.smithi033.stdout:3233: finishing write tid 1 to smithi03339061-22 2021-07-26T16:08:36.233 INFO:tasks.rados.rados.0.smithi033.stdout:3235: read oid 16 snap 248 2021-07-26T16:08:36.233 INFO:tasks.rados.rados.0.smithi033.stdout:3235: expect (ObjNum 622 snap 194 seq_num 622) 2021-07-26T16:08:36.233 INFO:tasks.rados.rados.0.smithi033.stdout:3236: read oid 9 snap -1 2021-07-26T16:08:36.233 INFO:tasks.rados.rados.0.smithi033.stdout:3236: expect (ObjNum 829 snap 275 seq_num 829) 2021-07-26T16:08:36.234 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 326 2021-07-26T16:08:36.234 INFO:tasks.rados.rados.0.smithi033.stdout:3237: seq_num 974 ranges {5013504=720896,5734400=507904,6242304=671744,6914048=24576} 2021-07-26T16:08:36.264 INFO:tasks.rados.rados.0.smithi033.stdout:3237: writing smithi03339061-24 from 5013504 to 5734400 tid 1 2021-07-26T16:08:36.267 INFO:tasks.rados.rados.0.smithi033.stdout:3237: writing smithi03339061-24 from 5734400 to 6242304 tid 2 2021-07-26T16:08:36.272 INFO:tasks.rados.rados.0.smithi033.stdout:3237: writing smithi03339061-24 from 6242304 to 6914048 tid 3 2021-07-26T16:08:36.272 INFO:tasks.rados.rados.0.smithi033.stdout:3237: writing smithi03339061-24 from 6914048 to 6938624 tid 4 2021-07-26T16:08:36.272 INFO:tasks.rados.rados.0.smithi033.stdout:3238: rollback oid 26 current snap is 326 2021-07-26T16:08:36.273 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 26 to 320 2021-07-26T16:08:36.273 INFO:tasks.rados.rados.0.smithi033.stdout:3233: finishing write tid 2 to smithi03339061-22 2021-07-26T16:08:36.273 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 326 2021-07-26T16:08:36.273 INFO:tasks.rados.rados.0.smithi033.stdout:3233: finishing write tid 3 to smithi03339061-22 2021-07-26T16:08:36.274 INFO:tasks.rados.rados.0.smithi033.stdout:3233: finishing write tid 4 to smithi03339061-22 2021-07-26T16:08:36.274 INFO:tasks.rados.rados.0.smithi033.stdout:3233: finishing write tid 5 to smithi03339061-22 2021-07-26T16:08:36.274 INFO:tasks.rados.rados.0.smithi033.stdout:3234: finishing rollback tid 0 to smithi03339061-33 2021-07-26T16:08:36.275 INFO:tasks.rados.rados.0.smithi033.stdout:3239: seq_num 975 ranges {0=737280,737280=786432,1523712=417792} 2021-07-26T16:08:36.276 INFO:tasks.rados.rados.0.smithi033.stdout:3239: writing smithi03339061-42 from 0 to 737280 tid 1 2021-07-26T16:08:36.282 INFO:tasks.rados.rados.0.smithi033.stdout:3239: writing smithi03339061-42 from 737280 to 1523712 tid 2 2021-07-26T16:08:36.285 INFO:tasks.rados.rados.0.smithi033.stdout:3239: writing smithi03339061-42 from 1523712 to 1941504 tid 3 2021-07-26T16:08:36.285 INFO:tasks.rados.rados.0.smithi033.stdout:3240: copy_from oid 25 from oid 39 current snap is 326 2021-07-26T16:08:36.286 INFO:tasks.rados.rados.0.smithi033.stdout:3233: finishing write tid 6 to smithi03339061-22 2021-07-26T16:08:36.286 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1949 (ObjNum 973 snap 326 seq_num 973) dirty exists 2021-07-26T16:08:36.286 INFO:tasks.rados.rados.0.smithi033.stdout:3233: left oid 22 (ObjNum 973 snap 326 seq_num 973) 2021-07-26T16:08:36.286 INFO:tasks.rados.rados.0.smithi033.stdout:3234: finishing rollback tid 1 to smithi03339061-33 2021-07-26T16:08:36.287 INFO:tasks.rados.rados.0.smithi033.stdout:3234: finishing rollback tid 2 to smithi03339061-33 2021-07-26T16:08:36.287 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 1953 (ObjNum 775 snap 256 seq_num 775) dirty exists 2021-07-26T16:08:36.287 INFO:tasks.rados.rados.0.smithi033.stdout:3236: expect (ObjNum 829 snap 275 seq_num 829) 2021-07-26T16:08:36.530 INFO:tasks.rados.rados.0.smithi033.stdout:3235: expect (ObjNum 622 snap 194 seq_num 622) 2021-07-26T16:08:36.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:36 smithi033 bash[42377]: cluster 2021-07-26T16:08:35.173375+0000 mgr.y (mgr.34104) 439 : cluster [DBG] pgmap v862: 25 pgs: 25 active+clean; 765 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2021-07-26T16:08:36.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:36 smithi033 bash[42377]: cluster 2021-07-26T16:08:35.294393+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e693: 8 total, 8 up, 8 in 2021-07-26T16:08:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:36 smithi033 bash[42377]: cluster 2021-07-26T16:08:36.207856+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e694: 8 total, 8 up, 8 in 2021-07-26T16:08:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:36 smithi033 bash[41341]: cluster 2021-07-26T16:08:35.173375+0000 mgr.y (mgr.34104) 439 : cluster [DBG] pgmap v862: 25 pgs: 25 active+clean; 765 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2021-07-26T16:08:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:36 smithi033 bash[41341]: cluster 2021-07-26T16:08:35.294393+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e693: 8 total, 8 up, 8 in 2021-07-26T16:08:36.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:36 smithi033 bash[41341]: cluster 2021-07-26T16:08:36.207856+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e694: 8 total, 8 up, 8 in 2021-07-26T16:08:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:36 smithi096 bash[33981]: cluster 2021-07-26T16:08:35.173375+0000 mgr.y (mgr.34104) 439 : cluster [DBG] pgmap v862: 25 pgs: 25 active+clean; 765 MiB data, 2.7 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 2.2 MiB/s wr, 17 op/s 2021-07-26T16:08:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:36 smithi096 bash[33981]: cluster 2021-07-26T16:08:35.294393+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e693: 8 total, 8 up, 8 in 2021-07-26T16:08:36.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:36 smithi096 bash[33981]: cluster 2021-07-26T16:08:36.207856+0000 mon.a (mon.0) 1068 : cluster [DBG] osdmap e694: 8 total, 8 up, 8 in 2021-07-26T16:08:37.611 INFO:tasks.rados.rados.0.smithi033.stdout:3237: finishing write tid 1 to smithi03339061-24 2021-07-26T16:08:37.611 INFO:tasks.rados.rados.0.smithi033.stdout:3237: finishing write tid 2 to smithi03339061-24 2021-07-26T16:08:37.611 INFO:tasks.rados.rados.0.smithi033.stdout:3238: finishing rollback tid 0 to smithi03339061-26 2021-07-26T16:08:37.612 INFO:tasks.rados.rados.0.smithi033.stdout:3237: finishing write tid 3 to smithi03339061-24 2021-07-26T16:08:37.612 INFO:tasks.rados.rados.0.smithi033.stdout:3238: finishing rollback tid 1 to smithi03339061-26 2021-07-26T16:08:37.612 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 1956 (ObjNum 1431267177 snap 1349736551 seq_num 1331712618) dirty dne 2021-07-26T16:08:37.612 INFO:tasks.rados.rados.0.smithi033.stdout:3239: finishing write tid 1 to smithi03339061-42 2021-07-26T16:08:37.612 INFO:tasks.rados.rados.0.smithi033.stdout:3237: finishing write tid 4 to smithi03339061-24 2021-07-26T16:08:37.613 INFO:tasks.rados.rados.0.smithi033.stdout:3237: finishing write tid 5 to smithi03339061-24 2021-07-26T16:08:37.613 INFO:tasks.rados.rados.0.smithi033.stdout:3237: finishing write tid 6 to smithi03339061-24 2021-07-26T16:08:37.613 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1830 (ObjNum 974 snap 326 seq_num 974) dirty exists 2021-07-26T16:08:37.613 INFO:tasks.rados.rados.0.smithi033.stdout:3237: left oid 24 (ObjNum 974 snap 326 seq_num 974) 2021-07-26T16:08:37.614 INFO:tasks.rados.rados.0.smithi033.stdout:3239: finishing write tid 2 to smithi03339061-42 2021-07-26T16:08:37.614 INFO:tasks.rados.rados.0.smithi033.stdout:3239: finishing write tid 3 to smithi03339061-42 2021-07-26T16:08:37.614 INFO:tasks.rados.rados.0.smithi033.stdout:3239: finishing write tid 4 to smithi03339061-42 2021-07-26T16:08:37.614 INFO:tasks.rados.rados.0.smithi033.stdout:3239: finishing write tid 5 to smithi03339061-42 2021-07-26T16:08:37.615 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1733 (ObjNum 975 snap 326 seq_num 975) dirty exists 2021-07-26T16:08:37.615 INFO:tasks.rados.rados.0.smithi033.stdout:3239: left oid 42 (ObjNum 975 snap 326 seq_num 975) 2021-07-26T16:08:37.615 INFO:tasks.rados.rados.0.smithi033.stdout:3240: finishing copy_from to smithi03339061-25 2021-07-26T16:08:37.615 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 1473 (ObjNum 833 snap 277 seq_num 833) dirty exists 2021-07-26T16:08:37.616 INFO:tasks.rados.rados.0.smithi033.stdout:3240: finishing copy_from racing read to smithi03339061-25 2021-07-26T16:08:37.616 INFO:tasks.rados.rados.0.smithi033.stdout:3233: done (7 left) 2021-07-26T16:08:37.616 INFO:tasks.rados.rados.0.smithi033.stdout:3234: done (6 left) 2021-07-26T16:08:37.616 INFO:tasks.rados.rados.0.smithi033.stdout:3235: done (5 left) 2021-07-26T16:08:37.616 INFO:tasks.rados.rados.0.smithi033.stdout:3236: done (4 left) 2021-07-26T16:08:37.617 INFO:tasks.rados.rados.0.smithi033.stdout:3237: done (3 left) 2021-07-26T16:08:37.617 INFO:tasks.rados.rados.0.smithi033.stdout:3238: done (2 left) 2021-07-26T16:08:37.617 INFO:tasks.rados.rados.0.smithi033.stdout:3239: done (1 left) 2021-07-26T16:08:37.617 INFO:tasks.rados.rados.0.smithi033.stdout:3240: done (0 left) 2021-07-26T16:08:37.618 INFO:tasks.rados.rados.0.smithi033.stdout:3241: read oid 28 snap -1 2021-07-26T16:08:37.618 INFO:tasks.rados.rados.0.smithi033.stdout:3241: expect deleted 2021-07-26T16:08:37.618 INFO:tasks.rados.rados.0.smithi033.stdout:3242: read oid 46 snap -1 2021-07-26T16:08:37.618 INFO:tasks.rados.rados.0.smithi033.stdout:3242: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:08:37.618 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 326 2021-07-26T16:08:37.619 INFO:tasks.rados.rados.0.smithi033.stdout:3243: seq_num 976 ranges {1966080=753664,2719744=671744,3391488=532480} 2021-07-26T16:08:37.632 INFO:tasks.rados.rados.0.smithi033.stdout:3243: writing smithi03339061-39 from 1966080 to 2719744 tid 1 2021-07-26T16:08:37.636 INFO:tasks.rados.rados.0.smithi033.stdout:3243: writing smithi03339061-39 from 2719744 to 3391488 tid 2 2021-07-26T16:08:37.639 INFO:tasks.rados.rados.0.smithi033.stdout:3243: writing smithi03339061-39 from 3391488 to 3923968 tid 3 2021-07-26T16:08:37.639 INFO:tasks.rados.rados.0.smithi033.stdout:3244: snap_remove snap 235 2021-07-26T16:08:38.313 INFO:tasks.rados.rados.0.smithi033.stdout:3244: done (3 left) 2021-07-26T16:08:38.313 INFO:tasks.rados.rados.0.smithi033.stdout:3245: snap_remove snap 250 2021-07-26T16:08:38.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:38 smithi033 bash[41341]: cluster 2021-07-26T16:08:37.174127+0000 mgr.y (mgr.34104) 440 : cluster [DBG] pgmap v865: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 771 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2021-07-26T16:08:38.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:38 smithi033 bash[42377]: cluster 2021-07-26T16:08:37.174127+0000 mgr.y (mgr.34104) 440 : cluster [DBG] pgmap v865: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 771 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2021-07-26T16:08:38.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:38 smithi096 bash[33981]: cluster 2021-07-26T16:08:37.174127+0000 mgr.y (mgr.34104) 440 : cluster [DBG] pgmap v865: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 771 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 2.4 MiB/s wr, 17 op/s 2021-07-26T16:08:39.325 INFO:tasks.rados.rados.0.smithi033.stdout:3245: done (3 left) 2021-07-26T16:08:39.326 INFO:tasks.rados.rados.0.smithi033.stdout:3246: copy_from oid 32 from oid 26 current snap is 326 2021-07-26T16:08:39.326 INFO:tasks.rados.rados.0.smithi033.stdout:3242: expect (ObjNum 685 snap 226 seq_num 685) 2021-07-26T16:08:39.388 INFO:tasks.rados.rados.0.smithi033.stdout:3243: finishing write tid 1 to smithi03339061-39 2021-07-26T16:08:39.388 INFO:tasks.rados.rados.0.smithi033.stdout:3243: finishing write tid 2 to smithi03339061-39 2021-07-26T16:08:39.389 INFO:tasks.rados.rados.0.smithi033.stdout:3243: finishing write tid 3 to smithi03339061-39 2021-07-26T16:08:39.389 INFO:tasks.rados.rados.0.smithi033.stdout:3243: finishing write tid 4 to smithi03339061-39 2021-07-26T16:08:39.389 INFO:tasks.rados.rados.0.smithi033.stdout:3241: done (3 left) 2021-07-26T16:08:39.389 INFO:tasks.rados.rados.0.smithi033.stdout:3242: done (2 left) 2021-07-26T16:08:39.389 INFO:tasks.rados.rados.0.smithi033.stdout:3247: copy_from oid 46 from oid 50 current snap is 326 2021-07-26T16:08:39.390 INFO:tasks.rados.rados.0.smithi033.stdout:3243: finishing write tid 5 to smithi03339061-39 2021-07-26T16:08:39.390 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1593 (ObjNum 976 snap 326 seq_num 976) dirty exists 2021-07-26T16:08:39.390 INFO:tasks.rados.rados.0.smithi033.stdout:3243: left oid 39 (ObjNum 976 snap 326 seq_num 976) 2021-07-26T16:08:39.390 INFO:tasks.rados.rados.0.smithi033.stdout:3246: finishing copy_from to smithi03339061-32 2021-07-26T16:08:39.391 INFO:tasks.rados.rados.0.smithi033.stdout:3246: got expected ENOENT (src dne) 2021-07-26T16:08:39.391 INFO:tasks.rados.rados.0.smithi033.stdout:3246: finishing copy_from racing read to smithi03339061-32 2021-07-26T16:08:39.391 INFO:tasks.rados.rados.0.smithi033.stdout:3243: done (2 left) 2021-07-26T16:08:39.391 INFO:tasks.rados.rados.0.smithi033.stdout:3246: done (1 left) 2021-07-26T16:08:39.391 INFO:tasks.rados.rados.0.smithi033.stdout:3248: setattr oid 49 current snap is 326 2021-07-26T16:08:39.392 INFO:tasks.rados.rados.0.smithi033.stdout:3249: delete oid 29 current snap is 326 2021-07-26T16:08:39.394 INFO:tasks.rados.rados.0.smithi033.stdout:3249: done (2 left) 2021-07-26T16:08:39.394 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 326 2021-07-26T16:08:39.394 INFO:tasks.rados.rados.0.smithi033.stdout:3250: seq_num 978 ranges {532480=786432,1318912=442368,1761280=647168,2408448=114688} 2021-07-26T16:08:39.407 INFO:tasks.rados.rados.0.smithi033.stdout:3250: writing smithi03339061-5 from 532480 to 1318912 tid 1 2021-07-26T16:08:39.410 INFO:tasks.rados.rados.0.smithi033.stdout:3250: writing smithi03339061-5 from 1318912 to 1761280 tid 2 2021-07-26T16:08:39.413 INFO:tasks.rados.rados.0.smithi033.stdout:3250: writing smithi03339061-5 from 1761280 to 2408448 tid 3 2021-07-26T16:08:39.414 INFO:tasks.rados.rados.0.smithi033.stdout:3250: writing smithi03339061-5 from 2408448 to 2523136 tid 4 2021-07-26T16:08:39.415 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 326 2021-07-26T16:08:39.415 INFO:tasks.rados.rados.0.smithi033.stdout:3251: seq_num 979 ranges {6938624=802816,7741440=729088,8470528=458752,8929280=16384} 2021-07-26T16:08:39.458 INFO:tasks.rados.rados.0.smithi033.stdout:3251: writing smithi03339061-24 from 6938624 to 7741440 tid 1 2021-07-26T16:08:39.462 INFO:tasks.rados.rados.0.smithi033.stdout:3251: writing smithi03339061-24 from 7741440 to 8470528 tid 2 2021-07-26T16:08:39.465 INFO:tasks.rados.rados.0.smithi033.stdout:3251: writing smithi03339061-24 from 8470528 to 8929280 tid 3 2021-07-26T16:08:39.465 INFO:tasks.rados.rados.0.smithi033.stdout:3251: writing smithi03339061-24 from 8929280 to 8945664 tid 4 2021-07-26T16:08:39.465 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 326 2021-07-26T16:08:39.466 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 934 (ObjNum 969 snap 325 seq_num 969) dirty exists 2021-07-26T16:08:39.466 INFO:tasks.rados.rados.0.smithi033.stdout:3252: seq_num 980 ranges {1802240=417792,2220032=614400,2834432=663552,3497984=327680} 2021-07-26T16:08:39.477 INFO:tasks.rados.rados.0.smithi033.stdout:3252: writing smithi03339061-2 from 1802240 to 2220032 tid 1 2021-07-26T16:08:39.481 INFO:tasks.rados.rados.0.smithi033.stdout:3252: writing smithi03339061-2 from 2220032 to 2834432 tid 2 2021-07-26T16:08:39.485 INFO:tasks.rados.rados.0.smithi033.stdout:3252: writing smithi03339061-2 from 2834432 to 3497984 tid 3 2021-07-26T16:08:39.487 INFO:tasks.rados.rados.0.smithi033.stdout:3252: writing smithi03339061-2 from 3497984 to 3825664 tid 4 2021-07-26T16:08:39.487 INFO:tasks.rados.rados.0.smithi033.stdout:3248: done (4 left) 2021-07-26T16:08:39.488 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 326 2021-07-26T16:08:39.488 INFO:tasks.rados.rados.0.smithi033.stdout:3247: finishing copy_from to smithi03339061-46 2021-07-26T16:08:39.488 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1338 (ObjNum 926 snap 309 seq_num 926) dirty exists 2021-07-26T16:08:39.488 INFO:tasks.rados.rados.0.smithi033.stdout:3253: seq_num 981 ranges {0=434176,434176=540672,974848=466944,1441792=524288,1966080=73728} 2021-07-26T16:08:39.489 INFO:tasks.rados.rados.0.smithi033.stdout:3253: writing smithi03339061-12 from 0 to 434176 tid 1 2021-07-26T16:08:39.492 INFO:tasks.rados.rados.0.smithi033.stdout:3253: writing smithi03339061-12 from 434176 to 974848 tid 2 2021-07-26T16:08:39.495 INFO:tasks.rados.rados.0.smithi033.stdout:3253: writing smithi03339061-12 from 974848 to 1441792 tid 3 2021-07-26T16:08:39.498 INFO:tasks.rados.rados.0.smithi033.stdout:3253: writing smithi03339061-12 from 1441792 to 1966080 tid 4 2021-07-26T16:08:39.500 INFO:tasks.rados.rados.0.smithi033.stdout:3253: writing smithi03339061-12 from 1966080 to 2039808 tid 5 2021-07-26T16:08:39.500 INFO:tasks.rados.rados.0.smithi033.stdout:3254: snap_create 2021-07-26T16:08:39.500 INFO:tasks.rados.rados.0.smithi033.stdout:3247: finishing copy_from racing read to smithi03339061-46 2021-07-26T16:08:39.500 INFO:tasks.rados.rados.0.smithi033.stdout:3250: finishing write tid 1 to smithi03339061-5 2021-07-26T16:08:39.501 INFO:tasks.rados.rados.0.smithi033.stdout:3250: finishing write tid 2 to smithi03339061-5 2021-07-26T16:08:39.501 INFO:tasks.rados.rados.0.smithi033.stdout:3250: finishing write tid 3 to smithi03339061-5 2021-07-26T16:08:39.501 INFO:tasks.rados.rados.0.smithi033.stdout:3250: finishing write tid 4 to smithi03339061-5 2021-07-26T16:08:39.501 INFO:tasks.rados.rados.0.smithi033.stdout:3250: finishing write tid 5 to smithi03339061-5 2021-07-26T16:08:39.502 INFO:tasks.rados.rados.0.smithi033.stdout:3250: finishing write tid 6 to smithi03339061-5 2021-07-26T16:08:39.502 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 1830 (ObjNum 978 snap 326 seq_num 978) dirty exists 2021-07-26T16:08:39.502 INFO:tasks.rados.rados.0.smithi033.stdout:3250: left oid 5 (ObjNum 978 snap 326 seq_num 978) 2021-07-26T16:08:39.502 INFO:tasks.rados.rados.0.smithi033.stdout:3251: finishing write tid 1 to smithi03339061-24 2021-07-26T16:08:39.502 INFO:tasks.rados.rados.0.smithi033.stdout:3251: finishing write tid 2 to smithi03339061-24 2021-07-26T16:08:39.503 INFO:tasks.rados.rados.0.smithi033.stdout:3251: finishing write tid 3 to smithi03339061-24 2021-07-26T16:08:39.503 INFO:tasks.rados.rados.0.smithi033.stdout:3251: finishing write tid 4 to smithi03339061-24 2021-07-26T16:08:39.503 INFO:tasks.rados.rados.0.smithi033.stdout:3251: finishing write tid 5 to smithi03339061-24 2021-07-26T16:08:39.503 INFO:tasks.rados.rados.0.smithi033.stdout:3251: finishing write tid 6 to smithi03339061-24 2021-07-26T16:08:39.504 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1835 (ObjNum 979 snap 326 seq_num 979) dirty exists 2021-07-26T16:08:39.504 INFO:tasks.rados.rados.0.smithi033.stdout:3251: left oid 24 (ObjNum 979 snap 326 seq_num 979) 2021-07-26T16:08:39.504 INFO:tasks.rados.rados.0.smithi033.stdout:3252: finishing write tid 1 to smithi03339061-2 2021-07-26T16:08:39.504 INFO:tasks.rados.rados.0.smithi033.stdout:3252: finishing write tid 2 to smithi03339061-2 2021-07-26T16:08:39.504 INFO:tasks.rados.rados.0.smithi033.stdout:3252: finishing write tid 3 to smithi03339061-2 2021-07-26T16:08:39.505 INFO:tasks.rados.rados.0.smithi033.stdout:3252: finishing write tid 4 to smithi03339061-2 2021-07-26T16:08:39.505 INFO:tasks.rados.rados.0.smithi033.stdout:3252: finishing write tid 5 to smithi03339061-2 2021-07-26T16:08:39.505 INFO:tasks.rados.rados.0.smithi033.stdout:3253: finishing write tid 1 to smithi03339061-12 2021-07-26T16:08:39.506 INFO:tasks.rados.rados.0.smithi033.stdout:3253: finishing write tid 2 to smithi03339061-12 2021-07-26T16:08:39.507 INFO:tasks.rados.rados.0.smithi033.stdout:3252: finishing write tid 6 to smithi03339061-2 2021-07-26T16:08:39.507 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1429 (ObjNum 980 snap 326 seq_num 980) dirty exists 2021-07-26T16:08:39.507 INFO:tasks.rados.rados.0.smithi033.stdout:3252: left oid 2 (ObjNum 980 snap 326 seq_num 980) 2021-07-26T16:08:39.507 INFO:tasks.rados.rados.0.smithi033.stdout:3253: finishing write tid 3 to smithi03339061-12 2021-07-26T16:08:39.508 INFO:tasks.rados.rados.0.smithi033.stdout:3253: finishing write tid 4 to smithi03339061-12 2021-07-26T16:08:39.508 INFO:tasks.rados.rados.0.smithi033.stdout:3253: finishing write tid 5 to smithi03339061-12 2021-07-26T16:08:39.508 INFO:tasks.rados.rados.0.smithi033.stdout:3253: finishing write tid 6 to smithi03339061-12 2021-07-26T16:08:39.509 INFO:tasks.rados.rados.0.smithi033.stdout:3253: finishing write tid 7 to smithi03339061-12 2021-07-26T16:08:39.509 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1435 (ObjNum 981 snap 326 seq_num 981) dirty exists 2021-07-26T16:08:39.509 INFO:tasks.rados.rados.0.smithi033.stdout:3253: left oid 12 (ObjNum 981 snap 326 seq_num 981) 2021-07-26T16:08:39.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:39 smithi033 bash[41341]: cluster 2021-07-26T16:08:38.309397+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e695: 8 total, 8 up, 8 in 2021-07-26T16:08:39.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:39 smithi033 bash[42377]: cluster 2021-07-26T16:08:38.309397+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e695: 8 total, 8 up, 8 in 2021-07-26T16:08:39.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:39 smithi096 bash[33981]: cluster 2021-07-26T16:08:38.309397+0000 mon.a (mon.0) 1069 : cluster [DBG] osdmap e695: 8 total, 8 up, 8 in 2021-07-26T16:08:40.331 INFO:tasks.rados.rados.0.smithi033.stdout:3247: done (5 left) 2021-07-26T16:08:40.332 INFO:tasks.rados.rados.0.smithi033.stdout:3250: done (4 left) 2021-07-26T16:08:40.332 INFO:tasks.rados.rados.0.smithi033.stdout:3251: done (3 left) 2021-07-26T16:08:40.332 INFO:tasks.rados.rados.0.smithi033.stdout:3252: done (2 left) 2021-07-26T16:08:40.332 INFO:tasks.rados.rados.0.smithi033.stdout:3253: done (1 left) 2021-07-26T16:08:40.333 INFO:tasks.rados.rados.0.smithi033.stdout:3254: done (0 left) 2021-07-26T16:08:40.333 INFO:tasks.rados.rados.0.smithi033.stdout:3255: read oid 22 snap -1 2021-07-26T16:08:40.333 INFO:tasks.rados.rados.0.smithi033.stdout:3255: expect (ObjNum 973 snap 326 seq_num 973) 2021-07-26T16:08:40.333 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 327 2021-07-26T16:08:40.334 INFO:tasks.rados.rados.0.smithi033.stdout:3256: seq_num 982 ranges {3825664=450560,4276224=425984,4702208=679936,5382144=466944,5849088=32768} 2021-07-26T16:08:40.358 INFO:tasks.rados.rados.0.smithi033.stdout:3256: writing smithi03339061-2 from 3825664 to 4276224 tid 1 2021-07-26T16:08:40.360 INFO:tasks.rados.rados.0.smithi033.stdout:3256: writing smithi03339061-2 from 4276224 to 4702208 tid 2 2021-07-26T16:08:40.364 INFO:tasks.rados.rados.0.smithi033.stdout:3256: writing smithi03339061-2 from 4702208 to 5382144 tid 3 2021-07-26T16:08:40.367 INFO:tasks.rados.rados.0.smithi033.stdout:3256: writing smithi03339061-2 from 5382144 to 5849088 tid 4 2021-07-26T16:08:40.367 INFO:tasks.rados.rados.0.smithi033.stdout:3256: writing smithi03339061-2 from 5849088 to 5881856 tid 5 2021-07-26T16:08:40.368 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 44 current snap is 327 2021-07-26T16:08:40.368 INFO:tasks.rados.rados.0.smithi033.stdout:3257: seq_num 983 ranges {1785856=466944,2252800=712704,2965504=434176,3399680=458752} 2021-07-26T16:08:40.380 INFO:tasks.rados.rados.0.smithi033.stdout:3257: writing smithi03339061-44 from 1785856 to 2252800 tid 1 2021-07-26T16:08:40.384 INFO:tasks.rados.rados.0.smithi033.stdout:3257: writing smithi03339061-44 from 2252800 to 2965504 tid 2 2021-07-26T16:08:40.386 INFO:tasks.rados.rados.0.smithi033.stdout:3257: writing smithi03339061-44 from 2965504 to 3399680 tid 3 2021-07-26T16:08:40.389 INFO:tasks.rados.rados.0.smithi033.stdout:3257: writing smithi03339061-44 from 3399680 to 3858432 tid 4 2021-07-26T16:08:40.390 INFO:tasks.rados.rados.0.smithi033.stdout:3258: copy_from oid 50 from oid 29 current snap is 327 2021-07-26T16:08:40.390 INFO:tasks.rados.rados.0.smithi033.stdout:3255: expect (ObjNum 973 snap 326 seq_num 973) 2021-07-26T16:08:40.483 INFO:tasks.rados.rados.0.smithi033.stdout:3256: finishing write tid 1 to smithi03339061-2 2021-07-26T16:08:40.483 INFO:tasks.rados.rados.0.smithi033.stdout:3256: finishing write tid 2 to smithi03339061-2 2021-07-26T16:08:40.483 INFO:tasks.rados.rados.0.smithi033.stdout:3256: finishing write tid 3 to smithi03339061-2 2021-07-26T16:08:40.484 INFO:tasks.rados.rados.0.smithi033.stdout:3256: finishing write tid 4 to smithi03339061-2 2021-07-26T16:08:40.484 INFO:tasks.rados.rados.0.smithi033.stdout:3256: finishing write tid 5 to smithi03339061-2 2021-07-26T16:08:40.484 INFO:tasks.rados.rados.0.smithi033.stdout:3256: finishing write tid 6 to smithi03339061-2 2021-07-26T16:08:40.484 INFO:tasks.rados.rados.0.smithi033.stdout:3256: finishing write tid 7 to smithi03339061-2 2021-07-26T16:08:40.484 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1441 (ObjNum 982 snap 327 seq_num 982) dirty exists 2021-07-26T16:08:40.485 INFO:tasks.rados.rados.0.smithi033.stdout:3256: left oid 2 (ObjNum 982 snap 327 seq_num 982) 2021-07-26T16:08:40.485 INFO:tasks.rados.rados.0.smithi033.stdout:3257: finishing write tid 1 to smithi03339061-44 2021-07-26T16:08:40.485 INFO:tasks.rados.rados.0.smithi033.stdout:3258: finishing copy_from to smithi03339061-50 2021-07-26T16:08:40.485 INFO:tasks.rados.rados.0.smithi033.stdout:3258: got expected ENOENT (src dne) 2021-07-26T16:08:40.485 INFO:tasks.rados.rados.0.smithi033.stdout:3258: finishing copy_from racing read to smithi03339061-50 2021-07-26T16:08:40.486 INFO:tasks.rados.rados.0.smithi033.stdout:3257: finishing write tid 2 to smithi03339061-44 2021-07-26T16:08:40.486 INFO:tasks.rados.rados.0.smithi033.stdout:3257: finishing write tid 3 to smithi03339061-44 2021-07-26T16:08:40.486 INFO:tasks.rados.rados.0.smithi033.stdout:3257: finishing write tid 4 to smithi03339061-44 2021-07-26T16:08:40.486 INFO:tasks.rados.rados.0.smithi033.stdout:3257: finishing write tid 5 to smithi03339061-44 2021-07-26T16:08:40.487 INFO:tasks.rados.rados.0.smithi033.stdout:3257: finishing write tid 6 to smithi03339061-44 2021-07-26T16:08:40.487 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1505 (ObjNum 983 snap 327 seq_num 983) dirty exists 2021-07-26T16:08:40.487 INFO:tasks.rados.rados.0.smithi033.stdout:3257: left oid 44 (ObjNum 983 snap 327 seq_num 983) 2021-07-26T16:08:40.487 INFO:tasks.rados.rados.0.smithi033.stdout:3255: done (3 left) 2021-07-26T16:08:40.488 INFO:tasks.rados.rados.0.smithi033.stdout:3256: done (2 left) 2021-07-26T16:08:40.488 INFO:tasks.rados.rados.0.smithi033.stdout:3257: done (1 left) 2021-07-26T16:08:40.488 INFO:tasks.rados.rados.0.smithi033.stdout:3258: done (0 left) 2021-07-26T16:08:40.488 INFO:tasks.rados.rados.0.smithi033.stdout:3259: read oid 25 snap 284 2021-07-26T16:08:40.489 INFO:tasks.rados.rados.0.smithi033.stdout:3259: expect (ObjNum 682 snap 225 seq_num 682) 2021-07-26T16:08:40.489 INFO:tasks.rados.rados.0.smithi033.stdout:3260: copy_from oid 4 from oid 26 current snap is 327 2021-07-26T16:08:40.489 INFO:tasks.rados.rados.0.smithi033.stdout:3261: rollback oid 49 current snap is 327 2021-07-26T16:08:40.489 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 49 to 326 2021-07-26T16:08:40.489 INFO:tasks.rados.rados.0.smithi033.stdout:3262: read oid 23 snap -1 2021-07-26T16:08:40.490 INFO:tasks.rados.rados.0.smithi033.stdout:3262: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:08:40.490 INFO:tasks.rados.rados.0.smithi033.stdout:3263: rollback oid 35 current snap is 327 2021-07-26T16:08:40.490 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 312 2021-07-26T16:08:40.491 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 41 current snap is 327 2021-07-26T16:08:40.491 INFO:tasks.rados.rados.0.smithi033.stdout:3264: seq_num 984 ranges {19283968=483328,19767296=598016,20365312=647168,21012480=360448} 2021-07-26T16:08:40.599 INFO:tasks.rados.rados.0.smithi033.stdout:3264: writing smithi03339061-41 from 19283968 to 19767296 tid 1 2021-07-26T16:08:40.602 INFO:tasks.rados.rados.0.smithi033.stdout:3264: writing smithi03339061-41 from 19767296 to 20365312 tid 2 2021-07-26T16:08:40.606 INFO:tasks.rados.rados.0.smithi033.stdout:3264: writing smithi03339061-41 from 20365312 to 21012480 tid 3 2021-07-26T16:08:40.608 INFO:tasks.rados.rados.0.smithi033.stdout:3264: writing smithi03339061-41 from 21012480 to 21372928 tid 4 2021-07-26T16:08:40.609 INFO:tasks.rados.rados.0.smithi033.stdout:3265: read oid 3 snap -1 2021-07-26T16:08:40.609 INFO:tasks.rados.rados.0.smithi033.stdout:3265: expect (ObjNum 920 snap 308 seq_num 920) 2021-07-26T16:08:40.609 INFO:tasks.rados.rados.0.smithi033.stdout:3266: snap_create 2021-07-26T16:08:40.609 INFO:tasks.rados.rados.0.smithi033.stdout:3260: finishing copy_from to smithi03339061-4 2021-07-26T16:08:40.609 INFO:tasks.rados.rados.0.smithi033.stdout:3260: got expected ENOENT (src dne) 2021-07-26T16:08:40.610 INFO:tasks.rados.rados.0.smithi033.stdout:3260: finishing copy_from racing read to smithi03339061-4 2021-07-26T16:08:40.610 INFO:tasks.rados.rados.0.smithi033.stdout:3263: finishing rollback tid 1 to smithi03339061-35 2021-07-26T16:08:40.610 INFO:tasks.rados.rados.0.smithi033.stdout:3263: finishing rollback tid 2 to smithi03339061-35 2021-07-26T16:08:40.610 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1770 (ObjNum 815 snap 272 seq_num 815) dirty exists 2021-07-26T16:08:40.611 INFO:tasks.rados.rados.0.smithi033.stdout:3261: finishing rollback tid 0 to smithi03339061-49 2021-07-26T16:08:40.611 INFO:tasks.rados.rados.0.smithi033.stdout:3261: finishing rollback tid 1 to smithi03339061-49 2021-07-26T16:08:40.611 INFO:tasks.rados.rados.0.smithi033.stdout:3261: finishing rollback tid 2 to smithi03339061-49 2021-07-26T16:08:40.611 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 937 (ObjNum 969 snap 325 seq_num 969) dirty exists 2021-07-26T16:08:40.612 INFO:tasks.rados.rados.0.smithi033.stdout:3259: expect (ObjNum 682 snap 225 seq_num 682) 2021-07-26T16:08:40.663 INFO:tasks.rados.rados.0.smithi033.stdout:3262: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:08:40.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:40 smithi033 bash[42377]: cluster 2021-07-26T16:08:39.174934+0000 mgr.y (mgr.34104) 441 : cluster [DBG] pgmap v867: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 782 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2021-07-26T16:08:40.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:40 smithi033 bash[42377]: cluster 2021-07-26T16:08:39.321945+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e696: 8 total, 8 up, 8 in 2021-07-26T16:08:40.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:40 smithi033 bash[41341]: cluster 2021-07-26T16:08:39.174934+0000 mgr.y (mgr.34104) 441 : cluster [DBG] pgmap v867: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 782 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2021-07-26T16:08:40.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:40 smithi033 bash[41341]: cluster 2021-07-26T16:08:39.321945+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e696: 8 total, 8 up, 8 in 2021-07-26T16:08:40.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:40 smithi096 bash[33981]: cluster 2021-07-26T16:08:39.174934+0000 mgr.y (mgr.34104) 441 : cluster [DBG] pgmap v867: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 782 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 1.7 MiB/s wr, 13 op/s 2021-07-26T16:08:40.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:40 smithi096 bash[33981]: cluster 2021-07-26T16:08:39.321945+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e696: 8 total, 8 up, 8 in 2021-07-26T16:08:40.735 INFO:tasks.rados.rados.0.smithi033.stdout:3264: finishing write tid 1 to smithi03339061-41 2021-07-26T16:08:40.735 INFO:tasks.rados.rados.0.smithi033.stdout:3264: finishing write tid 2 to smithi03339061-41 2021-07-26T16:08:40.735 INFO:tasks.rados.rados.0.smithi033.stdout:3264: finishing write tid 3 to smithi03339061-41 2021-07-26T16:08:40.736 INFO:tasks.rados.rados.0.smithi033.stdout:3265: expect (ObjNum 920 snap 308 seq_num 920) 2021-07-26T16:08:40.761 INFO:tasks.rados.rados.0.smithi033.stdout:3264: finishing write tid 4 to smithi03339061-41 2021-07-26T16:08:40.762 INFO:tasks.rados.rados.0.smithi033.stdout:3264: finishing write tid 5 to smithi03339061-41 2021-07-26T16:08:40.762 INFO:tasks.rados.rados.0.smithi033.stdout:3264: finishing write tid 6 to smithi03339061-41 2021-07-26T16:08:40.762 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1835 (ObjNum 984 snap 327 seq_num 984) dirty exists 2021-07-26T16:08:40.762 INFO:tasks.rados.rados.0.smithi033.stdout:3264: left oid 41 (ObjNum 984 snap 327 seq_num 984) 2021-07-26T16:08:41.215 INFO:tasks.rados.rados.0.smithi033.stdout:3259: done (7 left) 2021-07-26T16:08:41.215 INFO:tasks.rados.rados.0.smithi033.stdout:3260: done (6 left) 2021-07-26T16:08:41.215 INFO:tasks.rados.rados.0.smithi033.stdout:3261: done (5 left) 2021-07-26T16:08:41.215 INFO:tasks.rados.rados.0.smithi033.stdout:3262: done (4 left) 2021-07-26T16:08:41.216 INFO:tasks.rados.rados.0.smithi033.stdout:3263: done (3 left) 2021-07-26T16:08:41.216 INFO:tasks.rados.rados.0.smithi033.stdout:3264: done (2 left) 2021-07-26T16:08:41.216 INFO:tasks.rados.rados.0.smithi033.stdout:3265: done (1 left) 2021-07-26T16:08:41.216 INFO:tasks.rados.rados.0.smithi033.stdout:3266: done (0 left) 2021-07-26T16:08:41.217 INFO:tasks.rados.rados.0.smithi033.stdout:3267: snap_remove snap 306 2021-07-26T16:08:41.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:41 smithi033 bash[41341]: cluster 2021-07-26T16:08:40.328146+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e697: 8 total, 8 up, 8 in 2021-07-26T16:08:41.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:41 smithi033 bash[41341]: cluster 2021-07-26T16:08:41.211288+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e698: 8 total, 8 up, 8 in 2021-07-26T16:08:41.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:41 smithi033 bash[42377]: cluster 2021-07-26T16:08:40.328146+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e697: 8 total, 8 up, 8 in 2021-07-26T16:08:41.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:41 smithi033 bash[42377]: cluster 2021-07-26T16:08:41.211288+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e698: 8 total, 8 up, 8 in 2021-07-26T16:08:41.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:41 smithi096 bash[33981]: cluster 2021-07-26T16:08:40.328146+0000 mon.a (mon.0) 1071 : cluster [DBG] osdmap e697: 8 total, 8 up, 8 in 2021-07-26T16:08:41.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:41 smithi096 bash[33981]: cluster 2021-07-26T16:08:41.211288+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e698: 8 total, 8 up, 8 in 2021-07-26T16:08:42.227 INFO:tasks.rados.rados.0.smithi033.stdout:3267: done (0 left) 2021-07-26T16:08:42.228 INFO:tasks.rados.rados.0.smithi033.stdout:3268: setattr oid 44 current snap is 328 2021-07-26T16:08:42.230 INFO:tasks.rados.rados.0.smithi033.stdout:3269: copy_from oid 35 from oid 34 current snap is 328 2021-07-26T16:08:42.230 INFO:tasks.rados.rados.0.smithi033.stdout:3270: read oid 22 snap -1 2021-07-26T16:08:42.230 INFO:tasks.rados.rados.0.smithi033.stdout:3270: expect (ObjNum 973 snap 326 seq_num 973) 2021-07-26T16:08:42.231 INFO:tasks.rados.rados.0.smithi033.stdout:3271: snap_remove snap 323 2021-07-26T16:08:42.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:42 smithi033 bash[41341]: cluster 2021-07-26T16:08:41.175701+0000 mgr.y (mgr.34104) 442 : cluster [DBG] pgmap v870: 25 pgs: 25 active+clean; 783 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2021-07-26T16:08:42.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:42 smithi033 bash[41341]: cluster 2021-07-26T16:08:42.223319+0000 mon.a (mon.0) 1073 : cluster [DBG] osdmap e699: 8 total, 8 up, 8 in 2021-07-26T16:08:42.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:42 smithi033 bash[42377]: cluster 2021-07-26T16:08:41.175701+0000 mgr.y (mgr.34104) 442 : cluster [DBG] pgmap v870: 25 pgs: 25 active+clean; 783 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2021-07-26T16:08:42.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:42 smithi033 bash[42377]: cluster 2021-07-26T16:08:42.223319+0000 mon.a (mon.0) 1073 : cluster [DBG] osdmap e699: 8 total, 8 up, 8 in 2021-07-26T16:08:42.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:42 smithi096 bash[33981]: cluster 2021-07-26T16:08:41.175701+0000 mgr.y (mgr.34104) 442 : cluster [DBG] pgmap v870: 25 pgs: 25 active+clean; 783 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2021-07-26T16:08:42.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:42 smithi096 bash[33981]: cluster 2021-07-26T16:08:42.223319+0000 mon.a (mon.0) 1073 : cluster [DBG] osdmap e699: 8 total, 8 up, 8 in 2021-07-26T16:08:43.231 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1511 (ObjNum 983 snap 327 seq_num 983) dirty exists 2021-07-26T16:08:43.232 INFO:tasks.rados.rados.0.smithi033.stdout:3270: expect (ObjNum 973 snap 326 seq_num 973) 2021-07-26T16:08:43.323 INFO:tasks.rados.rados.0.smithi033.stdout:3269: finishing copy_from to smithi03339061-35 2021-07-26T16:08:43.323 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1279 (ObjNum 904 snap 302 seq_num 904) dirty exists 2021-07-26T16:08:43.323 INFO:tasks.rados.rados.0.smithi033.stdout:3269: finishing copy_from racing read to smithi03339061-35 2021-07-26T16:08:43.324 INFO:tasks.rados.rados.0.smithi033.stdout:3268: done (3 left) 2021-07-26T16:08:43.324 INFO:tasks.rados.rados.0.smithi033.stdout:3269: done (2 left) 2021-07-26T16:08:43.324 INFO:tasks.rados.rados.0.smithi033.stdout:3270: done (1 left) 2021-07-26T16:08:43.324 INFO:tasks.rados.rados.0.smithi033.stdout:3271: done (0 left) 2021-07-26T16:08:43.324 INFO:tasks.rados.rados.0.smithi033.stdout:3272: rollback oid 50 current snap is 328 2021-07-26T16:08:43.325 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 50 to 313 2021-07-26T16:08:43.325 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 19 current snap is 328 2021-07-26T16:08:43.325 INFO:tasks.rados.rados.0.smithi033.stdout:3273: seq_num 985 ranges {0=499712,499712=483328,983040=450560,1433600=581632,2015232=90112} 2021-07-26T16:08:43.330 INFO:tasks.rados.rados.0.smithi033.stdout:3273: writing smithi03339061-19 from 0 to 499712 tid 1 2021-07-26T16:08:43.336 INFO:tasks.rados.rados.0.smithi033.stdout:3273: writing smithi03339061-19 from 499712 to 983040 tid 2 2021-07-26T16:08:43.341 INFO:tasks.rados.rados.0.smithi033.stdout:3273: writing smithi03339061-19 from 983040 to 1433600 tid 3 2021-07-26T16:08:43.344 INFO:tasks.rados.rados.0.smithi033.stdout:3273: writing smithi03339061-19 from 1433600 to 2015232 tid 4 2021-07-26T16:08:43.345 INFO:tasks.rados.rados.0.smithi033.stdout:3273: writing smithi03339061-19 from 2015232 to 2105344 tid 5 2021-07-26T16:08:43.345 INFO:tasks.rados.rados.0.smithi033.stdout:3274: snap_remove snap 300 2021-07-26T16:08:44.351 INFO:tasks.rados.rados.0.smithi033.stdout:3274: done (2 left) 2021-07-26T16:08:44.351 INFO:tasks.rados.rados.0.smithi033.stdout:3275: read oid 17 snap -1 2021-07-26T16:08:44.352 INFO:tasks.rados.rados.0.smithi033.stdout:3275: expect deleted 2021-07-26T16:08:44.352 INFO:tasks.rados.rados.0.smithi033.stdout:3276: setattr oid 2 current snap is 328 2021-07-26T16:08:44.352 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 328 2021-07-26T16:08:44.353 INFO:tasks.rados.rados.0.smithi033.stdout:3277: seq_num 986 ranges {8945664=516096,9461760=770048,10231808=655360,10887168=180224} 2021-07-26T16:08:44.407 INFO:tasks.rados.rados.0.smithi033.stdout:3277: writing smithi03339061-24 from 8945664 to 9461760 tid 1 2021-07-26T16:08:44.411 INFO:tasks.rados.rados.0.smithi033.stdout:3277: writing smithi03339061-24 from 9461760 to 10231808 tid 2 2021-07-26T16:08:44.415 INFO:tasks.rados.rados.0.smithi033.stdout:3277: writing smithi03339061-24 from 10231808 to 10887168 tid 3 2021-07-26T16:08:44.417 INFO:tasks.rados.rados.0.smithi033.stdout:3277: writing smithi03339061-24 from 10887168 to 11067392 tid 4 2021-07-26T16:08:44.417 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 328 2021-07-26T16:08:44.417 INFO:tasks.rados.rados.0.smithi033.stdout:3272: finishing rollback tid 0 to smithi03339061-50 2021-07-26T16:08:44.417 INFO:tasks.rados.rados.0.smithi033.stdout:3272: finishing rollback tid 1 to smithi03339061-50 2021-07-26T16:08:44.418 INFO:tasks.rados.rados.0.smithi033.stdout:3272: finishing rollback tid 2 to smithi03339061-50 2021-07-26T16:08:44.418 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1823 (ObjNum 926 snap 309 seq_num 926) dirty exists 2021-07-26T16:08:44.418 INFO:tasks.rados.rados.0.smithi033.stdout:3273: finishing write tid 1 to smithi03339061-19 2021-07-26T16:08:44.418 INFO:tasks.rados.rados.0.smithi033.stdout:3273: finishing write tid 2 to smithi03339061-19 2021-07-26T16:08:44.418 INFO:tasks.rados.rados.0.smithi033.stdout:3273: finishing write tid 3 to smithi03339061-19 2021-07-26T16:08:44.419 INFO:tasks.rados.rados.0.smithi033.stdout:3278: seq_num 987 ranges {1720320=532480,2252800=647168,2899968=417792,3317760=409600,3727360=131072} 2021-07-26T16:08:44.429 INFO:tasks.rados.rados.0.smithi033.stdout:3278: writing smithi03339061-1 from 1720320 to 2252800 tid 1 2021-07-26T16:08:44.433 INFO:tasks.rados.rados.0.smithi033.stdout:3278: writing smithi03339061-1 from 2252800 to 2899968 tid 2 2021-07-26T16:08:44.435 INFO:tasks.rados.rados.0.smithi033.stdout:3278: writing smithi03339061-1 from 2899968 to 3317760 tid 3 2021-07-26T16:08:44.438 INFO:tasks.rados.rados.0.smithi033.stdout:3278: writing smithi03339061-1 from 3317760 to 3727360 tid 4 2021-07-26T16:08:44.440 INFO:tasks.rados.rados.0.smithi033.stdout:3278: writing smithi03339061-1 from 3727360 to 3858432 tid 5 2021-07-26T16:08:44.440 INFO:tasks.rados.rados.0.smithi033.stdout:3272: done (5 left) 2021-07-26T16:08:44.440 INFO:tasks.rados.rados.0.smithi033.stdout:3279: copy_from oid 12 from oid 4 current snap is 328 2021-07-26T16:08:44.440 INFO:tasks.rados.rados.0.smithi033.stdout:3273: finishing write tid 4 to smithi03339061-19 2021-07-26T16:08:44.441 INFO:tasks.rados.rados.0.smithi033.stdout:3273: finishing write tid 5 to smithi03339061-19 2021-07-26T16:08:44.441 INFO:tasks.rados.rados.0.smithi033.stdout:3273: finishing write tid 6 to smithi03339061-19 2021-07-26T16:08:44.441 INFO:tasks.rados.rados.0.smithi033.stdout:3273: finishing write tid 7 to smithi03339061-19 2021-07-26T16:08:44.441 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 1776 (ObjNum 985 snap 328 seq_num 985) dirty exists 2021-07-26T16:08:44.441 INFO:tasks.rados.rados.0.smithi033.stdout:3273: left oid 19 (ObjNum 985 snap 328 seq_num 985) 2021-07-26T16:08:44.442 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1442 (ObjNum 982 snap 327 seq_num 982) dirty exists 2021-07-26T16:08:44.442 INFO:tasks.rados.rados.0.smithi033.stdout:3277: finishing write tid 1 to smithi03339061-24 2021-07-26T16:08:44.442 INFO:tasks.rados.rados.0.smithi033.stdout:3273: done (5 left) 2021-07-26T16:08:44.442 INFO:tasks.rados.rados.0.smithi033.stdout:3275: done (4 left) 2021-07-26T16:08:44.443 INFO:tasks.rados.rados.0.smithi033.stdout:3276: done (3 left) 2021-07-26T16:08:44.443 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 328 2021-07-26T16:08:44.443 INFO:tasks.rados.rados.0.smithi033.stdout:3277: finishing write tid 2 to smithi03339061-24 2021-07-26T16:08:44.443 INFO:tasks.rados.rados.0.smithi033.stdout:3277: finishing write tid 3 to smithi03339061-24 2021-07-26T16:08:44.443 INFO:tasks.rados.rados.0.smithi033.stdout:3277: finishing write tid 4 to smithi03339061-24 2021-07-26T16:08:44.444 INFO:tasks.rados.rados.0.smithi033.stdout:3280: seq_num 988 ranges {0=557056,557056=532480,1089536=622592,1712128=450560} 2021-07-26T16:08:44.444 INFO:tasks.rados.rados.0.smithi033.stdout:3280: writing smithi03339061-28 from 0 to 557056 tid 1 2021-07-26T16:08:44.446 INFO:tasks.rados.rados.0.smithi033.stdout:3280: writing smithi03339061-28 from 557056 to 1089536 tid 2 2021-07-26T16:08:44.451 INFO:tasks.rados.rados.0.smithi033.stdout:3280: writing smithi03339061-28 from 1089536 to 1712128 tid 3 2021-07-26T16:08:44.454 INFO:tasks.rados.rados.0.smithi033.stdout:3280: writing smithi03339061-28 from 1712128 to 2162688 tid 4 2021-07-26T16:08:44.456 INFO:tasks.rados.rados.0.smithi033.stdout:3281: copy_from oid 42 from oid 29 current snap is 328 2021-07-26T16:08:44.457 INFO:tasks.rados.rados.0.smithi033.stdout:3277: finishing write tid 5 to smithi03339061-24 2021-07-26T16:08:44.457 INFO:tasks.rados.rados.0.smithi033.stdout:3277: finishing write tid 6 to smithi03339061-24 2021-07-26T16:08:44.457 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1840 (ObjNum 986 snap 328 seq_num 986) dirty exists 2021-07-26T16:08:44.457 INFO:tasks.rados.rados.0.smithi033.stdout:3277: left oid 24 (ObjNum 986 snap 328 seq_num 986) 2021-07-26T16:08:44.458 INFO:tasks.rados.rados.0.smithi033.stdout:3277: done (4 left) 2021-07-26T16:08:44.458 INFO:tasks.rados.rados.0.smithi033.stdout:3282: snap_remove snap 286 2021-07-26T16:08:44.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:44 smithi096 bash[33981]: cluster 2021-07-26T16:08:43.176374+0000 mgr.y (mgr.34104) 443 : cluster [DBG] pgmap v873: 25 pgs: 25 active+clean; 785 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 762 KiB/s wr, 15 op/s 2021-07-26T16:08:44.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:44 smithi096 bash[33981]: cluster 2021-07-26T16:08:43.225951+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e700: 8 total, 8 up, 8 in 2021-07-26T16:08:44.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:44 smithi033 bash[41341]: cluster 2021-07-26T16:08:43.176374+0000 mgr.y (mgr.34104) 443 : cluster [DBG] pgmap v873: 25 pgs: 25 active+clean; 785 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 762 KiB/s wr, 15 op/s 2021-07-26T16:08:44.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:44 smithi033 bash[41341]: cluster 2021-07-26T16:08:43.225951+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e700: 8 total, 8 up, 8 in 2021-07-26T16:08:44.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:44 smithi033 bash[42377]: cluster 2021-07-26T16:08:43.176374+0000 mgr.y (mgr.34104) 443 : cluster [DBG] pgmap v873: 25 pgs: 25 active+clean; 785 MiB data, 2.8 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 762 KiB/s wr, 15 op/s 2021-07-26T16:08:44.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:44 smithi033 bash[42377]: cluster 2021-07-26T16:08:43.225951+0000 mon.a (mon.0) 1074 : cluster [DBG] osdmap e700: 8 total, 8 up, 8 in 2021-07-26T16:08:45.357 INFO:tasks.rados.rados.0.smithi033.stdout:3278: finishing write tid 1 to smithi03339061-1 2021-07-26T16:08:45.357 INFO:tasks.rados.rados.0.smithi033.stdout:3278: finishing write tid 2 to smithi03339061-1 2021-07-26T16:08:45.358 INFO:tasks.rados.rados.0.smithi033.stdout:3278: finishing write tid 3 to smithi03339061-1 2021-07-26T16:08:45.358 INFO:tasks.rados.rados.0.smithi033.stdout:3278: finishing write tid 4 to smithi03339061-1 2021-07-26T16:08:45.358 INFO:tasks.rados.rados.0.smithi033.stdout:3278: finishing write tid 5 to smithi03339061-1 2021-07-26T16:08:45.358 INFO:tasks.rados.rados.0.smithi033.stdout:3278: finishing write tid 6 to smithi03339061-1 2021-07-26T16:08:45.358 INFO:tasks.rados.rados.0.smithi033.stdout:3278: finishing write tid 7 to smithi03339061-1 2021-07-26T16:08:45.359 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1080 (ObjNum 987 snap 328 seq_num 987) dirty exists 2021-07-26T16:08:45.359 INFO:tasks.rados.rados.0.smithi033.stdout:3278: left oid 1 (ObjNum 987 snap 328 seq_num 987) 2021-07-26T16:08:45.359 INFO:tasks.rados.rados.0.smithi033.stdout:3280: finishing write tid 1 to smithi03339061-28 2021-07-26T16:08:45.359 INFO:tasks.rados.rados.0.smithi033.stdout:3280: finishing write tid 2 to smithi03339061-28 2021-07-26T16:08:45.360 INFO:tasks.rados.rados.0.smithi033.stdout:3281: finishing copy_from to smithi03339061-42 2021-07-26T16:08:45.360 INFO:tasks.rados.rados.0.smithi033.stdout:3281: got expected ENOENT (src dne) 2021-07-26T16:08:45.360 INFO:tasks.rados.rados.0.smithi033.stdout:3281: finishing copy_from racing read to smithi03339061-42 2021-07-26T16:08:45.360 INFO:tasks.rados.rados.0.smithi033.stdout:3280: finishing write tid 3 to smithi03339061-28 2021-07-26T16:08:45.360 INFO:tasks.rados.rados.0.smithi033.stdout:3280: finishing write tid 4 to smithi03339061-28 2021-07-26T16:08:45.361 INFO:tasks.rados.rados.0.smithi033.stdout:3280: finishing write tid 5 to smithi03339061-28 2021-07-26T16:08:45.361 INFO:tasks.rados.rados.0.smithi033.stdout:3280: finishing write tid 6 to smithi03339061-28 2021-07-26T16:08:45.361 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1447 (ObjNum 988 snap 328 seq_num 988) dirty exists 2021-07-26T16:08:45.361 INFO:tasks.rados.rados.0.smithi033.stdout:3280: left oid 28 (ObjNum 988 snap 328 seq_num 988) 2021-07-26T16:08:45.362 INFO:tasks.rados.rados.0.smithi033.stdout:3279: finishing copy_from to smithi03339061-12 2021-07-26T16:08:45.362 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1409 (ObjNum 948 snap 321 seq_num 948) dirty exists 2021-07-26T16:08:45.362 INFO:tasks.rados.rados.0.smithi033.stdout:3279: finishing copy_from racing read to smithi03339061-12 2021-07-26T16:08:45.362 INFO:tasks.rados.rados.0.smithi033.stdout:3278: done (4 left) 2021-07-26T16:08:45.362 INFO:tasks.rados.rados.0.smithi033.stdout:3279: done (3 left) 2021-07-26T16:08:45.363 INFO:tasks.rados.rados.0.smithi033.stdout:3280: done (2 left) 2021-07-26T16:08:45.363 INFO:tasks.rados.rados.0.smithi033.stdout:3281: done (1 left) 2021-07-26T16:08:45.363 INFO:tasks.rados.rados.0.smithi033.stdout:3282: done (0 left) 2021-07-26T16:08:45.363 INFO:tasks.rados.rados.0.smithi033.stdout:3283: rollback oid 9 current snap is 328 2021-07-26T16:08:45.364 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 9 to 301 2021-07-26T16:08:45.364 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 328 2021-07-26T16:08:45.364 INFO:tasks.rados.rados.0.smithi033.stdout:3284: seq_num 989 ranges {532480=573440,1105920=466944,1572864=434176,2007040=638976,2646016=65536} 2021-07-26T16:08:45.368 INFO:tasks.rados.rados.0.smithi033.stdout:3284: writing smithi03339061-32 from 532480 to 1105920 tid 1 2021-07-26T16:08:45.368 INFO:tasks.rados.rados.0.smithi033.stdout:3284: writing smithi03339061-32 from 1105920 to 1572864 tid 2 2021-07-26T16:08:45.371 INFO:tasks.rados.rados.0.smithi033.stdout:3284: writing smithi03339061-32 from 1572864 to 2007040 tid 3 2021-07-26T16:08:45.376 INFO:tasks.rados.rados.0.smithi033.stdout:3284: writing smithi03339061-32 from 2007040 to 2646016 tid 4 2021-07-26T16:08:45.376 INFO:tasks.rados.rados.0.smithi033.stdout:3284: writing smithi03339061-32 from 2646016 to 2711552 tid 5 2021-07-26T16:08:45.377 INFO:tasks.rados.rados.0.smithi033.stdout:3285: read oid 6 snap 283 2021-07-26T16:08:45.377 INFO:tasks.rados.rados.0.smithi033.stdout:3285: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:08:45.378 INFO:tasks.rados.rados.0.smithi033.stdout:3286: copy_from oid 28 from oid 27 current snap is 328 2021-07-26T16:08:45.378 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 328 2021-07-26T16:08:45.379 INFO:tasks.rados.rados.0.smithi033.stdout:3287: seq_num 990 ranges {8077312=589824,8667136=753664,9420800=638976,10059776=212992} 2021-07-26T16:08:45.429 INFO:tasks.rados.rados.0.smithi033.stdout:3287: writing smithi03339061-35 from 8077312 to 8667136 tid 1 2021-07-26T16:08:45.434 INFO:tasks.rados.rados.0.smithi033.stdout:3287: writing smithi03339061-35 from 8667136 to 9420800 tid 2 2021-07-26T16:08:45.437 INFO:tasks.rados.rados.0.smithi033.stdout:3287: writing smithi03339061-35 from 9420800 to 10059776 tid 3 2021-07-26T16:08:45.439 INFO:tasks.rados.rados.0.smithi033.stdout:3287: writing smithi03339061-35 from 10059776 to 10272768 tid 4 2021-07-26T16:08:45.439 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 328 2021-07-26T16:08:45.440 INFO:tasks.rados.rados.0.smithi033.stdout:3284: finishing write tid 1 to smithi03339061-32 2021-07-26T16:08:45.440 INFO:tasks.rados.rados.0.smithi033.stdout:3288: seq_num 991 ranges {5881856=606208,6488064=638976,7127040=794624,7921664=172032} 2021-07-26T16:08:45.476 INFO:tasks.rados.rados.0.smithi033.stdout:3288: writing smithi03339061-2 from 5881856 to 6488064 tid 1 2021-07-26T16:08:45.479 INFO:tasks.rados.rados.0.smithi033.stdout:3288: writing smithi03339061-2 from 6488064 to 7127040 tid 2 2021-07-26T16:08:45.484 INFO:tasks.rados.rados.0.smithi033.stdout:3288: writing smithi03339061-2 from 7127040 to 7921664 tid 3 2021-07-26T16:08:45.486 INFO:tasks.rados.rados.0.smithi033.stdout:3288: writing smithi03339061-2 from 7921664 to 8093696 tid 4 2021-07-26T16:08:45.486 INFO:tasks.rados.rados.0.smithi033.stdout:3289: rollback oid 29 current snap is 328 2021-07-26T16:08:45.486 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 296 2021-07-26T16:08:45.487 INFO:tasks.rados.rados.0.smithi033.stdout:3283: finishing rollback tid 0 to smithi03339061-9 2021-07-26T16:08:45.487 INFO:tasks.rados.rados.0.smithi033.stdout:3284: finishing write tid 2 to smithi03339061-32 2021-07-26T16:08:45.487 INFO:tasks.rados.rados.0.smithi033.stdout:3290: copy_from oid 10 from oid 17 current snap is 328 2021-07-26T16:08:45.487 INFO:tasks.rados.rados.0.smithi033.stdout:3284: finishing write tid 3 to smithi03339061-32 2021-07-26T16:08:45.488 INFO:tasks.rados.rados.0.smithi033.stdout:3284: finishing write tid 4 to smithi03339061-32 2021-07-26T16:08:45.488 INFO:tasks.rados.rados.0.smithi033.stdout:3284: finishing write tid 5 to smithi03339061-32 2021-07-26T16:08:45.488 INFO:tasks.rados.rados.0.smithi033.stdout:3284: finishing write tid 6 to smithi03339061-32 2021-07-26T16:08:45.488 INFO:tasks.rados.rados.0.smithi033.stdout:3283: finishing rollback tid 1 to smithi03339061-9 2021-07-26T16:08:45.489 INFO:tasks.rados.rados.0.smithi033.stdout:3283: finishing rollback tid 2 to smithi03339061-9 2021-07-26T16:08:45.489 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 1779 (ObjNum 836 snap 277 seq_num 836) dirty exists 2021-07-26T16:08:45.489 INFO:tasks.rados.rados.0.smithi033.stdout:3284: finishing write tid 7 to smithi03339061-32 2021-07-26T16:08:45.489 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1829 (ObjNum 989 snap 328 seq_num 989) dirty exists 2021-07-26T16:08:45.490 INFO:tasks.rados.rados.0.smithi033.stdout:3284: left oid 32 (ObjNum 989 snap 328 seq_num 989) 2021-07-26T16:08:45.490 INFO:tasks.rados.rados.0.smithi033.stdout:3283: done (7 left) 2021-07-26T16:08:45.490 INFO:tasks.rados.rados.0.smithi033.stdout:3284: done (6 left) 2021-07-26T16:08:45.490 INFO:tasks.rados.rados.0.smithi033.stdout:3291: snap_create 2021-07-26T16:08:45.491 INFO:tasks.rados.rados.0.smithi033.stdout:3286: finishing copy_from to smithi03339061-28 2021-07-26T16:08:45.491 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1584 (ObjNum 806 snap 268 seq_num 806) dirty exists 2021-07-26T16:08:45.491 INFO:tasks.rados.rados.0.smithi033.stdout:3286: finishing copy_from racing read to smithi03339061-28 2021-07-26T16:08:45.491 INFO:tasks.rados.rados.0.smithi033.stdout:3285: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:08:45.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:45 smithi033 bash[41341]: cluster 2021-07-26T16:08:44.344867+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e701: 8 total, 8 up, 8 in 2021-07-26T16:08:45.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:45 smithi033 bash[42377]: cluster 2021-07-26T16:08:44.344867+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e701: 8 total, 8 up, 8 in 2021-07-26T16:08:45.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:45 smithi096 bash[33981]: cluster 2021-07-26T16:08:44.344867+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e701: 8 total, 8 up, 8 in 2021-07-26T16:08:46.002 INFO:tasks.rados.rados.0.smithi033.stdout:3287: finishing write tid 1 to smithi03339061-35 2021-07-26T16:08:46.003 INFO:tasks.rados.rados.0.smithi033.stdout:3287: finishing write tid 2 to smithi03339061-35 2021-07-26T16:08:46.003 INFO:tasks.rados.rados.0.smithi033.stdout:3287: finishing write tid 3 to smithi03339061-35 2021-07-26T16:08:46.003 INFO:tasks.rados.rados.0.smithi033.stdout:3287: finishing write tid 4 to smithi03339061-35 2021-07-26T16:08:46.003 INFO:tasks.rados.rados.0.smithi033.stdout:3287: finishing write tid 5 to smithi03339061-35 2021-07-26T16:08:46.004 INFO:tasks.rados.rados.0.smithi033.stdout:3287: finishing write tid 6 to smithi03339061-35 2021-07-26T16:08:46.004 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1784 (ObjNum 990 snap 328 seq_num 990) dirty exists 2021-07-26T16:08:46.004 INFO:tasks.rados.rados.0.smithi033.stdout:3287: left oid 35 (ObjNum 990 snap 328 seq_num 990) 2021-07-26T16:08:46.004 INFO:tasks.rados.rados.0.smithi033.stdout:3288: finishing write tid 1 to smithi03339061-2 2021-07-26T16:08:46.004 INFO:tasks.rados.rados.0.smithi033.stdout:3290: finishing copy_from to smithi03339061-10 2021-07-26T16:08:46.005 INFO:tasks.rados.rados.0.smithi033.stdout:3290: got expected ENOENT (src dne) 2021-07-26T16:08:46.005 INFO:tasks.rados.rados.0.smithi033.stdout:3290: finishing copy_from racing read to smithi03339061-10 2021-07-26T16:08:46.005 INFO:tasks.rados.rados.0.smithi033.stdout:3289: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:08:46.005 INFO:tasks.rados.rados.0.smithi033.stdout:3288: finishing write tid 2 to smithi03339061-2 2021-07-26T16:08:46.006 INFO:tasks.rados.rados.0.smithi033.stdout:3288: finishing write tid 3 to smithi03339061-2 2021-07-26T16:08:46.006 INFO:tasks.rados.rados.0.smithi033.stdout:3289: finishing rollback tid 2 to smithi03339061-29 2021-07-26T16:08:46.006 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1340 (ObjNum 890 snap 292 seq_num 890) dirty exists 2021-07-26T16:08:46.006 INFO:tasks.rados.rados.0.smithi033.stdout:3288: finishing write tid 4 to smithi03339061-2 2021-07-26T16:08:46.007 INFO:tasks.rados.rados.0.smithi033.stdout:3288: finishing write tid 5 to smithi03339061-2 2021-07-26T16:08:46.007 INFO:tasks.rados.rados.0.smithi033.stdout:3288: finishing write tid 6 to smithi03339061-2 2021-07-26T16:08:46.007 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1589 (ObjNum 991 snap 328 seq_num 991) dirty exists 2021-07-26T16:08:46.007 INFO:tasks.rados.rados.0.smithi033.stdout:3288: left oid 2 (ObjNum 991 snap 328 seq_num 991) 2021-07-26T16:08:46.218 INFO:tasks.rados.rados.0.smithi033.stdout:3285: done (6 left) 2021-07-26T16:08:46.219 INFO:tasks.rados.rados.0.smithi033.stdout:3286: done (5 left) 2021-07-26T16:08:46.219 INFO:tasks.rados.rados.0.smithi033.stdout:3287: done (4 left) 2021-07-26T16:08:46.219 INFO:tasks.rados.rados.0.smithi033.stdout:3288: done (3 left) 2021-07-26T16:08:46.219 INFO:tasks.rados.rados.0.smithi033.stdout:3289: done (2 left) 2021-07-26T16:08:46.219 INFO:tasks.rados.rados.0.smithi033.stdout:3290: done (1 left) 2021-07-26T16:08:46.220 INFO:tasks.rados.rados.0.smithi033.stdout:3291: done (0 left) 2021-07-26T16:08:46.220 INFO:tasks.rados.rados.0.smithi033.stdout:3292: rmattr oid 4 current snap is 329 2021-07-26T16:08:46.220 INFO:tasks.rados.rados.0.smithi033.stdout:3293: read oid 37 snap -1 2021-07-26T16:08:46.220 INFO:tasks.rados.rados.0.smithi033.stdout:3293: expect (ObjNum 963 snap 324 seq_num 963) 2021-07-26T16:08:46.220 INFO:tasks.rados.rados.0.smithi033.stdout:3294: copy_from oid 3 from oid 43 current snap is 329 2021-07-26T16:08:46.221 INFO:tasks.rados.rados.0.smithi033.stdout:3295: read oid 22 snap -1 2021-07-26T16:08:46.221 INFO:tasks.rados.rados.0.smithi033.stdout:3295: expect (ObjNum 973 snap 326 seq_num 973) 2021-07-26T16:08:46.221 INFO:tasks.rados.rados.0.smithi033.stdout:3296: delete oid 15 current snap is 329 2021-07-26T16:08:46.224 INFO:tasks.rados.rados.0.smithi033.stdout:3296: done (4 left) 2021-07-26T16:08:46.224 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 329 2021-07-26T16:08:46.225 INFO:tasks.rados.rados.0.smithi033.stdout:3297: seq_num 993 ranges {3923968=638976,4562944=409600,4972544=409600,5382144=688128,6070272=98304} 2021-07-26T16:08:46.250 INFO:tasks.rados.rados.0.smithi033.stdout:3297: writing smithi03339061-39 from 3923968 to 4562944 tid 1 2021-07-26T16:08:46.252 INFO:tasks.rados.rados.0.smithi033.stdout:3297: writing smithi03339061-39 from 4562944 to 4972544 tid 2 2021-07-26T16:08:46.255 INFO:tasks.rados.rados.0.smithi033.stdout:3297: writing smithi03339061-39 from 4972544 to 5382144 tid 3 2021-07-26T16:08:46.258 INFO:tasks.rados.rados.0.smithi033.stdout:3297: writing smithi03339061-39 from 5382144 to 6070272 tid 4 2021-07-26T16:08:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:3297: writing smithi03339061-39 from 6070272 to 6168576 tid 5 2021-07-26T16:08:46.260 INFO:tasks.rados.rados.0.smithi033.stdout:3298: read oid 32 snap 272 2021-07-26T16:08:46.261 INFO:tasks.rados.rados.0.smithi033.stdout:3298: expect (ObjNum 805 snap 268 seq_num 805) 2021-07-26T16:08:46.261 INFO:tasks.rados.rados.0.smithi033.stdout:3299: rmattr oid 20 current snap is 329 2021-07-26T16:08:46.261 INFO:tasks.rados.rados.0.smithi033.stdout:3299: done (6 left) 2021-07-26T16:08:46.262 INFO:tasks.rados.rados.0.smithi033.stdout:3300: delete oid 42 current snap is 329 2021-07-26T16:08:46.262 INFO:tasks.rados.rados.0.smithi033.stdout:3295: expect (ObjNum 973 snap 326 seq_num 973) 2021-07-26T16:08:46.346 INFO:tasks.rados.rados.0.smithi033.stdout:3293: expect (ObjNum 963 snap 324 seq_num 963) 2021-07-26T16:08:46.391 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1537 (ObjNum 948 snap 321 seq_num 948) dirty exists 2021-07-26T16:08:46.391 INFO:tasks.rados.rados.0.smithi033.stdout:3294: finishing copy_from to smithi03339061-3 2021-07-26T16:08:46.392 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1825 (ObjNum 965 snap 324 seq_num 965) dirty exists 2021-07-26T16:08:46.392 INFO:tasks.rados.rados.0.smithi033.stdout:3294: finishing copy_from racing read to smithi03339061-3 2021-07-26T16:08:46.392 INFO:tasks.rados.rados.0.smithi033.stdout:3297: finishing write tid 1 to smithi03339061-39 2021-07-26T16:08:46.392 INFO:tasks.rados.rados.0.smithi033.stdout:3297: finishing write tid 2 to smithi03339061-39 2021-07-26T16:08:46.393 INFO:tasks.rados.rados.0.smithi033.stdout:3292: done (6 left) 2021-07-26T16:08:46.393 INFO:tasks.rados.rados.0.smithi033.stdout:3293: done (5 left) 2021-07-26T16:08:46.393 INFO:tasks.rados.rados.0.smithi033.stdout:3294: done (4 left) 2021-07-26T16:08:46.393 INFO:tasks.rados.rados.0.smithi033.stdout:3295: done (3 left) 2021-07-26T16:08:46.393 INFO:tasks.rados.rados.0.smithi033.stdout:3300: done (2 left) 2021-07-26T16:08:46.394 INFO:tasks.rados.rados.0.smithi033.stdout:3301: read oid 34 snap -1 2021-07-26T16:08:46.394 INFO:tasks.rados.rados.0.smithi033.stdout:3301: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:08:46.394 INFO:tasks.rados.rados.0.smithi033.stdout:3302: read oid 8 snap -1 2021-07-26T16:08:46.394 INFO:tasks.rados.rados.0.smithi033.stdout:3302: expect (ObjNum 896 snap 295 seq_num 896) 2021-07-26T16:08:46.394 INFO:tasks.rados.rados.0.smithi033.stdout:3303: snap_remove snap 290 2021-07-26T16:08:46.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:46 smithi033 bash[42377]: cluster 2021-07-26T16:08:45.177092+0000 mgr.y (mgr.34104) 444 : cluster [DBG] pgmap v876: 25 pgs: 25 active+clean; 794 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2021-07-26T16:08:46.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:46 smithi033 bash[42377]: cluster 2021-07-26T16:08:45.353233+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e702: 8 total, 8 up, 8 in 2021-07-26T16:08:46.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:46 smithi033 bash[42377]: cluster 2021-07-26T16:08:46.212793+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e703: 8 total, 8 up, 8 in 2021-07-26T16:08:46.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:46 smithi033 bash[41341]: cluster 2021-07-26T16:08:45.177092+0000 mgr.y (mgr.34104) 444 : cluster [DBG] pgmap v876: 25 pgs: 25 active+clean; 794 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2021-07-26T16:08:46.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:46 smithi033 bash[41341]: cluster 2021-07-26T16:08:45.353233+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e702: 8 total, 8 up, 8 in 2021-07-26T16:08:46.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:46 smithi033 bash[41341]: cluster 2021-07-26T16:08:46.212793+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e703: 8 total, 8 up, 8 in 2021-07-26T16:08:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:46 smithi096 bash[33981]: cluster 2021-07-26T16:08:45.177092+0000 mgr.y (mgr.34104) 444 : cluster [DBG] pgmap v876: 25 pgs: 25 active+clean; 794 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 7.5 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2021-07-26T16:08:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:46 smithi096 bash[33981]: cluster 2021-07-26T16:08:45.353233+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e702: 8 total, 8 up, 8 in 2021-07-26T16:08:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:46 smithi096 bash[33981]: cluster 2021-07-26T16:08:46.212793+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e703: 8 total, 8 up, 8 in 2021-07-26T16:08:47.367 INFO:tasks.rados.rados.0.smithi033.stdout:3303: done (4 left) 2021-07-26T16:08:47.367 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 44 current snap is 329 2021-07-26T16:08:47.368 INFO:tasks.rados.rados.0.smithi033.stdout:3304: seq_num 995 ranges {3858432=671744,4530176=573440,5103616=778240,5881856=253952} 2021-07-26T16:08:47.395 INFO:tasks.rados.rados.0.smithi033.stdout:3304: writing smithi03339061-44 from 3858432 to 4530176 tid 1 2021-07-26T16:08:47.399 INFO:tasks.rados.rados.0.smithi033.stdout:3304: writing smithi03339061-44 from 4530176 to 5103616 tid 2 2021-07-26T16:08:47.404 INFO:tasks.rados.rados.0.smithi033.stdout:3304: writing smithi03339061-44 from 5103616 to 5881856 tid 3 2021-07-26T16:08:47.407 INFO:tasks.rados.rados.0.smithi033.stdout:3304: writing smithi03339061-44 from 5881856 to 6135808 tid 4 2021-07-26T16:08:47.407 INFO:tasks.rados.rados.0.smithi033.stdout:3297: finishing write tid 3 to smithi03339061-39 2021-07-26T16:08:47.407 INFO:tasks.rados.rados.0.smithi033.stdout:3297: finishing write tid 4 to smithi03339061-39 2021-07-26T16:08:47.407 INFO:tasks.rados.rados.0.smithi033.stdout:3298: expect (ObjNum 805 snap 268 seq_num 805) 2021-07-26T16:08:47.449 INFO:tasks.rados.rados.0.smithi033.stdout:3297: finishing write tid 5 to smithi03339061-39 2021-07-26T16:08:47.450 INFO:tasks.rados.rados.0.smithi033.stdout:3297: finishing write tid 6 to smithi03339061-39 2021-07-26T16:08:47.450 INFO:tasks.rados.rados.0.smithi033.stdout:3297: finishing write tid 7 to smithi03339061-39 2021-07-26T16:08:47.450 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1642 (ObjNum 993 snap 329 seq_num 993) dirty exists 2021-07-26T16:08:47.451 INFO:tasks.rados.rados.0.smithi033.stdout:3297: left oid 39 (ObjNum 993 snap 329 seq_num 993) 2021-07-26T16:08:47.451 INFO:tasks.rados.rados.0.smithi033.stdout:3297: done (4 left) 2021-07-26T16:08:47.451 INFO:tasks.rados.rados.0.smithi033.stdout:3298: done (3 left) 2021-07-26T16:08:47.451 INFO:tasks.rados.rados.0.smithi033.stdout:3305: rollback oid 24 current snap is 329 2021-07-26T16:08:47.451 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 24 to 287 2021-07-26T16:08:47.452 INFO:tasks.rados.rados.0.smithi033.stdout:3302: expect (ObjNum 896 snap 295 seq_num 896) 2021-07-26T16:08:47.620 INFO:tasks.rados.rados.0.smithi033.stdout:3301: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:08:48.152 INFO:tasks.rados.rados.0.smithi033.stdout:3304: finishing write tid 1 to smithi03339061-44 2021-07-26T16:08:48.152 INFO:tasks.rados.rados.0.smithi033.stdout:3304: finishing write tid 2 to smithi03339061-44 2021-07-26T16:08:48.152 INFO:tasks.rados.rados.0.smithi033.stdout:3304: finishing write tid 3 to smithi03339061-44 2021-07-26T16:08:48.153 INFO:tasks.rados.rados.0.smithi033.stdout:3304: finishing write tid 4 to smithi03339061-44 2021-07-26T16:08:48.153 INFO:tasks.rados.rados.0.smithi033.stdout:3304: finishing write tid 5 to smithi03339061-44 2021-07-26T16:08:48.153 INFO:tasks.rados.rados.0.smithi033.stdout:3304: finishing write tid 6 to smithi03339061-44 2021-07-26T16:08:48.153 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1553 (ObjNum 995 snap 329 seq_num 995) dirty exists 2021-07-26T16:08:48.154 INFO:tasks.rados.rados.0.smithi033.stdout:3304: left oid 44 (ObjNum 995 snap 329 seq_num 995) 2021-07-26T16:08:48.154 INFO:tasks.rados.rados.0.smithi033.stdout:3301: done (3 left) 2021-07-26T16:08:48.154 INFO:tasks.rados.rados.0.smithi033.stdout:3302: done (2 left) 2021-07-26T16:08:48.154 INFO:tasks.rados.rados.0.smithi033.stdout:3304: done (1 left) 2021-07-26T16:08:48.154 INFO:tasks.rados.rados.0.smithi033.stdout:3306: rmattr oid 36 current snap is 329 2021-07-26T16:08:48.155 INFO:tasks.rados.rados.0.smithi033.stdout:3305: finishing rollback tid 0 to smithi03339061-24 2021-07-26T16:08:48.155 INFO:tasks.rados.rados.0.smithi033.stdout:3305: finishing rollback tid 1 to smithi03339061-24 2021-07-26T16:08:48.155 INFO:tasks.rados.rados.0.smithi033.stdout:3305: finishing rollback tid 2 to smithi03339061-24 2021-07-26T16:08:48.156 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1843 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:08:48.156 INFO:tasks.rados.rados.0.smithi033.stdout:3305: done (1 left) 2021-07-26T16:08:48.156 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 329 2021-07-26T16:08:48.156 INFO:tasks.rados.rados.0.smithi033.stdout:3307: seq_num 996 ranges {5799936=688128,6488064=507904,6995968=581632,7577600=516096} 2021-07-26T16:08:48.189 INFO:tasks.rados.rados.0.smithi033.stdout:3307: writing smithi03339061-33 from 5799936 to 6488064 tid 1 2021-07-26T16:08:48.191 INFO:tasks.rados.rados.0.smithi033.stdout:3307: writing smithi03339061-33 from 6488064 to 6995968 tid 2 2021-07-26T16:08:48.195 INFO:tasks.rados.rados.0.smithi033.stdout:3307: writing smithi03339061-33 from 6995968 to 7577600 tid 3 2021-07-26T16:08:48.198 INFO:tasks.rados.rados.0.smithi033.stdout:3307: writing smithi03339061-33 from 7577600 to 8093696 tid 4 2021-07-26T16:08:48.199 INFO:tasks.rados.rados.0.smithi033.stdout:3308: read oid 16 snap -1 2021-07-26T16:08:48.199 INFO:tasks.rados.rados.0.smithi033.stdout:3308: expect (ObjNum 877 snap 288 seq_num 877) 2021-07-26T16:08:48.199 INFO:tasks.rados.rados.0.smithi033.stdout:3309: read oid 50 snap -1 2021-07-26T16:08:48.199 INFO:tasks.rados.rados.0.smithi033.stdout:3309: expect (ObjNum 926 snap 309 seq_num 926) 2021-07-26T16:08:48.200 INFO:tasks.rados.rados.0.smithi033.stdout:3310: read oid 4 snap -1 2021-07-26T16:08:48.200 INFO:tasks.rados.rados.0.smithi033.stdout:3310: expect (ObjNum 948 snap 321 seq_num 948) 2021-07-26T16:08:48.200 INFO:tasks.rados.rados.0.smithi033.stdout:3311: setattr oid 11 current snap is 329 2021-07-26T16:08:48.200 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1429 (ObjNum 960 snap 322 seq_num 960) dirty exists 2021-07-26T16:08:48.201 INFO:tasks.rados.rados.0.smithi033.stdout:3306: done (5 left) 2021-07-26T16:08:48.201 INFO:tasks.rados.rados.0.smithi033.stdout:3312: snap_create 2021-07-26T16:08:48.211 INFO:tasks.rados.rados.0.smithi033.stdout:3307: finishing write tid 1 to smithi03339061-33 2021-07-26T16:08:48.211 INFO:tasks.rados.rados.0.smithi033.stdout:3307: finishing write tid 2 to smithi03339061-33 2021-07-26T16:08:48.211 INFO:tasks.rados.rados.0.smithi033.stdout:3307: finishing write tid 3 to smithi03339061-33 2021-07-26T16:08:48.212 INFO:tasks.rados.rados.0.smithi033.stdout:3307: finishing write tid 4 to smithi03339061-33 2021-07-26T16:08:48.212 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1430 (ObjNum 695 snap 229 seq_num 695) dirty exists 2021-07-26T16:08:48.213 INFO:tasks.rados.rados.0.smithi033.stdout:3307: finishing write tid 5 to smithi03339061-33 2021-07-26T16:08:48.215 INFO:tasks.rados.rados.0.smithi033.stdout:3307: finishing write tid 6 to smithi03339061-33 2021-07-26T16:08:48.215 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 2018 (ObjNum 996 snap 329 seq_num 996) dirty exists 2021-07-26T16:08:48.216 INFO:tasks.rados.rados.0.smithi033.stdout:3307: left oid 33 (ObjNum 996 snap 329 seq_num 996) 2021-07-26T16:08:48.248 INFO:tasks.rados.rados.0.smithi033.stdout:3310: expect (ObjNum 948 snap 321 seq_num 948) 2021-07-26T16:08:48.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:48 smithi033 bash[41341]: cluster 2021-07-26T16:08:47.177823+0000 mgr.y (mgr.34104) 445 : cluster [DBG] pgmap v879: 25 pgs: 25 active+clean; 822 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 1.1 MiB/s rd, 7.6 MiB/s wr, 23 op/s 2021-07-26T16:08:48.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:48 smithi033 bash[41341]: cluster 2021-07-26T16:08:47.364629+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e704: 8 total, 8 up, 8 in 2021-07-26T16:08:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:48 smithi033 bash[42377]: cluster 2021-07-26T16:08:47.177823+0000 mgr.y (mgr.34104) 445 : cluster [DBG] pgmap v879: 25 pgs: 25 active+clean; 822 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 1.1 MiB/s rd, 7.6 MiB/s wr, 23 op/s 2021-07-26T16:08:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:48 smithi033 bash[42377]: cluster 2021-07-26T16:08:47.364629+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e704: 8 total, 8 up, 8 in 2021-07-26T16:08:48.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:48 smithi096 bash[33981]: cluster 2021-07-26T16:08:47.177823+0000 mgr.y (mgr.34104) 445 : cluster [DBG] pgmap v879: 25 pgs: 25 active+clean; 822 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 1.1 MiB/s rd, 7.6 MiB/s wr, 23 op/s 2021-07-26T16:08:48.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:48 smithi096 bash[33981]: cluster 2021-07-26T16:08:47.364629+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e704: 8 total, 8 up, 8 in 2021-07-26T16:08:49.381 INFO:tasks.rados.rados.0.smithi033.stdout:3308: expect (ObjNum 877 snap 288 seq_num 877) 2021-07-26T16:08:49.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:49 smithi033 bash[42377]: cluster 2021-07-26T16:08:48.373278+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e705: 8 total, 8 up, 8 in 2021-07-26T16:08:49.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:49 smithi033 bash[41341]: cluster 2021-07-26T16:08:48.373278+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e705: 8 total, 8 up, 8 in 2021-07-26T16:08:49.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:49 smithi096 bash[33981]: cluster 2021-07-26T16:08:48.373278+0000 mon.a (mon.0) 1079 : cluster [DBG] osdmap e705: 8 total, 8 up, 8 in 2021-07-26T16:08:50.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:50 smithi033 bash[41341]: cluster 2021-07-26T16:08:49.178432+0000 mgr.y (mgr.34104) 446 : cluster [DBG] pgmap v882: 25 pgs: 25 active+clean; 828 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 6.2 MiB/s wr, 22 op/s 2021-07-26T16:08:50.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:50 smithi033 bash[42377]: cluster 2021-07-26T16:08:49.178432+0000 mgr.y (mgr.34104) 446 : cluster [DBG] pgmap v882: 25 pgs: 25 active+clean; 828 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 6.2 MiB/s wr, 22 op/s 2021-07-26T16:08:50.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:50 smithi096 bash[33981]: cluster 2021-07-26T16:08:49.178432+0000 mgr.y (mgr.34104) 446 : cluster [DBG] pgmap v882: 25 pgs: 25 active+clean; 828 MiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 9.3 MiB/s rd, 6.2 MiB/s wr, 22 op/s 2021-07-26T16:08:50.879 INFO:tasks.rados.rados.0.smithi033.stdout:3309: expect (ObjNum 926 snap 309 seq_num 926) 2021-07-26T16:08:50.908 INFO:tasks.rados.rados.0.smithi033.stdout:3307: done (5 left) 2021-07-26T16:08:50.908 INFO:tasks.rados.rados.0.smithi033.stdout:3308: done (4 left) 2021-07-26T16:08:50.909 INFO:tasks.rados.rados.0.smithi033.stdout:3309: done (3 left) 2021-07-26T16:08:50.909 INFO:tasks.rados.rados.0.smithi033.stdout:3310: done (2 left) 2021-07-26T16:08:50.909 INFO:tasks.rados.rados.0.smithi033.stdout:3311: done (1 left) 2021-07-26T16:08:50.909 INFO:tasks.rados.rados.0.smithi033.stdout:3312: done (0 left) 2021-07-26T16:08:50.910 INFO:tasks.rados.rados.0.smithi033.stdout:3313: copy_from oid 15 from oid 17 current snap is 330 2021-07-26T16:08:50.910 INFO:tasks.rados.rados.0.smithi033.stdout:3314: snap_remove snap 319 2021-07-26T16:08:51.221 INFO:tasks.rados.rados.0.smithi033.stdout:3313: finishing copy_from to smithi03339061-15 2021-07-26T16:08:51.222 INFO:tasks.rados.rados.0.smithi033.stdout:3313: got expected ENOENT (src dne) 2021-07-26T16:08:51.222 INFO:tasks.rados.rados.0.smithi033.stdout:3313: finishing copy_from racing read to smithi03339061-15 2021-07-26T16:08:51.222 INFO:tasks.rados.rados.0.smithi033.stdout:3313: done (1 left) 2021-07-26T16:08:51.222 INFO:tasks.rados.rados.0.smithi033.stdout:3314: done (0 left) 2021-07-26T16:08:51.223 INFO:tasks.rados.rados.0.smithi033.stdout:3315: copy_from oid 10 from oid 6 current snap is 330 2021-07-26T16:08:51.223 INFO:tasks.rados.rados.0.smithi033.stdout:3316: snap_create 2021-07-26T16:08:51.239 INFO:tasks.rados.rados.0.smithi033.stdout:3315: finishing copy_from to smithi03339061-10 2021-07-26T16:08:51.239 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1820 (ObjNum 891 snap 292 seq_num 891) dirty exists 2021-07-26T16:08:51.240 INFO:tasks.rados.rados.0.smithi033.stdout:3315: finishing copy_from racing read to smithi03339061-10 2021-07-26T16:08:52.230 INFO:tasks.rados.rados.0.smithi033.stdout:3315: done (1 left) 2021-07-26T16:08:52.231 INFO:tasks.rados.rados.0.smithi033.stdout:3316: done (0 left) 2021-07-26T16:08:52.231 INFO:tasks.rados.rados.0.smithi033.stdout:3317: read oid 18 snap -1 2021-07-26T16:08:52.231 INFO:tasks.rados.rados.0.smithi033.stdout:3317: expect (ObjNum 905 snap 302 seq_num 905) 2021-07-26T16:08:52.231 INFO:tasks.rados.rados.0.smithi033.stdout:3318: delete oid 48 current snap is 331 2021-07-26T16:08:52.235 INFO:tasks.rados.rados.0.smithi033.stdout:3318: done (1 left) 2021-07-26T16:08:52.236 INFO:tasks.rados.rados.0.smithi033.stdout:3319: snap_create 2021-07-26T16:08:52.237 INFO:tasks.rados.rados.0.smithi033.stdout:3317: expect (ObjNum 905 snap 302 seq_num 905) 2021-07-26T16:08:52.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:52 smithi096 bash[33981]: cluster 2021-07-26T16:08:51.179307+0000 mgr.y (mgr.34104) 447 : cluster [DBG] pgmap v883: 25 pgs: 25 active+clean; 855 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 6.3 MiB/s wr, 26 op/s 2021-07-26T16:08:52.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:52 smithi096 bash[33981]: cluster 2021-07-26T16:08:51.215422+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e706: 8 total, 8 up, 8 in 2021-07-26T16:08:52.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:52 smithi033 bash[41341]: cluster 2021-07-26T16:08:51.179307+0000 mgr.y (mgr.34104) 447 : cluster [DBG] pgmap v883: 25 pgs: 25 active+clean; 855 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 6.3 MiB/s wr, 26 op/s 2021-07-26T16:08:52.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:52 smithi033 bash[41341]: cluster 2021-07-26T16:08:51.215422+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e706: 8 total, 8 up, 8 in 2021-07-26T16:08:52.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:52 smithi033 bash[42377]: cluster 2021-07-26T16:08:51.179307+0000 mgr.y (mgr.34104) 447 : cluster [DBG] pgmap v883: 25 pgs: 25 active+clean; 855 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 6.3 MiB/s wr, 26 op/s 2021-07-26T16:08:52.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:52 smithi033 bash[42377]: cluster 2021-07-26T16:08:51.215422+0000 mon.a (mon.0) 1080 : cluster [DBG] osdmap e706: 8 total, 8 up, 8 in 2021-07-26T16:08:53.239 INFO:tasks.rados.rados.0.smithi033.stdout:3317: done (1 left) 2021-07-26T16:08:53.239 INFO:tasks.rados.rados.0.smithi033.stdout:3319: done (0 left) 2021-07-26T16:08:53.240 INFO:tasks.rados.rados.0.smithi033.stdout:3320: setattr oid 5 current snap is 332 2021-07-26T16:08:53.242 INFO:tasks.rados.rados.0.smithi033.stdout:3321: snap_remove snap 322 2021-07-26T16:08:53.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:53 smithi033 bash[41341]: cluster 2021-07-26T16:08:52.225472+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e707: 8 total, 8 up, 8 in 2021-07-26T16:08:53.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:53 smithi033 bash[42377]: cluster 2021-07-26T16:08:52.225472+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e707: 8 total, 8 up, 8 in 2021-07-26T16:08:53.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:53 smithi096 bash[33981]: cluster 2021-07-26T16:08:52.225472+0000 mon.a (mon.0) 1081 : cluster [DBG] osdmap e707: 8 total, 8 up, 8 in 2021-07-26T16:08:54.245 INFO:tasks.rados.rados.0.smithi033.stdout:3321: done (1 left) 2021-07-26T16:08:54.246 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 332 2021-07-26T16:08:54.246 INFO:tasks.rados.rados.0.smithi033.stdout:3322: seq_num 998 ranges {14761984=720896,15482880=679936,16162816=598016,16760832=327680} 2021-07-26T16:08:54.333 INFO:tasks.rados.rados.0.smithi033.stdout:3322: writing smithi03339061-36 from 14761984 to 15482880 tid 1 2021-07-26T16:08:54.337 INFO:tasks.rados.rados.0.smithi033.stdout:3322: writing smithi03339061-36 from 15482880 to 16162816 tid 2 2021-07-26T16:08:54.340 INFO:tasks.rados.rados.0.smithi033.stdout:3322: writing smithi03339061-36 from 16162816 to 16760832 tid 3 2021-07-26T16:08:54.342 INFO:tasks.rados.rados.0.smithi033.stdout:3322: writing smithi03339061-36 from 16760832 to 17088512 tid 4 2021-07-26T16:08:54.343 INFO:tasks.rados.rados.0.smithi033.stdout:3323: setattr oid 31 current snap is 332 2021-07-26T16:08:54.343 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 1837 (ObjNum 978 snap 326 seq_num 978) dirty exists 2021-07-26T16:08:54.343 INFO:tasks.rados.rados.0.smithi033.stdout:3320: done (2 left) 2021-07-26T16:08:54.344 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 332 2021-07-26T16:08:54.344 INFO:tasks.rados.rados.0.smithi033.stdout:3324: seq_num 999 ranges {0=737280,737280=565248,1302528=761856,2064384=278528} 2021-07-26T16:08:54.347 INFO:tasks.rados.rados.0.smithi033.stdout:3324: writing smithi03339061-26 from 0 to 737280 tid 1 2021-07-26T16:08:54.351 INFO:tasks.rados.rados.0.smithi033.stdout:3324: writing smithi03339061-26 from 737280 to 1302528 tid 2 2021-07-26T16:08:54.356 INFO:tasks.rados.rados.0.smithi033.stdout:3324: writing smithi03339061-26 from 1302528 to 2064384 tid 3 2021-07-26T16:08:54.358 INFO:tasks.rados.rados.0.smithi033.stdout:3324: writing smithi03339061-26 from 2064384 to 2342912 tid 4 2021-07-26T16:08:54.359 INFO:tasks.rados.rados.0.smithi033.stdout:3325: snap_create 2021-07-26T16:08:54.359 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1380 (ObjNum 887 snap 291 seq_num 887) dirty exists 2021-07-26T16:08:54.359 INFO:tasks.rados.rados.0.smithi033.stdout:3322: finishing write tid 1 to smithi03339061-36 2021-07-26T16:08:54.359 INFO:tasks.rados.rados.0.smithi033.stdout:3322: finishing write tid 2 to smithi03339061-36 2021-07-26T16:08:54.360 INFO:tasks.rados.rados.0.smithi033.stdout:3322: finishing write tid 3 to smithi03339061-36 2021-07-26T16:08:54.360 INFO:tasks.rados.rados.0.smithi033.stdout:3324: finishing write tid 1 to smithi03339061-26 2021-07-26T16:08:54.360 INFO:tasks.rados.rados.0.smithi033.stdout:3324: finishing write tid 2 to smithi03339061-26 2021-07-26T16:08:54.360 INFO:tasks.rados.rados.0.smithi033.stdout:3322: finishing write tid 4 to smithi03339061-36 2021-07-26T16:08:54.360 INFO:tasks.rados.rados.0.smithi033.stdout:3322: finishing write tid 5 to smithi03339061-36 2021-07-26T16:08:54.361 INFO:tasks.rados.rados.0.smithi033.stdout:3322: finishing write tid 6 to smithi03339061-36 2021-07-26T16:08:54.361 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1435 (ObjNum 998 snap 332 seq_num 998) dirty exists 2021-07-26T16:08:54.361 INFO:tasks.rados.rados.0.smithi033.stdout:3322: left oid 36 (ObjNum 998 snap 332 seq_num 998) 2021-07-26T16:08:54.363 INFO:tasks.rados.rados.0.smithi033.stdout:3324: finishing write tid 3 to smithi03339061-26 2021-07-26T16:08:54.363 INFO:tasks.rados.rados.0.smithi033.stdout:3324: finishing write tid 4 to smithi03339061-26 2021-07-26T16:08:54.364 INFO:tasks.rados.rados.0.smithi033.stdout:3324: finishing write tid 5 to smithi03339061-26 2021-07-26T16:08:54.365 INFO:tasks.rados.rados.0.smithi033.stdout:3324: finishing write tid 6 to smithi03339061-26 2021-07-26T16:08:54.365 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 2027 (ObjNum 999 snap 332 seq_num 999) dirty exists 2021-07-26T16:08:54.366 INFO:tasks.rados.rados.0.smithi033.stdout:3324: left oid 26 (ObjNum 999 snap 332 seq_num 999) 2021-07-26T16:08:54.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:54 smithi033 bash[41341]: cluster 2021-07-26T16:08:53.180045+0000 mgr.y (mgr.34104) 448 : cluster [DBG] pgmap v886: 25 pgs: 25 active+clean; 857 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 5.3 MiB/s wr, 25 op/s 2021-07-26T16:08:54.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:54 smithi033 bash[41341]: cluster 2021-07-26T16:08:53.237013+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e708: 8 total, 8 up, 8 in 2021-07-26T16:08:54.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:54 smithi033 bash[42377]: cluster 2021-07-26T16:08:53.180045+0000 mgr.y (mgr.34104) 448 : cluster [DBG] pgmap v886: 25 pgs: 25 active+clean; 857 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 5.3 MiB/s wr, 25 op/s 2021-07-26T16:08:54.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:54 smithi033 bash[42377]: cluster 2021-07-26T16:08:53.237013+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e708: 8 total, 8 up, 8 in 2021-07-26T16:08:54.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:54 smithi096 bash[33981]: cluster 2021-07-26T16:08:53.180045+0000 mgr.y (mgr.34104) 448 : cluster [DBG] pgmap v886: 25 pgs: 25 active+clean; 857 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 5.3 MiB/s wr, 25 op/s 2021-07-26T16:08:54.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:54 smithi096 bash[33981]: cluster 2021-07-26T16:08:53.237013+0000 mon.a (mon.0) 1082 : cluster [DBG] osdmap e708: 8 total, 8 up, 8 in 2021-07-26T16:08:55.264 INFO:tasks.rados.rados.0.smithi033.stdout:3322: done (3 left) 2021-07-26T16:08:55.265 INFO:tasks.rados.rados.0.smithi033.stdout:3323: done (2 left) 2021-07-26T16:08:55.265 INFO:tasks.rados.rados.0.smithi033.stdout:3324: done (1 left) 2021-07-26T16:08:55.265 INFO:tasks.rados.rados.0.smithi033.stdout:3325: done (0 left) 2021-07-26T16:08:55.265 INFO:tasks.rados.rados.0.smithi033.stdout:3326: rollback oid 46 current snap is 333 2021-07-26T16:08:55.266 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 46 to 320 2021-07-26T16:08:55.266 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 333 2021-07-26T16:08:55.266 INFO:tasks.rados.rados.0.smithi033.stdout:3327: seq_num 1000 ranges {0=753664,753664=442368,1196032=565248,1761280=458752,2220032=139264} 2021-07-26T16:08:55.271 INFO:tasks.rados.rados.0.smithi033.stdout:3327: writing smithi03339061-48 from 0 to 753664 tid 1 2021-07-26T16:08:55.273 INFO:tasks.rados.rados.0.smithi033.stdout:3327: writing smithi03339061-48 from 753664 to 1196032 tid 2 2021-07-26T16:08:55.277 INFO:tasks.rados.rados.0.smithi033.stdout:3327: writing smithi03339061-48 from 1196032 to 1761280 tid 3 2021-07-26T16:08:55.280 INFO:tasks.rados.rados.0.smithi033.stdout:3327: writing smithi03339061-48 from 1761280 to 2220032 tid 4 2021-07-26T16:08:55.282 INFO:tasks.rados.rados.0.smithi033.stdout:3327: writing smithi03339061-48 from 2220032 to 2359296 tid 5 2021-07-26T16:08:55.282 INFO:tasks.rados.rados.0.smithi033.stdout:3328: read oid 33 snap -1 2021-07-26T16:08:55.282 INFO:tasks.rados.rados.0.smithi033.stdout:3328: expect (ObjNum 996 snap 329 seq_num 996) 2021-07-26T16:08:55.284 INFO:tasks.rados.rados.0.smithi033.stdout:3329: rollback oid 18 current snap is 333 2021-07-26T16:08:55.284 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 18 to 293 2021-07-26T16:08:55.285 INFO:tasks.rados.rados.0.smithi033.stdout:3326: finishing rollback tid 0 to smithi03339061-46 2021-07-26T16:08:55.285 INFO:tasks.rados.rados.0.smithi033.stdout:3330: read oid 25 snap -1 2021-07-26T16:08:55.285 INFO:tasks.rados.rados.0.smithi033.stdout:3330: expect (ObjNum 833 snap 277 seq_num 833) 2021-07-26T16:08:55.285 INFO:tasks.rados.rados.0.smithi033.stdout:3331: snap_create 2021-07-26T16:08:55.286 INFO:tasks.rados.rados.0.smithi033.stdout:3326: finishing rollback tid 1 to smithi03339061-46 2021-07-26T16:08:55.286 INFO:tasks.rados.rados.0.smithi033.stdout:3326: finishing rollback tid 2 to smithi03339061-46 2021-07-26T16:08:55.286 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1343 (ObjNum 938 snap 315 seq_num 938) dirty exists 2021-07-26T16:08:55.287 INFO:tasks.rados.rados.0.smithi033.stdout:3327: finishing write tid 1 to smithi03339061-48 2021-07-26T16:08:55.287 INFO:tasks.rados.rados.0.smithi033.stdout:3327: finishing write tid 2 to smithi03339061-48 2021-07-26T16:08:55.289 INFO:tasks.rados.rados.0.smithi033.stdout:3327: finishing write tid 3 to smithi03339061-48 2021-07-26T16:08:55.289 INFO:tasks.rados.rados.0.smithi033.stdout:3327: finishing write tid 4 to smithi03339061-48 2021-07-26T16:08:55.289 INFO:tasks.rados.rados.0.smithi033.stdout:3327: finishing write tid 5 to smithi03339061-48 2021-07-26T16:08:55.290 INFO:tasks.rados.rados.0.smithi033.stdout:3327: finishing write tid 6 to smithi03339061-48 2021-07-26T16:08:55.291 INFO:tasks.rados.rados.0.smithi033.stdout:3327: finishing write tid 7 to smithi03339061-48 2021-07-26T16:08:55.291 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 1843 (ObjNum 1000 snap 333 seq_num 1000) dirty exists 2021-07-26T16:08:55.291 INFO:tasks.rados.rados.0.smithi033.stdout:3327: left oid 48 (ObjNum 1000 snap 333 seq_num 1000) 2021-07-26T16:08:55.297 INFO:tasks.rados.rados.0.smithi033.stdout:3330: expect (ObjNum 833 snap 277 seq_num 833) 2021-07-26T16:08:55.361 INFO:tasks.rados.rados.0.smithi033.stdout:3329: finishing rollback tid 0 to smithi03339061-18 2021-07-26T16:08:55.362 INFO:tasks.rados.rados.0.smithi033.stdout:3329: finishing rollback tid 1 to smithi03339061-18 2021-07-26T16:08:55.362 INFO:tasks.rados.rados.0.smithi033.stdout:3328: expect (ObjNum 996 snap 329 seq_num 996) 2021-07-26T16:08:55.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:55 smithi033 bash[42377]: cluster 2021-07-26T16:08:54.240027+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e709: 8 total, 8 up, 8 in 2021-07-26T16:08:55.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:55 smithi033 bash[41341]: cluster 2021-07-26T16:08:54.240027+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e709: 8 total, 8 up, 8 in 2021-07-26T16:08:55.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:55 smithi096 bash[33981]: cluster 2021-07-26T16:08:54.240027+0000 mon.a (mon.0) 1083 : cluster [DBG] osdmap e709: 8 total, 8 up, 8 in 2021-07-26T16:08:55.993 INFO:tasks.rados.rados.0.smithi033.stdout:3329: finishing rollback tid 2 to smithi03339061-18 2021-07-26T16:08:55.993 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 2031 (ObjNum 888 snap 291 seq_num 888) dirty exists 2021-07-26T16:08:56.232 INFO:tasks.rados.rados.0.smithi033.stdout:3326: done (5 left) 2021-07-26T16:08:56.232 INFO:tasks.rados.rados.0.smithi033.stdout:3327: done (4 left) 2021-07-26T16:08:56.232 INFO:tasks.rados.rados.0.smithi033.stdout:3328: done (3 left) 2021-07-26T16:08:56.233 INFO:tasks.rados.rados.0.smithi033.stdout:3329: done (2 left) 2021-07-26T16:08:56.233 INFO:tasks.rados.rados.0.smithi033.stdout:3330: done (1 left) 2021-07-26T16:08:56.233 INFO:tasks.rados.rados.0.smithi033.stdout:3331: done (0 left) 2021-07-26T16:08:56.233 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 334 2021-07-26T16:08:56.233 INFO:tasks.rados.rados.0.smithi033.stdout:3332: seq_num 1001 ranges {2719744=770048,3489792=729088,4218880=770048,4988928=106496} 2021-07-26T16:08:56.255 INFO:tasks.rados.rados.0.smithi033.stdout:3332: writing smithi03339061-22 from 2719744 to 3489792 tid 1 2021-07-26T16:08:56.260 INFO:tasks.rados.rados.0.smithi033.stdout:3332: writing smithi03339061-22 from 3489792 to 4218880 tid 2 2021-07-26T16:08:56.264 INFO:tasks.rados.rados.0.smithi033.stdout:3332: writing smithi03339061-22 from 4218880 to 4988928 tid 3 2021-07-26T16:08:56.265 INFO:tasks.rados.rados.0.smithi033.stdout:3332: writing smithi03339061-22 from 4988928 to 5095424 tid 4 2021-07-26T16:08:56.265 INFO:tasks.rados.rados.0.smithi033.stdout:3333: read oid 32 snap -1 2021-07-26T16:08:56.266 INFO:tasks.rados.rados.0.smithi033.stdout:3333: expect (ObjNum 989 snap 328 seq_num 989) 2021-07-26T16:08:56.266 INFO:tasks.rados.rados.0.smithi033.stdout:3334: rmattr oid 7 current snap is 334 2021-07-26T16:08:56.266 INFO:tasks.rados.rados.0.smithi033.stdout:3335: snap_remove snap 325 2021-07-26T16:08:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:56 smithi033 bash[41341]: cluster 2021-07-26T16:08:55.180749+0000 mgr.y (mgr.34104) 449 : cluster [DBG] pgmap v889: 25 pgs: 25 active+clean; 860 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2021-07-26T16:08:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:56 smithi033 bash[41341]: cluster 2021-07-26T16:08:55.260747+0000 mon.a (mon.0) 1084 : cluster [DBG] osdmap e710: 8 total, 8 up, 8 in 2021-07-26T16:08:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:56 smithi033 bash[41341]: cluster 2021-07-26T16:08:56.225902+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e711: 8 total, 8 up, 8 in 2021-07-26T16:08:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:56 smithi033 bash[42377]: cluster 2021-07-26T16:08:55.180749+0000 mgr.y (mgr.34104) 449 : cluster [DBG] pgmap v889: 25 pgs: 25 active+clean; 860 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2021-07-26T16:08:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:56 smithi033 bash[42377]: cluster 2021-07-26T16:08:55.260747+0000 mon.a (mon.0) 1084 : cluster [DBG] osdmap e710: 8 total, 8 up, 8 in 2021-07-26T16:08:56.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:56 smithi033 bash[42377]: cluster 2021-07-26T16:08:56.225902+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e711: 8 total, 8 up, 8 in 2021-07-26T16:08:56.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:56 smithi096 bash[33981]: cluster 2021-07-26T16:08:55.180749+0000 mgr.y (mgr.34104) 449 : cluster [DBG] pgmap v889: 25 pgs: 25 active+clean; 860 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 1.2 MiB/s wr, 16 op/s 2021-07-26T16:08:56.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:56 smithi096 bash[33981]: cluster 2021-07-26T16:08:55.260747+0000 mon.a (mon.0) 1084 : cluster [DBG] osdmap e710: 8 total, 8 up, 8 in 2021-07-26T16:08:56.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:56 smithi096 bash[33981]: cluster 2021-07-26T16:08:56.225902+0000 mon.a (mon.0) 1085 : cluster [DBG] osdmap e711: 8 total, 8 up, 8 in 2021-07-26T16:08:57.251 INFO:tasks.rados.rados.0.smithi033.stdout:3335: done (3 left) 2021-07-26T16:08:57.251 INFO:tasks.rados.rados.0.smithi033.stdout:3336: snap_remove snap 276 2021-07-26T16:08:58.263 INFO:tasks.rados.rados.0.smithi033.stdout:3336: done (3 left) 2021-07-26T16:08:58.264 INFO:tasks.rados.rados.0.smithi033.stdout:3337: copy_from oid 24 from oid 19 current snap is 334 2021-07-26T16:08:58.264 INFO:tasks.rados.rados.0.smithi033.stdout:3338: setattr oid 47 current snap is 334 2021-07-26T16:08:58.264 INFO:tasks.rados.rados.0.smithi033.stdout:3332: finishing write tid 1 to smithi03339061-22 2021-07-26T16:08:58.264 INFO:tasks.rados.rados.0.smithi033.stdout:3332: finishing write tid 2 to smithi03339061-22 2021-07-26T16:08:58.264 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1666 (ObjNum 1 snap 32561 seq_num 2007338320) dirty exists 2021-07-26T16:08:58.265 INFO:tasks.rados.rados.0.smithi033.stdout:3332: finishing write tid 3 to smithi03339061-22 2021-07-26T16:08:58.265 INFO:tasks.rados.rados.0.smithi033.stdout:3332: finishing write tid 4 to smithi03339061-22 2021-07-26T16:08:58.265 INFO:tasks.rados.rados.0.smithi033.stdout:3332: finishing write tid 5 to smithi03339061-22 2021-07-26T16:08:58.265 INFO:tasks.rados.rados.0.smithi033.stdout:3332: finishing write tid 6 to smithi03339061-22 2021-07-26T16:08:58.266 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 2037 (ObjNum 1001 snap 334 seq_num 1001) dirty exists 2021-07-26T16:08:58.266 INFO:tasks.rados.rados.0.smithi033.stdout:3332: left oid 22 (ObjNum 1001 snap 334 seq_num 1001) 2021-07-26T16:08:58.266 INFO:tasks.rados.rados.0.smithi033.stdout:3333: expect (ObjNum 989 snap 328 seq_num 989) 2021-07-26T16:08:58.356 INFO:tasks.rados.rados.0.smithi033.stdout:3337: finishing copy_from to smithi03339061-24 2021-07-26T16:08:58.356 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1776 (ObjNum 985 snap 328 seq_num 985) dirty exists 2021-07-26T16:08:58.356 INFO:tasks.rados.rados.0.smithi033.stdout:3337: finishing copy_from racing read to smithi03339061-24 2021-07-26T16:08:58.357 INFO:tasks.rados.rados.0.smithi033.stdout:3332: done (4 left) 2021-07-26T16:08:58.357 INFO:tasks.rados.rados.0.smithi033.stdout:3333: done (3 left) 2021-07-26T16:08:58.357 INFO:tasks.rados.rados.0.smithi033.stdout:3334: done (2 left) 2021-07-26T16:08:58.357 INFO:tasks.rados.rados.0.smithi033.stdout:3337: done (1 left) 2021-07-26T16:08:58.357 INFO:tasks.rados.rados.0.smithi033.stdout:3339: delete oid 36 current snap is 334 2021-07-26T16:08:58.362 INFO:tasks.rados.rados.0.smithi033.stdout:3339: done (1 left) 2021-07-26T16:08:58.363 INFO:tasks.rados.rados.0.smithi033.stdout:3340: rollback oid 20 current snap is 334 2021-07-26T16:08:58.363 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 20 to 330 2021-07-26T16:08:58.363 INFO:tasks.rados.rados.0.smithi033.stdout:3341: read oid 49 snap -1 2021-07-26T16:08:58.363 INFO:tasks.rados.rados.0.smithi033.stdout:3341: expect (ObjNum 969 snap 325 seq_num 969) 2021-07-26T16:08:58.364 INFO:tasks.rados.rados.0.smithi033.stdout:3342: snap_create 2021-07-26T16:08:58.364 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1844 (ObjNum 0 snap 32561 seq_num 2008119120) dirty exists 2021-07-26T16:08:58.366 INFO:tasks.rados.rados.0.smithi033.stdout:3340: finishing rollback tid 1 to smithi03339061-20 2021-07-26T16:08:58.367 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1417 (ObjNum 1953066355 snap 858810728 seq_num 809055027) dirty dne 2021-07-26T16:08:58.375 INFO:tasks.rados.rados.0.smithi033.stdout:3341: expect (ObjNum 969 snap 325 seq_num 969) 2021-07-26T16:08:58.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:58 smithi033 bash[41341]: cluster 2021-07-26T16:08:57.181468+0000 mgr.y (mgr.34104) 450 : cluster [DBG] pgmap v892: 25 pgs: 25 active+clean; 860 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.4 MiB/s rd, 568 KiB/s wr, 13 op/s 2021-07-26T16:08:58.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:58 smithi033 bash[41341]: cluster 2021-07-26T16:08:57.244009+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e712: 8 total, 8 up, 8 in 2021-07-26T16:08:58.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:58 smithi033 bash[42377]: cluster 2021-07-26T16:08:57.181468+0000 mgr.y (mgr.34104) 450 : cluster [DBG] pgmap v892: 25 pgs: 25 active+clean; 860 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.4 MiB/s rd, 568 KiB/s wr, 13 op/s 2021-07-26T16:08:58.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:58 smithi033 bash[42377]: cluster 2021-07-26T16:08:57.244009+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e712: 8 total, 8 up, 8 in 2021-07-26T16:08:58.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:58 smithi096 bash[33981]: cluster 2021-07-26T16:08:57.181468+0000 mgr.y (mgr.34104) 450 : cluster [DBG] pgmap v892: 25 pgs: 25 active+clean; 860 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 3.4 MiB/s rd, 568 KiB/s wr, 13 op/s 2021-07-26T16:08:58.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:58 smithi096 bash[33981]: cluster 2021-07-26T16:08:57.244009+0000 mon.a (mon.0) 1086 : cluster [DBG] osdmap e712: 8 total, 8 up, 8 in 2021-07-26T16:08:59.271 INFO:tasks.rados.rados.0.smithi033.stdout:3338: done (3 left) 2021-07-26T16:08:59.271 INFO:tasks.rados.rados.0.smithi033.stdout:3340: done (2 left) 2021-07-26T16:08:59.271 INFO:tasks.rados.rados.0.smithi033.stdout:3341: done (1 left) 2021-07-26T16:08:59.271 INFO:tasks.rados.rados.0.smithi033.stdout:3342: done (0 left) 2021-07-26T16:08:59.272 INFO:tasks.rados.rados.0.smithi033.stdout:3343: read oid 6 snap -1 2021-07-26T16:08:59.272 INFO:tasks.rados.rados.0.smithi033.stdout:3343: expect (ObjNum 891 snap 292 seq_num 891) 2021-07-26T16:08:59.272 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 335 2021-07-26T16:08:59.272 INFO:tasks.rados.rados.0.smithi033.stdout:3344: seq_num 1003 ranges {5013504=802816,5816320=499712,6316032=737280,7053312=368640} 2021-07-26T16:08:59.307 INFO:tasks.rados.rados.0.smithi033.stdout:3344: writing smithi03339061-43 from 5013504 to 5816320 tid 1 2021-07-26T16:08:59.310 INFO:tasks.rados.rados.0.smithi033.stdout:3344: writing smithi03339061-43 from 5816320 to 6316032 tid 2 2021-07-26T16:08:59.314 INFO:tasks.rados.rados.0.smithi033.stdout:3344: writing smithi03339061-43 from 6316032 to 7053312 tid 3 2021-07-26T16:08:59.317 INFO:tasks.rados.rados.0.smithi033.stdout:3344: writing smithi03339061-43 from 7053312 to 7421952 tid 4 2021-07-26T16:08:59.317 INFO:tasks.rados.rados.0.smithi033.stdout:3345: read oid 10 snap -1 2021-07-26T16:08:59.317 INFO:tasks.rados.rados.0.smithi033.stdout:3345: expect (ObjNum 891 snap 292 seq_num 891) 2021-07-26T16:08:59.317 INFO:tasks.rados.rados.0.smithi033.stdout:3346: snap_create 2021-07-26T16:08:59.318 INFO:tasks.rados.rados.0.smithi033.stdout:3343: expect (ObjNum 891 snap 292 seq_num 891) 2021-07-26T16:08:59.340 INFO:tasks.rados.rados.0.smithi033.stdout:3344: finishing write tid 1 to smithi03339061-43 2021-07-26T16:08:59.340 INFO:tasks.rados.rados.0.smithi033.stdout:3344: finishing write tid 2 to smithi03339061-43 2021-07-26T16:08:59.340 INFO:tasks.rados.rados.0.smithi033.stdout:3345: expect (ObjNum 891 snap 292 seq_num 891) 2021-07-26T16:08:59.354 INFO:tasks.rados.rados.0.smithi033.stdout:3344: finishing write tid 3 to smithi03339061-43 2021-07-26T16:08:59.354 INFO:tasks.rados.rados.0.smithi033.stdout:3344: finishing write tid 4 to smithi03339061-43 2021-07-26T16:08:59.355 INFO:tasks.rados.rados.0.smithi033.stdout:3344: finishing write tid 5 to smithi03339061-43 2021-07-26T16:08:59.355 INFO:tasks.rados.rados.0.smithi033.stdout:3344: finishing write tid 6 to smithi03339061-43 2021-07-26T16:08:59.355 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 1848 (ObjNum 1003 snap 335 seq_num 1003) dirty exists 2021-07-26T16:08:59.355 INFO:tasks.rados.rados.0.smithi033.stdout:3344: left oid 43 (ObjNum 1003 snap 335 seq_num 1003) 2021-07-26T16:08:59.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:08:59 smithi033 bash[41341]: cluster 2021-07-26T16:08:58.251764+0000 mon.a (mon.0) 1087 : cluster [DBG] osdmap e713: 8 total, 8 up, 8 in 2021-07-26T16:08:59.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:08:59 smithi033 bash[42377]: cluster 2021-07-26T16:08:58.251764+0000 mon.a (mon.0) 1087 : cluster [DBG] osdmap e713: 8 total, 8 up, 8 in 2021-07-26T16:08:59.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:08:59 smithi096 bash[33981]: cluster 2021-07-26T16:08:58.251764+0000 mon.a (mon.0) 1087 : cluster [DBG] osdmap e713: 8 total, 8 up, 8 in 2021-07-26T16:09:00.270 INFO:tasks.rados.rados.0.smithi033.stdout:3343: done (3 left) 2021-07-26T16:09:00.271 INFO:tasks.rados.rados.0.smithi033.stdout:3344: done (2 left) 2021-07-26T16:09:00.271 INFO:tasks.rados.rados.0.smithi033.stdout:3345: done (1 left) 2021-07-26T16:09:00.271 INFO:tasks.rados.rados.0.smithi033.stdout:3346: done (0 left) 2021-07-26T16:09:00.271 INFO:tasks.rados.rados.0.smithi033.stdout:3347: setattr oid 34 current snap is 336 2021-07-26T16:09:00.274 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 336 2021-07-26T16:09:00.274 INFO:tasks.rados.rados.0.smithi033.stdout:3348: seq_num 1004 ranges {1966080=16384} 2021-07-26T16:09:00.285 INFO:tasks.rados.rados.0.smithi033.stdout:3348: writing smithi03339061-25 from 1966080 to 1982464 tid 1 2021-07-26T16:09:00.286 INFO:tasks.rados.rados.0.smithi033.stdout:3349: delete oid 35 current snap is 336 2021-07-26T16:09:00.286 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1437 (ObjNum 904 snap 302 seq_num 904) dirty exists 2021-07-26T16:09:00.291 INFO:tasks.rados.rados.0.smithi033.stdout:3347: done (2 left) 2021-07-26T16:09:00.291 INFO:tasks.rados.rados.0.smithi033.stdout:3349: done (1 left) 2021-07-26T16:09:00.291 INFO:tasks.rados.rados.0.smithi033.stdout:3350: snap_remove snap 313 2021-07-26T16:09:00.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:00 smithi033 bash[41341]: cluster 2021-07-26T16:08:59.182311+0000 mgr.y (mgr.34104) 451 : cluster [DBG] pgmap v895: 25 pgs: 25 active+clean; 855 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2021-07-26T16:09:00.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:00 smithi033 bash[41341]: cluster 2021-07-26T16:08:59.264810+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e714: 8 total, 8 up, 8 in 2021-07-26T16:09:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:00 smithi033 bash[42377]: cluster 2021-07-26T16:08:59.182311+0000 mgr.y (mgr.34104) 451 : cluster [DBG] pgmap v895: 25 pgs: 25 active+clean; 855 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2021-07-26T16:09:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:00 smithi033 bash[42377]: cluster 2021-07-26T16:08:59.264810+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e714: 8 total, 8 up, 8 in 2021-07-26T16:09:00.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:00 smithi096 bash[33981]: cluster 2021-07-26T16:08:59.182311+0000 mgr.y (mgr.34104) 451 : cluster [DBG] pgmap v895: 25 pgs: 25 active+clean; 855 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 1.1 MiB/s wr, 7 op/s 2021-07-26T16:09:00.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:00 smithi096 bash[33981]: cluster 2021-07-26T16:08:59.264810+0000 mon.a (mon.0) 1088 : cluster [DBG] osdmap e714: 8 total, 8 up, 8 in 2021-07-26T16:09:01.239 INFO:tasks.rados.rados.0.smithi033.stdout:3350: done (1 left) 2021-07-26T16:09:01.240 INFO:tasks.rados.rados.0.smithi033.stdout:3351: rollback oid 35 current snap is 336 2021-07-26T16:09:01.240 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 35 to 311 2021-07-26T16:09:01.240 INFO:tasks.rados.rados.0.smithi033.stdout:3348: finishing write tid 1 to smithi03339061-25 2021-07-26T16:09:01.241 INFO:tasks.rados.rados.0.smithi033.stdout:3348: finishing write tid 2 to smithi03339061-25 2021-07-26T16:09:01.241 INFO:tasks.rados.rados.0.smithi033.stdout:3348: finishing write tid 3 to smithi03339061-25 2021-07-26T16:09:01.241 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 1831 (ObjNum 1004 snap 336 seq_num 1004) dirty exists 2021-07-26T16:09:01.241 INFO:tasks.rados.rados.0.smithi033.stdout:3348: left oid 25 (ObjNum 1004 snap 336 seq_num 1004) 2021-07-26T16:09:01.242 INFO:tasks.rados.rados.0.smithi033.stdout:3348: done (1 left) 2021-07-26T16:09:01.242 INFO:tasks.rados.rados.0.smithi033.stdout:3352: setattr oid 17 current snap is 336 2021-07-26T16:09:01.242 INFO:tasks.rados.rados.0.smithi033.stdout:3353: setattr oid 34 current snap is 336 2021-07-26T16:09:01.243 INFO:tasks.rados.rados.0.smithi033.stdout:3354: snap_create 2021-07-26T16:09:01.247 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 1403 (ObjNum 1 snap 0 seq_num 2008758048) dirty exists 2021-07-26T16:09:01.253 INFO:tasks.rados.rados.0.smithi033.stdout:3351: finishing rollback tid 1 to smithi03339061-35 2021-07-26T16:09:01.254 INFO:tasks.rados.rados.0.smithi033.stdout:3351: finishing rollback tid 2 to smithi03339061-35 2021-07-26T16:09:01.254 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1787 (ObjNum 815 snap 272 seq_num 815) dirty exists 2021-07-26T16:09:01.257 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1438 (ObjNum 904 snap 302 seq_num 904) dirty exists 2021-07-26T16:09:01.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:01 smithi033 bash[41341]: cluster 2021-07-26T16:09:00.266753+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e715: 8 total, 8 up, 8 in 2021-07-26T16:09:01.705 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:01 smithi033 bash[41341]: cluster 2021-07-26T16:09:01.232020+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e716: 8 total, 8 up, 8 in 2021-07-26T16:09:01.706 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:01 smithi033 bash[42377]: cluster 2021-07-26T16:09:00.266753+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e715: 8 total, 8 up, 8 in 2021-07-26T16:09:01.706 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:01 smithi033 bash[42377]: cluster 2021-07-26T16:09:01.232020+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e716: 8 total, 8 up, 8 in 2021-07-26T16:09:01.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:01 smithi096 bash[33981]: cluster 2021-07-26T16:09:00.266753+0000 mon.a (mon.0) 1089 : cluster [DBG] osdmap e715: 8 total, 8 up, 8 in 2021-07-26T16:09:01.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:01 smithi096 bash[33981]: cluster 2021-07-26T16:09:01.232020+0000 mon.a (mon.0) 1090 : cluster [DBG] osdmap e716: 8 total, 8 up, 8 in 2021-07-26T16:09:02.249 INFO:tasks.rados.rados.0.smithi033.stdout:3351: done (3 left) 2021-07-26T16:09:02.250 INFO:tasks.rados.rados.0.smithi033.stdout:3352: done (2 left) 2021-07-26T16:09:02.250 INFO:tasks.rados.rados.0.smithi033.stdout:3353: done (1 left) 2021-07-26T16:09:02.250 INFO:tasks.rados.rados.0.smithi033.stdout:3354: done (0 left) 2021-07-26T16:09:02.250 INFO:tasks.rados.rados.0.smithi033.stdout:3355: snap_create 2021-07-26T16:09:02.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:02 smithi033 bash[41341]: cluster 2021-07-26T16:09:01.183104+0000 mgr.y (mgr.34104) 452 : cluster [DBG] pgmap v898: 25 pgs: 25 active+clean; 859 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2021-07-26T16:09:02.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:02 smithi033 bash[41341]: cluster 2021-07-26T16:09:02.246617+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e717: 8 total, 8 up, 8 in 2021-07-26T16:09:02.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:02 smithi033 bash[42377]: cluster 2021-07-26T16:09:01.183104+0000 mgr.y (mgr.34104) 452 : cluster [DBG] pgmap v898: 25 pgs: 25 active+clean; 859 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2021-07-26T16:09:02.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:02 smithi033 bash[42377]: cluster 2021-07-26T16:09:02.246617+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e717: 8 total, 8 up, 8 in 2021-07-26T16:09:02.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:02 smithi096 bash[33981]: cluster 2021-07-26T16:09:01.183104+0000 mgr.y (mgr.34104) 452 : cluster [DBG] pgmap v898: 25 pgs: 25 active+clean; 859 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 7.1 MiB/s rd, 1.7 MiB/s wr, 9 op/s 2021-07-26T16:09:02.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:02 smithi096 bash[33981]: cluster 2021-07-26T16:09:02.246617+0000 mon.a (mon.0) 1091 : cluster [DBG] osdmap e717: 8 total, 8 up, 8 in 2021-07-26T16:09:03.252 INFO:tasks.rados.rados.0.smithi033.stdout:3355: done (0 left) 2021-07-26T16:09:03.253 INFO:tasks.rados.rados.0.smithi033.stdout:3356: read oid 39 snap 295 2021-07-26T16:09:03.253 INFO:tasks.rados.rados.0.smithi033.stdout:3356: expect (ObjNum 833 snap 277 seq_num 833) 2021-07-26T16:09:03.253 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 338 2021-07-26T16:09:03.253 INFO:tasks.rados.rados.0.smithi033.stdout:3357: seq_num 1006 ranges {1875968=49152} 2021-07-26T16:09:03.268 INFO:tasks.rados.rados.0.smithi033.stdout:3357: writing smithi03339061-38 from 1875968 to 1925120 tid 1 2021-07-26T16:09:03.268 INFO:tasks.rados.rados.0.smithi033.stdout:3358: read oid 21 snap -1 2021-07-26T16:09:03.268 INFO:tasks.rados.rados.0.smithi033.stdout:3358: expect (ObjNum 951 snap 321 seq_num 951) 2021-07-26T16:09:03.269 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 338 2021-07-26T16:09:03.269 INFO:tasks.rados.rados.0.smithi033.stdout:3359: seq_num 1007 ranges {2965504=65536} 2021-07-26T16:09:03.287 INFO:tasks.rados.rados.0.smithi033.stdout:3359: writing smithi03339061-28 from 2965504 to 3031040 tid 1 2021-07-26T16:09:03.288 INFO:tasks.rados.rados.0.smithi033.stdout:3360: snap_remove snap 326 2021-07-26T16:09:04.296 INFO:tasks.rados.rados.0.smithi033.stdout:3360: done (4 left) 2021-07-26T16:09:04.296 INFO:tasks.rados.rados.0.smithi033.stdout:3361: read oid 29 snap 318 2021-07-26T16:09:04.296 INFO:tasks.rados.rados.0.smithi033.stdout:3361: expect (ObjNum 946 snap 318 seq_num 946) 2021-07-26T16:09:04.297 INFO:tasks.rados.rados.0.smithi033.stdout:3362: delete oid 14 current snap is 338 2021-07-26T16:09:04.297 INFO:tasks.rados.rados.0.smithi033.stdout:3356: expect (ObjNum 833 snap 277 seq_num 833) 2021-07-26T16:09:04.358 INFO:tasks.rados.rados.0.smithi033.stdout:3357: finishing write tid 1 to smithi03339061-38 2021-07-26T16:09:04.359 INFO:tasks.rados.rados.0.smithi033.stdout:3357: finishing write tid 2 to smithi03339061-38 2021-07-26T16:09:04.359 INFO:tasks.rados.rados.0.smithi033.stdout:3357: finishing write tid 3 to smithi03339061-38 2021-07-26T16:09:04.359 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 735 (ObjNum 1006 snap 338 seq_num 1006) dirty exists 2021-07-26T16:09:04.359 INFO:tasks.rados.rados.0.smithi033.stdout:3357: left oid 38 (ObjNum 1006 snap 338 seq_num 1006) 2021-07-26T16:09:04.360 INFO:tasks.rados.rados.0.smithi033.stdout:3358: expect (ObjNum 951 snap 321 seq_num 951) 2021-07-26T16:09:04.572 INFO:tasks.rados.rados.0.smithi033.stdout:3359: finishing write tid 1 to smithi03339061-28 2021-07-26T16:09:04.573 INFO:tasks.rados.rados.0.smithi033.stdout:3359: finishing write tid 2 to smithi03339061-28 2021-07-26T16:09:04.573 INFO:tasks.rados.rados.0.smithi033.stdout:3359: finishing write tid 3 to smithi03339061-28 2021-07-26T16:09:04.573 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1591 (ObjNum 1007 snap 338 seq_num 1007) dirty exists 2021-07-26T16:09:04.573 INFO:tasks.rados.rados.0.smithi033.stdout:3359: left oid 28 (ObjNum 1007 snap 338 seq_num 1007) 2021-07-26T16:09:04.574 INFO:tasks.rados.rados.0.smithi033.stdout:3361: expect (ObjNum 946 snap 318 seq_num 946) 2021-07-26T16:09:04.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:04 smithi033 bash[42377]: cluster 2021-07-26T16:09:03.183841+0000 mgr.y (mgr.34104) 453 : cluster [DBG] pgmap v901: 25 pgs: 25 active+clean; 861 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2021-07-26T16:09:04.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:04 smithi033 bash[42377]: cluster 2021-07-26T16:09:03.249685+0000 mon.a (mon.0) 1092 : cluster [DBG] osdmap e718: 8 total, 8 up, 8 in 2021-07-26T16:09:04.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:04 smithi033 bash[41341]: cluster 2021-07-26T16:09:03.183841+0000 mgr.y (mgr.34104) 453 : cluster [DBG] pgmap v901: 25 pgs: 25 active+clean; 861 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2021-07-26T16:09:04.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:04 smithi033 bash[41341]: cluster 2021-07-26T16:09:03.249685+0000 mon.a (mon.0) 1092 : cluster [DBG] osdmap e718: 8 total, 8 up, 8 in 2021-07-26T16:09:04.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:04 smithi096 bash[33981]: cluster 2021-07-26T16:09:03.183841+0000 mgr.y (mgr.34104) 453 : cluster [DBG] pgmap v901: 25 pgs: 25 active+clean; 861 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 12 op/s 2021-07-26T16:09:04.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:04 smithi096 bash[33981]: cluster 2021-07-26T16:09:03.249685+0000 mon.a (mon.0) 1092 : cluster [DBG] osdmap e718: 8 total, 8 up, 8 in 2021-07-26T16:09:04.823 INFO:tasks.rados.rados.0.smithi033.stdout:3356: done (5 left) 2021-07-26T16:09:04.824 INFO:tasks.rados.rados.0.smithi033.stdout:3357: done (4 left) 2021-07-26T16:09:04.824 INFO:tasks.rados.rados.0.smithi033.stdout:3358: done (3 left) 2021-07-26T16:09:04.824 INFO:tasks.rados.rados.0.smithi033.stdout:3359: done (2 left) 2021-07-26T16:09:04.824 INFO:tasks.rados.rados.0.smithi033.stdout:3361: done (1 left) 2021-07-26T16:09:04.824 INFO:tasks.rados.rados.0.smithi033.stdout:3362: done (0 left) 2021-07-26T16:09:04.825 INFO:tasks.rados.rados.0.smithi033.stdout:3363: rollback oid 24 current snap is 338 2021-07-26T16:09:04.825 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 24 to 318 2021-07-26T16:09:04.825 INFO:tasks.rados.rados.0.smithi033.stdout:3364: rollback oid 26 current snap is 338 2021-07-26T16:09:04.825 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 26 to 318 2021-07-26T16:09:04.825 INFO:tasks.rados.rados.0.smithi033.stdout:3365: snap_remove snap 310 2021-07-26T16:09:05.301 INFO:tasks.rados.rados.0.smithi033.stdout:3365: done (2 left) 2021-07-26T16:09:05.301 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 338 2021-07-26T16:09:05.302 INFO:tasks.rados.rados.0.smithi033.stdout:3366: seq_num 1009 ranges {13074432=106496} 2021-07-26T16:09:05.378 INFO:tasks.rados.rados.0.smithi033.stdout:3366: writing smithi03339061-12 from 13074432 to 13180928 tid 1 2021-07-26T16:09:05.378 INFO:tasks.rados.rados.0.smithi033.stdout:3367: snap_remove snap 327 2021-07-26T16:09:05.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:05 smithi033 bash[41341]: cluster 2021-07-26T16:09:04.290285+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e719: 8 total, 8 up, 8 in 2021-07-26T16:09:05.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:05 smithi033 bash[42377]: cluster 2021-07-26T16:09:04.290285+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e719: 8 total, 8 up, 8 in 2021-07-26T16:09:05.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:05 smithi096 bash[33981]: cluster 2021-07-26T16:09:04.290285+0000 mon.a (mon.0) 1093 : cluster [DBG] osdmap e719: 8 total, 8 up, 8 in 2021-07-26T16:09:06.241 INFO:tasks.rados.rados.0.smithi033.stdout:3364: finishing rollback tid 0 to smithi03339061-26 2021-07-26T16:09:06.241 INFO:tasks.rados.rados.0.smithi033.stdout:3364: finishing rollback tid 1 to smithi03339061-26 2021-07-26T16:09:06.241 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 2070 (ObjNum 2001415224 snap 22002 seq_num 10657792) dirty dne 2021-07-26T16:09:06.241 INFO:tasks.rados.rados.0.smithi033.stdout:3363: finishing rollback tid 0 to smithi03339061-24 2021-07-26T16:09:06.242 INFO:tasks.rados.rados.0.smithi033.stdout:3363: finishing rollback tid 1 to smithi03339061-24 2021-07-26T16:09:06.242 INFO:tasks.rados.rados.0.smithi033.stdout:3363: finishing rollback tid 2 to smithi03339061-24 2021-07-26T16:09:06.242 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1847 (ObjNum 911 snap 305 seq_num 911) dirty exists 2021-07-26T16:09:06.242 INFO:tasks.rados.rados.0.smithi033.stdout:3366: finishing write tid 1 to smithi03339061-12 2021-07-26T16:09:06.243 INFO:tasks.rados.rados.0.smithi033.stdout:3366: finishing write tid 2 to smithi03339061-12 2021-07-26T16:09:06.243 INFO:tasks.rados.rados.0.smithi033.stdout:3366: finishing write tid 3 to smithi03339061-12 2021-07-26T16:09:06.243 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1593 (ObjNum 1009 snap 338 seq_num 1009) dirty exists 2021-07-26T16:09:06.243 INFO:tasks.rados.rados.0.smithi033.stdout:3366: left oid 12 (ObjNum 1009 snap 338 seq_num 1009) 2021-07-26T16:09:06.244 INFO:tasks.rados.rados.0.smithi033.stdout:3363: done (3 left) 2021-07-26T16:09:06.244 INFO:tasks.rados.rados.0.smithi033.stdout:3364: done (2 left) 2021-07-26T16:09:06.244 INFO:tasks.rados.rados.0.smithi033.stdout:3366: done (1 left) 2021-07-26T16:09:06.244 INFO:tasks.rados.rados.0.smithi033.stdout:3367: done (0 left) 2021-07-26T16:09:06.244 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 37 current snap is 338 2021-07-26T16:09:06.245 INFO:tasks.rados.rados.0.smithi033.stdout:3368: seq_num 1010 ranges {1736704=122880} 2021-07-26T16:09:06.252 INFO:tasks.rados.rados.0.smithi033.stdout:3368: writing smithi03339061-37 from 1736704 to 1859584 tid 1 2021-07-26T16:09:06.253 INFO:tasks.rados.rados.0.smithi033.stdout:3369: copy_from oid 10 from oid 6 current snap is 338 2021-07-26T16:09:06.253 INFO:tasks.rados.rados.0.smithi033.stdout:3370: rmattr oid 23 current snap is 338 2021-07-26T16:09:06.253 INFO:tasks.rados.rados.0.smithi033.stdout:3370: done (2 left) 2021-07-26T16:09:06.253 INFO:tasks.rados.rados.0.smithi033.stdout:3371: read oid 49 snap -1 2021-07-26T16:09:06.253 INFO:tasks.rados.rados.0.smithi033.stdout:3371: expect (ObjNum 969 snap 325 seq_num 969) 2021-07-26T16:09:06.254 INFO:tasks.rados.rados.0.smithi033.stdout:3372: read oid 22 snap -1 2021-07-26T16:09:06.254 INFO:tasks.rados.rados.0.smithi033.stdout:3372: expect (ObjNum 1001 snap 334 seq_num 1001) 2021-07-26T16:09:06.254 INFO:tasks.rados.rados.0.smithi033.stdout:3373: rmattr oid 34 current snap is 338 2021-07-26T16:09:06.254 INFO:tasks.rados.rados.0.smithi033.stdout:3374: read oid 2 snap -1 2021-07-26T16:09:06.255 INFO:tasks.rados.rados.0.smithi033.stdout:3374: expect (ObjNum 991 snap 328 seq_num 991) 2021-07-26T16:09:06.255 INFO:tasks.rados.rados.0.smithi033.stdout:3375: copy_from oid 35 from oid 27 current snap is 338 2021-07-26T16:09:06.255 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 338 2021-07-26T16:09:06.255 INFO:tasks.rados.rados.0.smithi033.stdout:3376: seq_num 1011 ranges {2187264=139264} 2021-07-26T16:09:06.268 INFO:tasks.rados.rados.0.smithi033.stdout:3376: writing smithi03339061-45 from 2187264 to 2326528 tid 1 2021-07-26T16:09:06.268 INFO:tasks.rados.rados.0.smithi033.stdout:3377: read oid 38 snap -1 2021-07-26T16:09:06.268 INFO:tasks.rados.rados.0.smithi033.stdout:3377: expect (ObjNum 1006 snap 338 seq_num 1006) 2021-07-26T16:09:06.269 INFO:tasks.rados.rados.0.smithi033.stdout:3378: read oid 48 snap -1 2021-07-26T16:09:06.269 INFO:tasks.rados.rados.0.smithi033.stdout:3378: expect (ObjNum 1000 snap 333 seq_num 1000) 2021-07-26T16:09:06.269 INFO:tasks.rados.rados.0.smithi033.stdout:3379: delete oid 43 current snap is 338 2021-07-26T16:09:06.270 INFO:tasks.rados.rados.0.smithi033.stdout:3371: expect (ObjNum 969 snap 325 seq_num 969) 2021-07-26T16:09:06.331 INFO:tasks.rados.rados.0.smithi033.stdout:3368: finishing write tid 1 to smithi03339061-37 2021-07-26T16:09:06.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1439 (ObjNum 904 snap 302 seq_num 904) dirty exists 2021-07-26T16:09:06.332 INFO:tasks.rados.rados.0.smithi033.stdout:3371: done (10 left) 2021-07-26T16:09:06.332 INFO:tasks.rados.rados.0.smithi033.stdout:3373: done (9 left) 2021-07-26T16:09:06.332 INFO:tasks.rados.rados.0.smithi033.stdout:3379: done (8 left) 2021-07-26T16:09:06.332 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 338 2021-07-26T16:09:06.333 INFO:tasks.rados.rados.0.smithi033.stdout:3375: finishing copy_from to smithi03339061-35 2021-07-26T16:09:06.333 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1584 (ObjNum 806 snap 268 seq_num 806) dirty exists 2021-07-26T16:09:06.333 INFO:tasks.rados.rados.0.smithi033.stdout:3380: seq_num 1013 ranges {0=172032} 2021-07-26T16:09:06.334 INFO:tasks.rados.rados.0.smithi033.stdout:3380: writing smithi03339061-40 from 0 to 172032 tid 1 2021-07-26T16:09:06.334 INFO:tasks.rados.rados.0.smithi033.stdout:3381: setattr oid 23 current snap is 338 2021-07-26T16:09:06.334 INFO:tasks.rados.rados.0.smithi033.stdout:3377: expect (ObjNum 1006 snap 338 seq_num 1006) 2021-07-26T16:09:06.415 INFO:tasks.rados.rados.0.smithi033.stdout:3368: finishing write tid 2 to smithi03339061-37 2021-07-26T16:09:06.415 INFO:tasks.rados.rados.0.smithi033.stdout:3375: finishing copy_from racing read to smithi03339061-35 2021-07-26T16:09:06.416 INFO:tasks.rados.rados.0.smithi033.stdout:3372: expect (ObjNum 1001 snap 334 seq_num 1001) 2021-07-26T16:09:06.605 INFO:tasks.rados.rados.0.smithi033.stdout:3368: finishing write tid 3 to smithi03339061-37 2021-07-26T16:09:06.605 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 37 v 1849 (ObjNum 1010 snap 338 seq_num 1010) dirty exists 2021-07-26T16:09:06.605 INFO:tasks.rados.rados.0.smithi033.stdout:3368: left oid 37 (ObjNum 1010 snap 338 seq_num 1010) 2021-07-26T16:09:06.606 INFO:tasks.rados.rados.0.smithi033.stdout:3378: expect (ObjNum 1000 snap 333 seq_num 1000) 2021-07-26T16:09:06.665 INFO:tasks.rados.rados.0.smithi033.stdout:3376: finishing write tid 1 to smithi03339061-45 2021-07-26T16:09:06.666 INFO:tasks.rados.rados.0.smithi033.stdout:3376: finishing write tid 2 to smithi03339061-45 2021-07-26T16:09:06.666 INFO:tasks.rados.rados.0.smithi033.stdout:3369: finishing copy_from to smithi03339061-10 2021-07-26T16:09:06.666 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1820 (ObjNum 891 snap 292 seq_num 891) dirty exists 2021-07-26T16:09:06.666 INFO:tasks.rados.rados.0.smithi033.stdout:3376: finishing write tid 3 to smithi03339061-45 2021-07-26T16:09:06.667 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 2089 (ObjNum 1011 snap 338 seq_num 1011) dirty exists 2021-07-26T16:09:06.667 INFO:tasks.rados.rados.0.smithi033.stdout:3376: left oid 45 (ObjNum 1011 snap 338 seq_num 1011) 2021-07-26T16:09:06.667 INFO:tasks.rados.rados.0.smithi033.stdout:3369: finishing copy_from racing read to smithi03339061-10 2021-07-26T16:09:06.667 INFO:tasks.rados.rados.0.smithi033.stdout:3374: expect (ObjNum 991 snap 328 seq_num 991) 2021-07-26T16:09:06.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:06 smithi033 bash[41341]: cluster 2021-07-26T16:09:05.184534+0000 mgr.y (mgr.34104) 454 : cluster [DBG] pgmap v904: 25 pgs: 25 active+clean; 864 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2021-07-26T16:09:06.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:06 smithi033 bash[41341]: cluster 2021-07-26T16:09:05.293343+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e720: 8 total, 8 up, 8 in 2021-07-26T16:09:06.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:06 smithi033 bash[41341]: cluster 2021-07-26T16:09:06.235289+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e721: 8 total, 8 up, 8 in 2021-07-26T16:09:06.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:06 smithi033 bash[42377]: cluster 2021-07-26T16:09:05.184534+0000 mgr.y (mgr.34104) 454 : cluster [DBG] pgmap v904: 25 pgs: 25 active+clean; 864 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2021-07-26T16:09:06.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:06 smithi033 bash[42377]: cluster 2021-07-26T16:09:05.293343+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e720: 8 total, 8 up, 8 in 2021-07-26T16:09:06.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:06 smithi033 bash[42377]: cluster 2021-07-26T16:09:06.235289+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e721: 8 total, 8 up, 8 in 2021-07-26T16:09:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:06 smithi096 bash[33981]: cluster 2021-07-26T16:09:05.184534+0000 mgr.y (mgr.34104) 454 : cluster [DBG] pgmap v904: 25 pgs: 25 active+clean; 864 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 4.0 MiB/s rd, 1.1 MiB/s wr, 21 op/s 2021-07-26T16:09:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:06 smithi096 bash[33981]: cluster 2021-07-26T16:09:05.293343+0000 mon.a (mon.0) 1094 : cluster [DBG] osdmap e720: 8 total, 8 up, 8 in 2021-07-26T16:09:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:06 smithi096 bash[33981]: cluster 2021-07-26T16:09:06.235289+0000 mon.a (mon.0) 1095 : cluster [DBG] osdmap e721: 8 total, 8 up, 8 in 2021-07-26T16:09:07.075 INFO:tasks.rados.rados.0.smithi033.stdout:3380: finishing write tid 1 to smithi03339061-40 2021-07-26T16:09:07.075 INFO:tasks.rados.rados.0.smithi033.stdout:3380: finishing write tid 2 to smithi03339061-40 2021-07-26T16:09:07.076 INFO:tasks.rados.rados.0.smithi033.stdout:3380: finishing write tid 3 to smithi03339061-40 2021-07-26T16:09:07.076 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 1405 (ObjNum 1013 snap 338 seq_num 1013) dirty exists 2021-07-26T16:09:07.077 INFO:tasks.rados.rados.0.smithi033.stdout:3380: left oid 40 (ObjNum 1013 snap 338 seq_num 1013) 2021-07-26T16:09:07.077 INFO:tasks.rados.rados.0.smithi033.stdout:3368: done (9 left) 2021-07-26T16:09:07.078 INFO:tasks.rados.rados.0.smithi033.stdout:3369: done (8 left) 2021-07-26T16:09:07.078 INFO:tasks.rados.rados.0.smithi033.stdout:3372: done (7 left) 2021-07-26T16:09:07.078 INFO:tasks.rados.rados.0.smithi033.stdout:3374: done (6 left) 2021-07-26T16:09:07.078 INFO:tasks.rados.rados.0.smithi033.stdout:3375: done (5 left) 2021-07-26T16:09:07.079 INFO:tasks.rados.rados.0.smithi033.stdout:3376: done (4 left) 2021-07-26T16:09:07.079 INFO:tasks.rados.rados.0.smithi033.stdout:3377: done (3 left) 2021-07-26T16:09:07.080 INFO:tasks.rados.rados.0.smithi033.stdout:3378: done (2 left) 2021-07-26T16:09:07.080 INFO:tasks.rados.rados.0.smithi033.stdout:3380: done (1 left) 2021-07-26T16:09:07.080 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 338 2021-07-26T16:09:07.080 INFO:tasks.rados.rados.0.smithi033.stdout:3382: seq_num 1014 ranges {1843200=188416} 2021-07-26T16:09:07.092 INFO:tasks.rados.rados.0.smithi033.stdout:3382: writing smithi03339061-49 from 1843200 to 2031616 tid 1 2021-07-26T16:09:07.092 INFO:tasks.rados.rados.0.smithi033.stdout:3383: read oid 48 snap -1 2021-07-26T16:09:07.092 INFO:tasks.rados.rados.0.smithi033.stdout:3383: expect (ObjNum 1000 snap 333 seq_num 1000) 2021-07-26T16:09:07.093 INFO:tasks.rados.rados.0.smithi033.stdout:3384: read oid 2 snap -1 2021-07-26T16:09:07.093 INFO:tasks.rados.rados.0.smithi033.stdout:3384: expect (ObjNum 991 snap 328 seq_num 991) 2021-07-26T16:09:07.093 INFO:tasks.rados.rados.0.smithi033.stdout:3385: read oid 8 snap -1 2021-07-26T16:09:07.093 INFO:tasks.rados.rados.0.smithi033.stdout:3385: expect (ObjNum 896 snap 295 seq_num 896) 2021-07-26T16:09:07.094 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 338 2021-07-26T16:09:07.094 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1704 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:09:07.094 INFO:tasks.rados.rados.0.smithi033.stdout:3386: seq_num 1015 ranges {0=204800} 2021-07-26T16:09:07.095 INFO:tasks.rados.rados.0.smithi033.stdout:3386: writing smithi03339061-20 from 0 to 204800 tid 1 2021-07-26T16:09:07.095 INFO:tasks.rados.rados.0.smithi033.stdout:3381: done (5 left) 2021-07-26T16:09:07.095 INFO:tasks.rados.rados.0.smithi033.stdout:3387: rollback oid 3 current snap is 338 2021-07-26T16:09:07.095 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 3 to 302 2021-07-26T16:09:07.096 INFO:tasks.rados.rados.0.smithi033.stdout:3388: snap_create 2021-07-26T16:09:07.101 INFO:tasks.rados.rados.0.smithi033.stdout:3387: finishing rollback tid 0 to smithi03339061-3 2021-07-26T16:09:07.102 INFO:tasks.rados.rados.0.smithi033.stdout:3387: finishing rollback tid 1 to smithi03339061-3 2021-07-26T16:09:07.103 INFO:tasks.rados.rados.0.smithi033.stdout:3387: finishing rollback tid 2 to smithi03339061-3 2021-07-26T16:09:07.103 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1829 (ObjNum 1 snap 32561 seq_num 2007675672) dirty exists 2021-07-26T16:09:07.103 INFO:tasks.rados.rados.0.smithi033.stdout:3386: finishing write tid 1 to smithi03339061-20 2021-07-26T16:09:07.103 INFO:tasks.rados.rados.0.smithi033.stdout:3386: finishing write tid 2 to smithi03339061-20 2021-07-26T16:09:07.104 INFO:tasks.rados.rados.0.smithi033.stdout:3382: finishing write tid 1 to smithi03339061-49 2021-07-26T16:09:07.104 INFO:tasks.rados.rados.0.smithi033.stdout:3382: finishing write tid 2 to smithi03339061-49 2021-07-26T16:09:07.105 INFO:tasks.rados.rados.0.smithi033.stdout:3386: finishing write tid 3 to smithi03339061-20 2021-07-26T16:09:07.105 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 1606 (ObjNum 1015 snap 338 seq_num 1015) dirty exists 2021-07-26T16:09:07.105 INFO:tasks.rados.rados.0.smithi033.stdout:3386: left oid 20 (ObjNum 1015 snap 338 seq_num 1015) 2021-07-26T16:09:07.106 INFO:tasks.rados.rados.0.smithi033.stdout:3382: finishing write tid 3 to smithi03339061-49 2021-07-26T16:09:07.106 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 940 (ObjNum 1014 snap 338 seq_num 1014) dirty exists 2021-07-26T16:09:07.106 INFO:tasks.rados.rados.0.smithi033.stdout:3382: left oid 49 (ObjNum 1014 snap 338 seq_num 1014) 2021-07-26T16:09:07.107 INFO:tasks.rados.rados.0.smithi033.stdout:3385: expect (ObjNum 896 snap 295 seq_num 896) 2021-07-26T16:09:07.282 INFO:tasks.rados.rados.0.smithi033.stdout:3383: expect (ObjNum 1000 snap 333 seq_num 1000) 2021-07-26T16:09:07.346 INFO:tasks.rados.rados.0.smithi033.stdout:3384: expect (ObjNum 991 snap 328 seq_num 991) 2021-07-26T16:09:07.744 INFO:tasks.rados.rados.0.smithi033.stdout:3382: done (6 left) 2021-07-26T16:09:07.744 INFO:tasks.rados.rados.0.smithi033.stdout:3383: done (5 left) 2021-07-26T16:09:07.744 INFO:tasks.rados.rados.0.smithi033.stdout:3384: done (4 left) 2021-07-26T16:09:07.744 INFO:tasks.rados.rados.0.smithi033.stdout:3385: done (3 left) 2021-07-26T16:09:07.745 INFO:tasks.rados.rados.0.smithi033.stdout:3386: done (2 left) 2021-07-26T16:09:07.745 INFO:tasks.rados.rados.0.smithi033.stdout:3387: done (1 left) 2021-07-26T16:09:07.745 INFO:tasks.rados.rados.0.smithi033.stdout:3388: done (0 left) 2021-07-26T16:09:07.745 INFO:tasks.rados.rados.0.smithi033.stdout:3389: copy_from oid 35 from oid 14 current snap is 339 2021-07-26T16:09:07.746 INFO:tasks.rados.rados.0.smithi033.stdout:3390: read oid 41 snap -1 2021-07-26T16:09:07.746 INFO:tasks.rados.rados.0.smithi033.stdout:3390: expect (ObjNum 984 snap 327 seq_num 984) 2021-07-26T16:09:07.746 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 339 2021-07-26T16:09:07.746 INFO:tasks.rados.rados.0.smithi033.stdout:3391: seq_num 1016 ranges {2523136=221184} 2021-07-26T16:09:07.768 INFO:tasks.rados.rados.0.smithi033.stdout:3391: writing smithi03339061-5 from 2523136 to 2744320 tid 1 2021-07-26T16:09:07.768 INFO:tasks.rados.rados.0.smithi033.stdout:3392: copy_from oid 47 from oid 21 current snap is 339 2021-07-26T16:09:07.769 INFO:tasks.rados.rados.0.smithi033.stdout:3389: finishing copy_from to smithi03339061-35 2021-07-26T16:09:07.769 INFO:tasks.rados.rados.0.smithi033.stdout:3389: got expected ENOENT (src dne) 2021-07-26T16:09:07.769 INFO:tasks.rados.rados.0.smithi033.stdout:3393: snap_create 2021-07-26T16:09:07.769 INFO:tasks.rados.rados.0.smithi033.stdout:3389: finishing copy_from racing read to smithi03339061-35 2021-07-26T16:09:07.828 INFO:tasks.rados.rados.0.smithi033.stdout:3392: finishing copy_from to smithi03339061-47 2021-07-26T16:09:07.828 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1552 (ObjNum 951 snap 321 seq_num 951) dirty exists 2021-07-26T16:09:07.829 INFO:tasks.rados.rados.0.smithi033.stdout:3392: finishing copy_from racing read to smithi03339061-47 2021-07-26T16:09:07.862 INFO:tasks.rados.rados.0.smithi033.stdout:3390: expect (ObjNum 984 snap 327 seq_num 984) 2021-07-26T16:09:08.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:08 smithi033 bash[41341]: cluster 2021-07-26T16:09:07.185158+0000 mgr.y (mgr.34104) 455 : cluster [DBG] pgmap v907: 25 pgs: 25 active+clean; 870 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 604 KiB/s wr, 18 op/s 2021-07-26T16:09:08.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:08 smithi033 bash[41341]: cluster 2021-07-26T16:09:07.321253+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e722: 8 total, 8 up, 8 in 2021-07-26T16:09:08.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:08 smithi033 bash[42377]: cluster 2021-07-26T16:09:07.185158+0000 mgr.y (mgr.34104) 455 : cluster [DBG] pgmap v907: 25 pgs: 25 active+clean; 870 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 604 KiB/s wr, 18 op/s 2021-07-26T16:09:08.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:08 smithi033 bash[42377]: cluster 2021-07-26T16:09:07.321253+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e722: 8 total, 8 up, 8 in 2021-07-26T16:09:08.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:08 smithi096 bash[33981]: cluster 2021-07-26T16:09:07.185158+0000 mgr.y (mgr.34104) 455 : cluster [DBG] pgmap v907: 25 pgs: 25 active+clean; 870 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 3.2 MiB/s rd, 604 KiB/s wr, 18 op/s 2021-07-26T16:09:08.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:08 smithi096 bash[33981]: cluster 2021-07-26T16:09:07.321253+0000 mon.a (mon.0) 1096 : cluster [DBG] osdmap e722: 8 total, 8 up, 8 in 2021-07-26T16:09:09.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:09 smithi033 bash[41341]: cluster 2021-07-26T16:09:08.325971+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e723: 8 total, 8 up, 8 in 2021-07-26T16:09:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:09 smithi033 bash[41341]: audit 2021-07-26T16:09:09.253118+0000 mon.c (mon.1) 266 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:09:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:09 smithi033 bash[41341]: audit 2021-07-26T16:09:09.253877+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:09:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:09 smithi033 bash[41341]: audit 2021-07-26T16:09:09.271383+0000 mon.c (mon.1) 267 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:09:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:09 smithi033 bash[41341]: audit 2021-07-26T16:09:09.272211+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:09:09.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:09 smithi033 bash[42377]: cluster 2021-07-26T16:09:08.325971+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e723: 8 total, 8 up, 8 in 2021-07-26T16:09:09.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:09 smithi033 bash[42377]: audit 2021-07-26T16:09:09.253118+0000 mon.c (mon.1) 266 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:09:09.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:09 smithi033 bash[42377]: audit 2021-07-26T16:09:09.253877+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:09:09.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:09 smithi033 bash[42377]: audit 2021-07-26T16:09:09.271383+0000 mon.c (mon.1) 267 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:09:09.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:09 smithi033 bash[42377]: audit 2021-07-26T16:09:09.272211+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:09:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:09 smithi096 bash[33981]: cluster 2021-07-26T16:09:08.325971+0000 mon.a (mon.0) 1097 : cluster [DBG] osdmap e723: 8 total, 8 up, 8 in 2021-07-26T16:09:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:09 smithi096 bash[33981]: audit 2021-07-26T16:09:09.253118+0000 mon.c (mon.1) 266 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:09:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:09 smithi096 bash[33981]: audit 2021-07-26T16:09:09.253877+0000 mon.a (mon.0) 1098 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:09:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:09 smithi096 bash[33981]: audit 2021-07-26T16:09:09.271383+0000 mon.c (mon.1) 267 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:09:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:09 smithi096 bash[33981]: audit 2021-07-26T16:09:09.272211+0000 mon.a (mon.0) 1099 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:09:10.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:10 smithi033 bash[41341]: cluster 2021-07-26T16:09:09.185565+0000 mgr.y (mgr.34104) 456 : cluster [DBG] pgmap v910: 25 pgs: 25 active+clean; 878 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 1.3 MiB/s wr, 18 op/s 2021-07-26T16:09:10.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:10 smithi033 bash[42377]: cluster 2021-07-26T16:09:09.185565+0000 mgr.y (mgr.34104) 456 : cluster [DBG] pgmap v910: 25 pgs: 25 active+clean; 878 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 1.3 MiB/s wr, 18 op/s 2021-07-26T16:09:10.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:10 smithi096 bash[33981]: cluster 2021-07-26T16:09:09.185565+0000 mgr.y (mgr.34104) 456 : cluster [DBG] pgmap v910: 25 pgs: 25 active+clean; 878 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 9.7 MiB/s rd, 1.3 MiB/s wr, 18 op/s 2021-07-26T16:09:11.444 INFO:tasks.rados.rados.0.smithi033.stdout:3391: finishing write tid 1 to smithi03339061-5 2021-07-26T16:09:11.444 INFO:tasks.rados.rados.0.smithi033.stdout:3391: finishing write tid 2 to smithi03339061-5 2021-07-26T16:09:11.444 INFO:tasks.rados.rados.0.smithi033.stdout:3391: finishing write tid 3 to smithi03339061-5 2021-07-26T16:09:11.445 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 1851 (ObjNum 1016 snap 339 seq_num 1016) dirty exists 2021-07-26T16:09:11.445 INFO:tasks.rados.rados.0.smithi033.stdout:3391: left oid 5 (ObjNum 1016 snap 339 seq_num 1016) 2021-07-26T16:09:11.445 INFO:tasks.rados.rados.0.smithi033.stdout:3389: done (4 left) 2021-07-26T16:09:11.445 INFO:tasks.rados.rados.0.smithi033.stdout:3390: done (3 left) 2021-07-26T16:09:11.446 INFO:tasks.rados.rados.0.smithi033.stdout:3391: done (2 left) 2021-07-26T16:09:11.446 INFO:tasks.rados.rados.0.smithi033.stdout:3392: done (1 left) 2021-07-26T16:09:11.446 INFO:tasks.rados.rados.0.smithi033.stdout:3393: done (0 left) 2021-07-26T16:09:11.447 INFO:tasks.rados.rados.0.smithi033.stdout:3394: rollback oid 31 current snap is 340 2021-07-26T16:09:11.447 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 31 to 328 2021-07-26T16:09:11.447 INFO:tasks.rados.rados.0.smithi033.stdout:3395: read oid 29 snap -1 2021-07-26T16:09:11.447 INFO:tasks.rados.rados.0.smithi033.stdout:3395: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:09:11.447 INFO:tasks.rados.rados.0.smithi033.stdout:3396: read oid 3 snap -1 2021-07-26T16:09:11.448 INFO:tasks.rados.rados.0.smithi033.stdout:3396: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:09:11.448 INFO:tasks.rados.rados.0.smithi033.stdout:3397: read oid 33 snap -1 2021-07-26T16:09:11.448 INFO:tasks.rados.rados.0.smithi033.stdout:3397: expect (ObjNum 996 snap 329 seq_num 996) 2021-07-26T16:09:11.448 INFO:tasks.rados.rados.0.smithi033.stdout:3398: copy_from oid 39 from oid 30 current snap is 340 2021-07-26T16:09:11.449 INFO:tasks.rados.rados.0.smithi033.stdout:3399: snap_remove snap 331 2021-07-26T16:09:12.357 INFO:tasks.rados.rados.0.smithi033.stdout:3399: done (5 left) 2021-07-26T16:09:12.357 INFO:tasks.rados.rados.0.smithi033.stdout:3400: read oid 48 snap -1 2021-07-26T16:09:12.357 INFO:tasks.rados.rados.0.smithi033.stdout:3400: expect (ObjNum 1000 snap 333 seq_num 1000) 2021-07-26T16:09:12.357 INFO:tasks.rados.rados.0.smithi033.stdout:3401: read oid 2 snap 311 2021-07-26T16:09:12.358 INFO:tasks.rados.rados.0.smithi033.stdout:3401: expect deleted 2021-07-26T16:09:12.358 INFO:tasks.rados.rados.0.smithi033.stdout:3402: read oid 47 snap -1 2021-07-26T16:09:12.358 INFO:tasks.rados.rados.0.smithi033.stdout:3402: expect (ObjNum 951 snap 321 seq_num 951) 2021-07-26T16:09:12.358 INFO:tasks.rados.rados.0.smithi033.stdout:3403: read oid 15 snap -1 2021-07-26T16:09:12.359 INFO:tasks.rados.rados.0.smithi033.stdout:3403: expect deleted 2021-07-26T16:09:12.359 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 340 2021-07-26T16:09:12.359 INFO:tasks.rados.rados.0.smithi033.stdout:3404: seq_num 1017 ranges {2965504=237568} 2021-07-26T16:09:12.376 INFO:tasks.rados.rados.0.smithi033.stdout:3404: writing smithi03339061-35 from 2965504 to 3203072 tid 1 2021-07-26T16:09:12.376 INFO:tasks.rados.rados.0.smithi033.stdout:3405: read oid 43 snap -1 2021-07-26T16:09:12.376 INFO:tasks.rados.rados.0.smithi033.stdout:3405: expect deleted 2021-07-26T16:09:12.377 INFO:tasks.rados.rados.0.smithi033.stdout:3406: snap_remove snap 337 2021-07-26T16:09:12.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:12 smithi033 bash[41341]: cluster 2021-07-26T16:09:11.185973+0000 mgr.y (mgr.34104) 457 : cluster [DBG] pgmap v911: 25 pgs: 25 active+clean; 873 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 30 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2021-07-26T16:09:12.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:12 smithi033 bash[41341]: cluster 2021-07-26T16:09:11.236055+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e724: 8 total, 8 up, 8 in 2021-07-26T16:09:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:12 smithi033 bash[42377]: cluster 2021-07-26T16:09:11.185973+0000 mgr.y (mgr.34104) 457 : cluster [DBG] pgmap v911: 25 pgs: 25 active+clean; 873 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 30 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2021-07-26T16:09:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:12 smithi033 bash[42377]: cluster 2021-07-26T16:09:11.236055+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e724: 8 total, 8 up, 8 in 2021-07-26T16:09:12.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:12 smithi096 bash[33981]: cluster 2021-07-26T16:09:11.185973+0000 mgr.y (mgr.34104) 457 : cluster [DBG] pgmap v911: 25 pgs: 25 active+clean; 873 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 30 MiB/s rd, 1.5 MiB/s wr, 23 op/s 2021-07-26T16:09:12.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:12 smithi096 bash[33981]: cluster 2021-07-26T16:09:11.236055+0000 mon.a (mon.0) 1100 : cluster [DBG] osdmap e724: 8 total, 8 up, 8 in 2021-07-26T16:09:13.363 INFO:tasks.rados.rados.0.smithi033.stdout:3398: finishing copy_from to smithi03339061-39 2021-07-26T16:09:13.364 INFO:tasks.rados.rados.0.smithi033.stdout:3398: got expected ENOENT (src dne) 2021-07-26T16:09:13.364 INFO:tasks.rados.rados.0.smithi033.stdout:3398: finishing copy_from racing read to smithi03339061-39 2021-07-26T16:09:13.364 INFO:tasks.rados.rados.0.smithi033.stdout:3396: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:09:13.366 INFO:tasks.rados.rados.0.smithi033.stdout:3394: finishing rollback tid 0 to smithi03339061-31 2021-07-26T16:09:13.366 INFO:tasks.rados.rados.0.smithi033.stdout:3394: finishing rollback tid 1 to smithi03339061-31 2021-07-26T16:09:13.366 INFO:tasks.rados.rados.0.smithi033.stdout:3394: finishing rollback tid 2 to smithi03339061-31 2021-07-26T16:09:13.367 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1383 (ObjNum 887 snap 291 seq_num 887) dirty exists 2021-07-26T16:09:13.367 INFO:tasks.rados.rados.0.smithi033.stdout:3395: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:09:13.535 INFO:tasks.rados.rados.0.smithi033.stdout:3397: expect (ObjNum 996 snap 329 seq_num 996) 2021-07-26T16:09:13.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:13 smithi033 bash[41341]: cluster 2021-07-26T16:09:12.351291+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e725: 8 total, 8 up, 8 in 2021-07-26T16:09:13.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:13 smithi033 bash[42377]: cluster 2021-07-26T16:09:12.351291+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e725: 8 total, 8 up, 8 in 2021-07-26T16:09:13.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:13 smithi096 bash[33981]: cluster 2021-07-26T16:09:12.351291+0000 mon.a (mon.0) 1101 : cluster [DBG] osdmap e725: 8 total, 8 up, 8 in 2021-07-26T16:09:14.147 INFO:tasks.rados.rados.0.smithi033.stdout:3394: done (11 left) 2021-07-26T16:09:14.148 INFO:tasks.rados.rados.0.smithi033.stdout:3395: done (10 left) 2021-07-26T16:09:14.148 INFO:tasks.rados.rados.0.smithi033.stdout:3396: done (9 left) 2021-07-26T16:09:14.148 INFO:tasks.rados.rados.0.smithi033.stdout:3397: done (8 left) 2021-07-26T16:09:14.149 INFO:tasks.rados.rados.0.smithi033.stdout:3398: done (7 left) 2021-07-26T16:09:14.149 INFO:tasks.rados.rados.0.smithi033.stdout:3401: done (6 left) 2021-07-26T16:09:14.149 INFO:tasks.rados.rados.0.smithi033.stdout:3403: done (5 left) 2021-07-26T16:09:14.149 INFO:tasks.rados.rados.0.smithi033.stdout:3406: done (4 left) 2021-07-26T16:09:14.150 INFO:tasks.rados.rados.0.smithi033.stdout:3407: copy_from oid 23 from oid 39 current snap is 340 2021-07-26T16:09:14.150 INFO:tasks.rados.rados.0.smithi033.stdout:3404: finishing write tid 1 to smithi03339061-35 2021-07-26T16:09:14.150 INFO:tasks.rados.rados.0.smithi033.stdout:3404: finishing write tid 2 to smithi03339061-35 2021-07-26T16:09:14.150 INFO:tasks.rados.rados.0.smithi033.stdout:3400: expect (ObjNum 1000 snap 333 seq_num 1000) 2021-07-26T16:09:14.210 INFO:tasks.rados.rados.0.smithi033.stdout:3402: expect (ObjNum 951 snap 321 seq_num 951) 2021-07-26T16:09:14.419 INFO:tasks.rados.rados.0.smithi033.stdout:3404: finishing write tid 3 to smithi03339061-35 2021-07-26T16:09:14.419 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1789 (ObjNum 1017 snap 340 seq_num 1017) dirty exists 2021-07-26T16:09:14.419 INFO:tasks.rados.rados.0.smithi033.stdout:3404: left oid 35 (ObjNum 1017 snap 340 seq_num 1017) 2021-07-26T16:09:14.419 INFO:tasks.rados.rados.0.smithi033.stdout:3400: done (4 left) 2021-07-26T16:09:14.420 INFO:tasks.rados.rados.0.smithi033.stdout:3402: done (3 left) 2021-07-26T16:09:14.420 INFO:tasks.rados.rados.0.smithi033.stdout:3404: done (2 left) 2021-07-26T16:09:14.420 INFO:tasks.rados.rados.0.smithi033.stdout:3405: done (1 left) 2021-07-26T16:09:14.420 INFO:tasks.rados.rados.0.smithi033.stdout:3408: rollback oid 22 current snap is 340 2021-07-26T16:09:14.421 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 22 to 287 2021-07-26T16:09:14.421 INFO:tasks.rados.rados.0.smithi033.stdout:3407: finishing copy_from to smithi03339061-23 2021-07-26T16:09:14.421 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1642 (ObjNum 993 snap 329 seq_num 993) dirty exists 2021-07-26T16:09:14.421 INFO:tasks.rados.rados.0.smithi033.stdout:3407: finishing copy_from racing read to smithi03339061-23 2021-07-26T16:09:14.421 INFO:tasks.rados.rados.0.smithi033.stdout:3407: done (1 left) 2021-07-26T16:09:14.422 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 17 current snap is 340 2021-07-26T16:09:14.422 INFO:tasks.rados.rados.0.smithi033.stdout:3409: seq_num 1018 ranges {0=253952} 2021-07-26T16:09:14.423 INFO:tasks.rados.rados.0.smithi033.stdout:3409: writing smithi03339061-17 from 0 to 253952 tid 1 2021-07-26T16:09:14.423 INFO:tasks.rados.rados.0.smithi033.stdout:3410: snap_create 2021-07-26T16:09:14.425 INFO:tasks.rados.rados.0.smithi033.stdout:3408: finishing rollback tid 0 to smithi03339061-22 2021-07-26T16:09:14.427 INFO:tasks.rados.rados.0.smithi033.stdout:3408: finishing rollback tid 1 to smithi03339061-22 2021-07-26T16:09:14.427 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 2102 (ObjNum 2006045936 snap 22002 seq_num 2007592208) dirty dne 2021-07-26T16:09:14.429 INFO:tasks.rados.rados.0.smithi033.stdout:3409: finishing write tid 1 to smithi03339061-17 2021-07-26T16:09:14.429 INFO:tasks.rados.rados.0.smithi033.stdout:3409: finishing write tid 2 to smithi03339061-17 2021-07-26T16:09:14.433 INFO:tasks.rados.rados.0.smithi033.stdout:3409: finishing write tid 3 to smithi03339061-17 2021-07-26T16:09:14.433 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 1407 (ObjNum 1018 snap 340 seq_num 1018) dirty exists 2021-07-26T16:09:14.433 INFO:tasks.rados.rados.0.smithi033.stdout:3409: left oid 17 (ObjNum 1018 snap 340 seq_num 1018) 2021-07-26T16:09:14.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:14 smithi033 bash[41341]: cluster 2021-07-26T16:09:13.186593+0000 mgr.y (mgr.34104) 458 : cluster [DBG] pgmap v914: 25 pgs: 25 active+clean; 873 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 36 MiB/s rd, 1.5 MiB/s wr, 21 op/s 2021-07-26T16:09:14.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:14 smithi033 bash[41341]: cluster 2021-07-26T16:09:13.358476+0000 mon.a (mon.0) 1102 : cluster [DBG] osdmap e726: 8 total, 8 up, 8 in 2021-07-26T16:09:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:14 smithi033 bash[42377]: cluster 2021-07-26T16:09:13.186593+0000 mgr.y (mgr.34104) 458 : cluster [DBG] pgmap v914: 25 pgs: 25 active+clean; 873 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 36 MiB/s rd, 1.5 MiB/s wr, 21 op/s 2021-07-26T16:09:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:14 smithi033 bash[42377]: cluster 2021-07-26T16:09:13.358476+0000 mon.a (mon.0) 1102 : cluster [DBG] osdmap e726: 8 total, 8 up, 8 in 2021-07-26T16:09:14.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:14 smithi096 bash[33981]: cluster 2021-07-26T16:09:13.186593+0000 mgr.y (mgr.34104) 458 : cluster [DBG] pgmap v914: 25 pgs: 25 active+clean; 873 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 36 MiB/s rd, 1.5 MiB/s wr, 21 op/s 2021-07-26T16:09:14.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:14 smithi096 bash[33981]: cluster 2021-07-26T16:09:13.358476+0000 mon.a (mon.0) 1102 : cluster [DBG] osdmap e726: 8 total, 8 up, 8 in 2021-07-26T16:09:15.374 INFO:tasks.rados.rados.0.smithi033.stdout:3408: done (2 left) 2021-07-26T16:09:15.374 INFO:tasks.rados.rados.0.smithi033.stdout:3409: done (1 left) 2021-07-26T16:09:15.375 INFO:tasks.rados.rados.0.smithi033.stdout:3410: done (0 left) 2021-07-26T16:09:15.375 INFO:tasks.rados.rados.0.smithi033.stdout:3411: snap_remove snap 266 2021-07-26T16:09:16.246 INFO:tasks.rados.rados.0.smithi033.stdout:3411: done (0 left) 2021-07-26T16:09:16.247 INFO:tasks.rados.rados.0.smithi033.stdout:3412: read oid 22 snap 338 2021-07-26T16:09:16.247 INFO:tasks.rados.rados.0.smithi033.stdout:3412: expect (ObjNum 1001 snap 334 seq_num 1001) 2021-07-26T16:09:16.247 INFO:tasks.rados.rados.0.smithi033.stdout:3413: read oid 41 snap -1 2021-07-26T16:09:16.247 INFO:tasks.rados.rados.0.smithi033.stdout:3413: expect (ObjNum 984 snap 327 seq_num 984) 2021-07-26T16:09:16.248 INFO:tasks.rados.rados.0.smithi033.stdout:3414: rmattr oid 35 current snap is 341 2021-07-26T16:09:16.248 INFO:tasks.rados.rados.0.smithi033.stdout:3415: read oid 4 snap -1 2021-07-26T16:09:16.248 INFO:tasks.rados.rados.0.smithi033.stdout:3415: expect (ObjNum 948 snap 321 seq_num 948) 2021-07-26T16:09:16.280 INFO:tasks.rados.rados.0.smithi033.stdout:3416: setattr oid 48 current snap is 341 2021-07-26T16:09:16.280 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1790 (ObjNum 1017 snap 340 seq_num 1017) dirty exists 2021-07-26T16:09:16.281 INFO:tasks.rados.rados.0.smithi033.stdout:3412: expect (ObjNum 1001 snap 334 seq_num 1001) 2021-07-26T16:09:16.488 INFO:tasks.rados.rados.0.smithi033.stdout:3415: expect (ObjNum 948 snap 321 seq_num 948) 2021-07-26T16:09:16.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:16 smithi033 bash[41341]: cluster 2021-07-26T16:09:15.187358+0000 mgr.y (mgr.34104) 459 : cluster [DBG] pgmap v916: 25 pgs: 25 active+clean; 873 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 31 MiB/s rd, 628 KiB/s wr, 14 op/s 2021-07-26T16:09:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:16 smithi033 bash[41341]: cluster 2021-07-26T16:09:15.368149+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e727: 8 total, 8 up, 8 in 2021-07-26T16:09:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:16 smithi033 bash[41341]: cluster 2021-07-26T16:09:16.237898+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e728: 8 total, 8 up, 8 in 2021-07-26T16:09:16.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:16 smithi033 bash[42377]: cluster 2021-07-26T16:09:15.187358+0000 mgr.y (mgr.34104) 459 : cluster [DBG] pgmap v916: 25 pgs: 25 active+clean; 873 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 31 MiB/s rd, 628 KiB/s wr, 14 op/s 2021-07-26T16:09:16.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:16 smithi033 bash[42377]: cluster 2021-07-26T16:09:15.368149+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e727: 8 total, 8 up, 8 in 2021-07-26T16:09:16.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:16 smithi033 bash[42377]: cluster 2021-07-26T16:09:16.237898+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e728: 8 total, 8 up, 8 in 2021-07-26T16:09:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:16 smithi096 bash[33981]: cluster 2021-07-26T16:09:15.187358+0000 mgr.y (mgr.34104) 459 : cluster [DBG] pgmap v916: 25 pgs: 25 active+clean; 873 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 31 MiB/s rd, 628 KiB/s wr, 14 op/s 2021-07-26T16:09:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:16 smithi096 bash[33981]: cluster 2021-07-26T16:09:15.368149+0000 mon.a (mon.0) 1103 : cluster [DBG] osdmap e727: 8 total, 8 up, 8 in 2021-07-26T16:09:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:16 smithi096 bash[33981]: cluster 2021-07-26T16:09:16.237898+0000 mon.a (mon.0) 1104 : cluster [DBG] osdmap e728: 8 total, 8 up, 8 in 2021-07-26T16:09:17.601 INFO:tasks.rados.rados.0.smithi033.stdout:3413: expect (ObjNum 984 snap 327 seq_num 984) 2021-07-26T16:09:18.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:18 smithi033 bash[41341]: cluster 2021-07-26T16:09:17.188000+0000 mgr.y (mgr.34104) 460 : cluster [DBG] pgmap v919: 25 pgs: 25 active+clean; 874 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 99 KiB/s wr, 5 op/s 2021-07-26T16:09:18.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:18 smithi033 bash[42377]: cluster 2021-07-26T16:09:17.188000+0000 mgr.y (mgr.34104) 460 : cluster [DBG] pgmap v919: 25 pgs: 25 active+clean; 874 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 99 KiB/s wr, 5 op/s 2021-07-26T16:09:18.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:18 smithi096 bash[33981]: cluster 2021-07-26T16:09:17.188000+0000 mgr.y (mgr.34104) 460 : cluster [DBG] pgmap v919: 25 pgs: 25 active+clean; 874 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 99 KiB/s wr, 5 op/s 2021-07-26T16:09:20.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:20 smithi033 bash[41341]: cluster 2021-07-26T16:09:19.188629+0000 mgr.y (mgr.34104) 461 : cluster [DBG] pgmap v920: 25 pgs: 25 active+clean; 876 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 5.0 MiB/s rd, 1.1 MiB/s wr, 3 op/s 2021-07-26T16:09:20.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:20 smithi033 bash[42377]: cluster 2021-07-26T16:09:19.188629+0000 mgr.y (mgr.34104) 461 : cluster [DBG] pgmap v920: 25 pgs: 25 active+clean; 876 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 5.0 MiB/s rd, 1.1 MiB/s wr, 3 op/s 2021-07-26T16:09:20.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:20 smithi096 bash[33981]: cluster 2021-07-26T16:09:19.188629+0000 mgr.y (mgr.34104) 461 : cluster [DBG] pgmap v920: 25 pgs: 25 active+clean; 876 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 5.0 MiB/s rd, 1.1 MiB/s wr, 3 op/s 2021-07-26T16:09:21.159 INFO:tasks.rados.rados.0.smithi033.stdout:3412: done (4 left) 2021-07-26T16:09:21.159 INFO:tasks.rados.rados.0.smithi033.stdout:3413: done (3 left) 2021-07-26T16:09:21.160 INFO:tasks.rados.rados.0.smithi033.stdout:3414: done (2 left) 2021-07-26T16:09:21.160 INFO:tasks.rados.rados.0.smithi033.stdout:3415: done (1 left) 2021-07-26T16:09:21.160 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 341 2021-07-26T16:09:21.160 INFO:tasks.rados.rados.0.smithi033.stdout:3417: seq_num 1019 ranges {0=270336} 2021-07-26T16:09:21.164 INFO:tasks.rados.rados.0.smithi033.stdout:3417: writing smithi03339061-26 from 0 to 270336 tid 1 2021-07-26T16:09:21.164 INFO:tasks.rados.rados.0.smithi033.stdout:3418: rollback oid 2 current snap is 341 2021-07-26T16:09:21.164 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 2 to 296 2021-07-26T16:09:21.164 INFO:tasks.rados.rados.0.smithi033.stdout:3419: snap_remove snap 318 2021-07-26T16:09:21.245 INFO:tasks.rados.rados.0.smithi033.stdout:3417: finishing write tid 1 to smithi03339061-26 2021-07-26T16:09:21.245 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 1852 (ObjNum 1000 snap 333 seq_num 1000) dirty exists 2021-07-26T16:09:21.245 INFO:tasks.rados.rados.0.smithi033.stdout:3417: finishing write tid 2 to smithi03339061-26 2021-07-26T16:09:21.246 INFO:tasks.rados.rados.0.smithi033.stdout:3418: finishing rollback tid 0 to smithi03339061-2 2021-07-26T16:09:21.246 INFO:tasks.rados.rados.0.smithi033.stdout:3417: finishing write tid 3 to smithi03339061-26 2021-07-26T16:09:21.246 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 2112 (ObjNum 1019 snap 341 seq_num 1019) dirty exists 2021-07-26T16:09:21.246 INFO:tasks.rados.rados.0.smithi033.stdout:3417: left oid 26 (ObjNum 1019 snap 341 seq_num 1019) 2021-07-26T16:09:21.247 INFO:tasks.rados.rados.0.smithi033.stdout:3418: finishing rollback tid 1 to smithi03339061-2 2021-07-26T16:09:21.247 INFO:tasks.rados.rados.0.smithi033.stdout:3418: finishing rollback tid 2 to smithi03339061-2 2021-07-26T16:09:21.247 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 1596 (ObjNum 876 snap 287 seq_num 876) dirty exists 2021-07-26T16:09:21.247 INFO:tasks.rados.rados.0.smithi033.stdout:3416: done (3 left) 2021-07-26T16:09:21.247 INFO:tasks.rados.rados.0.smithi033.stdout:3417: done (2 left) 2021-07-26T16:09:21.248 INFO:tasks.rados.rados.0.smithi033.stdout:3418: done (1 left) 2021-07-26T16:09:21.248 INFO:tasks.rados.rados.0.smithi033.stdout:3419: done (0 left) 2021-07-26T16:09:21.248 INFO:tasks.rados.rados.0.smithi033.stdout:3420: delete oid 39 current snap is 341 2021-07-26T16:09:21.265 INFO:tasks.rados.rados.0.smithi033.stdout:3420: done (0 left) 2021-07-26T16:09:21.265 INFO:tasks.rados.rados.0.smithi033.stdout:3421: read oid 12 snap -1 2021-07-26T16:09:21.265 INFO:tasks.rados.rados.0.smithi033.stdout:3421: expect (ObjNum 1009 snap 338 seq_num 1009) 2021-07-26T16:09:21.265 INFO:tasks.rados.rados.0.smithi033.stdout:3422: rmattr oid 17 current snap is 341 2021-07-26T16:09:21.266 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 341 2021-07-26T16:09:21.266 INFO:tasks.rados.rados.0.smithi033.stdout:3423: seq_num 1021 ranges {0=303104} 2021-07-26T16:09:21.267 INFO:tasks.rados.rados.0.smithi033.stdout:3423: writing smithi03339061-7 from 0 to 303104 tid 1 2021-07-26T16:09:21.267 INFO:tasks.rados.rados.0.smithi033.stdout:3424: copy_from oid 6 from oid 3 current snap is 341 2021-07-26T16:09:21.267 INFO:tasks.rados.rados.0.smithi033.stdout:3425: read oid 2 snap -1 2021-07-26T16:09:21.268 INFO:tasks.rados.rados.0.smithi033.stdout:3425: expect (ObjNum 876 snap 287 seq_num 876) 2021-07-26T16:09:21.268 INFO:tasks.rados.rados.0.smithi033.stdout:3426: read oid 16 snap -1 2021-07-26T16:09:21.268 INFO:tasks.rados.rados.0.smithi033.stdout:3426: expect (ObjNum 877 snap 288 seq_num 877) 2021-07-26T16:09:21.268 INFO:tasks.rados.rados.0.smithi033.stdout:3427: delete oid 8 current snap is 341 2021-07-26T16:09:21.269 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 1408 (ObjNum 1018 snap 340 seq_num 1018) dirty exists 2021-07-26T16:09:21.276 INFO:tasks.rados.rados.0.smithi033.stdout:3422: done (6 left) 2021-07-26T16:09:21.276 INFO:tasks.rados.rados.0.smithi033.stdout:3427: done (5 left) 2021-07-26T16:09:21.277 INFO:tasks.rados.rados.0.smithi033.stdout:3428: snap_remove snap 311 2021-07-26T16:09:22.257 INFO:tasks.rados.rados.0.smithi033.stdout:3428: done (5 left) 2021-07-26T16:09:22.257 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 341 2021-07-26T16:09:22.257 INFO:tasks.rados.rados.0.smithi033.stdout:3429: seq_num 1023 ranges {1114112=335872} 2021-07-26T16:09:22.263 INFO:tasks.rados.rados.0.smithi033.stdout:3429: writing smithi03339061-50 from 1114112 to 1449984 tid 1 2021-07-26T16:09:22.263 INFO:tasks.rados.rados.0.smithi033.stdout:3430: read oid 8 snap -1 2021-07-26T16:09:22.264 INFO:tasks.rados.rados.0.smithi033.stdout:3430: expect deleted 2021-07-26T16:09:22.264 INFO:tasks.rados.rados.0.smithi033.stdout:3431: read oid 33 snap 231 2021-07-26T16:09:22.264 INFO:tasks.rados.rados.0.smithi033.stdout:3431: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:09:22.264 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 341 2021-07-26T16:09:22.265 INFO:tasks.rados.rados.0.smithi033.stdout:3423: finishing write tid 1 to smithi03339061-7 2021-07-26T16:09:22.265 INFO:tasks.rados.rados.0.smithi033.stdout:3424: finishing copy_from to smithi03339061-6 2021-07-26T16:09:22.265 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1829 (ObjNum 1852527969 snap 1701800035 seq_num 1449616982) dirty exists 2021-07-26T16:09:22.266 INFO:tasks.rados.rados.0.smithi033.stdout:3423: finishing write tid 2 to smithi03339061-7 2021-07-26T16:09:22.266 INFO:tasks.rados.rados.0.smithi033.stdout:3424: finishing copy_from racing read to smithi03339061-6 2021-07-26T16:09:22.266 INFO:tasks.rados.rados.0.smithi033.stdout:3423: finishing write tid 3 to smithi03339061-7 2021-07-26T16:09:22.267 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 1733 (ObjNum 1021 snap 341 seq_num 1021) dirty exists 2021-07-26T16:09:22.267 INFO:tasks.rados.rados.0.smithi033.stdout:3423: left oid 7 (ObjNum 1021 snap 341 seq_num 1021) 2021-07-26T16:09:22.267 INFO:tasks.rados.rados.0.smithi033.stdout:3426: expect (ObjNum 877 snap 288 seq_num 877) 2021-07-26T16:09:22.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[41341]: cluster 2021-07-26T16:09:21.189230+0000 mgr.y (mgr.34104) 462 : cluster [DBG] pgmap v921: 25 pgs: 25 active+clean; 871 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 832 KiB/s wr, 5 op/s 2021-07-26T16:09:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[41341]: cluster 2021-07-26T16:09:21.239408+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e729: 8 total, 8 up, 8 in 2021-07-26T16:09:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[41341]: audit 2021-07-26T16:09:21.939277+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:09:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[41341]: audit 2021-07-26T16:09:21.942462+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:09:22.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[41341]: audit 2021-07-26T16:09:21.944509+0000 mon.c (mon.1) 270 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:09:22.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[41341]: audit 2021-07-26T16:09:22.225194+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:09:22.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[42377]: cluster 2021-07-26T16:09:21.189230+0000 mgr.y (mgr.34104) 462 : cluster [DBG] pgmap v921: 25 pgs: 25 active+clean; 871 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 832 KiB/s wr, 5 op/s 2021-07-26T16:09:22.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[42377]: cluster 2021-07-26T16:09:21.239408+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e729: 8 total, 8 up, 8 in 2021-07-26T16:09:22.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[42377]: audit 2021-07-26T16:09:21.939277+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:09:22.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[42377]: audit 2021-07-26T16:09:21.942462+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:09:22.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[42377]: audit 2021-07-26T16:09:21.944509+0000 mon.c (mon.1) 270 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:09:22.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:22 smithi033 bash[42377]: audit 2021-07-26T16:09:22.225194+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:09:22.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:22 smithi096 bash[33981]: cluster 2021-07-26T16:09:21.189230+0000 mgr.y (mgr.34104) 462 : cluster [DBG] pgmap v921: 25 pgs: 25 active+clean; 871 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 832 KiB/s wr, 5 op/s 2021-07-26T16:09:22.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:22 smithi096 bash[33981]: cluster 2021-07-26T16:09:21.239408+0000 mon.a (mon.0) 1105 : cluster [DBG] osdmap e729: 8 total, 8 up, 8 in 2021-07-26T16:09:22.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:22 smithi096 bash[33981]: audit 2021-07-26T16:09:21.939277+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:09:22.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:22 smithi096 bash[33981]: audit 2021-07-26T16:09:21.942462+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:09:22.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:22 smithi096 bash[33981]: audit 2021-07-26T16:09:21.944509+0000 mon.c (mon.1) 270 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:09:22.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:22 smithi096 bash[33981]: audit 2021-07-26T16:09:22.225194+0000 mon.a (mon.0) 1106 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:09:23.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:23 smithi033 bash[41341]: cluster 2021-07-26T16:09:22.250953+0000 mon.a (mon.0) 1107 : cluster [DBG] osdmap e730: 8 total, 8 up, 8 in 2021-07-26T16:09:23.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:23 smithi033 bash[42377]: cluster 2021-07-26T16:09:22.250953+0000 mon.a (mon.0) 1107 : cluster [DBG] osdmap e730: 8 total, 8 up, 8 in 2021-07-26T16:09:23.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:23 smithi096 bash[33981]: cluster 2021-07-26T16:09:22.250953+0000 mon.a (mon.0) 1107 : cluster [DBG] osdmap e730: 8 total, 8 up, 8 in 2021-07-26T16:09:23.780 INFO:tasks.rados.rados.0.smithi033.stdout:3421: expect (ObjNum 1009 snap 338 seq_num 1009) 2021-07-26T16:09:24.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:24 smithi033 bash[42377]: cluster 2021-07-26T16:09:23.189836+0000 mgr.y (mgr.34104) 463 : cluster [DBG] pgmap v924: 25 pgs: 25 active+clean; 872 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 947 KiB/s wr, 6 op/s 2021-07-26T16:09:24.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:24 smithi033 bash[41341]: cluster 2021-07-26T16:09:23.189836+0000 mgr.y (mgr.34104) 463 : cluster [DBG] pgmap v924: 25 pgs: 25 active+clean; 872 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 947 KiB/s wr, 6 op/s 2021-07-26T16:09:24.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:24 smithi096 bash[33981]: cluster 2021-07-26T16:09:23.189836+0000 mgr.y (mgr.34104) 463 : cluster [DBG] pgmap v924: 25 pgs: 25 active+clean; 872 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 22 MiB/s rd, 947 KiB/s wr, 6 op/s 2021-07-26T16:09:25.110 INFO:tasks.rados.rados.0.smithi033.stdout:3425: expect (ObjNum 876 snap 287 seq_num 876) 2021-07-26T16:09:25.456 INFO:tasks.rados.rados.0.smithi033.stdout:3431: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:09:25.525 INFO:tasks.rados.rados.0.smithi033.stdout:3429: finishing write tid 1 to smithi03339061-50 2021-07-26T16:09:25.526 INFO:tasks.rados.rados.0.smithi033.stdout:3429: finishing write tid 2 to smithi03339061-50 2021-07-26T16:09:25.526 INFO:tasks.rados.rados.0.smithi033.stdout:3429: finishing write tid 3 to smithi03339061-50 2021-07-26T16:09:25.526 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1833 (ObjNum 1023 snap 341 seq_num 1023) dirty exists 2021-07-26T16:09:25.526 INFO:tasks.rados.rados.0.smithi033.stdout:3429: left oid 50 (ObjNum 1023 snap 341 seq_num 1023) 2021-07-26T16:09:25.527 INFO:tasks.rados.rados.0.smithi033.stdout:3432: seq_num 1024 ranges {0=352256} 2021-07-26T16:09:25.531 INFO:tasks.rados.rados.0.smithi033.stdout:3432: writing smithi03339061-22 from 0 to 352256 tid 1 2021-07-26T16:09:25.532 INFO:tasks.rados.rados.0.smithi033.stdout:3421: done (8 left) 2021-07-26T16:09:25.532 INFO:tasks.rados.rados.0.smithi033.stdout:3423: done (7 left) 2021-07-26T16:09:25.532 INFO:tasks.rados.rados.0.smithi033.stdout:3424: done (6 left) 2021-07-26T16:09:25.532 INFO:tasks.rados.rados.0.smithi033.stdout:3425: done (5 left) 2021-07-26T16:09:25.533 INFO:tasks.rados.rados.0.smithi033.stdout:3426: done (4 left) 2021-07-26T16:09:25.533 INFO:tasks.rados.rados.0.smithi033.stdout:3429: done (3 left) 2021-07-26T16:09:25.533 INFO:tasks.rados.rados.0.smithi033.stdout:3430: done (2 left) 2021-07-26T16:09:25.533 INFO:tasks.rados.rados.0.smithi033.stdout:3431: done (1 left) 2021-07-26T16:09:25.533 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 341 2021-07-26T16:09:25.534 INFO:tasks.rados.rados.0.smithi033.stdout:3433: seq_num 1025 ranges {3858432=368640} 2021-07-26T16:09:25.559 INFO:tasks.rados.rados.0.smithi033.stdout:3433: writing smithi03339061-1 from 3858432 to 4227072 tid 1 2021-07-26T16:09:25.559 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 341 2021-07-26T16:09:25.560 INFO:tasks.rados.rados.0.smithi033.stdout:3434: seq_num 1026 ranges {0=385024} 2021-07-26T16:09:25.561 INFO:tasks.rados.rados.0.smithi033.stdout:3434: writing smithi03339061-36 from 0 to 385024 tid 1 2021-07-26T16:09:25.561 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 11 current snap is 341 2021-07-26T16:09:25.561 INFO:tasks.rados.rados.0.smithi033.stdout:3435: seq_num 1027 ranges {13475840=409600} 2021-07-26T16:09:25.640 INFO:tasks.rados.rados.0.smithi033.stdout:3435: writing smithi03339061-11 from 13475840 to 13885440 tid 1 2021-07-26T16:09:25.640 INFO:tasks.rados.rados.0.smithi033.stdout:3436: read oid 17 snap 320 2021-07-26T16:09:25.640 INFO:tasks.rados.rados.0.smithi033.stdout:3436: expect deleted 2021-07-26T16:09:25.641 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 341 2021-07-26T16:09:25.641 INFO:tasks.rados.rados.0.smithi033.stdout:3432: finishing write tid 1 to smithi03339061-22 2021-07-26T16:09:25.641 INFO:tasks.rados.rados.0.smithi033.stdout:3437: seq_num 1028 ranges {1925120=425984} 2021-07-26T16:09:25.652 INFO:tasks.rados.rados.0.smithi033.stdout:3437: writing smithi03339061-38 from 1925120 to 2351104 tid 1 2021-07-26T16:09:25.653 INFO:tasks.rados.rados.0.smithi033.stdout:3438: snap_remove snap 339 2021-07-26T16:09:26.250 INFO:tasks.rados.rados.0.smithi033.stdout:3438: done (6 left) 2021-07-26T16:09:26.250 INFO:tasks.rados.rados.0.smithi033.stdout:3439: read oid 30 snap -1 2021-07-26T16:09:26.250 INFO:tasks.rados.rados.0.smithi033.stdout:3439: expect deleted 2021-07-26T16:09:26.251 INFO:tasks.rados.rados.0.smithi033.stdout:3440: setattr oid 46 current snap is 341 2021-07-26T16:09:26.251 INFO:tasks.rados.rados.0.smithi033.stdout:3432: finishing write tid 2 to smithi03339061-22 2021-07-26T16:09:26.251 INFO:tasks.rados.rados.0.smithi033.stdout:3432: finishing write tid 3 to smithi03339061-22 2021-07-26T16:09:26.251 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 2134 (ObjNum 1024 snap 341 seq_num 1024) dirty exists 2021-07-26T16:09:26.252 INFO:tasks.rados.rados.0.smithi033.stdout:3432: left oid 22 (ObjNum 1024 snap 341 seq_num 1024) 2021-07-26T16:09:26.252 INFO:tasks.rados.rados.0.smithi033.stdout:3433: finishing write tid 1 to smithi03339061-1 2021-07-26T16:09:26.252 INFO:tasks.rados.rados.0.smithi033.stdout:3433: finishing write tid 2 to smithi03339061-1 2021-07-26T16:09:26.252 INFO:tasks.rados.rados.0.smithi033.stdout:3433: finishing write tid 3 to smithi03339061-1 2021-07-26T16:09:26.253 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1082 (ObjNum 1025 snap 341 seq_num 1025) dirty exists 2021-07-26T16:09:26.253 INFO:tasks.rados.rados.0.smithi033.stdout:3433: left oid 1 (ObjNum 1025 snap 341 seq_num 1025) 2021-07-26T16:09:26.253 INFO:tasks.rados.rados.0.smithi033.stdout:3434: finishing write tid 1 to smithi03339061-36 2021-07-26T16:09:26.253 INFO:tasks.rados.rados.0.smithi033.stdout:3434: finishing write tid 2 to smithi03339061-36 2021-07-26T16:09:26.253 INFO:tasks.rados.rados.0.smithi033.stdout:3434: finishing write tid 3 to smithi03339061-36 2021-07-26T16:09:26.254 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1441 (ObjNum 1026 snap 341 seq_num 1026) dirty exists 2021-07-26T16:09:26.254 INFO:tasks.rados.rados.0.smithi033.stdout:3434: left oid 36 (ObjNum 1026 snap 341 seq_num 1026) 2021-07-26T16:09:26.254 INFO:tasks.rados.rados.0.smithi033.stdout:3435: finishing write tid 1 to smithi03339061-11 2021-07-26T16:09:26.254 INFO:tasks.rados.rados.0.smithi033.stdout:3435: finishing write tid 2 to smithi03339061-11 2021-07-26T16:09:26.254 INFO:tasks.rados.rados.0.smithi033.stdout:3435: finishing write tid 3 to smithi03339061-11 2021-07-26T16:09:26.255 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1443 (ObjNum 1027 snap 341 seq_num 1027) dirty exists 2021-07-26T16:09:26.255 INFO:tasks.rados.rados.0.smithi033.stdout:3435: left oid 11 (ObjNum 1027 snap 341 seq_num 1027) 2021-07-26T16:09:26.255 INFO:tasks.rados.rados.0.smithi033.stdout:3437: finishing write tid 1 to smithi03339061-38 2021-07-26T16:09:26.255 INFO:tasks.rados.rados.0.smithi033.stdout:3437: finishing write tid 2 to smithi03339061-38 2021-07-26T16:09:26.256 INFO:tasks.rados.rados.0.smithi033.stdout:3437: finishing write tid 3 to smithi03339061-38 2021-07-26T16:09:26.256 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 737 (ObjNum 1028 snap 341 seq_num 1028) dirty exists 2021-07-26T16:09:26.256 INFO:tasks.rados.rados.0.smithi033.stdout:3437: left oid 38 (ObjNum 1028 snap 341 seq_num 1028) 2021-07-26T16:09:26.258 INFO:tasks.rados.rados.0.smithi033.stdout:3432: done (7 left) 2021-07-26T16:09:26.258 INFO:tasks.rados.rados.0.smithi033.stdout:3433: done (6 left) 2021-07-26T16:09:26.258 INFO:tasks.rados.rados.0.smithi033.stdout:3434: done (5 left) 2021-07-26T16:09:26.258 INFO:tasks.rados.rados.0.smithi033.stdout:3435: done (4 left) 2021-07-26T16:09:26.259 INFO:tasks.rados.rados.0.smithi033.stdout:3436: done (3 left) 2021-07-26T16:09:26.259 INFO:tasks.rados.rados.0.smithi033.stdout:3437: done (2 left) 2021-07-26T16:09:26.259 INFO:tasks.rados.rados.0.smithi033.stdout:3441: setattr oid 49 current snap is 341 2021-07-26T16:09:26.259 INFO:tasks.rados.rados.0.smithi033.stdout:3439: done (2 left) 2021-07-26T16:09:26.260 INFO:tasks.rados.rados.0.smithi033.stdout:3442: rollback oid 19 current snap is 341 2021-07-26T16:09:26.260 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 19 to 330 2021-07-26T16:09:26.260 INFO:tasks.rados.rados.0.smithi033.stdout:3443: rollback oid 38 current snap is 341 2021-07-26T16:09:26.260 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 38 to 307 2021-07-26T16:09:26.260 INFO:tasks.rados.rados.0.smithi033.stdout:3444: read oid 4 snap -1 2021-07-26T16:09:26.261 INFO:tasks.rados.rados.0.smithi033.stdout:3444: expect (ObjNum 948 snap 321 seq_num 948) 2021-07-26T16:09:26.261 INFO:tasks.rados.rados.0.smithi033.stdout:3445: copy_from oid 16 from oid 3 current snap is 341 2021-07-26T16:09:26.261 INFO:tasks.rados.rados.0.smithi033.stdout:3446: snap_create 2021-07-26T16:09:26.262 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1344 (ObjNum 938 snap 315 seq_num 938) dirty exists 2021-07-26T16:09:26.264 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 941 (ObjNum 1014 snap 338 seq_num 1014) dirty exists 2021-07-26T16:09:26.277 INFO:tasks.rados.rados.0.smithi033.stdout:3442: finishing rollback tid 0 to smithi03339061-19 2021-07-26T16:09:26.278 INFO:tasks.rados.rados.0.smithi033.stdout:3443: finishing rollback tid 0 to smithi03339061-38 2021-07-26T16:09:26.278 INFO:tasks.rados.rados.0.smithi033.stdout:3442: finishing rollback tid 1 to smithi03339061-19 2021-07-26T16:09:26.279 INFO:tasks.rados.rados.0.smithi033.stdout:3443: finishing rollback tid 1 to smithi03339061-38 2021-07-26T16:09:26.280 INFO:tasks.rados.rados.0.smithi033.stdout:3443: finishing rollback tid 2 to smithi03339061-38 2021-07-26T16:09:26.280 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 740 (ObjNum 850 snap 282 seq_num 850) dirty exists 2021-07-26T16:09:26.281 INFO:tasks.rados.rados.0.smithi033.stdout:3442: finishing rollback tid 2 to smithi03339061-19 2021-07-26T16:09:26.281 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 1794 (ObjNum 985 snap 328 seq_num 985) dirty exists 2021-07-26T16:09:26.282 INFO:tasks.rados.rados.0.smithi033.stdout:3445: finishing copy_from to smithi03339061-16 2021-07-26T16:09:26.282 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1829 (ObjNum 1701409624 snap 1316247898 seq_num 1381652571) dirty exists 2021-07-26T16:09:26.282 INFO:tasks.rados.rados.0.smithi033.stdout:3445: finishing copy_from racing read to smithi03339061-16 2021-07-26T16:09:26.308 INFO:tasks.rados.rados.0.smithi033.stdout:3444: expect (ObjNum 948 snap 321 seq_num 948) 2021-07-26T16:09:26.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:26 smithi033 bash[41341]: cluster 2021-07-26T16:09:25.190545+0000 mgr.y (mgr.34104) 464 : cluster [DBG] pgmap v925: 25 pgs: 25 active+clean; 877 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 823 KiB/s wr, 9 op/s 2021-07-26T16:09:26.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:26 smithi033 bash[41341]: cluster 2021-07-26T16:09:26.243019+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e731: 8 total, 8 up, 8 in 2021-07-26T16:09:26.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:26 smithi033 bash[42377]: cluster 2021-07-26T16:09:25.190545+0000 mgr.y (mgr.34104) 464 : cluster [DBG] pgmap v925: 25 pgs: 25 active+clean; 877 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 823 KiB/s wr, 9 op/s 2021-07-26T16:09:26.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:26 smithi033 bash[42377]: cluster 2021-07-26T16:09:26.243019+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e731: 8 total, 8 up, 8 in 2021-07-26T16:09:26.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:26 smithi096 bash[33981]: cluster 2021-07-26T16:09:25.190545+0000 mgr.y (mgr.34104) 464 : cluster [DBG] pgmap v925: 25 pgs: 25 active+clean; 877 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 26 MiB/s rd, 823 KiB/s wr, 9 op/s 2021-07-26T16:09:26.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:26 smithi096 bash[33981]: cluster 2021-07-26T16:09:26.243019+0000 mon.a (mon.0) 1108 : cluster [DBG] osdmap e731: 8 total, 8 up, 8 in 2021-07-26T16:09:27.434 INFO:tasks.rados.rados.0.smithi033.stdout:3440: done (6 left) 2021-07-26T16:09:27.434 INFO:tasks.rados.rados.0.smithi033.stdout:3441: done (5 left) 2021-07-26T16:09:27.435 INFO:tasks.rados.rados.0.smithi033.stdout:3442: done (4 left) 2021-07-26T16:09:27.435 INFO:tasks.rados.rados.0.smithi033.stdout:3443: done (3 left) 2021-07-26T16:09:27.435 INFO:tasks.rados.rados.0.smithi033.stdout:3444: done (2 left) 2021-07-26T16:09:27.435 INFO:tasks.rados.rados.0.smithi033.stdout:3445: done (1 left) 2021-07-26T16:09:27.436 INFO:tasks.rados.rados.0.smithi033.stdout:3446: done (0 left) 2021-07-26T16:09:27.436 INFO:tasks.rados.rados.0.smithi033.stdout:3447: snap_create 2021-07-26T16:09:28.276 INFO:tasks.rados.rados.0.smithi033.stdout:3447: done (0 left) 2021-07-26T16:09:28.276 INFO:tasks.rados.rados.0.smithi033.stdout:3448: read oid 36 snap -1 2021-07-26T16:09:28.276 INFO:tasks.rados.rados.0.smithi033.stdout:3448: expect (ObjNum 1026 snap 341 seq_num 1026) 2021-07-26T16:09:28.276 INFO:tasks.rados.rados.0.smithi033.stdout:3449: read oid 23 snap 271 2021-07-26T16:09:28.277 INFO:tasks.rados.rados.0.smithi033.stdout:3449: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:09:28.277 INFO:tasks.rados.rados.0.smithi033.stdout:3450: read oid 10 snap -1 2021-07-26T16:09:28.277 INFO:tasks.rados.rados.0.smithi033.stdout:3450: expect (ObjNum 891 snap 292 seq_num 891) 2021-07-26T16:09:28.277 INFO:tasks.rados.rados.0.smithi033.stdout:3451: rmattr oid 50 current snap is 343 2021-07-26T16:09:28.278 INFO:tasks.rados.rados.0.smithi033.stdout:3451: done (3 left) 2021-07-26T16:09:28.278 INFO:tasks.rados.rados.0.smithi033.stdout:3452: copy_from oid 20 from oid 18 current snap is 343 2021-07-26T16:09:28.278 INFO:tasks.rados.rados.0.smithi033.stdout:3453: copy_from oid 12 from oid 50 current snap is 343 2021-07-26T16:09:28.278 INFO:tasks.rados.rados.0.smithi033.stdout:3454: copy_from oid 47 from oid 13 current snap is 343 2021-07-26T16:09:28.278 INFO:tasks.rados.rados.0.smithi033.stdout:3455: copy_from oid 19 from oid 9 current snap is 343 2021-07-26T16:09:28.279 INFO:tasks.rados.rados.0.smithi033.stdout:3456: delete oid 42 current snap is 343 2021-07-26T16:09:28.284 INFO:tasks.rados.rados.0.smithi033.stdout:3456: done (7 left) 2021-07-26T16:09:28.284 INFO:tasks.rados.rados.0.smithi033.stdout:3457: snap_create 2021-07-26T16:09:28.284 INFO:tasks.rados.rados.0.smithi033.stdout:3450: expect (ObjNum 891 snap 292 seq_num 891) 2021-07-26T16:09:28.304 INFO:tasks.rados.rados.0.smithi033.stdout:3448: expect (ObjNum 1026 snap 341 seq_num 1026) 2021-07-26T16:09:28.314 INFO:tasks.rados.rados.0.smithi033.stdout:3449: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:09:28.389 INFO:tasks.rados.rados.0.smithi033.stdout:3453: finishing copy_from to smithi03339061-12 2021-07-26T16:09:28.390 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1833 (ObjNum 1023 snap 341 seq_num 1023) dirty exists 2021-07-26T16:09:28.390 INFO:tasks.rados.rados.0.smithi033.stdout:3452: finishing copy_from to smithi03339061-20 2021-07-26T16:09:28.390 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 2031 (ObjNum 888 snap 291 seq_num 888) dirty exists 2021-07-26T16:09:28.391 INFO:tasks.rados.rados.0.smithi033.stdout:3453: finishing copy_from racing read to smithi03339061-12 2021-07-26T16:09:28.391 INFO:tasks.rados.rados.0.smithi033.stdout:3452: finishing copy_from racing read to smithi03339061-20 2021-07-26T16:09:28.391 INFO:tasks.rados.rados.0.smithi033.stdout:3455: finishing copy_from to smithi03339061-19 2021-07-26T16:09:28.391 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 1779 (ObjNum 836 snap 277 seq_num 836) dirty exists 2021-07-26T16:09:28.392 INFO:tasks.rados.rados.0.smithi033.stdout:3455: finishing copy_from racing read to smithi03339061-19 2021-07-26T16:09:28.392 INFO:tasks.rados.rados.0.smithi033.stdout:3454: finishing copy_from to smithi03339061-47 2021-07-26T16:09:28.392 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1394 (ObjNum 930 snap 312 seq_num 930) dirty exists 2021-07-26T16:09:28.392 INFO:tasks.rados.rados.0.smithi033.stdout:3454: finishing copy_from racing read to smithi03339061-47 2021-07-26T16:09:28.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:28 smithi033 bash[41341]: cluster 2021-07-26T16:09:27.191204+0000 mgr.y (mgr.34104) 465 : cluster [DBG] pgmap v927: 25 pgs: 25 active+clean; 877 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 208 KiB/s wr, 10 op/s 2021-07-26T16:09:28.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:28 smithi033 bash[41341]: cluster 2021-07-26T16:09:27.256529+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e732: 8 total, 8 up, 8 in 2021-07-26T16:09:28.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:28 smithi033 bash[42377]: cluster 2021-07-26T16:09:27.191204+0000 mgr.y (mgr.34104) 465 : cluster [DBG] pgmap v927: 25 pgs: 25 active+clean; 877 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 208 KiB/s wr, 10 op/s 2021-07-26T16:09:28.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:28 smithi033 bash[42377]: cluster 2021-07-26T16:09:27.256529+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e732: 8 total, 8 up, 8 in 2021-07-26T16:09:28.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:28 smithi096 bash[33981]: cluster 2021-07-26T16:09:27.191204+0000 mgr.y (mgr.34104) 465 : cluster [DBG] pgmap v927: 25 pgs: 25 active+clean; 877 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 208 KiB/s wr, 10 op/s 2021-07-26T16:09:28.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:28 smithi096 bash[33981]: cluster 2021-07-26T16:09:27.256529+0000 mon.a (mon.0) 1109 : cluster [DBG] osdmap e732: 8 total, 8 up, 8 in 2021-07-26T16:09:29.288 INFO:tasks.rados.rados.0.smithi033.stdout:3448: done (7 left) 2021-07-26T16:09:29.288 INFO:tasks.rados.rados.0.smithi033.stdout:3449: done (6 left) 2021-07-26T16:09:29.289 INFO:tasks.rados.rados.0.smithi033.stdout:3450: done (5 left) 2021-07-26T16:09:29.289 INFO:tasks.rados.rados.0.smithi033.stdout:3452: done (4 left) 2021-07-26T16:09:29.290 INFO:tasks.rados.rados.0.smithi033.stdout:3453: done (3 left) 2021-07-26T16:09:29.290 INFO:tasks.rados.rados.0.smithi033.stdout:3454: done (2 left) 2021-07-26T16:09:29.291 INFO:tasks.rados.rados.0.smithi033.stdout:3455: done (1 left) 2021-07-26T16:09:29.291 INFO:tasks.rados.rados.0.smithi033.stdout:3457: done (0 left) 2021-07-26T16:09:29.291 INFO:tasks.rados.rados.0.smithi033.stdout:3458: read oid 1 snap 312 2021-07-26T16:09:29.292 INFO:tasks.rados.rados.0.smithi033.stdout:3458: expect deleted 2021-07-26T16:09:29.292 INFO:tasks.rados.rados.0.smithi033.stdout:3459: read oid 44 snap -1 2021-07-26T16:09:29.293 INFO:tasks.rados.rados.0.smithi033.stdout:3459: expect (ObjNum 995 snap 329 seq_num 995) 2021-07-26T16:09:29.293 INFO:tasks.rados.rados.0.smithi033.stdout:3460: rmattr oid 35 current snap is 344 2021-07-26T16:09:29.294 INFO:tasks.rados.rados.0.smithi033.stdout:3461: rollback oid 14 current snap is 344 2021-07-26T16:09:29.294 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 14 to 321 2021-07-26T16:09:29.295 INFO:tasks.rados.rados.0.smithi033.stdout:3462: read oid 21 snap -1 2021-07-26T16:09:29.295 INFO:tasks.rados.rados.0.smithi033.stdout:3462: expect (ObjNum 951 snap 321 seq_num 951) 2021-07-26T16:09:29.296 INFO:tasks.rados.rados.0.smithi033.stdout:3463: read oid 10 snap -1 2021-07-26T16:09:29.296 INFO:tasks.rados.rados.0.smithi033.stdout:3463: expect (ObjNum 891 snap 292 seq_num 891) 2021-07-26T16:09:29.297 INFO:tasks.rados.rados.0.smithi033.stdout:3464: rmattr oid 34 current snap is 344 2021-07-26T16:09:29.297 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 344 2021-07-26T16:09:29.298 INFO:tasks.rados.rados.0.smithi033.stdout:3465: seq_num 1030 ranges {475136=458752} 2021-07-26T16:09:29.300 INFO:tasks.rados.rados.0.smithi033.stdout:3465: writing smithi03339061-20 from 475136 to 933888 tid 1 2021-07-26T16:09:29.300 INFO:tasks.rados.rados.0.smithi033.stdout:3466: read oid 49 snap 248 2021-07-26T16:09:29.301 INFO:tasks.rados.rados.0.smithi033.stdout:3466: expect deleted 2021-07-26T16:09:29.301 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 344 2021-07-26T16:09:29.302 INFO:tasks.rados.rados.0.smithi033.stdout:3467: seq_num 1031 ranges {2244608=475136} 2021-07-26T16:09:29.311 INFO:tasks.rados.rados.0.smithi033.stdout:3467: writing smithi03339061-38 from 2244608 to 2719744 tid 1 2021-07-26T16:09:29.311 INFO:tasks.rados.rados.0.smithi033.stdout:3458: done (9 left) 2021-07-26T16:09:29.312 INFO:tasks.rados.rados.0.smithi033.stdout:3468: read oid 23 snap -1 2021-07-26T16:09:29.312 INFO:tasks.rados.rados.0.smithi033.stdout:3468: expect (ObjNum 993 snap 329 seq_num 993) 2021-07-26T16:09:29.312 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 6 current snap is 344 2021-07-26T16:09:29.313 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1444 (ObjNum 904 snap 302 seq_num 904) dirty exists 2021-07-26T16:09:29.313 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1795 (ObjNum 1017 snap 340 seq_num 1017) dirty exists 2021-07-26T16:09:29.314 INFO:tasks.rados.rados.0.smithi033.stdout:3463: expect (ObjNum 891 snap 292 seq_num 891) 2021-07-26T16:09:29.331 INFO:tasks.rados.rados.0.smithi033.stdout:3469: seq_num 1032 ranges {0=491520} 2021-07-26T16:09:29.335 INFO:tasks.rados.rados.0.smithi033.stdout:3469: writing smithi03339061-6 from 0 to 491520 tid 1 2021-07-26T16:09:29.336 INFO:tasks.rados.rados.0.smithi033.stdout:3460: done (10 left) 2021-07-26T16:09:29.336 INFO:tasks.rados.rados.0.smithi033.stdout:3463: done (9 left) 2021-07-26T16:09:29.337 INFO:tasks.rados.rados.0.smithi033.stdout:3464: done (8 left) 2021-07-26T16:09:29.337 INFO:tasks.rados.rados.0.smithi033.stdout:3466: done (7 left) 2021-07-26T16:09:29.338 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 344 2021-07-26T16:09:29.338 INFO:tasks.rados.rados.0.smithi033.stdout:3470: seq_num 1033 ranges {270336=507904} 2021-07-26T16:09:29.340 INFO:tasks.rados.rados.0.smithi033.stdout:3470: writing smithi03339061-26 from 270336 to 778240 tid 1 2021-07-26T16:09:29.341 INFO:tasks.rados.rados.0.smithi033.stdout:3471: snap_remove snap 334 2021-07-26T16:09:29.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:29 smithi033 bash[41341]: cluster 2021-07-26T16:09:28.272549+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e733: 8 total, 8 up, 8 in 2021-07-26T16:09:29.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:29 smithi033 bash[42377]: cluster 2021-07-26T16:09:28.272549+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e733: 8 total, 8 up, 8 in 2021-07-26T16:09:29.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:29 smithi096 bash[33981]: cluster 2021-07-26T16:09:28.272549+0000 mon.a (mon.0) 1110 : cluster [DBG] osdmap e733: 8 total, 8 up, 8 in 2021-07-26T16:09:30.301 INFO:tasks.rados.rados.0.smithi033.stdout:3471: done (8 left) 2021-07-26T16:09:30.302 INFO:tasks.rados.rados.0.smithi033.stdout:3472: read oid 35 snap -1 2021-07-26T16:09:30.302 INFO:tasks.rados.rados.0.smithi033.stdout:3472: expect (ObjNum 1017 snap 340 seq_num 1017) 2021-07-26T16:09:30.302 INFO:tasks.rados.rados.0.smithi033.stdout:3473: read oid 24 snap 329 2021-07-26T16:09:30.302 INFO:tasks.rados.rados.0.smithi033.stdout:3473: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:09:30.303 INFO:tasks.rados.rados.0.smithi033.stdout:3474: read oid 12 snap -1 2021-07-26T16:09:30.303 INFO:tasks.rados.rados.0.smithi033.stdout:3474: expect (ObjNum 1023 snap 341 seq_num 1023) 2021-07-26T16:09:30.303 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 344 2021-07-26T16:09:30.303 INFO:tasks.rados.rados.0.smithi033.stdout:3475: seq_num 1034 ranges {2031616=524288} 2021-07-26T16:09:30.317 INFO:tasks.rados.rados.0.smithi033.stdout:3475: writing smithi03339061-49 from 2031616 to 2555904 tid 1 2021-07-26T16:09:30.318 INFO:tasks.rados.rados.0.smithi033.stdout:3462: expect (ObjNum 951 snap 321 seq_num 951) 2021-07-26T16:09:30.540 INFO:tasks.rados.rados.0.smithi033.stdout:3459: expect (ObjNum 995 snap 329 seq_num 995) 2021-07-26T16:09:30.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:30 smithi033 bash[41341]: cluster 2021-07-26T16:09:29.192023+0000 mgr.y (mgr.34104) 466 : cluster [DBG] pgmap v930: 25 pgs: 25 active+clean; 880 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 8.7 MiB/s rd, 241 KiB/s wr, 8 op/s 2021-07-26T16:09:30.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:30 smithi033 bash[41341]: cluster 2021-07-26T16:09:29.282621+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e734: 8 total, 8 up, 8 in 2021-07-26T16:09:30.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:30 smithi033 bash[42377]: cluster 2021-07-26T16:09:29.192023+0000 mgr.y (mgr.34104) 466 : cluster [DBG] pgmap v930: 25 pgs: 25 active+clean; 880 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 8.7 MiB/s rd, 241 KiB/s wr, 8 op/s 2021-07-26T16:09:30.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:30 smithi033 bash[42377]: cluster 2021-07-26T16:09:29.282621+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e734: 8 total, 8 up, 8 in 2021-07-26T16:09:30.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:30 smithi096 bash[33981]: cluster 2021-07-26T16:09:29.192023+0000 mgr.y (mgr.34104) 466 : cluster [DBG] pgmap v930: 25 pgs: 25 active+clean; 880 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 8.7 MiB/s rd, 241 KiB/s wr, 8 op/s 2021-07-26T16:09:30.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:30 smithi096 bash[33981]: cluster 2021-07-26T16:09:29.282621+0000 mon.a (mon.0) 1111 : cluster [DBG] osdmap e734: 8 total, 8 up, 8 in 2021-07-26T16:09:30.792 INFO:tasks.rados.rados.0.smithi033.stdout:3461: finishing rollback tid 1 to smithi03339061-14 2021-07-26T16:09:30.793 INFO:tasks.rados.rados.0.smithi033.stdout:3467: finishing write tid 1 to smithi03339061-38 2021-07-26T16:09:30.793 INFO:tasks.rados.rados.0.smithi033.stdout:3467: finishing write tid 2 to smithi03339061-38 2021-07-26T16:09:30.793 INFO:tasks.rados.rados.0.smithi033.stdout:3467: finishing write tid 3 to smithi03339061-38 2021-07-26T16:09:30.793 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 742 (ObjNum 1031 snap 344 seq_num 1031) dirty exists 2021-07-26T16:09:30.793 INFO:tasks.rados.rados.0.smithi033.stdout:3467: left oid 38 (ObjNum 1031 snap 344 seq_num 1031) 2021-07-26T16:09:30.794 INFO:tasks.rados.rados.0.smithi033.stdout:3461: finishing rollback tid 2 to smithi03339061-14 2021-07-26T16:09:30.794 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 2033 (ObjNum 829 snap 275 seq_num 829) dirty exists 2021-07-26T16:09:30.794 INFO:tasks.rados.rados.0.smithi033.stdout:3465: finishing write tid 1 to smithi03339061-20 2021-07-26T16:09:30.794 INFO:tasks.rados.rados.0.smithi033.stdout:3465: finishing write tid 2 to smithi03339061-20 2021-07-26T16:09:30.795 INFO:tasks.rados.rados.0.smithi033.stdout:3465: finishing write tid 3 to smithi03339061-20 2021-07-26T16:09:30.795 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 2035 (ObjNum 1030 snap 344 seq_num 1030) dirty exists 2021-07-26T16:09:30.795 INFO:tasks.rados.rados.0.smithi033.stdout:3465: left oid 20 (ObjNum 1030 snap 344 seq_num 1030) 2021-07-26T16:09:30.795 INFO:tasks.rados.rados.0.smithi033.stdout:3468: expect (ObjNum 993 snap 329 seq_num 993) 2021-07-26T16:09:31.050 INFO:tasks.rados.rados.0.smithi033.stdout:3469: finishing write tid 1 to smithi03339061-6 2021-07-26T16:09:31.051 INFO:tasks.rados.rados.0.smithi033.stdout:3469: finishing write tid 2 to smithi03339061-6 2021-07-26T16:09:31.051 INFO:tasks.rados.rados.0.smithi033.stdout:3470: finishing write tid 1 to smithi03339061-26 2021-07-26T16:09:31.051 INFO:tasks.rados.rados.0.smithi033.stdout:3470: finishing write tid 2 to smithi03339061-26 2021-07-26T16:09:31.051 INFO:tasks.rados.rados.0.smithi033.stdout:3469: finishing write tid 3 to smithi03339061-6 2021-07-26T16:09:31.051 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 2141 (ObjNum 1032 snap 344 seq_num 1032) dirty exists 2021-07-26T16:09:31.052 INFO:tasks.rados.rados.0.smithi033.stdout:3469: left oid 6 (ObjNum 1032 snap 344 seq_num 1032) 2021-07-26T16:09:31.052 INFO:tasks.rados.rados.0.smithi033.stdout:3470: finishing write tid 3 to smithi03339061-26 2021-07-26T16:09:31.052 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 2144 (ObjNum 1033 snap 344 seq_num 1033) dirty exists 2021-07-26T16:09:31.052 INFO:tasks.rados.rados.0.smithi033.stdout:3470: left oid 26 (ObjNum 1033 snap 344 seq_num 1033) 2021-07-26T16:09:31.053 INFO:tasks.rados.rados.0.smithi033.stdout:3474: expect (ObjNum 1023 snap 341 seq_num 1023) 2021-07-26T16:09:31.106 INFO:tasks.rados.rados.0.smithi033.stdout:3473: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:09:31.166 INFO:tasks.rados.rados.0.smithi033.stdout:3475: finishing write tid 1 to smithi03339061-49 2021-07-26T16:09:31.166 INFO:tasks.rados.rados.0.smithi033.stdout:3475: finishing write tid 2 to smithi03339061-49 2021-07-26T16:09:31.166 INFO:tasks.rados.rados.0.smithi033.stdout:3472: expect (ObjNum 1017 snap 340 seq_num 1017) 2021-07-26T16:09:31.325 INFO:tasks.rados.rados.0.smithi033.stdout:3475: finishing write tid 3 to smithi03339061-49 2021-07-26T16:09:31.325 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 943 (ObjNum 1034 snap 344 seq_num 1034) dirty exists 2021-07-26T16:09:31.325 INFO:tasks.rados.rados.0.smithi033.stdout:3475: left oid 49 (ObjNum 1034 snap 344 seq_num 1034) 2021-07-26T16:09:31.325 INFO:tasks.rados.rados.0.smithi033.stdout:3459: done (11 left) 2021-07-26T16:09:31.326 INFO:tasks.rados.rados.0.smithi033.stdout:3461: done (10 left) 2021-07-26T16:09:31.326 INFO:tasks.rados.rados.0.smithi033.stdout:3462: done (9 left) 2021-07-26T16:09:31.326 INFO:tasks.rados.rados.0.smithi033.stdout:3465: done (8 left) 2021-07-26T16:09:31.326 INFO:tasks.rados.rados.0.smithi033.stdout:3467: done (7 left) 2021-07-26T16:09:31.327 INFO:tasks.rados.rados.0.smithi033.stdout:3468: done (6 left) 2021-07-26T16:09:31.327 INFO:tasks.rados.rados.0.smithi033.stdout:3469: done (5 left) 2021-07-26T16:09:31.327 INFO:tasks.rados.rados.0.smithi033.stdout:3470: done (4 left) 2021-07-26T16:09:31.327 INFO:tasks.rados.rados.0.smithi033.stdout:3472: done (3 left) 2021-07-26T16:09:31.327 INFO:tasks.rados.rados.0.smithi033.stdout:3473: done (2 left) 2021-07-26T16:09:31.328 INFO:tasks.rados.rados.0.smithi033.stdout:3474: done (1 left) 2021-07-26T16:09:31.328 INFO:tasks.rados.rados.0.smithi033.stdout:3475: done (0 left) 2021-07-26T16:09:31.328 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 344 2021-07-26T16:09:31.328 INFO:tasks.rados.rados.0.smithi033.stdout:3476: seq_num 1035 ranges {2359296=540672} 2021-07-26T16:09:31.350 INFO:tasks.rados.rados.0.smithi033.stdout:3476: writing smithi03339061-48 from 2359296 to 2899968 tid 1 2021-07-26T16:09:31.350 INFO:tasks.rados.rados.0.smithi033.stdout:3477: copy_from oid 50 from oid 1 current snap is 344 2021-07-26T16:09:31.350 INFO:tasks.rados.rados.0.smithi033.stdout:3478: read oid 25 snap 293 2021-07-26T16:09:31.351 INFO:tasks.rados.rados.0.smithi033.stdout:3478: expect deleted 2021-07-26T16:09:31.351 INFO:tasks.rados.rados.0.smithi033.stdout:3479: rmattr oid 4 current snap is 344 2021-07-26T16:09:31.351 INFO:tasks.rados.rados.0.smithi033.stdout:3480: rmattr oid 16 current snap is 344 2021-07-26T16:09:31.351 INFO:tasks.rados.rados.0.smithi033.stdout:3481: delete oid 46 current snap is 344 2021-07-26T16:09:31.358 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 2036 (ObjNum 948 snap 321 seq_num 948) dirty exists 2021-07-26T16:09:31.359 INFO:tasks.rados.rados.0.smithi033.stdout:3478: done (5 left) 2021-07-26T16:09:31.360 INFO:tasks.rados.rados.0.smithi033.stdout:3479: done (4 left) 2021-07-26T16:09:31.360 INFO:tasks.rados.rados.0.smithi033.stdout:3481: done (3 left) 2021-07-26T16:09:31.360 INFO:tasks.rados.rados.0.smithi033.stdout:3482: rollback oid 28 current snap is 344 2021-07-26T16:09:31.360 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 28 to 271 2021-07-26T16:09:31.361 INFO:tasks.rados.rados.0.smithi033.stdout:3483: copy_from oid 20 from oid 38 current snap is 344 2021-07-26T16:09:31.361 INFO:tasks.rados.rados.0.smithi033.stdout:3484: snap_remove snap 295 2021-07-26T16:09:31.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:31 smithi033 bash[41341]: cluster 2021-07-26T16:09:30.291187+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e735: 8 total, 8 up, 8 in 2021-07-26T16:09:31.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:31 smithi033 bash[41341]: cluster 2021-07-26T16:09:31.247088+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e736: 8 total, 8 up, 8 in 2021-07-26T16:09:31.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:31 smithi033 bash[42377]: cluster 2021-07-26T16:09:30.291187+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e735: 8 total, 8 up, 8 in 2021-07-26T16:09:31.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:31 smithi033 bash[42377]: cluster 2021-07-26T16:09:31.247088+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e736: 8 total, 8 up, 8 in 2021-07-26T16:09:31.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:31 smithi096 bash[33981]: cluster 2021-07-26T16:09:30.291187+0000 mon.a (mon.0) 1112 : cluster [DBG] osdmap e735: 8 total, 8 up, 8 in 2021-07-26T16:09:31.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:31 smithi096 bash[33981]: cluster 2021-07-26T16:09:31.247088+0000 mon.a (mon.0) 1113 : cluster [DBG] osdmap e736: 8 total, 8 up, 8 in 2021-07-26T16:09:32.319 INFO:tasks.rados.rados.0.smithi033.stdout:3476: finishing write tid 1 to smithi03339061-48 2021-07-26T16:09:32.319 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 1834 (ObjNum 1953066355 snap 858810728 seq_num 809055027) dirty exists 2021-07-26T16:09:32.320 INFO:tasks.rados.rados.0.smithi033.stdout:3476: finishing write tid 2 to smithi03339061-48 2021-07-26T16:09:32.320 INFO:tasks.rados.rados.0.smithi033.stdout:3482: finishing rollback tid 0 to smithi03339061-28 2021-07-26T16:09:32.320 INFO:tasks.rados.rados.0.smithi033.stdout:3482: finishing rollback tid 1 to smithi03339061-28 2021-07-26T16:09:32.320 INFO:tasks.rados.rados.0.smithi033.stdout:3476: finishing write tid 3 to smithi03339061-48 2021-07-26T16:09:32.321 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 1854 (ObjNum 1035 snap 344 seq_num 1035) dirty exists 2021-07-26T16:09:32.321 INFO:tasks.rados.rados.0.smithi033.stdout:3476: left oid 48 (ObjNum 1035 snap 344 seq_num 1035) 2021-07-26T16:09:32.321 INFO:tasks.rados.rados.0.smithi033.stdout:3482: finishing rollback tid 2 to smithi03339061-28 2021-07-26T16:09:32.321 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1836 (ObjNum 569 snap 177 seq_num 569) dirty exists 2021-07-26T16:09:32.321 INFO:tasks.rados.rados.0.smithi033.stdout:3477: finishing copy_from to smithi03339061-50 2021-07-26T16:09:32.322 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1082 (ObjNum 1025 snap 341 seq_num 1025) dirty exists 2021-07-26T16:09:32.322 INFO:tasks.rados.rados.0.smithi033.stdout:3477: finishing copy_from racing read to smithi03339061-50 2021-07-26T16:09:32.322 INFO:tasks.rados.rados.0.smithi033.stdout:3483: finishing copy_from to smithi03339061-20 2021-07-26T16:09:32.322 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 742 (ObjNum 1031 snap 344 seq_num 1031) dirty exists 2021-07-26T16:09:32.323 INFO:tasks.rados.rados.0.smithi033.stdout:3483: finishing copy_from racing read to smithi03339061-20 2021-07-26T16:09:32.323 INFO:tasks.rados.rados.0.smithi033.stdout:3476: done (5 left) 2021-07-26T16:09:32.323 INFO:tasks.rados.rados.0.smithi033.stdout:3477: done (4 left) 2021-07-26T16:09:32.323 INFO:tasks.rados.rados.0.smithi033.stdout:3480: done (3 left) 2021-07-26T16:09:32.323 INFO:tasks.rados.rados.0.smithi033.stdout:3482: done (2 left) 2021-07-26T16:09:32.324 INFO:tasks.rados.rados.0.smithi033.stdout:3483: done (1 left) 2021-07-26T16:09:32.324 INFO:tasks.rados.rados.0.smithi033.stdout:3484: done (0 left) 2021-07-26T16:09:32.324 INFO:tasks.rados.rados.0.smithi033.stdout:3485: snap_remove snap 272 2021-07-26T16:09:32.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:32 smithi033 bash[41341]: cluster 2021-07-26T16:09:31.192759+0000 mgr.y (mgr.34104) 467 : cluster [DBG] pgmap v933: 25 pgs: 25 active+clean; 891 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2021-07-26T16:09:32.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:32 smithi033 bash[42377]: cluster 2021-07-26T16:09:31.192759+0000 mgr.y (mgr.34104) 467 : cluster [DBG] pgmap v933: 25 pgs: 25 active+clean; 891 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2021-07-26T16:09:32.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:32 smithi096 bash[33981]: cluster 2021-07-26T16:09:31.192759+0000 mgr.y (mgr.34104) 467 : cluster [DBG] pgmap v933: 25 pgs: 25 active+clean; 891 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 1.7 MiB/s wr, 25 op/s 2021-07-26T16:09:33.335 INFO:tasks.rados.rados.0.smithi033.stdout:3485: done (0 left) 2021-07-26T16:09:33.336 INFO:tasks.rados.rados.0.smithi033.stdout:3486: delete oid 2 current snap is 344 2021-07-26T16:09:33.356 INFO:tasks.rados.rados.0.smithi033.stdout:3486: done (0 left) 2021-07-26T16:09:33.356 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 344 2021-07-26T16:09:33.356 INFO:tasks.rados.rados.0.smithi033.stdout:3487: seq_num 1038 ranges {8093696=589824} 2021-07-26T16:09:33.406 INFO:tasks.rados.rados.0.smithi033.stdout:3487: writing smithi03339061-33 from 8093696 to 8683520 tid 1 2021-07-26T16:09:33.406 INFO:tasks.rados.rados.0.smithi033.stdout:3488: read oid 39 snap -1 2021-07-26T16:09:33.406 INFO:tasks.rados.rados.0.smithi033.stdout:3488: expect deleted 2021-07-26T16:09:33.407 INFO:tasks.rados.rados.0.smithi033.stdout:3489: read oid 42 snap -1 2021-07-26T16:09:33.407 INFO:tasks.rados.rados.0.smithi033.stdout:3489: expect deleted 2021-07-26T16:09:33.407 INFO:tasks.rados.rados.0.smithi033.stdout:3490: copy_from oid 28 from oid 9 current snap is 344 2021-07-26T16:09:33.407 INFO:tasks.rados.rados.0.smithi033.stdout:3491: read oid 6 snap -1 2021-07-26T16:09:33.407 INFO:tasks.rados.rados.0.smithi033.stdout:3491: expect (ObjNum 1032 snap 344 seq_num 1032) 2021-07-26T16:09:33.408 INFO:tasks.rados.rados.0.smithi033.stdout:3492: delete oid 24 current snap is 344 2021-07-26T16:09:33.412 INFO:tasks.rados.rados.0.smithi033.stdout:3488: done (5 left) 2021-07-26T16:09:33.412 INFO:tasks.rados.rados.0.smithi033.stdout:3489: done (4 left) 2021-07-26T16:09:33.412 INFO:tasks.rados.rados.0.smithi033.stdout:3492: done (3 left) 2021-07-26T16:09:33.413 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 344 2021-07-26T16:09:33.413 INFO:tasks.rados.rados.0.smithi033.stdout:3493: seq_num 1040 ranges {4227072=622592} 2021-07-26T16:09:33.440 INFO:tasks.rados.rados.0.smithi033.stdout:3493: writing smithi03339061-50 from 4227072 to 4849664 tid 1 2021-07-26T16:09:33.440 INFO:tasks.rados.rados.0.smithi033.stdout:3494: read oid 36 snap -1 2021-07-26T16:09:33.441 INFO:tasks.rados.rados.0.smithi033.stdout:3494: expect (ObjNum 1026 snap 341 seq_num 1026) 2021-07-26T16:09:33.441 INFO:tasks.rados.rados.0.smithi033.stdout:3495: read oid 8 snap -1 2021-07-26T16:09:33.441 INFO:tasks.rados.rados.0.smithi033.stdout:3495: expect deleted 2021-07-26T16:09:33.441 INFO:tasks.rados.rados.0.smithi033.stdout:3496: snap_remove snap 343 2021-07-26T16:09:33.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:33 smithi033 bash[41341]: cluster 2021-07-26T16:09:32.313316+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e737: 8 total, 8 up, 8 in 2021-07-26T16:09:33.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:33 smithi033 bash[42377]: cluster 2021-07-26T16:09:32.313316+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e737: 8 total, 8 up, 8 in 2021-07-26T16:09:33.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:33 smithi096 bash[33981]: cluster 2021-07-26T16:09:32.313316+0000 mon.a (mon.0) 1114 : cluster [DBG] osdmap e737: 8 total, 8 up, 8 in 2021-07-26T16:09:34.357 INFO:tasks.rados.rados.0.smithi033.stdout:3487: finishing write tid 1 to smithi03339061-33 2021-07-26T16:09:34.357 INFO:tasks.rados.rados.0.smithi033.stdout:3487: finishing write tid 2 to smithi03339061-33 2021-07-26T16:09:34.357 INFO:tasks.rados.rados.0.smithi033.stdout:3491: expect (ObjNum 1032 snap 344 seq_num 1032) 2021-07-26T16:09:34.373 INFO:tasks.rados.rados.0.smithi033.stdout:3487: finishing write tid 3 to smithi03339061-33 2021-07-26T16:09:34.373 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 2173 (ObjNum 1038 snap 344 seq_num 1038) dirty exists 2021-07-26T16:09:34.373 INFO:tasks.rados.rados.0.smithi033.stdout:3487: left oid 33 (ObjNum 1038 snap 344 seq_num 1038) 2021-07-26T16:09:34.373 INFO:tasks.rados.rados.0.smithi033.stdout:3490: finishing copy_from to smithi03339061-28 2021-07-26T16:09:34.375 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1779 (ObjNum 836 snap 277 seq_num 836) dirty exists 2021-07-26T16:09:34.375 INFO:tasks.rados.rados.0.smithi033.stdout:3490: finishing copy_from racing read to smithi03339061-28 2021-07-26T16:09:34.375 INFO:tasks.rados.rados.0.smithi033.stdout:3487: done (6 left) 2021-07-26T16:09:34.375 INFO:tasks.rados.rados.0.smithi033.stdout:3490: done (5 left) 2021-07-26T16:09:34.375 INFO:tasks.rados.rados.0.smithi033.stdout:3491: done (4 left) 2021-07-26T16:09:34.376 INFO:tasks.rados.rados.0.smithi033.stdout:3496: done (3 left) 2021-07-26T16:09:34.377 INFO:tasks.rados.rados.0.smithi033.stdout:3497: rollback oid 6 current snap is 344 2021-07-26T16:09:34.377 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 6 to 275 2021-07-26T16:09:34.377 INFO:tasks.rados.rados.0.smithi033.stdout:3493: finishing write tid 1 to smithi03339061-50 2021-07-26T16:09:34.377 INFO:tasks.rados.rados.0.smithi033.stdout:3493: finishing write tid 2 to smithi03339061-50 2021-07-26T16:09:34.377 INFO:tasks.rados.rados.0.smithi033.stdout:3494: expect (ObjNum 1026 snap 341 seq_num 1026) 2021-07-26T16:09:34.385 INFO:tasks.rados.rados.0.smithi033.stdout:3493: finishing write tid 3 to smithi03339061-50 2021-07-26T16:09:34.387 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1836 (ObjNum 1040 snap 344 seq_num 1040) dirty exists 2021-07-26T16:09:34.387 INFO:tasks.rados.rados.0.smithi033.stdout:3493: left oid 50 (ObjNum 1040 snap 344 seq_num 1040) 2021-07-26T16:09:34.387 INFO:tasks.rados.rados.0.smithi033.stdout:3493: done (3 left) 2021-07-26T16:09:34.387 INFO:tasks.rados.rados.0.smithi033.stdout:3494: done (2 left) 2021-07-26T16:09:34.388 INFO:tasks.rados.rados.0.smithi033.stdout:3495: done (1 left) 2021-07-26T16:09:34.388 INFO:tasks.rados.rados.0.smithi033.stdout:3498: rollback oid 13 current snap is 344 2021-07-26T16:09:34.388 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 13 to 321 2021-07-26T16:09:34.388 INFO:tasks.rados.rados.0.smithi033.stdout:3497: finishing rollback tid 0 to smithi03339061-6 2021-07-26T16:09:34.388 INFO:tasks.rados.rados.0.smithi033.stdout:3497: finishing rollback tid 1 to smithi03339061-6 2021-07-26T16:09:34.389 INFO:tasks.rados.rados.0.smithi033.stdout:3497: finishing rollback tid 2 to smithi03339061-6 2021-07-26T16:09:34.389 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 2182 (ObjNum 824 snap 274 seq_num 824) dirty exists 2021-07-26T16:09:34.389 INFO:tasks.rados.rados.0.smithi033.stdout:3497: done (1 left) 2021-07-26T16:09:34.389 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 344 2021-07-26T16:09:34.390 INFO:tasks.rados.rados.0.smithi033.stdout:3499: seq_num 1041 ranges {8683520=638976} 2021-07-26T16:09:34.441 INFO:tasks.rados.rados.0.smithi033.stdout:3499: writing smithi03339061-33 from 8683520 to 9322496 tid 1 2021-07-26T16:09:34.442 INFO:tasks.rados.rados.0.smithi033.stdout:3500: snap_create 2021-07-26T16:09:34.442 INFO:tasks.rados.rados.0.smithi033.stdout:3498: finishing rollback tid 0 to smithi03339061-13 2021-07-26T16:09:34.442 INFO:tasks.rados.rados.0.smithi033.stdout:3498: finishing rollback tid 1 to smithi03339061-13 2021-07-26T16:09:34.442 INFO:tasks.rados.rados.0.smithi033.stdout:3498: finishing rollback tid 2 to smithi03339061-13 2021-07-26T16:09:34.443 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 2039 (ObjNum 930 snap 312 seq_num 930) dirty exists 2021-07-26T16:09:34.448 INFO:tasks.rados.rados.0.smithi033.stdout:3499: finishing write tid 1 to smithi03339061-33 2021-07-26T16:09:34.449 INFO:tasks.rados.rados.0.smithi033.stdout:3499: finishing write tid 2 to smithi03339061-33 2021-07-26T16:09:34.452 INFO:tasks.rados.rados.0.smithi033.stdout:3499: finishing write tid 3 to smithi03339061-33 2021-07-26T16:09:34.452 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 2184 (ObjNum 1041 snap 344 seq_num 1041) dirty exists 2021-07-26T16:09:34.452 INFO:tasks.rados.rados.0.smithi033.stdout:3499: left oid 33 (ObjNum 1041 snap 344 seq_num 1041) 2021-07-26T16:09:34.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:34 smithi033 bash[41341]: cluster 2021-07-26T16:09:33.193556+0000 mgr.y (mgr.34104) 468 : cluster [DBG] pgmap v936: 25 pgs: 25 active+clean; 914 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 7.1 MiB/s wr, 37 op/s 2021-07-26T16:09:34.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:34 smithi033 bash[41341]: cluster 2021-07-26T16:09:33.333024+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e738: 8 total, 8 up, 8 in 2021-07-26T16:09:34.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:34 smithi033 bash[42377]: cluster 2021-07-26T16:09:33.193556+0000 mgr.y (mgr.34104) 468 : cluster [DBG] pgmap v936: 25 pgs: 25 active+clean; 914 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 7.1 MiB/s wr, 37 op/s 2021-07-26T16:09:34.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:34 smithi033 bash[42377]: cluster 2021-07-26T16:09:33.333024+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e738: 8 total, 8 up, 8 in 2021-07-26T16:09:34.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:34 smithi096 bash[33981]: cluster 2021-07-26T16:09:33.193556+0000 mgr.y (mgr.34104) 468 : cluster [DBG] pgmap v936: 25 pgs: 25 active+clean; 914 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 28 MiB/s rd, 7.1 MiB/s wr, 37 op/s 2021-07-26T16:09:34.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:34 smithi096 bash[33981]: cluster 2021-07-26T16:09:33.333024+0000 mon.a (mon.0) 1115 : cluster [DBG] osdmap e738: 8 total, 8 up, 8 in 2021-07-26T16:09:35.364 INFO:tasks.rados.rados.0.smithi033.stdout:3498: done (2 left) 2021-07-26T16:09:35.364 INFO:tasks.rados.rados.0.smithi033.stdout:3499: done (1 left) 2021-07-26T16:09:35.365 INFO:tasks.rados.rados.0.smithi033.stdout:3500: done (0 left) 2021-07-26T16:09:35.365 INFO:tasks.rados.rados.0.smithi033.stdout:3501: snap_create 2021-07-26T16:09:35.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:35 smithi033 bash[41341]: cluster 2021-07-26T16:09:34.345703+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e739: 8 total, 8 up, 8 in 2021-07-26T16:09:35.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:35 smithi033 bash[42377]: cluster 2021-07-26T16:09:34.345703+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e739: 8 total, 8 up, 8 in 2021-07-26T16:09:35.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:35 smithi096 bash[33981]: cluster 2021-07-26T16:09:34.345703+0000 mon.a (mon.0) 1116 : cluster [DBG] osdmap e739: 8 total, 8 up, 8 in 2021-07-26T16:09:36.251 INFO:tasks.rados.rados.0.smithi033.stdout:3501: done (0 left) 2021-07-26T16:09:36.252 INFO:tasks.rados.rados.0.smithi033.stdout:3502: snap_remove snap 332 2021-07-26T16:09:36.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:36 smithi033 bash[41341]: cluster 2021-07-26T16:09:35.194325+0000 mgr.y (mgr.34104) 469 : cluster [DBG] pgmap v939: 25 pgs: 25 active+clean; 917 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.4 MiB/s wr, 18 op/s 2021-07-26T16:09:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:36 smithi033 bash[41341]: cluster 2021-07-26T16:09:35.361296+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e740: 8 total, 8 up, 8 in 2021-07-26T16:09:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:36 smithi033 bash[41341]: cluster 2021-07-26T16:09:36.247842+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e741: 8 total, 8 up, 8 in 2021-07-26T16:09:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:36 smithi033 bash[42377]: cluster 2021-07-26T16:09:35.194325+0000 mgr.y (mgr.34104) 469 : cluster [DBG] pgmap v939: 25 pgs: 25 active+clean; 917 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.4 MiB/s wr, 18 op/s 2021-07-26T16:09:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:36 smithi033 bash[42377]: cluster 2021-07-26T16:09:35.361296+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e740: 8 total, 8 up, 8 in 2021-07-26T16:09:36.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:36 smithi033 bash[42377]: cluster 2021-07-26T16:09:36.247842+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e741: 8 total, 8 up, 8 in 2021-07-26T16:09:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:36 smithi096 bash[33981]: cluster 2021-07-26T16:09:35.194325+0000 mgr.y (mgr.34104) 469 : cluster [DBG] pgmap v939: 25 pgs: 25 active+clean; 917 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 6.4 MiB/s wr, 18 op/s 2021-07-26T16:09:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:36 smithi096 bash[33981]: cluster 2021-07-26T16:09:35.361296+0000 mon.a (mon.0) 1117 : cluster [DBG] osdmap e740: 8 total, 8 up, 8 in 2021-07-26T16:09:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:36 smithi096 bash[33981]: cluster 2021-07-26T16:09:36.247842+0000 mon.a (mon.0) 1118 : cluster [DBG] osdmap e741: 8 total, 8 up, 8 in 2021-07-26T16:09:37.264 INFO:tasks.rados.rados.0.smithi033.stdout:3502: done (0 left) 2021-07-26T16:09:37.265 INFO:tasks.rados.rados.0.smithi033.stdout:3503: read oid 44 snap -1 2021-07-26T16:09:37.265 INFO:tasks.rados.rados.0.smithi033.stdout:3503: expect (ObjNum 995 snap 329 seq_num 995) 2021-07-26T16:09:37.265 INFO:tasks.rados.rados.0.smithi033.stdout:3504: read oid 21 snap -1 2021-07-26T16:09:37.266 INFO:tasks.rados.rados.0.smithi033.stdout:3504: expect (ObjNum 951 snap 321 seq_num 951) 2021-07-26T16:09:37.266 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 346 2021-07-26T16:09:37.266 INFO:tasks.rados.rados.0.smithi033.stdout:3505: seq_num 1042 ranges {0=655360} 2021-07-26T16:09:37.271 INFO:tasks.rados.rados.0.smithi033.stdout:3505: writing smithi03339061-46 from 0 to 655360 tid 1 2021-07-26T16:09:37.272 INFO:tasks.rados.rados.0.smithi033.stdout:3506: read oid 3 snap -1 2021-07-26T16:09:37.272 INFO:tasks.rados.rados.0.smithi033.stdout:3506: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:09:37.273 INFO:tasks.rados.rados.0.smithi033.stdout:3507: snap_create 2021-07-26T16:09:37.282 INFO:tasks.rados.rados.0.smithi033.stdout:3506: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:09:37.295 INFO:tasks.rados.rados.0.smithi033.stdout:3505: finishing write tid 1 to smithi03339061-46 2021-07-26T16:09:37.295 INFO:tasks.rados.rados.0.smithi033.stdout:3505: finishing write tid 2 to smithi03339061-46 2021-07-26T16:09:37.297 INFO:tasks.rados.rados.0.smithi033.stdout:3505: finishing write tid 3 to smithi03339061-46 2021-07-26T16:09:37.297 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1347 (ObjNum 1042 snap 346 seq_num 1042) dirty exists 2021-07-26T16:09:37.297 INFO:tasks.rados.rados.0.smithi033.stdout:3505: left oid 46 (ObjNum 1042 snap 346 seq_num 1042) 2021-07-26T16:09:37.306 INFO:tasks.rados.rados.0.smithi033.stdout:3504: expect (ObjNum 951 snap 321 seq_num 951) 2021-07-26T16:09:37.523 INFO:tasks.rados.rados.0.smithi033.stdout:3503: expect (ObjNum 995 snap 329 seq_num 995) 2021-07-26T16:09:38.275 INFO:tasks.rados.rados.0.smithi033.stdout:3503: done (4 left) 2021-07-26T16:09:38.275 INFO:tasks.rados.rados.0.smithi033.stdout:3504: done (3 left) 2021-07-26T16:09:38.275 INFO:tasks.rados.rados.0.smithi033.stdout:3505: done (2 left) 2021-07-26T16:09:38.275 INFO:tasks.rados.rados.0.smithi033.stdout:3506: done (1 left) 2021-07-26T16:09:38.276 INFO:tasks.rados.rados.0.smithi033.stdout:3507: done (0 left) 2021-07-26T16:09:38.276 INFO:tasks.rados.rados.0.smithi033.stdout:3508: snap_remove snap 307 2021-07-26T16:09:38.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:38 smithi033 bash[42377]: cluster 2021-07-26T16:09:37.195027+0000 mgr.y (mgr.34104) 470 : cluster [DBG] pgmap v942: 25 pgs: 25 active+clean; 919 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 6 op/s 2021-07-26T16:09:38.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:38 smithi033 bash[42377]: cluster 2021-07-26T16:09:37.261294+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e742: 8 total, 8 up, 8 in 2021-07-26T16:09:38.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:38 smithi033 bash[41341]: cluster 2021-07-26T16:09:37.195027+0000 mgr.y (mgr.34104) 470 : cluster [DBG] pgmap v942: 25 pgs: 25 active+clean; 919 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 6 op/s 2021-07-26T16:09:38.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:38 smithi033 bash[41341]: cluster 2021-07-26T16:09:37.261294+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e742: 8 total, 8 up, 8 in 2021-07-26T16:09:38.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:38 smithi096 bash[33981]: cluster 2021-07-26T16:09:37.195027+0000 mgr.y (mgr.34104) 470 : cluster [DBG] pgmap v942: 25 pgs: 25 active+clean; 919 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 6 op/s 2021-07-26T16:09:38.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:38 smithi096 bash[33981]: cluster 2021-07-26T16:09:37.261294+0000 mon.a (mon.0) 1119 : cluster [DBG] osdmap e742: 8 total, 8 up, 8 in 2021-07-26T16:09:39.281 INFO:tasks.rados.rados.0.smithi033.stdout:3508: done (0 left) 2021-07-26T16:09:39.281 INFO:tasks.rados.rados.0.smithi033.stdout:3509: snap_remove snap 301 2021-07-26T16:09:39.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:39 smithi033 bash[41341]: cluster 2021-07-26T16:09:38.272238+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e743: 8 total, 8 up, 8 in 2021-07-26T16:09:39.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:39 smithi033 bash[42377]: cluster 2021-07-26T16:09:38.272238+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e743: 8 total, 8 up, 8 in 2021-07-26T16:09:39.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:39 smithi096 bash[33981]: cluster 2021-07-26T16:09:38.272238+0000 mon.a (mon.0) 1120 : cluster [DBG] osdmap e743: 8 total, 8 up, 8 in 2021-07-26T16:09:40.294 INFO:tasks.rados.rados.0.smithi033.stdout:3509: done (0 left) 2021-07-26T16:09:40.295 INFO:tasks.rados.rados.0.smithi033.stdout:3510: read oid 24 snap 340 2021-07-26T16:09:40.295 INFO:tasks.rados.rados.0.smithi033.stdout:3510: expect (ObjNum 911 snap 305 seq_num 911) 2021-07-26T16:09:40.295 INFO:tasks.rados.rados.0.smithi033.stdout:3511: read oid 38 snap 329 2021-07-26T16:09:40.296 INFO:tasks.rados.rados.0.smithi033.stdout:3511: expect (ObjNum 971 snap 325 seq_num 971) 2021-07-26T16:09:40.296 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 347 2021-07-26T16:09:40.296 INFO:tasks.rados.rados.0.smithi033.stdout:3512: seq_num 1043 ranges {2646016=671744} 2021-07-26T16:09:40.316 INFO:tasks.rados.rados.0.smithi033.stdout:3512: writing smithi03339061-31 from 2646016 to 3317760 tid 1 2021-07-26T16:09:40.317 INFO:tasks.rados.rados.0.smithi033.stdout:3513: snap_remove snap 338 2021-07-26T16:09:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:40 smithi033 bash[41341]: cluster 2021-07-26T16:09:39.195758+0000 mgr.y (mgr.34104) 471 : cluster [DBG] pgmap v945: 25 pgs: 25 active+clean; 924 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2021-07-26T16:09:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:40 smithi033 bash[41341]: cluster 2021-07-26T16:09:39.275452+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e744: 8 total, 8 up, 8 in 2021-07-26T16:09:40.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:40 smithi033 bash[42377]: cluster 2021-07-26T16:09:39.195758+0000 mgr.y (mgr.34104) 471 : cluster [DBG] pgmap v945: 25 pgs: 25 active+clean; 924 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2021-07-26T16:09:40.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:40 smithi033 bash[42377]: cluster 2021-07-26T16:09:39.275452+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e744: 8 total, 8 up, 8 in 2021-07-26T16:09:40.733 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:40 smithi096 bash[33981]: cluster 2021-07-26T16:09:39.195758+0000 mgr.y (mgr.34104) 471 : cluster [DBG] pgmap v945: 25 pgs: 25 active+clean; 924 MiB data, 3.2 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 1.1 MiB/s wr, 6 op/s 2021-07-26T16:09:40.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:40 smithi096 bash[33981]: cluster 2021-07-26T16:09:39.275452+0000 mon.a (mon.0) 1121 : cluster [DBG] osdmap e744: 8 total, 8 up, 8 in 2021-07-26T16:09:41.257 INFO:tasks.rados.rados.0.smithi033.stdout:3512: finishing write tid 1 to smithi03339061-31 2021-07-26T16:09:41.257 INFO:tasks.rados.rados.0.smithi033.stdout:3512: finishing write tid 2 to smithi03339061-31 2021-07-26T16:09:41.257 INFO:tasks.rados.rados.0.smithi033.stdout:3512: finishing write tid 3 to smithi03339061-31 2021-07-26T16:09:41.258 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1385 (ObjNum 1043 snap 347 seq_num 1043) dirty exists 2021-07-26T16:09:41.258 INFO:tasks.rados.rados.0.smithi033.stdout:3512: left oid 31 (ObjNum 1043 snap 347 seq_num 1043) 2021-07-26T16:09:41.258 INFO:tasks.rados.rados.0.smithi033.stdout:3511: expect (ObjNum 971 snap 325 seq_num 971) 2021-07-26T16:09:41.317 INFO:tasks.rados.rados.0.smithi033.stdout:3510: expect (ObjNum 911 snap 305 seq_num 911) 2021-07-26T16:09:41.439 INFO:tasks.rados.rados.0.smithi033.stdout:3510: done (3 left) 2021-07-26T16:09:41.439 INFO:tasks.rados.rados.0.smithi033.stdout:3511: done (2 left) 2021-07-26T16:09:41.440 INFO:tasks.rados.rados.0.smithi033.stdout:3512: done (1 left) 2021-07-26T16:09:41.440 INFO:tasks.rados.rados.0.smithi033.stdout:3513: done (0 left) 2021-07-26T16:09:41.440 INFO:tasks.rados.rados.0.smithi033.stdout:3514: snap_remove snap 231 2021-07-26T16:09:41.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:41 smithi033 bash[42377]: cluster 2021-07-26T16:09:40.290511+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e745: 8 total, 8 up, 8 in 2021-07-26T16:09:41.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:41 smithi033 bash[42377]: cluster 2021-07-26T16:09:41.249807+0000 mon.a (mon.0) 1123 : cluster [DBG] osdmap e746: 8 total, 8 up, 8 in 2021-07-26T16:09:41.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:41 smithi033 bash[41341]: cluster 2021-07-26T16:09:40.290511+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e745: 8 total, 8 up, 8 in 2021-07-26T16:09:41.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:41 smithi033 bash[41341]: cluster 2021-07-26T16:09:41.249807+0000 mon.a (mon.0) 1123 : cluster [DBG] osdmap e746: 8 total, 8 up, 8 in 2021-07-26T16:09:41.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:41 smithi096 bash[33981]: cluster 2021-07-26T16:09:40.290511+0000 mon.a (mon.0) 1122 : cluster [DBG] osdmap e745: 8 total, 8 up, 8 in 2021-07-26T16:09:41.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:41 smithi096 bash[33981]: cluster 2021-07-26T16:09:41.249807+0000 mon.a (mon.0) 1123 : cluster [DBG] osdmap e746: 8 total, 8 up, 8 in 2021-07-26T16:09:42.329 INFO:tasks.rados.rados.0.smithi033.stdout:3514: done (0 left) 2021-07-26T16:09:42.330 INFO:tasks.rados.rados.0.smithi033.stdout:3515: delete oid 18 current snap is 347 2021-07-26T16:09:42.346 INFO:tasks.rados.rados.0.smithi033.stdout:3515: done (0 left) 2021-07-26T16:09:42.346 INFO:tasks.rados.rados.0.smithi033.stdout:3516: read oid 6 snap -1 2021-07-26T16:09:42.347 INFO:tasks.rados.rados.0.smithi033.stdout:3516: expect (ObjNum 824 snap 274 seq_num 824) 2021-07-26T16:09:42.347 INFO:tasks.rados.rados.0.smithi033.stdout:3517: rollback oid 26 current snap is 347 2021-07-26T16:09:42.347 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 26 to 344 2021-07-26T16:09:42.347 INFO:tasks.rados.rados.0.smithi033.stdout:3518: snap_remove snap 320 2021-07-26T16:09:42.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:42 smithi033 bash[42377]: cluster 2021-07-26T16:09:41.196572+0000 mgr.y (mgr.34104) 472 : cluster [DBG] pgmap v948: 25 pgs: 25 active+clean; 925 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 460 KiB/s wr, 6 op/s 2021-07-26T16:09:42.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:42 smithi033 bash[41341]: cluster 2021-07-26T16:09:41.196572+0000 mgr.y (mgr.34104) 472 : cluster [DBG] pgmap v948: 25 pgs: 25 active+clean; 925 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 460 KiB/s wr, 6 op/s 2021-07-26T16:09:42.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:42 smithi096 bash[33981]: cluster 2021-07-26T16:09:41.196572+0000 mgr.y (mgr.34104) 472 : cluster [DBG] pgmap v948: 25 pgs: 25 active+clean; 925 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 8.0 MiB/s rd, 460 KiB/s wr, 6 op/s 2021-07-26T16:09:43.336 INFO:tasks.rados.rados.0.smithi033.stdout:3518: done (2 left) 2021-07-26T16:09:43.337 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 347 2021-07-26T16:09:43.337 INFO:tasks.rados.rados.0.smithi033.stdout:3519: seq_num 1045 ranges {4227072=704512} 2021-07-26T16:09:43.366 INFO:tasks.rados.rados.0.smithi033.stdout:3519: writing smithi03339061-1 from 4227072 to 4931584 tid 1 2021-07-26T16:09:43.367 INFO:tasks.rados.rados.0.smithi033.stdout:3517: finishing rollback tid 0 to smithi03339061-26 2021-07-26T16:09:43.367 INFO:tasks.rados.rados.0.smithi033.stdout:3516: expect (ObjNum 824 snap 274 seq_num 824) 2021-07-26T16:09:43.637 INFO:tasks.rados.rados.0.smithi033.stdout:3517: finishing rollback tid 1 to smithi03339061-26 2021-07-26T16:09:43.637 INFO:tasks.rados.rados.0.smithi033.stdout:3517: finishing rollback tid 2 to smithi03339061-26 2021-07-26T16:09:43.638 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 2228 (ObjNum 1033 snap 344 seq_num 1033) dirty exists 2021-07-26T16:09:43.638 INFO:tasks.rados.rados.0.smithi033.stdout:3519: finishing write tid 1 to smithi03339061-1 2021-07-26T16:09:43.638 INFO:tasks.rados.rados.0.smithi033.stdout:3519: finishing write tid 2 to smithi03339061-1 2021-07-26T16:09:43.638 INFO:tasks.rados.rados.0.smithi033.stdout:3519: finishing write tid 3 to smithi03339061-1 2021-07-26T16:09:43.639 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1084 (ObjNum 1045 snap 347 seq_num 1045) dirty exists 2021-07-26T16:09:43.639 INFO:tasks.rados.rados.0.smithi033.stdout:3519: left oid 1 (ObjNum 1045 snap 347 seq_num 1045) 2021-07-26T16:09:43.639 INFO:tasks.rados.rados.0.smithi033.stdout:3516: done (2 left) 2021-07-26T16:09:43.639 INFO:tasks.rados.rados.0.smithi033.stdout:3517: done (1 left) 2021-07-26T16:09:43.639 INFO:tasks.rados.rados.0.smithi033.stdout:3519: done (0 left) 2021-07-26T16:09:43.640 INFO:tasks.rados.rados.0.smithi033.stdout:3520: read oid 40 snap -1 2021-07-26T16:09:43.640 INFO:tasks.rados.rados.0.smithi033.stdout:3520: expect (ObjNum 1013 snap 338 seq_num 1013) 2021-07-26T16:09:43.640 INFO:tasks.rados.rados.0.smithi033.stdout:3521: read oid 19 snap -1 2021-07-26T16:09:43.640 INFO:tasks.rados.rados.0.smithi033.stdout:3521: expect (ObjNum 836 snap 277 seq_num 836) 2021-07-26T16:09:43.641 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 347 2021-07-26T16:09:43.641 INFO:tasks.rados.rados.0.smithi033.stdout:3522: seq_num 1046 ranges {2498560=729088} 2021-07-26T16:09:43.664 INFO:tasks.rados.rados.0.smithi033.stdout:3522: writing smithi03339061-28 from 2498560 to 3227648 tid 1 2021-07-26T16:09:43.665 INFO:tasks.rados.rados.0.smithi033.stdout:3523: read oid 24 snap 248 2021-07-26T16:09:43.665 INFO:tasks.rados.rados.0.smithi033.stdout:3523: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:09:43.665 INFO:tasks.rados.rados.0.smithi033.stdout:3524: read oid 11 snap -1 2021-07-26T16:09:43.665 INFO:tasks.rados.rados.0.smithi033.stdout:3524: expect (ObjNum 1027 snap 341 seq_num 1027) 2021-07-26T16:09:43.665 INFO:tasks.rados.rados.0.smithi033.stdout:3525: read oid 36 snap -1 2021-07-26T16:09:43.666 INFO:tasks.rados.rados.0.smithi033.stdout:3525: expect (ObjNum 1026 snap 341 seq_num 1026) 2021-07-26T16:09:43.666 INFO:tasks.rados.rados.0.smithi033.stdout:3526: setattr oid 20 current snap is 347 2021-07-26T16:09:43.666 INFO:tasks.rados.rados.0.smithi033.stdout:3520: expect (ObjNum 1013 snap 338 seq_num 1013) 2021-07-26T16:09:43.675 INFO:tasks.rados.rados.0.smithi033.stdout:3521: expect (ObjNum 836 snap 277 seq_num 836) 2021-07-26T16:09:43.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:43 smithi033 bash[41341]: cluster 2021-07-26T16:09:42.323264+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e747: 8 total, 8 up, 8 in 2021-07-26T16:09:43.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:43 smithi033 bash[42377]: cluster 2021-07-26T16:09:42.323264+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e747: 8 total, 8 up, 8 in 2021-07-26T16:09:43.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:43 smithi096 bash[33981]: cluster 2021-07-26T16:09:42.323264+0000 mon.a (mon.0) 1124 : cluster [DBG] osdmap e747: 8 total, 8 up, 8 in 2021-07-26T16:09:43.752 INFO:tasks.rados.rados.0.smithi033.stdout:3523: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:09:43.814 INFO:tasks.rados.rados.0.smithi033.stdout:3522: finishing write tid 1 to smithi03339061-28 2021-07-26T16:09:43.814 INFO:tasks.rados.rados.0.smithi033.stdout:3522: finishing write tid 2 to smithi03339061-28 2021-07-26T16:09:43.814 INFO:tasks.rados.rados.0.smithi033.stdout:3522: finishing write tid 3 to smithi03339061-28 2021-07-26T16:09:43.815 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1839 (ObjNum 1046 snap 347 seq_num 1046) dirty exists 2021-07-26T16:09:43.815 INFO:tasks.rados.rados.0.smithi033.stdout:3522: left oid 28 (ObjNum 1046 snap 347 seq_num 1046) 2021-07-26T16:09:43.815 INFO:tasks.rados.rados.0.smithi033.stdout:3524: expect (ObjNum 1027 snap 341 seq_num 1027) 2021-07-26T16:09:44.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:44 smithi033 bash[41341]: cluster 2021-07-26T16:09:43.197288+0000 mgr.y (mgr.34104) 473 : cluster [DBG] pgmap v951: 25 pgs: 25 active+clean; 910 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 160 KiB/s wr, 6 op/s 2021-07-26T16:09:44.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:44 smithi033 bash[41341]: cluster 2021-07-26T16:09:43.333736+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e748: 8 total, 8 up, 8 in 2021-07-26T16:09:44.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:44 smithi033 bash[42377]: cluster 2021-07-26T16:09:43.197288+0000 mgr.y (mgr.34104) 473 : cluster [DBG] pgmap v951: 25 pgs: 25 active+clean; 910 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 160 KiB/s wr, 6 op/s 2021-07-26T16:09:44.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:44 smithi033 bash[42377]: cluster 2021-07-26T16:09:43.333736+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e748: 8 total, 8 up, 8 in 2021-07-26T16:09:44.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:44 smithi096 bash[33981]: cluster 2021-07-26T16:09:43.197288+0000 mgr.y (mgr.34104) 473 : cluster [DBG] pgmap v951: 25 pgs: 25 active+clean; 910 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 160 KiB/s wr, 6 op/s 2021-07-26T16:09:44.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:44 smithi096 bash[33981]: cluster 2021-07-26T16:09:43.333736+0000 mon.a (mon.0) 1125 : cluster [DBG] osdmap e748: 8 total, 8 up, 8 in 2021-07-26T16:09:45.552 INFO:tasks.rados.rados.0.smithi033.stdout:3525: expect (ObjNum 1026 snap 341 seq_num 1026) 2021-07-26T16:09:45.563 INFO:tasks.rados.rados.0.smithi033.stdout:3520: done (6 left) 2021-07-26T16:09:45.563 INFO:tasks.rados.rados.0.smithi033.stdout:3521: done (5 left) 2021-07-26T16:09:45.563 INFO:tasks.rados.rados.0.smithi033.stdout:3522: done (4 left) 2021-07-26T16:09:45.563 INFO:tasks.rados.rados.0.smithi033.stdout:3523: done (3 left) 2021-07-26T16:09:45.563 INFO:tasks.rados.rados.0.smithi033.stdout:3524: done (2 left) 2021-07-26T16:09:45.564 INFO:tasks.rados.rados.0.smithi033.stdout:3525: done (1 left) 2021-07-26T16:09:45.564 INFO:tasks.rados.rados.0.smithi033.stdout:3527: delete oid 44 current snap is 347 2021-07-26T16:09:45.571 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 2040 (ObjNum 1031 snap 344 seq_num 1031) dirty exists 2021-07-26T16:09:45.572 INFO:tasks.rados.rados.0.smithi033.stdout:3526: done (1 left) 2021-07-26T16:09:45.573 INFO:tasks.rados.rados.0.smithi033.stdout:3527: done (0 left) 2021-07-26T16:09:45.573 INFO:tasks.rados.rados.0.smithi033.stdout:3528: delete oid 30 current snap is 347 2021-07-26T16:09:45.577 INFO:tasks.rados.rados.0.smithi033.stdout:3528: done (0 left) 2021-07-26T16:09:45.577 INFO:tasks.rados.rados.0.smithi033.stdout:3529: rollback oid 21 current snap is 347 2021-07-26T16:09:45.578 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 21 to 346 2021-07-26T16:09:45.578 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 50 current snap is 347 2021-07-26T16:09:45.578 INFO:tasks.rados.rados.0.smithi033.stdout:3530: seq_num 1049 ranges {4849664=778240} 2021-07-26T16:09:45.613 INFO:tasks.rados.rados.0.smithi033.stdout:3530: writing smithi03339061-50 from 4849664 to 5627904 tid 1 2021-07-26T16:09:45.613 INFO:tasks.rados.rados.0.smithi033.stdout:3531: rollback oid 12 current snap is 347 2021-07-26T16:09:45.614 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 12 to 328 2021-07-26T16:09:45.614 INFO:tasks.rados.rados.0.smithi033.stdout:3529: finishing rollback tid 0 to smithi03339061-21 2021-07-26T16:09:45.614 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 347 2021-07-26T16:09:45.614 INFO:tasks.rados.rados.0.smithi033.stdout:3529: finishing rollback tid 1 to smithi03339061-21 2021-07-26T16:09:45.615 INFO:tasks.rados.rados.0.smithi033.stdout:3529: finishing rollback tid 2 to smithi03339061-21 2021-07-26T16:09:45.615 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1833 (ObjNum 951 snap 321 seq_num 951) dirty exists 2021-07-26T16:09:45.615 INFO:tasks.rados.rados.0.smithi033.stdout:3532: seq_num 1050 ranges {2899968=794624} 2021-07-26T16:09:45.634 INFO:tasks.rados.rados.0.smithi033.stdout:3532: writing smithi03339061-48 from 2899968 to 3694592 tid 1 2021-07-26T16:09:45.634 INFO:tasks.rados.rados.0.smithi033.stdout:3529: done (3 left) 2021-07-26T16:09:45.635 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 347 2021-07-26T16:09:45.635 INFO:tasks.rados.rados.0.smithi033.stdout:3533: seq_num 1051 ranges {9322496=409600,9732096=401408} 2021-07-26T16:09:45.688 INFO:tasks.rados.rados.0.smithi033.stdout:3533: writing smithi03339061-33 from 9322496 to 9732096 tid 1 2021-07-26T16:09:45.691 INFO:tasks.rados.rados.0.smithi033.stdout:3533: writing smithi03339061-33 from 9732096 to 10133504 tid 2 2021-07-26T16:09:45.691 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 347 2021-07-26T16:09:45.692 INFO:tasks.rados.rados.0.smithi033.stdout:3534: seq_num 1052 ranges {778240=425984,1204224=401408} 2021-07-26T16:09:45.698 INFO:tasks.rados.rados.0.smithi033.stdout:3534: writing smithi03339061-26 from 778240 to 1204224 tid 1 2021-07-26T16:09:45.701 INFO:tasks.rados.rados.0.smithi033.stdout:3534: writing smithi03339061-26 from 1204224 to 1605632 tid 2 2021-07-26T16:09:45.701 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 347 2021-07-26T16:09:45.702 INFO:tasks.rados.rados.0.smithi033.stdout:3530: finishing write tid 1 to smithi03339061-50 2021-07-26T16:09:45.702 INFO:tasks.rados.rados.0.smithi033.stdout:3535: seq_num 1053 ranges {2744320=442368,3186688=401408} 2021-07-26T16:09:45.719 INFO:tasks.rados.rados.0.smithi033.stdout:3535: writing smithi03339061-5 from 2744320 to 3186688 tid 1 2021-07-26T16:09:45.721 INFO:tasks.rados.rados.0.smithi033.stdout:3535: writing smithi03339061-5 from 3186688 to 3588096 tid 2 2021-07-26T16:09:45.722 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 24 current snap is 347 2021-07-26T16:09:45.722 INFO:tasks.rados.rados.0.smithi033.stdout:3536: seq_num 1054 ranges {0=458752,458752=401408} 2021-07-26T16:09:45.724 INFO:tasks.rados.rados.0.smithi033.stdout:3536: writing smithi03339061-24 from 0 to 458752 tid 1 2021-07-26T16:09:45.727 INFO:tasks.rados.rados.0.smithi033.stdout:3536: writing smithi03339061-24 from 458752 to 860160 tid 2 2021-07-26T16:09:45.727 INFO:tasks.rados.rados.0.smithi033.stdout:3537: rollback oid 44 current snap is 347 2021-07-26T16:09:45.728 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 44 to 278 2021-07-26T16:09:45.728 INFO:tasks.rados.rados.0.smithi033.stdout:3530: finishing write tid 2 to smithi03339061-50 2021-07-26T16:09:45.728 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 347 2021-07-26T16:09:45.728 INFO:tasks.rados.rados.0.smithi033.stdout:3538: seq_num 1055 ranges {18014208=475136,18489344=401408} 2021-07-26T16:09:45.828 INFO:tasks.rados.rados.0.smithi033.stdout:3538: writing smithi03339061-47 from 18014208 to 18489344 tid 1 2021-07-26T16:09:45.833 INFO:tasks.rados.rados.0.smithi033.stdout:3538: writing smithi03339061-47 from 18489344 to 18890752 tid 2 2021-07-26T16:09:45.833 INFO:tasks.rados.rados.0.smithi033.stdout:3539: copy_from oid 21 from oid 37 current snap is 347 2021-07-26T16:09:45.833 INFO:tasks.rados.rados.0.smithi033.stdout:3531: finishing rollback tid 0 to smithi03339061-12 2021-07-26T16:09:45.834 INFO:tasks.rados.rados.0.smithi033.stdout:3531: finishing rollback tid 1 to smithi03339061-12 2021-07-26T16:09:45.834 INFO:tasks.rados.rados.0.smithi033.stdout:3540: copy_from oid 14 from oid 20 current snap is 347 2021-07-26T16:09:45.834 INFO:tasks.rados.rados.0.smithi033.stdout:3530: finishing write tid 3 to smithi03339061-50 2021-07-26T16:09:45.834 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1838 (ObjNum 1049 snap 347 seq_num 1049) dirty exists 2021-07-26T16:09:45.835 INFO:tasks.rados.rados.0.smithi033.stdout:3530: left oid 50 (ObjNum 1049 snap 347 seq_num 1049) 2021-07-26T16:09:45.835 INFO:tasks.rados.rados.0.smithi033.stdout:3531: finishing rollback tid 2 to smithi03339061-12 2021-07-26T16:09:45.835 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1842 (ObjNum 948 snap 321 seq_num 948) dirty exists 2021-07-26T16:09:45.835 INFO:tasks.rados.rados.0.smithi033.stdout:3532: finishing write tid 1 to smithi03339061-48 2021-07-26T16:09:45.835 INFO:tasks.rados.rados.0.smithi033.stdout:3532: finishing write tid 2 to smithi03339061-48 2021-07-26T16:09:45.836 INFO:tasks.rados.rados.0.smithi033.stdout:3532: finishing write tid 3 to smithi03339061-48 2021-07-26T16:09:45.836 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 1856 (ObjNum 1050 snap 347 seq_num 1050) dirty exists 2021-07-26T16:09:45.836 INFO:tasks.rados.rados.0.smithi033.stdout:3532: left oid 48 (ObjNum 1050 snap 347 seq_num 1050) 2021-07-26T16:09:45.836 INFO:tasks.rados.rados.0.smithi033.stdout:3533: finishing write tid 1 to smithi03339061-33 2021-07-26T16:09:45.837 INFO:tasks.rados.rados.0.smithi033.stdout:3533: finishing write tid 2 to smithi03339061-33 2021-07-26T16:09:45.837 INFO:tasks.rados.rados.0.smithi033.stdout:3530: done (10 left) 2021-07-26T16:09:45.837 INFO:tasks.rados.rados.0.smithi033.stdout:3531: done (9 left) 2021-07-26T16:09:45.837 INFO:tasks.rados.rados.0.smithi033.stdout:3532: done (8 left) 2021-07-26T16:09:45.837 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 347 2021-07-26T16:09:45.838 INFO:tasks.rados.rados.0.smithi033.stdout:3533: finishing write tid 3 to smithi03339061-33 2021-07-26T16:09:45.838 INFO:tasks.rados.rados.0.smithi033.stdout:3534: finishing write tid 1 to smithi03339061-26 2021-07-26T16:09:45.838 INFO:tasks.rados.rados.0.smithi033.stdout:3534: finishing write tid 2 to smithi03339061-26 2021-07-26T16:09:45.838 INFO:tasks.rados.rados.0.smithi033.stdout:3534: finishing write tid 3 to smithi03339061-26 2021-07-26T16:09:45.839 INFO:tasks.rados.rados.0.smithi033.stdout:3533: finishing write tid 4 to smithi03339061-33 2021-07-26T16:09:45.839 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 2252 (ObjNum 1051 snap 347 seq_num 1051) dirty exists 2021-07-26T16:09:45.839 INFO:tasks.rados.rados.0.smithi033.stdout:3533: left oid 33 (ObjNum 1051 snap 347 seq_num 1051) 2021-07-26T16:09:45.839 INFO:tasks.rados.rados.0.smithi033.stdout:3534: finishing write tid 4 to smithi03339061-26 2021-07-26T16:09:45.839 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 2255 (ObjNum 1052 snap 347 seq_num 1052) dirty exists 2021-07-26T16:09:45.840 INFO:tasks.rados.rados.0.smithi033.stdout:3534: left oid 26 (ObjNum 1052 snap 347 seq_num 1052) 2021-07-26T16:09:45.840 INFO:tasks.rados.rados.0.smithi033.stdout:3535: finishing write tid 1 to smithi03339061-5 2021-07-26T16:09:45.840 INFO:tasks.rados.rados.0.smithi033.stdout:3535: finishing write tid 2 to smithi03339061-5 2021-07-26T16:09:45.840 INFO:tasks.rados.rados.0.smithi033.stdout:3537: finishing rollback tid 1 to smithi03339061-44 2021-07-26T16:09:45.840 INFO:tasks.rados.rados.0.smithi033.stdout:3535: finishing write tid 3 to smithi03339061-5 2021-07-26T16:09:45.841 INFO:tasks.rados.rados.0.smithi033.stdout:3537: finishing rollback tid 2 to smithi03339061-44 2021-07-26T16:09:45.841 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 2043 (ObjNum 826 snap 274 seq_num 826) dirty exists 2021-07-26T16:09:45.841 INFO:tasks.rados.rados.0.smithi033.stdout:3536: finishing write tid 1 to smithi03339061-24 2021-07-26T16:09:45.841 INFO:tasks.rados.rados.0.smithi033.stdout:3535: finishing write tid 4 to smithi03339061-5 2021-07-26T16:09:45.842 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 1859 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2021-07-26T16:09:45.842 INFO:tasks.rados.rados.0.smithi033.stdout:3535: left oid 5 (ObjNum 1053 snap 347 seq_num 1053) 2021-07-26T16:09:45.842 INFO:tasks.rados.rados.0.smithi033.stdout:3536: finishing write tid 2 to smithi03339061-24 2021-07-26T16:09:45.842 INFO:tasks.rados.rados.0.smithi033.stdout:3536: finishing write tid 3 to smithi03339061-24 2021-07-26T16:09:45.842 INFO:tasks.rados.rados.0.smithi033.stdout:3536: finishing write tid 4 to smithi03339061-24 2021-07-26T16:09:45.843 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 1888 (ObjNum 1054 snap 347 seq_num 1054) dirty exists 2021-07-26T16:09:45.843 INFO:tasks.rados.rados.0.smithi033.stdout:3536: left oid 24 (ObjNum 1054 snap 347 seq_num 1054) 2021-07-26T16:09:45.843 INFO:tasks.rados.rados.0.smithi033.stdout:3541: seq_num 1056 ranges {2981888=491520,3473408=401408} 2021-07-26T16:09:45.850 INFO:tasks.rados.rados.0.smithi033.stdout:3541: writing smithi03339061-29 from 2981888 to 3473408 tid 1 2021-07-26T16:09:45.854 INFO:tasks.rados.rados.0.smithi033.stdout:3541: writing smithi03339061-29 from 3473408 to 3874816 tid 2 2021-07-26T16:09:45.854 INFO:tasks.rados.rados.0.smithi033.stdout:3533: done (8 left) 2021-07-26T16:09:45.854 INFO:tasks.rados.rados.0.smithi033.stdout:3534: done (7 left) 2021-07-26T16:09:45.855 INFO:tasks.rados.rados.0.smithi033.stdout:3535: done (6 left) 2021-07-26T16:09:45.855 INFO:tasks.rados.rados.0.smithi033.stdout:3536: done (5 left) 2021-07-26T16:09:45.855 INFO:tasks.rados.rados.0.smithi033.stdout:3537: done (4 left) 2021-07-26T16:09:45.855 INFO:tasks.rados.rados.0.smithi033.stdout:3542: snap_create 2021-07-26T16:09:45.855 INFO:tasks.rados.rados.0.smithi033.stdout:3538: finishing write tid 1 to smithi03339061-47 2021-07-26T16:09:45.856 INFO:tasks.rados.rados.0.smithi033.stdout:3538: finishing write tid 2 to smithi03339061-47 2021-07-26T16:09:45.856 INFO:tasks.rados.rados.0.smithi033.stdout:3538: finishing write tid 3 to smithi03339061-47 2021-07-26T16:09:45.856 INFO:tasks.rados.rados.0.smithi033.stdout:3538: finishing write tid 4 to smithi03339061-47 2021-07-26T16:09:45.856 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 1892 (ObjNum 1055 snap 347 seq_num 1055) dirty exists 2021-07-26T16:09:45.857 INFO:tasks.rados.rados.0.smithi033.stdout:3538: left oid 47 (ObjNum 1055 snap 347 seq_num 1055) 2021-07-26T16:09:45.857 INFO:tasks.rados.rados.0.smithi033.stdout:3540: finishing copy_from to smithi03339061-14 2021-07-26T16:09:45.857 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 2040 (ObjNum 1031 snap 344 seq_num 1031) dirty exists 2021-07-26T16:09:45.857 INFO:tasks.rados.rados.0.smithi033.stdout:3540: finishing copy_from racing read to smithi03339061-14 2021-07-26T16:09:45.858 INFO:tasks.rados.rados.0.smithi033.stdout:3539: finishing copy_from to smithi03339061-21 2021-07-26T16:09:45.858 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1849 (ObjNum 1010 snap 338 seq_num 1010) dirty exists 2021-07-26T16:09:45.858 INFO:tasks.rados.rados.0.smithi033.stdout:3539: finishing copy_from racing read to smithi03339061-21 2021-07-26T16:09:45.860 INFO:tasks.rados.rados.0.smithi033.stdout:3541: finishing write tid 1 to smithi03339061-29 2021-07-26T16:09:45.860 INFO:tasks.rados.rados.0.smithi033.stdout:3541: finishing write tid 2 to smithi03339061-29 2021-07-26T16:09:45.861 INFO:tasks.rados.rados.0.smithi033.stdout:3541: finishing write tid 3 to smithi03339061-29 2021-07-26T16:09:45.863 INFO:tasks.rados.rados.0.smithi033.stdout:3541: finishing write tid 4 to smithi03339061-29 2021-07-26T16:09:45.863 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1350 (ObjNum 1056 snap 347 seq_num 1056) dirty exists 2021-07-26T16:09:45.863 INFO:tasks.rados.rados.0.smithi033.stdout:3541: left oid 29 (ObjNum 1056 snap 347 seq_num 1056) 2021-07-26T16:09:46.258 INFO:tasks.rados.rados.0.smithi033.stdout:3538: done (4 left) 2021-07-26T16:09:46.258 INFO:tasks.rados.rados.0.smithi033.stdout:3539: done (3 left) 2021-07-26T16:09:46.258 INFO:tasks.rados.rados.0.smithi033.stdout:3540: done (2 left) 2021-07-26T16:09:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:3541: done (1 left) 2021-07-26T16:09:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:3542: done (0 left) 2021-07-26T16:09:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:3543: rollback oid 20 current snap is 348 2021-07-26T16:09:46.259 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 20 to 296 2021-07-26T16:09:46.260 INFO:tasks.rados.rados.0.smithi033.stdout:3544: read oid 37 snap -1 2021-07-26T16:09:46.260 INFO:tasks.rados.rados.0.smithi033.stdout:3544: expect (ObjNum 1010 snap 338 seq_num 1010) 2021-07-26T16:09:46.260 INFO:tasks.rados.rados.0.smithi033.stdout:3545: read oid 29 snap -1 2021-07-26T16:09:46.260 INFO:tasks.rados.rados.0.smithi033.stdout:3545: expect (ObjNum 1056 snap 347 seq_num 1056) 2021-07-26T16:09:46.260 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 348 2021-07-26T16:09:46.261 INFO:tasks.rados.rados.0.smithi033.stdout:3546: seq_num 1057 ranges {655360=507904,1163264=401408} 2021-07-26T16:09:46.268 INFO:tasks.rados.rados.0.smithi033.stdout:3546: writing smithi03339061-46 from 655360 to 1163264 tid 1 2021-07-26T16:09:46.271 INFO:tasks.rados.rados.0.smithi033.stdout:3546: writing smithi03339061-46 from 1163264 to 1564672 tid 2 2021-07-26T16:09:46.271 INFO:tasks.rados.rados.0.smithi033.stdout:3547: rmattr oid 33 current snap is 348 2021-07-26T16:09:46.272 INFO:tasks.rados.rados.0.smithi033.stdout:3544: expect (ObjNum 1010 snap 338 seq_num 1010) 2021-07-26T16:09:46.353 INFO:tasks.rados.rados.0.smithi033.stdout:3543: finishing rollback tid 0 to smithi03339061-20 2021-07-26T16:09:46.353 INFO:tasks.rados.rados.0.smithi033.stdout:3543: finishing rollback tid 1 to smithi03339061-20 2021-07-26T16:09:46.354 INFO:tasks.rados.rados.0.smithi033.stdout:3543: finishing rollback tid 2 to smithi03339061-20 2021-07-26T16:09:46.354 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 2046 (ObjNum 895 snap 294 seq_num 895) dirty exists 2021-07-26T16:09:46.354 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 2257 (ObjNum 1051 snap 347 seq_num 1051) dirty exists 2021-07-26T16:09:46.354 INFO:tasks.rados.rados.0.smithi033.stdout:3545: expect (ObjNum 1056 snap 347 seq_num 1056) 2021-07-26T16:09:46.595 INFO:tasks.rados.rados.0.smithi033.stdout:3546: finishing write tid 1 to smithi03339061-46 2021-07-26T16:09:46.596 INFO:tasks.rados.rados.0.smithi033.stdout:3546: finishing write tid 2 to smithi03339061-46 2021-07-26T16:09:46.596 INFO:tasks.rados.rados.0.smithi033.stdout:3546: finishing write tid 3 to smithi03339061-46 2021-07-26T16:09:46.596 INFO:tasks.rados.rados.0.smithi033.stdout:3546: finishing write tid 4 to smithi03339061-46 2021-07-26T16:09:46.597 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1353 (ObjNum 1057 snap 348 seq_num 1057) dirty exists 2021-07-26T16:09:46.597 INFO:tasks.rados.rados.0.smithi033.stdout:3546: left oid 46 (ObjNum 1057 snap 348 seq_num 1057) 2021-07-26T16:09:46.597 INFO:tasks.rados.rados.0.smithi033.stdout:3543: done (4 left) 2021-07-26T16:09:46.597 INFO:tasks.rados.rados.0.smithi033.stdout:3544: done (3 left) 2021-07-26T16:09:46.597 INFO:tasks.rados.rados.0.smithi033.stdout:3545: done (2 left) 2021-07-26T16:09:46.598 INFO:tasks.rados.rados.0.smithi033.stdout:3546: done (1 left) 2021-07-26T16:09:46.598 INFO:tasks.rados.rados.0.smithi033.stdout:3547: done (0 left) 2021-07-26T16:09:46.598 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 348 2021-07-26T16:09:46.598 INFO:tasks.rados.rados.0.smithi033.stdout:3548: seq_num 1058 ranges {172032=524288,696320=401408} 2021-07-26T16:09:46.605 INFO:tasks.rados.rados.0.smithi033.stdout:3548: writing smithi03339061-40 from 172032 to 696320 tid 1 2021-07-26T16:09:46.610 INFO:tasks.rados.rados.0.smithi033.stdout:3548: writing smithi03339061-40 from 696320 to 1097728 tid 2 2021-07-26T16:09:46.610 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 44 current snap is 348 2021-07-26T16:09:46.611 INFO:tasks.rados.rados.0.smithi033.stdout:3549: seq_num 1059 ranges {4202496=540672,4743168=401408} 2021-07-26T16:09:46.636 INFO:tasks.rados.rados.0.smithi033.stdout:3549: writing smithi03339061-44 from 4202496 to 4743168 tid 1 2021-07-26T16:09:46.639 INFO:tasks.rados.rados.0.smithi033.stdout:3549: writing smithi03339061-44 from 4743168 to 5144576 tid 2 2021-07-26T16:09:46.639 INFO:tasks.rados.rados.0.smithi033.stdout:3550: read oid 11 snap 302 2021-07-26T16:09:46.639 INFO:tasks.rados.rados.0.smithi033.stdout:3550: expect (ObjNum 695 snap 229 seq_num 695) 2021-07-26T16:09:46.639 INFO:tasks.rados.rados.0.smithi033.stdout:3551: snap_remove snap 255 2021-07-26T16:09:46.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:46 smithi033 bash[42377]: cluster 2021-07-26T16:09:45.197771+0000 mgr.y (mgr.34104) 474 : cluster [DBG] pgmap v953: 25 pgs: 25 active+clean; 891 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 279 KiB/s wr, 7 op/s 2021-07-26T16:09:46.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:46 smithi033 bash[42377]: cluster 2021-07-26T16:09:46.253553+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e749: 8 total, 8 up, 8 in 2021-07-26T16:09:46.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:46 smithi033 bash[41341]: cluster 2021-07-26T16:09:45.197771+0000 mgr.y (mgr.34104) 474 : cluster [DBG] pgmap v953: 25 pgs: 25 active+clean; 891 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 279 KiB/s wr, 7 op/s 2021-07-26T16:09:46.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:46 smithi033 bash[41341]: cluster 2021-07-26T16:09:46.253553+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e749: 8 total, 8 up, 8 in 2021-07-26T16:09:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:46 smithi096 bash[33981]: cluster 2021-07-26T16:09:45.197771+0000 mgr.y (mgr.34104) 474 : cluster [DBG] pgmap v953: 25 pgs: 25 active+clean; 891 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 279 KiB/s wr, 7 op/s 2021-07-26T16:09:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:46 smithi096 bash[33981]: cluster 2021-07-26T16:09:46.253553+0000 mon.a (mon.0) 1126 : cluster [DBG] osdmap e749: 8 total, 8 up, 8 in 2021-07-26T16:09:47.350 INFO:tasks.rados.rados.0.smithi033.stdout:3551: done (3 left) 2021-07-26T16:09:47.351 INFO:tasks.rados.rados.0.smithi033.stdout:3552: copy_from oid 35 from oid 1 current snap is 348 2021-07-26T16:09:47.351 INFO:tasks.rados.rados.0.smithi033.stdout:3548: finishing write tid 1 to smithi03339061-40 2021-07-26T16:09:47.351 INFO:tasks.rados.rados.0.smithi033.stdout:3548: finishing write tid 2 to smithi03339061-40 2021-07-26T16:09:47.351 INFO:tasks.rados.rados.0.smithi033.stdout:3548: finishing write tid 3 to smithi03339061-40 2021-07-26T16:09:47.352 INFO:tasks.rados.rados.0.smithi033.stdout:3548: finishing write tid 4 to smithi03339061-40 2021-07-26T16:09:47.352 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 1411 (ObjNum 1058 snap 348 seq_num 1058) dirty exists 2021-07-26T16:09:47.352 INFO:tasks.rados.rados.0.smithi033.stdout:3548: left oid 40 (ObjNum 1058 snap 348 seq_num 1058) 2021-07-26T16:09:47.352 INFO:tasks.rados.rados.0.smithi033.stdout:3549: finishing write tid 1 to smithi03339061-44 2021-07-26T16:09:47.352 INFO:tasks.rados.rados.0.smithi033.stdout:3549: finishing write tid 2 to smithi03339061-44 2021-07-26T16:09:47.353 INFO:tasks.rados.rados.0.smithi033.stdout:3549: finishing write tid 3 to smithi03339061-44 2021-07-26T16:09:47.353 INFO:tasks.rados.rados.0.smithi033.stdout:3549: finishing write tid 4 to smithi03339061-44 2021-07-26T16:09:47.353 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 2049 (ObjNum 1059 snap 348 seq_num 1059) dirty exists 2021-07-26T16:09:47.354 INFO:tasks.rados.rados.0.smithi033.stdout:3549: left oid 44 (ObjNum 1059 snap 348 seq_num 1059) 2021-07-26T16:09:47.354 INFO:tasks.rados.rados.0.smithi033.stdout:3550: expect (ObjNum 695 snap 229 seq_num 695) 2021-07-26T16:09:48.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:48 smithi033 bash[41341]: cluster 2021-07-26T16:09:47.198436+0000 mgr.y (mgr.34104) 475 : cluster [DBG] pgmap v955: 25 pgs: 25 active+clean; 892 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 473 KiB/s wr, 8 op/s 2021-07-26T16:09:48.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:48 smithi033 bash[41341]: cluster 2021-07-26T16:09:47.345867+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e750: 8 total, 8 up, 8 in 2021-07-26T16:09:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:48 smithi033 bash[42377]: cluster 2021-07-26T16:09:47.198436+0000 mgr.y (mgr.34104) 475 : cluster [DBG] pgmap v955: 25 pgs: 25 active+clean; 892 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 473 KiB/s wr, 8 op/s 2021-07-26T16:09:48.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:48 smithi033 bash[42377]: cluster 2021-07-26T16:09:47.345867+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e750: 8 total, 8 up, 8 in 2021-07-26T16:09:48.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:48 smithi096 bash[33981]: cluster 2021-07-26T16:09:47.198436+0000 mgr.y (mgr.34104) 475 : cluster [DBG] pgmap v955: 25 pgs: 25 active+clean; 892 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 473 KiB/s wr, 8 op/s 2021-07-26T16:09:48.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:48 smithi096 bash[33981]: cluster 2021-07-26T16:09:47.345867+0000 mon.a (mon.0) 1127 : cluster [DBG] osdmap e750: 8 total, 8 up, 8 in 2021-07-26T16:09:48.872 INFO:tasks.rados.rados.0.smithi033.stdout:3552: finishing copy_from to smithi03339061-35 2021-07-26T16:09:48.873 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1084 (ObjNum 1045 snap 347 seq_num 1045) dirty exists 2021-07-26T16:09:48.873 INFO:tasks.rados.rados.0.smithi033.stdout:3552: finishing copy_from racing read to smithi03339061-35 2021-07-26T16:09:48.873 INFO:tasks.rados.rados.0.smithi033.stdout:3548: done (3 left) 2021-07-26T16:09:48.873 INFO:tasks.rados.rados.0.smithi033.stdout:3549: done (2 left) 2021-07-26T16:09:48.874 INFO:tasks.rados.rados.0.smithi033.stdout:3550: done (1 left) 2021-07-26T16:09:48.874 INFO:tasks.rados.rados.0.smithi033.stdout:3552: done (0 left) 2021-07-26T16:09:48.874 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 348 2021-07-26T16:09:48.874 INFO:tasks.rados.rados.0.smithi033.stdout:3553: seq_num 1060 ranges {3874816=557056,4431872=401408} 2021-07-26T16:09:48.905 INFO:tasks.rados.rados.0.smithi033.stdout:3553: writing smithi03339061-29 from 3874816 to 4431872 tid 1 2021-07-26T16:09:48.907 INFO:tasks.rados.rados.0.smithi033.stdout:3553: writing smithi03339061-29 from 4431872 to 4833280 tid 2 2021-07-26T16:09:48.908 INFO:tasks.rados.rados.0.smithi033.stdout:3554: snap_create 2021-07-26T16:09:48.919 INFO:tasks.rados.rados.0.smithi033.stdout:3553: finishing write tid 1 to smithi03339061-29 2021-07-26T16:09:48.920 INFO:tasks.rados.rados.0.smithi033.stdout:3553: finishing write tid 2 to smithi03339061-29 2021-07-26T16:09:48.920 INFO:tasks.rados.rados.0.smithi033.stdout:3553: finishing write tid 3 to smithi03339061-29 2021-07-26T16:09:48.923 INFO:tasks.rados.rados.0.smithi033.stdout:3553: finishing write tid 4 to smithi03339061-29 2021-07-26T16:09:48.924 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1356 (ObjNum 1060 snap 348 seq_num 1060) dirty exists 2021-07-26T16:09:48.924 INFO:tasks.rados.rados.0.smithi033.stdout:3553: left oid 29 (ObjNum 1060 snap 348 seq_num 1060) 2021-07-26T16:09:49.360 INFO:tasks.rados.rados.0.smithi033.stdout:3553: done (1 left) 2021-07-26T16:09:49.361 INFO:tasks.rados.rados.0.smithi033.stdout:3554: done (0 left) 2021-07-26T16:09:49.361 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 349 2021-07-26T16:09:49.361 INFO:tasks.rados.rados.0.smithi033.stdout:3555: seq_num 1061 ranges {2555904=573440,3129344=401408} 2021-07-26T16:09:49.380 INFO:tasks.rados.rados.0.smithi033.stdout:3555: writing smithi03339061-49 from 2555904 to 3129344 tid 1 2021-07-26T16:09:49.382 INFO:tasks.rados.rados.0.smithi033.stdout:3555: writing smithi03339061-49 from 3129344 to 3530752 tid 2 2021-07-26T16:09:49.382 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 349 2021-07-26T16:09:49.382 INFO:tasks.rados.rados.0.smithi033.stdout:3556: seq_num 1062 ranges {0=589824,589824=401408} 2021-07-26T16:09:49.386 INFO:tasks.rados.rados.0.smithi033.stdout:3556: writing smithi03339061-18 from 0 to 589824 tid 1 2021-07-26T16:09:49.389 INFO:tasks.rados.rados.0.smithi033.stdout:3556: writing smithi03339061-18 from 589824 to 991232 tid 2 2021-07-26T16:09:49.389 INFO:tasks.rados.rados.0.smithi033.stdout:3557: snap_remove snap 347 2021-07-26T16:09:50.367 INFO:tasks.rados.rados.0.smithi033.stdout:3557: done (2 left) 2021-07-26T16:09:50.367 INFO:tasks.rados.rados.0.smithi033.stdout:3558: read oid 7 snap -1 2021-07-26T16:09:50.367 INFO:tasks.rados.rados.0.smithi033.stdout:3558: expect (ObjNum 1021 snap 341 seq_num 1021) 2021-07-26T16:09:50.367 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 349 2021-07-26T16:09:50.368 INFO:tasks.rados.rados.0.smithi033.stdout:3559: seq_num 1063 ranges {4931584=606208,5537792=401408} 2021-07-26T16:09:50.401 INFO:tasks.rados.rados.0.smithi033.stdout:3559: writing smithi03339061-1 from 4931584 to 5537792 tid 1 2021-07-26T16:09:50.404 INFO:tasks.rados.rados.0.smithi033.stdout:3559: writing smithi03339061-1 from 5537792 to 5939200 tid 2 2021-07-26T16:09:50.404 INFO:tasks.rados.rados.0.smithi033.stdout:3560: rollback oid 50 current snap is 349 2021-07-26T16:09:50.404 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 50 to 330 2021-07-26T16:09:50.404 INFO:tasks.rados.rados.0.smithi033.stdout:3555: finishing write tid 1 to smithi03339061-49 2021-07-26T16:09:50.405 INFO:tasks.rados.rados.0.smithi033.stdout:3555: finishing write tid 2 to smithi03339061-49 2021-07-26T16:09:50.405 INFO:tasks.rados.rados.0.smithi033.stdout:3555: finishing write tid 3 to smithi03339061-49 2021-07-26T16:09:50.405 INFO:tasks.rados.rados.0.smithi033.stdout:3561: snap_remove snap 283 2021-07-26T16:09:50.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:50 smithi033 bash[41341]: cluster 2021-07-26T16:09:49.199170+0000 mgr.y (mgr.34104) 476 : cluster [DBG] pgmap v957: 25 pgs: 25 active+clean; 883 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2021-07-26T16:09:50.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:50 smithi033 bash[41341]: cluster 2021-07-26T16:09:49.355268+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e751: 8 total, 8 up, 8 in 2021-07-26T16:09:50.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:50 smithi033 bash[42377]: cluster 2021-07-26T16:09:49.199170+0000 mgr.y (mgr.34104) 476 : cluster [DBG] pgmap v957: 25 pgs: 25 active+clean; 883 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2021-07-26T16:09:50.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:50 smithi033 bash[42377]: cluster 2021-07-26T16:09:49.355268+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e751: 8 total, 8 up, 8 in 2021-07-26T16:09:50.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:50 smithi096 bash[33981]: cluster 2021-07-26T16:09:49.199170+0000 mgr.y (mgr.34104) 476 : cluster [DBG] pgmap v957: 25 pgs: 25 active+clean; 883 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 1.3 MiB/s wr, 9 op/s 2021-07-26T16:09:50.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:50 smithi096 bash[33981]: cluster 2021-07-26T16:09:49.355268+0000 mon.a (mon.0) 1128 : cluster [DBG] osdmap e751: 8 total, 8 up, 8 in 2021-07-26T16:09:51.258 INFO:tasks.rados.rados.0.smithi033.stdout:3561: done (5 left) 2021-07-26T16:09:51.259 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 20 current snap is 349 2021-07-26T16:09:51.259 INFO:tasks.rados.rados.0.smithi033.stdout:3556: finishing write tid 1 to smithi03339061-18 2021-07-26T16:09:51.259 INFO:tasks.rados.rados.0.smithi033.stdout:3555: finishing write tid 4 to smithi03339061-49 2021-07-26T16:09:51.259 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 946 (ObjNum 1061 snap 349 seq_num 1061) dirty exists 2021-07-26T16:09:51.260 INFO:tasks.rados.rados.0.smithi033.stdout:3555: left oid 49 (ObjNum 1061 snap 349 seq_num 1061) 2021-07-26T16:09:51.260 INFO:tasks.rados.rados.0.smithi033.stdout:3556: finishing write tid 2 to smithi03339061-18 2021-07-26T16:09:51.260 INFO:tasks.rados.rados.0.smithi033.stdout:3556: finishing write tid 3 to smithi03339061-18 2021-07-26T16:09:51.260 INFO:tasks.rados.rados.0.smithi033.stdout:3556: finishing write tid 4 to smithi03339061-18 2021-07-26T16:09:51.261 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 2270 (ObjNum 1062 snap 349 seq_num 1062) dirty exists 2021-07-26T16:09:51.261 INFO:tasks.rados.rados.0.smithi033.stdout:3556: left oid 18 (ObjNum 1062 snap 349 seq_num 1062) 2021-07-26T16:09:51.261 INFO:tasks.rados.rados.0.smithi033.stdout:3558: expect (ObjNum 1021 snap 341 seq_num 1021) 2021-07-26T16:09:51.280 INFO:tasks.rados.rados.0.smithi033.stdout:3562: seq_num 1064 ranges {2383872=622592,3006464=401408} 2021-07-26T16:09:51.292 INFO:tasks.rados.rados.0.smithi033.stdout:3562: writing smithi03339061-20 from 2383872 to 3006464 tid 1 2021-07-26T16:09:51.296 INFO:tasks.rados.rados.0.smithi033.stdout:3562: writing smithi03339061-20 from 3006464 to 3407872 tid 2 2021-07-26T16:09:51.296 INFO:tasks.rados.rados.0.smithi033.stdout:3555: done (5 left) 2021-07-26T16:09:51.296 INFO:tasks.rados.rados.0.smithi033.stdout:3556: done (4 left) 2021-07-26T16:09:51.296 INFO:tasks.rados.rados.0.smithi033.stdout:3558: done (3 left) 2021-07-26T16:09:51.297 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 349 2021-07-26T16:09:51.297 INFO:tasks.rados.rados.0.smithi033.stdout:3559: finishing write tid 1 to smithi03339061-1 2021-07-26T16:09:51.297 INFO:tasks.rados.rados.0.smithi033.stdout:3559: finishing write tid 2 to smithi03339061-1 2021-07-26T16:09:51.297 INFO:tasks.rados.rados.0.smithi033.stdout:3559: finishing write tid 3 to smithi03339061-1 2021-07-26T16:09:51.297 INFO:tasks.rados.rados.0.smithi033.stdout:3560: finishing rollback tid 0 to smithi03339061-50 2021-07-26T16:09:51.298 INFO:tasks.rados.rados.0.smithi033.stdout:3559: finishing write tid 4 to smithi03339061-1 2021-07-26T16:09:51.298 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1087 (ObjNum 1063 snap 349 seq_num 1063) dirty exists 2021-07-26T16:09:51.298 INFO:tasks.rados.rados.0.smithi033.stdout:3559: left oid 1 (ObjNum 1063 snap 349 seq_num 1063) 2021-07-26T16:09:51.299 INFO:tasks.rados.rados.0.smithi033.stdout:3560: finishing rollback tid 1 to smithi03339061-50 2021-07-26T16:09:51.299 INFO:tasks.rados.rados.0.smithi033.stdout:3560: finishing rollback tid 2 to smithi03339061-50 2021-07-26T16:09:51.299 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 1841 (ObjNum 926 snap 309 seq_num 926) dirty exists 2021-07-26T16:09:51.299 INFO:tasks.rados.rados.0.smithi033.stdout:3563: seq_num 1065 ranges {991232=638976,1630208=401408} 2021-07-26T16:09:51.305 INFO:tasks.rados.rados.0.smithi033.stdout:3563: writing smithi03339061-18 from 991232 to 1630208 tid 1 2021-07-26T16:09:51.309 INFO:tasks.rados.rados.0.smithi033.stdout:3563: writing smithi03339061-18 from 1630208 to 2031616 tid 2 2021-07-26T16:09:51.309 INFO:tasks.rados.rados.0.smithi033.stdout:3559: done (3 left) 2021-07-26T16:09:51.309 INFO:tasks.rados.rados.0.smithi033.stdout:3560: done (2 left) 2021-07-26T16:09:51.309 INFO:tasks.rados.rados.0.smithi033.stdout:3564: copy_from oid 13 from oid 47 current snap is 349 2021-07-26T16:09:51.310 INFO:tasks.rados.rados.0.smithi033.stdout:3562: finishing write tid 1 to smithi03339061-20 2021-07-26T16:09:51.310 INFO:tasks.rados.rados.0.smithi033.stdout:3562: finishing write tid 2 to smithi03339061-20 2021-07-26T16:09:51.310 INFO:tasks.rados.rados.0.smithi033.stdout:3562: finishing write tid 3 to smithi03339061-20 2021-07-26T16:09:51.310 INFO:tasks.rados.rados.0.smithi033.stdout:3562: finishing write tid 4 to smithi03339061-20 2021-07-26T16:09:51.310 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 2052 (ObjNum 1064 snap 349 seq_num 1064) dirty exists 2021-07-26T16:09:51.311 INFO:tasks.rados.rados.0.smithi033.stdout:3562: left oid 20 (ObjNum 1064 snap 349 seq_num 1064) 2021-07-26T16:09:51.311 INFO:tasks.rados.rados.0.smithi033.stdout:3562: done (2 left) 2021-07-26T16:09:51.311 INFO:tasks.rados.rados.0.smithi033.stdout:3565: read oid 28 snap -1 2021-07-26T16:09:51.311 INFO:tasks.rados.rados.0.smithi033.stdout:3565: expect (ObjNum 1046 snap 347 seq_num 1046) 2021-07-26T16:09:51.312 INFO:tasks.rados.rados.0.smithi033.stdout:3566: snap_remove snap 336 2021-07-26T16:09:51.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:51 smithi033 bash[41341]: cluster 2021-07-26T16:09:50.359542+0000 mon.a (mon.0) 1129 : cluster [DBG] osdmap e752: 8 total, 8 up, 8 in 2021-07-26T16:09:51.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:51 smithi033 bash[41341]: cluster 2021-07-26T16:09:51.254570+0000 mon.a (mon.0) 1130 : cluster [DBG] osdmap e753: 8 total, 8 up, 8 in 2021-07-26T16:09:51.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:51 smithi033 bash[42377]: cluster 2021-07-26T16:09:50.359542+0000 mon.a (mon.0) 1129 : cluster [DBG] osdmap e752: 8 total, 8 up, 8 in 2021-07-26T16:09:51.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:51 smithi033 bash[42377]: cluster 2021-07-26T16:09:51.254570+0000 mon.a (mon.0) 1130 : cluster [DBG] osdmap e753: 8 total, 8 up, 8 in 2021-07-26T16:09:51.733 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:51 smithi096 bash[33981]: cluster 2021-07-26T16:09:50.359542+0000 mon.a (mon.0) 1129 : cluster [DBG] osdmap e752: 8 total, 8 up, 8 in 2021-07-26T16:09:51.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:51 smithi096 bash[33981]: cluster 2021-07-26T16:09:51.254570+0000 mon.a (mon.0) 1130 : cluster [DBG] osdmap e753: 8 total, 8 up, 8 in 2021-07-26T16:09:52.275 INFO:tasks.rados.rados.0.smithi033.stdout:3566: done (3 left) 2021-07-26T16:09:52.276 INFO:tasks.rados.rados.0.smithi033.stdout:3567: snap_remove snap 328 2021-07-26T16:09:52.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:52 smithi033 bash[41341]: cluster 2021-07-26T16:09:51.199886+0000 mgr.y (mgr.34104) 477 : cluster [DBG] pgmap v960: 25 pgs: 25 active+clean; 907 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 21 op/s 2021-07-26T16:09:52.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:52 smithi033 bash[41341]: cluster 2021-07-26T16:09:52.271165+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e754: 8 total, 8 up, 8 in 2021-07-26T16:09:52.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:52 smithi033 bash[42377]: cluster 2021-07-26T16:09:51.199886+0000 mgr.y (mgr.34104) 477 : cluster [DBG] pgmap v960: 25 pgs: 25 active+clean; 907 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 21 op/s 2021-07-26T16:09:52.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:52 smithi033 bash[42377]: cluster 2021-07-26T16:09:52.271165+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e754: 8 total, 8 up, 8 in 2021-07-26T16:09:52.733 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:52 smithi096 bash[33981]: cluster 2021-07-26T16:09:51.199886+0000 mgr.y (mgr.34104) 477 : cluster [DBG] pgmap v960: 25 pgs: 25 active+clean; 907 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 4.2 MiB/s wr, 21 op/s 2021-07-26T16:09:52.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:52 smithi096 bash[33981]: cluster 2021-07-26T16:09:52.271165+0000 mon.a (mon.0) 1131 : cluster [DBG] osdmap e754: 8 total, 8 up, 8 in 2021-07-26T16:09:53.273 INFO:tasks.rados.rados.0.smithi033.stdout:3567: done (3 left) 2021-07-26T16:09:53.274 INFO:tasks.rados.rados.0.smithi033.stdout:3568: setattr oid 48 current snap is 349 2021-07-26T16:09:53.277 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 349 2021-07-26T16:09:53.277 INFO:tasks.rados.rados.0.smithi033.stdout:3563: finishing write tid 1 to smithi03339061-18 2021-07-26T16:09:53.278 INFO:tasks.rados.rados.0.smithi033.stdout:3563: finishing write tid 2 to smithi03339061-18 2021-07-26T16:09:53.278 INFO:tasks.rados.rados.0.smithi033.stdout:3563: finishing write tid 3 to smithi03339061-18 2021-07-26T16:09:53.278 INFO:tasks.rados.rados.0.smithi033.stdout:3563: finishing write tid 4 to smithi03339061-18 2021-07-26T16:09:53.278 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 2279 (ObjNum 1065 snap 349 seq_num 1065) dirty exists 2021-07-26T16:09:53.279 INFO:tasks.rados.rados.0.smithi033.stdout:3563: left oid 18 (ObjNum 1065 snap 349 seq_num 1065) 2021-07-26T16:09:53.279 INFO:tasks.rados.rados.0.smithi033.stdout:3565: expect (ObjNum 1046 snap 347 seq_num 1046) 2021-07-26T16:09:53.426 INFO:tasks.rados.rados.0.smithi033.stdout:3564: finishing copy_from to smithi03339061-13 2021-07-26T16:09:53.427 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1892 (ObjNum 1055 snap 347 seq_num 1055) dirty exists 2021-07-26T16:09:53.427 INFO:tasks.rados.rados.0.smithi033.stdout:3564: finishing copy_from racing read to smithi03339061-13 2021-07-26T16:09:53.427 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 1860 (ObjNum 1050 snap 347 seq_num 1050) dirty exists 2021-07-26T16:09:53.427 INFO:tasks.rados.rados.0.smithi033.stdout:3569: seq_num 1066 ranges {5939200=663552,6602752=401408} 2021-07-26T16:09:53.472 INFO:tasks.rados.rados.0.smithi033.stdout:3569: writing smithi03339061-1 from 5939200 to 6602752 tid 1 2021-07-26T16:09:53.475 INFO:tasks.rados.rados.0.smithi033.stdout:3569: writing smithi03339061-1 from 6602752 to 7004160 tid 2 2021-07-26T16:09:53.475 INFO:tasks.rados.rados.0.smithi033.stdout:3563: done (4 left) 2021-07-26T16:09:53.476 INFO:tasks.rados.rados.0.smithi033.stdout:3564: done (3 left) 2021-07-26T16:09:53.476 INFO:tasks.rados.rados.0.smithi033.stdout:3565: done (2 left) 2021-07-26T16:09:53.476 INFO:tasks.rados.rados.0.smithi033.stdout:3568: done (1 left) 2021-07-26T16:09:53.476 INFO:tasks.rados.rados.0.smithi033.stdout:3570: copy_from oid 6 from oid 30 current snap is 349 2021-07-26T16:09:53.476 INFO:tasks.rados.rados.0.smithi033.stdout:3571: read oid 31 snap 316 2021-07-26T16:09:53.477 INFO:tasks.rados.rados.0.smithi033.stdout:3571: expect (ObjNum 887 snap 291 seq_num 887) 2021-07-26T16:09:53.477 INFO:tasks.rados.rados.0.smithi033.stdout:3572: delete oid 25 current snap is 349 2021-07-26T16:09:53.478 INFO:tasks.rados.rados.0.smithi033.stdout:3570: finishing copy_from to smithi03339061-6 2021-07-26T16:09:53.478 INFO:tasks.rados.rados.0.smithi033.stdout:3570: got expected ENOENT (src dne) 2021-07-26T16:09:53.478 INFO:tasks.rados.rados.0.smithi033.stdout:3570: finishing copy_from racing read to smithi03339061-6 2021-07-26T16:09:53.481 INFO:tasks.rados.rados.0.smithi033.stdout:3569: finishing write tid 1 to smithi03339061-1 2021-07-26T16:09:53.482 INFO:tasks.rados.rados.0.smithi033.stdout:3569: finishing write tid 2 to smithi03339061-1 2021-07-26T16:09:53.482 INFO:tasks.rados.rados.0.smithi033.stdout:3569: finishing write tid 3 to smithi03339061-1 2021-07-26T16:09:53.484 INFO:tasks.rados.rados.0.smithi033.stdout:3570: done (3 left) 2021-07-26T16:09:53.484 INFO:tasks.rados.rados.0.smithi033.stdout:3572: done (2 left) 2021-07-26T16:09:53.484 INFO:tasks.rados.rados.0.smithi033.stdout:3573: delete oid 42 current snap is 349 2021-07-26T16:09:53.485 INFO:tasks.rados.rados.0.smithi033.stdout:3569: finishing write tid 4 to smithi03339061-1 2021-07-26T16:09:53.485 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1090 (ObjNum 1066 snap 349 seq_num 1066) dirty exists 2021-07-26T16:09:53.485 INFO:tasks.rados.rados.0.smithi033.stdout:3569: left oid 1 (ObjNum 1066 snap 349 seq_num 1066) 2021-07-26T16:09:53.488 INFO:tasks.rados.rados.0.smithi033.stdout:3569: done (2 left) 2021-07-26T16:09:53.488 INFO:tasks.rados.rados.0.smithi033.stdout:3573: done (1 left) 2021-07-26T16:09:53.488 INFO:tasks.rados.rados.0.smithi033.stdout:3574: delete oid 19 current snap is 349 2021-07-26T16:09:53.492 INFO:tasks.rados.rados.0.smithi033.stdout:3571: expect (ObjNum 887 snap 291 seq_num 887) 2021-07-26T16:09:53.613 INFO:tasks.rados.rados.0.smithi033.stdout:3571: done (1 left) 2021-07-26T16:09:53.613 INFO:tasks.rados.rados.0.smithi033.stdout:3574: done (0 left) 2021-07-26T16:09:53.613 INFO:tasks.rados.rados.0.smithi033.stdout:3575: read oid 35 snap 287 2021-07-26T16:09:53.613 INFO:tasks.rados.rados.0.smithi033.stdout:3575: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:09:53.614 INFO:tasks.rados.rados.0.smithi033.stdout:3576: snap_remove snap 248 2021-07-26T16:09:54.397 INFO:tasks.rados.rados.0.smithi033.stdout:3576: done (1 left) 2021-07-26T16:09:54.398 INFO:tasks.rados.rados.0.smithi033.stdout:3577: snap_create 2021-07-26T16:09:54.398 INFO:tasks.rados.rados.0.smithi033.stdout:3575: expect (ObjNum 815 snap 272 seq_num 815) 2021-07-26T16:09:54.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:54 smithi033 bash[41341]: cluster 2021-07-26T16:09:53.200603+0000 mgr.y (mgr.34104) 478 : cluster [DBG] pgmap v963: 25 pgs: 25 active+clean; 903 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 21 op/s 2021-07-26T16:09:54.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:54 smithi033 bash[41341]: cluster 2021-07-26T16:09:53.269815+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e755: 8 total, 8 up, 8 in 2021-07-26T16:09:54.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:54 smithi033 bash[42377]: cluster 2021-07-26T16:09:53.200603+0000 mgr.y (mgr.34104) 478 : cluster [DBG] pgmap v963: 25 pgs: 25 active+clean; 903 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 21 op/s 2021-07-26T16:09:54.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:54 smithi033 bash[42377]: cluster 2021-07-26T16:09:53.269815+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e755: 8 total, 8 up, 8 in 2021-07-26T16:09:54.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:54 smithi096 bash[33981]: cluster 2021-07-26T16:09:53.200603+0000 mgr.y (mgr.34104) 478 : cluster [DBG] pgmap v963: 25 pgs: 25 active+clean; 903 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 4.3 MiB/s wr, 21 op/s 2021-07-26T16:09:54.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:54 smithi096 bash[33981]: cluster 2021-07-26T16:09:53.269815+0000 mon.a (mon.0) 1132 : cluster [DBG] osdmap e755: 8 total, 8 up, 8 in 2021-07-26T16:09:55.407 INFO:tasks.rados.rados.0.smithi033.stdout:3575: done (1 left) 2021-07-26T16:09:55.407 INFO:tasks.rados.rados.0.smithi033.stdout:3577: done (0 left) 2021-07-26T16:09:55.408 INFO:tasks.rados.rados.0.smithi033.stdout:3578: rollback oid 41 current snap is 350 2021-07-26T16:09:55.408 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 41 to 335 2021-07-26T16:09:55.408 INFO:tasks.rados.rados.0.smithi033.stdout:3579: snap_remove snap 333 2021-07-26T16:09:55.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:55 smithi033 bash[41341]: cluster 2021-07-26T16:09:54.389893+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e756: 8 total, 8 up, 8 in 2021-07-26T16:09:55.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:55 smithi033 bash[42377]: cluster 2021-07-26T16:09:54.389893+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e756: 8 total, 8 up, 8 in 2021-07-26T16:09:55.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:55 smithi096 bash[33981]: cluster 2021-07-26T16:09:54.389893+0000 mon.a (mon.0) 1133 : cluster [DBG] osdmap e756: 8 total, 8 up, 8 in 2021-07-26T16:09:56.261 INFO:tasks.rados.rados.0.smithi033.stdout:3579: done (1 left) 2021-07-26T16:09:56.261 INFO:tasks.rados.rados.0.smithi033.stdout:3580: read oid 6 snap -1 2021-07-26T16:09:56.261 INFO:tasks.rados.rados.0.smithi033.stdout:3580: expect (ObjNum 824 snap 274 seq_num 824) 2021-07-26T16:09:56.262 INFO:tasks.rados.rados.0.smithi033.stdout:3581: setattr oid 46 current snap is 350 2021-07-26T16:09:56.262 INFO:tasks.rados.rados.0.smithi033.stdout:3578: finishing rollback tid 0 to smithi03339061-41 2021-07-26T16:09:56.263 INFO:tasks.rados.rados.0.smithi033.stdout:3578: finishing rollback tid 1 to smithi03339061-41 2021-07-26T16:09:56.263 INFO:tasks.rados.rados.0.smithi033.stdout:3578: finishing rollback tid 2 to smithi03339061-41 2021-07-26T16:09:56.263 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 1863 (ObjNum 984 snap 327 seq_num 984) dirty exists 2021-07-26T16:09:56.264 INFO:tasks.rados.rados.0.smithi033.stdout:3578: done (2 left) 2021-07-26T16:09:56.264 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 350 2021-07-26T16:09:56.265 INFO:tasks.rados.rados.0.smithi033.stdout:3582: seq_num 1070 ranges {3694592=729088,4423680=401408} 2021-07-26T16:09:56.291 INFO:tasks.rados.rados.0.smithi033.stdout:3582: writing smithi03339061-48 from 3694592 to 4423680 tid 1 2021-07-26T16:09:56.294 INFO:tasks.rados.rados.0.smithi033.stdout:3582: writing smithi03339061-48 from 4423680 to 4825088 tid 2 2021-07-26T16:09:56.294 INFO:tasks.rados.rados.0.smithi033.stdout:3583: copy_from oid 45 from oid 27 current snap is 350 2021-07-26T16:09:56.295 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1357 (ObjNum 1057 snap 348 seq_num 1057) dirty exists 2021-07-26T16:09:56.295 INFO:tasks.rados.rados.0.smithi033.stdout:3580: expect (ObjNum 824 snap 274 seq_num 824) 2021-07-26T16:09:56.562 INFO:tasks.rados.rados.0.smithi033.stdout:3582: finishing write tid 1 to smithi03339061-48 2021-07-26T16:09:56.563 INFO:tasks.rados.rados.0.smithi033.stdout:3582: finishing write tid 2 to smithi03339061-48 2021-07-26T16:09:56.563 INFO:tasks.rados.rados.0.smithi033.stdout:3582: finishing write tid 3 to smithi03339061-48 2021-07-26T16:09:56.563 INFO:tasks.rados.rados.0.smithi033.stdout:3582: finishing write tid 4 to smithi03339061-48 2021-07-26T16:09:56.563 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 1866 (ObjNum 1070 snap 350 seq_num 1070) dirty exists 2021-07-26T16:09:56.564 INFO:tasks.rados.rados.0.smithi033.stdout:3582: left oid 48 (ObjNum 1070 snap 350 seq_num 1070) 2021-07-26T16:09:56.564 INFO:tasks.rados.rados.0.smithi033.stdout:3583: finishing copy_from to smithi03339061-45 2021-07-26T16:09:56.564 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1584 (ObjNum 806 snap 268 seq_num 806) dirty exists 2021-07-26T16:09:56.564 INFO:tasks.rados.rados.0.smithi033.stdout:3580: done (3 left) 2021-07-26T16:09:56.565 INFO:tasks.rados.rados.0.smithi033.stdout:3581: done (2 left) 2021-07-26T16:09:56.565 INFO:tasks.rados.rados.0.smithi033.stdout:3582: done (1 left) 2021-07-26T16:09:56.565 INFO:tasks.rados.rados.0.smithi033.stdout:3584: copy_from oid 43 from oid 44 current snap is 350 2021-07-26T16:09:56.565 INFO:tasks.rados.rados.0.smithi033.stdout:3583: finishing copy_from racing read to smithi03339061-45 2021-07-26T16:09:56.565 INFO:tasks.rados.rados.0.smithi033.stdout:3583: done (1 left) 2021-07-26T16:09:56.566 INFO:tasks.rados.rados.0.smithi033.stdout:3585: read oid 5 snap -1 2021-07-26T16:09:56.566 INFO:tasks.rados.rados.0.smithi033.stdout:3585: expect (ObjNum 1053 snap 347 seq_num 1053) 2021-07-26T16:09:56.566 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 25 current snap is 350 2021-07-26T16:09:56.566 INFO:tasks.rados.rados.0.smithi033.stdout:3586: seq_num 1071 ranges {0=745472,745472=401408} 2021-07-26T16:09:56.575 INFO:tasks.rados.rados.0.smithi033.stdout:3586: writing smithi03339061-25 from 0 to 745472 tid 1 2021-07-26T16:09:56.579 INFO:tasks.rados.rados.0.smithi033.stdout:3586: writing smithi03339061-25 from 745472 to 1146880 tid 2 2021-07-26T16:09:56.579 INFO:tasks.rados.rados.0.smithi033.stdout:3587: copy_from oid 50 from oid 20 current snap is 350 2021-07-26T16:09:56.580 INFO:tasks.rados.rados.0.smithi033.stdout:3588: read oid 9 snap -1 2021-07-26T16:09:56.580 INFO:tasks.rados.rados.0.smithi033.stdout:3588: expect (ObjNum 836 snap 277 seq_num 836) 2021-07-26T16:09:56.580 INFO:tasks.rados.rados.0.smithi033.stdout:3589: copy_from oid 40 from oid 39 current snap is 350 2021-07-26T16:09:56.580 INFO:tasks.rados.rados.0.smithi033.stdout:3590: read oid 26 snap -1 2021-07-26T16:09:56.581 INFO:tasks.rados.rados.0.smithi033.stdout:3590: expect (ObjNum 1052 snap 347 seq_num 1052) 2021-07-26T16:09:56.581 INFO:tasks.rados.rados.0.smithi033.stdout:3591: read oid 46 snap -1 2021-07-26T16:09:56.581 INFO:tasks.rados.rados.0.smithi033.stdout:3591: expect (ObjNum 1057 snap 348 seq_num 1057) 2021-07-26T16:09:56.581 INFO:tasks.rados.rados.0.smithi033.stdout:3592: snap_create 2021-07-26T16:09:56.583 INFO:tasks.rados.rados.0.smithi033.stdout:3589: finishing copy_from to smithi03339061-40 2021-07-26T16:09:56.583 INFO:tasks.rados.rados.0.smithi033.stdout:3589: got expected ENOENT (src dne) 2021-07-26T16:09:56.584 INFO:tasks.rados.rados.0.smithi033.stdout:3589: finishing copy_from racing read to smithi03339061-40 2021-07-26T16:09:56.585 INFO:tasks.rados.rados.0.smithi033.stdout:3586: finishing write tid 1 to smithi03339061-25 2021-07-26T16:09:56.590 INFO:tasks.rados.rados.0.smithi033.stdout:3585: expect (ObjNum 1053 snap 347 seq_num 1053) 2021-07-26T16:09:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:56 smithi033 bash[41341]: cluster 2021-07-26T16:09:55.201302+0000 mgr.y (mgr.34104) 479 : cluster [DBG] pgmap v966: 25 pgs: 25 active+clean; 900 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.4 MiB/s rd, 742 KiB/s wr, 11 op/s 2021-07-26T16:09:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:56 smithi033 bash[41341]: cluster 2021-07-26T16:09:55.403602+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e757: 8 total, 8 up, 8 in 2021-07-26T16:09:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:56 smithi033 bash[41341]: cluster 2021-07-26T16:09:56.258051+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e758: 8 total, 8 up, 8 in 2021-07-26T16:09:56.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:56 smithi033 bash[42377]: cluster 2021-07-26T16:09:55.201302+0000 mgr.y (mgr.34104) 479 : cluster [DBG] pgmap v966: 25 pgs: 25 active+clean; 900 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.4 MiB/s rd, 742 KiB/s wr, 11 op/s 2021-07-26T16:09:56.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:56 smithi033 bash[42377]: cluster 2021-07-26T16:09:55.403602+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e757: 8 total, 8 up, 8 in 2021-07-26T16:09:56.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:56 smithi033 bash[42377]: cluster 2021-07-26T16:09:56.258051+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e758: 8 total, 8 up, 8 in 2021-07-26T16:09:56.733 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:56 smithi096 bash[33981]: cluster 2021-07-26T16:09:55.201302+0000 mgr.y (mgr.34104) 479 : cluster [DBG] pgmap v966: 25 pgs: 25 active+clean; 900 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.4 MiB/s rd, 742 KiB/s wr, 11 op/s 2021-07-26T16:09:56.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:56 smithi096 bash[33981]: cluster 2021-07-26T16:09:55.403602+0000 mon.a (mon.0) 1134 : cluster [DBG] osdmap e757: 8 total, 8 up, 8 in 2021-07-26T16:09:56.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:56 smithi096 bash[33981]: cluster 2021-07-26T16:09:56.258051+0000 mon.a (mon.0) 1135 : cluster [DBG] osdmap e758: 8 total, 8 up, 8 in 2021-07-26T16:09:56.788 INFO:tasks.rados.rados.0.smithi033.stdout:3586: finishing write tid 2 to smithi03339061-25 2021-07-26T16:09:56.788 INFO:tasks.rados.rados.0.smithi033.stdout:3586: finishing write tid 3 to smithi03339061-25 2021-07-26T16:09:56.789 INFO:tasks.rados.rados.0.smithi033.stdout:3591: expect (ObjNum 1057 snap 348 seq_num 1057) 2021-07-26T16:09:56.843 INFO:tasks.rados.rados.0.smithi033.stdout:3586: finishing write tid 4 to smithi03339061-25 2021-07-26T16:09:56.843 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 1845 (ObjNum 1071 snap 350 seq_num 1071) dirty exists 2021-07-26T16:09:56.843 INFO:tasks.rados.rados.0.smithi033.stdout:3586: left oid 25 (ObjNum 1071 snap 350 seq_num 1071) 2021-07-26T16:09:56.844 INFO:tasks.rados.rados.0.smithi033.stdout:3588: expect (ObjNum 836 snap 277 seq_num 836) 2021-07-26T16:09:56.917 INFO:tasks.rados.rados.0.smithi033.stdout:3590: expect (ObjNum 1052 snap 347 seq_num 1052) 2021-07-26T16:09:56.975 INFO:tasks.rados.rados.0.smithi033.stdout:3584: finishing copy_from to smithi03339061-43 2021-07-26T16:09:56.976 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 2049 (ObjNum 1059 snap 348 seq_num 1059) dirty exists 2021-07-26T16:09:56.976 INFO:tasks.rados.rados.0.smithi033.stdout:3587: finishing copy_from to smithi03339061-50 2021-07-26T16:09:56.976 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 2052 (ObjNum 1064 snap 349 seq_num 1064) dirty exists 2021-07-26T16:09:56.977 INFO:tasks.rados.rados.0.smithi033.stdout:3584: finishing copy_from racing read to smithi03339061-43 2021-07-26T16:09:56.977 INFO:tasks.rados.rados.0.smithi033.stdout:3587: finishing copy_from racing read to smithi03339061-50 2021-07-26T16:09:57.413 INFO:tasks.rados.rados.0.smithi033.stdout:3584: done (8 left) 2021-07-26T16:09:57.413 INFO:tasks.rados.rados.0.smithi033.stdout:3585: done (7 left) 2021-07-26T16:09:57.413 INFO:tasks.rados.rados.0.smithi033.stdout:3586: done (6 left) 2021-07-26T16:09:57.414 INFO:tasks.rados.rados.0.smithi033.stdout:3587: done (5 left) 2021-07-26T16:09:57.414 INFO:tasks.rados.rados.0.smithi033.stdout:3588: done (4 left) 2021-07-26T16:09:57.414 INFO:tasks.rados.rados.0.smithi033.stdout:3589: done (3 left) 2021-07-26T16:09:57.414 INFO:tasks.rados.rados.0.smithi033.stdout:3590: done (2 left) 2021-07-26T16:09:57.415 INFO:tasks.rados.rados.0.smithi033.stdout:3591: done (1 left) 2021-07-26T16:09:57.415 INFO:tasks.rados.rados.0.smithi033.stdout:3592: done (0 left) 2021-07-26T16:09:57.415 INFO:tasks.rados.rados.0.smithi033.stdout:3593: delete oid 44 current snap is 351 2021-07-26T16:09:57.419 INFO:tasks.rados.rados.0.smithi033.stdout:3593: done (0 left) 2021-07-26T16:09:57.419 INFO:tasks.rados.rados.0.smithi033.stdout:3594: read oid 26 snap -1 2021-07-26T16:09:57.420 INFO:tasks.rados.rados.0.smithi033.stdout:3594: expect (ObjNum 1052 snap 347 seq_num 1052) 2021-07-26T16:09:57.420 INFO:tasks.rados.rados.0.smithi033.stdout:3595: rmattr oid 50 current snap is 351 2021-07-26T16:09:57.420 INFO:tasks.rados.rados.0.smithi033.stdout:3596: snap_remove snap 342 2021-07-26T16:09:58.430 INFO:tasks.rados.rados.0.smithi033.stdout:3596: done (2 left) 2021-07-26T16:09:58.431 INFO:tasks.rados.rados.0.smithi033.stdout:3597: snap_remove snap 315 2021-07-26T16:09:58.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:58 smithi033 bash[41341]: cluster 2021-07-26T16:09:57.201972+0000 mgr.y (mgr.34104) 480 : cluster [DBG] pgmap v969: 25 pgs: 25 active+clean; 909 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 6.1 MiB/s wr, 12 op/s 2021-07-26T16:09:58.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:58 smithi033 bash[41341]: cluster 2021-07-26T16:09:57.410122+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e759: 8 total, 8 up, 8 in 2021-07-26T16:09:58.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:58 smithi033 bash[42377]: cluster 2021-07-26T16:09:57.201972+0000 mgr.y (mgr.34104) 480 : cluster [DBG] pgmap v969: 25 pgs: 25 active+clean; 909 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 6.1 MiB/s wr, 12 op/s 2021-07-26T16:09:58.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:58 smithi033 bash[42377]: cluster 2021-07-26T16:09:57.410122+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e759: 8 total, 8 up, 8 in 2021-07-26T16:09:58.733 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:58 smithi096 bash[33981]: cluster 2021-07-26T16:09:57.201972+0000 mgr.y (mgr.34104) 480 : cluster [DBG] pgmap v969: 25 pgs: 25 active+clean; 909 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 9.2 MiB/s rd, 6.1 MiB/s wr, 12 op/s 2021-07-26T16:09:58.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:58 smithi096 bash[33981]: cluster 2021-07-26T16:09:57.410122+0000 mon.a (mon.0) 1136 : cluster [DBG] osdmap e759: 8 total, 8 up, 8 in 2021-07-26T16:09:59.445 INFO:tasks.rados.rados.0.smithi033.stdout:3597: done (2 left) 2021-07-26T16:09:59.445 INFO:tasks.rados.rados.0.smithi033.stdout:3598: delete oid 23 current snap is 351 2021-07-26T16:09:59.445 INFO:tasks.rados.rados.0.smithi033.stdout:3594: expect (ObjNum 1052 snap 347 seq_num 1052) 2021-07-26T16:09:59.516 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 2053 (ObjNum 1064 snap 349 seq_num 1064) dirty exists 2021-07-26T16:09:59.516 INFO:tasks.rados.rados.0.smithi033.stdout:3594: done (2 left) 2021-07-26T16:09:59.516 INFO:tasks.rados.rados.0.smithi033.stdout:3595: done (1 left) 2021-07-26T16:09:59.516 INFO:tasks.rados.rados.0.smithi033.stdout:3598: done (0 left) 2021-07-26T16:09:59.517 INFO:tasks.rados.rados.0.smithi033.stdout:3599: snap_create 2021-07-26T16:09:59.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:09:59 smithi033 bash[41341]: cluster 2021-07-26T16:09:58.424821+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e760: 8 total, 8 up, 8 in 2021-07-26T16:09:59.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:09:59 smithi033 bash[42377]: cluster 2021-07-26T16:09:58.424821+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e760: 8 total, 8 up, 8 in 2021-07-26T16:09:59.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:09:59 smithi096 bash[33981]: cluster 2021-07-26T16:09:58.424821+0000 mon.a (mon.0) 1137 : cluster [DBG] osdmap e760: 8 total, 8 up, 8 in 2021-07-26T16:10:00.440 INFO:tasks.rados.rados.0.smithi033.stdout:3599: done (0 left) 2021-07-26T16:10:00.441 INFO:tasks.rados.rados.0.smithi033.stdout:3600: read oid 34 snap -1 2021-07-26T16:10:00.441 INFO:tasks.rados.rados.0.smithi033.stdout:3600: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:10:00.441 INFO:tasks.rados.rados.0.smithi033.stdout:3601: read oid 13 snap -1 2021-07-26T16:10:00.442 INFO:tasks.rados.rados.0.smithi033.stdout:3601: expect (ObjNum 1055 snap 347 seq_num 1055) 2021-07-26T16:10:00.442 INFO:tasks.rados.rados.0.smithi033.stdout:3602: copy_from oid 22 from oid 29 current snap is 352 2021-07-26T16:10:00.442 INFO:tasks.rados.rados.0.smithi033.stdout:3603: setattr oid 17 current snap is 352 2021-07-26T16:10:00.444 INFO:tasks.rados.rados.0.smithi033.stdout:3604: rmattr oid 42 current snap is 352 2021-07-26T16:10:00.444 INFO:tasks.rados.rados.0.smithi033.stdout:3604: done (4 left) 2021-07-26T16:10:00.444 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 352 2021-07-26T16:10:00.444 INFO:tasks.rados.rados.0.smithi033.stdout:3605: seq_num 1074 ranges {0=794624,794624=401408} 2021-07-26T16:10:00.448 INFO:tasks.rados.rados.0.smithi033.stdout:3605: writing smithi03339061-39 from 0 to 794624 tid 1 2021-07-26T16:10:00.451 INFO:tasks.rados.rados.0.smithi033.stdout:3605: writing smithi03339061-39 from 794624 to 1196032 tid 2 2021-07-26T16:10:00.452 INFO:tasks.rados.rados.0.smithi033.stdout:3606: rollback oid 20 current snap is 352 2021-07-26T16:10:00.452 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 20 to 271 2021-07-26T16:10:00.452 INFO:tasks.rados.rados.0.smithi033.stdout:3607: snap_create 2021-07-26T16:10:00.453 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 1412 (ObjNum 1018 snap 340 seq_num 1018) dirty exists 2021-07-26T16:10:00.460 INFO:tasks.rados.rados.0.smithi033.stdout:3605: finishing write tid 1 to smithi03339061-39 2021-07-26T16:10:00.461 INFO:tasks.rados.rados.0.smithi033.stdout:3605: finishing write tid 2 to smithi03339061-39 2021-07-26T16:10:00.462 INFO:tasks.rados.rados.0.smithi033.stdout:3605: finishing write tid 3 to smithi03339061-39 2021-07-26T16:10:00.469 INFO:tasks.rados.rados.0.smithi033.stdout:3605: finishing write tid 4 to smithi03339061-39 2021-07-26T16:10:00.470 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 1897 (ObjNum 1074 snap 352 seq_num 1074) dirty exists 2021-07-26T16:10:00.470 INFO:tasks.rados.rados.0.smithi033.stdout:3605: left oid 39 (ObjNum 1074 snap 352 seq_num 1074) 2021-07-26T16:10:00.481 INFO:tasks.rados.rados.0.smithi033.stdout:3602: finishing copy_from to smithi03339061-22 2021-07-26T16:10:00.481 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 1356 (ObjNum 1060 snap 348 seq_num 1060) dirty exists 2021-07-26T16:10:00.482 INFO:tasks.rados.rados.0.smithi033.stdout:3602: finishing copy_from racing read to smithi03339061-22 2021-07-26T16:10:00.491 INFO:tasks.rados.rados.0.smithi033.stdout:3600: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:10:00.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:00 smithi033 bash[41341]: cluster 2021-07-26T16:09:59.202640+0000 mgr.y (mgr.34104) 481 : cluster [DBG] pgmap v972: 25 pgs: 25 active+clean; 896 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 6.8 MiB/s wr, 9 op/s 2021-07-26T16:10:00.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:00 smithi033 bash[41341]: cluster 2021-07-26T16:09:59.437595+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e761: 8 total, 8 up, 8 in 2021-07-26T16:10:00.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:00 smithi033 bash[41341]: cluster 2021-07-26T16:10:00.000140+0000 mon.a (mon.0) 1139 : cluster [INF] overall HEALTH_OK 2021-07-26T16:10:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:00 smithi033 bash[42377]: cluster 2021-07-26T16:09:59.202640+0000 mgr.y (mgr.34104) 481 : cluster [DBG] pgmap v972: 25 pgs: 25 active+clean; 896 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 6.8 MiB/s wr, 9 op/s 2021-07-26T16:10:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:00 smithi033 bash[42377]: cluster 2021-07-26T16:09:59.437595+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e761: 8 total, 8 up, 8 in 2021-07-26T16:10:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:00 smithi033 bash[42377]: cluster 2021-07-26T16:10:00.000140+0000 mon.a (mon.0) 1139 : cluster [INF] overall HEALTH_OK 2021-07-26T16:10:00.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:00 smithi096 bash[33981]: cluster 2021-07-26T16:09:59.202640+0000 mgr.y (mgr.34104) 481 : cluster [DBG] pgmap v972: 25 pgs: 25 active+clean; 896 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 6.8 MiB/s wr, 9 op/s 2021-07-26T16:10:00.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:00 smithi096 bash[33981]: cluster 2021-07-26T16:09:59.437595+0000 mon.a (mon.0) 1138 : cluster [DBG] osdmap e761: 8 total, 8 up, 8 in 2021-07-26T16:10:00.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:00 smithi096 bash[33981]: cluster 2021-07-26T16:10:00.000140+0000 mon.a (mon.0) 1139 : cluster [INF] overall HEALTH_OK 2021-07-26T16:10:01.046 INFO:tasks.rados.rados.0.smithi033.stdout:3601: expect (ObjNum 1055 snap 347 seq_num 1055) 2021-07-26T16:10:01.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:01 smithi096 bash[33981]: cluster 2021-07-26T16:10:00.436747+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e762: 8 total, 8 up, 8 in 2021-07-26T16:10:01.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:01 smithi096 bash[33981]: cluster 2021-07-26T16:10:01.258584+0000 mon.a (mon.0) 1141 : cluster [DBG] osdmap e763: 8 total, 8 up, 8 in 2021-07-26T16:10:01.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:01 smithi033 bash[41341]: cluster 2021-07-26T16:10:00.436747+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e762: 8 total, 8 up, 8 in 2021-07-26T16:10:01.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:01 smithi033 bash[41341]: cluster 2021-07-26T16:10:01.258584+0000 mon.a (mon.0) 1141 : cluster [DBG] osdmap e763: 8 total, 8 up, 8 in 2021-07-26T16:10:01.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:01 smithi033 bash[42377]: cluster 2021-07-26T16:10:00.436747+0000 mon.a (mon.0) 1140 : cluster [DBG] osdmap e762: 8 total, 8 up, 8 in 2021-07-26T16:10:01.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:01 smithi033 bash[42377]: cluster 2021-07-26T16:10:01.258584+0000 mon.a (mon.0) 1141 : cluster [DBG] osdmap e763: 8 total, 8 up, 8 in 2021-07-26T16:10:02.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:02 smithi096 bash[33981]: cluster 2021-07-26T16:10:01.203288+0000 mgr.y (mgr.34104) 482 : cluster [DBG] pgmap v975: 25 pgs: 25 active+clean; 888 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.2 MiB/s wr, 19 op/s 2021-07-26T16:10:02.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:02 smithi033 bash[41341]: cluster 2021-07-26T16:10:01.203288+0000 mgr.y (mgr.34104) 482 : cluster [DBG] pgmap v975: 25 pgs: 25 active+clean; 888 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.2 MiB/s wr, 19 op/s 2021-07-26T16:10:02.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:02 smithi033 bash[42377]: cluster 2021-07-26T16:10:01.203288+0000 mgr.y (mgr.34104) 482 : cluster [DBG] pgmap v975: 25 pgs: 25 active+clean; 888 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 2.2 MiB/s wr, 19 op/s 2021-07-26T16:10:04.235 INFO:tasks.rados.rados.0.smithi033.stdout:3606: finishing rollback tid 0 to smithi03339061-20 2021-07-26T16:10:04.235 INFO:tasks.rados.rados.0.smithi033.stdout:3606: finishing rollback tid 1 to smithi03339061-20 2021-07-26T16:10:04.236 INFO:tasks.rados.rados.0.smithi033.stdout:3606: finishing rollback tid 2 to smithi03339061-20 2021-07-26T16:10:04.236 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 20 v 2056 (ObjNum 773 snap 255 seq_num 773) dirty exists 2021-07-26T16:10:04.236 INFO:tasks.rados.rados.0.smithi033.stdout:3600: done (6 left) 2021-07-26T16:10:04.237 INFO:tasks.rados.rados.0.smithi033.stdout:3601: done (5 left) 2021-07-26T16:10:04.237 INFO:tasks.rados.rados.0.smithi033.stdout:3602: done (4 left) 2021-07-26T16:10:04.237 INFO:tasks.rados.rados.0.smithi033.stdout:3603: done (3 left) 2021-07-26T16:10:04.237 INFO:tasks.rados.rados.0.smithi033.stdout:3605: done (2 left) 2021-07-26T16:10:04.238 INFO:tasks.rados.rados.0.smithi033.stdout:3606: done (1 left) 2021-07-26T16:10:04.238 INFO:tasks.rados.rados.0.smithi033.stdout:3607: done (0 left) 2021-07-26T16:10:04.238 INFO:tasks.rados.rados.0.smithi033.stdout:3608: snap_create 2021-07-26T16:10:04.479 INFO:tasks.rados.rados.0.smithi033.stdout:3608: done (0 left) 2021-07-26T16:10:04.479 INFO:tasks.rados.rados.0.smithi033.stdout:3609: setattr oid 45 current snap is 354 2021-07-26T16:10:04.480 INFO:tasks.rados.rados.0.smithi033.stdout:3610: copy_from oid 13 from oid 16 current snap is 354 2021-07-26T16:10:04.481 INFO:tasks.rados.rados.0.smithi033.stdout:3611: snap_remove snap 237 2021-07-26T16:10:04.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:04 smithi096 bash[33981]: cluster 2021-07-26T16:10:03.204000+0000 mgr.y (mgr.34104) 483 : cluster [DBG] pgmap v977: 25 pgs: 25 active+clean; 893 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.6 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2021-07-26T16:10:04.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:04 smithi033 bash[41341]: cluster 2021-07-26T16:10:03.204000+0000 mgr.y (mgr.34104) 483 : cluster [DBG] pgmap v977: 25 pgs: 25 active+clean; 893 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.6 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2021-07-26T16:10:04.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:04 smithi033 bash[42377]: cluster 2021-07-26T16:10:03.204000+0000 mgr.y (mgr.34104) 483 : cluster [DBG] pgmap v977: 25 pgs: 25 active+clean; 893 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 4.6 MiB/s rd, 2.5 MiB/s wr, 14 op/s 2021-07-26T16:10:05.497 INFO:tasks.rados.rados.0.smithi033.stdout:3611: done (2 left) 2021-07-26T16:10:05.497 INFO:tasks.rados.rados.0.smithi033.stdout:3612: snap_remove snap 302 2021-07-26T16:10:05.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:05 smithi096 bash[33981]: cluster 2021-07-26T16:10:04.476830+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e764: 8 total, 8 up, 8 in 2021-07-26T16:10:05.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:05 smithi033 bash[41341]: cluster 2021-07-26T16:10:04.476830+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e764: 8 total, 8 up, 8 in 2021-07-26T16:10:05.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:05 smithi033 bash[42377]: cluster 2021-07-26T16:10:04.476830+0000 mon.a (mon.0) 1142 : cluster [DBG] osdmap e764: 8 total, 8 up, 8 in 2021-07-26T16:10:06.266 INFO:tasks.rados.rados.0.smithi033.stdout:3612: done (2 left) 2021-07-26T16:10:06.266 INFO:tasks.rados.rados.0.smithi033.stdout:3613: delete oid 2 current snap is 354 2021-07-26T16:10:06.267 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 2355 (ObjNum 806 snap 268 seq_num 806) dirty exists 2021-07-26T16:10:06.267 INFO:tasks.rados.rados.0.smithi033.stdout:3610: finishing copy_from to smithi03339061-13 2021-07-26T16:10:06.267 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1834 (ObjNum 2008769952 snap 22002 seq_num 0) dirty exists 2021-07-26T16:10:06.267 INFO:tasks.rados.rados.0.smithi033.stdout:3610: finishing copy_from racing read to smithi03339061-13 2021-07-26T16:10:06.281 INFO:tasks.rados.rados.0.smithi033.stdout:3609: done (2 left) 2021-07-26T16:10:06.281 INFO:tasks.rados.rados.0.smithi033.stdout:3610: done (1 left) 2021-07-26T16:10:06.281 INFO:tasks.rados.rados.0.smithi033.stdout:3613: done (0 left) 2021-07-26T16:10:06.282 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 354 2021-07-26T16:10:06.282 INFO:tasks.rados.rados.0.smithi033.stdout:3614: seq_num 1076 ranges {13074432=425984,13500416=548864,14049280=253952} 2021-07-26T16:10:06.358 INFO:tasks.rados.rados.0.smithi033.stdout:3614: writing smithi03339061-12 from 13074432 to 13500416 tid 1 2021-07-26T16:10:06.361 INFO:tasks.rados.rados.0.smithi033.stdout:3614: writing smithi03339061-12 from 13500416 to 14049280 tid 2 2021-07-26T16:10:06.363 INFO:tasks.rados.rados.0.smithi033.stdout:3614: writing smithi03339061-12 from 14049280 to 14303232 tid 3 2021-07-26T16:10:06.364 INFO:tasks.rados.rados.0.smithi033.stdout:3615: copy_from oid 9 from oid 13 current snap is 354 2021-07-26T16:10:06.364 INFO:tasks.rados.rados.0.smithi033.stdout:3616: read oid 27 snap -1 2021-07-26T16:10:06.364 INFO:tasks.rados.rados.0.smithi033.stdout:3616: expect (ObjNum 806 snap 268 seq_num 806) 2021-07-26T16:10:06.364 INFO:tasks.rados.rados.0.smithi033.stdout:3617: rollback oid 29 current snap is 354 2021-07-26T16:10:06.365 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 348 2021-07-26T16:10:06.365 INFO:tasks.rados.rados.0.smithi033.stdout:3618: delete oid 50 current snap is 354 2021-07-26T16:10:06.372 INFO:tasks.rados.rados.0.smithi033.stdout:3614: finishing write tid 1 to smithi03339061-12 2021-07-26T16:10:06.373 INFO:tasks.rados.rados.0.smithi033.stdout:3618: done (4 left) 2021-07-26T16:10:06.373 INFO:tasks.rados.rados.0.smithi033.stdout:3619: setattr oid 31 current snap is 354 2021-07-26T16:10:06.373 INFO:tasks.rados.rados.0.smithi033.stdout:3617: finishing rollback tid 0 to smithi03339061-29 2021-07-26T16:10:06.375 INFO:tasks.rados.rados.0.smithi033.stdout:3614: finishing write tid 2 to smithi03339061-12 2021-07-26T16:10:06.375 INFO:tasks.rados.rados.0.smithi033.stdout:3617: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:10:06.376 INFO:tasks.rados.rados.0.smithi033.stdout:3617: finishing rollback tid 2 to smithi03339061-29 2021-07-26T16:10:06.376 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1360 (ObjNum 1060 snap 348 seq_num 1060) dirty exists 2021-07-26T16:10:06.376 INFO:tasks.rados.rados.0.smithi033.stdout:3615: finishing copy_from to smithi03339061-9 2021-07-26T16:10:06.376 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 1834 (ObjNum 2008308352 snap 22002 seq_num 0) dirty exists 2021-07-26T16:10:06.377 INFO:tasks.rados.rados.0.smithi033.stdout:3617: done (4 left) 2021-07-26T16:10:06.377 INFO:tasks.rados.rados.0.smithi033.stdout:3620: snap_create 2021-07-26T16:10:06.377 INFO:tasks.rados.rados.0.smithi033.stdout:3615: finishing copy_from racing read to smithi03339061-9 2021-07-26T16:10:06.379 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1386 (ObjNum 1043 snap 347 seq_num 1043) dirty exists 2021-07-26T16:10:06.379 INFO:tasks.rados.rados.0.smithi033.stdout:3614: finishing write tid 3 to smithi03339061-12 2021-07-26T16:10:06.379 INFO:tasks.rados.rados.0.smithi033.stdout:3614: finishing write tid 4 to smithi03339061-12 2021-07-26T16:10:06.380 INFO:tasks.rados.rados.0.smithi033.stdout:3616: expect (ObjNum 806 snap 268 seq_num 806) 2021-07-26T16:10:06.490 INFO:tasks.rados.rados.0.smithi033.stdout:3614: finishing write tid 5 to smithi03339061-12 2021-07-26T16:10:06.491 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1846 (ObjNum 1076 snap 354 seq_num 1076) dirty exists 2021-07-26T16:10:06.491 INFO:tasks.rados.rados.0.smithi033.stdout:3614: left oid 12 (ObjNum 1076 snap 354 seq_num 1076) 2021-07-26T16:10:06.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:06 smithi033 bash[42377]: cluster 2021-07-26T16:10:05.204728+0000 mgr.y (mgr.34104) 484 : cluster [DBG] pgmap v979: 25 pgs: 25 active+clean; 893 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 1020 KiB/s wr, 10 op/s 2021-07-26T16:10:06.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:06 smithi033 bash[42377]: cluster 2021-07-26T16:10:05.487829+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e765: 8 total, 8 up, 8 in 2021-07-26T16:10:06.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:06 smithi033 bash[42377]: cluster 2021-07-26T16:10:06.261085+0000 mon.a (mon.0) 1144 : cluster [DBG] osdmap e766: 8 total, 8 up, 8 in 2021-07-26T16:10:06.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:06 smithi033 bash[41341]: cluster 2021-07-26T16:10:05.204728+0000 mgr.y (mgr.34104) 484 : cluster [DBG] pgmap v979: 25 pgs: 25 active+clean; 893 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 1020 KiB/s wr, 10 op/s 2021-07-26T16:10:06.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:06 smithi033 bash[41341]: cluster 2021-07-26T16:10:05.487829+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e765: 8 total, 8 up, 8 in 2021-07-26T16:10:06.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:06 smithi033 bash[41341]: cluster 2021-07-26T16:10:06.261085+0000 mon.a (mon.0) 1144 : cluster [DBG] osdmap e766: 8 total, 8 up, 8 in 2021-07-26T16:10:06.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:06 smithi096 bash[33981]: cluster 2021-07-26T16:10:05.204728+0000 mgr.y (mgr.34104) 484 : cluster [DBG] pgmap v979: 25 pgs: 25 active+clean; 893 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 6.1 MiB/s rd, 1020 KiB/s wr, 10 op/s 2021-07-26T16:10:06.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:06 smithi096 bash[33981]: cluster 2021-07-26T16:10:05.487829+0000 mon.a (mon.0) 1143 : cluster [DBG] osdmap e765: 8 total, 8 up, 8 in 2021-07-26T16:10:06.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:06 smithi096 bash[33981]: cluster 2021-07-26T16:10:06.261085+0000 mon.a (mon.0) 1144 : cluster [DBG] osdmap e766: 8 total, 8 up, 8 in 2021-07-26T16:10:07.277 INFO:tasks.rados.rados.0.smithi033.stdout:3614: done (4 left) 2021-07-26T16:10:07.278 INFO:tasks.rados.rados.0.smithi033.stdout:3615: done (3 left) 2021-07-26T16:10:07.278 INFO:tasks.rados.rados.0.smithi033.stdout:3616: done (2 left) 2021-07-26T16:10:07.278 INFO:tasks.rados.rados.0.smithi033.stdout:3619: done (1 left) 2021-07-26T16:10:07.279 INFO:tasks.rados.rados.0.smithi033.stdout:3620: done (0 left) 2021-07-26T16:10:07.279 INFO:tasks.rados.rados.0.smithi033.stdout:3621: read oid 14 snap -1 2021-07-26T16:10:07.279 INFO:tasks.rados.rados.0.smithi033.stdout:3621: expect (ObjNum 1031 snap 344 seq_num 1031) 2021-07-26T16:10:07.279 INFO:tasks.rados.rados.0.smithi033.stdout:3622: copy_from oid 48 from oid 19 current snap is 355 2021-07-26T16:10:07.279 INFO:tasks.rados.rados.0.smithi033.stdout:3623: copy_from oid 4 from oid 5 current snap is 355 2021-07-26T16:10:07.280 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 29 current snap is 355 2021-07-26T16:10:07.280 INFO:tasks.rados.rados.0.smithi033.stdout:3624: seq_num 1078 ranges {4833280=458752,5292032=720896,6012928=81920} 2021-07-26T16:10:07.309 INFO:tasks.rados.rados.0.smithi033.stdout:3624: writing smithi03339061-29 from 4833280 to 5292032 tid 1 2021-07-26T16:10:07.315 INFO:tasks.rados.rados.0.smithi033.stdout:3624: writing smithi03339061-29 from 5292032 to 6012928 tid 2 2021-07-26T16:10:07.316 INFO:tasks.rados.rados.0.smithi033.stdout:3624: writing smithi03339061-29 from 6012928 to 6094848 tid 3 2021-07-26T16:10:07.316 INFO:tasks.rados.rados.0.smithi033.stdout:3625: delete oid 25 current snap is 355 2021-07-26T16:10:07.316 INFO:tasks.rados.rados.0.smithi033.stdout:3622: finishing copy_from to smithi03339061-48 2021-07-26T16:10:07.316 INFO:tasks.rados.rados.0.smithi033.stdout:3622: got expected ENOENT (src dne) 2021-07-26T16:10:07.317 INFO:tasks.rados.rados.0.smithi033.stdout:3622: finishing copy_from racing read to smithi03339061-48 2021-07-26T16:10:07.317 INFO:tasks.rados.rados.0.smithi033.stdout:3621: expect (ObjNum 1031 snap 344 seq_num 1031) 2021-07-26T16:10:07.437 INFO:tasks.rados.rados.0.smithi033.stdout:3623: finishing copy_from to smithi03339061-4 2021-07-26T16:10:07.437 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1859 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2021-07-26T16:10:07.437 INFO:tasks.rados.rados.0.smithi033.stdout:3623: finishing copy_from racing read to smithi03339061-4 2021-07-26T16:10:07.438 INFO:tasks.rados.rados.0.smithi033.stdout:3624: finishing write tid 1 to smithi03339061-29 2021-07-26T16:10:07.438 INFO:tasks.rados.rados.0.smithi033.stdout:3624: finishing write tid 2 to smithi03339061-29 2021-07-26T16:10:07.438 INFO:tasks.rados.rados.0.smithi033.stdout:3624: finishing write tid 3 to smithi03339061-29 2021-07-26T16:10:07.439 INFO:tasks.rados.rados.0.smithi033.stdout:3624: finishing write tid 4 to smithi03339061-29 2021-07-26T16:10:07.440 INFO:tasks.rados.rados.0.smithi033.stdout:3624: finishing write tid 5 to smithi03339061-29 2021-07-26T16:10:07.440 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1364 (ObjNum 1078 snap 355 seq_num 1078) dirty exists 2021-07-26T16:10:07.440 INFO:tasks.rados.rados.0.smithi033.stdout:3624: left oid 29 (ObjNum 1078 snap 355 seq_num 1078) 2021-07-26T16:10:07.440 INFO:tasks.rados.rados.0.smithi033.stdout:3621: done (4 left) 2021-07-26T16:10:07.441 INFO:tasks.rados.rados.0.smithi033.stdout:3622: done (3 left) 2021-07-26T16:10:07.441 INFO:tasks.rados.rados.0.smithi033.stdout:3623: done (2 left) 2021-07-26T16:10:07.441 INFO:tasks.rados.rados.0.smithi033.stdout:3624: done (1 left) 2021-07-26T16:10:07.441 INFO:tasks.rados.rados.0.smithi033.stdout:3625: done (0 left) 2021-07-26T16:10:07.441 INFO:tasks.rados.rados.0.smithi033.stdout:3626: setattr oid 38 current snap is 355 2021-07-26T16:10:07.442 INFO:tasks.rados.rados.0.smithi033.stdout:3627: rollback oid 36 current snap is 355 2021-07-26T16:10:07.443 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 36 to 340 2021-07-26T16:10:07.443 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 355 2021-07-26T16:10:07.443 INFO:tasks.rados.rados.0.smithi033.stdout:3628: seq_num 1080 ranges {3588096=491520,4079616=540672,4620288=262144} 2021-07-26T16:10:07.471 INFO:tasks.rados.rados.0.smithi033.stdout:3628: writing smithi03339061-4 from 3588096 to 4079616 tid 1 2021-07-26T16:10:07.474 INFO:tasks.rados.rados.0.smithi033.stdout:3628: writing smithi03339061-4 from 4079616 to 4620288 tid 2 2021-07-26T16:10:07.476 INFO:tasks.rados.rados.0.smithi033.stdout:3628: writing smithi03339061-4 from 4620288 to 4882432 tid 3 2021-07-26T16:10:07.476 INFO:tasks.rados.rados.0.smithi033.stdout:3629: read oid 30 snap -1 2021-07-26T16:10:07.477 INFO:tasks.rados.rados.0.smithi033.stdout:3629: expect deleted 2021-07-26T16:10:07.477 INFO:tasks.rados.rados.0.smithi033.stdout:3630: snap_remove snap 349 2021-07-26T16:10:08.283 INFO:tasks.rados.rados.0.smithi033.stdout:3630: done (4 left) 2021-07-26T16:10:08.284 INFO:tasks.rados.rados.0.smithi033.stdout:3631: copy_from oid 35 from oid 31 current snap is 355 2021-07-26T16:10:08.284 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 743 (ObjNum 1031 snap 344 seq_num 1031) dirty exists 2021-07-26T16:10:08.284 INFO:tasks.rados.rados.0.smithi033.stdout:3627: finishing rollback tid 0 to smithi03339061-36 2021-07-26T16:10:08.284 INFO:tasks.rados.rados.0.smithi033.stdout:3627: finishing rollback tid 1 to smithi03339061-36 2021-07-26T16:10:08.285 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1446 (ObjNum 1516654449 snap 1448239971 seq_num 1784115548) dirty dne 2021-07-26T16:10:08.285 INFO:tasks.rados.rados.0.smithi033.stdout:3628: finishing write tid 1 to smithi03339061-4 2021-07-26T16:10:08.285 INFO:tasks.rados.rados.0.smithi033.stdout:3628: finishing write tid 2 to smithi03339061-4 2021-07-26T16:10:08.285 INFO:tasks.rados.rados.0.smithi033.stdout:3628: finishing write tid 3 to smithi03339061-4 2021-07-26T16:10:08.285 INFO:tasks.rados.rados.0.smithi033.stdout:3628: finishing write tid 4 to smithi03339061-4 2021-07-26T16:10:08.286 INFO:tasks.rados.rados.0.smithi033.stdout:3628: finishing write tid 5 to smithi03339061-4 2021-07-26T16:10:08.286 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 2060 (ObjNum 1080 snap 355 seq_num 1080) dirty exists 2021-07-26T16:10:08.286 INFO:tasks.rados.rados.0.smithi033.stdout:3628: left oid 4 (ObjNum 1080 snap 355 seq_num 1080) 2021-07-26T16:10:08.286 INFO:tasks.rados.rados.0.smithi033.stdout:3626: done (4 left) 2021-07-26T16:10:08.287 INFO:tasks.rados.rados.0.smithi033.stdout:3627: done (3 left) 2021-07-26T16:10:08.287 INFO:tasks.rados.rados.0.smithi033.stdout:3628: done (2 left) 2021-07-26T16:10:08.287 INFO:tasks.rados.rados.0.smithi033.stdout:3629: done (1 left) 2021-07-26T16:10:08.287 INFO:tasks.rados.rados.0.smithi033.stdout:3632: snap_create 2021-07-26T16:10:08.306 INFO:tasks.rados.rados.0.smithi033.stdout:3631: finishing copy_from to smithi03339061-35 2021-07-26T16:10:08.307 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1386 (ObjNum 1043 snap 347 seq_num 1043) dirty exists 2021-07-26T16:10:08.308 INFO:tasks.rados.rados.0.smithi033.stdout:3631: finishing copy_from racing read to smithi03339061-35 2021-07-26T16:10:08.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:08 smithi033 bash[41341]: cluster 2021-07-26T16:10:07.205546+0000 mgr.y (mgr.34104) 485 : cluster [DBG] pgmap v982: 25 pgs: 25 active+clean; 861 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 989 KiB/s wr, 3 op/s 2021-07-26T16:10:08.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:08 smithi033 bash[41341]: cluster 2021-07-26T16:10:07.273437+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e767: 8 total, 8 up, 8 in 2021-07-26T16:10:08.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:08 smithi033 bash[42377]: cluster 2021-07-26T16:10:07.205546+0000 mgr.y (mgr.34104) 485 : cluster [DBG] pgmap v982: 25 pgs: 25 active+clean; 861 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 989 KiB/s wr, 3 op/s 2021-07-26T16:10:08.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:08 smithi033 bash[42377]: cluster 2021-07-26T16:10:07.273437+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e767: 8 total, 8 up, 8 in 2021-07-26T16:10:08.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:08 smithi096 bash[33981]: cluster 2021-07-26T16:10:07.205546+0000 mgr.y (mgr.34104) 485 : cluster [DBG] pgmap v982: 25 pgs: 25 active+clean; 861 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 13 MiB/s rd, 989 KiB/s wr, 3 op/s 2021-07-26T16:10:08.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:08 smithi096 bash[33981]: cluster 2021-07-26T16:10:07.273437+0000 mon.a (mon.0) 1145 : cluster [DBG] osdmap e767: 8 total, 8 up, 8 in 2021-07-26T16:10:09.297 INFO:tasks.rados.rados.0.smithi033.stdout:3631: done (1 left) 2021-07-26T16:10:09.297 INFO:tasks.rados.rados.0.smithi033.stdout:3632: done (0 left) 2021-07-26T16:10:09.297 INFO:tasks.rados.rados.0.smithi033.stdout:3633: snap_remove snap 341 2021-07-26T16:10:09.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:09 smithi033 bash[41341]: cluster 2021-07-26T16:10:08.276348+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e768: 8 total, 8 up, 8 in 2021-07-26T16:10:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:09 smithi033 bash[41341]: audit 2021-07-26T16:10:09.258783+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:10:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:09 smithi033 bash[41341]: audit 2021-07-26T16:10:09.259556+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:10:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:09 smithi033 bash[41341]: audit 2021-07-26T16:10:09.279182+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:10:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:09 smithi033 bash[41341]: audit 2021-07-26T16:10:09.279895+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:10:09.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:09 smithi033 bash[42377]: cluster 2021-07-26T16:10:08.276348+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e768: 8 total, 8 up, 8 in 2021-07-26T16:10:09.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:09 smithi033 bash[42377]: audit 2021-07-26T16:10:09.258783+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:10:09.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:09 smithi033 bash[42377]: audit 2021-07-26T16:10:09.259556+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:10:09.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:09 smithi033 bash[42377]: audit 2021-07-26T16:10:09.279182+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:10:09.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:09 smithi033 bash[42377]: audit 2021-07-26T16:10:09.279895+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:10:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:09 smithi096 bash[33981]: cluster 2021-07-26T16:10:08.276348+0000 mon.a (mon.0) 1146 : cluster [DBG] osdmap e768: 8 total, 8 up, 8 in 2021-07-26T16:10:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:09 smithi096 bash[33981]: audit 2021-07-26T16:10:09.258783+0000 mon.c (mon.1) 271 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:10:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:09 smithi096 bash[33981]: audit 2021-07-26T16:10:09.259556+0000 mon.a (mon.0) 1147 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:10:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:09 smithi096 bash[33981]: audit 2021-07-26T16:10:09.279182+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:10:09.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:09 smithi096 bash[33981]: audit 2021-07-26T16:10:09.279895+0000 mon.a (mon.0) 1148 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:10:10.320 INFO:tasks.rados.rados.0.smithi033.stdout:3633: done (0 left) 2021-07-26T16:10:10.320 INFO:tasks.rados.rados.0.smithi033.stdout:3634: rollback oid 34 current snap is 356 2021-07-26T16:10:10.321 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 34 to 346 2021-07-26T16:10:10.321 INFO:tasks.rados.rados.0.smithi033.stdout:3635: read oid 8 snap 278 2021-07-26T16:10:10.321 INFO:tasks.rados.rados.0.smithi033.stdout:3635: expect (ObjNum 723 snap 242 seq_num 723) 2021-07-26T16:10:10.321 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 356 2021-07-26T16:10:10.321 INFO:tasks.rados.rados.0.smithi033.stdout:3636: seq_num 1081 ranges {3227648=507904,3735552=425984,4161536=376832} 2021-07-26T16:10:10.342 INFO:tasks.rados.rados.0.smithi033.stdout:3636: writing smithi03339061-28 from 3227648 to 3735552 tid 1 2021-07-26T16:10:10.345 INFO:tasks.rados.rados.0.smithi033.stdout:3636: writing smithi03339061-28 from 3735552 to 4161536 tid 2 2021-07-26T16:10:10.349 INFO:tasks.rados.rados.0.smithi033.stdout:3636: writing smithi03339061-28 from 4161536 to 4538368 tid 3 2021-07-26T16:10:10.349 INFO:tasks.rados.rados.0.smithi033.stdout:3637: snap_create 2021-07-26T16:10:10.349 INFO:tasks.rados.rados.0.smithi033.stdout:3634: finishing rollback tid 0 to smithi03339061-34 2021-07-26T16:10:10.349 INFO:tasks.rados.rados.0.smithi033.stdout:3634: finishing rollback tid 1 to smithi03339061-34 2021-07-26T16:10:10.350 INFO:tasks.rados.rados.0.smithi033.stdout:3634: finishing rollback tid 2 to smithi03339061-34 2021-07-26T16:10:10.350 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1449 (ObjNum 904 snap 302 seq_num 904) dirty exists 2021-07-26T16:10:10.351 INFO:tasks.rados.rados.0.smithi033.stdout:3635: expect (ObjNum 723 snap 242 seq_num 723) 2021-07-26T16:10:10.470 INFO:tasks.rados.rados.0.smithi033.stdout:3636: finishing write tid 1 to smithi03339061-28 2021-07-26T16:10:10.471 INFO:tasks.rados.rados.0.smithi033.stdout:3636: finishing write tid 2 to smithi03339061-28 2021-07-26T16:10:10.471 INFO:tasks.rados.rados.0.smithi033.stdout:3636: finishing write tid 3 to smithi03339061-28 2021-07-26T16:10:10.471 INFO:tasks.rados.rados.0.smithi033.stdout:3636: finishing write tid 4 to smithi03339061-28 2021-07-26T16:10:10.472 INFO:tasks.rados.rados.0.smithi033.stdout:3636: finishing write tid 5 to smithi03339061-28 2021-07-26T16:10:10.472 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1850 (ObjNum 1081 snap 356 seq_num 1081) dirty exists 2021-07-26T16:10:10.472 INFO:tasks.rados.rados.0.smithi033.stdout:3636: left oid 28 (ObjNum 1081 snap 356 seq_num 1081) 2021-07-26T16:10:10.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:10 smithi033 bash[41341]: cluster 2021-07-26T16:10:09.206246+0000 mgr.y (mgr.34104) 486 : cluster [DBG] pgmap v985: 25 pgs: 25 active+clean; 821 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 0 B/s wr, 13 op/s 2021-07-26T16:10:10.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:10 smithi033 bash[41341]: cluster 2021-07-26T16:10:09.293820+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e769: 8 total, 8 up, 8 in 2021-07-26T16:10:10.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:10 smithi033 bash[42377]: cluster 2021-07-26T16:10:09.206246+0000 mgr.y (mgr.34104) 486 : cluster [DBG] pgmap v985: 25 pgs: 25 active+clean; 821 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 0 B/s wr, 13 op/s 2021-07-26T16:10:10.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:10 smithi033 bash[42377]: cluster 2021-07-26T16:10:09.293820+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e769: 8 total, 8 up, 8 in 2021-07-26T16:10:10.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:10 smithi096 bash[33981]: cluster 2021-07-26T16:10:09.206246+0000 mgr.y (mgr.34104) 486 : cluster [DBG] pgmap v985: 25 pgs: 25 active+clean; 821 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 16 MiB/s rd, 0 B/s wr, 13 op/s 2021-07-26T16:10:10.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:10 smithi096 bash[33981]: cluster 2021-07-26T16:10:09.293820+0000 mon.a (mon.0) 1149 : cluster [DBG] osdmap e769: 8 total, 8 up, 8 in 2021-07-26T16:10:11.328 INFO:tasks.rados.rados.0.smithi033.stdout:3634: done (3 left) 2021-07-26T16:10:11.329 INFO:tasks.rados.rados.0.smithi033.stdout:3635: done (2 left) 2021-07-26T16:10:11.329 INFO:tasks.rados.rados.0.smithi033.stdout:3636: done (1 left) 2021-07-26T16:10:11.329 INFO:tasks.rados.rados.0.smithi033.stdout:3637: done (0 left) 2021-07-26T16:10:11.329 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 357 2021-07-26T16:10:11.330 INFO:tasks.rados.rados.0.smithi033.stdout:3638: seq_num 1082 ranges {1605632=524288,2129920=704512,2834432=98304} 2021-07-26T16:10:11.345 INFO:tasks.rados.rados.0.smithi033.stdout:3638: writing smithi03339061-26 from 1605632 to 2129920 tid 1 2021-07-26T16:10:11.348 INFO:tasks.rados.rados.0.smithi033.stdout:3638: writing smithi03339061-26 from 2129920 to 2834432 tid 2 2021-07-26T16:10:11.349 INFO:tasks.rados.rados.0.smithi033.stdout:3638: writing smithi03339061-26 from 2834432 to 2932736 tid 3 2021-07-26T16:10:11.350 INFO:tasks.rados.rados.0.smithi033.stdout:3639: rollback oid 23 current snap is 357 2021-07-26T16:10:11.350 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 23 to 316 2021-07-26T16:10:11.350 INFO:tasks.rados.rados.0.smithi033.stdout:3640: delete oid 42 current snap is 357 2021-07-26T16:10:11.355 INFO:tasks.rados.rados.0.smithi033.stdout:3638: finishing write tid 1 to smithi03339061-26 2021-07-26T16:10:11.356 INFO:tasks.rados.rados.0.smithi033.stdout:3639: finishing rollback tid 1 to smithi03339061-23 2021-07-26T16:10:11.357 INFO:tasks.rados.rados.0.smithi033.stdout:3639: finishing rollback tid 2 to smithi03339061-23 2021-07-26T16:10:11.357 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1921 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:10:11.358 INFO:tasks.rados.rados.0.smithi033.stdout:3639: done (2 left) 2021-07-26T16:10:11.359 INFO:tasks.rados.rados.0.smithi033.stdout:3640: done (1 left) 2021-07-26T16:10:11.359 INFO:tasks.rados.rados.0.smithi033.stdout:3641: snap_create 2021-07-26T16:10:11.360 INFO:tasks.rados.rados.0.smithi033.stdout:3638: finishing write tid 2 to smithi03339061-26 2021-07-26T16:10:11.362 INFO:tasks.rados.rados.0.smithi033.stdout:3638: finishing write tid 3 to smithi03339061-26 2021-07-26T16:10:11.362 INFO:tasks.rados.rados.0.smithi033.stdout:3638: finishing write tid 4 to smithi03339061-26 2021-07-26T16:10:11.365 INFO:tasks.rados.rados.0.smithi033.stdout:3638: finishing write tid 5 to smithi03339061-26 2021-07-26T16:10:11.366 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 2396 (ObjNum 1082 snap 357 seq_num 1082) dirty exists 2021-07-26T16:10:11.366 INFO:tasks.rados.rados.0.smithi033.stdout:3638: left oid 26 (ObjNum 1082 snap 357 seq_num 1082) 2021-07-26T16:10:11.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:11 smithi033 bash[41341]: cluster 2021-07-26T16:10:10.313351+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e770: 8 total, 8 up, 8 in 2021-07-26T16:10:11.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:11 smithi033 bash[42377]: cluster 2021-07-26T16:10:10.313351+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e770: 8 total, 8 up, 8 in 2021-07-26T16:10:11.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:11 smithi096 bash[33981]: cluster 2021-07-26T16:10:10.313351+0000 mon.a (mon.0) 1150 : cluster [DBG] osdmap e770: 8 total, 8 up, 8 in 2021-07-26T16:10:12.332 INFO:tasks.rados.rados.0.smithi033.stdout:3638: done (1 left) 2021-07-26T16:10:12.333 INFO:tasks.rados.rados.0.smithi033.stdout:3641: done (0 left) 2021-07-26T16:10:12.333 INFO:tasks.rados.rados.0.smithi033.stdout:3642: delete oid 20 current snap is 358 2021-07-26T16:10:12.343 INFO:tasks.rados.rados.0.smithi033.stdout:3642: done (0 left) 2021-07-26T16:10:12.344 INFO:tasks.rados.rados.0.smithi033.stdout:3643: rmattr oid 25 current snap is 358 2021-07-26T16:10:12.344 INFO:tasks.rados.rados.0.smithi033.stdout:3643: done (0 left) 2021-07-26T16:10:12.344 INFO:tasks.rados.rados.0.smithi033.stdout:3644: read oid 35 snap -1 2021-07-26T16:10:12.344 INFO:tasks.rados.rados.0.smithi033.stdout:3644: expect (ObjNum 1043 snap 347 seq_num 1043) 2021-07-26T16:10:12.344 INFO:tasks.rados.rados.0.smithi033.stdout:3645: setattr oid 40 current snap is 358 2021-07-26T16:10:12.345 INFO:tasks.rados.rados.0.smithi033.stdout:3646: setattr oid 34 current snap is 358 2021-07-26T16:10:12.345 INFO:tasks.rados.rados.0.smithi033.stdout:3647: snap_remove snap 329 2021-07-26T16:10:12.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:12 smithi033 bash[41341]: cluster 2021-07-26T16:10:11.207020+0000 mgr.y (mgr.34104) 487 : cluster [DBG] pgmap v988: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 781 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.5 MiB/s wr, 23 op/s 2021-07-26T16:10:12.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:12 smithi033 bash[41341]: cluster 2021-07-26T16:10:11.325654+0000 mon.a (mon.0) 1151 : cluster [DBG] osdmap e771: 8 total, 8 up, 8 in 2021-07-26T16:10:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:12 smithi033 bash[42377]: cluster 2021-07-26T16:10:11.207020+0000 mgr.y (mgr.34104) 487 : cluster [DBG] pgmap v988: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 781 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.5 MiB/s wr, 23 op/s 2021-07-26T16:10:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:12 smithi033 bash[42377]: cluster 2021-07-26T16:10:11.325654+0000 mon.a (mon.0) 1151 : cluster [DBG] osdmap e771: 8 total, 8 up, 8 in 2021-07-26T16:10:12.733 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:12 smithi096 bash[33981]: cluster 2021-07-26T16:10:11.207020+0000 mgr.y (mgr.34104) 487 : cluster [DBG] pgmap v988: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 781 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 4.7 MiB/s rd, 2.5 MiB/s wr, 23 op/s 2021-07-26T16:10:12.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:12 smithi096 bash[33981]: cluster 2021-07-26T16:10:11.325654+0000 mon.a (mon.0) 1151 : cluster [DBG] osdmap e771: 8 total, 8 up, 8 in 2021-07-26T16:10:13.352 INFO:tasks.rados.rados.0.smithi033.stdout:3647: done (3 left) 2021-07-26T16:10:13.352 INFO:tasks.rados.rados.0.smithi033.stdout:3648: delete oid 23 current snap is 358 2021-07-26T16:10:13.353 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 1413 (ObjNum 1058 snap 348 seq_num 1058) dirty exists 2021-07-26T16:10:13.353 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1450 (ObjNum 904 snap 302 seq_num 904) dirty exists 2021-07-26T16:10:13.353 INFO:tasks.rados.rados.0.smithi033.stdout:3644: expect (ObjNum 1043 snap 347 seq_num 1043) 2021-07-26T16:10:13.550 INFO:tasks.rados.rados.0.smithi033.stdout:3644: done (3 left) 2021-07-26T16:10:13.551 INFO:tasks.rados.rados.0.smithi033.stdout:3645: done (2 left) 2021-07-26T16:10:13.551 INFO:tasks.rados.rados.0.smithi033.stdout:3646: done (1 left) 2021-07-26T16:10:13.552 INFO:tasks.rados.rados.0.smithi033.stdout:3648: done (0 left) 2021-07-26T16:10:13.553 INFO:tasks.rados.rados.0.smithi033.stdout:3649: rmattr oid 43 current snap is 358 2021-07-26T16:10:13.553 INFO:tasks.rados.rados.0.smithi033.stdout:3650: read oid 44 snap -1 2021-07-26T16:10:13.553 INFO:tasks.rados.rados.0.smithi033.stdout:3650: expect deleted 2021-07-26T16:10:13.553 INFO:tasks.rados.rados.0.smithi033.stdout:3651: snap_remove snap 357 2021-07-26T16:10:13.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:13 smithi033 bash[41341]: cluster 2021-07-26T16:10:12.329481+0000 mon.a (mon.0) 1152 : cluster [DBG] osdmap e772: 8 total, 8 up, 8 in 2021-07-26T16:10:13.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:13 smithi033 bash[42377]: cluster 2021-07-26T16:10:12.329481+0000 mon.a (mon.0) 1152 : cluster [DBG] osdmap e772: 8 total, 8 up, 8 in 2021-07-26T16:10:13.733 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:13 smithi096 bash[33981]: cluster 2021-07-26T16:10:12.329481+0000 mon.a (mon.0) 1152 : cluster [DBG] osdmap e772: 8 total, 8 up, 8 in 2021-07-26T16:10:14.362 INFO:tasks.rados.rados.0.smithi033.stdout:3651: done (2 left) 2021-07-26T16:10:14.363 INFO:tasks.rados.rados.0.smithi033.stdout:3652: snap_remove snap 293 2021-07-26T16:10:14.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:14 smithi033 bash[41341]: cluster 2021-07-26T16:10:13.207755+0000 mgr.y (mgr.34104) 488 : cluster [DBG] pgmap v991: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 782 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2021-07-26T16:10:14.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:14 smithi033 bash[41341]: cluster 2021-07-26T16:10:13.346863+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e773: 8 total, 8 up, 8 in 2021-07-26T16:10:14.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:14 smithi033 bash[42377]: cluster 2021-07-26T16:10:13.207755+0000 mgr.y (mgr.34104) 488 : cluster [DBG] pgmap v991: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 782 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2021-07-26T16:10:14.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:14 smithi033 bash[42377]: cluster 2021-07-26T16:10:13.346863+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e773: 8 total, 8 up, 8 in 2021-07-26T16:10:14.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:14 smithi096 bash[33981]: cluster 2021-07-26T16:10:13.207755+0000 mgr.y (mgr.34104) 488 : cluster [DBG] pgmap v991: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 782 MiB data, 3.3 GiB used, 712 GiB / 715 GiB avail; 2.6 MiB/s rd, 2.9 MiB/s wr, 14 op/s 2021-07-26T16:10:14.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:14 smithi096 bash[33981]: cluster 2021-07-26T16:10:13.346863+0000 mon.a (mon.0) 1153 : cluster [DBG] osdmap e773: 8 total, 8 up, 8 in 2021-07-26T16:10:15.369 INFO:tasks.rados.rados.0.smithi033.stdout:3652: done (2 left) 2021-07-26T16:10:15.370 INFO:tasks.rados.rados.0.smithi033.stdout:3653: snap_create 2021-07-26T16:10:15.370 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 2050 (ObjNum 1059 snap 348 seq_num 1059) dirty exists 2021-07-26T16:10:15.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:15 smithi033 bash[41341]: cluster 2021-07-26T16:10:14.358848+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e774: 8 total, 8 up, 8 in 2021-07-26T16:10:15.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:15 smithi033 bash[42377]: cluster 2021-07-26T16:10:14.358848+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e774: 8 total, 8 up, 8 in 2021-07-26T16:10:15.733 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:15 smithi096 bash[33981]: cluster 2021-07-26T16:10:14.358848+0000 mon.a (mon.0) 1154 : cluster [DBG] osdmap e774: 8 total, 8 up, 8 in 2021-07-26T16:10:16.280 INFO:tasks.rados.rados.0.smithi033.stdout:3649: done (2 left) 2021-07-26T16:10:16.280 INFO:tasks.rados.rados.0.smithi033.stdout:3650: done (1 left) 2021-07-26T16:10:16.281 INFO:tasks.rados.rados.0.smithi033.stdout:3653: done (0 left) 2021-07-26T16:10:16.281 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 359 2021-07-26T16:10:16.281 INFO:tasks.rados.rados.0.smithi033.stdout:3654: seq_num 1086 ranges {2719744=598016,3317760=647168,3964928=155648} 2021-07-26T16:10:16.301 INFO:tasks.rados.rados.0.smithi033.stdout:3654: writing smithi03339061-14 from 2719744 to 3317760 tid 1 2021-07-26T16:10:16.304 INFO:tasks.rados.rados.0.smithi033.stdout:3654: writing smithi03339061-14 from 3317760 to 3964928 tid 2 2021-07-26T16:10:16.305 INFO:tasks.rados.rados.0.smithi033.stdout:3654: writing smithi03339061-14 from 3964928 to 4120576 tid 3 2021-07-26T16:10:16.306 INFO:tasks.rados.rados.0.smithi033.stdout:3655: snap_create 2021-07-26T16:10:16.311 INFO:tasks.rados.rados.0.smithi033.stdout:3654: finishing write tid 1 to smithi03339061-14 2021-07-26T16:10:16.313 INFO:tasks.rados.rados.0.smithi033.stdout:3654: finishing write tid 2 to smithi03339061-14 2021-07-26T16:10:16.313 INFO:tasks.rados.rados.0.smithi033.stdout:3654: finishing write tid 3 to smithi03339061-14 2021-07-26T16:10:16.314 INFO:tasks.rados.rados.0.smithi033.stdout:3654: finishing write tid 4 to smithi03339061-14 2021-07-26T16:10:16.316 INFO:tasks.rados.rados.0.smithi033.stdout:3654: finishing write tid 5 to smithi03339061-14 2021-07-26T16:10:16.316 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 2065 (ObjNum 1086 snap 359 seq_num 1086) dirty exists 2021-07-26T16:10:16.316 INFO:tasks.rados.rados.0.smithi033.stdout:3654: left oid 14 (ObjNum 1086 snap 359 seq_num 1086) 2021-07-26T16:10:16.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:16 smithi033 bash[42377]: cluster 2021-07-26T16:10:15.208542+0000 mgr.y (mgr.34104) 489 : cluster [DBG] pgmap v994: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 779 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 644 KiB/s wr, 11 op/s 2021-07-26T16:10:16.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:16 smithi033 bash[42377]: cluster 2021-07-26T16:10:15.366729+0000 mon.a (mon.0) 1155 : cluster [DBG] osdmap e775: 8 total, 8 up, 8 in 2021-07-26T16:10:16.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:16 smithi033 bash[42377]: cluster 2021-07-26T16:10:16.276508+0000 mon.a (mon.0) 1156 : cluster [DBG] osdmap e776: 8 total, 8 up, 8 in 2021-07-26T16:10:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:16 smithi033 bash[41341]: cluster 2021-07-26T16:10:15.208542+0000 mgr.y (mgr.34104) 489 : cluster [DBG] pgmap v994: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 779 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 644 KiB/s wr, 11 op/s 2021-07-26T16:10:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:16 smithi033 bash[41341]: cluster 2021-07-26T16:10:15.366729+0000 mon.a (mon.0) 1155 : cluster [DBG] osdmap e775: 8 total, 8 up, 8 in 2021-07-26T16:10:16.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:16 smithi033 bash[41341]: cluster 2021-07-26T16:10:16.276508+0000 mon.a (mon.0) 1156 : cluster [DBG] osdmap e776: 8 total, 8 up, 8 in 2021-07-26T16:10:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:16 smithi096 bash[33981]: cluster 2021-07-26T16:10:15.208542+0000 mgr.y (mgr.34104) 489 : cluster [DBG] pgmap v994: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 779 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 511 B/s rd, 644 KiB/s wr, 11 op/s 2021-07-26T16:10:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:16 smithi096 bash[33981]: cluster 2021-07-26T16:10:15.366729+0000 mon.a (mon.0) 1155 : cluster [DBG] osdmap e775: 8 total, 8 up, 8 in 2021-07-26T16:10:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:16 smithi096 bash[33981]: cluster 2021-07-26T16:10:16.276508+0000 mon.a (mon.0) 1156 : cluster [DBG] osdmap e776: 8 total, 8 up, 8 in 2021-07-26T16:10:17.296 INFO:tasks.rados.rados.0.smithi033.stdout:3654: done (1 left) 2021-07-26T16:10:17.297 INFO:tasks.rados.rados.0.smithi033.stdout:3655: done (0 left) 2021-07-26T16:10:17.297 INFO:tasks.rados.rados.0.smithi033.stdout:3656: rollback oid 29 current snap is 360 2021-07-26T16:10:17.297 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 346 2021-07-26T16:10:17.297 INFO:tasks.rados.rados.0.smithi033.stdout:3657: snap_remove snap 288 2021-07-26T16:10:18.302 INFO:tasks.rados.rados.0.smithi033.stdout:3657: done (1 left) 2021-07-26T16:10:18.302 INFO:tasks.rados.rados.0.smithi033.stdout:3658: read oid 48 snap -1 2021-07-26T16:10:18.302 INFO:tasks.rados.rados.0.smithi033.stdout:3658: expect (ObjNum 1070 snap 350 seq_num 1070) 2021-07-26T16:10:18.303 INFO:tasks.rados.rados.0.smithi033.stdout:3659: copy_from oid 10 from oid 5 current snap is 360 2021-07-26T16:10:18.303 INFO:tasks.rados.rados.0.smithi033.stdout:3656: finishing rollback tid 0 to smithi03339061-29 2021-07-26T16:10:18.303 INFO:tasks.rados.rados.0.smithi033.stdout:3656: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:10:18.303 INFO:tasks.rados.rados.0.smithi033.stdout:3656: finishing rollback tid 2 to smithi03339061-29 2021-07-26T16:10:18.303 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1367 (ObjNum 890 snap 292 seq_num 890) dirty exists 2021-07-26T16:10:18.304 INFO:tasks.rados.rados.0.smithi033.stdout:3656: done (2 left) 2021-07-26T16:10:18.304 INFO:tasks.rados.rados.0.smithi033.stdout:3660: snap_remove snap 351 2021-07-26T16:10:18.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:18 smithi033 bash[42377]: cluster 2021-07-26T16:10:17.209255+0000 mgr.y (mgr.34104) 490 : cluster [DBG] pgmap v997: 25 pgs: 25 active+clean; 779 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 320 KiB/s wr, 16 op/s 2021-07-26T16:10:18.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:18 smithi033 bash[42377]: cluster 2021-07-26T16:10:17.292346+0000 mon.a (mon.0) 1157 : cluster [DBG] osdmap e777: 8 total, 8 up, 8 in 2021-07-26T16:10:18.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:18 smithi033 bash[41341]: cluster 2021-07-26T16:10:17.209255+0000 mgr.y (mgr.34104) 490 : cluster [DBG] pgmap v997: 25 pgs: 25 active+clean; 779 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 320 KiB/s wr, 16 op/s 2021-07-26T16:10:18.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:18 smithi033 bash[41341]: cluster 2021-07-26T16:10:17.292346+0000 mon.a (mon.0) 1157 : cluster [DBG] osdmap e777: 8 total, 8 up, 8 in 2021-07-26T16:10:18.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:18 smithi096 bash[33981]: cluster 2021-07-26T16:10:17.209255+0000 mgr.y (mgr.34104) 490 : cluster [DBG] pgmap v997: 25 pgs: 25 active+clean; 779 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 320 KiB/s wr, 16 op/s 2021-07-26T16:10:18.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:18 smithi096 bash[33981]: cluster 2021-07-26T16:10:17.292346+0000 mon.a (mon.0) 1157 : cluster [DBG] osdmap e777: 8 total, 8 up, 8 in 2021-07-26T16:10:19.323 INFO:tasks.rados.rados.0.smithi033.stdout:3660: done (2 left) 2021-07-26T16:10:19.323 INFO:tasks.rados.rados.0.smithi033.stdout:3661: copy_from oid 13 from oid 41 current snap is 360 2021-07-26T16:10:19.324 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 35 current snap is 360 2021-07-26T16:10:19.324 INFO:tasks.rados.rados.0.smithi033.stdout:3662: seq_num 1087 ranges {3317760=614400,3932160=532480,4464640=270336} 2021-07-26T16:10:19.349 INFO:tasks.rados.rados.0.smithi033.stdout:3662: writing smithi03339061-35 from 3317760 to 3932160 tid 1 2021-07-26T16:10:19.352 INFO:tasks.rados.rados.0.smithi033.stdout:3662: writing smithi03339061-35 from 3932160 to 4464640 tid 2 2021-07-26T16:10:19.355 INFO:tasks.rados.rados.0.smithi033.stdout:3662: writing smithi03339061-35 from 4464640 to 4734976 tid 3 2021-07-26T16:10:19.355 INFO:tasks.rados.rados.0.smithi033.stdout:3663: read oid 50 snap -1 2021-07-26T16:10:19.356 INFO:tasks.rados.rados.0.smithi033.stdout:3663: expect deleted 2021-07-26T16:10:19.356 INFO:tasks.rados.rados.0.smithi033.stdout:3664: snap_create 2021-07-26T16:10:19.356 INFO:tasks.rados.rados.0.smithi033.stdout:3659: finishing copy_from to smithi03339061-10 2021-07-26T16:10:19.356 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1859 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2021-07-26T16:10:19.357 INFO:tasks.rados.rados.0.smithi033.stdout:3659: finishing copy_from racing read to smithi03339061-10 2021-07-26T16:10:19.357 INFO:tasks.rados.rados.0.smithi033.stdout:3658: expect (ObjNum 1070 snap 350 seq_num 1070) 2021-07-26T16:10:19.643 INFO:tasks.rados.rados.0.smithi033.stdout:3662: finishing write tid 1 to smithi03339061-35 2021-07-26T16:10:19.643 INFO:tasks.rados.rados.0.smithi033.stdout:3662: finishing write tid 2 to smithi03339061-35 2021-07-26T16:10:19.643 INFO:tasks.rados.rados.0.smithi033.stdout:3662: finishing write tid 3 to smithi03339061-35 2021-07-26T16:10:19.644 INFO:tasks.rados.rados.0.smithi033.stdout:3662: finishing write tid 4 to smithi03339061-35 2021-07-26T16:10:19.644 INFO:tasks.rados.rados.0.smithi033.stdout:3662: finishing write tid 5 to smithi03339061-35 2021-07-26T16:10:19.644 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1838 (ObjNum 1087 snap 360 seq_num 1087) dirty exists 2021-07-26T16:10:19.644 INFO:tasks.rados.rados.0.smithi033.stdout:3662: left oid 35 (ObjNum 1087 snap 360 seq_num 1087) 2021-07-26T16:10:19.645 INFO:tasks.rados.rados.0.smithi033.stdout:3661: finishing copy_from to smithi03339061-13 2021-07-26T16:10:19.645 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 1863 (ObjNum 984 snap 327 seq_num 984) dirty exists 2021-07-26T16:10:19.645 INFO:tasks.rados.rados.0.smithi033.stdout:3661: finishing copy_from racing read to smithi03339061-13 2021-07-26T16:10:19.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:19 smithi033 bash[41341]: cluster 2021-07-26T16:10:18.294668+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e778: 8 total, 8 up, 8 in 2021-07-26T16:10:19.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:19 smithi033 bash[42377]: cluster 2021-07-26T16:10:18.294668+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e778: 8 total, 8 up, 8 in 2021-07-26T16:10:19.733 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:19 smithi096 bash[33981]: cluster 2021-07-26T16:10:18.294668+0000 mon.a (mon.0) 1158 : cluster [DBG] osdmap e778: 8 total, 8 up, 8 in 2021-07-26T16:10:20.324 INFO:tasks.rados.rados.0.smithi033.stdout:3658: done (5 left) 2021-07-26T16:10:20.325 INFO:tasks.rados.rados.0.smithi033.stdout:3659: done (4 left) 2021-07-26T16:10:20.325 INFO:tasks.rados.rados.0.smithi033.stdout:3661: done (3 left) 2021-07-26T16:10:20.325 INFO:tasks.rados.rados.0.smithi033.stdout:3662: done (2 left) 2021-07-26T16:10:20.326 INFO:tasks.rados.rados.0.smithi033.stdout:3663: done (1 left) 2021-07-26T16:10:20.326 INFO:tasks.rados.rados.0.smithi033.stdout:3664: done (0 left) 2021-07-26T16:10:20.326 INFO:tasks.rados.rados.0.smithi033.stdout:3665: rollback oid 8 current snap is 361 2021-07-26T16:10:20.326 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 8 to 271 2021-07-26T16:10:20.326 INFO:tasks.rados.rados.0.smithi033.stdout:3666: copy_from oid 25 from oid 38 current snap is 361 2021-07-26T16:10:20.327 INFO:tasks.rados.rados.0.smithi033.stdout:3667: snap_create 2021-07-26T16:10:20.333 INFO:tasks.rados.rados.0.smithi033.stdout:3665: finishing rollback tid 1 to smithi03339061-8 2021-07-26T16:10:20.333 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1791 (ObjNum 1058724832 snap 32561 seq_num 2006982272) dirty dne 2021-07-26T16:10:20.347 INFO:tasks.rados.rados.0.smithi033.stdout:3666: finishing copy_from to smithi03339061-25 2021-07-26T16:10:20.348 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 25 v 743 (ObjNum 1031 snap 344 seq_num 1031) dirty exists 2021-07-26T16:10:20.349 INFO:tasks.rados.rados.0.smithi033.stdout:3666: finishing copy_from racing read to smithi03339061-25 2021-07-26T16:10:20.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:20 smithi033 bash[42377]: cluster 2021-07-26T16:10:19.210034+0000 mgr.y (mgr.34104) 491 : cluster [DBG] pgmap v1000: 25 pgs: 25 active+clean; 777 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 0 B/s wr, 7 op/s 2021-07-26T16:10:20.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:20 smithi033 bash[42377]: cluster 2021-07-26T16:10:19.316926+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e779: 8 total, 8 up, 8 in 2021-07-26T16:10:20.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:20 smithi033 bash[41341]: cluster 2021-07-26T16:10:19.210034+0000 mgr.y (mgr.34104) 491 : cluster [DBG] pgmap v1000: 25 pgs: 25 active+clean; 777 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 0 B/s wr, 7 op/s 2021-07-26T16:10:20.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:20 smithi033 bash[41341]: cluster 2021-07-26T16:10:19.316926+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e779: 8 total, 8 up, 8 in 2021-07-26T16:10:20.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:20 smithi096 bash[33981]: cluster 2021-07-26T16:10:19.210034+0000 mgr.y (mgr.34104) 491 : cluster [DBG] pgmap v1000: 25 pgs: 25 active+clean; 777 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.6 MiB/s rd, 0 B/s wr, 7 op/s 2021-07-26T16:10:20.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:20 smithi096 bash[33981]: cluster 2021-07-26T16:10:19.316926+0000 mon.a (mon.0) 1159 : cluster [DBG] osdmap e779: 8 total, 8 up, 8 in 2021-07-26T16:10:21.287 INFO:tasks.rados.rados.0.smithi033.stdout:3665: done (2 left) 2021-07-26T16:10:21.287 INFO:tasks.rados.rados.0.smithi033.stdout:3666: done (1 left) 2021-07-26T16:10:21.287 INFO:tasks.rados.rados.0.smithi033.stdout:3667: done (0 left) 2021-07-26T16:10:21.288 INFO:tasks.rados.rados.0.smithi033.stdout:3668: snap_create 2021-07-26T16:10:21.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:21 smithi033 bash[42377]: cluster 2021-07-26T16:10:20.321248+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e780: 8 total, 8 up, 8 in 2021-07-26T16:10:21.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:21 smithi033 bash[42377]: cluster 2021-07-26T16:10:21.283978+0000 mon.a (mon.0) 1161 : cluster [DBG] osdmap e781: 8 total, 8 up, 8 in 2021-07-26T16:10:21.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:21 smithi033 bash[41341]: cluster 2021-07-26T16:10:20.321248+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e780: 8 total, 8 up, 8 in 2021-07-26T16:10:21.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:21 smithi033 bash[41341]: cluster 2021-07-26T16:10:21.283978+0000 mon.a (mon.0) 1161 : cluster [DBG] osdmap e781: 8 total, 8 up, 8 in 2021-07-26T16:10:21.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:21 smithi096 bash[33981]: cluster 2021-07-26T16:10:20.321248+0000 mon.a (mon.0) 1160 : cluster [DBG] osdmap e780: 8 total, 8 up, 8 in 2021-07-26T16:10:21.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:21 smithi096 bash[33981]: cluster 2021-07-26T16:10:21.283978+0000 mon.a (mon.0) 1161 : cluster [DBG] osdmap e781: 8 total, 8 up, 8 in 2021-07-26T16:10:22.298 INFO:tasks.rados.rados.0.smithi033.stdout:3668: done (0 left) 2021-07-26T16:10:22.298 INFO:tasks.rados.rados.0.smithi033.stdout:3669: delete oid 3 current snap is 363 2021-07-26T16:10:22.306 INFO:tasks.rados.rados.0.smithi033.stdout:3669: done (0 left) 2021-07-26T16:10:22.306 INFO:tasks.rados.rados.0.smithi033.stdout:3670: setattr oid 11 current snap is 363 2021-07-26T16:10:22.308 INFO:tasks.rados.rados.0.smithi033.stdout:3671: delete oid 10 current snap is 363 2021-07-26T16:10:22.316 INFO:tasks.rados.rados.0.smithi033.stdout:3671: done (1 left) 2021-07-26T16:10:22.316 INFO:tasks.rados.rados.0.smithi033.stdout:3672: read oid 13 snap -1 2021-07-26T16:10:22.316 INFO:tasks.rados.rados.0.smithi033.stdout:3672: expect (ObjNum 984 snap 327 seq_num 984) 2021-07-26T16:10:22.317 INFO:tasks.rados.rados.0.smithi033.stdout:3673: read oid 6 snap 358 2021-07-26T16:10:22.317 INFO:tasks.rados.rados.0.smithi033.stdout:3673: expect (ObjNum 824 snap 274 seq_num 824) 2021-07-26T16:10:22.317 INFO:tasks.rados.rados.0.smithi033.stdout:3674: setattr oid 46 current snap is 363 2021-07-26T16:10:22.320 INFO:tasks.rados.rados.0.smithi033.stdout:3675: delete oid 27 current snap is 363 2021-07-26T16:10:22.322 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1451 (ObjNum 1027 snap 341 seq_num 1027) dirty exists 2021-07-26T16:10:22.328 INFO:tasks.rados.rados.0.smithi033.stdout:3670: done (4 left) 2021-07-26T16:10:22.329 INFO:tasks.rados.rados.0.smithi033.stdout:3675: done (3 left) 2021-07-26T16:10:22.329 INFO:tasks.rados.rados.0.smithi033.stdout:3676: snap_remove snap 287 2021-07-26T16:10:22.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:22 smithi033 bash[41341]: cluster 2021-07-26T16:10:21.210798+0000 mgr.y (mgr.34104) 492 : cluster [DBG] pgmap v1003: 25 pgs: 25 active+clean; 800 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 4 op/s 2021-07-26T16:10:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:22 smithi033 bash[41341]: audit 2021-07-26T16:10:22.232362+0000 mon.c (mon.1) 273 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:10:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:22 smithi033 bash[41341]: audit 2021-07-26T16:10:22.235412+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:10:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:22 smithi033 bash[41341]: audit 2021-07-26T16:10:22.237476+0000 mon.c (mon.1) 275 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:10:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:22 smithi033 bash[41341]: cluster 2021-07-26T16:10:22.295385+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e782: 8 total, 8 up, 8 in 2021-07-26T16:10:22.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:22 smithi033 bash[42377]: cluster 2021-07-26T16:10:21.210798+0000 mgr.y (mgr.34104) 492 : cluster [DBG] pgmap v1003: 25 pgs: 25 active+clean; 800 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 4 op/s 2021-07-26T16:10:22.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:22 smithi033 bash[42377]: audit 2021-07-26T16:10:22.232362+0000 mon.c (mon.1) 273 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:10:22.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:22 smithi033 bash[42377]: audit 2021-07-26T16:10:22.235412+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:10:22.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:22 smithi033 bash[42377]: audit 2021-07-26T16:10:22.237476+0000 mon.c (mon.1) 275 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:10:22.711 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:22 smithi033 bash[42377]: cluster 2021-07-26T16:10:22.295385+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e782: 8 total, 8 up, 8 in 2021-07-26T16:10:22.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:22 smithi096 bash[33981]: cluster 2021-07-26T16:10:21.210798+0000 mgr.y (mgr.34104) 492 : cluster [DBG] pgmap v1003: 25 pgs: 25 active+clean; 800 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 3.5 MiB/s rd, 5.8 MiB/s wr, 4 op/s 2021-07-26T16:10:22.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:22 smithi096 bash[33981]: audit 2021-07-26T16:10:22.232362+0000 mon.c (mon.1) 273 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:10:22.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:22 smithi096 bash[33981]: audit 2021-07-26T16:10:22.235412+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:10:22.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:22 smithi096 bash[33981]: audit 2021-07-26T16:10:22.237476+0000 mon.c (mon.1) 275 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:10:22.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:22 smithi096 bash[33981]: cluster 2021-07-26T16:10:22.295385+0000 mon.a (mon.0) 1162 : cluster [DBG] osdmap e782: 8 total, 8 up, 8 in 2021-07-26T16:10:23.306 INFO:tasks.rados.rados.0.smithi033.stdout:3676: done (3 left) 2021-07-26T16:10:23.307 INFO:tasks.rados.rados.0.smithi033.stdout:3677: rollback oid 48 current snap is 363 2021-07-26T16:10:23.307 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 48 to 355 2021-07-26T16:10:23.307 INFO:tasks.rados.rados.0.smithi033.stdout:3678: rollback oid 49 current snap is 363 2021-07-26T16:10:23.307 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 49 to 350 2021-07-26T16:10:23.308 INFO:tasks.rados.rados.0.smithi033.stdout:3679: snap_create 2021-07-26T16:10:23.308 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1368 (ObjNum 1057 snap 348 seq_num 1057) dirty exists 2021-07-26T16:10:23.308 INFO:tasks.rados.rados.0.smithi033.stdout:3673: expect (ObjNum 824 snap 274 seq_num 824) 2021-07-26T16:10:23.588 INFO:tasks.rados.rados.0.smithi033.stdout:3672: expect (ObjNum 984 snap 327 seq_num 984) 2021-07-26T16:10:23.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:23 smithi033 bash[42377]: audit 2021-07-26T16:10:22.536891+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:10:23.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:23 smithi033 bash[42377]: cluster 2021-07-26T16:10:23.296433+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e783: 8 total, 8 up, 8 in 2021-07-26T16:10:23.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:23 smithi033 bash[41341]: audit 2021-07-26T16:10:22.536891+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:10:23.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:23 smithi033 bash[41341]: cluster 2021-07-26T16:10:23.296433+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e783: 8 total, 8 up, 8 in 2021-07-26T16:10:23.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:23 smithi096 bash[33981]: audit 2021-07-26T16:10:22.536891+0000 mon.a (mon.0) 1163 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:10:23.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:23 smithi096 bash[33981]: cluster 2021-07-26T16:10:23.296433+0000 mon.a (mon.0) 1164 : cluster [DBG] osdmap e783: 8 total, 8 up, 8 in 2021-07-26T16:10:24.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:24 smithi033 bash[41341]: cluster 2021-07-26T16:10:23.211546+0000 mgr.y (mgr.34104) 493 : cluster [DBG] pgmap v1006: 25 pgs: 25 active+clean; 806 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.3 MiB/s wr, 7 op/s 2021-07-26T16:10:24.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:24 smithi033 bash[41341]: cluster 2021-07-26T16:10:24.299108+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e784: 8 total, 8 up, 8 in 2021-07-26T16:10:24.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:24 smithi033 bash[42377]: cluster 2021-07-26T16:10:23.211546+0000 mgr.y (mgr.34104) 493 : cluster [DBG] pgmap v1006: 25 pgs: 25 active+clean; 806 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.3 MiB/s wr, 7 op/s 2021-07-26T16:10:24.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:24 smithi033 bash[42377]: cluster 2021-07-26T16:10:24.299108+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e784: 8 total, 8 up, 8 in 2021-07-26T16:10:24.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:24 smithi096 bash[33981]: cluster 2021-07-26T16:10:23.211546+0000 mgr.y (mgr.34104) 493 : cluster [DBG] pgmap v1006: 25 pgs: 25 active+clean; 806 MiB data, 3.4 GiB used, 712 GiB / 715 GiB avail; 7.0 MiB/s rd, 7.3 MiB/s wr, 7 op/s 2021-07-26T16:10:24.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:24 smithi096 bash[33981]: cluster 2021-07-26T16:10:24.299108+0000 mon.a (mon.0) 1165 : cluster [DBG] osdmap e784: 8 total, 8 up, 8 in 2021-07-26T16:10:26.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:26 smithi033 bash[41341]: cluster 2021-07-26T16:10:25.212208+0000 mgr.y (mgr.34104) 494 : cluster [DBG] pgmap v1009: 25 pgs: 25 active+clean; 806 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2021-07-26T16:10:26.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:26 smithi033 bash[41341]: cluster 2021-07-26T16:10:26.281432+0000 mon.a (mon.0) 1166 : cluster [DBG] osdmap e785: 8 total, 8 up, 8 in 2021-07-26T16:10:26.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:26 smithi033 bash[42377]: cluster 2021-07-26T16:10:25.212208+0000 mgr.y (mgr.34104) 494 : cluster [DBG] pgmap v1009: 25 pgs: 25 active+clean; 806 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2021-07-26T16:10:26.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:26 smithi033 bash[42377]: cluster 2021-07-26T16:10:26.281432+0000 mon.a (mon.0) 1166 : cluster [DBG] osdmap e785: 8 total, 8 up, 8 in 2021-07-26T16:10:26.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:26 smithi096 bash[33981]: cluster 2021-07-26T16:10:25.212208+0000 mgr.y (mgr.34104) 494 : cluster [DBG] pgmap v1009: 25 pgs: 25 active+clean; 806 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 13 op/s 2021-07-26T16:10:26.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:26 smithi096 bash[33981]: cluster 2021-07-26T16:10:26.281432+0000 mon.a (mon.0) 1166 : cluster [DBG] osdmap e785: 8 total, 8 up, 8 in 2021-07-26T16:10:27.158 INFO:tasks.rados.rados.0.smithi033.stdout:3677: finishing rollback tid 0 to smithi03339061-48 2021-07-26T16:10:27.158 INFO:tasks.rados.rados.0.smithi033.stdout:3677: finishing rollback tid 1 to smithi03339061-48 2021-07-26T16:10:27.159 INFO:tasks.rados.rados.0.smithi033.stdout:3677: finishing rollback tid 2 to smithi03339061-48 2021-07-26T16:10:27.159 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 2053 (ObjNum 1070 snap 350 seq_num 1070) dirty exists 2021-07-26T16:10:27.159 INFO:tasks.rados.rados.0.smithi033.stdout:3678: finishing rollback tid 0 to smithi03339061-49 2021-07-26T16:10:27.159 INFO:tasks.rados.rados.0.smithi033.stdout:3678: finishing rollback tid 1 to smithi03339061-49 2021-07-26T16:10:27.159 INFO:tasks.rados.rados.0.smithi033.stdout:3678: finishing rollback tid 2 to smithi03339061-49 2021-07-26T16:10:27.160 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 949 (ObjNum 1061 snap 349 seq_num 1061) dirty exists 2021-07-26T16:10:27.160 INFO:tasks.rados.rados.0.smithi033.stdout:3672: done (5 left) 2021-07-26T16:10:27.160 INFO:tasks.rados.rados.0.smithi033.stdout:3673: done (4 left) 2021-07-26T16:10:27.160 INFO:tasks.rados.rados.0.smithi033.stdout:3674: done (3 left) 2021-07-26T16:10:27.161 INFO:tasks.rados.rados.0.smithi033.stdout:3677: done (2 left) 2021-07-26T16:10:27.161 INFO:tasks.rados.rados.0.smithi033.stdout:3678: done (1 left) 2021-07-26T16:10:27.161 INFO:tasks.rados.rados.0.smithi033.stdout:3679: done (0 left) 2021-07-26T16:10:27.161 INFO:tasks.rados.rados.0.smithi033.stdout:3680: delete oid 21 current snap is 364 2021-07-26T16:10:27.163 INFO:tasks.rados.rados.0.smithi033.stdout:3680: done (0 left) 2021-07-26T16:10:27.164 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 33 current snap is 364 2021-07-26T16:10:27.164 INFO:tasks.rados.rados.0.smithi033.stdout:3681: seq_num 1092 ranges {10133504=696320,10829824=802816} 2021-07-26T16:10:27.222 INFO:tasks.rados.rados.0.smithi033.stdout:3681: writing smithi03339061-33 from 10133504 to 10829824 tid 1 2021-07-26T16:10:27.227 INFO:tasks.rados.rados.0.smithi033.stdout:3681: writing smithi03339061-33 from 10829824 to 11632640 tid 2 2021-07-26T16:10:27.227 INFO:tasks.rados.rados.0.smithi033.stdout:3682: read oid 43 snap -1 2021-07-26T16:10:27.227 INFO:tasks.rados.rados.0.smithi033.stdout:3682: expect (ObjNum 1059 snap 348 seq_num 1059) 2021-07-26T16:10:27.227 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 364 2021-07-26T16:10:27.228 INFO:tasks.rados.rados.0.smithi033.stdout:3683: seq_num 1093 ranges {1564672=712704,2277376=688128,2965504=114688} 2021-07-26T16:10:27.239 INFO:tasks.rados.rados.0.smithi033.stdout:3683: writing smithi03339061-46 from 1564672 to 2277376 tid 1 2021-07-26T16:10:27.243 INFO:tasks.rados.rados.0.smithi033.stdout:3683: writing smithi03339061-46 from 2277376 to 2965504 tid 2 2021-07-26T16:10:27.245 INFO:tasks.rados.rados.0.smithi033.stdout:3683: writing smithi03339061-46 from 2965504 to 3080192 tid 3 2021-07-26T16:10:27.245 INFO:tasks.rados.rados.0.smithi033.stdout:3684: read oid 34 snap -1 2021-07-26T16:10:27.246 INFO:tasks.rados.rados.0.smithi033.stdout:3684: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:10:27.246 INFO:tasks.rados.rados.0.smithi033.stdout:3681: finishing write tid 1 to smithi03339061-33 2021-07-26T16:10:27.246 INFO:tasks.rados.rados.0.smithi033.stdout:3685: read oid 26 snap 344 2021-07-26T16:10:27.246 INFO:tasks.rados.rados.0.smithi033.stdout:3685: expect (ObjNum 1033 snap 344 seq_num 1033) 2021-07-26T16:10:27.247 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 364 2021-07-26T16:10:27.247 INFO:tasks.rados.rados.0.smithi033.stdout:3681: finishing write tid 2 to smithi03339061-33 2021-07-26T16:10:27.247 INFO:tasks.rados.rados.0.smithi033.stdout:3681: finishing write tid 3 to smithi03339061-33 2021-07-26T16:10:27.247 INFO:tasks.rados.rados.0.smithi033.stdout:3681: finishing write tid 4 to smithi03339061-33 2021-07-26T16:10:27.247 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 2440 (ObjNum 1092 snap 364 seq_num 1092) dirty exists 2021-07-26T16:10:27.248 INFO:tasks.rados.rados.0.smithi033.stdout:3681: left oid 33 (ObjNum 1092 snap 364 seq_num 1092) 2021-07-26T16:10:27.248 INFO:tasks.rados.rados.0.smithi033.stdout:3686: seq_num 1094 ranges {4120576=729088,4849664=573440,5423104=229376} 2021-07-26T16:10:27.271 INFO:tasks.rados.rados.0.smithi033.stdout:3686: writing smithi03339061-14 from 4120576 to 4849664 tid 1 2021-07-26T16:10:27.274 INFO:tasks.rados.rados.0.smithi033.stdout:3686: writing smithi03339061-14 from 4849664 to 5423104 tid 2 2021-07-26T16:10:27.276 INFO:tasks.rados.rados.0.smithi033.stdout:3686: writing smithi03339061-14 from 5423104 to 5652480 tid 3 2021-07-26T16:10:27.276 INFO:tasks.rados.rados.0.smithi033.stdout:3681: done (5 left) 2021-07-26T16:10:27.276 INFO:tasks.rados.rados.0.smithi033.stdout:3687: copy_from oid 32 from oid 47 current snap is 364 2021-07-26T16:10:27.277 INFO:tasks.rados.rados.0.smithi033.stdout:3685: expect (ObjNum 1033 snap 344 seq_num 1033) 2021-07-26T16:10:27.305 INFO:tasks.rados.rados.0.smithi033.stdout:3685: done (5 left) 2021-07-26T16:10:27.305 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 28 current snap is 364 2021-07-26T16:10:27.305 INFO:tasks.rados.rados.0.smithi033.stdout:3683: finishing write tid 1 to smithi03339061-46 2021-07-26T16:10:27.306 INFO:tasks.rados.rados.0.smithi033.stdout:3688: seq_num 1095 ranges {4538368=745472,5283840=499712,5783552=303104} 2021-07-26T16:10:27.334 INFO:tasks.rados.rados.0.smithi033.stdout:3688: writing smithi03339061-28 from 4538368 to 5283840 tid 1 2021-07-26T16:10:27.337 INFO:tasks.rados.rados.0.smithi033.stdout:3688: writing smithi03339061-28 from 5283840 to 5783552 tid 2 2021-07-26T16:10:27.339 INFO:tasks.rados.rados.0.smithi033.stdout:3688: writing smithi03339061-28 from 5783552 to 6086656 tid 3 2021-07-26T16:10:27.339 INFO:tasks.rados.rados.0.smithi033.stdout:3689: delete oid 18 current snap is 364 2021-07-26T16:10:27.339 INFO:tasks.rados.rados.0.smithi033.stdout:3682: expect (ObjNum 1059 snap 348 seq_num 1059) 2021-07-26T16:10:27.586 INFO:tasks.rados.rados.0.smithi033.stdout:3683: finishing write tid 2 to smithi03339061-46 2021-07-26T16:10:27.586 INFO:tasks.rados.rados.0.smithi033.stdout:3683: finishing write tid 3 to smithi03339061-46 2021-07-26T16:10:27.586 INFO:tasks.rados.rados.0.smithi033.stdout:3683: finishing write tid 4 to smithi03339061-46 2021-07-26T16:10:27.586 INFO:tasks.rados.rados.0.smithi033.stdout:3683: finishing write tid 5 to smithi03339061-46 2021-07-26T16:10:27.587 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1372 (ObjNum 1093 snap 364 seq_num 1093) dirty exists 2021-07-26T16:10:27.587 INFO:tasks.rados.rados.0.smithi033.stdout:3683: left oid 46 (ObjNum 1093 snap 364 seq_num 1093) 2021-07-26T16:10:27.587 INFO:tasks.rados.rados.0.smithi033.stdout:3682: done (6 left) 2021-07-26T16:10:27.587 INFO:tasks.rados.rados.0.smithi033.stdout:3683: done (5 left) 2021-07-26T16:10:27.588 INFO:tasks.rados.rados.0.smithi033.stdout:3689: done (4 left) 2021-07-26T16:10:27.588 INFO:tasks.rados.rados.0.smithi033.stdout:3690: delete oid 49 current snap is 364 2021-07-26T16:10:27.588 INFO:tasks.rados.rados.0.smithi033.stdout:3686: finishing write tid 1 to smithi03339061-14 2021-07-26T16:10:27.588 INFO:tasks.rados.rados.0.smithi033.stdout:3686: finishing write tid 2 to smithi03339061-14 2021-07-26T16:10:27.589 INFO:tasks.rados.rados.0.smithi033.stdout:3686: finishing write tid 3 to smithi03339061-14 2021-07-26T16:10:27.589 INFO:tasks.rados.rados.0.smithi033.stdout:3686: finishing write tid 4 to smithi03339061-14 2021-07-26T16:10:27.589 INFO:tasks.rados.rados.0.smithi033.stdout:3684: expect (ObjNum 904 snap 302 seq_num 904) 2021-07-26T16:10:28.122 INFO:tasks.rados.rados.0.smithi033.stdout:3686: finishing write tid 5 to smithi03339061-14 2021-07-26T16:10:28.122 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 2069 (ObjNum 1094 snap 364 seq_num 1094) dirty exists 2021-07-26T16:10:28.122 INFO:tasks.rados.rados.0.smithi033.stdout:3686: left oid 14 (ObjNum 1094 snap 364 seq_num 1094) 2021-07-26T16:10:28.123 INFO:tasks.rados.rados.0.smithi033.stdout:3688: finishing write tid 1 to smithi03339061-28 2021-07-26T16:10:28.123 INFO:tasks.rados.rados.0.smithi033.stdout:3688: finishing write tid 2 to smithi03339061-28 2021-07-26T16:10:28.123 INFO:tasks.rados.rados.0.smithi033.stdout:3684: done (4 left) 2021-07-26T16:10:28.123 INFO:tasks.rados.rados.0.smithi033.stdout:3686: done (3 left) 2021-07-26T16:10:28.124 INFO:tasks.rados.rados.0.smithi033.stdout:3690: done (2 left) 2021-07-26T16:10:28.124 INFO:tasks.rados.rados.0.smithi033.stdout:3691: delete oid 40 current snap is 364 2021-07-26T16:10:28.124 INFO:tasks.rados.rados.0.smithi033.stdout:3688: finishing write tid 3 to smithi03339061-28 2021-07-26T16:10:28.124 INFO:tasks.rados.rados.0.smithi033.stdout:3688: finishing write tid 4 to smithi03339061-28 2021-07-26T16:10:28.124 INFO:tasks.rados.rados.0.smithi033.stdout:3688: finishing write tid 5 to smithi03339061-28 2021-07-26T16:10:28.125 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 1854 (ObjNum 1095 snap 364 seq_num 1095) dirty exists 2021-07-26T16:10:28.125 INFO:tasks.rados.rados.0.smithi033.stdout:3688: left oid 28 (ObjNum 1095 snap 364 seq_num 1095) 2021-07-26T16:10:28.125 INFO:tasks.rados.rados.0.smithi033.stdout:3687: finishing copy_from to smithi03339061-32 2021-07-26T16:10:28.125 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 1892 (ObjNum 1055 snap 347 seq_num 1055) dirty exists 2021-07-26T16:10:28.126 INFO:tasks.rados.rados.0.smithi033.stdout:3687: finishing copy_from racing read to smithi03339061-32 2021-07-26T16:10:28.126 INFO:tasks.rados.rados.0.smithi033.stdout:3687: done (2 left) 2021-07-26T16:10:28.127 INFO:tasks.rados.rados.0.smithi033.stdout:3688: done (1 left) 2021-07-26T16:10:28.127 INFO:tasks.rados.rados.0.smithi033.stdout:3691: done (0 left) 2021-07-26T16:10:28.127 INFO:tasks.rados.rados.0.smithi033.stdout:3692: read oid 29 snap 361 2021-07-26T16:10:28.127 INFO:tasks.rados.rados.0.smithi033.stdout:3692: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:10:28.128 INFO:tasks.rados.rados.0.smithi033.stdout:3693: delete oid 50 current snap is 364 2021-07-26T16:10:28.131 INFO:tasks.rados.rados.0.smithi033.stdout:3693: done (1 left) 2021-07-26T16:10:28.132 INFO:tasks.rados.rados.0.smithi033.stdout:3694: snap_create 2021-07-26T16:10:28.144 INFO:tasks.rados.rados.0.smithi033.stdout:3692: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:10:28.567 INFO:tasks.rados.rados.0.smithi033.stdout:3692: done (1 left) 2021-07-26T16:10:28.568 INFO:tasks.rados.rados.0.smithi033.stdout:3694: done (0 left) 2021-07-26T16:10:28.568 INFO:tasks.rados.rados.0.smithi033.stdout:3695: rmattr oid 32 current snap is 365 2021-07-26T16:10:28.568 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 365 2021-07-26T16:10:28.568 INFO:tasks.rados.rados.0.smithi033.stdout:3696: seq_num 1100 ranges {0=425984,425984=729088,1155072=475136} 2021-07-26T16:10:28.573 INFO:tasks.rados.rados.0.smithi033.stdout:3696: writing smithi03339061-9 from 0 to 425984 tid 1 2021-07-26T16:10:28.579 INFO:tasks.rados.rados.0.smithi033.stdout:3696: writing smithi03339061-9 from 425984 to 1155072 tid 2 2021-07-26T16:10:28.581 INFO:tasks.rados.rados.0.smithi033.stdout:3696: writing smithi03339061-9 from 1155072 to 1630208 tid 3 2021-07-26T16:10:28.582 INFO:tasks.rados.rados.0.smithi033.stdout:3697: read oid 27 snap -1 2021-07-26T16:10:28.582 INFO:tasks.rados.rados.0.smithi033.stdout:3697: expect deleted 2021-07-26T16:10:28.582 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 365 2021-07-26T16:10:28.582 INFO:tasks.rados.rados.0.smithi033.stdout:3698: seq_num 1101 ranges {14303232=442368,14745600=606208,15351808=598016} 2021-07-26T16:10:28.663 INFO:tasks.rados.rados.0.smithi033.stdout:3698: writing smithi03339061-12 from 14303232 to 14745600 tid 1 2021-07-26T16:10:28.666 INFO:tasks.rados.rados.0.smithi033.stdout:3698: writing smithi03339061-12 from 14745600 to 15351808 tid 2 2021-07-26T16:10:28.669 INFO:tasks.rados.rados.0.smithi033.stdout:3698: writing smithi03339061-12 from 15351808 to 15949824 tid 3 2021-07-26T16:10:28.670 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 365 2021-07-26T16:10:28.670 INFO:tasks.rados.rados.0.smithi033.stdout:3696: finishing write tid 1 to smithi03339061-9 2021-07-26T16:10:28.670 INFO:tasks.rados.rados.0.smithi033.stdout:3699: seq_num 1102 ranges {0=458752,458752=491520,950272=491520,1441792=221184} 2021-07-26T16:10:28.672 INFO:tasks.rados.rados.0.smithi033.stdout:3699: writing smithi03339061-15 from 0 to 458752 tid 1 2021-07-26T16:10:28.675 INFO:tasks.rados.rados.0.smithi033.stdout:3699: writing smithi03339061-15 from 458752 to 950272 tid 2 2021-07-26T16:10:28.678 INFO:tasks.rados.rados.0.smithi033.stdout:3699: writing smithi03339061-15 from 950272 to 1441792 tid 3 2021-07-26T16:10:28.680 INFO:tasks.rados.rados.0.smithi033.stdout:3699: writing smithi03339061-15 from 1441792 to 1662976 tid 4 2021-07-26T16:10:28.680 INFO:tasks.rados.rados.0.smithi033.stdout:3700: setattr oid 35 current snap is 365 2021-07-26T16:10:28.680 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 2056 (ObjNum 1055 snap 347 seq_num 1055) dirty exists 2021-07-26T16:10:28.681 INFO:tasks.rados.rados.0.smithi033.stdout:3696: finishing write tid 2 to smithi03339061-9 2021-07-26T16:10:28.681 INFO:tasks.rados.rados.0.smithi033.stdout:3696: finishing write tid 3 to smithi03339061-9 2021-07-26T16:10:28.681 INFO:tasks.rados.rados.0.smithi033.stdout:3696: finishing write tid 4 to smithi03339061-9 2021-07-26T16:10:28.681 INFO:tasks.rados.rados.0.smithi033.stdout:3696: finishing write tid 5 to smithi03339061-9 2021-07-26T16:10:28.682 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 1842 (ObjNum 1100 snap 365 seq_num 1100) dirty exists 2021-07-26T16:10:28.682 INFO:tasks.rados.rados.0.smithi033.stdout:3696: left oid 9 (ObjNum 1100 snap 365 seq_num 1100) 2021-07-26T16:10:28.682 INFO:tasks.rados.rados.0.smithi033.stdout:3698: finishing write tid 1 to smithi03339061-12 2021-07-26T16:10:28.684 INFO:tasks.rados.rados.0.smithi033.stdout:3699: finishing write tid 1 to smithi03339061-15 2021-07-26T16:10:28.684 INFO:tasks.rados.rados.0.smithi033.stdout:3698: finishing write tid 2 to smithi03339061-12 2021-07-26T16:10:28.684 INFO:tasks.rados.rados.0.smithi033.stdout:3698: finishing write tid 3 to smithi03339061-12 2021-07-26T16:10:28.685 INFO:tasks.rados.rados.0.smithi033.stdout:3695: done (5 left) 2021-07-26T16:10:28.685 INFO:tasks.rados.rados.0.smithi033.stdout:3696: done (4 left) 2021-07-26T16:10:28.686 INFO:tasks.rados.rados.0.smithi033.stdout:3697: done (3 left) 2021-07-26T16:10:28.686 INFO:tasks.rados.rados.0.smithi033.stdout:3701: rmattr oid 4 current snap is 365 2021-07-26T16:10:28.686 INFO:tasks.rados.rados.0.smithi033.stdout:3702: snap_remove snap 355 2021-07-26T16:10:28.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:28 smithi033 bash[41341]: cluster 2021-07-26T16:10:27.212861+0000 mgr.y (mgr.34104) 495 : cluster [DBG] pgmap v1011: 25 pgs: 25 active+clean; 806 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 712 KiB/s wr, 11 op/s 2021-07-26T16:10:28.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:28 smithi033 bash[42377]: cluster 2021-07-26T16:10:27.212861+0000 mgr.y (mgr.34104) 495 : cluster [DBG] pgmap v1011: 25 pgs: 25 active+clean; 806 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 712 KiB/s wr, 11 op/s 2021-07-26T16:10:28.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:28 smithi096 bash[33981]: cluster 2021-07-26T16:10:27.212861+0000 mgr.y (mgr.34104) 495 : cluster [DBG] pgmap v1011: 25 pgs: 25 active+clean; 806 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 15 MiB/s rd, 712 KiB/s wr, 11 op/s 2021-07-26T16:10:29.584 INFO:tasks.rados.rados.0.smithi033.stdout:3702: done (4 left) 2021-07-26T16:10:29.584 INFO:tasks.rados.rados.0.smithi033.stdout:3703: read oid 23 snap -1 2021-07-26T16:10:29.585 INFO:tasks.rados.rados.0.smithi033.stdout:3703: expect deleted 2021-07-26T16:10:29.586 INFO:tasks.rados.rados.0.smithi033.stdout:3704: copy_from oid 43 from oid 39 current snap is 365 2021-07-26T16:10:29.586 INFO:tasks.rados.rados.0.smithi033.stdout:3705: snap_create 2021-07-26T16:10:29.586 INFO:tasks.rados.rados.0.smithi033.stdout:3699: finishing write tid 2 to smithi03339061-15 2021-07-26T16:10:29.587 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 2070 (ObjNum 1080 snap 355 seq_num 1080) dirty exists 2021-07-26T16:10:29.587 INFO:tasks.rados.rados.0.smithi033.stdout:3698: finishing write tid 4 to smithi03339061-12 2021-07-26T16:10:29.587 INFO:tasks.rados.rados.0.smithi033.stdout:3699: finishing write tid 3 to smithi03339061-15 2021-07-26T16:10:29.588 INFO:tasks.rados.rados.0.smithi033.stdout:3699: finishing write tid 4 to smithi03339061-15 2021-07-26T16:10:29.588 INFO:tasks.rados.rados.0.smithi033.stdout:3698: finishing write tid 5 to smithi03339061-12 2021-07-26T16:10:29.588 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 1858 (ObjNum 1101 snap 365 seq_num 1101) dirty exists 2021-07-26T16:10:29.588 INFO:tasks.rados.rados.0.smithi033.stdout:3698: left oid 12 (ObjNum 1101 snap 365 seq_num 1101) 2021-07-26T16:10:29.588 INFO:tasks.rados.rados.0.smithi033.stdout:3699: finishing write tid 5 to smithi03339061-15 2021-07-26T16:10:29.589 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1843 (ObjNum 1087 snap 360 seq_num 1087) dirty exists 2021-07-26T16:10:29.589 INFO:tasks.rados.rados.0.smithi033.stdout:3699: finishing write tid 6 to smithi03339061-15 2021-07-26T16:10:29.589 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 955 (ObjNum 1102 snap 365 seq_num 1102) dirty exists 2021-07-26T16:10:29.589 INFO:tasks.rados.rados.0.smithi033.stdout:3699: left oid 15 (ObjNum 1102 snap 365 seq_num 1102) 2021-07-26T16:10:29.611 INFO:tasks.rados.rados.0.smithi033.stdout:3704: finishing copy_from to smithi03339061-43 2021-07-26T16:10:29.612 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 1897 (ObjNum 1074 snap 352 seq_num 1074) dirty exists 2021-07-26T16:10:29.612 INFO:tasks.rados.rados.0.smithi033.stdout:3704: finishing copy_from racing read to smithi03339061-43 2021-07-26T16:10:29.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:29 smithi033 bash[41341]: cluster 2021-07-26T16:10:28.563019+0000 mon.a (mon.0) 1167 : cluster [DBG] osdmap e786: 8 total, 8 up, 8 in 2021-07-26T16:10:29.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:29 smithi033 bash[42377]: cluster 2021-07-26T16:10:28.563019+0000 mon.a (mon.0) 1167 : cluster [DBG] osdmap e786: 8 total, 8 up, 8 in 2021-07-26T16:10:29.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:29 smithi096 bash[33981]: cluster 2021-07-26T16:10:28.563019+0000 mon.a (mon.0) 1167 : cluster [DBG] osdmap e786: 8 total, 8 up, 8 in 2021-07-26T16:10:30.592 INFO:tasks.rados.rados.0.smithi033.stdout:3698: done (6 left) 2021-07-26T16:10:30.592 INFO:tasks.rados.rados.0.smithi033.stdout:3699: done (5 left) 2021-07-26T16:10:30.593 INFO:tasks.rados.rados.0.smithi033.stdout:3700: done (4 left) 2021-07-26T16:10:30.593 INFO:tasks.rados.rados.0.smithi033.stdout:3701: done (3 left) 2021-07-26T16:10:30.593 INFO:tasks.rados.rados.0.smithi033.stdout:3703: done (2 left) 2021-07-26T16:10:30.593 INFO:tasks.rados.rados.0.smithi033.stdout:3704: done (1 left) 2021-07-26T16:10:30.594 INFO:tasks.rados.rados.0.smithi033.stdout:3705: done (0 left) 2021-07-26T16:10:30.594 INFO:tasks.rados.rados.0.smithi033.stdout:3706: snap_create 2021-07-26T16:10:30.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:30 smithi033 bash[41341]: cluster 2021-07-26T16:10:29.213549+0000 mgr.y (mgr.34104) 496 : cluster [DBG] pgmap v1013: 25 pgs: 25 active+clean; 807 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 247 KiB/s wr, 10 op/s 2021-07-26T16:10:30.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:30 smithi033 bash[41341]: cluster 2021-07-26T16:10:29.580629+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e787: 8 total, 8 up, 8 in 2021-07-26T16:10:30.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:30 smithi033 bash[42377]: cluster 2021-07-26T16:10:29.213549+0000 mgr.y (mgr.34104) 496 : cluster [DBG] pgmap v1013: 25 pgs: 25 active+clean; 807 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 247 KiB/s wr, 10 op/s 2021-07-26T16:10:30.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:30 smithi033 bash[42377]: cluster 2021-07-26T16:10:29.580629+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e787: 8 total, 8 up, 8 in 2021-07-26T16:10:30.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:30 smithi096 bash[33981]: cluster 2021-07-26T16:10:29.213549+0000 mgr.y (mgr.34104) 496 : cluster [DBG] pgmap v1013: 25 pgs: 25 active+clean; 807 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 11 MiB/s rd, 247 KiB/s wr, 10 op/s 2021-07-26T16:10:30.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:30 smithi096 bash[33981]: cluster 2021-07-26T16:10:29.580629+0000 mon.a (mon.0) 1168 : cluster [DBG] osdmap e787: 8 total, 8 up, 8 in 2021-07-26T16:10:31.287 INFO:tasks.rados.rados.0.smithi033.stdout:3706: done (0 left) 2021-07-26T16:10:31.288 INFO:tasks.rados.rados.0.smithi033.stdout:3707: delete oid 11 current snap is 367 2021-07-26T16:10:31.295 INFO:tasks.rados.rados.0.smithi033.stdout:3707: done (0 left) 2021-07-26T16:10:31.296 INFO:tasks.rados.rados.0.smithi033.stdout:3708: setattr oid 50 current snap is 367 2021-07-26T16:10:31.298 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 367 2021-07-26T16:10:31.299 INFO:tasks.rados.rados.0.smithi033.stdout:3709: seq_num 1104 ranges {0=499712,499712=712704,1212416=491520} 2021-07-26T16:10:31.302 INFO:tasks.rados.rados.0.smithi033.stdout:3709: writing smithi03339061-23 from 0 to 499712 tid 1 2021-07-26T16:10:31.308 INFO:tasks.rados.rados.0.smithi033.stdout:3709: writing smithi03339061-23 from 499712 to 1212416 tid 2 2021-07-26T16:10:31.311 INFO:tasks.rados.rados.0.smithi033.stdout:3709: writing smithi03339061-23 from 1212416 to 1703936 tid 3 2021-07-26T16:10:31.312 INFO:tasks.rados.rados.0.smithi033.stdout:3710: snap_remove snap 360 2021-07-26T16:10:31.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:31 smithi033 bash[41341]: cluster 2021-07-26T16:10:30.589543+0000 mon.a (mon.0) 1169 : cluster [DBG] osdmap e788: 8 total, 8 up, 8 in 2021-07-26T16:10:31.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:31 smithi033 bash[41341]: cluster 2021-07-26T16:10:31.283922+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e789: 8 total, 8 up, 8 in 2021-07-26T16:10:31.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:31 smithi033 bash[42377]: cluster 2021-07-26T16:10:30.589543+0000 mon.a (mon.0) 1169 : cluster [DBG] osdmap e788: 8 total, 8 up, 8 in 2021-07-26T16:10:31.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:31 smithi033 bash[42377]: cluster 2021-07-26T16:10:31.283922+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e789: 8 total, 8 up, 8 in 2021-07-26T16:10:31.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:31 smithi096 bash[33981]: cluster 2021-07-26T16:10:30.589543+0000 mon.a (mon.0) 1169 : cluster [DBG] osdmap e788: 8 total, 8 up, 8 in 2021-07-26T16:10:31.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:31 smithi096 bash[33981]: cluster 2021-07-26T16:10:31.283922+0000 mon.a (mon.0) 1170 : cluster [DBG] osdmap e789: 8 total, 8 up, 8 in 2021-07-26T16:10:32.304 INFO:tasks.rados.rados.0.smithi033.stdout:3710: done (2 left) 2021-07-26T16:10:32.305 INFO:tasks.rados.rados.0.smithi033.stdout:3711: copy_from oid 30 from oid 29 current snap is 367 2021-07-26T16:10:32.305 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 2057 (ObjNum 1 snap 22002 seq_num 2006676640) dirty exists 2021-07-26T16:10:32.305 INFO:tasks.rados.rados.0.smithi033.stdout:3709: finishing write tid 1 to smithi03339061-23 2021-07-26T16:10:32.305 INFO:tasks.rados.rados.0.smithi033.stdout:3709: finishing write tid 2 to smithi03339061-23 2021-07-26T16:10:32.305 INFO:tasks.rados.rados.0.smithi033.stdout:3709: finishing write tid 3 to smithi03339061-23 2021-07-26T16:10:32.306 INFO:tasks.rados.rados.0.smithi033.stdout:3709: finishing write tid 4 to smithi03339061-23 2021-07-26T16:10:32.306 INFO:tasks.rados.rados.0.smithi033.stdout:3709: finishing write tid 5 to smithi03339061-23 2021-07-26T16:10:32.306 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1973 (ObjNum 1104 snap 367 seq_num 1104) dirty exists 2021-07-26T16:10:32.306 INFO:tasks.rados.rados.0.smithi033.stdout:3709: left oid 23 (ObjNum 1104 snap 367 seq_num 1104) 2021-07-26T16:10:32.307 INFO:tasks.rados.rados.0.smithi033.stdout:3708: done (2 left) 2021-07-26T16:10:32.307 INFO:tasks.rados.rados.0.smithi033.stdout:3709: done (1 left) 2021-07-26T16:10:32.307 INFO:tasks.rados.rados.0.smithi033.stdout:3712: rollback oid 3 current snap is 367 2021-07-26T16:10:32.307 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 3 to 363 2021-07-26T16:10:32.308 INFO:tasks.rados.rados.0.smithi033.stdout:3713: rollback oid 32 current snap is 367 2021-07-26T16:10:32.308 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 32 to 354 2021-07-26T16:10:32.308 INFO:tasks.rados.rados.0.smithi033.stdout:3714: delete oid 25 current snap is 367 2021-07-26T16:10:32.315 INFO:tasks.rados.rados.0.smithi033.stdout:3712: finishing rollback tid 1 to smithi03339061-3 2021-07-26T16:10:32.315 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1830 (ObjNum 1 snap 32561 seq_num 2007132320) dirty dne 2021-07-26T16:10:32.318 INFO:tasks.rados.rados.0.smithi033.stdout:3713: finishing rollback tid 0 to smithi03339061-32 2021-07-26T16:10:32.323 INFO:tasks.rados.rados.0.smithi033.stdout:3713: finishing rollback tid 1 to smithi03339061-32 2021-07-26T16:10:32.323 INFO:tasks.rados.rados.0.smithi033.stdout:3713: finishing rollback tid 2 to smithi03339061-32 2021-07-26T16:10:32.323 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 2060 (ObjNum 989 snap 328 seq_num 989) dirty exists 2021-07-26T16:10:32.324 INFO:tasks.rados.rados.0.smithi033.stdout:3712: done (3 left) 2021-07-26T16:10:32.324 INFO:tasks.rados.rados.0.smithi033.stdout:3713: done (2 left) 2021-07-26T16:10:32.324 INFO:tasks.rados.rados.0.smithi033.stdout:3714: done (1 left) 2021-07-26T16:10:32.325 INFO:tasks.rados.rados.0.smithi033.stdout:3715: copy_from oid 28 from oid 32 current snap is 367 2021-07-26T16:10:32.325 INFO:tasks.rados.rados.0.smithi033.stdout:3716: snap_create 2021-07-26T16:10:32.333 INFO:tasks.rados.rados.0.smithi033.stdout:3711: finishing copy_from to smithi03339061-30 2021-07-26T16:10:32.334 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 1367 (ObjNum 890 snap 292 seq_num 890) dirty exists 2021-07-26T16:10:32.335 INFO:tasks.rados.rados.0.smithi033.stdout:3711: finishing copy_from racing read to smithi03339061-30 2021-07-26T16:10:32.345 INFO:tasks.rados.rados.0.smithi033.stdout:3715: finishing copy_from to smithi03339061-28 2021-07-26T16:10:32.345 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 2060 (ObjNum 989 snap 328 seq_num 989) dirty exists 2021-07-26T16:10:32.346 INFO:tasks.rados.rados.0.smithi033.stdout:3715: finishing copy_from racing read to smithi03339061-28 2021-07-26T16:10:32.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:32 smithi033 bash[41341]: cluster 2021-07-26T16:10:31.214323+0000 mgr.y (mgr.34104) 497 : cluster [DBG] pgmap v1016: 25 pgs: 25 active+clean; 816 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.9 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2021-07-26T16:10:32.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:32 smithi033 bash[41341]: cluster 2021-07-26T16:10:32.300099+0000 mon.a (mon.0) 1171 : cluster [DBG] osdmap e790: 8 total, 8 up, 8 in 2021-07-26T16:10:32.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:32 smithi033 bash[42377]: cluster 2021-07-26T16:10:31.214323+0000 mgr.y (mgr.34104) 497 : cluster [DBG] pgmap v1016: 25 pgs: 25 active+clean; 816 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.9 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2021-07-26T16:10:32.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:32 smithi033 bash[42377]: cluster 2021-07-26T16:10:32.300099+0000 mon.a (mon.0) 1171 : cluster [DBG] osdmap e790: 8 total, 8 up, 8 in 2021-07-26T16:10:32.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:32 smithi096 bash[33981]: cluster 2021-07-26T16:10:31.214323+0000 mgr.y (mgr.34104) 497 : cluster [DBG] pgmap v1016: 25 pgs: 25 active+clean; 816 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 9.9 MiB/s rd, 2.1 MiB/s wr, 17 op/s 2021-07-26T16:10:32.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:32 smithi096 bash[33981]: cluster 2021-07-26T16:10:32.300099+0000 mon.a (mon.0) 1171 : cluster [DBG] osdmap e790: 8 total, 8 up, 8 in 2021-07-26T16:10:33.303 INFO:tasks.rados.rados.0.smithi033.stdout:3711: done (2 left) 2021-07-26T16:10:33.303 INFO:tasks.rados.rados.0.smithi033.stdout:3715: done (1 left) 2021-07-26T16:10:33.304 INFO:tasks.rados.rados.0.smithi033.stdout:3716: done (0 left) 2021-07-26T16:10:33.304 INFO:tasks.rados.rados.0.smithi033.stdout:3717: snap_remove snap 364 2021-07-26T16:10:34.312 INFO:tasks.rados.rados.0.smithi033.stdout:3717: done (0 left) 2021-07-26T16:10:34.312 INFO:tasks.rados.rados.0.smithi033.stdout:3718: copy_from oid 46 from oid 5 current snap is 368 2021-07-26T16:10:34.313 INFO:tasks.rados.rados.0.smithi033.stdout:3719: read oid 32 snap -1 2021-07-26T16:10:34.313 INFO:tasks.rados.rados.0.smithi033.stdout:3719: expect (ObjNum 989 snap 328 seq_num 989) 2021-07-26T16:10:34.313 INFO:tasks.rados.rados.0.smithi033.stdout:3720: copy_from oid 49 from oid 27 current snap is 368 2021-07-26T16:10:34.313 INFO:tasks.rados.rados.0.smithi033.stdout:3721: snap_create 2021-07-26T16:10:34.323 INFO:tasks.rados.rados.0.smithi033.stdout:3720: finishing copy_from to smithi03339061-49 2021-07-26T16:10:34.323 INFO:tasks.rados.rados.0.smithi033.stdout:3720: got expected ENOENT (src dne) 2021-07-26T16:10:34.323 INFO:tasks.rados.rados.0.smithi033.stdout:3720: finishing copy_from racing read to smithi03339061-49 2021-07-26T16:10:34.331 INFO:tasks.rados.rados.0.smithi033.stdout:3719: expect (ObjNum 989 snap 328 seq_num 989) 2021-07-26T16:10:34.414 INFO:tasks.rados.rados.0.smithi033.stdout:3718: finishing copy_from to smithi03339061-46 2021-07-26T16:10:34.414 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1859 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2021-07-26T16:10:34.415 INFO:tasks.rados.rados.0.smithi033.stdout:3718: finishing copy_from racing read to smithi03339061-46 2021-07-26T16:10:34.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:34 smithi033 bash[41341]: cluster 2021-07-26T16:10:33.215076+0000 mgr.y (mgr.34104) 498 : cluster [DBG] pgmap v1019: 25 pgs: 25 active+clean; 839 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 7.9 MiB/s wr, 29 op/s 2021-07-26T16:10:34.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:34 smithi033 bash[41341]: cluster 2021-07-26T16:10:33.300528+0000 mon.a (mon.0) 1172 : cluster [DBG] osdmap e791: 8 total, 8 up, 8 in 2021-07-26T16:10:34.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:34 smithi033 bash[42377]: cluster 2021-07-26T16:10:33.215076+0000 mgr.y (mgr.34104) 498 : cluster [DBG] pgmap v1019: 25 pgs: 25 active+clean; 839 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 7.9 MiB/s wr, 29 op/s 2021-07-26T16:10:34.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:34 smithi033 bash[42377]: cluster 2021-07-26T16:10:33.300528+0000 mon.a (mon.0) 1172 : cluster [DBG] osdmap e791: 8 total, 8 up, 8 in 2021-07-26T16:10:34.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:34 smithi096 bash[33981]: cluster 2021-07-26T16:10:33.215076+0000 mgr.y (mgr.34104) 498 : cluster [DBG] pgmap v1019: 25 pgs: 25 active+clean; 839 MiB data, 3.5 GiB used, 712 GiB / 715 GiB avail; 12 MiB/s rd, 7.9 MiB/s wr, 29 op/s 2021-07-26T16:10:34.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:34 smithi096 bash[33981]: cluster 2021-07-26T16:10:33.300528+0000 mon.a (mon.0) 1172 : cluster [DBG] osdmap e791: 8 total, 8 up, 8 in 2021-07-26T16:10:35.315 INFO:tasks.rados.rados.0.smithi033.stdout:3718: done (3 left) 2021-07-26T16:10:35.316 INFO:tasks.rados.rados.0.smithi033.stdout:3719: done (2 left) 2021-07-26T16:10:35.316 INFO:tasks.rados.rados.0.smithi033.stdout:3720: done (1 left) 2021-07-26T16:10:35.316 INFO:tasks.rados.rados.0.smithi033.stdout:3721: done (0 left) 2021-07-26T16:10:35.316 INFO:tasks.rados.rados.0.smithi033.stdout:3722: snap_remove snap 366 2021-07-26T16:10:35.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:35 smithi033 bash[41341]: cluster 2021-07-26T16:10:34.307215+0000 mon.a (mon.0) 1173 : cluster [DBG] osdmap e792: 8 total, 8 up, 8 in 2021-07-26T16:10:35.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:35 smithi033 bash[42377]: cluster 2021-07-26T16:10:34.307215+0000 mon.a (mon.0) 1173 : cluster [DBG] osdmap e792: 8 total, 8 up, 8 in 2021-07-26T16:10:35.733 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:35 smithi096 bash[33981]: cluster 2021-07-26T16:10:34.307215+0000 mon.a (mon.0) 1173 : cluster [DBG] osdmap e792: 8 total, 8 up, 8 in 2021-07-26T16:10:36.290 INFO:tasks.rados.rados.0.smithi033.stdout:3722: done (0 left) 2021-07-26T16:10:36.290 INFO:tasks.rados.rados.0.smithi033.stdout:3723: setattr oid 15 current snap is 369 2021-07-26T16:10:36.291 INFO:tasks.rados.rados.0.smithi033.stdout:3724: snap_create 2021-07-26T16:10:36.303 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 956 (ObjNum 1102 snap 365 seq_num 1102) dirty exists 2021-07-26T16:10:36.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:36 smithi033 bash[41341]: cluster 2021-07-26T16:10:35.215799+0000 mgr.y (mgr.34104) 499 : cluster [DBG] pgmap v1022: 25 pgs: 25 active+clean; 846 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 7.4 MiB/s wr, 13 op/s 2021-07-26T16:10:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:36 smithi033 bash[41341]: cluster 2021-07-26T16:10:35.312205+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e793: 8 total, 8 up, 8 in 2021-07-26T16:10:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:36 smithi033 bash[41341]: cluster 2021-07-26T16:10:36.286049+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e794: 8 total, 8 up, 8 in 2021-07-26T16:10:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:36 smithi033 bash[42377]: cluster 2021-07-26T16:10:35.215799+0000 mgr.y (mgr.34104) 499 : cluster [DBG] pgmap v1022: 25 pgs: 25 active+clean; 846 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 7.4 MiB/s wr, 13 op/s 2021-07-26T16:10:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:36 smithi033 bash[42377]: cluster 2021-07-26T16:10:35.312205+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e793: 8 total, 8 up, 8 in 2021-07-26T16:10:36.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:36 smithi033 bash[42377]: cluster 2021-07-26T16:10:36.286049+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e794: 8 total, 8 up, 8 in 2021-07-26T16:10:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:36 smithi096 bash[33981]: cluster 2021-07-26T16:10:35.215799+0000 mgr.y (mgr.34104) 499 : cluster [DBG] pgmap v1022: 25 pgs: 25 active+clean; 846 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 255 B/s rd, 7.4 MiB/s wr, 13 op/s 2021-07-26T16:10:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:36 smithi096 bash[33981]: cluster 2021-07-26T16:10:35.312205+0000 mon.a (mon.0) 1174 : cluster [DBG] osdmap e793: 8 total, 8 up, 8 in 2021-07-26T16:10:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:36 smithi096 bash[33981]: cluster 2021-07-26T16:10:36.286049+0000 mon.a (mon.0) 1175 : cluster [DBG] osdmap e794: 8 total, 8 up, 8 in 2021-07-26T16:10:37.301 INFO:tasks.rados.rados.0.smithi033.stdout:3723: done (1 left) 2021-07-26T16:10:37.301 INFO:tasks.rados.rados.0.smithi033.stdout:3724: done (0 left) 2021-07-26T16:10:37.302 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 370 2021-07-26T16:10:37.302 INFO:tasks.rados.rados.0.smithi033.stdout:3725: seq_num 1106 ranges {18890752=532480,19423232=483328,19906560=475136,20381696=245760} 2021-07-26T16:10:37.413 INFO:tasks.rados.rados.0.smithi033.stdout:3725: writing smithi03339061-47 from 18890752 to 19423232 tid 1 2021-07-26T16:10:37.416 INFO:tasks.rados.rados.0.smithi033.stdout:3725: writing smithi03339061-47 from 19423232 to 19906560 tid 2 2021-07-26T16:10:37.419 INFO:tasks.rados.rados.0.smithi033.stdout:3725: writing smithi03339061-47 from 19906560 to 20381696 tid 3 2021-07-26T16:10:37.421 INFO:tasks.rados.rados.0.smithi033.stdout:3725: writing smithi03339061-47 from 20381696 to 20627456 tid 4 2021-07-26T16:10:37.421 INFO:tasks.rados.rados.0.smithi033.stdout:3726: read oid 14 snap -1 2021-07-26T16:10:37.422 INFO:tasks.rados.rados.0.smithi033.stdout:3726: expect (ObjNum 1094 snap 364 seq_num 1094) 2021-07-26T16:10:37.422 INFO:tasks.rados.rados.0.smithi033.stdout:3727: copy_from oid 31 from oid 46 current snap is 370 2021-07-26T16:10:37.422 INFO:tasks.rados.rados.0.smithi033.stdout:3728: copy_from oid 10 from oid 18 current snap is 370 2021-07-26T16:10:37.422 INFO:tasks.rados.rados.0.smithi033.stdout:3729: delete oid 39 current snap is 370 2021-07-26T16:10:37.431 INFO:tasks.rados.rados.0.smithi033.stdout:3729: done (4 left) 2021-07-26T16:10:37.431 INFO:tasks.rados.rados.0.smithi033.stdout:3730: snap_remove snap 346 2021-07-26T16:10:38.333 INFO:tasks.rados.rados.0.smithi033.stdout:3730: done (4 left) 2021-07-26T16:10:38.333 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 32 current snap is 370 2021-07-26T16:10:38.334 INFO:tasks.rados.rados.0.smithi033.stdout:3725: finishing write tid 1 to smithi03339061-47 2021-07-26T16:10:38.334 INFO:tasks.rados.rados.0.smithi033.stdout:3731: seq_num 1108 ranges {2711552=565248,3276800=647168,3923968=483328,4407296=73728} 2021-07-26T16:10:38.354 INFO:tasks.rados.rados.0.smithi033.stdout:3731: writing smithi03339061-32 from 2711552 to 3276800 tid 1 2021-07-26T16:10:38.359 INFO:tasks.rados.rados.0.smithi033.stdout:3731: writing smithi03339061-32 from 3276800 to 3923968 tid 2 2021-07-26T16:10:38.362 INFO:tasks.rados.rados.0.smithi033.stdout:3731: writing smithi03339061-32 from 3923968 to 4407296 tid 3 2021-07-26T16:10:38.364 INFO:tasks.rados.rados.0.smithi033.stdout:3731: writing smithi03339061-32 from 4407296 to 4481024 tid 4 2021-07-26T16:10:38.364 INFO:tasks.rados.rados.0.smithi033.stdout:3732: delete oid 17 current snap is 370 2021-07-26T16:10:38.364 INFO:tasks.rados.rados.0.smithi033.stdout:3728: finishing copy_from to smithi03339061-10 2021-07-26T16:10:38.364 INFO:tasks.rados.rados.0.smithi033.stdout:3728: got expected ENOENT (src dne) 2021-07-26T16:10:38.365 INFO:tasks.rados.rados.0.smithi033.stdout:3728: finishing copy_from racing read to smithi03339061-10 2021-07-26T16:10:38.365 INFO:tasks.rados.rados.0.smithi033.stdout:3725: finishing write tid 2 to smithi03339061-47 2021-07-26T16:10:38.365 INFO:tasks.rados.rados.0.smithi033.stdout:3725: finishing write tid 3 to smithi03339061-47 2021-07-26T16:10:38.365 INFO:tasks.rados.rados.0.smithi033.stdout:3725: finishing write tid 4 to smithi03339061-47 2021-07-26T16:10:38.365 INFO:tasks.rados.rados.0.smithi033.stdout:3725: finishing write tid 5 to smithi03339061-47 2021-07-26T16:10:38.366 INFO:tasks.rados.rados.0.smithi033.stdout:3725: finishing write tid 6 to smithi03339061-47 2021-07-26T16:10:38.366 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 2035 (ObjNum 1106 snap 370 seq_num 1106) dirty exists 2021-07-26T16:10:38.366 INFO:tasks.rados.rados.0.smithi033.stdout:3725: left oid 47 (ObjNum 1106 snap 370 seq_num 1106) 2021-07-26T16:10:38.366 INFO:tasks.rados.rados.0.smithi033.stdout:3726: expect (ObjNum 1094 snap 364 seq_num 1094) 2021-07-26T16:10:38.671 INFO:tasks.rados.rados.0.smithi033.stdout:3727: finishing copy_from to smithi03339061-31 2021-07-26T16:10:38.672 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1859 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2021-07-26T16:10:38.672 INFO:tasks.rados.rados.0.smithi033.stdout:3727: finishing copy_from racing read to smithi03339061-31 2021-07-26T16:10:38.672 INFO:tasks.rados.rados.0.smithi033.stdout:3725: done (5 left) 2021-07-26T16:10:38.672 INFO:tasks.rados.rados.0.smithi033.stdout:3726: done (4 left) 2021-07-26T16:10:38.673 INFO:tasks.rados.rados.0.smithi033.stdout:3727: done (3 left) 2021-07-26T16:10:38.673 INFO:tasks.rados.rados.0.smithi033.stdout:3728: done (2 left) 2021-07-26T16:10:38.673 INFO:tasks.rados.rados.0.smithi033.stdout:3732: done (1 left) 2021-07-26T16:10:38.673 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 370 2021-07-26T16:10:38.674 INFO:tasks.rados.rados.0.smithi033.stdout:3731: finishing write tid 1 to smithi03339061-32 2021-07-26T16:10:38.674 INFO:tasks.rados.rados.0.smithi033.stdout:3731: finishing write tid 2 to smithi03339061-32 2021-07-26T16:10:38.674 INFO:tasks.rados.rados.0.smithi033.stdout:3731: finishing write tid 3 to smithi03339061-32 2021-07-26T16:10:38.674 INFO:tasks.rados.rados.0.smithi033.stdout:3731: finishing write tid 4 to smithi03339061-32 2021-07-26T16:10:38.675 INFO:tasks.rados.rados.0.smithi033.stdout:3731: finishing write tid 5 to smithi03339061-32 2021-07-26T16:10:38.675 INFO:tasks.rados.rados.0.smithi033.stdout:3731: finishing write tid 6 to smithi03339061-32 2021-07-26T16:10:38.675 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 32 v 2066 (ObjNum 1108 snap 370 seq_num 1108) dirty exists 2021-07-26T16:10:38.675 INFO:tasks.rados.rados.0.smithi033.stdout:3731: left oid 32 (ObjNum 1108 snap 370 seq_num 1108) 2021-07-26T16:10:38.676 INFO:tasks.rados.rados.0.smithi033.stdout:3733: seq_num 1110 ranges {0=598016,598016=466944,1064960=450560,1515520=286720} 2021-07-26T16:10:38.679 INFO:tasks.rados.rados.0.smithi033.stdout:3733: writing smithi03339061-21 from 0 to 598016 tid 1 2021-07-26T16:10:38.683 INFO:tasks.rados.rados.0.smithi033.stdout:3733: writing smithi03339061-21 from 598016 to 1064960 tid 2 2021-07-26T16:10:38.687 INFO:tasks.rados.rados.0.smithi033.stdout:3733: writing smithi03339061-21 from 1064960 to 1515520 tid 3 2021-07-26T16:10:38.690 INFO:tasks.rados.rados.0.smithi033.stdout:3733: writing smithi03339061-21 from 1515520 to 1802240 tid 4 2021-07-26T16:10:38.690 INFO:tasks.rados.rados.0.smithi033.stdout:3731: done (1 left) 2021-07-26T16:10:38.690 INFO:tasks.rados.rados.0.smithi033.stdout:3734: copy_from oid 30 from oid 11 current snap is 370 2021-07-26T16:10:38.691 INFO:tasks.rados.rados.0.smithi033.stdout:3733: finishing write tid 1 to smithi03339061-21 2021-07-26T16:10:38.691 INFO:tasks.rados.rados.0.smithi033.stdout:3733: finishing write tid 2 to smithi03339061-21 2021-07-26T16:10:38.691 INFO:tasks.rados.rados.0.smithi033.stdout:3735: read oid 45 snap -1 2021-07-26T16:10:38.691 INFO:tasks.rados.rados.0.smithi033.stdout:3735: expect (ObjNum 806 snap 268 seq_num 806) 2021-07-26T16:10:38.692 INFO:tasks.rados.rados.0.smithi033.stdout:3736: setattr oid 42 current snap is 370 2021-07-26T16:10:38.693 INFO:tasks.rados.rados.0.smithi033.stdout:3734: finishing copy_from to smithi03339061-30 2021-07-26T16:10:38.693 INFO:tasks.rados.rados.0.smithi033.stdout:3734: got expected ENOENT (src dne) 2021-07-26T16:10:38.693 INFO:tasks.rados.rados.0.smithi033.stdout:3737: read oid 25 snap -1 2021-07-26T16:10:38.694 INFO:tasks.rados.rados.0.smithi033.stdout:3737: expect deleted 2021-07-26T16:10:38.694 INFO:tasks.rados.rados.0.smithi033.stdout:3738: snap_create 2021-07-26T16:10:38.695 INFO:tasks.rados.rados.0.smithi033.stdout:3734: finishing copy_from racing read to smithi03339061-30 2021-07-26T16:10:38.695 INFO:tasks.rados.rados.0.smithi033.stdout:3733: finishing write tid 3 to smithi03339061-21 2021-07-26T16:10:38.697 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1831 (ObjNum 2006924368 snap 22002 seq_num 2022518960) dirty exists 2021-07-26T16:10:38.698 INFO:tasks.rados.rados.0.smithi033.stdout:3733: finishing write tid 4 to smithi03339061-21 2021-07-26T16:10:38.698 INFO:tasks.rados.rados.0.smithi033.stdout:3733: finishing write tid 5 to smithi03339061-21 2021-07-26T16:10:38.701 INFO:tasks.rados.rados.0.smithi033.stdout:3733: finishing write tid 6 to smithi03339061-21 2021-07-26T16:10:38.701 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 1990 (ObjNum 1110 snap 370 seq_num 1110) dirty exists 2021-07-26T16:10:38.701 INFO:tasks.rados.rados.0.smithi033.stdout:3733: left oid 21 (ObjNum 1110 snap 370 seq_num 1110) 2021-07-26T16:10:38.702 INFO:tasks.rados.rados.0.smithi033.stdout:3735: expect (ObjNum 806 snap 268 seq_num 806) 2021-07-26T16:10:38.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:38 smithi033 bash[41341]: cluster 2021-07-26T16:10:37.216481+0000 mgr.y (mgr.34104) 500 : cluster [DBG] pgmap v1025: 25 pgs: 25 active+clean; 848 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 3 op/s 2021-07-26T16:10:38.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:38 smithi033 bash[41341]: cluster 2021-07-26T16:10:37.298002+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e795: 8 total, 8 up, 8 in 2021-07-26T16:10:38.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:38 smithi033 bash[42377]: cluster 2021-07-26T16:10:37.216481+0000 mgr.y (mgr.34104) 500 : cluster [DBG] pgmap v1025: 25 pgs: 25 active+clean; 848 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 3 op/s 2021-07-26T16:10:38.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:38 smithi033 bash[42377]: cluster 2021-07-26T16:10:37.298002+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e795: 8 total, 8 up, 8 in 2021-07-26T16:10:38.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:38 smithi096 bash[33981]: cluster 2021-07-26T16:10:37.216481+0000 mgr.y (mgr.34104) 500 : cluster [DBG] pgmap v1025: 25 pgs: 25 active+clean; 848 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 1.8 MiB/s wr, 3 op/s 2021-07-26T16:10:38.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:38 smithi096 bash[33981]: cluster 2021-07-26T16:10:37.298002+0000 mon.a (mon.0) 1176 : cluster [DBG] osdmap e795: 8 total, 8 up, 8 in 2021-07-26T16:10:39.345 INFO:tasks.rados.rados.0.smithi033.stdout:3733: done (5 left) 2021-07-26T16:10:39.345 INFO:tasks.rados.rados.0.smithi033.stdout:3734: done (4 left) 2021-07-26T16:10:39.345 INFO:tasks.rados.rados.0.smithi033.stdout:3735: done (3 left) 2021-07-26T16:10:39.346 INFO:tasks.rados.rados.0.smithi033.stdout:3736: done (2 left) 2021-07-26T16:10:39.346 INFO:tasks.rados.rados.0.smithi033.stdout:3737: done (1 left) 2021-07-26T16:10:39.346 INFO:tasks.rados.rados.0.smithi033.stdout:3738: done (0 left) 2021-07-26T16:10:39.346 INFO:tasks.rados.rados.0.smithi033.stdout:3739: copy_from oid 14 from oid 41 current snap is 371 2021-07-26T16:10:39.346 INFO:tasks.rados.rados.0.smithi033.stdout:3740: read oid 6 snap -1 2021-07-26T16:10:39.347 INFO:tasks.rados.rados.0.smithi033.stdout:3740: expect (ObjNum 824 snap 274 seq_num 824) 2021-07-26T16:10:39.347 INFO:tasks.rados.rados.0.smithi033.stdout:3741: read oid 29 snap -1 2021-07-26T16:10:39.347 INFO:tasks.rados.rados.0.smithi033.stdout:3741: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:10:39.347 INFO:tasks.rados.rados.0.smithi033.stdout:3742: snap_remove snap 367 2021-07-26T16:10:39.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:39 smithi033 bash[41341]: cluster 2021-07-26T16:10:38.326578+0000 mon.a (mon.0) 1177 : cluster [DBG] osdmap e796: 8 total, 8 up, 8 in 2021-07-26T16:10:39.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:39 smithi033 bash[42377]: cluster 2021-07-26T16:10:38.326578+0000 mon.a (mon.0) 1177 : cluster [DBG] osdmap e796: 8 total, 8 up, 8 in 2021-07-26T16:10:39.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:39 smithi096 bash[33981]: cluster 2021-07-26T16:10:38.326578+0000 mon.a (mon.0) 1177 : cluster [DBG] osdmap e796: 8 total, 8 up, 8 in 2021-07-26T16:10:40.349 INFO:tasks.rados.rados.0.smithi033.stdout:3742: done (3 left) 2021-07-26T16:10:40.350 INFO:tasks.rados.rados.0.smithi033.stdout:3743: rmattr oid 46 current snap is 371 2021-07-26T16:10:40.350 INFO:tasks.rados.rados.0.smithi033.stdout:3744: read oid 1 snap -1 2021-07-26T16:10:40.350 INFO:tasks.rados.rados.0.smithi033.stdout:3744: expect (ObjNum 1066 snap 349 seq_num 1066) 2021-07-26T16:10:40.350 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 371 2021-07-26T16:10:40.351 INFO:tasks.rados.rados.0.smithi033.stdout:3745: seq_num 1111 ranges {2719744=614400,3334144=753664,4087808=450560} 2021-07-26T16:10:40.370 INFO:tasks.rados.rados.0.smithi033.stdout:3745: writing smithi03339061-38 from 2719744 to 3334144 tid 1 2021-07-26T16:10:40.375 INFO:tasks.rados.rados.0.smithi033.stdout:3745: writing smithi03339061-38 from 3334144 to 4087808 tid 2 2021-07-26T16:10:40.378 INFO:tasks.rados.rados.0.smithi033.stdout:3745: writing smithi03339061-38 from 4087808 to 4538368 tid 3 2021-07-26T16:10:40.378 INFO:tasks.rados.rados.0.smithi033.stdout:3746: snap_remove snap 368 2021-07-26T16:10:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:40 smithi033 bash[41341]: cluster 2021-07-26T16:10:39.217181+0000 mgr.y (mgr.34104) 501 : cluster [DBG] pgmap v1028: 25 pgs: 25 active+clean; 850 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 424 KiB/s wr, 3 op/s 2021-07-26T16:10:40.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:40 smithi033 bash[41341]: cluster 2021-07-26T16:10:39.341995+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e797: 8 total, 8 up, 8 in 2021-07-26T16:10:40.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:40 smithi033 bash[42377]: cluster 2021-07-26T16:10:39.217181+0000 mgr.y (mgr.34104) 501 : cluster [DBG] pgmap v1028: 25 pgs: 25 active+clean; 850 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 424 KiB/s wr, 3 op/s 2021-07-26T16:10:40.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:40 smithi033 bash[42377]: cluster 2021-07-26T16:10:39.341995+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e797: 8 total, 8 up, 8 in 2021-07-26T16:10:40.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:40 smithi096 bash[33981]: cluster 2021-07-26T16:10:39.217181+0000 mgr.y (mgr.34104) 501 : cluster [DBG] pgmap v1028: 25 pgs: 25 active+clean; 850 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 1.9 MiB/s rd, 424 KiB/s wr, 3 op/s 2021-07-26T16:10:40.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:40 smithi096 bash[33981]: cluster 2021-07-26T16:10:39.341995+0000 mon.a (mon.0) 1178 : cluster [DBG] osdmap e797: 8 total, 8 up, 8 in 2021-07-26T16:10:41.292 INFO:tasks.rados.rados.0.smithi033.stdout:3746: done (6 left) 2021-07-26T16:10:41.292 INFO:tasks.rados.rados.0.smithi033.stdout:3747: snap_create 2021-07-26T16:10:41.293 INFO:tasks.rados.rados.0.smithi033.stdout:3741: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:10:41.466 INFO:tasks.rados.rados.0.smithi033.stdout:3740: expect (ObjNum 824 snap 274 seq_num 824) 2021-07-26T16:10:41.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:41 smithi033 bash[41341]: cluster 2021-07-26T16:10:40.346787+0000 mon.a (mon.0) 1179 : cluster [DBG] osdmap e798: 8 total, 8 up, 8 in 2021-07-26T16:10:41.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:41 smithi033 bash[41341]: cluster 2021-07-26T16:10:41.288842+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e799: 8 total, 8 up, 8 in 2021-07-26T16:10:41.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:41 smithi033 bash[42377]: cluster 2021-07-26T16:10:40.346787+0000 mon.a (mon.0) 1179 : cluster [DBG] osdmap e798: 8 total, 8 up, 8 in 2021-07-26T16:10:41.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:41 smithi033 bash[42377]: cluster 2021-07-26T16:10:41.288842+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e799: 8 total, 8 up, 8 in 2021-07-26T16:10:41.730 INFO:tasks.rados.rados.0.smithi033.stdout:3739: finishing copy_from to smithi03339061-14 2021-07-26T16:10:41.730 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 1863 (ObjNum 984 snap 327 seq_num 984) dirty exists 2021-07-26T16:10:41.730 INFO:tasks.rados.rados.0.smithi033.stdout:3739: finishing copy_from racing read to smithi03339061-14 2021-07-26T16:10:41.731 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1860 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2021-07-26T16:10:41.731 INFO:tasks.rados.rados.0.smithi033.stdout:3745: finishing write tid 1 to smithi03339061-38 2021-07-26T16:10:41.731 INFO:tasks.rados.rados.0.smithi033.stdout:3745: finishing write tid 2 to smithi03339061-38 2021-07-26T16:10:41.731 INFO:tasks.rados.rados.0.smithi033.stdout:3745: finishing write tid 3 to smithi03339061-38 2021-07-26T16:10:41.732 INFO:tasks.rados.rados.0.smithi033.stdout:3745: finishing write tid 4 to smithi03339061-38 2021-07-26T16:10:41.732 INFO:tasks.rados.rados.0.smithi033.stdout:3745: finishing write tid 5 to smithi03339061-38 2021-07-26T16:10:41.732 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 747 (ObjNum 1111 snap 371 seq_num 1111) dirty exists 2021-07-26T16:10:41.732 INFO:tasks.rados.rados.0.smithi033.stdout:3745: left oid 38 (ObjNum 1111 snap 371 seq_num 1111) 2021-07-26T16:10:41.732 INFO:tasks.rados.rados.0.smithi033.stdout:3744: expect (ObjNum 1066 snap 349 seq_num 1066) 2021-07-26T16:10:41.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:41 smithi096 bash[33981]: cluster 2021-07-26T16:10:40.346787+0000 mon.a (mon.0) 1179 : cluster [DBG] osdmap e798: 8 total, 8 up, 8 in 2021-07-26T16:10:41.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:41 smithi096 bash[33981]: cluster 2021-07-26T16:10:41.288842+0000 mon.a (mon.0) 1180 : cluster [DBG] osdmap e799: 8 total, 8 up, 8 in 2021-07-26T16:10:42.296 INFO:tasks.rados.rados.0.smithi033.stdout:3739: done (6 left) 2021-07-26T16:10:42.296 INFO:tasks.rados.rados.0.smithi033.stdout:3740: done (5 left) 2021-07-26T16:10:42.297 INFO:tasks.rados.rados.0.smithi033.stdout:3741: done (4 left) 2021-07-26T16:10:42.297 INFO:tasks.rados.rados.0.smithi033.stdout:3743: done (3 left) 2021-07-26T16:10:42.297 INFO:tasks.rados.rados.0.smithi033.stdout:3744: done (2 left) 2021-07-26T16:10:42.297 INFO:tasks.rados.rados.0.smithi033.stdout:3745: done (1 left) 2021-07-26T16:10:42.298 INFO:tasks.rados.rados.0.smithi033.stdout:3747: done (0 left) 2021-07-26T16:10:42.298 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 42 current snap is 372 2021-07-26T16:10:42.298 INFO:tasks.rados.rados.0.smithi033.stdout:3748: seq_num 1112 ranges {0=630784,630784=638976,1269760=466944,1736704=98304} 2021-07-26T16:10:42.301 INFO:tasks.rados.rados.0.smithi033.stdout:3748: writing smithi03339061-42 from 0 to 630784 tid 1 2021-07-26T16:10:42.306 INFO:tasks.rados.rados.0.smithi033.stdout:3748: writing smithi03339061-42 from 630784 to 1269760 tid 2 2021-07-26T16:10:42.308 INFO:tasks.rados.rados.0.smithi033.stdout:3748: writing smithi03339061-42 from 1269760 to 1736704 tid 3 2021-07-26T16:10:42.310 INFO:tasks.rados.rados.0.smithi033.stdout:3748: writing smithi03339061-42 from 1736704 to 1835008 tid 4 2021-07-26T16:10:42.310 INFO:tasks.rados.rados.0.smithi033.stdout:3749: copy_from oid 28 from oid 50 current snap is 372 2021-07-26T16:10:42.310 INFO:tasks.rados.rados.0.smithi033.stdout:3750: read oid 41 snap -1 2021-07-26T16:10:42.310 INFO:tasks.rados.rados.0.smithi033.stdout:3750: expect (ObjNum 984 snap 327 seq_num 984) 2021-07-26T16:10:42.311 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 372 2021-07-26T16:10:42.311 INFO:tasks.rados.rados.0.smithi033.stdout:3751: seq_num 1113 ranges {1703936=647168,2351104=524288,2875392=622592,3497984=57344} 2021-07-26T16:10:42.323 INFO:tasks.rados.rados.0.smithi033.stdout:3751: writing smithi03339061-23 from 1703936 to 2351104 tid 1 2021-07-26T16:10:42.327 INFO:tasks.rados.rados.0.smithi033.stdout:3751: writing smithi03339061-23 from 2351104 to 2875392 tid 2 2021-07-26T16:10:42.331 INFO:tasks.rados.rados.0.smithi033.stdout:3751: writing smithi03339061-23 from 2875392 to 3497984 tid 3 2021-07-26T16:10:42.331 INFO:tasks.rados.rados.0.smithi033.stdout:3751: writing smithi03339061-23 from 3497984 to 3555328 tid 4 2021-07-26T16:10:42.332 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 3 current snap is 372 2021-07-26T16:10:42.332 INFO:tasks.rados.rados.0.smithi033.stdout:3748: finishing write tid 1 to smithi03339061-42 2021-07-26T16:10:42.332 INFO:tasks.rados.rados.0.smithi033.stdout:3752: seq_num 1114 ranges {0=663552,663552=802816,1466368=401408} 2021-07-26T16:10:42.336 INFO:tasks.rados.rados.0.smithi033.stdout:3752: writing smithi03339061-3 from 0 to 663552 tid 1 2021-07-26T16:10:42.340 INFO:tasks.rados.rados.0.smithi033.stdout:3752: writing smithi03339061-3 from 663552 to 1466368 tid 2 2021-07-26T16:10:42.342 INFO:tasks.rados.rados.0.smithi033.stdout:3752: writing smithi03339061-3 from 1466368 to 1867776 tid 3 2021-07-26T16:10:42.343 INFO:tasks.rados.rados.0.smithi033.stdout:3753: snap_remove snap 330 2021-07-26T16:10:42.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:42 smithi033 bash[41341]: cluster 2021-07-26T16:10:41.217970+0000 mgr.y (mgr.34104) 502 : cluster [DBG] pgmap v1031: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 874 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.4 MiB/s wr, 9 op/s 2021-07-26T16:10:42.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:42 smithi033 bash[41341]: cluster 2021-07-26T16:10:42.289666+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e800: 8 total, 8 up, 8 in 2021-07-26T16:10:42.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:42 smithi033 bash[42377]: cluster 2021-07-26T16:10:41.217970+0000 mgr.y (mgr.34104) 502 : cluster [DBG] pgmap v1031: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 874 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.4 MiB/s wr, 9 op/s 2021-07-26T16:10:42.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:42 smithi033 bash[42377]: cluster 2021-07-26T16:10:42.289666+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e800: 8 total, 8 up, 8 in 2021-07-26T16:10:42.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:42 smithi096 bash[33981]: cluster 2021-07-26T16:10:41.217970+0000 mgr.y (mgr.34104) 502 : cluster [DBG] pgmap v1031: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 874 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 6.2 MiB/s rd, 6.4 MiB/s wr, 9 op/s 2021-07-26T16:10:42.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:42 smithi096 bash[33981]: cluster 2021-07-26T16:10:42.289666+0000 mon.a (mon.0) 1181 : cluster [DBG] osdmap e800: 8 total, 8 up, 8 in 2021-07-26T16:10:43.299 INFO:tasks.rados.rados.0.smithi033.stdout:3753: done (5 left) 2021-07-26T16:10:43.299 INFO:tasks.rados.rados.0.smithi033.stdout:3754: rollback oid 29 current snap is 372 2021-07-26T16:10:43.300 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 29 to 348 2021-07-26T16:10:43.301 INFO:tasks.rados.rados.0.smithi033.stdout:3748: finishing write tid 2 to smithi03339061-42 2021-07-26T16:10:43.301 INFO:tasks.rados.rados.0.smithi033.stdout:3748: finishing write tid 3 to smithi03339061-42 2021-07-26T16:10:43.301 INFO:tasks.rados.rados.0.smithi033.stdout:3748: finishing write tid 4 to smithi03339061-42 2021-07-26T16:10:43.301 INFO:tasks.rados.rados.0.smithi033.stdout:3748: finishing write tid 5 to smithi03339061-42 2021-07-26T16:10:43.302 INFO:tasks.rados.rados.0.smithi033.stdout:3748: finishing write tid 6 to smithi03339061-42 2021-07-26T16:10:43.302 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1836 (ObjNum 1112 snap 372 seq_num 1112) dirty exists 2021-07-26T16:10:43.302 INFO:tasks.rados.rados.0.smithi033.stdout:3748: left oid 42 (ObjNum 1112 snap 372 seq_num 1112) 2021-07-26T16:10:43.302 INFO:tasks.rados.rados.0.smithi033.stdout:3752: finishing write tid 1 to smithi03339061-3 2021-07-26T16:10:43.303 INFO:tasks.rados.rados.0.smithi033.stdout:3751: finishing write tid 1 to smithi03339061-23 2021-07-26T16:10:43.303 INFO:tasks.rados.rados.0.smithi033.stdout:3752: finishing write tid 2 to smithi03339061-3 2021-07-26T16:10:43.304 INFO:tasks.rados.rados.0.smithi033.stdout:3751: finishing write tid 2 to smithi03339061-23 2021-07-26T16:10:43.304 INFO:tasks.rados.rados.0.smithi033.stdout:3752: finishing write tid 3 to smithi03339061-3 2021-07-26T16:10:43.305 INFO:tasks.rados.rados.0.smithi033.stdout:3752: finishing write tid 4 to smithi03339061-3 2021-07-26T16:10:43.305 INFO:tasks.rados.rados.0.smithi033.stdout:3749: finishing copy_from to smithi03339061-28 2021-07-26T16:10:43.305 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 28 v 2057 (ObjNum 0 snap 32561 seq_num 2006803104) dirty exists 2021-07-26T16:10:43.306 INFO:tasks.rados.rados.0.smithi033.stdout:3749: finishing copy_from racing read to smithi03339061-28 2021-07-26T16:10:43.306 INFO:tasks.rados.rados.0.smithi033.stdout:3752: finishing write tid 5 to smithi03339061-3 2021-07-26T16:10:43.306 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1840 (ObjNum 1114 snap 372 seq_num 1114) dirty exists 2021-07-26T16:10:43.307 INFO:tasks.rados.rados.0.smithi033.stdout:3752: left oid 3 (ObjNum 1114 snap 372 seq_num 1114) 2021-07-26T16:10:43.307 INFO:tasks.rados.rados.0.smithi033.stdout:3751: finishing write tid 3 to smithi03339061-23 2021-07-26T16:10:43.308 INFO:tasks.rados.rados.0.smithi033.stdout:3751: finishing write tid 4 to smithi03339061-23 2021-07-26T16:10:43.308 INFO:tasks.rados.rados.0.smithi033.stdout:3751: finishing write tid 5 to smithi03339061-23 2021-07-26T16:10:43.308 INFO:tasks.rados.rados.0.smithi033.stdout:3751: finishing write tid 6 to smithi03339061-23 2021-07-26T16:10:43.308 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 2000 (ObjNum 1113 snap 372 seq_num 1113) dirty exists 2021-07-26T16:10:43.309 INFO:tasks.rados.rados.0.smithi033.stdout:3751: left oid 23 (ObjNum 1113 snap 372 seq_num 1113) 2021-07-26T16:10:43.309 INFO:tasks.rados.rados.0.smithi033.stdout:3750: expect (ObjNum 984 snap 327 seq_num 984) 2021-07-26T16:10:44.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:44 smithi033 bash[41341]: cluster 2021-07-26T16:10:43.218703+0000 mgr.y (mgr.34104) 503 : cluster [DBG] pgmap v1034: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 881 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 7.7 MiB/s wr, 22 op/s 2021-07-26T16:10:44.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:44 smithi033 bash[41341]: cluster 2021-07-26T16:10:43.293903+0000 mon.a (mon.0) 1182 : cluster [DBG] osdmap e801: 8 total, 8 up, 8 in 2021-07-26T16:10:44.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:44 smithi033 bash[42377]: cluster 2021-07-26T16:10:43.218703+0000 mgr.y (mgr.34104) 503 : cluster [DBG] pgmap v1034: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 881 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 7.7 MiB/s wr, 22 op/s 2021-07-26T16:10:44.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:44 smithi033 bash[42377]: cluster 2021-07-26T16:10:43.293903+0000 mon.a (mon.0) 1182 : cluster [DBG] osdmap e801: 8 total, 8 up, 8 in 2021-07-26T16:10:44.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:44 smithi096 bash[33981]: cluster 2021-07-26T16:10:43.218703+0000 mgr.y (mgr.34104) 503 : cluster [DBG] pgmap v1034: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 881 MiB data, 3.6 GiB used, 712 GiB / 715 GiB avail; 17 MiB/s rd, 7.7 MiB/s wr, 22 op/s 2021-07-26T16:10:44.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:44 smithi096 bash[33981]: cluster 2021-07-26T16:10:43.293903+0000 mon.a (mon.0) 1182 : cluster [DBG] osdmap e801: 8 total, 8 up, 8 in 2021-07-26T16:10:46.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:46 smithi033 bash[41341]: cluster 2021-07-26T16:10:45.219422+0000 mgr.y (mgr.34104) 504 : cluster [DBG] pgmap v1036: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 880 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 5.6 MiB/s wr, 20 op/s 2021-07-26T16:10:46.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:46 smithi033 bash[41341]: cluster 2021-07-26T16:10:46.289158+0000 mon.a (mon.0) 1183 : cluster [DBG] osdmap e802: 8 total, 8 up, 8 in 2021-07-26T16:10:46.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:46 smithi033 bash[42377]: cluster 2021-07-26T16:10:45.219422+0000 mgr.y (mgr.34104) 504 : cluster [DBG] pgmap v1036: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 880 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 5.6 MiB/s wr, 20 op/s 2021-07-26T16:10:46.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:46 smithi033 bash[42377]: cluster 2021-07-26T16:10:46.289158+0000 mon.a (mon.0) 1183 : cluster [DBG] osdmap e802: 8 total, 8 up, 8 in 2021-07-26T16:10:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:46 smithi096 bash[33981]: cluster 2021-07-26T16:10:45.219422+0000 mgr.y (mgr.34104) 504 : cluster [DBG] pgmap v1036: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 880 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 25 MiB/s rd, 5.6 MiB/s wr, 20 op/s 2021-07-26T16:10:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:46 smithi096 bash[33981]: cluster 2021-07-26T16:10:46.289158+0000 mon.a (mon.0) 1183 : cluster [DBG] osdmap e802: 8 total, 8 up, 8 in 2021-07-26T16:10:46.880 INFO:tasks.rados.rados.0.smithi033.stdout:3754: finishing rollback tid 0 to smithi03339061-29 2021-07-26T16:10:46.880 INFO:tasks.rados.rados.0.smithi033.stdout:3754: finishing rollback tid 1 to smithi03339061-29 2021-07-26T16:10:46.881 INFO:tasks.rados.rados.0.smithi033.stdout:3754: finishing rollback tid 2 to smithi03339061-29 2021-07-26T16:10:46.881 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1863 (ObjNum 1060 snap 348 seq_num 1060) dirty exists 2021-07-26T16:10:46.881 INFO:tasks.rados.rados.0.smithi033.stdout:3748: done (5 left) 2021-07-26T16:10:46.881 INFO:tasks.rados.rados.0.smithi033.stdout:3749: done (4 left) 2021-07-26T16:10:46.882 INFO:tasks.rados.rados.0.smithi033.stdout:3750: done (3 left) 2021-07-26T16:10:46.882 INFO:tasks.rados.rados.0.smithi033.stdout:3751: done (2 left) 2021-07-26T16:10:46.882 INFO:tasks.rados.rados.0.smithi033.stdout:3752: done (1 left) 2021-07-26T16:10:46.882 INFO:tasks.rados.rados.0.smithi033.stdout:3754: done (0 left) 2021-07-26T16:10:46.882 INFO:tasks.rados.rados.0.smithi033.stdout:3755: read oid 11 snap -1 2021-07-26T16:10:46.883 INFO:tasks.rados.rados.0.smithi033.stdout:3755: expect deleted 2021-07-26T16:10:46.883 INFO:tasks.rados.rados.0.smithi033.stdout:3756: delete oid 3 current snap is 372 2021-07-26T16:10:46.884 INFO:tasks.rados.rados.0.smithi033.stdout:3755: done (1 left) 2021-07-26T16:10:46.884 INFO:tasks.rados.rados.0.smithi033.stdout:3756: done (0 left) 2021-07-26T16:10:46.885 INFO:tasks.rados.rados.0.smithi033.stdout:3757: setattr oid 29 current snap is 372 2021-07-26T16:10:46.889 INFO:tasks.rados.rados.0.smithi033.stdout:3758: snap_create 2021-07-26T16:10:46.897 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 29 v 1864 (ObjNum 1060 snap 348 seq_num 1060) dirty exists 2021-07-26T16:10:47.315 INFO:tasks.rados.rados.0.smithi033.stdout:3757: done (1 left) 2021-07-26T16:10:47.316 INFO:tasks.rados.rados.0.smithi033.stdout:3758: done (0 left) 2021-07-26T16:10:47.316 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 373 2021-07-26T16:10:47.316 INFO:tasks.rados.rados.0.smithi033.stdout:3759: seq_num 1116 ranges {21372928=696320,22069248=573440,22642688=450560,23093248=180224} 2021-07-26T16:10:47.444 INFO:tasks.rados.rados.0.smithi033.stdout:3759: writing smithi03339061-13 from 21372928 to 22069248 tid 1 2021-07-26T16:10:47.447 INFO:tasks.rados.rados.0.smithi033.stdout:3759: writing smithi03339061-13 from 22069248 to 22642688 tid 2 2021-07-26T16:10:47.450 INFO:tasks.rados.rados.0.smithi033.stdout:3759: writing smithi03339061-13 from 22642688 to 23093248 tid 3 2021-07-26T16:10:47.451 INFO:tasks.rados.rados.0.smithi033.stdout:3759: writing smithi03339061-13 from 23093248 to 23273472 tid 4 2021-07-26T16:10:47.451 INFO:tasks.rados.rados.0.smithi033.stdout:3760: read oid 46 snap 348 2021-07-26T16:10:47.451 INFO:tasks.rados.rados.0.smithi033.stdout:3760: expect (ObjNum 1057 snap 348 seq_num 1057) 2021-07-26T16:10:47.452 INFO:tasks.rados.rados.0.smithi033.stdout:3761: setattr oid 3 current snap is 373 2021-07-26T16:10:47.453 INFO:tasks.rados.rados.0.smithi033.stdout:3762: rollback oid 11 current snap is 373 2021-07-26T16:10:47.453 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 11 to 345 2021-07-26T16:10:47.453 INFO:tasks.rados.rados.0.smithi033.stdout:3763: rmattr oid 20 current snap is 373 2021-07-26T16:10:47.453 INFO:tasks.rados.rados.0.smithi033.stdout:3763: done (4 left) 2021-07-26T16:10:47.454 INFO:tasks.rados.rados.0.smithi033.stdout:3764: delete oid 14 current snap is 373 2021-07-26T16:10:47.462 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1842 (ObjNum 2007842992 snap 22002 seq_num 2006857680) dirty exists 2021-07-26T16:10:47.463 INFO:tasks.rados.rados.0.smithi033.stdout:3759: finishing write tid 1 to smithi03339061-13 2021-07-26T16:10:47.464 INFO:tasks.rados.rados.0.smithi033.stdout:3759: finishing write tid 2 to smithi03339061-13 2021-07-26T16:10:47.466 INFO:tasks.rados.rados.0.smithi033.stdout:3762: finishing rollback tid 1 to smithi03339061-11 2021-07-26T16:10:47.466 INFO:tasks.rados.rados.0.smithi033.stdout:3759: finishing write tid 3 to smithi03339061-13 2021-07-26T16:10:47.466 INFO:tasks.rados.rados.0.smithi033.stdout:3759: finishing write tid 4 to smithi03339061-13 2021-07-26T16:10:47.467 INFO:tasks.rados.rados.0.smithi033.stdout:3760: expect (ObjNum 1057 snap 348 seq_num 1057) 2021-07-26T16:10:47.522 INFO:tasks.rados.rados.0.smithi033.stdout:3762: finishing rollback tid 2 to smithi03339061-11 2021-07-26T16:10:47.522 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1454 (ObjNum 1027 snap 341 seq_num 1027) dirty exists 2021-07-26T16:10:47.522 INFO:tasks.rados.rados.0.smithi033.stdout:3759: finishing write tid 5 to smithi03339061-13 2021-07-26T16:10:47.522 INFO:tasks.rados.rados.0.smithi033.stdout:3759: finishing write tid 6 to smithi03339061-13 2021-07-26T16:10:47.523 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 2075 (ObjNum 1116 snap 373 seq_num 1116) dirty exists 2021-07-26T16:10:47.523 INFO:tasks.rados.rados.0.smithi033.stdout:3759: left oid 13 (ObjNum 1116 snap 373 seq_num 1116) 2021-07-26T16:10:47.523 INFO:tasks.rados.rados.0.smithi033.stdout:3759: done (4 left) 2021-07-26T16:10:47.523 INFO:tasks.rados.rados.0.smithi033.stdout:3760: done (3 left) 2021-07-26T16:10:47.524 INFO:tasks.rados.rados.0.smithi033.stdout:3761: done (2 left) 2021-07-26T16:10:47.524 INFO:tasks.rados.rados.0.smithi033.stdout:3762: done (1 left) 2021-07-26T16:10:47.524 INFO:tasks.rados.rados.0.smithi033.stdout:3764: done (0 left) 2021-07-26T16:10:47.524 INFO:tasks.rados.rados.0.smithi033.stdout:3765: setattr oid 35 current snap is 373 2021-07-26T16:10:47.525 INFO:tasks.rados.rados.0.smithi033.stdout:3766: rollback oid 33 current snap is 373 2021-07-26T16:10:47.525 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 33 to 284 2021-07-26T16:10:47.525 INFO:tasks.rados.rados.0.smithi033.stdout:3767: delete oid 9 current snap is 373 2021-07-26T16:10:47.532 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 35 v 1844 (ObjNum 1087 snap 360 seq_num 1087) dirty exists 2021-07-26T16:10:47.533 INFO:tasks.rados.rados.0.smithi033.stdout:3765: done (2 left) 2021-07-26T16:10:47.533 INFO:tasks.rados.rados.0.smithi033.stdout:3767: done (1 left) 2021-07-26T16:10:47.533 INFO:tasks.rados.rados.0.smithi033.stdout:3768: rollback oid 38 current snap is 373 2021-07-26T16:10:47.533 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 38 to 344 2021-07-26T16:10:47.534 INFO:tasks.rados.rados.0.smithi033.stdout:3769: delete oid 41 current snap is 373 2021-07-26T16:10:47.536 INFO:tasks.rados.rados.0.smithi033.stdout:3766: finishing rollback tid 0 to smithi03339061-33 2021-07-26T16:10:47.537 INFO:tasks.rados.rados.0.smithi033.stdout:3766: finishing rollback tid 1 to smithi03339061-33 2021-07-26T16:10:47.539 INFO:tasks.rados.rados.0.smithi033.stdout:3766: finishing rollback tid 2 to smithi03339061-33 2021-07-26T16:10:47.539 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 33 v 2476 (ObjNum 655 snap 210 seq_num 655) dirty exists 2021-07-26T16:10:47.540 INFO:tasks.rados.rados.0.smithi033.stdout:3768: finishing rollback tid 0 to smithi03339061-38 2021-07-26T16:10:47.542 INFO:tasks.rados.rados.0.smithi033.stdout:3768: finishing rollback tid 1 to smithi03339061-38 2021-07-26T16:10:47.542 INFO:tasks.rados.rados.0.smithi033.stdout:3766: done (2 left) 2021-07-26T16:10:47.542 INFO:tasks.rados.rados.0.smithi033.stdout:3769: done (1 left) 2021-07-26T16:10:47.543 INFO:tasks.rados.rados.0.smithi033.stdout:3770: copy_from oid 44 from oid 22 current snap is 373 2021-07-26T16:10:47.543 INFO:tasks.rados.rados.0.smithi033.stdout:3768: finishing rollback tid 2 to smithi03339061-38 2021-07-26T16:10:47.543 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 750 (ObjNum 1031 snap 344 seq_num 1031) dirty exists 2021-07-26T16:10:47.543 INFO:tasks.rados.rados.0.smithi033.stdout:3768: done (1 left) 2021-07-26T16:10:47.544 INFO:tasks.rados.rados.0.smithi033.stdout:3771: copy_from oid 16 from oid 45 current snap is 373 2021-07-26T16:10:47.544 INFO:tasks.rados.rados.0.smithi033.stdout:3772: read oid 5 snap -1 2021-07-26T16:10:47.544 INFO:tasks.rados.rados.0.smithi033.stdout:3772: expect (ObjNum 1053 snap 347 seq_num 1053) 2021-07-26T16:10:47.544 INFO:tasks.rados.rados.0.smithi033.stdout:3773: rollback oid 21 current snap is 373 2021-07-26T16:10:47.544 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 21 to 271 2021-07-26T16:10:47.545 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 373 2021-07-26T16:10:47.545 INFO:tasks.rados.rados.0.smithi033.stdout:3774: seq_num 1120 ranges {0=761856,761856=557056,1318912=425984,1744896=221184} 2021-07-26T16:10:47.546 INFO:tasks.rados.rados.0.smithi033.stdout:3774: writing smithi03339061-49 from 0 to 761856 tid 1 2021-07-26T16:10:47.550 INFO:tasks.rados.rados.0.smithi033.stdout:3774: writing smithi03339061-49 from 761856 to 1318912 tid 2 2021-07-26T16:10:47.553 INFO:tasks.rados.rados.0.smithi033.stdout:3774: writing smithi03339061-49 from 1318912 to 1744896 tid 3 2021-07-26T16:10:47.555 INFO:tasks.rados.rados.0.smithi033.stdout:3774: writing smithi03339061-49 from 1744896 to 1966080 tid 4 2021-07-26T16:10:47.555 INFO:tasks.rados.rados.0.smithi033.stdout:3775: copy_from oid 42 from oid 9 current snap is 373 2021-07-26T16:10:47.555 INFO:tasks.rados.rados.0.smithi033.stdout:3774: finishing write tid 1 to smithi03339061-49 2021-07-26T16:10:47.556 INFO:tasks.rados.rados.0.smithi033.stdout:3773: finishing rollback tid 0 to smithi03339061-21 2021-07-26T16:10:47.556 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 373 2021-07-26T16:10:47.556 INFO:tasks.rados.rados.0.smithi033.stdout:3776: seq_num 1121 ranges {1196032=778240,1974272=442368,2416640=638976,3055616=122880} 2021-07-26T16:10:47.567 INFO:tasks.rados.rados.0.smithi033.stdout:3776: writing smithi03339061-43 from 1196032 to 1974272 tid 1 2021-07-26T16:10:47.571 INFO:tasks.rados.rados.0.smithi033.stdout:3776: writing smithi03339061-43 from 1974272 to 2416640 tid 2 2021-07-26T16:10:47.576 INFO:tasks.rados.rados.0.smithi033.stdout:3776: writing smithi03339061-43 from 2416640 to 3055616 tid 3 2021-07-26T16:10:47.578 INFO:tasks.rados.rados.0.smithi033.stdout:3776: writing smithi03339061-43 from 3055616 to 3178496 tid 4 2021-07-26T16:10:47.578 INFO:tasks.rados.rados.0.smithi033.stdout:3777: setattr oid 3 current snap is 373 2021-07-26T16:10:47.578 INFO:tasks.rados.rados.0.smithi033.stdout:3774: finishing write tid 2 to smithi03339061-49 2021-07-26T16:10:47.578 INFO:tasks.rados.rados.0.smithi033.stdout:3775: finishing copy_from to smithi03339061-42 2021-07-26T16:10:47.579 INFO:tasks.rados.rados.0.smithi033.stdout:3775: got expected ENOENT (src dne) 2021-07-26T16:10:47.579 INFO:tasks.rados.rados.0.smithi033.stdout:3775: finishing copy_from racing read to smithi03339061-42 2021-07-26T16:10:47.579 INFO:tasks.rados.rados.0.smithi033.stdout:3773: finishing rollback tid 1 to smithi03339061-21 2021-07-26T16:10:47.579 INFO:tasks.rados.rados.0.smithi033.stdout:3773: finishing rollback tid 2 to smithi03339061-21 2021-07-26T16:10:47.580 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 2014 (ObjNum 673 snap 219 seq_num 673) dirty exists 2021-07-26T16:10:47.580 INFO:tasks.rados.rados.0.smithi033.stdout:3774: finishing write tid 3 to smithi03339061-49 2021-07-26T16:10:47.580 INFO:tasks.rados.rados.0.smithi033.stdout:3774: finishing write tid 4 to smithi03339061-49 2021-07-26T16:10:47.580 INFO:tasks.rados.rados.0.smithi033.stdout:3774: finishing write tid 5 to smithi03339061-49 2021-07-26T16:10:47.580 INFO:tasks.rados.rados.0.smithi033.stdout:3774: finishing write tid 6 to smithi03339061-49 2021-07-26T16:10:47.581 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 961 (ObjNum 1120 snap 373 seq_num 1120) dirty exists 2021-07-26T16:10:47.581 INFO:tasks.rados.rados.0.smithi033.stdout:3774: left oid 49 (ObjNum 1120 snap 373 seq_num 1120) 2021-07-26T16:10:47.581 INFO:tasks.rados.rados.0.smithi033.stdout:3772: expect (ObjNum 1053 snap 347 seq_num 1053) 2021-07-26T16:10:47.770 INFO:tasks.rados.rados.0.smithi033.stdout:3771: finishing copy_from to smithi03339061-16 2021-07-26T16:10:47.770 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 2355 (ObjNum 806 snap 268 seq_num 806) dirty exists 2021-07-26T16:10:47.771 INFO:tasks.rados.rados.0.smithi033.stdout:3771: finishing copy_from racing read to smithi03339061-16 2021-07-26T16:10:47.771 INFO:tasks.rados.rados.0.smithi033.stdout:3770: finishing copy_from to smithi03339061-44 2021-07-26T16:10:47.771 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 1356 (ObjNum 1060 snap 348 seq_num 1060) dirty exists 2021-07-26T16:10:47.771 INFO:tasks.rados.rados.0.smithi033.stdout:3770: finishing copy_from racing read to smithi03339061-44 2021-07-26T16:10:47.772 INFO:tasks.rados.rados.0.smithi033.stdout:3776: finishing write tid 1 to smithi03339061-43 2021-07-26T16:10:47.772 INFO:tasks.rados.rados.0.smithi033.stdout:3776: finishing write tid 2 to smithi03339061-43 2021-07-26T16:10:47.772 INFO:tasks.rados.rados.0.smithi033.stdout:3776: finishing write tid 3 to smithi03339061-43 2021-07-26T16:10:47.772 INFO:tasks.rados.rados.0.smithi033.stdout:3776: finishing write tid 4 to smithi03339061-43 2021-07-26T16:10:47.772 INFO:tasks.rados.rados.0.smithi033.stdout:3776: finishing write tid 5 to smithi03339061-43 2021-07-26T16:10:47.773 INFO:tasks.rados.rados.0.smithi033.stdout:3776: finishing write tid 6 to smithi03339061-43 2021-07-26T16:10:47.774 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 2059 (ObjNum 1121 snap 373 seq_num 1121) dirty exists 2021-07-26T16:10:47.775 INFO:tasks.rados.rados.0.smithi033.stdout:3776: left oid 43 (ObjNum 1121 snap 373 seq_num 1121) 2021-07-26T16:10:47.775 INFO:tasks.rados.rados.0.smithi033.stdout:3770: done (7 left) 2021-07-26T16:10:47.775 INFO:tasks.rados.rados.0.smithi033.stdout:3771: done (6 left) 2021-07-26T16:10:47.775 INFO:tasks.rados.rados.0.smithi033.stdout:3772: done (5 left) 2021-07-26T16:10:47.776 INFO:tasks.rados.rados.0.smithi033.stdout:3773: done (4 left) 2021-07-26T16:10:47.776 INFO:tasks.rados.rados.0.smithi033.stdout:3774: done (3 left) 2021-07-26T16:10:47.776 INFO:tasks.rados.rados.0.smithi033.stdout:3775: done (2 left) 2021-07-26T16:10:47.776 INFO:tasks.rados.rados.0.smithi033.stdout:3776: done (1 left) 2021-07-26T16:10:47.776 INFO:tasks.rados.rados.0.smithi033.stdout:3778: delete oid 9 current snap is 373 2021-07-26T16:10:47.777 INFO:tasks.rados.rados.0.smithi033.stdout:3778: done (1 left) 2021-07-26T16:10:47.777 INFO:tasks.rados.rados.0.smithi033.stdout:3779: delete oid 16 current snap is 373 2021-07-26T16:10:47.778 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 1843 (ObjNum 2007842992 snap 22002 seq_num 2007017216) dirty exists 2021-07-26T16:10:47.779 INFO:tasks.rados.rados.0.smithi033.stdout:3777: done (1 left) 2021-07-26T16:10:47.779 INFO:tasks.rados.rados.0.smithi033.stdout:3779: done (0 left) 2021-07-26T16:10:47.780 INFO:tasks.rados.rados.0.smithi033.stdout:3780: rollback oid 24 current snap is 373 2021-07-26T16:10:47.781 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 24 to 369 2021-07-26T16:10:47.781 INFO:tasks.rados.rados.0.smithi033.stdout:3781: copy_from oid 4 from oid 29 current snap is 373 2021-07-26T16:10:47.781 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 14 current snap is 373 2021-07-26T16:10:47.781 INFO:tasks.rados.rados.0.smithi033.stdout:3782: seq_num 1124 ranges {0=434176,434176=499712,933888=409600,1343488=663552,2007040=32768} 2021-07-26T16:10:47.784 INFO:tasks.rados.rados.0.smithi033.stdout:3782: writing smithi03339061-14 from 0 to 434176 tid 1 2021-07-26T16:10:47.790 INFO:tasks.rados.rados.0.smithi033.stdout:3782: writing smithi03339061-14 from 434176 to 933888 tid 2 2021-07-26T16:10:47.793 INFO:tasks.rados.rados.0.smithi033.stdout:3782: writing smithi03339061-14 from 933888 to 1343488 tid 3 2021-07-26T16:10:47.797 INFO:tasks.rados.rados.0.smithi033.stdout:3782: writing smithi03339061-14 from 1343488 to 2007040 tid 4 2021-07-26T16:10:47.797 INFO:tasks.rados.rados.0.smithi033.stdout:3782: writing smithi03339061-14 from 2007040 to 2039808 tid 5 2021-07-26T16:10:47.798 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 10 current snap is 373 2021-07-26T16:10:47.798 INFO:tasks.rados.rados.0.smithi033.stdout:3783: seq_num 1125 ranges {0=450560,450560=786432,1236992=614400,1851392=204800} 2021-07-26T16:10:47.800 INFO:tasks.rados.rados.0.smithi033.stdout:3783: writing smithi03339061-10 from 0 to 450560 tid 1 2021-07-26T16:10:47.806 INFO:tasks.rados.rados.0.smithi033.stdout:3783: writing smithi03339061-10 from 450560 to 1236992 tid 2 2021-07-26T16:10:47.810 INFO:tasks.rados.rados.0.smithi033.stdout:3783: writing smithi03339061-10 from 1236992 to 1851392 tid 3 2021-07-26T16:10:47.812 INFO:tasks.rados.rados.0.smithi033.stdout:3783: writing smithi03339061-10 from 1851392 to 2056192 tid 4 2021-07-26T16:10:47.812 INFO:tasks.rados.rados.0.smithi033.stdout:3784: setattr oid 7 current snap is 373 2021-07-26T16:10:47.813 INFO:tasks.rados.rados.0.smithi033.stdout:3780: finishing rollback tid 0 to smithi03339061-24 2021-07-26T16:10:47.813 INFO:tasks.rados.rados.0.smithi033.stdout:3780: finishing rollback tid 1 to smithi03339061-24 2021-07-26T16:10:47.813 INFO:tasks.rados.rados.0.smithi033.stdout:3782: finishing write tid 1 to smithi03339061-14 2021-07-26T16:10:47.813 INFO:tasks.rados.rados.0.smithi033.stdout:3780: finishing rollback tid 2 to smithi03339061-24 2021-07-26T16:10:47.813 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 24 v 2055 (ObjNum 1054 snap 347 seq_num 1054) dirty exists 2021-07-26T16:10:47.814 INFO:tasks.rados.rados.0.smithi033.stdout:3783: finishing write tid 1 to smithi03339061-10 2021-07-26T16:10:47.814 INFO:tasks.rados.rados.0.smithi033.stdout:3782: finishing write tid 2 to smithi03339061-14 2021-07-26T16:10:47.814 INFO:tasks.rados.rados.0.smithi033.stdout:3783: finishing write tid 2 to smithi03339061-10 2021-07-26T16:10:47.815 INFO:tasks.rados.rados.0.smithi033.stdout:3780: done (4 left) 2021-07-26T16:10:47.816 INFO:tasks.rados.rados.0.smithi033.stdout:3785: rmattr oid 46 current snap is 373 2021-07-26T16:10:47.816 INFO:tasks.rados.rados.0.smithi033.stdout:3786: rmattr oid 38 current snap is 373 2021-07-26T16:10:47.816 INFO:tasks.rados.rados.0.smithi033.stdout:3786: done (5 left) 2021-07-26T16:10:47.816 INFO:tasks.rados.rados.0.smithi033.stdout:3787: snap_remove snap 365 2021-07-26T16:10:48.328 INFO:tasks.rados.rados.0.smithi033.stdout:3787: done (5 left) 2021-07-26T16:10:48.329 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 31 current snap is 373 2021-07-26T16:10:48.329 INFO:tasks.rados.rados.0.smithi033.stdout:3781: finishing copy_from to smithi03339061-4 2021-07-26T16:10:48.329 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 1864 (ObjNum 1060 snap 348 seq_num 1060) dirty exists 2021-07-26T16:10:48.329 INFO:tasks.rados.rados.0.smithi033.stdout:3781: finishing copy_from racing read to smithi03339061-4 2021-07-26T16:10:48.329 INFO:tasks.rados.rados.0.smithi033.stdout:3782: finishing write tid 3 to smithi03339061-14 2021-07-26T16:10:48.330 INFO:tasks.rados.rados.0.smithi033.stdout:3782: finishing write tid 4 to smithi03339061-14 2021-07-26T16:10:48.330 INFO:tasks.rados.rados.0.smithi033.stdout:3783: finishing write tid 3 to smithi03339061-10 2021-07-26T16:10:48.330 INFO:tasks.rados.rados.0.smithi033.stdout:3782: finishing write tid 5 to smithi03339061-14 2021-07-26T16:10:48.330 INFO:tasks.rados.rados.0.smithi033.stdout:3782: finishing write tid 6 to smithi03339061-14 2021-07-26T16:10:48.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 1865 (ObjNum 1053 snap 347 seq_num 1053) dirty exists 2021-07-26T16:10:48.331 INFO:tasks.rados.rados.0.smithi033.stdout:3783: finishing write tid 4 to smithi03339061-10 2021-07-26T16:10:48.331 INFO:tasks.rados.rados.0.smithi033.stdout:3782: finishing write tid 7 to smithi03339061-14 2021-07-26T16:10:48.331 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 14 v 2082 (ObjNum 1124 snap 373 seq_num 1124) dirty exists 2021-07-26T16:10:48.332 INFO:tasks.rados.rados.0.smithi033.stdout:3782: left oid 14 (ObjNum 1124 snap 373 seq_num 1124) 2021-07-26T16:10:48.332 INFO:tasks.rados.rados.0.smithi033.stdout:3783: finishing write tid 5 to smithi03339061-10 2021-07-26T16:10:48.332 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 2016 (ObjNum 1021 snap 341 seq_num 1021) dirty exists 2021-07-26T16:10:48.332 INFO:tasks.rados.rados.0.smithi033.stdout:3783: finishing write tid 6 to smithi03339061-10 2021-07-26T16:10:48.332 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 2060 (ObjNum 1125 snap 373 seq_num 1125) dirty exists 2021-07-26T16:10:48.333 INFO:tasks.rados.rados.0.smithi033.stdout:3783: left oid 10 (ObjNum 1125 snap 373 seq_num 1125) 2021-07-26T16:10:48.333 INFO:tasks.rados.rados.0.smithi033.stdout:3788: seq_num 1126 ranges {3588096=466944,4055040=720896,4775936=778240,5554176=106496} 2021-07-26T16:10:48.354 INFO:tasks.rados.rados.0.smithi033.stdout:3788: writing smithi03339061-31 from 3588096 to 4055040 tid 1 2021-07-26T16:10:48.358 INFO:tasks.rados.rados.0.smithi033.stdout:3788: writing smithi03339061-31 from 4055040 to 4775936 tid 2 2021-07-26T16:10:48.362 INFO:tasks.rados.rados.0.smithi033.stdout:3788: writing smithi03339061-31 from 4775936 to 5554176 tid 3 2021-07-26T16:10:48.364 INFO:tasks.rados.rados.0.smithi033.stdout:3788: writing smithi03339061-31 from 5554176 to 5660672 tid 4 2021-07-26T16:10:48.364 INFO:tasks.rados.rados.0.smithi033.stdout:3781: done (5 left) 2021-07-26T16:10:48.364 INFO:tasks.rados.rados.0.smithi033.stdout:3782: done (4 left) 2021-07-26T16:10:48.364 INFO:tasks.rados.rados.0.smithi033.stdout:3783: done (3 left) 2021-07-26T16:10:48.365 INFO:tasks.rados.rados.0.smithi033.stdout:3784: done (2 left) 2021-07-26T16:10:48.365 INFO:tasks.rados.rados.0.smithi033.stdout:3785: done (1 left) 2021-07-26T16:10:48.365 INFO:tasks.rados.rados.0.smithi033.stdout:3789: delete oid 14 current snap is 373 2021-07-26T16:10:48.365 INFO:tasks.rados.rados.0.smithi033.stdout:3788: finishing write tid 1 to smithi03339061-31 2021-07-26T16:10:48.365 INFO:tasks.rados.rados.0.smithi033.stdout:3788: finishing write tid 2 to smithi03339061-31 2021-07-26T16:10:48.366 INFO:tasks.rados.rados.0.smithi033.stdout:3789: done (1 left) 2021-07-26T16:10:48.366 INFO:tasks.rados.rados.0.smithi033.stdout:3790: snap_remove snap 362 2021-07-26T16:10:48.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:48 smithi033 bash[41341]: cluster 2021-07-26T16:10:47.220067+0000 mgr.y (mgr.34104) 505 : cluster [DBG] pgmap v1038: 25 pgs: 25 active+clean; 881 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2021-07-26T16:10:48.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:48 smithi033 bash[41341]: cluster 2021-07-26T16:10:47.312277+0000 mon.a (mon.0) 1184 : cluster [DBG] osdmap e803: 8 total, 8 up, 8 in 2021-07-26T16:10:48.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:48 smithi033 bash[42377]: cluster 2021-07-26T16:10:47.220067+0000 mgr.y (mgr.34104) 505 : cluster [DBG] pgmap v1038: 25 pgs: 25 active+clean; 881 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2021-07-26T16:10:48.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:48 smithi033 bash[42377]: cluster 2021-07-26T16:10:47.312277+0000 mon.a (mon.0) 1184 : cluster [DBG] osdmap e803: 8 total, 8 up, 8 in 2021-07-26T16:10:48.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:48 smithi096 bash[33981]: cluster 2021-07-26T16:10:47.220067+0000 mgr.y (mgr.34104) 505 : cluster [DBG] pgmap v1038: 25 pgs: 25 active+clean; 881 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 18 MiB/s rd, 1.8 MiB/s wr, 14 op/s 2021-07-26T16:10:48.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:48 smithi096 bash[33981]: cluster 2021-07-26T16:10:47.312277+0000 mon.a (mon.0) 1184 : cluster [DBG] osdmap e803: 8 total, 8 up, 8 in 2021-07-26T16:10:49.338 INFO:tasks.rados.rados.0.smithi033.stdout:3788: finishing write tid 3 to smithi03339061-31 2021-07-26T16:10:49.339 INFO:tasks.rados.rados.0.smithi033.stdout:3788: finishing write tid 4 to smithi03339061-31 2021-07-26T16:10:49.339 INFO:tasks.rados.rados.0.smithi033.stdout:3788: finishing write tid 5 to smithi03339061-31 2021-07-26T16:10:49.339 INFO:tasks.rados.rados.0.smithi033.stdout:3788: finishing write tid 6 to smithi03339061-31 2021-07-26T16:10:49.339 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 31 v 1864 (ObjNum 1126 snap 373 seq_num 1126) dirty exists 2021-07-26T16:10:49.339 INFO:tasks.rados.rados.0.smithi033.stdout:3788: left oid 31 (ObjNum 1126 snap 373 seq_num 1126) 2021-07-26T16:10:49.340 INFO:tasks.rados.rados.0.smithi033.stdout:3788: done (1 left) 2021-07-26T16:10:49.340 INFO:tasks.rados.rados.0.smithi033.stdout:3790: done (0 left) 2021-07-26T16:10:49.340 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 49 current snap is 373 2021-07-26T16:10:49.340 INFO:tasks.rados.rados.0.smithi033.stdout:3791: seq_num 1128 ranges {1966080=499712,2465792=483328,2949120=786432,3735552=335872} 2021-07-26T16:10:49.356 INFO:tasks.rados.rados.0.smithi033.stdout:3791: writing smithi03339061-49 from 1966080 to 2465792 tid 1 2021-07-26T16:10:49.359 INFO:tasks.rados.rados.0.smithi033.stdout:3791: writing smithi03339061-49 from 2465792 to 2949120 tid 2 2021-07-26T16:10:49.364 INFO:tasks.rados.rados.0.smithi033.stdout:3791: writing smithi03339061-49 from 2949120 to 3735552 tid 3 2021-07-26T16:10:49.368 INFO:tasks.rados.rados.0.smithi033.stdout:3791: writing smithi03339061-49 from 3735552 to 4071424 tid 4 2021-07-26T16:10:49.368 INFO:tasks.rados.rados.0.smithi033.stdout:3791: finishing write tid 1 to smithi03339061-49 2021-07-26T16:10:49.368 INFO:tasks.rados.rados.0.smithi033.stdout:3791: finishing write tid 2 to smithi03339061-49 2021-07-26T16:10:49.369 INFO:tasks.rados.rados.0.smithi033.stdout:3792: copy_from oid 50 from oid 20 current snap is 373 2021-07-26T16:10:49.369 INFO:tasks.rados.rados.0.smithi033.stdout:3793: read oid 7 snap 359 2021-07-26T16:10:49.369 INFO:tasks.rados.rados.0.smithi033.stdout:3793: expect (ObjNum 1021 snap 341 seq_num 1021) 2021-07-26T16:10:49.369 INFO:tasks.rados.rados.0.smithi033.stdout:3794: rollback oid 15 current snap is 373 2021-07-26T16:10:49.369 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 15 to 312 2021-07-26T16:10:49.370 INFO:tasks.rados.rados.0.smithi033.stdout:3795: read oid 40 snap -1 2021-07-26T16:10:49.370 INFO:tasks.rados.rados.0.smithi033.stdout:3795: expect deleted 2021-07-26T16:10:49.370 INFO:tasks.rados.rados.0.smithi033.stdout:3796: delete oid 41 current snap is 373 2021-07-26T16:10:49.371 INFO:tasks.rados.rados.0.smithi033.stdout:3792: finishing copy_from to smithi03339061-50 2021-07-26T16:10:49.371 INFO:tasks.rados.rados.0.smithi033.stdout:3792: got expected ENOENT (src dne) 2021-07-26T16:10:49.371 INFO:tasks.rados.rados.0.smithi033.stdout:3792: finishing copy_from racing read to smithi03339061-50 2021-07-26T16:10:49.372 INFO:tasks.rados.rados.0.smithi033.stdout:3791: finishing write tid 3 to smithi03339061-49 2021-07-26T16:10:49.375 INFO:tasks.rados.rados.0.smithi033.stdout:3791: finishing write tid 4 to smithi03339061-49 2021-07-26T16:10:49.376 INFO:tasks.rados.rados.0.smithi033.stdout:3792: done (5 left) 2021-07-26T16:10:49.376 INFO:tasks.rados.rados.0.smithi033.stdout:3795: done (4 left) 2021-07-26T16:10:49.376 INFO:tasks.rados.rados.0.smithi033.stdout:3796: done (3 left) 2021-07-26T16:10:49.376 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 39 current snap is 373 2021-07-26T16:10:49.376 INFO:tasks.rados.rados.0.smithi033.stdout:3791: finishing write tid 5 to smithi03339061-49 2021-07-26T16:10:49.377 INFO:tasks.rados.rados.0.smithi033.stdout:3797: seq_num 1130 ranges {0=532480,532480=655360,1187840=753664,1941504=196608} 2021-07-26T16:10:49.378 INFO:tasks.rados.rados.0.smithi033.stdout:3797: writing smithi03339061-39 from 0 to 532480 tid 1 2021-07-26T16:10:49.382 INFO:tasks.rados.rados.0.smithi033.stdout:3797: writing smithi03339061-39 from 532480 to 1187840 tid 2 2021-07-26T16:10:49.387 INFO:tasks.rados.rados.0.smithi033.stdout:3797: writing smithi03339061-39 from 1187840 to 1941504 tid 3 2021-07-26T16:10:49.388 INFO:tasks.rados.rados.0.smithi033.stdout:3797: writing smithi03339061-39 from 1941504 to 2138112 tid 4 2021-07-26T16:10:49.389 INFO:tasks.rados.rados.0.smithi033.stdout:3794: finishing rollback tid 0 to smithi03339061-15 2021-07-26T16:10:49.389 INFO:tasks.rados.rados.0.smithi033.stdout:3793: expect (ObjNum 1021 snap 341 seq_num 1021) 2021-07-26T16:10:49.401 INFO:tasks.rados.rados.0.smithi033.stdout:3791: finishing write tid 6 to smithi03339061-49 2021-07-26T16:10:49.402 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 49 v 966 (ObjNum 1128 snap 373 seq_num 1128) dirty exists 2021-07-26T16:10:49.402 INFO:tasks.rados.rados.0.smithi033.stdout:3791: left oid 49 (ObjNum 1128 snap 373 seq_num 1128) 2021-07-26T16:10:49.402 INFO:tasks.rados.rados.0.smithi033.stdout:3794: finishing rollback tid 1 to smithi03339061-15 2021-07-26T16:10:49.402 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 968 (ObjNum 288 snap 0 seq_num 81) dirty dne 2021-07-26T16:10:49.402 INFO:tasks.rados.rados.0.smithi033.stdout:3797: finishing write tid 1 to smithi03339061-39 2021-07-26T16:10:49.403 INFO:tasks.rados.rados.0.smithi033.stdout:3791: done (3 left) 2021-07-26T16:10:49.403 INFO:tasks.rados.rados.0.smithi033.stdout:3793: done (2 left) 2021-07-26T16:10:49.403 INFO:tasks.rados.rados.0.smithi033.stdout:3794: done (1 left) 2021-07-26T16:10:49.403 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 373 2021-07-26T16:10:49.404 INFO:tasks.rados.rados.0.smithi033.stdout:3797: finishing write tid 2 to smithi03339061-39 2021-07-26T16:10:49.404 INFO:tasks.rados.rados.0.smithi033.stdout:3798: seq_num 1131 ranges {2080768=548864,2629632=540672,3170304=565248,3735552=425984,4161536=73728} 2021-07-26T16:10:49.419 INFO:tasks.rados.rados.0.smithi033.stdout:3798: writing smithi03339061-21 from 2080768 to 2629632 tid 1 2021-07-26T16:10:49.423 INFO:tasks.rados.rados.0.smithi033.stdout:3798: writing smithi03339061-21 from 2629632 to 3170304 tid 2 2021-07-26T16:10:49.426 INFO:tasks.rados.rados.0.smithi033.stdout:3798: writing smithi03339061-21 from 3170304 to 3735552 tid 3 2021-07-26T16:10:49.429 INFO:tasks.rados.rados.0.smithi033.stdout:3798: writing smithi03339061-21 from 3735552 to 4161536 tid 4 2021-07-26T16:10:49.429 INFO:tasks.rados.rados.0.smithi033.stdout:3798: writing smithi03339061-21 from 4161536 to 4235264 tid 5 2021-07-26T16:10:49.430 INFO:tasks.rados.rados.0.smithi033.stdout:3799: snap_remove snap 361 2021-07-26T16:10:49.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:49 smithi033 bash[41341]: cluster 2021-07-26T16:10:48.321386+0000 mon.a (mon.0) 1185 : cluster [DBG] osdmap e804: 8 total, 8 up, 8 in 2021-07-26T16:10:49.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:49 smithi033 bash[42377]: cluster 2021-07-26T16:10:48.321386+0000 mon.a (mon.0) 1185 : cluster [DBG] osdmap e804: 8 total, 8 up, 8 in 2021-07-26T16:10:49.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:49 smithi096 bash[33981]: cluster 2021-07-26T16:10:48.321386+0000 mon.a (mon.0) 1185 : cluster [DBG] osdmap e804: 8 total, 8 up, 8 in 2021-07-26T16:10:50.346 INFO:tasks.rados.rados.0.smithi033.stdout:3799: done (2 left) 2021-07-26T16:10:50.346 INFO:tasks.rados.rados.0.smithi033.stdout:3800: read oid 23 snap -1 2021-07-26T16:10:50.346 INFO:tasks.rados.rados.0.smithi033.stdout:3800: expect (ObjNum 1113 snap 372 seq_num 1113) 2021-07-26T16:10:50.347 INFO:tasks.rados.rados.0.smithi033.stdout:3801: read oid 26 snap -1 2021-07-26T16:10:50.347 INFO:tasks.rados.rados.0.smithi033.stdout:3801: expect (ObjNum 1082 snap 357 seq_num 1082) 2021-07-26T16:10:50.347 INFO:tasks.rados.rados.0.smithi033.stdout:3802: setattr oid 42 current snap is 373 2021-07-26T16:10:50.348 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 2 current snap is 373 2021-07-26T16:10:50.348 INFO:tasks.rados.rados.0.smithi033.stdout:3803: seq_num 1132 ranges {0=565248,565248=425984,991232=770048,1761280=409600} 2021-07-26T16:10:50.352 INFO:tasks.rados.rados.0.smithi033.stdout:3803: writing smithi03339061-2 from 0 to 565248 tid 1 2021-07-26T16:10:50.356 INFO:tasks.rados.rados.0.smithi033.stdout:3803: writing smithi03339061-2 from 565248 to 991232 tid 2 2021-07-26T16:10:50.361 INFO:tasks.rados.rados.0.smithi033.stdout:3803: writing smithi03339061-2 from 991232 to 1761280 tid 3 2021-07-26T16:10:50.364 INFO:tasks.rados.rados.0.smithi033.stdout:3803: writing smithi03339061-2 from 1761280 to 2170880 tid 4 2021-07-26T16:10:50.364 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 373 2021-07-26T16:10:50.365 INFO:tasks.rados.rados.0.smithi033.stdout:3804: seq_num 1133 ranges {3588096=581632,4169728=753664,4923392=573440,5496832=278528} 2021-07-26T16:10:50.389 INFO:tasks.rados.rados.0.smithi033.stdout:3804: writing smithi03339061-5 from 3588096 to 4169728 tid 1 2021-07-26T16:10:50.394 INFO:tasks.rados.rados.0.smithi033.stdout:3804: writing smithi03339061-5 from 4169728 to 4923392 tid 2 2021-07-26T16:10:50.398 INFO:tasks.rados.rados.0.smithi033.stdout:3804: writing smithi03339061-5 from 4923392 to 5496832 tid 3 2021-07-26T16:10:50.400 INFO:tasks.rados.rados.0.smithi033.stdout:3804: writing smithi03339061-5 from 5496832 to 5775360 tid 4 2021-07-26T16:10:50.400 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 373 2021-07-26T16:10:50.400 INFO:tasks.rados.rados.0.smithi033.stdout:3797: finishing write tid 3 to smithi03339061-39 2021-07-26T16:10:50.401 INFO:tasks.rados.rados.0.smithi033.stdout:3797: finishing write tid 4 to smithi03339061-39 2021-07-26T16:10:50.401 INFO:tasks.rados.rados.0.smithi033.stdout:3797: finishing write tid 5 to smithi03339061-39 2021-07-26T16:10:50.401 INFO:tasks.rados.rados.0.smithi033.stdout:3797: finishing write tid 6 to smithi03339061-39 2021-07-26T16:10:50.401 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 2033 (ObjNum 1130 snap 373 seq_num 1130) dirty exists 2021-07-26T16:10:50.402 INFO:tasks.rados.rados.0.smithi033.stdout:3797: left oid 39 (ObjNum 1130 snap 373 seq_num 1130) 2021-07-26T16:10:50.402 INFO:tasks.rados.rados.0.smithi033.stdout:3805: seq_num 1134 ranges {20627456=598016,21225472=638976,21864448=737280,22601728=229376} 2021-07-26T16:10:50.519 INFO:tasks.rados.rados.0.smithi033.stdout:3805: writing smithi03339061-47 from 20627456 to 21225472 tid 1 2021-07-26T16:10:50.522 INFO:tasks.rados.rados.0.smithi033.stdout:3805: writing smithi03339061-47 from 21225472 to 21864448 tid 2 2021-07-26T16:10:50.526 INFO:tasks.rados.rados.0.smithi033.stdout:3805: writing smithi03339061-47 from 21864448 to 22601728 tid 3 2021-07-26T16:10:50.528 INFO:tasks.rados.rados.0.smithi033.stdout:3805: writing smithi03339061-47 from 22601728 to 22831104 tid 4 2021-07-26T16:10:50.529 INFO:tasks.rados.rados.0.smithi033.stdout:3797: done (7 left) 2021-07-26T16:10:50.529 INFO:tasks.rados.rados.0.smithi033.stdout:3806: read oid 3 snap -1 2021-07-26T16:10:50.529 INFO:tasks.rados.rados.0.smithi033.stdout:3806: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:10:50.529 INFO:tasks.rados.rados.0.smithi033.stdout:3807: read oid 33 snap -1 2021-07-26T16:10:50.530 INFO:tasks.rados.rados.0.smithi033.stdout:3807: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:10:50.530 INFO:tasks.rados.rados.0.smithi033.stdout:3808: setattr oid 43 current snap is 373 2021-07-26T16:10:50.530 INFO:tasks.rados.rados.0.smithi033.stdout:3798: finishing write tid 1 to smithi03339061-21 2021-07-26T16:10:50.530 INFO:tasks.rados.rados.0.smithi033.stdout:3798: finishing write tid 2 to smithi03339061-21 2021-07-26T16:10:50.531 INFO:tasks.rados.rados.0.smithi033.stdout:3798: finishing write tid 3 to smithi03339061-21 2021-07-26T16:10:50.531 INFO:tasks.rados.rados.0.smithi033.stdout:3798: finishing write tid 4 to smithi03339061-21 2021-07-26T16:10:50.531 INFO:tasks.rados.rados.0.smithi033.stdout:3798: finishing write tid 5 to smithi03339061-21 2021-07-26T16:10:50.531 INFO:tasks.rados.rados.0.smithi033.stdout:3798: finishing write tid 6 to smithi03339061-21 2021-07-26T16:10:50.532 INFO:tasks.rados.rados.0.smithi033.stdout:3798: finishing write tid 7 to smithi03339061-21 2021-07-26T16:10:50.532 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 2039 (ObjNum 1131 snap 373 seq_num 1131) dirty exists 2021-07-26T16:10:50.532 INFO:tasks.rados.rados.0.smithi033.stdout:3798: left oid 21 (ObjNum 1131 snap 373 seq_num 1131) 2021-07-26T16:10:50.532 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1844 (ObjNum 1112 snap 372 seq_num 1112) dirty exists 2021-07-26T16:10:50.532 INFO:tasks.rados.rados.0.smithi033.stdout:3801: expect (ObjNum 1082 snap 357 seq_num 1082) 2021-07-26T16:10:50.653 INFO:tasks.rados.rados.0.smithi033.stdout:3803: finishing write tid 1 to smithi03339061-2 2021-07-26T16:10:50.654 INFO:tasks.rados.rados.0.smithi033.stdout:3803: finishing write tid 2 to smithi03339061-2 2021-07-26T16:10:50.654 INFO:tasks.rados.rados.0.smithi033.stdout:3803: finishing write tid 3 to smithi03339061-2 2021-07-26T16:10:50.654 INFO:tasks.rados.rados.0.smithi033.stdout:3800: expect (ObjNum 1113 snap 372 seq_num 1113) 2021-07-26T16:10:50.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:50 smithi033 bash[42377]: cluster 2021-07-26T16:10:49.220801+0000 mgr.y (mgr.34104) 506 : cluster [DBG] pgmap v1041: 25 pgs: 25 active+clean; 886 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 948 KiB/s wr, 10 op/s 2021-07-26T16:10:50.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:50 smithi033 bash[42377]: cluster 2021-07-26T16:10:49.332330+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e805: 8 total, 8 up, 8 in 2021-07-26T16:10:50.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:50 smithi033 bash[41341]: cluster 2021-07-26T16:10:49.220801+0000 mgr.y (mgr.34104) 506 : cluster [DBG] pgmap v1041: 25 pgs: 25 active+clean; 886 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 948 KiB/s wr, 10 op/s 2021-07-26T16:10:50.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:50 smithi033 bash[41341]: cluster 2021-07-26T16:10:49.332330+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e805: 8 total, 8 up, 8 in 2021-07-26T16:10:50.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:50 smithi096 bash[33981]: cluster 2021-07-26T16:10:49.220801+0000 mgr.y (mgr.34104) 506 : cluster [DBG] pgmap v1041: 25 pgs: 25 active+clean; 886 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 10 MiB/s rd, 948 KiB/s wr, 10 op/s 2021-07-26T16:10:50.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:50 smithi096 bash[33981]: cluster 2021-07-26T16:10:49.332330+0000 mon.a (mon.0) 1186 : cluster [DBG] osdmap e805: 8 total, 8 up, 8 in 2021-07-26T16:10:50.776 INFO:tasks.rados.rados.0.smithi033.stdout:3803: finishing write tid 4 to smithi03339061-2 2021-07-26T16:10:50.776 INFO:tasks.rados.rados.0.smithi033.stdout:3803: finishing write tid 5 to smithi03339061-2 2021-07-26T16:10:50.776 INFO:tasks.rados.rados.0.smithi033.stdout:3803: finishing write tid 6 to smithi03339061-2 2021-07-26T16:10:50.777 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 2 v 2065 (ObjNum 1132 snap 373 seq_num 1132) dirty exists 2021-07-26T16:10:50.777 INFO:tasks.rados.rados.0.smithi033.stdout:3803: left oid 2 (ObjNum 1132 snap 373 seq_num 1132) 2021-07-26T16:10:50.777 INFO:tasks.rados.rados.0.smithi033.stdout:3804: finishing write tid 1 to smithi03339061-5 2021-07-26T16:10:50.777 INFO:tasks.rados.rados.0.smithi033.stdout:3804: finishing write tid 2 to smithi03339061-5 2021-07-26T16:10:50.777 INFO:tasks.rados.rados.0.smithi033.stdout:3804: finishing write tid 3 to smithi03339061-5 2021-07-26T16:10:50.778 INFO:tasks.rados.rados.0.smithi033.stdout:3804: finishing write tid 4 to smithi03339061-5 2021-07-26T16:10:50.778 INFO:tasks.rados.rados.0.smithi033.stdout:3804: finishing write tid 5 to smithi03339061-5 2021-07-26T16:10:50.778 INFO:tasks.rados.rados.0.smithi033.stdout:3804: finishing write tid 6 to smithi03339061-5 2021-07-26T16:10:50.778 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 2064 (ObjNum 1133 snap 373 seq_num 1133) dirty exists 2021-07-26T16:10:50.779 INFO:tasks.rados.rados.0.smithi033.stdout:3804: left oid 5 (ObjNum 1133 snap 373 seq_num 1133) 2021-07-26T16:10:50.779 INFO:tasks.rados.rados.0.smithi033.stdout:3806: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:10:50.779 INFO:tasks.rados.rados.0.smithi033.stdout:3805: finishing write tid 1 to smithi03339061-47 2021-07-26T16:10:50.780 INFO:tasks.rados.rados.0.smithi033.stdout:3805: finishing write tid 2 to smithi03339061-47 2021-07-26T16:10:50.780 INFO:tasks.rados.rados.0.smithi033.stdout:3805: finishing write tid 3 to smithi03339061-47 2021-07-26T16:10:50.780 INFO:tasks.rados.rados.0.smithi033.stdout:3805: finishing write tid 4 to smithi03339061-47 2021-07-26T16:10:50.780 INFO:tasks.rados.rados.0.smithi033.stdout:3807: expect (ObjNum 655 snap 210 seq_num 655) 2021-07-26T16:10:50.851 INFO:tasks.rados.rados.0.smithi033.stdout:3805: finishing write tid 5 to smithi03339061-47 2021-07-26T16:10:50.851 INFO:tasks.rados.rados.0.smithi033.stdout:3805: finishing write tid 6 to smithi03339061-47 2021-07-26T16:10:50.852 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 2082 (ObjNum 1134 snap 373 seq_num 1134) dirty exists 2021-07-26T16:10:50.852 INFO:tasks.rados.rados.0.smithi033.stdout:3805: left oid 47 (ObjNum 1134 snap 373 seq_num 1134) 2021-07-26T16:10:50.852 INFO:tasks.rados.rados.0.smithi033.stdout:3798: done (9 left) 2021-07-26T16:10:50.852 INFO:tasks.rados.rados.0.smithi033.stdout:3800: done (8 left) 2021-07-26T16:10:50.852 INFO:tasks.rados.rados.0.smithi033.stdout:3801: done (7 left) 2021-07-26T16:10:50.853 INFO:tasks.rados.rados.0.smithi033.stdout:3802: done (6 left) 2021-07-26T16:10:50.853 INFO:tasks.rados.rados.0.smithi033.stdout:3803: done (5 left) 2021-07-26T16:10:50.853 INFO:tasks.rados.rados.0.smithi033.stdout:3804: done (4 left) 2021-07-26T16:10:50.853 INFO:tasks.rados.rados.0.smithi033.stdout:3805: done (3 left) 2021-07-26T16:10:50.854 INFO:tasks.rados.rados.0.smithi033.stdout:3806: done (2 left) 2021-07-26T16:10:50.854 INFO:tasks.rados.rados.0.smithi033.stdout:3807: done (1 left) 2021-07-26T16:10:50.854 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 373 2021-07-26T16:10:50.854 INFO:tasks.rados.rados.0.smithi033.stdout:3809: seq_num 1135 ranges {4833280=614400,5447680=524288,5971968=540672,6512640=483328,6995968=57344} 2021-07-26T16:10:50.890 INFO:tasks.rados.rados.0.smithi033.stdout:3809: writing smithi03339061-4 from 4833280 to 5447680 tid 1 2021-07-26T16:10:50.894 INFO:tasks.rados.rados.0.smithi033.stdout:3809: writing smithi03339061-4 from 5447680 to 5971968 tid 2 2021-07-26T16:10:50.897 INFO:tasks.rados.rados.0.smithi033.stdout:3809: writing smithi03339061-4 from 5971968 to 6512640 tid 3 2021-07-26T16:10:50.900 INFO:tasks.rados.rados.0.smithi033.stdout:3809: writing smithi03339061-4 from 6512640 to 6995968 tid 4 2021-07-26T16:10:50.901 INFO:tasks.rados.rados.0.smithi033.stdout:3809: writing smithi03339061-4 from 6995968 to 7053312 tid 5 2021-07-26T16:10:50.901 INFO:tasks.rados.rados.0.smithi033.stdout:3810: copy_from oid 3 from oid 47 current snap is 373 2021-07-26T16:10:50.901 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 2065 (ObjNum 1121 snap 373 seq_num 1121) dirty exists 2021-07-26T16:10:50.902 INFO:tasks.rados.rados.0.smithi033.stdout:3808: done (2 left) 2021-07-26T16:10:50.902 INFO:tasks.rados.rados.0.smithi033.stdout:3811: setattr oid 11 current snap is 373 2021-07-26T16:10:50.902 INFO:tasks.rados.rados.0.smithi033.stdout:3809: finishing write tid 1 to smithi03339061-4 2021-07-26T16:10:50.904 INFO:tasks.rados.rados.0.smithi033.stdout:3812: copy_from oid 34 from oid 1 current snap is 373 2021-07-26T16:10:50.904 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 373 2021-07-26T16:10:50.904 INFO:tasks.rados.rados.0.smithi033.stdout:3813: seq_num 1136 ranges {303104=630784,933888=409600,1343488=753664,2097152=417792,2514944=24576} 2021-07-26T16:10:50.909 INFO:tasks.rados.rados.0.smithi033.stdout:3813: writing smithi03339061-7 from 303104 to 933888 tid 1 2021-07-26T16:10:50.912 INFO:tasks.rados.rados.0.smithi033.stdout:3813: writing smithi03339061-7 from 933888 to 1343488 tid 2 2021-07-26T16:10:50.917 INFO:tasks.rados.rados.0.smithi033.stdout:3813: writing smithi03339061-7 from 1343488 to 2097152 tid 3 2021-07-26T16:10:50.921 INFO:tasks.rados.rados.0.smithi033.stdout:3813: writing smithi03339061-7 from 2097152 to 2514944 tid 4 2021-07-26T16:10:50.921 INFO:tasks.rados.rados.0.smithi033.stdout:3813: writing smithi03339061-7 from 2514944 to 2539520 tid 5 2021-07-26T16:10:50.921 INFO:tasks.rados.rados.0.smithi033.stdout:3809: finishing write tid 2 to smithi03339061-4 2021-07-26T16:10:50.922 INFO:tasks.rados.rados.0.smithi033.stdout:3809: finishing write tid 3 to smithi03339061-4 2021-07-26T16:10:50.922 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1455 (ObjNum 1027 snap 341 seq_num 1027) dirty exists 2021-07-26T16:10:50.922 INFO:tasks.rados.rados.0.smithi033.stdout:3809: finishing write tid 4 to smithi03339061-4 2021-07-26T16:10:50.922 INFO:tasks.rados.rados.0.smithi033.stdout:3814: read oid 42 snap -1 2021-07-26T16:10:50.922 INFO:tasks.rados.rados.0.smithi033.stdout:3814: expect (ObjNum 1112 snap 372 seq_num 1112) 2021-07-26T16:10:50.923 INFO:tasks.rados.rados.0.smithi033.stdout:3811: done (5 left) 2021-07-26T16:10:50.923 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 36 current snap is 373 2021-07-26T16:10:50.923 INFO:tasks.rados.rados.0.smithi033.stdout:3809: finishing write tid 5 to smithi03339061-4 2021-07-26T16:10:50.923 INFO:tasks.rados.rados.0.smithi033.stdout:3815: seq_num 1137 ranges {0=647168,647168=696320,1343488=557056,1900544=352256} 2021-07-26T16:10:50.925 INFO:tasks.rados.rados.0.smithi033.stdout:3815: writing smithi03339061-36 from 0 to 647168 tid 1 2021-07-26T16:10:50.929 INFO:tasks.rados.rados.0.smithi033.stdout:3815: writing smithi03339061-36 from 647168 to 1343488 tid 2 2021-07-26T16:10:50.932 INFO:tasks.rados.rados.0.smithi033.stdout:3815: writing smithi03339061-36 from 1343488 to 1900544 tid 3 2021-07-26T16:10:50.935 INFO:tasks.rados.rados.0.smithi033.stdout:3815: writing smithi03339061-36 from 1900544 to 2252800 tid 4 2021-07-26T16:10:50.935 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 373 2021-07-26T16:10:50.935 INFO:tasks.rados.rados.0.smithi033.stdout:3809: finishing write tid 6 to smithi03339061-4 2021-07-26T16:10:50.935 INFO:tasks.rados.rados.0.smithi033.stdout:3816: seq_num 1138 ranges {5775360=663552,6438912=581632,7020544=712704,7733248=311296} 2021-07-26T16:10:50.971 INFO:tasks.rados.rados.0.smithi033.stdout:3816: writing smithi03339061-5 from 5775360 to 6438912 tid 1 2021-07-26T16:10:50.975 INFO:tasks.rados.rados.0.smithi033.stdout:3816: writing smithi03339061-5 from 6438912 to 7020544 tid 2 2021-07-26T16:10:50.979 INFO:tasks.rados.rados.0.smithi033.stdout:3816: writing smithi03339061-5 from 7020544 to 7733248 tid 3 2021-07-26T16:10:50.981 INFO:tasks.rados.rados.0.smithi033.stdout:3816: writing smithi03339061-5 from 7733248 to 8044544 tid 4 2021-07-26T16:10:50.981 INFO:tasks.rados.rados.0.smithi033.stdout:3817: snap_remove snap 353 2021-07-26T16:10:51.298 INFO:tasks.rados.rados.0.smithi033.stdout:3809: finishing write tid 7 to smithi03339061-4 2021-07-26T16:10:51.298 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 2089 (ObjNum 1135 snap 373 seq_num 1135) dirty exists 2021-07-26T16:10:51.298 INFO:tasks.rados.rados.0.smithi033.stdout:3809: left oid 4 (ObjNum 1135 snap 373 seq_num 1135) 2021-07-26T16:10:51.298 INFO:tasks.rados.rados.0.smithi033.stdout:3813: finishing write tid 1 to smithi03339061-7 2021-07-26T16:10:51.299 INFO:tasks.rados.rados.0.smithi033.stdout:3813: finishing write tid 2 to smithi03339061-7 2021-07-26T16:10:51.299 INFO:tasks.rados.rados.0.smithi033.stdout:3815: finishing write tid 1 to smithi03339061-36 2021-07-26T16:10:51.299 INFO:tasks.rados.rados.0.smithi033.stdout:3813: finishing write tid 3 to smithi03339061-7 2021-07-26T16:10:51.299 INFO:tasks.rados.rados.0.smithi033.stdout:3813: finishing write tid 4 to smithi03339061-7 2021-07-26T16:10:51.300 INFO:tasks.rados.rados.0.smithi033.stdout:3813: finishing write tid 5 to smithi03339061-7 2021-07-26T16:10:51.300 INFO:tasks.rados.rados.0.smithi033.stdout:3813: finishing write tid 6 to smithi03339061-7 2021-07-26T16:10:51.300 INFO:tasks.rados.rados.0.smithi033.stdout:3813: finishing write tid 7 to smithi03339061-7 2021-07-26T16:10:51.300 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 2053 (ObjNum 1136 snap 373 seq_num 1136) dirty exists 2021-07-26T16:10:51.300 INFO:tasks.rados.rados.0.smithi033.stdout:3813: left oid 7 (ObjNum 1136 snap 373 seq_num 1136) 2021-07-26T16:10:51.301 INFO:tasks.rados.rados.0.smithi033.stdout:3814: expect (ObjNum 1112 snap 372 seq_num 1112) 2021-07-26T16:10:51.369 INFO:tasks.rados.rados.0.smithi033.stdout:3815: finishing write tid 2 to smithi03339061-36 2021-07-26T16:10:51.369 INFO:tasks.rados.rados.0.smithi033.stdout:3815: finishing write tid 3 to smithi03339061-36 2021-07-26T16:10:51.370 INFO:tasks.rados.rados.0.smithi033.stdout:3815: finishing write tid 4 to smithi03339061-36 2021-07-26T16:10:51.370 INFO:tasks.rados.rados.0.smithi033.stdout:3812: finishing copy_from to smithi03339061-34 2021-07-26T16:10:51.370 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1090 (ObjNum 1066 snap 349 seq_num 1066) dirty exists 2021-07-26T16:10:51.370 INFO:tasks.rados.rados.0.smithi033.stdout:3812: finishing copy_from racing read to smithi03339061-34 2021-07-26T16:10:51.370 INFO:tasks.rados.rados.0.smithi033.stdout:3815: finishing write tid 5 to smithi03339061-36 2021-07-26T16:10:51.371 INFO:tasks.rados.rados.0.smithi033.stdout:3809: done (7 left) 2021-07-26T16:10:51.371 INFO:tasks.rados.rados.0.smithi033.stdout:3812: done (6 left) 2021-07-26T16:10:51.371 INFO:tasks.rados.rados.0.smithi033.stdout:3813: done (5 left) 2021-07-26T16:10:51.371 INFO:tasks.rados.rados.0.smithi033.stdout:3814: done (4 left) 2021-07-26T16:10:51.372 INFO:tasks.rados.rados.0.smithi033.stdout:3817: done (3 left) 2021-07-26T16:10:51.372 INFO:tasks.rados.rados.0.smithi033.stdout:3818: copy_from oid 44 from oid 19 current snap is 373 2021-07-26T16:10:51.372 INFO:tasks.rados.rados.0.smithi033.stdout:3815: finishing write tid 6 to smithi03339061-36 2021-07-26T16:10:51.372 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1460 (ObjNum 1137 snap 373 seq_num 1137) dirty exists 2021-07-26T16:10:51.373 INFO:tasks.rados.rados.0.smithi033.stdout:3815: left oid 36 (ObjNum 1137 snap 373 seq_num 1137) 2021-07-26T16:10:51.373 INFO:tasks.rados.rados.0.smithi033.stdout:3816: finishing write tid 1 to smithi03339061-5 2021-07-26T16:10:51.373 INFO:tasks.rados.rados.0.smithi033.stdout:3816: finishing write tid 2 to smithi03339061-5 2021-07-26T16:10:51.373 INFO:tasks.rados.rados.0.smithi033.stdout:3816: finishing write tid 3 to smithi03339061-5 2021-07-26T16:10:51.373 INFO:tasks.rados.rados.0.smithi033.stdout:3816: finishing write tid 4 to smithi03339061-5 2021-07-26T16:10:51.374 INFO:tasks.rados.rados.0.smithi033.stdout:3816: finishing write tid 5 to smithi03339061-5 2021-07-26T16:10:51.374 INFO:tasks.rados.rados.0.smithi033.stdout:3816: finishing write tid 6 to smithi03339061-5 2021-07-26T16:10:51.374 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 2070 (ObjNum 1138 snap 373 seq_num 1138) dirty exists 2021-07-26T16:10:51.374 INFO:tasks.rados.rados.0.smithi033.stdout:3816: left oid 5 (ObjNum 1138 snap 373 seq_num 1138) 2021-07-26T16:10:51.375 INFO:tasks.rados.rados.0.smithi033.stdout:3815: done (3 left) 2021-07-26T16:10:51.375 INFO:tasks.rados.rados.0.smithi033.stdout:3816: done (2 left) 2021-07-26T16:10:51.375 INFO:tasks.rados.rados.0.smithi033.stdout:3819: copy_from oid 42 from oid 34 current snap is 373 2021-07-26T16:10:51.375 INFO:tasks.rados.rados.0.smithi033.stdout:3810: finishing copy_from to smithi03339061-3 2021-07-26T16:10:51.375 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 2082 (ObjNum 1134 snap 373 seq_num 1134) dirty exists 2021-07-26T16:10:51.376 INFO:tasks.rados.rados.0.smithi033.stdout:3810: finishing copy_from racing read to smithi03339061-3 2021-07-26T16:10:51.376 INFO:tasks.rados.rados.0.smithi033.stdout:3810: done (2 left) 2021-07-26T16:10:51.376 INFO:tasks.rados.rados.0.smithi033.stdout:3820: read oid 38 snap -1 2021-07-26T16:10:51.376 INFO:tasks.rados.rados.0.smithi033.stdout:3820: expect (ObjNum 1031 snap 344 seq_num 1031) 2021-07-26T16:10:51.377 INFO:tasks.rados.rados.0.smithi033.stdout:3821: copy_from oid 15 from oid 49 current snap is 373 2021-07-26T16:10:51.377 INFO:tasks.rados.rados.0.smithi033.stdout:3822: read oid 36 snap -1 2021-07-26T16:10:51.377 INFO:tasks.rados.rados.0.smithi033.stdout:3822: expect (ObjNum 1137 snap 373 seq_num 1137) 2021-07-26T16:10:51.377 INFO:tasks.rados.rados.0.smithi033.stdout:3823: copy_from oid 45 from oid 31 current snap is 373 2021-07-26T16:10:51.378 INFO:tasks.rados.rados.0.smithi033.stdout:3824: copy_from oid 41 from oid 10 current snap is 373 2021-07-26T16:10:51.378 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 373 2021-07-26T16:10:51.378 INFO:tasks.rados.rados.0.smithi033.stdout:3825: seq_num 1139 ranges {8044544=679936,8724480=458752,9183232=524288,9707520=540672,10248192=81920} 2021-07-26T16:10:51.425 INFO:tasks.rados.rados.0.smithi033.stdout:3825: writing smithi03339061-5 from 8044544 to 8724480 tid 1 2021-07-26T16:10:51.427 INFO:tasks.rados.rados.0.smithi033.stdout:3825: writing smithi03339061-5 from 8724480 to 9183232 tid 2 2021-07-26T16:10:51.430 INFO:tasks.rados.rados.0.smithi033.stdout:3825: writing smithi03339061-5 from 9183232 to 9707520 tid 3 2021-07-26T16:10:51.433 INFO:tasks.rados.rados.0.smithi033.stdout:3825: writing smithi03339061-5 from 9707520 to 10248192 tid 4 2021-07-26T16:10:51.434 INFO:tasks.rados.rados.0.smithi033.stdout:3825: writing smithi03339061-5 from 10248192 to 10330112 tid 5 2021-07-26T16:10:51.435 INFO:tasks.rados.rados.0.smithi033.stdout:3826: rollback oid 17 current snap is 373 2021-07-26T16:10:51.435 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 17 to 370 2021-07-26T16:10:51.435 INFO:tasks.rados.rados.0.smithi033.stdout:3818: finishing copy_from to smithi03339061-44 2021-07-26T16:10:51.435 INFO:tasks.rados.rados.0.smithi033.stdout:3818: got expected ENOENT (src dne) 2021-07-26T16:10:51.436 INFO:tasks.rados.rados.0.smithi033.stdout:3827: rmattr oid 20 current snap is 373 2021-07-26T16:10:51.436 INFO:tasks.rados.rados.0.smithi033.stdout:3818: finishing copy_from racing read to smithi03339061-44 2021-07-26T16:10:51.436 INFO:tasks.rados.rados.0.smithi033.stdout:3818: done (9 left) 2021-07-26T16:10:51.436 INFO:tasks.rados.rados.0.smithi033.stdout:3827: done (8 left) 2021-07-26T16:10:51.436 INFO:tasks.rados.rados.0.smithi033.stdout:3828: read oid 11 snap -1 2021-07-26T16:10:51.437 INFO:tasks.rados.rados.0.smithi033.stdout:3828: expect (ObjNum 1027 snap 341 seq_num 1027) 2021-07-26T16:10:51.437 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 373 2021-07-26T16:10:51.437 INFO:tasks.rados.rados.0.smithi033.stdout:3829: seq_num 1140 ranges {3178496=696320,3874816=745472,4620288=729088,5349376=131072} 2021-07-26T16:10:51.456 INFO:tasks.rados.rados.0.smithi033.stdout:3829: writing smithi03339061-43 from 3178496 to 3874816 tid 1 2021-07-26T16:10:51.460 INFO:tasks.rados.rados.0.smithi033.stdout:3829: writing smithi03339061-43 from 3874816 to 4620288 tid 2 2021-07-26T16:10:51.464 INFO:tasks.rados.rados.0.smithi033.stdout:3829: writing smithi03339061-43 from 4620288 to 5349376 tid 3 2021-07-26T16:10:51.465 INFO:tasks.rados.rados.0.smithi033.stdout:3829: writing smithi03339061-43 from 5349376 to 5480448 tid 4 2021-07-26T16:10:51.465 INFO:tasks.rados.rados.0.smithi033.stdout:3830: setattr oid 3 current snap is 373 2021-07-26T16:10:51.466 INFO:tasks.rados.rados.0.smithi033.stdout:3820: expect (ObjNum 1031 snap 344 seq_num 1031) 2021-07-26T16:10:51.589 INFO:tasks.rados.rados.0.smithi033.stdout:3824: finishing copy_from to smithi03339061-41 2021-07-26T16:10:51.589 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 41 v 2060 (ObjNum 1125 snap 373 seq_num 1125) dirty exists 2021-07-26T16:10:51.589 INFO:tasks.rados.rados.0.smithi033.stdout:3824: finishing copy_from racing read to smithi03339061-41 2021-07-26T16:10:51.589 INFO:tasks.rados.rados.0.smithi033.stdout:3822: expect (ObjNum 1137 snap 373 seq_num 1137) 2021-07-26T16:10:51.648 INFO:tasks.rados.rados.0.smithi033.stdout:3821: finishing copy_from to smithi03339061-15 2021-07-26T16:10:51.649 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 966 (ObjNum 1128 snap 373 seq_num 1128) dirty exists 2021-07-26T16:10:51.649 INFO:tasks.rados.rados.0.smithi033.stdout:3821: finishing copy_from racing read to smithi03339061-15 2021-07-26T16:10:51.649 INFO:tasks.rados.rados.0.smithi033.stdout:3823: finishing copy_from to smithi03339061-45 2021-07-26T16:10:51.650 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1864 (ObjNum 1126 snap 373 seq_num 1126) dirty exists 2021-07-26T16:10:51.651 INFO:tasks.rados.rados.0.smithi033.stdout:3823: finishing copy_from racing read to smithi03339061-45 2021-07-26T16:10:51.651 INFO:tasks.rados.rados.0.smithi033.stdout:3819: finishing copy_from to smithi03339061-42 2021-07-26T16:10:51.652 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1090 (ObjNum 1066 snap 349 seq_num 1066) dirty exists 2021-07-26T16:10:51.652 INFO:tasks.rados.rados.0.smithi033.stdout:3819: finishing copy_from racing read to smithi03339061-42 2021-07-26T16:10:51.652 INFO:tasks.rados.rados.0.smithi033.stdout:3825: finishing write tid 1 to smithi03339061-5 2021-07-26T16:10:51.653 INFO:tasks.rados.rados.0.smithi033.stdout:3825: finishing write tid 2 to smithi03339061-5 2021-07-26T16:10:51.653 INFO:tasks.rados.rados.0.smithi033.stdout:3825: finishing write tid 3 to smithi03339061-5 2021-07-26T16:10:51.654 INFO:tasks.rados.rados.0.smithi033.stdout:3826: finishing rollback tid 1 to smithi03339061-17 2021-07-26T16:10:51.654 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 1415 (ObjNum 0 snap 0 seq_num 0) dirty dne 2021-07-26T16:10:51.655 INFO:tasks.rados.rados.0.smithi033.stdout:3825: finishing write tid 4 to smithi03339061-5 2021-07-26T16:10:51.655 INFO:tasks.rados.rados.0.smithi033.stdout:3825: finishing write tid 5 to smithi03339061-5 2021-07-26T16:10:51.655 INFO:tasks.rados.rados.0.smithi033.stdout:3825: finishing write tid 6 to smithi03339061-5 2021-07-26T16:10:51.656 INFO:tasks.rados.rados.0.smithi033.stdout:3825: finishing write tid 7 to smithi03339061-5 2021-07-26T16:10:51.656 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 2076 (ObjNum 1139 snap 373 seq_num 1139) dirty exists 2021-07-26T16:10:51.657 INFO:tasks.rados.rados.0.smithi033.stdout:3825: left oid 5 (ObjNum 1139 snap 373 seq_num 1139) 2021-07-26T16:10:51.657 INFO:tasks.rados.rados.0.smithi033.stdout:3829: finishing write tid 1 to smithi03339061-43 2021-07-26T16:10:51.658 INFO:tasks.rados.rados.0.smithi033.stdout:3829: finishing write tid 2 to smithi03339061-43 2021-07-26T16:10:51.658 INFO:tasks.rados.rados.0.smithi033.stdout:3829: finishing write tid 3 to smithi03339061-43 2021-07-26T16:10:51.658 INFO:tasks.rados.rados.0.smithi033.stdout:3829: finishing write tid 4 to smithi03339061-43 2021-07-26T16:10:51.659 INFO:tasks.rados.rados.0.smithi033.stdout:3829: finishing write tid 5 to smithi03339061-43 2021-07-26T16:10:51.659 INFO:tasks.rados.rados.0.smithi033.stdout:3829: finishing write tid 6 to smithi03339061-43 2021-07-26T16:10:51.662 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 2081 (ObjNum 1140 snap 373 seq_num 1140) dirty exists 2021-07-26T16:10:51.663 INFO:tasks.rados.rados.0.smithi033.stdout:3829: left oid 43 (ObjNum 1140 snap 373 seq_num 1140) 2021-07-26T16:10:51.663 INFO:tasks.rados.rados.0.smithi033.stdout:3828: expect (ObjNum 1027 snap 341 seq_num 1027) 2021-07-26T16:10:51.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:51 smithi033 bash[42377]: cluster 2021-07-26T16:10:50.341162+0000 mon.a (mon.0) 1187 : cluster [DBG] osdmap e806: 8 total, 8 up, 8 in 2021-07-26T16:10:51.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:51 smithi033 bash[42377]: cluster 2021-07-26T16:10:51.294590+0000 mon.a (mon.0) 1188 : cluster [DBG] osdmap e807: 8 total, 8 up, 8 in 2021-07-26T16:10:51.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:51 smithi033 bash[41341]: cluster 2021-07-26T16:10:50.341162+0000 mon.a (mon.0) 1187 : cluster [DBG] osdmap e806: 8 total, 8 up, 8 in 2021-07-26T16:10:51.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:51 smithi033 bash[41341]: cluster 2021-07-26T16:10:51.294590+0000 mon.a (mon.0) 1188 : cluster [DBG] osdmap e807: 8 total, 8 up, 8 in 2021-07-26T16:10:51.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:51 smithi096 bash[33981]: cluster 2021-07-26T16:10:50.341162+0000 mon.a (mon.0) 1187 : cluster [DBG] osdmap e806: 8 total, 8 up, 8 in 2021-07-26T16:10:51.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:51 smithi096 bash[33981]: cluster 2021-07-26T16:10:51.294590+0000 mon.a (mon.0) 1188 : cluster [DBG] osdmap e807: 8 total, 8 up, 8 in 2021-07-26T16:10:52.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:52 smithi033 bash[41341]: cluster 2021-07-26T16:10:51.221674+0000 mgr.y (mgr.34104) 507 : cluster [DBG] pgmap v1044: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 915 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 5.7 MiB/s wr, 33 op/s 2021-07-26T16:10:52.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:52 smithi033 bash[42377]: cluster 2021-07-26T16:10:51.221674+0000 mgr.y (mgr.34104) 507 : cluster [DBG] pgmap v1044: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 915 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 5.7 MiB/s wr, 33 op/s 2021-07-26T16:10:52.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:52 smithi096 bash[33981]: cluster 2021-07-26T16:10:51.221674+0000 mgr.y (mgr.34104) 507 : cluster [DBG] pgmap v1044: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 915 MiB data, 3.7 GiB used, 712 GiB / 715 GiB avail; 3.7 MiB/s rd, 5.7 MiB/s wr, 33 op/s 2021-07-26T16:10:53.397 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 3 v 2083 (ObjNum 1134 snap 373 seq_num 1134) dirty exists 2021-07-26T16:10:53.397 INFO:tasks.rados.rados.0.smithi033.stdout:3819: done (10 left) 2021-07-26T16:10:53.398 INFO:tasks.rados.rados.0.smithi033.stdout:3820: done (9 left) 2021-07-26T16:10:53.398 INFO:tasks.rados.rados.0.smithi033.stdout:3821: done (8 left) 2021-07-26T16:10:53.398 INFO:tasks.rados.rados.0.smithi033.stdout:3822: done (7 left) 2021-07-26T16:10:53.398 INFO:tasks.rados.rados.0.smithi033.stdout:3823: done (6 left) 2021-07-26T16:10:53.398 INFO:tasks.rados.rados.0.smithi033.stdout:3824: done (5 left) 2021-07-26T16:10:53.399 INFO:tasks.rados.rados.0.smithi033.stdout:3825: done (4 left) 2021-07-26T16:10:53.399 INFO:tasks.rados.rados.0.smithi033.stdout:3826: done (3 left) 2021-07-26T16:10:53.399 INFO:tasks.rados.rados.0.smithi033.stdout:3828: done (2 left) 2021-07-26T16:10:53.399 INFO:tasks.rados.rados.0.smithi033.stdout:3829: done (1 left) 2021-07-26T16:10:53.399 INFO:tasks.rados.rados.0.smithi033.stdout:3830: done (0 left) 2021-07-26T16:10:53.400 INFO:tasks.rados.rados.0.smithi033.stdout:3831: snap_create 2021-07-26T16:10:54.360 INFO:tasks.rados.rados.0.smithi033.stdout:3831: done (0 left) 2021-07-26T16:10:54.360 INFO:tasks.rados.rados.0.smithi033.stdout:3832: rollback oid 7 current snap is 374 2021-07-26T16:10:54.360 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 7 to 352 2021-07-26T16:10:54.361 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 22 current snap is 374 2021-07-26T16:10:54.361 INFO:tasks.rados.rados.0.smithi033.stdout:3833: seq_num 1141 ranges {4833280=712704,5545984=679936,6225920=540672,6766592=385024} 2021-07-26T16:10:54.392 INFO:tasks.rados.rados.0.smithi033.stdout:3833: writing smithi03339061-22 from 4833280 to 5545984 tid 1 2021-07-26T16:10:54.396 INFO:tasks.rados.rados.0.smithi033.stdout:3833: writing smithi03339061-22 from 5545984 to 6225920 tid 2 2021-07-26T16:10:54.399 INFO:tasks.rados.rados.0.smithi033.stdout:3833: writing smithi03339061-22 from 6225920 to 6766592 tid 3 2021-07-26T16:10:54.402 INFO:tasks.rados.rados.0.smithi033.stdout:3833: writing smithi03339061-22 from 6766592 to 7151616 tid 4 2021-07-26T16:10:54.402 INFO:tasks.rados.rados.0.smithi033.stdout:3834: rollback oid 17 current snap is 374 2021-07-26T16:10:54.403 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 17 to 275 2021-07-26T16:10:54.403 INFO:tasks.rados.rados.0.smithi033.stdout:3832: finishing rollback tid 0 to smithi03339061-7 2021-07-26T16:10:54.403 INFO:tasks.rados.rados.0.smithi033.stdout:3835: rmattr oid 40 current snap is 374 2021-07-26T16:10:54.403 INFO:tasks.rados.rados.0.smithi033.stdout:3835: done (3 left) 2021-07-26T16:10:54.403 INFO:tasks.rados.rados.0.smithi033.stdout:3836: rmattr oid 33 current snap is 374 2021-07-26T16:10:54.404 INFO:tasks.rados.rados.0.smithi033.stdout:3836: done (3 left) 2021-07-26T16:10:54.404 INFO:tasks.rados.rados.0.smithi033.stdout:3837: read oid 30 snap -1 2021-07-26T16:10:54.404 INFO:tasks.rados.rados.0.smithi033.stdout:3837: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:10:54.404 INFO:tasks.rados.rados.0.smithi033.stdout:3838: snap_remove snap 363 2021-07-26T16:10:54.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:54 smithi033 bash[41341]: cluster 2021-07-26T16:10:53.222416+0000 mgr.y (mgr.34104) 508 : cluster [DBG] pgmap v1046: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 935 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 13 MiB/s wr, 50 op/s 2021-07-26T16:10:54.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:54 smithi033 bash[42377]: cluster 2021-07-26T16:10:53.222416+0000 mgr.y (mgr.34104) 508 : cluster [DBG] pgmap v1046: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 935 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 13 MiB/s wr, 50 op/s 2021-07-26T16:10:54.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:54 smithi096 bash[33981]: cluster 2021-07-26T16:10:53.222416+0000 mgr.y (mgr.34104) 508 : cluster [DBG] pgmap v1046: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 935 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 11 MiB/s rd, 13 MiB/s wr, 50 op/s 2021-07-26T16:10:55.375 INFO:tasks.rados.rados.0.smithi033.stdout:3838: done (4 left) 2021-07-26T16:10:55.376 INFO:tasks.rados.rados.0.smithi033.stdout:3839: read oid 27 snap -1 2021-07-26T16:10:55.376 INFO:tasks.rados.rados.0.smithi033.stdout:3839: expect deleted 2021-07-26T16:10:55.376 INFO:tasks.rados.rados.0.smithi033.stdout:3840: copy_from oid 39 from oid 6 current snap is 374 2021-07-26T16:10:55.376 INFO:tasks.rados.rados.0.smithi033.stdout:3832: finishing rollback tid 1 to smithi03339061-7 2021-07-26T16:10:55.376 INFO:tasks.rados.rados.0.smithi033.stdout:3832: finishing rollback tid 2 to smithi03339061-7 2021-07-26T16:10:55.377 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 2065 (ObjNum 1021 snap 341 seq_num 1021) dirty exists 2021-07-26T16:10:55.377 INFO:tasks.rados.rados.0.smithi033.stdout:3833: finishing write tid 1 to smithi03339061-22 2021-07-26T16:10:55.377 INFO:tasks.rados.rados.0.smithi033.stdout:3833: finishing write tid 2 to smithi03339061-22 2021-07-26T16:10:55.377 INFO:tasks.rados.rados.0.smithi033.stdout:3834: finishing rollback tid 1 to smithi03339061-17 2021-07-26T16:10:55.378 INFO:tasks.rados.rados.0.smithi033.stdout:3834: finishing rollback tid 2 to smithi03339061-17 2021-07-26T16:10:55.378 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 1417 (ObjNum 815 snap 272 seq_num 815) dirty exists 2021-07-26T16:10:55.378 INFO:tasks.rados.rados.0.smithi033.stdout:3833: finishing write tid 3 to smithi03339061-22 2021-07-26T16:10:55.378 INFO:tasks.rados.rados.0.smithi033.stdout:3833: finishing write tid 4 to smithi03339061-22 2021-07-26T16:10:55.379 INFO:tasks.rados.rados.0.smithi033.stdout:3833: finishing write tid 5 to smithi03339061-22 2021-07-26T16:10:55.379 INFO:tasks.rados.rados.0.smithi033.stdout:3837: expect (ObjNum 890 snap 292 seq_num 890) 2021-07-26T16:10:55.555 INFO:tasks.rados.rados.0.smithi033.stdout:3833: finishing write tid 6 to smithi03339061-22 2021-07-26T16:10:55.555 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 2502 (ObjNum 1141 snap 374 seq_num 1141) dirty exists 2021-07-26T16:10:55.555 INFO:tasks.rados.rados.0.smithi033.stdout:3833: left oid 22 (ObjNum 1141 snap 374 seq_num 1141) 2021-07-26T16:10:55.556 INFO:tasks.rados.rados.0.smithi033.stdout:3832: done (5 left) 2021-07-26T16:10:55.556 INFO:tasks.rados.rados.0.smithi033.stdout:3833: done (4 left) 2021-07-26T16:10:55.556 INFO:tasks.rados.rados.0.smithi033.stdout:3834: done (3 left) 2021-07-26T16:10:55.556 INFO:tasks.rados.rados.0.smithi033.stdout:3837: done (2 left) 2021-07-26T16:10:55.556 INFO:tasks.rados.rados.0.smithi033.stdout:3841: delete oid 14 current snap is 374 2021-07-26T16:10:55.557 INFO:tasks.rados.rados.0.smithi033.stdout:3840: finishing copy_from to smithi03339061-39 2021-07-26T16:10:55.557 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 39 v 2182 (ObjNum 824 snap 274 seq_num 824) dirty exists 2021-07-26T16:10:55.557 INFO:tasks.rados.rados.0.smithi033.stdout:3840: finishing copy_from racing read to smithi03339061-39 2021-07-26T16:10:55.560 INFO:tasks.rados.rados.0.smithi033.stdout:3839: done (2 left) 2021-07-26T16:10:55.560 INFO:tasks.rados.rados.0.smithi033.stdout:3840: done (1 left) 2021-07-26T16:10:55.560 INFO:tasks.rados.rados.0.smithi033.stdout:3841: done (0 left) 2021-07-26T16:10:55.560 INFO:tasks.rados.rados.0.smithi033.stdout:3842: snap_remove snap 373 2021-07-26T16:10:55.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:55 smithi033 bash[41341]: cluster 2021-07-26T16:10:54.355149+0000 mon.a (mon.0) 1189 : cluster [DBG] osdmap e808: 8 total, 8 up, 8 in 2021-07-26T16:10:55.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:55 smithi033 bash[42377]: cluster 2021-07-26T16:10:54.355149+0000 mon.a (mon.0) 1189 : cluster [DBG] osdmap e808: 8 total, 8 up, 8 in 2021-07-26T16:10:55.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:55 smithi096 bash[33981]: cluster 2021-07-26T16:10:54.355149+0000 mon.a (mon.0) 1189 : cluster [DBG] osdmap e808: 8 total, 8 up, 8 in 2021-07-26T16:10:56.299 INFO:tasks.rados.rados.0.smithi033.stdout:3842: done (0 left) 2021-07-26T16:10:56.300 INFO:tasks.rados.rados.0.smithi033.stdout:3843: read oid 36 snap 312 2021-07-26T16:10:56.300 INFO:tasks.rados.rados.0.smithi033.stdout:3843: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:10:56.300 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 374 2021-07-26T16:10:56.301 INFO:tasks.rados.rados.0.smithi033.stdout:3844: seq_num 1143 ranges {5480448=753664,6234112=450560,6684672=507904,7192576=589824,7782400=57344} 2021-07-26T16:10:56.337 INFO:tasks.rados.rados.0.smithi033.stdout:3844: writing smithi03339061-43 from 5480448 to 6234112 tid 1 2021-07-26T16:10:56.340 INFO:tasks.rados.rados.0.smithi033.stdout:3844: writing smithi03339061-43 from 6234112 to 6684672 tid 2 2021-07-26T16:10:56.343 INFO:tasks.rados.rados.0.smithi033.stdout:3844: writing smithi03339061-43 from 6684672 to 7192576 tid 3 2021-07-26T16:10:56.346 INFO:tasks.rados.rados.0.smithi033.stdout:3844: writing smithi03339061-43 from 7192576 to 7782400 tid 4 2021-07-26T16:10:56.347 INFO:tasks.rados.rados.0.smithi033.stdout:3844: writing smithi03339061-43 from 7782400 to 7839744 tid 5 2021-07-26T16:10:56.347 INFO:tasks.rados.rados.0.smithi033.stdout:3845: copy_from oid 9 from oid 18 current snap is 374 2021-07-26T16:10:56.347 INFO:tasks.rados.rados.0.smithi033.stdout:3843: expect (ObjNum 673 snap 219 seq_num 673) 2021-07-26T16:10:56.414 INFO:tasks.rados.rados.0.smithi033.stdout:3844: finishing write tid 1 to smithi03339061-43 2021-07-26T16:10:56.414 INFO:tasks.rados.rados.0.smithi033.stdout:3843: done (2 left) 2021-07-26T16:10:56.414 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 374 2021-07-26T16:10:56.415 INFO:tasks.rados.rados.0.smithi033.stdout:3844: finishing write tid 2 to smithi03339061-43 2021-07-26T16:10:56.415 INFO:tasks.rados.rados.0.smithi033.stdout:3845: finishing copy_from to smithi03339061-9 2021-07-26T16:10:56.415 INFO:tasks.rados.rados.0.smithi033.stdout:3845: got expected ENOENT (src dne) 2021-07-26T16:10:56.415 INFO:tasks.rados.rados.0.smithi033.stdout:3845: finishing copy_from racing read to smithi03339061-9 2021-07-26T16:10:56.416 INFO:tasks.rados.rados.0.smithi033.stdout:3844: finishing write tid 3 to smithi03339061-43 2021-07-26T16:10:56.416 INFO:tasks.rados.rados.0.smithi033.stdout:3846: seq_num 1144 ranges {23273472=770048,24043520=737280,24780800=712704,25493504=155648} 2021-07-26T16:10:56.550 INFO:tasks.rados.rados.0.smithi033.stdout:3846: writing smithi03339061-13 from 23273472 to 24043520 tid 1 2021-07-26T16:10:56.554 INFO:tasks.rados.rados.0.smithi033.stdout:3846: writing smithi03339061-13 from 24043520 to 24780800 tid 2 2021-07-26T16:10:56.559 INFO:tasks.rados.rados.0.smithi033.stdout:3846: writing smithi03339061-13 from 24780800 to 25493504 tid 3 2021-07-26T16:10:56.560 INFO:tasks.rados.rados.0.smithi033.stdout:3846: writing smithi03339061-13 from 25493504 to 25649152 tid 4 2021-07-26T16:10:56.560 INFO:tasks.rados.rados.0.smithi033.stdout:3845: done (2 left) 2021-07-26T16:10:56.561 INFO:tasks.rados.rados.0.smithi033.stdout:3847: setattr oid 22 current snap is 374 2021-07-26T16:10:56.561 INFO:tasks.rados.rados.0.smithi033.stdout:3844: finishing write tid 4 to smithi03339061-43 2021-07-26T16:10:56.561 INFO:tasks.rados.rados.0.smithi033.stdout:3844: finishing write tid 5 to smithi03339061-43 2021-07-26T16:10:56.561 INFO:tasks.rados.rados.0.smithi033.stdout:3844: finishing write tid 6 to smithi03339061-43 2021-07-26T16:10:56.561 INFO:tasks.rados.rados.0.smithi033.stdout:3844: finishing write tid 7 to smithi03339061-43 2021-07-26T16:10:56.562 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 2087 (ObjNum 1143 snap 374 seq_num 1143) dirty exists 2021-07-26T16:10:56.562 INFO:tasks.rados.rados.0.smithi033.stdout:3844: left oid 43 (ObjNum 1143 snap 374 seq_num 1143) 2021-07-26T16:10:56.562 INFO:tasks.rados.rados.0.smithi033.stdout:3844: done (2 left) 2021-07-26T16:10:56.563 INFO:tasks.rados.rados.0.smithi033.stdout:3848: snap_create 2021-07-26T16:10:56.567 INFO:tasks.rados.rados.0.smithi033.stdout:3846: finishing write tid 1 to smithi03339061-13 2021-07-26T16:10:56.567 INFO:tasks.rados.rados.0.smithi033.stdout:3846: finishing write tid 2 to smithi03339061-13 2021-07-26T16:10:56.568 INFO:tasks.rados.rados.0.smithi033.stdout:3846: finishing write tid 3 to smithi03339061-13 2021-07-26T16:10:56.568 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 22 v 2513 (ObjNum 1141 snap 374 seq_num 1141) dirty exists 2021-07-26T16:10:56.569 INFO:tasks.rados.rados.0.smithi033.stdout:3846: finishing write tid 4 to smithi03339061-13 2021-07-26T16:10:56.570 INFO:tasks.rados.rados.0.smithi033.stdout:3846: finishing write tid 5 to smithi03339061-13 2021-07-26T16:10:56.572 INFO:tasks.rados.rados.0.smithi033.stdout:3846: finishing write tid 6 to smithi03339061-13 2021-07-26T16:10:56.573 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 2094 (ObjNum 1144 snap 374 seq_num 1144) dirty exists 2021-07-26T16:10:56.573 INFO:tasks.rados.rados.0.smithi033.stdout:3846: left oid 13 (ObjNum 1144 snap 374 seq_num 1144) 2021-07-26T16:10:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:56 smithi033 bash[41341]: cluster 2021-07-26T16:10:55.223236+0000 mgr.y (mgr.34104) 509 : cluster [DBG] pgmap v1048: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 957 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 15 MiB/s rd, 14 MiB/s wr, 54 op/s 2021-07-26T16:10:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:56 smithi033 bash[41341]: cluster 2021-07-26T16:10:55.371274+0000 mon.a (mon.0) 1190 : cluster [DBG] osdmap e809: 8 total, 8 up, 8 in 2021-07-26T16:10:56.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:56 smithi033 bash[41341]: cluster 2021-07-26T16:10:56.295509+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e810: 8 total, 8 up, 8 in 2021-07-26T16:10:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:56 smithi033 bash[42377]: cluster 2021-07-26T16:10:55.223236+0000 mgr.y (mgr.34104) 509 : cluster [DBG] pgmap v1048: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 957 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 15 MiB/s rd, 14 MiB/s wr, 54 op/s 2021-07-26T16:10:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:56 smithi033 bash[42377]: cluster 2021-07-26T16:10:55.371274+0000 mon.a (mon.0) 1190 : cluster [DBG] osdmap e809: 8 total, 8 up, 8 in 2021-07-26T16:10:56.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:56 smithi033 bash[42377]: cluster 2021-07-26T16:10:56.295509+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e810: 8 total, 8 up, 8 in 2021-07-26T16:10:56.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:56 smithi096 bash[33981]: cluster 2021-07-26T16:10:55.223236+0000 mgr.y (mgr.34104) 509 : cluster [DBG] pgmap v1048: 25 pgs: 2 active+clean+snaptrim, 23 active+clean; 957 MiB data, 3.8 GiB used, 711 GiB / 715 GiB avail; 15 MiB/s rd, 14 MiB/s wr, 54 op/s 2021-07-26T16:10:56.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:56 smithi096 bash[33981]: cluster 2021-07-26T16:10:55.371274+0000 mon.a (mon.0) 1190 : cluster [DBG] osdmap e809: 8 total, 8 up, 8 in 2021-07-26T16:10:56.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:56 smithi096 bash[33981]: cluster 2021-07-26T16:10:56.295509+0000 mon.a (mon.0) 1191 : cluster [DBG] osdmap e810: 8 total, 8 up, 8 in 2021-07-26T16:10:57.390 INFO:tasks.rados.rados.0.smithi033.stdout:3846: done (2 left) 2021-07-26T16:10:57.390 INFO:tasks.rados.rados.0.smithi033.stdout:3847: done (1 left) 2021-07-26T16:10:57.390 INFO:tasks.rados.rados.0.smithi033.stdout:3848: done (0 left) 2021-07-26T16:10:57.391 INFO:tasks.rados.rados.0.smithi033.stdout:3849: delete oid 43 current snap is 375 2021-07-26T16:10:57.399 INFO:tasks.rados.rados.0.smithi033.stdout:3849: done (0 left) 2021-07-26T16:10:57.399 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 375 2021-07-26T16:10:57.399 INFO:tasks.rados.rados.0.smithi033.stdout:3850: seq_num 1146 ranges {10330112=802816,11132928=499712,11632640=679936,12312576=425984} 2021-07-26T16:10:57.467 INFO:tasks.rados.rados.0.smithi033.stdout:3850: writing smithi03339061-5 from 10330112 to 11132928 tid 1 2021-07-26T16:10:57.470 INFO:tasks.rados.rados.0.smithi033.stdout:3850: writing smithi03339061-5 from 11132928 to 11632640 tid 2 2021-07-26T16:10:57.474 INFO:tasks.rados.rados.0.smithi033.stdout:3850: writing smithi03339061-5 from 11632640 to 12312576 tid 3 2021-07-26T16:10:57.477 INFO:tasks.rados.rados.0.smithi033.stdout:3850: writing smithi03339061-5 from 12312576 to 12738560 tid 4 2021-07-26T16:10:57.477 INFO:tasks.rados.rados.0.smithi033.stdout:3851: snap_remove snap 374 2021-07-26T16:10:58.392 INFO:tasks.rados.rados.0.smithi033.stdout:3851: done (1 left) 2021-07-26T16:10:58.392 INFO:tasks.rados.rados.0.smithi033.stdout:3852: copy_from oid 6 from oid 31 current snap is 375 2021-07-26T16:10:58.392 INFO:tasks.rados.rados.0.smithi033.stdout:3853: copy_from oid 22 from oid 14 current snap is 375 2021-07-26T16:10:58.393 INFO:tasks.rados.rados.0.smithi033.stdout:3854: delete oid 3 current snap is 375 2021-07-26T16:10:58.393 INFO:tasks.rados.rados.0.smithi033.stdout:3850: finishing write tid 1 to smithi03339061-5 2021-07-26T16:10:58.393 INFO:tasks.rados.rados.0.smithi033.stdout:3850: finishing write tid 2 to smithi03339061-5 2021-07-26T16:10:58.393 INFO:tasks.rados.rados.0.smithi033.stdout:3850: finishing write tid 3 to smithi03339061-5 2021-07-26T16:10:58.394 INFO:tasks.rados.rados.0.smithi033.stdout:3850: finishing write tid 4 to smithi03339061-5 2021-07-26T16:10:58.394 INFO:tasks.rados.rados.0.smithi033.stdout:3850: finishing write tid 5 to smithi03339061-5 2021-07-26T16:10:58.394 INFO:tasks.rados.rados.0.smithi033.stdout:3850: finishing write tid 6 to smithi03339061-5 2021-07-26T16:10:58.394 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 2093 (ObjNum 1146 snap 375 seq_num 1146) dirty exists 2021-07-26T16:10:58.395 INFO:tasks.rados.rados.0.smithi033.stdout:3850: left oid 5 (ObjNum 1146 snap 375 seq_num 1146) 2021-07-26T16:10:58.395 INFO:tasks.rados.rados.0.smithi033.stdout:3853: finishing copy_from to smithi03339061-22 2021-07-26T16:10:58.395 INFO:tasks.rados.rados.0.smithi033.stdout:3853: got expected ENOENT (src dne) 2021-07-26T16:10:58.396 INFO:tasks.rados.rados.0.smithi033.stdout:3853: finishing copy_from racing read to smithi03339061-22 2021-07-26T16:10:58.404 INFO:tasks.rados.rados.0.smithi033.stdout:3850: done (3 left) 2021-07-26T16:10:58.404 INFO:tasks.rados.rados.0.smithi033.stdout:3853: done (2 left) 2021-07-26T16:10:58.404 INFO:tasks.rados.rados.0.smithi033.stdout:3854: done (1 left) 2021-07-26T16:10:58.405 INFO:tasks.rados.rados.0.smithi033.stdout:3855: snap_create 2021-07-26T16:10:58.439 INFO:tasks.rados.rados.0.smithi033.stdout:3852: finishing copy_from to smithi03339061-6 2021-07-26T16:10:58.439 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 6 v 1864 (ObjNum 1126 snap 373 seq_num 1126) dirty exists 2021-07-26T16:10:58.440 INFO:tasks.rados.rados.0.smithi033.stdout:3852: finishing copy_from racing read to smithi03339061-6 2021-07-26T16:10:58.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:58 smithi033 bash[41341]: cluster 2021-07-26T16:10:57.223970+0000 mgr.y (mgr.34104) 510 : cluster [DBG] pgmap v1051: 25 pgs: 25 active+clean; 967 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 12 MiB/s wr, 41 op/s 2021-07-26T16:10:58.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:58 smithi033 bash[41341]: cluster 2021-07-26T16:10:57.383392+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e811: 8 total, 8 up, 8 in 2021-07-26T16:10:58.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:58 smithi033 bash[42377]: cluster 2021-07-26T16:10:57.223970+0000 mgr.y (mgr.34104) 510 : cluster [DBG] pgmap v1051: 25 pgs: 25 active+clean; 967 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 12 MiB/s wr, 41 op/s 2021-07-26T16:10:58.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:58 smithi033 bash[42377]: cluster 2021-07-26T16:10:57.383392+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e811: 8 total, 8 up, 8 in 2021-07-26T16:10:58.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:58 smithi096 bash[33981]: cluster 2021-07-26T16:10:57.223970+0000 mgr.y (mgr.34104) 510 : cluster [DBG] pgmap v1051: 25 pgs: 25 active+clean; 967 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 12 MiB/s wr, 41 op/s 2021-07-26T16:10:58.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:58 smithi096 bash[33981]: cluster 2021-07-26T16:10:57.383392+0000 mon.a (mon.0) 1192 : cluster [DBG] osdmap e811: 8 total, 8 up, 8 in 2021-07-26T16:10:59.412 INFO:tasks.rados.rados.0.smithi033.stdout:3852: done (1 left) 2021-07-26T16:10:59.468 INFO:tasks.rados.rados.0.smithi033.stdout:3855: done (0 left) 2021-07-26T16:10:59.468 INFO:tasks.rados.rados.0.smithi033.stdout:3856: read oid 11 snap -1 2021-07-26T16:10:59.468 INFO:tasks.rados.rados.0.smithi033.stdout:3856: expect (ObjNum 1027 snap 341 seq_num 1027) 2021-07-26T16:10:59.469 INFO:tasks.rados.rados.0.smithi033.stdout:3857: read oid 1 snap -1 2021-07-26T16:10:59.469 INFO:tasks.rados.rados.0.smithi033.stdout:3857: expect (ObjNum 1066 snap 349 seq_num 1066) 2021-07-26T16:10:59.469 INFO:tasks.rados.rados.0.smithi033.stdout:3858: read oid 50 snap -1 2021-07-26T16:10:59.469 INFO:tasks.rados.rados.0.smithi033.stdout:3858: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:10:59.470 INFO:tasks.rados.rados.0.smithi033.stdout:3859: snap_create 2021-07-26T16:10:59.470 INFO:tasks.rados.rados.0.smithi033.stdout:3858: expect (ObjNum 0 snap 0 seq_num 0) 2021-07-26T16:10:59.471 INFO:tasks.rados.rados.0.smithi033.stdout:3857: expect (ObjNum 1066 snap 349 seq_num 1066) 2021-07-26T16:10:59.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:10:59 smithi033 bash[41341]: cluster 2021-07-26T16:10:58.385487+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e812: 8 total, 8 up, 8 in 2021-07-26T16:10:59.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:10:59 smithi033 bash[42377]: cluster 2021-07-26T16:10:58.385487+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e812: 8 total, 8 up, 8 in 2021-07-26T16:10:59.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:10:59 smithi096 bash[33981]: cluster 2021-07-26T16:10:58.385487+0000 mon.a (mon.0) 1193 : cluster [DBG] osdmap e812: 8 total, 8 up, 8 in 2021-07-26T16:10:59.983 INFO:tasks.rados.rados.0.smithi033.stdout:3856: expect (ObjNum 1027 snap 341 seq_num 1027) 2021-07-26T16:11:00.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:00 smithi033 bash[42377]: cluster 2021-07-26T16:10:59.224741+0000 mgr.y (mgr.34104) 511 : cluster [DBG] pgmap v1054: 25 pgs: 25 active+clean; 970 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2021-07-26T16:11:00.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:00 smithi033 bash[42377]: cluster 2021-07-26T16:10:59.406423+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e813: 8 total, 8 up, 8 in 2021-07-26T16:11:00.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:00 smithi033 bash[41341]: cluster 2021-07-26T16:10:59.224741+0000 mgr.y (mgr.34104) 511 : cluster [DBG] pgmap v1054: 25 pgs: 25 active+clean; 970 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2021-07-26T16:11:00.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:00 smithi033 bash[41341]: cluster 2021-07-26T16:10:59.406423+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e813: 8 total, 8 up, 8 in 2021-07-26T16:11:00.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:00 smithi096 bash[33981]: cluster 2021-07-26T16:10:59.224741+0000 mgr.y (mgr.34104) 511 : cluster [DBG] pgmap v1054: 25 pgs: 25 active+clean; 970 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2021-07-26T16:11:00.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:00 smithi096 bash[33981]: cluster 2021-07-26T16:10:59.406423+0000 mon.a (mon.0) 1194 : cluster [DBG] osdmap e813: 8 total, 8 up, 8 in 2021-07-26T16:11:01.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:01 smithi033 bash[41341]: cluster 2021-07-26T16:11:00.416748+0000 mon.a (mon.0) 1195 : cluster [DBG] osdmap e814: 8 total, 8 up, 8 in 2021-07-26T16:11:01.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:01 smithi033 bash[41341]: cluster 2021-07-26T16:11:01.297026+0000 mon.a (mon.0) 1196 : cluster [DBG] osdmap e815: 8 total, 8 up, 8 in 2021-07-26T16:11:01.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:01 smithi033 bash[42377]: cluster 2021-07-26T16:11:00.416748+0000 mon.a (mon.0) 1195 : cluster [DBG] osdmap e814: 8 total, 8 up, 8 in 2021-07-26T16:11:01.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:01 smithi033 bash[42377]: cluster 2021-07-26T16:11:01.297026+0000 mon.a (mon.0) 1196 : cluster [DBG] osdmap e815: 8 total, 8 up, 8 in 2021-07-26T16:11:01.724 INFO:tasks.rados.rados.0.smithi033.stdout:3856: done (3 left) 2021-07-26T16:11:01.724 INFO:tasks.rados.rados.0.smithi033.stdout:3857: done (2 left) 2021-07-26T16:11:01.724 INFO:tasks.rados.rados.0.smithi033.stdout:3858: done (1 left) 2021-07-26T16:11:01.725 INFO:tasks.rados.rados.0.smithi033.stdout:3859: done (0 left) 2021-07-26T16:11:01.725 INFO:tasks.rados.rados.0.smithi033.stdout:3860: snap_create 2021-07-26T16:11:01.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:01 smithi096 bash[33981]: cluster 2021-07-26T16:11:00.416748+0000 mon.a (mon.0) 1195 : cluster [DBG] osdmap e814: 8 total, 8 up, 8 in 2021-07-26T16:11:01.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:01 smithi096 bash[33981]: cluster 2021-07-26T16:11:01.297026+0000 mon.a (mon.0) 1196 : cluster [DBG] osdmap e815: 8 total, 8 up, 8 in 2021-07-26T16:11:02.445 INFO:tasks.rados.rados.0.smithi033.stdout:3860: done (0 left) 2021-07-26T16:11:02.445 INFO:tasks.rados.rados.0.smithi033.stdout:3861: read oid 39 snap -1 2021-07-26T16:11:02.446 INFO:tasks.rados.rados.0.smithi033.stdout:3861: expect (ObjNum 824 snap 274 seq_num 824) 2021-07-26T16:11:02.446 INFO:tasks.rados.rados.0.smithi033.stdout:3862: delete oid 46 current snap is 378 2021-07-26T16:11:02.454 INFO:tasks.rados.rados.0.smithi033.stdout:3862: done (1 left) 2021-07-26T16:11:02.454 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 8 current snap is 378 2021-07-26T16:11:02.454 INFO:tasks.rados.rados.0.smithi033.stdout:3863: seq_num 1149 ranges {0=49152} 2021-07-26T16:11:02.455 INFO:tasks.rados.rados.0.smithi033.stdout:3863: writing smithi03339061-8 from 0 to 49152 tid 1 2021-07-26T16:11:02.455 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 5 current snap is 378 2021-07-26T16:11:02.456 INFO:tasks.rados.rados.0.smithi033.stdout:3864: seq_num 1150 ranges {12738560=65536} 2021-07-26T16:11:02.530 INFO:tasks.rados.rados.0.smithi033.stdout:3864: writing smithi03339061-5 from 12738560 to 12804096 tid 1 2021-07-26T16:11:02.531 INFO:tasks.rados.rados.0.smithi033.stdout:3865: read oid 25 snap -1 2021-07-26T16:11:02.531 INFO:tasks.rados.rados.0.smithi033.stdout:3865: expect deleted 2021-07-26T16:11:02.531 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 23 current snap is 378 2021-07-26T16:11:02.531 INFO:tasks.rados.rados.0.smithi033.stdout:3863: finishing write tid 1 to smithi03339061-8 2021-07-26T16:11:02.532 INFO:tasks.rados.rados.0.smithi033.stdout:3866: seq_num 1151 ranges {3555328=81920} 2021-07-26T16:11:02.550 INFO:tasks.rados.rados.0.smithi033.stdout:3866: writing smithi03339061-23 from 3555328 to 3637248 tid 1 2021-07-26T16:11:02.550 INFO:tasks.rados.rados.0.smithi033.stdout:3867: snap_remove snap 352 2021-07-26T16:11:02.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:02 smithi033 bash[41341]: cluster 2021-07-26T16:11:01.225535+0000 mgr.y (mgr.34104) 512 : cluster [DBG] pgmap v1057: 25 pgs: 25 active+clean; 970 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2021-07-26T16:11:02.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:02 smithi033 bash[42377]: cluster 2021-07-26T16:11:01.225535+0000 mgr.y (mgr.34104) 512 : cluster [DBG] pgmap v1057: 25 pgs: 25 active+clean; 970 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2021-07-26T16:11:02.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:02 smithi096 bash[33981]: cluster 2021-07-26T16:11:01.225535+0000 mgr.y (mgr.34104) 512 : cluster [DBG] pgmap v1057: 25 pgs: 25 active+clean; 970 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 14 MiB/s rd, 3.4 MiB/s wr, 15 op/s 2021-07-26T16:11:03.457 INFO:tasks.rados.rados.0.smithi033.stdout:3867: done (5 left) 2021-07-26T16:11:03.457 INFO:tasks.rados.rados.0.smithi033.stdout:3868: snap_create 2021-07-26T16:11:03.457 INFO:tasks.rados.rados.0.smithi033.stdout:3863: finishing write tid 2 to smithi03339061-8 2021-07-26T16:11:03.458 INFO:tasks.rados.rados.0.smithi033.stdout:3863: finishing write tid 3 to smithi03339061-8 2021-07-26T16:11:03.458 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1847 (ObjNum 1149 snap 378 seq_num 1149) dirty exists 2021-07-26T16:11:03.458 INFO:tasks.rados.rados.0.smithi033.stdout:3863: left oid 8 (ObjNum 1149 snap 378 seq_num 1149) 2021-07-26T16:11:03.458 INFO:tasks.rados.rados.0.smithi033.stdout:3861: expect (ObjNum 824 snap 274 seq_num 824) 2021-07-26T16:11:03.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:03 smithi033 bash[41341]: cluster 2021-07-26T16:11:02.441389+0000 mon.a (mon.0) 1197 : cluster [DBG] osdmap e816: 8 total, 8 up, 8 in 2021-07-26T16:11:03.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:03 smithi033 bash[42377]: cluster 2021-07-26T16:11:02.441389+0000 mon.a (mon.0) 1197 : cluster [DBG] osdmap e816: 8 total, 8 up, 8 in 2021-07-26T16:11:03.732 INFO:tasks.rados.rados.0.smithi033.stdout:3864: finishing write tid 1 to smithi03339061-5 2021-07-26T16:11:03.733 INFO:tasks.rados.rados.0.smithi033.stdout:3864: finishing write tid 2 to smithi03339061-5 2021-07-26T16:11:03.733 INFO:tasks.rados.rados.0.smithi033.stdout:3864: finishing write tid 3 to smithi03339061-5 2021-07-26T16:11:03.733 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 2095 (ObjNum 1150 snap 378 seq_num 1150) dirty exists 2021-07-26T16:11:03.733 INFO:tasks.rados.rados.0.smithi033.stdout:3864: left oid 5 (ObjNum 1150 snap 378 seq_num 1150) 2021-07-26T16:11:03.734 INFO:tasks.rados.rados.0.smithi033.stdout:3866: finishing write tid 1 to smithi03339061-23 2021-07-26T16:11:03.734 INFO:tasks.rados.rados.0.smithi033.stdout:3866: finishing write tid 2 to smithi03339061-23 2021-07-26T16:11:03.734 INFO:tasks.rados.rados.0.smithi033.stdout:3866: finishing write tid 3 to smithi03339061-23 2021-07-26T16:11:03.734 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 2184 (ObjNum 1151 snap 378 seq_num 1151) dirty exists 2021-07-26T16:11:03.734 INFO:tasks.rados.rados.0.smithi033.stdout:3866: left oid 23 (ObjNum 1151 snap 378 seq_num 1151) 2021-07-26T16:11:03.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:03 smithi096 bash[33981]: cluster 2021-07-26T16:11:02.441389+0000 mon.a (mon.0) 1197 : cluster [DBG] osdmap e816: 8 total, 8 up, 8 in 2021-07-26T16:11:04.469 INFO:tasks.rados.rados.0.smithi033.stdout:3861: done (5 left) 2021-07-26T16:11:04.469 INFO:tasks.rados.rados.0.smithi033.stdout:3863: done (4 left) 2021-07-26T16:11:04.469 INFO:tasks.rados.rados.0.smithi033.stdout:3864: done (3 left) 2021-07-26T16:11:04.470 INFO:tasks.rados.rados.0.smithi033.stdout:3865: done (2 left) 2021-07-26T16:11:04.470 INFO:tasks.rados.rados.0.smithi033.stdout:3866: done (1 left) 2021-07-26T16:11:04.470 INFO:tasks.rados.rados.0.smithi033.stdout:3868: done (0 left) 2021-07-26T16:11:04.470 INFO:tasks.rados.rados.0.smithi033.stdout:3869: copy_from oid 48 from oid 35 current snap is 379 2021-07-26T16:11:04.470 INFO:tasks.rados.rados.0.smithi033.stdout:3870: rollback oid 43 current snap is 379 2021-07-26T16:11:04.471 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 43 to 312 2021-07-26T16:11:04.471 INFO:tasks.rados.rados.0.smithi033.stdout:3871: copy_from oid 45 from oid 11 current snap is 379 2021-07-26T16:11:04.471 INFO:tasks.rados.rados.0.smithi033.stdout:3872: delete oid 22 current snap is 379 2021-07-26T16:11:04.481 INFO:tasks.rados.rados.0.smithi033.stdout:3870: finishing rollback tid 1 to smithi03339061-43 2021-07-26T16:11:04.481 INFO:tasks.rados.rados.0.smithi033.stdout:3870: finishing rollback tid 2 to smithi03339061-43 2021-07-26T16:11:04.481 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 2097 (ObjNum 733 snap 246 seq_num 733) dirty exists 2021-07-26T16:11:04.483 INFO:tasks.rados.rados.0.smithi033.stdout:3870: done (3 left) 2021-07-26T16:11:04.483 INFO:tasks.rados.rados.0.smithi033.stdout:3872: done (2 left) 2021-07-26T16:11:04.483 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 379 2021-07-26T16:11:04.484 INFO:tasks.rados.rados.0.smithi033.stdout:3873: seq_num 1153 ranges {7004160=114688} 2021-07-26T16:11:04.529 INFO:tasks.rados.rados.0.smithi033.stdout:3873: writing smithi03339061-1 from 7004160 to 7118848 tid 1 2021-07-26T16:11:04.529 INFO:tasks.rados.rados.0.smithi033.stdout:3874: snap_create 2021-07-26T16:11:04.530 INFO:tasks.rados.rados.0.smithi033.stdout:3869: finishing copy_from to smithi03339061-48 2021-07-26T16:11:04.530 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 1844 (ObjNum 1087 snap 360 seq_num 1087) dirty exists 2021-07-26T16:11:04.530 INFO:tasks.rados.rados.0.smithi033.stdout:3869: finishing copy_from racing read to smithi03339061-48 2021-07-26T16:11:04.532 INFO:tasks.rados.rados.0.smithi033.stdout:3873: finishing write tid 1 to smithi03339061-1 2021-07-26T16:11:04.533 INFO:tasks.rados.rados.0.smithi033.stdout:3873: finishing write tid 2 to smithi03339061-1 2021-07-26T16:11:04.534 INFO:tasks.rados.rados.0.smithi033.stdout:3873: finishing write tid 3 to smithi03339061-1 2021-07-26T16:11:04.535 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1092 (ObjNum 1153 snap 379 seq_num 1153) dirty exists 2021-07-26T16:11:04.535 INFO:tasks.rados.rados.0.smithi033.stdout:3873: left oid 1 (ObjNum 1153 snap 379 seq_num 1153) 2021-07-26T16:11:04.547 INFO:tasks.rados.rados.0.smithi033.stdout:3871: finishing copy_from to smithi03339061-45 2021-07-26T16:11:04.548 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 1455 (ObjNum 1027 snap 341 seq_num 1027) dirty exists 2021-07-26T16:11:04.549 INFO:tasks.rados.rados.0.smithi033.stdout:3871: finishing copy_from racing read to smithi03339061-45 2021-07-26T16:11:04.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:04 smithi033 bash[41341]: cluster 2021-07-26T16:11:03.226374+0000 mgr.y (mgr.34104) 513 : cluster [DBG] pgmap v1060: 25 pgs: 25 active+clean; 954 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 20 MiB/s rd, 3.1 MiB/s wr, 11 op/s 2021-07-26T16:11:04.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:04 smithi033 bash[41341]: cluster 2021-07-26T16:11:03.450716+0000 mon.a (mon.0) 1198 : cluster [DBG] osdmap e817: 8 total, 8 up, 8 in 2021-07-26T16:11:04.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:04 smithi033 bash[42377]: cluster 2021-07-26T16:11:03.226374+0000 mgr.y (mgr.34104) 513 : cluster [DBG] pgmap v1060: 25 pgs: 25 active+clean; 954 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 20 MiB/s rd, 3.1 MiB/s wr, 11 op/s 2021-07-26T16:11:04.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:04 smithi033 bash[42377]: cluster 2021-07-26T16:11:03.450716+0000 mon.a (mon.0) 1198 : cluster [DBG] osdmap e817: 8 total, 8 up, 8 in 2021-07-26T16:11:04.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:04 smithi096 bash[33981]: cluster 2021-07-26T16:11:03.226374+0000 mgr.y (mgr.34104) 513 : cluster [DBG] pgmap v1060: 25 pgs: 25 active+clean; 954 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 20 MiB/s rd, 3.1 MiB/s wr, 11 op/s 2021-07-26T16:11:04.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:04 smithi096 bash[33981]: cluster 2021-07-26T16:11:03.450716+0000 mon.a (mon.0) 1198 : cluster [DBG] osdmap e817: 8 total, 8 up, 8 in 2021-07-26T16:11:05.473 INFO:tasks.rados.rados.0.smithi033.stdout:3869: done (3 left) 2021-07-26T16:11:05.474 INFO:tasks.rados.rados.0.smithi033.stdout:3871: done (2 left) 2021-07-26T16:11:05.474 INFO:tasks.rados.rados.0.smithi033.stdout:3873: done (1 left) 2021-07-26T16:11:05.474 INFO:tasks.rados.rados.0.smithi033.stdout:3874: done (0 left) 2021-07-26T16:11:05.475 INFO:tasks.rados.rados.0.smithi033.stdout:3875: snap_remove snap 379 2021-07-26T16:11:05.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:05 smithi096 bash[33981]: cluster 2021-07-26T16:11:04.465917+0000 mon.a (mon.0) 1199 : cluster [DBG] osdmap e818: 8 total, 8 up, 8 in 2021-07-26T16:11:05.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:05 smithi033 bash[41341]: cluster 2021-07-26T16:11:04.465917+0000 mon.a (mon.0) 1199 : cluster [DBG] osdmap e818: 8 total, 8 up, 8 in 2021-07-26T16:11:05.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:05 smithi033 bash[42377]: cluster 2021-07-26T16:11:04.465917+0000 mon.a (mon.0) 1199 : cluster [DBG] osdmap e818: 8 total, 8 up, 8 in 2021-07-26T16:11:06.303 INFO:tasks.rados.rados.0.smithi033.stdout:3875: done (0 left) 2021-07-26T16:11:06.304 INFO:tasks.rados.rados.0.smithi033.stdout:3876: copy_from oid 41 from oid 14 current snap is 380 2021-07-26T16:11:06.304 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 43 current snap is 380 2021-07-26T16:11:06.305 INFO:tasks.rados.rados.0.smithi033.stdout:3877: seq_num 1154 ranges {3244032=131072} 2021-07-26T16:11:06.324 INFO:tasks.rados.rados.0.smithi033.stdout:3877: writing smithi03339061-43 from 3244032 to 3375104 tid 1 2021-07-26T16:11:06.325 INFO:tasks.rados.rados.0.smithi033.stdout:3878: copy_from oid 46 from oid 47 current snap is 380 2021-07-26T16:11:06.325 INFO:tasks.rados.rados.0.smithi033.stdout:3876: finishing copy_from to smithi03339061-41 2021-07-26T16:11:06.325 INFO:tasks.rados.rados.0.smithi033.stdout:3876: got expected ENOENT (src dne) 2021-07-26T16:11:06.325 INFO:tasks.rados.rados.0.smithi033.stdout:3876: finishing copy_from racing read to smithi03339061-41 2021-07-26T16:11:06.326 INFO:tasks.rados.rados.0.smithi033.stdout:3876: done (2 left) 2021-07-26T16:11:06.326 INFO:tasks.rados.rados.0.smithi033.stdout:3879: rollback oid 10 current snap is 380 2021-07-26T16:11:06.326 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 10 to 348 2021-07-26T16:11:06.326 INFO:tasks.rados.rados.0.smithi033.stdout:3880: read oid 37 snap -1 2021-07-26T16:11:06.327 INFO:tasks.rados.rados.0.smithi033.stdout:3880: expect (ObjNum 1010 snap 338 seq_num 1010) 2021-07-26T16:11:06.327 INFO:tasks.rados.rados.0.smithi033.stdout:3881: rollback oid 30 current snap is 380 2021-07-26T16:11:06.327 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 30 to 284 2021-07-26T16:11:06.327 INFO:tasks.rados.rados.0.smithi033.stdout:3882: read oid 28 snap 296 2021-07-26T16:11:06.328 INFO:tasks.rados.rados.0.smithi033.stdout:3882: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:11:06.328 INFO:tasks.rados.rados.0.smithi033.stdout:3883: copy_from oid 23 from oid 48 current snap is 380 2021-07-26T16:11:06.328 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 13 current snap is 380 2021-07-26T16:11:06.328 INFO:tasks.rados.rados.0.smithi033.stdout:3884: seq_num 1155 ranges {25649152=147456} 2021-07-26T16:11:06.472 INFO:tasks.rados.rados.0.smithi033.stdout:3884: writing smithi03339061-13 from 25649152 to 25796608 tid 1 2021-07-26T16:11:06.472 INFO:tasks.rados.rados.0.smithi033.stdout:3885: copy_from oid 34 from oid 14 current snap is 380 2021-07-26T16:11:06.472 INFO:tasks.rados.rados.0.smithi033.stdout:3882: expect (ObjNum 569 snap 177 seq_num 569) 2021-07-26T16:11:06.544 INFO:tasks.rados.rados.0.smithi033.stdout:3877: finishing write tid 1 to smithi03339061-43 2021-07-26T16:11:06.544 INFO:tasks.rados.rados.0.smithi033.stdout:3877: finishing write tid 2 to smithi03339061-43 2021-07-26T16:11:06.544 INFO:tasks.rados.rados.0.smithi033.stdout:3877: finishing write tid 3 to smithi03339061-43 2021-07-26T16:11:06.544 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 43 v 2099 (ObjNum 1154 snap 380 seq_num 1154) dirty exists 2021-07-26T16:11:06.545 INFO:tasks.rados.rados.0.smithi033.stdout:3877: left oid 43 (ObjNum 1154 snap 380 seq_num 1154) 2021-07-26T16:11:06.545 INFO:tasks.rados.rados.0.smithi033.stdout:3879: finishing rollback tid 0 to smithi03339061-10 2021-07-26T16:11:06.545 INFO:tasks.rados.rados.0.smithi033.stdout:3879: finishing rollback tid 1 to smithi03339061-10 2021-07-26T16:11:06.545 INFO:tasks.rados.rados.0.smithi033.stdout:3879: finishing rollback tid 2 to smithi03339061-10 2021-07-26T16:11:06.546 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 2102 (ObjNum 891 snap 292 seq_num 891) dirty exists 2021-07-26T16:11:06.546 INFO:tasks.rados.rados.0.smithi033.stdout:3881: finishing rollback tid 0 to smithi03339061-30 2021-07-26T16:11:06.546 INFO:tasks.rados.rados.0.smithi033.stdout:3881: finishing rollback tid 1 to smithi03339061-30 2021-07-26T16:11:06.546 INFO:tasks.rados.rados.0.smithi033.stdout:3881: finishing rollback tid 2 to smithi03339061-30 2021-07-26T16:11:06.547 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 2106 (ObjNum 864 snap 283 seq_num 864) dirty exists 2021-07-26T16:11:06.547 INFO:tasks.rados.rados.0.smithi033.stdout:3880: expect (ObjNum 1010 snap 338 seq_num 1010) 2021-07-26T16:11:06.626 INFO:tasks.rados.rados.0.smithi033.stdout:3883: finishing copy_from to smithi03339061-23 2021-07-26T16:11:06.627 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 23 v 1844 (ObjNum 1087 snap 360 seq_num 1087) dirty exists 2021-07-26T16:11:06.627 INFO:tasks.rados.rados.0.smithi033.stdout:3883: finishing copy_from racing read to smithi03339061-23 2021-07-26T16:11:06.627 INFO:tasks.rados.rados.0.smithi033.stdout:3878: finishing copy_from to smithi03339061-46 2021-07-26T16:11:06.627 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 2082 (ObjNum 1134 snap 373 seq_num 1134) dirty exists 2021-07-26T16:11:06.628 INFO:tasks.rados.rados.0.smithi033.stdout:3878: finishing copy_from racing read to smithi03339061-46 2021-07-26T16:11:06.628 INFO:tasks.rados.rados.0.smithi033.stdout:3884: finishing write tid 1 to smithi03339061-13 2021-07-26T16:11:06.628 INFO:tasks.rados.rados.0.smithi033.stdout:3884: finishing write tid 2 to smithi03339061-13 2021-07-26T16:11:06.628 INFO:tasks.rados.rados.0.smithi033.stdout:3885: finishing copy_from to smithi03339061-34 2021-07-26T16:11:06.628 INFO:tasks.rados.rados.0.smithi033.stdout:3885: got expected ENOENT (src dne) 2021-07-26T16:11:06.629 INFO:tasks.rados.rados.0.smithi033.stdout:3885: finishing copy_from racing read to smithi03339061-34 2021-07-26T16:11:06.629 INFO:tasks.rados.rados.0.smithi033.stdout:3884: finishing write tid 3 to smithi03339061-13 2021-07-26T16:11:06.629 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 13 v 2096 (ObjNum 1155 snap 380 seq_num 1155) dirty exists 2021-07-26T16:11:06.629 INFO:tasks.rados.rados.0.smithi033.stdout:3884: left oid 13 (ObjNum 1155 snap 380 seq_num 1155) 2021-07-26T16:11:06.630 INFO:tasks.rados.rados.0.smithi033.stdout:3877: done (8 left) 2021-07-26T16:11:06.630 INFO:tasks.rados.rados.0.smithi033.stdout:3878: done (7 left) 2021-07-26T16:11:06.630 INFO:tasks.rados.rados.0.smithi033.stdout:3879: done (6 left) 2021-07-26T16:11:06.630 INFO:tasks.rados.rados.0.smithi033.stdout:3880: done (5 left) 2021-07-26T16:11:06.630 INFO:tasks.rados.rados.0.smithi033.stdout:3881: done (4 left) 2021-07-26T16:11:06.631 INFO:tasks.rados.rados.0.smithi033.stdout:3882: done (3 left) 2021-07-26T16:11:06.631 INFO:tasks.rados.rados.0.smithi033.stdout:3883: done (2 left) 2021-07-26T16:11:06.631 INFO:tasks.rados.rados.0.smithi033.stdout:3884: done (1 left) 2021-07-26T16:11:06.631 INFO:tasks.rados.rados.0.smithi033.stdout:3885: done (0 left) 2021-07-26T16:11:06.632 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 21 current snap is 380 2021-07-26T16:11:06.632 INFO:tasks.rados.rados.0.smithi033.stdout:3886: seq_num 1156 ranges {4235264=163840} 2021-07-26T16:11:06.660 INFO:tasks.rados.rados.0.smithi033.stdout:3886: writing smithi03339061-21 from 4235264 to 4399104 tid 1 2021-07-26T16:11:06.660 INFO:tasks.rados.rados.0.smithi033.stdout:3887: rmattr oid 22 current snap is 380 2021-07-26T16:11:06.660 INFO:tasks.rados.rados.0.smithi033.stdout:3887: done (1 left) 2021-07-26T16:11:06.661 INFO:tasks.rados.rados.0.smithi033.stdout:3888: delete oid 14 current snap is 380 2021-07-26T16:11:06.665 INFO:tasks.rados.rados.0.smithi033.stdout:3888: done (1 left) 2021-07-26T16:11:06.665 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 380 2021-07-26T16:11:06.665 INFO:tasks.rados.rados.0.smithi033.stdout:3889: seq_num 1158 ranges {22831104=196608} 2021-07-26T16:11:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:06 smithi096 bash[33981]: cluster 2021-07-26T16:11:05.227174+0000 mgr.y (mgr.34104) 514 : cluster [DBG] pgmap v1063: 25 pgs: 25 active+clean; 954 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 8.6 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2021-07-26T16:11:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:06 smithi096 bash[33981]: cluster 2021-07-26T16:11:05.469711+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e819: 8 total, 8 up, 8 in 2021-07-26T16:11:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:06 smithi096 bash[33981]: cluster 2021-07-26T16:11:06.300427+0000 mon.a (mon.0) 1201 : cluster [DBG] osdmap e820: 8 total, 8 up, 8 in 2021-07-26T16:11:06.794 INFO:tasks.rados.rados.0.smithi033.stdout:3889: writing smithi03339061-46 from 22831104 to 23027712 tid 1 2021-07-26T16:11:06.795 INFO:tasks.rados.rados.0.smithi033.stdout:3890: rollback oid 42 current snap is 380 2021-07-26T16:11:06.795 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 42 to 370 2021-07-26T16:11:06.795 INFO:tasks.rados.rados.0.smithi033.stdout:3886: finishing write tid 1 to smithi03339061-21 2021-07-26T16:11:06.795 INFO:tasks.rados.rados.0.smithi033.stdout:3891: snap_create 2021-07-26T16:11:06.796 INFO:tasks.rados.rados.0.smithi033.stdout:3886: finishing write tid 2 to smithi03339061-21 2021-07-26T16:11:06.796 INFO:tasks.rados.rados.0.smithi033.stdout:3886: finishing write tid 3 to smithi03339061-21 2021-07-26T16:11:06.796 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 2186 (ObjNum 1156 snap 380 seq_num 1156) dirty exists 2021-07-26T16:11:06.796 INFO:tasks.rados.rados.0.smithi033.stdout:3886: left oid 21 (ObjNum 1156 snap 380 seq_num 1156) 2021-07-26T16:11:06.802 INFO:tasks.rados.rados.0.smithi033.stdout:3889: finishing write tid 1 to smithi03339061-46 2021-07-26T16:11:06.804 INFO:tasks.rados.rados.0.smithi033.stdout:3890: finishing rollback tid 0 to smithi03339061-42 2021-07-26T16:11:06.804 INFO:tasks.rados.rados.0.smithi033.stdout:3889: finishing write tid 2 to smithi03339061-46 2021-07-26T16:11:06.805 INFO:tasks.rados.rados.0.smithi033.stdout:3890: finishing rollback tid 1 to smithi03339061-42 2021-07-26T16:11:06.806 INFO:tasks.rados.rados.0.smithi033.stdout:3890: finishing rollback tid 2 to smithi03339061-42 2021-07-26T16:11:06.806 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 2087 (ObjNum 1 snap 32561 seq_num 2006843840) dirty exists 2021-07-26T16:11:06.807 INFO:tasks.rados.rados.0.smithi033.stdout:3889: finishing write tid 3 to smithi03339061-46 2021-07-26T16:11:06.807 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 2084 (ObjNum 1158 snap 380 seq_num 1158) dirty exists 2021-07-26T16:11:06.808 INFO:tasks.rados.rados.0.smithi033.stdout:3889: left oid 46 (ObjNum 1158 snap 380 seq_num 1158) 2021-07-26T16:11:06.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:06 smithi033 bash[41341]: cluster 2021-07-26T16:11:05.227174+0000 mgr.y (mgr.34104) 514 : cluster [DBG] pgmap v1063: 25 pgs: 25 active+clean; 954 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 8.6 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2021-07-26T16:11:06.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:06 smithi033 bash[41341]: cluster 2021-07-26T16:11:05.469711+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e819: 8 total, 8 up, 8 in 2021-07-26T16:11:06.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:06 smithi033 bash[41341]: cluster 2021-07-26T16:11:06.300427+0000 mon.a (mon.0) 1201 : cluster [DBG] osdmap e820: 8 total, 8 up, 8 in 2021-07-26T16:11:06.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:06 smithi033 bash[42377]: cluster 2021-07-26T16:11:05.227174+0000 mgr.y (mgr.34104) 514 : cluster [DBG] pgmap v1063: 25 pgs: 25 active+clean; 954 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 8.6 MiB/s rd, 1.4 MiB/s wr, 5 op/s 2021-07-26T16:11:06.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:06 smithi033 bash[42377]: cluster 2021-07-26T16:11:05.469711+0000 mon.a (mon.0) 1200 : cluster [DBG] osdmap e819: 8 total, 8 up, 8 in 2021-07-26T16:11:06.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:06 smithi033 bash[42377]: cluster 2021-07-26T16:11:06.300427+0000 mon.a (mon.0) 1201 : cluster [DBG] osdmap e820: 8 total, 8 up, 8 in 2021-07-26T16:11:07.485 INFO:tasks.rados.rados.0.smithi033.stdout:3886: done (3 left) 2021-07-26T16:11:07.486 INFO:tasks.rados.rados.0.smithi033.stdout:3889: done (2 left) 2021-07-26T16:11:07.486 INFO:tasks.rados.rados.0.smithi033.stdout:3890: done (1 left) 2021-07-26T16:11:07.486 INFO:tasks.rados.rados.0.smithi033.stdout:3891: done (0 left) 2021-07-26T16:11:07.486 INFO:tasks.rados.rados.0.smithi033.stdout:3892: rollback oid 19 current snap is 381 2021-07-26T16:11:07.487 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 19 to 369 2021-07-26T16:11:07.487 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 47 current snap is 381 2021-07-26T16:11:07.487 INFO:tasks.rados.rados.0.smithi033.stdout:3893: seq_num 1159 ranges {22831104=212992} 2021-07-26T16:11:07.619 INFO:tasks.rados.rados.0.smithi033.stdout:3893: writing smithi03339061-47 from 22831104 to 23044096 tid 1 2021-07-26T16:11:07.620 INFO:tasks.rados.rados.0.smithi033.stdout:3894: copy_from oid 7 from oid 15 current snap is 381 2021-07-26T16:11:07.620 INFO:tasks.rados.rados.0.smithi033.stdout:3892: finishing rollback tid 1 to smithi03339061-19 2021-07-26T16:11:07.620 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 19 v 1796 (ObjNum 1 snap 32561 seq_num 2007505424) dirty dne 2021-07-26T16:11:07.620 INFO:tasks.rados.rados.0.smithi033.stdout:3892: done (2 left) 2021-07-26T16:11:07.621 INFO:tasks.rados.rados.0.smithi033.stdout:3895: snap_create 2021-07-26T16:11:07.628 INFO:tasks.rados.rados.0.smithi033.stdout:3893: finishing write tid 1 to smithi03339061-47 2021-07-26T16:11:07.628 INFO:tasks.rados.rados.0.smithi033.stdout:3893: finishing write tid 2 to smithi03339061-47 2021-07-26T16:11:07.631 INFO:tasks.rados.rados.0.smithi033.stdout:3893: finishing write tid 3 to smithi03339061-47 2021-07-26T16:11:07.631 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 2109 (ObjNum 1159 snap 381 seq_num 1159) dirty exists 2021-07-26T16:11:07.631 INFO:tasks.rados.rados.0.smithi033.stdout:3893: left oid 47 (ObjNum 1159 snap 381 seq_num 1159) 2021-07-26T16:11:07.652 INFO:tasks.rados.rados.0.smithi033.stdout:3894: finishing copy_from to smithi03339061-7 2021-07-26T16:11:07.652 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 966 (ObjNum 1128 snap 373 seq_num 1128) dirty exists 2021-07-26T16:11:07.654 INFO:tasks.rados.rados.0.smithi033.stdout:3894: finishing copy_from racing read to smithi03339061-7 2021-07-26T16:11:08.489 INFO:tasks.rados.rados.0.smithi033.stdout:3893: done (2 left) 2021-07-26T16:11:08.489 INFO:tasks.rados.rados.0.smithi033.stdout:3894: done (1 left) 2021-07-26T16:11:08.489 INFO:tasks.rados.rados.0.smithi033.stdout:3895: done (0 left) 2021-07-26T16:11:08.489 INFO:tasks.rados.rados.0.smithi033.stdout:3896: delete oid 41 current snap is 382 2021-07-26T16:11:08.495 INFO:tasks.rados.rados.0.smithi033.stdout:3896: done (0 left) 2021-07-26T16:11:08.495 INFO:tasks.rados.rados.0.smithi033.stdout:3897: read oid 30 snap 359 2021-07-26T16:11:08.495 INFO:tasks.rados.rados.0.smithi033.stdout:3897: expect deleted 2021-07-26T16:11:08.496 INFO:tasks.rados.rados.0.smithi033.stdout:3898: read oid 4 snap -1 2021-07-26T16:11:08.496 INFO:tasks.rados.rados.0.smithi033.stdout:3898: expect (ObjNum 1135 snap 373 seq_num 1135) 2021-07-26T16:11:08.496 INFO:tasks.rados.rados.0.smithi033.stdout:3899: rollback oid 45 current snap is 382 2021-07-26T16:11:08.496 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 45 to 345 2021-07-26T16:11:08.496 INFO:tasks.rados.rados.0.smithi033.stdout:3900: snap_create 2021-07-26T16:11:08.513 INFO:tasks.rados.rados.0.smithi033.stdout:3899: finishing rollback tid 0 to smithi03339061-45 2021-07-26T16:11:08.513 INFO:tasks.rados.rados.0.smithi033.stdout:3899: finishing rollback tid 1 to smithi03339061-45 2021-07-26T16:11:08.513 INFO:tasks.rados.rados.0.smithi033.stdout:3899: finishing rollback tid 2 to smithi03339061-45 2021-07-26T16:11:08.514 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 2535 (ObjNum 1011 snap 338 seq_num 1011) dirty exists 2021-07-26T16:11:08.526 INFO:tasks.rados.rados.0.smithi033.stdout:3898: expect (ObjNum 1135 snap 373 seq_num 1135) 2021-07-26T16:11:08.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:08 smithi033 bash[41341]: cluster 2021-07-26T16:11:07.227991+0000 mgr.y (mgr.34104) 515 : cluster [DBG] pgmap v1066: 25 pgs: 25 active+clean; 954 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 767 B/s rd, 56 KiB/s wr, 2 op/s 2021-07-26T16:11:08.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:08 smithi033 bash[41341]: cluster 2021-07-26T16:11:07.479938+0000 mon.a (mon.0) 1202 : cluster [DBG] osdmap e821: 8 total, 8 up, 8 in 2021-07-26T16:11:08.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:08 smithi033 bash[42377]: cluster 2021-07-26T16:11:07.227991+0000 mgr.y (mgr.34104) 515 : cluster [DBG] pgmap v1066: 25 pgs: 25 active+clean; 954 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 767 B/s rd, 56 KiB/s wr, 2 op/s 2021-07-26T16:11:08.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:08 smithi033 bash[42377]: cluster 2021-07-26T16:11:07.479938+0000 mon.a (mon.0) 1202 : cluster [DBG] osdmap e821: 8 total, 8 up, 8 in 2021-07-26T16:11:08.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:08 smithi096 bash[33981]: cluster 2021-07-26T16:11:07.227991+0000 mgr.y (mgr.34104) 515 : cluster [DBG] pgmap v1066: 25 pgs: 25 active+clean; 954 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 767 B/s rd, 56 KiB/s wr, 2 op/s 2021-07-26T16:11:08.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:08 smithi096 bash[33981]: cluster 2021-07-26T16:11:07.479938+0000 mon.a (mon.0) 1202 : cluster [DBG] osdmap e821: 8 total, 8 up, 8 in 2021-07-26T16:11:09.507 INFO:tasks.rados.rados.0.smithi033.stdout:3897: done (3 left) 2021-07-26T16:11:09.507 INFO:tasks.rados.rados.0.smithi033.stdout:3898: done (2 left) 2021-07-26T16:11:09.507 INFO:tasks.rados.rados.0.smithi033.stdout:3899: done (1 left) 2021-07-26T16:11:09.507 INFO:tasks.rados.rados.0.smithi033.stdout:3900: done (0 left) 2021-07-26T16:11:09.508 INFO:tasks.rados.rados.0.smithi033.stdout:3901: rollback oid 17 current snap is 383 2021-07-26T16:11:09.508 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 17 to 356 2021-07-26T16:11:09.508 INFO:tasks.rados.rados.0.smithi033.stdout:3902: snap_create 2021-07-26T16:11:09.514 INFO:tasks.rados.rados.0.smithi033.stdout:3901: finishing rollback tid 0 to smithi03339061-17 2021-07-26T16:11:09.514 INFO:tasks.rados.rados.0.smithi033.stdout:3901: finishing rollback tid 1 to smithi03339061-17 2021-07-26T16:11:09.515 INFO:tasks.rados.rados.0.smithi033.stdout:3901: finishing rollback tid 2 to smithi03339061-17 2021-07-26T16:11:09.515 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 1420 (ObjNum 1018 snap 340 seq_num 1018) dirty exists 2021-07-26T16:11:09.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:09 smithi033 bash[41341]: cluster 2021-07-26T16:11:08.483511+0000 mon.a (mon.0) 1203 : cluster [DBG] osdmap e822: 8 total, 8 up, 8 in 2021-07-26T16:11:09.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:09 smithi033 bash[41341]: audit 2021-07-26T16:11:09.264571+0000 mon.c (mon.1) 276 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:11:09.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:09 smithi033 bash[41341]: audit 2021-07-26T16:11:09.265253+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:11:09.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:09 smithi033 bash[41341]: audit 2021-07-26T16:11:09.286413+0000 mon.c (mon.1) 277 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:11:09.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:09 smithi033 bash[41341]: audit 2021-07-26T16:11:09.287151+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:11:09.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:09 smithi033 bash[42377]: cluster 2021-07-26T16:11:08.483511+0000 mon.a (mon.0) 1203 : cluster [DBG] osdmap e822: 8 total, 8 up, 8 in 2021-07-26T16:11:09.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:09 smithi033 bash[42377]: audit 2021-07-26T16:11:09.264571+0000 mon.c (mon.1) 276 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:11:09.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:09 smithi033 bash[42377]: audit 2021-07-26T16:11:09.265253+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:11:09.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:09 smithi033 bash[42377]: audit 2021-07-26T16:11:09.286413+0000 mon.c (mon.1) 277 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:11:09.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:09 smithi033 bash[42377]: audit 2021-07-26T16:11:09.287151+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:11:09.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:09 smithi096 bash[33981]: cluster 2021-07-26T16:11:08.483511+0000 mon.a (mon.0) 1203 : cluster [DBG] osdmap e822: 8 total, 8 up, 8 in 2021-07-26T16:11:09.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:09 smithi096 bash[33981]: audit 2021-07-26T16:11:09.264571+0000 mon.c (mon.1) 276 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:11:09.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:09 smithi096 bash[33981]: audit 2021-07-26T16:11:09.265253+0000 mon.a (mon.0) 1204 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:11:09.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:09 smithi096 bash[33981]: audit 2021-07-26T16:11:09.286413+0000 mon.c (mon.1) 277 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:11:09.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:09 smithi096 bash[33981]: audit 2021-07-26T16:11:09.287151+0000 mon.a (mon.0) 1205 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:11:10.514 INFO:tasks.rados.rados.0.smithi033.stdout:3901: done (1 left) 2021-07-26T16:11:10.514 INFO:tasks.rados.rados.0.smithi033.stdout:3902: done (0 left) 2021-07-26T16:11:10.514 INFO:tasks.rados.rados.0.smithi033.stdout:3903: read oid 13 snap -1 2021-07-26T16:11:10.515 INFO:tasks.rados.rados.0.smithi033.stdout:3903: expect (ObjNum 1155 snap 380 seq_num 1155) 2021-07-26T16:11:10.515 INFO:tasks.rados.rados.0.smithi033.stdout:3904: read oid 3 snap 376 2021-07-26T16:11:10.515 INFO:tasks.rados.rados.0.smithi033.stdout:3904: expect deleted 2021-07-26T16:11:10.515 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 4 current snap is 384 2021-07-26T16:11:10.516 INFO:tasks.rados.rados.0.smithi033.stdout:3905: seq_num 1161 ranges {7053312=245760} 2021-07-26T16:11:10.559 INFO:tasks.rados.rados.0.smithi033.stdout:3905: writing smithi03339061-4 from 7053312 to 7299072 tid 1 2021-07-26T16:11:10.559 INFO:tasks.rados.rados.0.smithi033.stdout:3906: rollback oid 30 current snap is 384 2021-07-26T16:11:10.559 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 30 to 358 2021-07-26T16:11:10.560 INFO:tasks.rados.rados.0.smithi033.stdout:3904: done (3 left) 2021-07-26T16:11:10.560 INFO:tasks.rados.rados.0.smithi033.stdout:3907: copy_from oid 40 from oid 16 current snap is 384 2021-07-26T16:11:10.560 INFO:tasks.rados.rados.0.smithi033.stdout:3908: delete oid 41 current snap is 384 2021-07-26T16:11:10.564 INFO:tasks.rados.rados.0.smithi033.stdout:3907: finishing copy_from to smithi03339061-40 2021-07-26T16:11:10.564 INFO:tasks.rados.rados.0.smithi033.stdout:3907: got expected ENOENT (src dne) 2021-07-26T16:11:10.565 INFO:tasks.rados.rados.0.smithi033.stdout:3907: finishing copy_from racing read to smithi03339061-40 2021-07-26T16:11:10.568 INFO:tasks.rados.rados.0.smithi033.stdout:3907: done (4 left) 2021-07-26T16:11:10.568 INFO:tasks.rados.rados.0.smithi033.stdout:3908: done (3 left) 2021-07-26T16:11:10.569 INFO:tasks.rados.rados.0.smithi033.stdout:3909: delete oid 26 current snap is 384 2021-07-26T16:11:10.569 INFO:tasks.rados.rados.0.smithi033.stdout:3906: finishing rollback tid 0 to smithi03339061-30 2021-07-26T16:11:10.571 INFO:tasks.rados.rados.0.smithi033.stdout:3906: finishing rollback tid 1 to smithi03339061-30 2021-07-26T16:11:10.571 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 30 v 2112 (ObjNum 2007814448 snap 22002 seq_num 738199760) dirty dne 2021-07-26T16:11:10.573 INFO:tasks.rados.rados.0.smithi033.stdout:3906: done (3 left) 2021-07-26T16:11:10.573 INFO:tasks.rados.rados.0.smithi033.stdout:3909: done (2 left) 2021-07-26T16:11:10.573 INFO:tasks.rados.rados.0.smithi033.stdout:3910: rollback oid 8 current snap is 384 2021-07-26T16:11:10.573 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 8 to 316 2021-07-26T16:11:10.574 INFO:tasks.rados.rados.0.smithi033.stdout:3911: rmattr oid 17 current snap is 384 2021-07-26T16:11:10.574 INFO:tasks.rados.rados.0.smithi033.stdout:3912: delete oid 14 current snap is 384 2021-07-26T16:11:10.589 INFO:tasks.rados.rados.0.smithi033.stdout:3910: finishing rollback tid 0 to smithi03339061-8 2021-07-26T16:11:10.589 INFO:tasks.rados.rados.0.smithi033.stdout:3910: finishing rollback tid 1 to smithi03339061-8 2021-07-26T16:11:10.589 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 1849 (ObjNum 288 snap 0 seq_num 33) dirty dne 2021-07-26T16:11:10.590 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 17 v 1421 (ObjNum 1018 snap 340 seq_num 1018) dirty exists 2021-07-26T16:11:10.624 INFO:tasks.rados.rados.0.smithi033.stdout:3903: expect (ObjNum 1155 snap 380 seq_num 1155) 2021-07-26T16:11:10.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:10 smithi033 bash[41341]: cluster 2021-07-26T16:11:09.228681+0000 mgr.y (mgr.34104) 516 : cluster [DBG] pgmap v1069: 25 pgs: 25 active+clean; 983 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.5 MiB/s wr, 7 op/s 2021-07-26T16:11:10.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:10 smithi033 bash[41341]: cluster 2021-07-26T16:11:09.502920+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e823: 8 total, 8 up, 8 in 2021-07-26T16:11:10.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:10 smithi033 bash[42377]: cluster 2021-07-26T16:11:09.228681+0000 mgr.y (mgr.34104) 516 : cluster [DBG] pgmap v1069: 25 pgs: 25 active+clean; 983 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.5 MiB/s wr, 7 op/s 2021-07-26T16:11:10.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:10 smithi033 bash[42377]: cluster 2021-07-26T16:11:09.502920+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e823: 8 total, 8 up, 8 in 2021-07-26T16:11:10.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:10 smithi096 bash[33981]: cluster 2021-07-26T16:11:09.228681+0000 mgr.y (mgr.34104) 516 : cluster [DBG] pgmap v1069: 25 pgs: 25 active+clean; 983 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 1.3 MiB/s rd, 5.5 MiB/s wr, 7 op/s 2021-07-26T16:11:10.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:10 smithi096 bash[33981]: cluster 2021-07-26T16:11:09.502920+0000 mon.a (mon.0) 1206 : cluster [DBG] osdmap e823: 8 total, 8 up, 8 in 2021-07-26T16:11:11.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:11 smithi033 bash[41341]: cluster 2021-07-26T16:11:10.510196+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e824: 8 total, 8 up, 8 in 2021-07-26T16:11:11.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:11 smithi033 bash[41341]: cluster 2021-07-26T16:11:11.302877+0000 mon.a (mon.0) 1208 : cluster [DBG] osdmap e825: 8 total, 8 up, 8 in 2021-07-26T16:11:11.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:11 smithi033 bash[42377]: cluster 2021-07-26T16:11:10.510196+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e824: 8 total, 8 up, 8 in 2021-07-26T16:11:11.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:11 smithi033 bash[42377]: cluster 2021-07-26T16:11:11.302877+0000 mon.a (mon.0) 1208 : cluster [DBG] osdmap e825: 8 total, 8 up, 8 in 2021-07-26T16:11:11.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:11 smithi096 bash[33981]: cluster 2021-07-26T16:11:10.510196+0000 mon.a (mon.0) 1207 : cluster [DBG] osdmap e824: 8 total, 8 up, 8 in 2021-07-26T16:11:11.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:11 smithi096 bash[33981]: cluster 2021-07-26T16:11:11.302877+0000 mon.a (mon.0) 1208 : cluster [DBG] osdmap e825: 8 total, 8 up, 8 in 2021-07-26T16:11:12.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:12 smithi033 bash[41341]: cluster 2021-07-26T16:11:11.229303+0000 mgr.y (mgr.34104) 517 : cluster [DBG] pgmap v1072: 25 pgs: 25 active+clean; 1013 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 8.1 MiB/s rd, 12 MiB/s wr, 14 op/s 2021-07-26T16:11:12.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:12 smithi033 bash[42377]: cluster 2021-07-26T16:11:11.229303+0000 mgr.y (mgr.34104) 517 : cluster [DBG] pgmap v1072: 25 pgs: 25 active+clean; 1013 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 8.1 MiB/s rd, 12 MiB/s wr, 14 op/s 2021-07-26T16:11:12.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:12 smithi096 bash[33981]: cluster 2021-07-26T16:11:11.229303+0000 mgr.y (mgr.34104) 517 : cluster [DBG] pgmap v1072: 25 pgs: 25 active+clean; 1013 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 8.1 MiB/s rd, 12 MiB/s wr, 14 op/s 2021-07-26T16:11:14.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:14 smithi033 bash[41341]: cluster 2021-07-26T16:11:13.229971+0000 mgr.y (mgr.34104) 518 : cluster [DBG] pgmap v1074: 25 pgs: 25 active+clean; 1015 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 8 op/s 2021-07-26T16:11:14.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:14 smithi033 bash[42377]: cluster 2021-07-26T16:11:13.229971+0000 mgr.y (mgr.34104) 518 : cluster [DBG] pgmap v1074: 25 pgs: 25 active+clean; 1015 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 8 op/s 2021-07-26T16:11:14.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:14 smithi096 bash[33981]: cluster 2021-07-26T16:11:13.229971+0000 mgr.y (mgr.34104) 518 : cluster [DBG] pgmap v1074: 25 pgs: 25 active+clean; 1015 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 5.7 MiB/s rd, 5.6 MiB/s wr, 8 op/s 2021-07-26T16:11:15.466 INFO:tasks.rados.rados.0.smithi033.stdout:3905: finishing write tid 1 to smithi03339061-4 2021-07-26T16:11:15.466 INFO:tasks.rados.rados.0.smithi033.stdout:3905: finishing write tid 2 to smithi03339061-4 2021-07-26T16:11:15.467 INFO:tasks.rados.rados.0.smithi033.stdout:3905: finishing write tid 3 to smithi03339061-4 2021-07-26T16:11:15.467 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 2098 (ObjNum 1161 snap 384 seq_num 1161) dirty exists 2021-07-26T16:11:15.467 INFO:tasks.rados.rados.0.smithi033.stdout:3905: left oid 4 (ObjNum 1161 snap 384 seq_num 1161) 2021-07-26T16:11:15.467 INFO:tasks.rados.rados.0.smithi033.stdout:3903: done (4 left) 2021-07-26T16:11:15.468 INFO:tasks.rados.rados.0.smithi033.stdout:3905: done (3 left) 2021-07-26T16:11:15.468 INFO:tasks.rados.rados.0.smithi033.stdout:3910: done (2 left) 2021-07-26T16:11:15.469 INFO:tasks.rados.rados.0.smithi033.stdout:3911: done (1 left) 2021-07-26T16:11:15.469 INFO:tasks.rados.rados.0.smithi033.stdout:3912: done (0 left) 2021-07-26T16:11:15.469 INFO:tasks.rados.rados.0.smithi033.stdout:3913: read oid 7 snap -1 2021-07-26T16:11:15.469 INFO:tasks.rados.rados.0.smithi033.stdout:3913: expect (ObjNum 1128 snap 373 seq_num 1128) 2021-07-26T16:11:15.469 INFO:tasks.rados.rados.0.smithi033.stdout:3914: snap_remove snap 370 2021-07-26T16:11:15.535 INFO:tasks.rados.rados.0.smithi033.stdout:3914: done (1 left) 2021-07-26T16:11:15.535 INFO:tasks.rados.rados.0.smithi033.stdout:3915: setattr oid 50 current snap is 384 2021-07-26T16:11:15.538 INFO:tasks.rados.rados.0.smithi033.stdout:3913: expect (ObjNum 1128 snap 373 seq_num 1128) 2021-07-26T16:11:15.683 INFO:tasks.rados.rados.0.smithi033.stdout:3913: done (1 left) 2021-07-26T16:11:15.684 INFO:tasks.rados.rados.0.smithi033.stdout:3916: delete oid 4 current snap is 384 2021-07-26T16:11:15.690 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 50 v 2357 (ObjNum 0 snap 0 seq_num 0) dirty exists 2021-07-26T16:11:15.690 INFO:tasks.rados.rados.0.smithi033.stdout:3915: done (1 left) 2021-07-26T16:11:15.690 INFO:tasks.rados.rados.0.smithi033.stdout:3916: done (0 left) 2021-07-26T16:11:15.690 INFO:tasks.rados.rados.0.smithi033.stdout:3917: copy_from oid 26 from oid 41 current snap is 384 2021-07-26T16:11:15.691 INFO:tasks.rados.rados.0.smithi033.stdout:3918: delete oid 50 current snap is 384 2021-07-26T16:11:15.693 INFO:tasks.rados.rados.0.smithi033.stdout:3917: finishing copy_from to smithi03339061-26 2021-07-26T16:11:15.693 INFO:tasks.rados.rados.0.smithi033.stdout:3917: got expected ENOENT (src dne) 2021-07-26T16:11:15.694 INFO:tasks.rados.rados.0.smithi033.stdout:3917: finishing copy_from racing read to smithi03339061-26 2021-07-26T16:11:15.695 INFO:tasks.rados.rados.0.smithi033.stdout:3917: done (1 left) 2021-07-26T16:11:15.695 INFO:tasks.rados.rados.0.smithi033.stdout:3918: done (0 left) 2021-07-26T16:11:15.695 INFO:tasks.rados.rados.0.smithi033.stdout:3919: delete oid 32 current snap is 384 2021-07-26T16:11:15.700 INFO:tasks.rados.rados.0.smithi033.stdout:3919: done (0 left) 2021-07-26T16:11:15.700 INFO:tasks.rados.rados.0.smithi033.stdout:3920: rollback oid 48 current snap is 384 2021-07-26T16:11:15.700 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 48 to 321 2021-07-26T16:11:15.700 INFO:tasks.rados.rados.0.smithi033.stdout:3921: copy_from oid 7 from oid 5 current snap is 384 2021-07-26T16:11:15.700 INFO:tasks.rados.rados.0.smithi033.stdout:3922: read oid 14 snap -1 2021-07-26T16:11:15.701 INFO:tasks.rados.rados.0.smithi033.stdout:3922: expect deleted 2021-07-26T16:11:15.701 INFO:tasks.rados.rados.0.smithi033.stdout:3923: snap_create 2021-07-26T16:11:15.709 INFO:tasks.rados.rados.0.smithi033.stdout:3920: finishing rollback tid 0 to smithi03339061-48 2021-07-26T16:11:15.710 INFO:tasks.rados.rados.0.smithi033.stdout:3920: finishing rollback tid 1 to smithi03339061-48 2021-07-26T16:11:15.710 INFO:tasks.rados.rados.0.smithi033.stdout:3920: finishing rollback tid 2 to smithi03339061-48 2021-07-26T16:11:15.710 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 2103 (ObjNum 904 snap 302 seq_num 904) dirty exists 2021-07-26T16:11:15.780 INFO:tasks.rados.rados.0.smithi033.stdout:3921: finishing copy_from to smithi03339061-7 2021-07-26T16:11:15.781 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 2095 (ObjNum 1150 snap 378 seq_num 1150) dirty exists 2021-07-26T16:11:15.781 INFO:tasks.rados.rados.0.smithi033.stdout:3921: finishing copy_from racing read to smithi03339061-7 2021-07-26T16:11:16.308 INFO:tasks.rados.rados.0.smithi033.stdout:3920: done (3 left) 2021-07-26T16:11:16.309 INFO:tasks.rados.rados.0.smithi033.stdout:3921: done (2 left) 2021-07-26T16:11:16.309 INFO:tasks.rados.rados.0.smithi033.stdout:3922: done (1 left) 2021-07-26T16:11:16.310 INFO:tasks.rados.rados.0.smithi033.stdout:3923: done (0 left) 2021-07-26T16:11:16.311 INFO:tasks.rados.rados.0.smithi033.stdout:3924: delete oid 40 current snap is 385 2021-07-26T16:11:16.312 INFO:tasks.rados.rados.0.smithi033.stdout:3924: done (0 left) 2021-07-26T16:11:16.312 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 40 current snap is 385 2021-07-26T16:11:16.313 INFO:tasks.rados.rados.0.smithi033.stdout:3925: seq_num 1169 ranges {0=385024} 2021-07-26T16:11:16.315 INFO:tasks.rados.rados.0.smithi033.stdout:3925: writing smithi03339061-40 from 0 to 385024 tid 1 2021-07-26T16:11:16.316 INFO:tasks.rados.rados.0.smithi033.stdout:3926: rmattr oid 33 current snap is 385 2021-07-26T16:11:16.316 INFO:tasks.rados.rados.0.smithi033.stdout:3926: done (1 left) 2021-07-26T16:11:16.316 INFO:tasks.rados.rados.0.smithi033.stdout:3927: rollback oid 5 current snap is 385 2021-07-26T16:11:16.317 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 5 to 345 2021-07-26T16:11:16.318 INFO:tasks.rados.rados.0.smithi033.stdout:3928: copy_from oid 30 from oid 25 current snap is 385 2021-07-26T16:11:16.318 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 46 current snap is 385 2021-07-26T16:11:16.319 INFO:tasks.rados.rados.0.smithi033.stdout:3929: seq_num 1170 ranges {23027712=401408} 2021-07-26T16:11:16.447 INFO:tasks.rados.rados.0.smithi033.stdout:3929: writing smithi03339061-46 from 23027712 to 23429120 tid 1 2021-07-26T16:11:16.447 INFO:tasks.rados.rados.0.smithi033.stdout:3930: rollback oid 26 current snap is 385 2021-07-26T16:11:16.448 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 26 to 344 2021-07-26T16:11:16.448 INFO:tasks.rados.rados.0.smithi033.stdout:3928: finishing copy_from to smithi03339061-30 2021-07-26T16:11:16.448 INFO:tasks.rados.rados.0.smithi033.stdout:3928: got expected ENOENT (src dne) 2021-07-26T16:11:16.448 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 385 2021-07-26T16:11:16.449 INFO:tasks.rados.rados.0.smithi033.stdout:3931: seq_num 1171 ranges {2719744=417792} 2021-07-26T16:11:16.465 INFO:tasks.rados.rados.0.smithi033.stdout:3931: writing smithi03339061-38 from 2719744 to 3137536 tid 1 2021-07-26T16:11:16.465 INFO:tasks.rados.rados.0.smithi033.stdout:3932: read oid 45 snap -1 2021-07-26T16:11:16.465 INFO:tasks.rados.rados.0.smithi033.stdout:3932: expect (ObjNum 1011 snap 338 seq_num 1011) 2021-07-26T16:11:16.465 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 34 current snap is 385 2021-07-26T16:11:16.466 INFO:tasks.rados.rados.0.smithi033.stdout:3928: finishing copy_from racing read to smithi03339061-30 2021-07-26T16:11:16.466 INFO:tasks.rados.rados.0.smithi033.stdout:3933: seq_num 1172 ranges {7004160=434176} 2021-07-26T16:11:16.507 INFO:tasks.rados.rados.0.smithi033.stdout:3933: writing smithi03339061-34 from 7004160 to 7438336 tid 1 2021-07-26T16:11:16.507 INFO:tasks.rados.rados.0.smithi033.stdout:3928: done (7 left) 2021-07-26T16:11:16.507 INFO:tasks.rados.rados.0.smithi033.stdout:3934: snap_create 2021-07-26T16:11:16.508 INFO:tasks.rados.rados.0.smithi033.stdout:3925: finishing write tid 1 to smithi03339061-40 2021-07-26T16:11:16.508 INFO:tasks.rados.rados.0.smithi033.stdout:3925: finishing write tid 2 to smithi03339061-40 2021-07-26T16:11:16.508 INFO:tasks.rados.rados.0.smithi033.stdout:3927: finishing rollback tid 0 to smithi03339061-5 2021-07-26T16:11:16.509 INFO:tasks.rados.rados.0.smithi033.stdout:3925: finishing write tid 3 to smithi03339061-40 2021-07-26T16:11:16.509 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 40 v 1423 (ObjNum 1169 snap 385 seq_num 1169) dirty exists 2021-07-26T16:11:16.509 INFO:tasks.rados.rados.0.smithi033.stdout:3925: left oid 40 (ObjNum 1169 snap 385 seq_num 1169) 2021-07-26T16:11:16.509 INFO:tasks.rados.rados.0.smithi033.stdout:3927: finishing rollback tid 1 to smithi03339061-5 2021-07-26T16:11:16.510 INFO:tasks.rados.rados.0.smithi033.stdout:3927: finishing rollback tid 2 to smithi03339061-5 2021-07-26T16:11:16.510 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 5 v 2106 (ObjNum 1016 snap 339 seq_num 1016) dirty exists 2021-07-26T16:11:16.510 INFO:tasks.rados.rados.0.smithi033.stdout:3930: finishing rollback tid 1 to smithi03339061-26 2021-07-26T16:11:16.510 INFO:tasks.rados.rados.0.smithi033.stdout:3930: finishing rollback tid 2 to smithi03339061-26 2021-07-26T16:11:16.510 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 2549 (ObjNum 1033 snap 344 seq_num 1033) dirty exists 2021-07-26T16:11:16.511 INFO:tasks.rados.rados.0.smithi033.stdout:3929: finishing write tid 1 to smithi03339061-46 2021-07-26T16:11:16.511 INFO:tasks.rados.rados.0.smithi033.stdout:3929: finishing write tid 2 to smithi03339061-46 2021-07-26T16:11:16.511 INFO:tasks.rados.rados.0.smithi033.stdout:3929: finishing write tid 3 to smithi03339061-46 2021-07-26T16:11:16.511 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 46 v 2086 (ObjNum 1170 snap 385 seq_num 1170) dirty exists 2021-07-26T16:11:16.512 INFO:tasks.rados.rados.0.smithi033.stdout:3929: left oid 46 (ObjNum 1170 snap 385 seq_num 1170) 2021-07-26T16:11:16.512 INFO:tasks.rados.rados.0.smithi033.stdout:3931: finishing write tid 1 to smithi03339061-38 2021-07-26T16:11:16.512 INFO:tasks.rados.rados.0.smithi033.stdout:3931: finishing write tid 2 to smithi03339061-38 2021-07-26T16:11:16.512 INFO:tasks.rados.rados.0.smithi033.stdout:3932: expect (ObjNum 1011 snap 338 seq_num 1011) 2021-07-26T16:11:16.653 INFO:tasks.rados.rados.0.smithi033.stdout:3931: finishing write tid 3 to smithi03339061-38 2021-07-26T16:11:16.654 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 752 (ObjNum 1171 snap 385 seq_num 1171) dirty exists 2021-07-26T16:11:16.654 INFO:tasks.rados.rados.0.smithi033.stdout:3931: left oid 38 (ObjNum 1171 snap 385 seq_num 1171) 2021-07-26T16:11:16.654 INFO:tasks.rados.rados.0.smithi033.stdout:3933: finishing write tid 1 to smithi03339061-34 2021-07-26T16:11:16.654 INFO:tasks.rados.rados.0.smithi033.stdout:3933: finishing write tid 2 to smithi03339061-34 2021-07-26T16:11:16.655 INFO:tasks.rados.rados.0.smithi033.stdout:3933: finishing write tid 3 to smithi03339061-34 2021-07-26T16:11:16.655 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1462 (ObjNum 1172 snap 385 seq_num 1172) dirty exists 2021-07-26T16:11:16.655 INFO:tasks.rados.rados.0.smithi033.stdout:3933: left oid 34 (ObjNum 1172 snap 385 seq_num 1172) 2021-07-26T16:11:16.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:16 smithi033 bash[41341]: cluster 2021-07-26T16:11:15.230727+0000 mgr.y (mgr.34104) 519 : cluster [DBG] pgmap v1075: 25 pgs: 25 active+clean; 1015 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 6 op/s 2021-07-26T16:11:16.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:16 smithi033 bash[41341]: cluster 2021-07-26T16:11:15.531540+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e826: 8 total, 8 up, 8 in 2021-07-26T16:11:16.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:16 smithi033 bash[41341]: cluster 2021-07-26T16:11:16.303655+0000 mon.a (mon.0) 1210 : cluster [DBG] osdmap e827: 8 total, 8 up, 8 in 2021-07-26T16:11:16.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:16 smithi033 bash[42377]: cluster 2021-07-26T16:11:15.230727+0000 mgr.y (mgr.34104) 519 : cluster [DBG] pgmap v1075: 25 pgs: 25 active+clean; 1015 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 6 op/s 2021-07-26T16:11:16.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:16 smithi033 bash[42377]: cluster 2021-07-26T16:11:15.531540+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e826: 8 total, 8 up, 8 in 2021-07-26T16:11:16.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:16 smithi033 bash[42377]: cluster 2021-07-26T16:11:16.303655+0000 mon.a (mon.0) 1210 : cluster [DBG] osdmap e827: 8 total, 8 up, 8 in 2021-07-26T16:11:16.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:16 smithi096 bash[33981]: cluster 2021-07-26T16:11:15.230727+0000 mgr.y (mgr.34104) 519 : cluster [DBG] pgmap v1075: 25 pgs: 25 active+clean; 1015 MiB data, 3.9 GiB used, 711 GiB / 715 GiB avail; 4.5 MiB/s rd, 4.5 MiB/s wr, 6 op/s 2021-07-26T16:11:16.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:16 smithi096 bash[33981]: cluster 2021-07-26T16:11:15.531540+0000 mon.a (mon.0) 1209 : cluster [DBG] osdmap e826: 8 total, 8 up, 8 in 2021-07-26T16:11:16.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:16 smithi096 bash[33981]: cluster 2021-07-26T16:11:16.303655+0000 mon.a (mon.0) 1210 : cluster [DBG] osdmap e827: 8 total, 8 up, 8 in 2021-07-26T16:11:17.319 INFO:tasks.rados.rados.0.smithi033.stdout:3925: done (7 left) 2021-07-26T16:11:17.320 INFO:tasks.rados.rados.0.smithi033.stdout:3927: done (6 left) 2021-07-26T16:11:17.320 INFO:tasks.rados.rados.0.smithi033.stdout:3929: done (5 left) 2021-07-26T16:11:17.320 INFO:tasks.rados.rados.0.smithi033.stdout:3930: done (4 left) 2021-07-26T16:11:17.320 INFO:tasks.rados.rados.0.smithi033.stdout:3931: done (3 left) 2021-07-26T16:11:17.321 INFO:tasks.rados.rados.0.smithi033.stdout:3932: done (2 left) 2021-07-26T16:11:17.321 INFO:tasks.rados.rados.0.smithi033.stdout:3933: done (1 left) 2021-07-26T16:11:17.321 INFO:tasks.rados.rados.0.smithi033.stdout:3934: done (0 left) 2021-07-26T16:11:17.321 INFO:tasks.rados.rados.0.smithi033.stdout:3935: copy_from oid 7 from oid 42 current snap is 386 2021-07-26T16:11:17.321 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 386 2021-07-26T16:11:17.322 INFO:tasks.rados.rados.0.smithi033.stdout:3936: seq_num 1173 ranges {8077312=450560} 2021-07-26T16:11:17.370 INFO:tasks.rados.rados.0.smithi033.stdout:3936: writing smithi03339061-48 from 8077312 to 8527872 tid 1 2021-07-26T16:11:17.371 INFO:tasks.rados.rados.0.smithi033.stdout:3937: snap_remove snap 354 2021-07-26T16:11:18.323 INFO:tasks.rados.rados.0.smithi033.stdout:3937: done (2 left) 2021-07-26T16:11:18.323 INFO:tasks.rados.rados.0.smithi033.stdout:3938: read oid 43 snap -1 2021-07-26T16:11:18.324 INFO:tasks.rados.rados.0.smithi033.stdout:3938: expect (ObjNum 1154 snap 380 seq_num 1154) 2021-07-26T16:11:18.324 INFO:tasks.rados.rados.0.smithi033.stdout:3939: read oid 22 snap -1 2021-07-26T16:11:18.324 INFO:tasks.rados.rados.0.smithi033.stdout:3939: expect deleted 2021-07-26T16:11:18.324 INFO:tasks.rados.rados.0.smithi033.stdout:3940: setattr oid 34 current snap is 386 2021-07-26T16:11:18.325 INFO:tasks.rados.rados.0.smithi033.stdout:3935: finishing copy_from to smithi03339061-7 2021-07-26T16:11:18.326 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 2087 (ObjNum 0 snap 0 seq_num 0) dirty exists 2021-07-26T16:11:18.326 INFO:tasks.rados.rados.0.smithi033.stdout:3935: finishing copy_from racing read to smithi03339061-7 2021-07-26T16:11:18.326 INFO:tasks.rados.rados.0.smithi033.stdout:3936: finishing write tid 1 to smithi03339061-48 2021-07-26T16:11:18.327 INFO:tasks.rados.rados.0.smithi033.stdout:3936: finishing write tid 2 to smithi03339061-48 2021-07-26T16:11:18.327 INFO:tasks.rados.rados.0.smithi033.stdout:3936: finishing write tid 3 to smithi03339061-48 2021-07-26T16:11:18.327 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 2108 (ObjNum 1173 snap 386 seq_num 1173) dirty exists 2021-07-26T16:11:18.327 INFO:tasks.rados.rados.0.smithi033.stdout:3936: left oid 48 (ObjNum 1173 snap 386 seq_num 1173) 2021-07-26T16:11:18.327 INFO:tasks.rados.rados.0.smithi033.stdout:3935: done (4 left) 2021-07-26T16:11:18.328 INFO:tasks.rados.rados.0.smithi033.stdout:3936: done (3 left) 2021-07-26T16:11:18.328 INFO:tasks.rados.rados.0.smithi033.stdout:3941: read oid 23 snap -1 2021-07-26T16:11:18.328 INFO:tasks.rados.rados.0.smithi033.stdout:3941: expect (ObjNum 1087 snap 360 seq_num 1087) 2021-07-26T16:11:18.328 INFO:tasks.rados.rados.0.smithi033.stdout:3942: read oid 4 snap 384 2021-07-26T16:11:18.329 INFO:tasks.rados.rados.0.smithi033.stdout:3942: expect deleted 2021-07-26T16:11:18.329 INFO:tasks.rados.rados.0.smithi033.stdout:3943: copy_from oid 26 from oid 20 current snap is 386 2021-07-26T16:11:18.329 INFO:tasks.rados.rados.0.smithi033.stdout:3944: snap_remove snap 381 2021-07-26T16:11:18.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:18 smithi033 bash[42377]: cluster 2021-07-26T16:11:17.231610+0000 mgr.y (mgr.34104) 520 : cluster [DBG] pgmap v1078: 25 pgs: 25 active+clean; 1015 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 40 KiB/s wr, 6 op/s 2021-07-26T16:11:18.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:18 smithi033 bash[42377]: cluster 2021-07-26T16:11:17.315860+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e828: 8 total, 8 up, 8 in 2021-07-26T16:11:18.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:18 smithi033 bash[41341]: cluster 2021-07-26T16:11:17.231610+0000 mgr.y (mgr.34104) 520 : cluster [DBG] pgmap v1078: 25 pgs: 25 active+clean; 1015 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 40 KiB/s wr, 6 op/s 2021-07-26T16:11:18.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:18 smithi033 bash[41341]: cluster 2021-07-26T16:11:17.315860+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e828: 8 total, 8 up, 8 in 2021-07-26T16:11:18.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:18 smithi096 bash[33981]: cluster 2021-07-26T16:11:17.231610+0000 mgr.y (mgr.34104) 520 : cluster [DBG] pgmap v1078: 25 pgs: 25 active+clean; 1015 MiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 12 MiB/s rd, 40 KiB/s wr, 6 op/s 2021-07-26T16:11:18.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:18 smithi096 bash[33981]: cluster 2021-07-26T16:11:17.315860+0000 mon.a (mon.0) 1211 : cluster [DBG] osdmap e828: 8 total, 8 up, 8 in 2021-07-26T16:11:19.343 INFO:tasks.rados.rados.0.smithi033.stdout:3944: done (6 left) 2021-07-26T16:11:19.344 INFO:tasks.rados.rados.0.smithi033.stdout:3945: read oid 15 snap -1 2021-07-26T16:11:19.344 INFO:tasks.rados.rados.0.smithi033.stdout:3945: expect (ObjNum 1128 snap 373 seq_num 1128) 2021-07-26T16:11:19.344 INFO:tasks.rados.rados.0.smithi033.stdout:3946: snap_create 2021-07-26T16:11:19.344 INFO:tasks.rados.rados.0.smithi033.stdout:3943: finishing copy_from to smithi03339061-26 2021-07-26T16:11:19.345 INFO:tasks.rados.rados.0.smithi033.stdout:3943: got expected ENOENT (src dne) 2021-07-26T16:11:19.345 INFO:tasks.rados.rados.0.smithi033.stdout:3943: finishing copy_from racing read to smithi03339061-26 2021-07-26T16:11:19.345 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1463 (ObjNum 1172 snap 385 seq_num 1172) dirty exists 2021-07-26T16:11:19.345 INFO:tasks.rados.rados.0.smithi033.stdout:3938: expect (ObjNum 1154 snap 380 seq_num 1154) 2021-07-26T16:11:19.565 INFO:tasks.rados.rados.0.smithi033.stdout:3941: expect (ObjNum 1087 snap 360 seq_num 1087) 2021-07-26T16:11:19.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:19 smithi033 bash[41341]: cluster 2021-07-26T16:11:18.318396+0000 mon.a (mon.0) 1212 : cluster [DBG] osdmap e829: 8 total, 8 up, 8 in 2021-07-26T16:11:19.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:19 smithi033 bash[42377]: cluster 2021-07-26T16:11:18.318396+0000 mon.a (mon.0) 1212 : cluster [DBG] osdmap e829: 8 total, 8 up, 8 in 2021-07-26T16:11:19.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:19 smithi096 bash[33981]: cluster 2021-07-26T16:11:18.318396+0000 mon.a (mon.0) 1212 : cluster [DBG] osdmap e829: 8 total, 8 up, 8 in 2021-07-26T16:11:19.842 INFO:tasks.rados.rados.0.smithi033.stdout:3945: expect (ObjNum 1128 snap 373 seq_num 1128) 2021-07-26T16:11:20.353 INFO:tasks.rados.rados.0.smithi033.stdout:3938: done (7 left) 2021-07-26T16:11:20.353 INFO:tasks.rados.rados.0.smithi033.stdout:3939: done (6 left) 2021-07-26T16:11:20.353 INFO:tasks.rados.rados.0.smithi033.stdout:3940: done (5 left) 2021-07-26T16:11:20.354 INFO:tasks.rados.rados.0.smithi033.stdout:3941: done (4 left) 2021-07-26T16:11:20.354 INFO:tasks.rados.rados.0.smithi033.stdout:3942: done (3 left) 2021-07-26T16:11:20.354 INFO:tasks.rados.rados.0.smithi033.stdout:3943: done (2 left) 2021-07-26T16:11:20.354 INFO:tasks.rados.rados.0.smithi033.stdout:3945: done (1 left) 2021-07-26T16:11:20.355 INFO:tasks.rados.rados.0.smithi033.stdout:3946: done (0 left) 2021-07-26T16:11:20.355 INFO:tasks.rados.rados.0.smithi033.stdout:3947: copy_from oid 47 from oid 24 current snap is 387 2021-07-26T16:11:20.355 INFO:tasks.rados.rados.0.smithi033.stdout:3948: snap_remove snap 376 2021-07-26T16:11:20.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:20 smithi033 bash[41341]: cluster 2021-07-26T16:11:19.232306+0000 mgr.y (mgr.34104) 521 : cluster [DBG] pgmap v1081: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 23 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2021-07-26T16:11:20.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:20 smithi033 bash[41341]: cluster 2021-07-26T16:11:19.341016+0000 mon.a (mon.0) 1213 : cluster [DBG] osdmap e830: 8 total, 8 up, 8 in 2021-07-26T16:11:20.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:20 smithi033 bash[42377]: cluster 2021-07-26T16:11:19.232306+0000 mgr.y (mgr.34104) 521 : cluster [DBG] pgmap v1081: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 23 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2021-07-26T16:11:20.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:20 smithi033 bash[42377]: cluster 2021-07-26T16:11:19.341016+0000 mon.a (mon.0) 1213 : cluster [DBG] osdmap e830: 8 total, 8 up, 8 in 2021-07-26T16:11:20.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:20 smithi096 bash[33981]: cluster 2021-07-26T16:11:19.232306+0000 mgr.y (mgr.34104) 521 : cluster [DBG] pgmap v1081: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 23 MiB/s rd, 3.2 MiB/s wr, 11 op/s 2021-07-26T16:11:20.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:20 smithi096 bash[33981]: cluster 2021-07-26T16:11:19.341016+0000 mon.a (mon.0) 1213 : cluster [DBG] osdmap e830: 8 total, 8 up, 8 in 2021-07-26T16:11:21.362 INFO:tasks.rados.rados.0.smithi033.stdout:3948: done (1 left) 2021-07-26T16:11:21.363 INFO:tasks.rados.rados.0.smithi033.stdout:3949: read oid 31 snap -1 2021-07-26T16:11:21.363 INFO:tasks.rados.rados.0.smithi033.stdout:3949: expect (ObjNum 1126 snap 373 seq_num 1126) 2021-07-26T16:11:21.363 INFO:tasks.rados.rados.0.smithi033.stdout:3950: read oid 14 snap -1 2021-07-26T16:11:21.363 INFO:tasks.rados.rados.0.smithi033.stdout:3950: expect deleted 2021-07-26T16:11:21.364 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 26 current snap is 387 2021-07-26T16:11:21.364 INFO:tasks.rados.rados.0.smithi033.stdout:3951: seq_num 1174 ranges {778240=466944} 2021-07-26T16:11:21.372 INFO:tasks.rados.rados.0.smithi033.stdout:3951: writing smithi03339061-26 from 778240 to 1245184 tid 1 2021-07-26T16:11:21.372 INFO:tasks.rados.rados.0.smithi033.stdout:3952: rollback oid 16 current snap is 387 2021-07-26T16:11:21.372 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 16 to 321 2021-07-26T16:11:21.372 INFO:tasks.rados.rados.0.smithi033.stdout:3947: finishing copy_from to smithi03339061-47 2021-07-26T16:11:21.373 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 47 v 2055 (ObjNum 1054 snap 347 seq_num 1054) dirty exists 2021-07-26T16:11:21.373 INFO:tasks.rados.rados.0.smithi033.stdout:3947: finishing copy_from racing read to smithi03339061-47 2021-07-26T16:11:21.373 INFO:tasks.rados.rados.0.smithi033.stdout:3947: done (4 left) 2021-07-26T16:11:21.373 INFO:tasks.rados.rados.0.smithi033.stdout:3950: done (3 left) 2021-07-26T16:11:21.373 INFO:tasks.rados.rados.0.smithi033.stdout:3953: read oid 46 snap -1 2021-07-26T16:11:21.374 INFO:tasks.rados.rados.0.smithi033.stdout:3953: expect (ObjNum 1170 snap 385 seq_num 1170) 2021-07-26T16:11:21.374 INFO:tasks.rados.rados.0.smithi033.stdout:3954: rmattr oid 24 current snap is 387 2021-07-26T16:11:21.374 INFO:tasks.rados.rados.0.smithi033.stdout:3954: done (4 left) 2021-07-26T16:11:21.374 INFO:tasks.rados.rados.0.smithi033.stdout:3955: copy_from oid 7 from oid 32 current snap is 387 2021-07-26T16:11:21.375 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 48 current snap is 387 2021-07-26T16:11:21.375 INFO:tasks.rados.rados.0.smithi033.stdout:3956: seq_num 1175 ranges {8527872=483328} 2021-07-26T16:11:21.424 INFO:tasks.rados.rados.0.smithi033.stdout:3956: writing smithi03339061-48 from 8527872 to 9011200 tid 1 2021-07-26T16:11:21.425 INFO:tasks.rados.rados.0.smithi033.stdout:3957: rollback oid 11 current snap is 387 2021-07-26T16:11:21.425 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 11 to 344 2021-07-26T16:11:21.425 INFO:tasks.rados.rados.0.smithi033.stdout:3951: finishing write tid 1 to smithi03339061-26 2021-07-26T16:11:21.425 INFO:tasks.rados.rados.0.smithi033.stdout:3951: finishing write tid 2 to smithi03339061-26 2021-07-26T16:11:21.426 INFO:tasks.rados.rados.0.smithi033.stdout:3952: finishing rollback tid 1 to smithi03339061-16 2021-07-26T16:11:21.426 INFO:tasks.rados.rados.0.smithi033.stdout:3955: finishing copy_from to smithi03339061-7 2021-07-26T16:11:21.426 INFO:tasks.rados.rados.0.smithi033.stdout:3955: got expected ENOENT (src dne) 2021-07-26T16:11:21.426 INFO:tasks.rados.rados.0.smithi033.stdout:3952: finishing rollback tid 2 to smithi03339061-16 2021-07-26T16:11:21.427 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 16 v 2361 (ObjNum 877 snap 288 seq_num 877) dirty exists 2021-07-26T16:11:21.427 INFO:tasks.rados.rados.0.smithi033.stdout:3955: finishing copy_from racing read to smithi03339061-7 2021-07-26T16:11:21.427 INFO:tasks.rados.rados.0.smithi033.stdout:3951: finishing write tid 3 to smithi03339061-26 2021-07-26T16:11:21.427 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 26 v 2568 (ObjNum 1174 snap 387 seq_num 1174) dirty exists 2021-07-26T16:11:21.428 INFO:tasks.rados.rados.0.smithi033.stdout:3951: left oid 26 (ObjNum 1174 snap 387 seq_num 1174) 2021-07-26T16:11:21.428 INFO:tasks.rados.rados.0.smithi033.stdout:3949: expect (ObjNum 1126 snap 373 seq_num 1126) 2021-07-26T16:11:21.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:21 smithi033 bash[41341]: cluster 2021-07-26T16:11:20.350448+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e831: 8 total, 8 up, 8 in 2021-07-26T16:11:21.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:21 smithi033 bash[42377]: cluster 2021-07-26T16:11:20.350448+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e831: 8 total, 8 up, 8 in 2021-07-26T16:11:21.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:21 smithi096 bash[33981]: cluster 2021-07-26T16:11:20.350448+0000 mon.a (mon.0) 1214 : cluster [DBG] osdmap e831: 8 total, 8 up, 8 in 2021-07-26T16:11:21.749 INFO:tasks.rados.rados.0.smithi033.stdout:3956: finishing write tid 1 to smithi03339061-48 2021-07-26T16:11:21.749 INFO:tasks.rados.rados.0.smithi033.stdout:3956: finishing write tid 2 to smithi03339061-48 2021-07-26T16:11:21.750 INFO:tasks.rados.rados.0.smithi033.stdout:3956: finishing write tid 3 to smithi03339061-48 2021-07-26T16:11:21.750 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 48 v 2110 (ObjNum 1175 snap 387 seq_num 1175) dirty exists 2021-07-26T16:11:21.750 INFO:tasks.rados.rados.0.smithi033.stdout:3956: left oid 48 (ObjNum 1175 snap 387 seq_num 1175) 2021-07-26T16:11:21.750 INFO:tasks.rados.rados.0.smithi033.stdout:3957: finishing rollback tid 0 to smithi03339061-11 2021-07-26T16:11:21.750 INFO:tasks.rados.rados.0.smithi033.stdout:3949: done (6 left) 2021-07-26T16:11:21.751 INFO:tasks.rados.rados.0.smithi033.stdout:3951: done (5 left) 2021-07-26T16:11:21.751 INFO:tasks.rados.rados.0.smithi033.stdout:3952: done (4 left) 2021-07-26T16:11:21.751 INFO:tasks.rados.rados.0.smithi033.stdout:3955: done (3 left) 2021-07-26T16:11:21.751 INFO:tasks.rados.rados.0.smithi033.stdout:3956: done (2 left) 2021-07-26T16:11:21.752 INFO:tasks.rados.rados.0.smithi033.stdout:3958: setattr oid 18 current snap is 387 2021-07-26T16:11:21.752 INFO:tasks.rados.rados.0.smithi033.stdout:3957: finishing rollback tid 1 to smithi03339061-11 2021-07-26T16:11:21.752 INFO:tasks.rados.rados.0.smithi033.stdout:3957: finishing rollback tid 2 to smithi03339061-11 2021-07-26T16:11:21.752 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 11 v 1466 (ObjNum 1027 snap 341 seq_num 1027) dirty exists 2021-07-26T16:11:21.752 INFO:tasks.rados.rados.0.smithi033.stdout:3953: expect (ObjNum 1170 snap 385 seq_num 1170) 2021-07-26T16:11:22.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:22 smithi033 bash[41341]: cluster 2021-07-26T16:11:21.233024+0000 mgr.y (mgr.34104) 522 : cluster [DBG] pgmap v1084: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 9.9 MiB/s rd, 3.5 MiB/s wr, 15 op/s 2021-07-26T16:11:22.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:22 smithi033 bash[41341]: cluster 2021-07-26T16:11:21.359476+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e832: 8 total, 8 up, 8 in 2021-07-26T16:11:22.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:22 smithi033 bash[42377]: cluster 2021-07-26T16:11:21.233024+0000 mgr.y (mgr.34104) 522 : cluster [DBG] pgmap v1084: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 9.9 MiB/s rd, 3.5 MiB/s wr, 15 op/s 2021-07-26T16:11:22.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:22 smithi033 bash[42377]: cluster 2021-07-26T16:11:21.359476+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e832: 8 total, 8 up, 8 in 2021-07-26T16:11:22.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:22 smithi096 bash[33981]: cluster 2021-07-26T16:11:21.233024+0000 mgr.y (mgr.34104) 522 : cluster [DBG] pgmap v1084: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 9.9 MiB/s rd, 3.5 MiB/s wr, 15 op/s 2021-07-26T16:11:22.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:22 smithi096 bash[33981]: cluster 2021-07-26T16:11:21.359476+0000 mon.a (mon.0) 1215 : cluster [DBG] osdmap e832: 8 total, 8 up, 8 in 2021-07-26T16:11:23.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:23 smithi033 bash[41341]: audit 2021-07-26T16:11:22.542593+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:11:23.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:23 smithi033 bash[41341]: audit 2021-07-26T16:11:22.545487+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:11:23.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:23 smithi033 bash[41341]: audit 2021-07-26T16:11:22.547539+0000 mon.c (mon.1) 280 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:11:23.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:23 smithi033 bash[41341]: audit 2021-07-26T16:11:22.807620+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:11:23.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:23 smithi033 bash[42377]: audit 2021-07-26T16:11:22.542593+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:11:23.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:23 smithi033 bash[42377]: audit 2021-07-26T16:11:22.545487+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:11:23.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:23 smithi033 bash[42377]: audit 2021-07-26T16:11:22.547539+0000 mon.c (mon.1) 280 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:11:23.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:23 smithi033 bash[42377]: audit 2021-07-26T16:11:22.807620+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:11:23.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:23 smithi096 bash[33981]: audit 2021-07-26T16:11:22.542593+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:11:23.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:23 smithi096 bash[33981]: audit 2021-07-26T16:11:22.545487+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:11:23.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:23 smithi096 bash[33981]: audit 2021-07-26T16:11:22.547539+0000 mon.c (mon.1) 280 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:11:23.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:23 smithi096 bash[33981]: audit 2021-07-26T16:11:22.807620+0000 mon.a (mon.0) 1216 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:11:24.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:24 smithi033 bash[41341]: cluster 2021-07-26T16:11:23.233520+0000 mgr.y (mgr.34104) 523 : cluster [DBG] pgmap v1086: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 595 KiB/s wr, 11 op/s 2021-07-26T16:11:24.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:24 smithi033 bash[42377]: cluster 2021-07-26T16:11:23.233520+0000 mgr.y (mgr.34104) 523 : cluster [DBG] pgmap v1086: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 595 KiB/s wr, 11 op/s 2021-07-26T16:11:24.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:24 smithi096 bash[33981]: cluster 2021-07-26T16:11:23.233520+0000 mgr.y (mgr.34104) 523 : cluster [DBG] pgmap v1086: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 7.1 MiB/s rd, 595 KiB/s wr, 11 op/s 2021-07-26T16:11:26.452 INFO:tasks.rados.rados.0.smithi033.stdout:3953: done (2 left) 2021-07-26T16:11:26.452 INFO:tasks.rados.rados.0.smithi033.stdout:3957: done (1 left) 2021-07-26T16:11:26.453 INFO:tasks.rados.rados.0.smithi033.stdout:3959: snap_create 2021-07-26T16:11:26.457 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 2575 (ObjNum 2008769952 snap 22002 seq_num 0) dirty exists 2021-07-26T16:11:26.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:26 smithi033 bash[41341]: cluster 2021-07-26T16:11:25.233905+0000 mgr.y (mgr.34104) 524 : cluster [DBG] pgmap v1087: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 20 MiB/s rd, 567 KiB/s wr, 11 op/s 2021-07-26T16:11:26.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:26 smithi033 bash[41341]: cluster 2021-07-26T16:11:26.309952+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e833: 8 total, 8 up, 8 in 2021-07-26T16:11:26.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:26 smithi033 bash[42377]: cluster 2021-07-26T16:11:25.233905+0000 mgr.y (mgr.34104) 524 : cluster [DBG] pgmap v1087: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 20 MiB/s rd, 567 KiB/s wr, 11 op/s 2021-07-26T16:11:26.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:26 smithi033 bash[42377]: cluster 2021-07-26T16:11:26.309952+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e833: 8 total, 8 up, 8 in 2021-07-26T16:11:26.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:26 smithi096 bash[33981]: cluster 2021-07-26T16:11:25.233905+0000 mgr.y (mgr.34104) 524 : cluster [DBG] pgmap v1087: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 20 MiB/s rd, 567 KiB/s wr, 11 op/s 2021-07-26T16:11:26.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:26 smithi096 bash[33981]: cluster 2021-07-26T16:11:26.309952+0000 mon.a (mon.0) 1217 : cluster [DBG] osdmap e833: 8 total, 8 up, 8 in 2021-07-26T16:11:27.386 INFO:tasks.rados.rados.0.smithi033.stdout:3958: done (1 left) 2021-07-26T16:11:27.386 INFO:tasks.rados.rados.0.smithi033.stdout:3959: done (0 left) 2021-07-26T16:11:27.387 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 38 current snap is 388 2021-07-26T16:11:27.387 INFO:tasks.rados.rados.0.smithi033.stdout:3960: seq_num 1176 ranges {3137536=499712} 2021-07-26T16:11:27.410 INFO:tasks.rados.rados.0.smithi033.stdout:3960: writing smithi03339061-38 from 3137536 to 3637248 tid 1 2021-07-26T16:11:27.410 INFO:tasks.rados.rados.0.smithi033.stdout:3961: snap_remove snap 344 2021-07-26T16:11:28.392 INFO:tasks.rados.rados.0.smithi033.stdout:3960: finishing write tid 1 to smithi03339061-38 2021-07-26T16:11:28.392 INFO:tasks.rados.rados.0.smithi033.stdout:3960: finishing write tid 2 to smithi03339061-38 2021-07-26T16:11:28.392 INFO:tasks.rados.rados.0.smithi033.stdout:3960: finishing write tid 3 to smithi03339061-38 2021-07-26T16:11:28.393 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 38 v 754 (ObjNum 1176 snap 388 seq_num 1176) dirty exists 2021-07-26T16:11:28.393 INFO:tasks.rados.rados.0.smithi033.stdout:3960: left oid 38 (ObjNum 1176 snap 388 seq_num 1176) 2021-07-26T16:11:28.393 INFO:tasks.rados.rados.0.smithi033.stdout:3960: done (1 left) 2021-07-26T16:11:28.393 INFO:tasks.rados.rados.0.smithi033.stdout:3961: done (0 left) 2021-07-26T16:11:28.394 INFO:tasks.rados.rados.0.smithi033.stdout:3962: read oid 12 snap -1 2021-07-26T16:11:28.394 INFO:tasks.rados.rados.0.smithi033.stdout:3962: expect (ObjNum 1101 snap 365 seq_num 1101) 2021-07-26T16:11:28.394 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 15 current snap is 388 2021-07-26T16:11:28.394 INFO:tasks.rados.rados.0.smithi033.stdout:3963: seq_num 1177 ranges {4071424=516096} 2021-07-26T16:11:28.420 INFO:tasks.rados.rados.0.smithi033.stdout:3963: writing smithi03339061-15 from 4071424 to 4587520 tid 1 2021-07-26T16:11:28.420 INFO:tasks.rados.rados.0.smithi033.stdout:3964: delete oid 28 current snap is 388 2021-07-26T16:11:28.427 INFO:tasks.rados.rados.0.smithi033.stdout:3963: finishing write tid 1 to smithi03339061-15 2021-07-26T16:11:28.427 INFO:tasks.rados.rados.0.smithi033.stdout:3963: finishing write tid 2 to smithi03339061-15 2021-07-26T16:11:28.429 INFO:tasks.rados.rados.0.smithi033.stdout:3963: finishing write tid 3 to smithi03339061-15 2021-07-26T16:11:28.429 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 15 v 970 (ObjNum 1177 snap 388 seq_num 1177) dirty exists 2021-07-26T16:11:28.429 INFO:tasks.rados.rados.0.smithi033.stdout:3963: left oid 15 (ObjNum 1177 snap 388 seq_num 1177) 2021-07-26T16:11:28.481 INFO:tasks.rados.rados.0.smithi033.stdout:3962: expect (ObjNum 1101 snap 365 seq_num 1101) 2021-07-26T16:11:28.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:28 smithi033 bash[41341]: cluster 2021-07-26T16:11:27.234540+0000 mgr.y (mgr.34104) 525 : cluster [DBG] pgmap v1089: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 16 MiB/s rd, 311 KiB/s wr, 4 op/s 2021-07-26T16:11:28.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:28 smithi033 bash[41341]: cluster 2021-07-26T16:11:27.382752+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e834: 8 total, 8 up, 8 in 2021-07-26T16:11:28.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:28 smithi033 bash[42377]: cluster 2021-07-26T16:11:27.234540+0000 mgr.y (mgr.34104) 525 : cluster [DBG] pgmap v1089: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 16 MiB/s rd, 311 KiB/s wr, 4 op/s 2021-07-26T16:11:28.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:28 smithi033 bash[42377]: cluster 2021-07-26T16:11:27.382752+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e834: 8 total, 8 up, 8 in 2021-07-26T16:11:28.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:28 smithi096 bash[33981]: cluster 2021-07-26T16:11:27.234540+0000 mgr.y (mgr.34104) 525 : cluster [DBG] pgmap v1089: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 16 MiB/s rd, 311 KiB/s wr, 4 op/s 2021-07-26T16:11:28.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:28 smithi096 bash[33981]: cluster 2021-07-26T16:11:27.382752+0000 mon.a (mon.0) 1218 : cluster [DBG] osdmap e834: 8 total, 8 up, 8 in 2021-07-26T16:11:29.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:29 smithi033 bash[41341]: cluster 2021-07-26T16:11:28.382944+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e835: 8 total, 8 up, 8 in 2021-07-26T16:11:29.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:29 smithi033 bash[42377]: cluster 2021-07-26T16:11:28.382944+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e835: 8 total, 8 up, 8 in 2021-07-26T16:11:29.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:29 smithi096 bash[33981]: cluster 2021-07-26T16:11:28.382944+0000 mon.a (mon.0) 1219 : cluster [DBG] osdmap e835: 8 total, 8 up, 8 in 2021-07-26T16:11:30.132 INFO:tasks.rados.rados.0.smithi033.stdout:3962: done (2 left) 2021-07-26T16:11:30.180 INFO:tasks.rados.rados.0.smithi033.stdout:3963: done (1 left) 2021-07-26T16:11:30.180 INFO:tasks.rados.rados.0.smithi033.stdout:3964: done (0 left) 2021-07-26T16:11:30.180 INFO:tasks.rados.rados.0.smithi033.stdout:3965: copy_from oid 42 from oid 35 current snap is 388 2021-07-26T16:11:30.180 INFO:tasks.rados.rados.0.smithi033.stdout:3966: copy_from oid 10 from oid 44 current snap is 388 2021-07-26T16:11:30.181 INFO:tasks.rados.rados.0.smithi033.stdout:3967: rollback oid 4 current snap is 388 2021-07-26T16:11:30.181 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 4 to 356 2021-07-26T16:11:30.181 INFO:tasks.rados.rados.0.smithi033.stdout:3968: snap_remove snap 358 2021-07-26T16:11:30.422 INFO:tasks.rados.rados.0.smithi033.stdout:3967: finishing rollback tid 1 to smithi03339061-4 2021-07-26T16:11:30.422 INFO:tasks.rados.rados.0.smithi033.stdout:3967: finishing rollback tid 2 to smithi03339061-4 2021-07-26T16:11:30.423 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 2101 (ObjNum 1080 snap 355 seq_num 1080) dirty exists 2021-07-26T16:11:30.423 INFO:tasks.rados.rados.0.smithi033.stdout:3965: finishing copy_from to smithi03339061-42 2021-07-26T16:11:30.423 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 42 v 1844 (ObjNum 1087 snap 360 seq_num 1087) dirty exists 2021-07-26T16:11:30.424 INFO:tasks.rados.rados.0.smithi033.stdout:3965: finishing copy_from racing read to smithi03339061-42 2021-07-26T16:11:30.424 INFO:tasks.rados.rados.0.smithi033.stdout:3966: finishing copy_from to smithi03339061-10 2021-07-26T16:11:30.424 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 10 v 1356 (ObjNum 1060 snap 348 seq_num 1060) dirty exists 2021-07-26T16:11:30.424 INFO:tasks.rados.rados.0.smithi033.stdout:3966: finishing copy_from racing read to smithi03339061-10 2021-07-26T16:11:30.425 INFO:tasks.rados.rados.0.smithi033.stdout:3965: done (3 left) 2021-07-26T16:11:30.425 INFO:tasks.rados.rados.0.smithi033.stdout:3966: done (2 left) 2021-07-26T16:11:30.425 INFO:tasks.rados.rados.0.smithi033.stdout:3967: done (1 left) 2021-07-26T16:11:30.425 INFO:tasks.rados.rados.0.smithi033.stdout:3968: done (0 left) 2021-07-26T16:11:30.425 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 12 current snap is 388 2021-07-26T16:11:30.426 INFO:tasks.rados.rados.0.smithi033.stdout:3969: seq_num 1179 ranges {15949824=548864} 2021-07-26T16:11:30.513 INFO:tasks.rados.rados.0.smithi033.stdout:3969: writing smithi03339061-12 from 15949824 to 16498688 tid 1 2021-07-26T16:11:30.514 INFO:tasks.rados.rados.0.smithi033.stdout:3970: copy_from oid 36 from oid 34 current snap is 388 2021-07-26T16:11:30.514 INFO:tasks.rados.rados.0.smithi033.stdout:3971: snap_create 2021-07-26T16:11:30.525 INFO:tasks.rados.rados.0.smithi033.stdout:3969: finishing write tid 1 to smithi03339061-12 2021-07-26T16:11:30.525 INFO:tasks.rados.rados.0.smithi033.stdout:3969: finishing write tid 2 to smithi03339061-12 2021-07-26T16:11:30.528 INFO:tasks.rados.rados.0.smithi033.stdout:3969: finishing write tid 3 to smithi03339061-12 2021-07-26T16:11:30.529 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 12 v 2068 (ObjNum 1179 snap 388 seq_num 1179) dirty exists 2021-07-26T16:11:30.529 INFO:tasks.rados.rados.0.smithi033.stdout:3969: left oid 12 (ObjNum 1179 snap 388 seq_num 1179) 2021-07-26T16:11:30.565 INFO:tasks.rados.rados.0.smithi033.stdout:3970: finishing copy_from to smithi03339061-36 2021-07-26T16:11:30.566 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1463 (ObjNum 1172 snap 385 seq_num 1172) dirty exists 2021-07-26T16:11:30.566 INFO:tasks.rados.rados.0.smithi033.stdout:3970: finishing copy_from racing read to smithi03339061-36 2021-07-26T16:11:30.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:30 smithi033 bash[41341]: cluster 2021-07-26T16:11:29.235200+0000 mgr.y (mgr.34104) 526 : cluster [DBG] pgmap v1092: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 22 MiB/s rd, 160 KiB/s wr, 6 op/s 2021-07-26T16:11:30.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:30 smithi033 bash[42377]: cluster 2021-07-26T16:11:29.235200+0000 mgr.y (mgr.34104) 526 : cluster [DBG] pgmap v1092: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 22 MiB/s rd, 160 KiB/s wr, 6 op/s 2021-07-26T16:11:30.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:30 smithi096 bash[33981]: cluster 2021-07-26T16:11:29.235200+0000 mgr.y (mgr.34104) 526 : cluster [DBG] pgmap v1092: 25 pgs: 25 active+clean; 1.0 GiB data, 4.0 GiB used, 711 GiB / 715 GiB avail; 22 MiB/s rd, 160 KiB/s wr, 6 op/s 2021-07-26T16:11:31.315 INFO:tasks.rados.rados.0.smithi033.stdout:3969: done (2 left) 2021-07-26T16:11:31.315 INFO:tasks.rados.rados.0.smithi033.stdout:3970: done (1 left) 2021-07-26T16:11:31.316 INFO:tasks.rados.rados.0.smithi033.stdout:3971: done (0 left) 2021-07-26T16:11:31.316 INFO:tasks.rados.rados.0.smithi033.stdout:3972: snap_create 2021-07-26T16:11:31.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:31 smithi033 bash[41341]: cluster 2021-07-26T16:11:30.412073+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e836: 8 total, 8 up, 8 in 2021-07-26T16:11:31.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:31 smithi033 bash[41341]: cluster 2021-07-26T16:11:31.309177+0000 mon.a (mon.0) 1221 : cluster [DBG] osdmap e837: 8 total, 8 up, 8 in 2021-07-26T16:11:31.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:31 smithi033 bash[42377]: cluster 2021-07-26T16:11:30.412073+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e836: 8 total, 8 up, 8 in 2021-07-26T16:11:31.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:31 smithi033 bash[42377]: cluster 2021-07-26T16:11:31.309177+0000 mon.a (mon.0) 1221 : cluster [DBG] osdmap e837: 8 total, 8 up, 8 in 2021-07-26T16:11:31.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:31 smithi096 bash[33981]: cluster 2021-07-26T16:11:30.412073+0000 mon.a (mon.0) 1220 : cluster [DBG] osdmap e836: 8 total, 8 up, 8 in 2021-07-26T16:11:31.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:31 smithi096 bash[33981]: cluster 2021-07-26T16:11:31.309177+0000 mon.a (mon.0) 1221 : cluster [DBG] osdmap e837: 8 total, 8 up, 8 in 2021-07-26T16:11:32.326 INFO:tasks.rados.rados.0.smithi033.stdout:3972: done (0 left) 2021-07-26T16:11:32.326 INFO:tasks.rados.rados.0.smithi033.stdout:3973: rmattr oid 24 current snap is 390 2021-07-26T16:11:32.326 INFO:tasks.rados.rados.0.smithi033.stdout:3973: done (0 left) 2021-07-26T16:11:32.327 INFO:tasks.rados.rados.0.smithi033.stdout:3974: snap_create 2021-07-26T16:11:32.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:32 smithi033 bash[41341]: cluster 2021-07-26T16:11:31.235923+0000 mgr.y (mgr.34104) 527 : cluster [DBG] pgmap v1094: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 9.3 MiB/s rd, 201 KiB/s wr, 6 op/s 2021-07-26T16:11:32.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:32 smithi033 bash[41341]: cluster 2021-07-26T16:11:32.322786+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e838: 8 total, 8 up, 8 in 2021-07-26T16:11:32.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:32 smithi033 bash[42377]: cluster 2021-07-26T16:11:31.235923+0000 mgr.y (mgr.34104) 527 : cluster [DBG] pgmap v1094: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 9.3 MiB/s rd, 201 KiB/s wr, 6 op/s 2021-07-26T16:11:32.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:32 smithi033 bash[42377]: cluster 2021-07-26T16:11:32.322786+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e838: 8 total, 8 up, 8 in 2021-07-26T16:11:32.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:32 smithi096 bash[33981]: cluster 2021-07-26T16:11:31.235923+0000 mgr.y (mgr.34104) 527 : cluster [DBG] pgmap v1094: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 9.3 MiB/s rd, 201 KiB/s wr, 6 op/s 2021-07-26T16:11:32.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:32 smithi096 bash[33981]: cluster 2021-07-26T16:11:32.322786+0000 mon.a (mon.0) 1222 : cluster [DBG] osdmap e838: 8 total, 8 up, 8 in 2021-07-26T16:11:33.330 INFO:tasks.rados.rados.0.smithi033.stdout:3974: done (0 left) 2021-07-26T16:11:33.331 INFO:tasks.rados.rados.0.smithi033.stdout:3975: copy_from oid 8 from oid 38 current snap is 391 2021-07-26T16:11:33.331 INFO:tasks.rados.rados.0.smithi033.stdout:3976: snap_remove snap 321 2021-07-26T16:11:34.343 INFO:tasks.rados.rados.0.smithi033.stdout:3976: done (1 left) 2021-07-26T16:11:34.343 INFO:tasks.rados.rados.0.smithi033.stdout:3977: copy_from oid 15 from oid 22 current snap is 391 2021-07-26T16:11:34.343 INFO:tasks.rados.rados.0.smithi033.stdout:3978: snap_create 2021-07-26T16:11:34.344 INFO:tasks.rados.rados.0.smithi033.stdout:3975: finishing copy_from to smithi03339061-8 2021-07-26T16:11:34.344 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 8 v 754 (ObjNum 1176 snap 388 seq_num 1176) dirty exists 2021-07-26T16:11:34.344 INFO:tasks.rados.rados.0.smithi033.stdout:3975: finishing copy_from racing read to smithi03339061-8 2021-07-26T16:11:34.345 INFO:tasks.rados.rados.0.smithi033.stdout:3977: finishing copy_from to smithi03339061-15 2021-07-26T16:11:34.345 INFO:tasks.rados.rados.0.smithi033.stdout:3977: got expected ENOENT (src dne) 2021-07-26T16:11:34.356 INFO:tasks.rados.rados.0.smithi033.stdout:3977: finishing copy_from racing read to smithi03339061-15 2021-07-26T16:11:34.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:34 smithi033 bash[41341]: cluster 2021-07-26T16:11:33.236598+0000 mgr.y (mgr.34104) 528 : cluster [DBG] pgmap v1097: 25 pgs: 25 active+clean; 1.1 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 2.0 MiB/s wr, 2 op/s 2021-07-26T16:11:34.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:34 smithi033 bash[41341]: cluster 2021-07-26T16:11:33.325455+0000 mon.a (mon.0) 1223 : cluster [DBG] osdmap e839: 8 total, 8 up, 8 in 2021-07-26T16:11:34.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:34 smithi033 bash[42377]: cluster 2021-07-26T16:11:33.236598+0000 mgr.y (mgr.34104) 528 : cluster [DBG] pgmap v1097: 25 pgs: 25 active+clean; 1.1 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 2.0 MiB/s wr, 2 op/s 2021-07-26T16:11:34.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:34 smithi033 bash[42377]: cluster 2021-07-26T16:11:33.325455+0000 mon.a (mon.0) 1223 : cluster [DBG] osdmap e839: 8 total, 8 up, 8 in 2021-07-26T16:11:34.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:34 smithi096 bash[33981]: cluster 2021-07-26T16:11:33.236598+0000 mgr.y (mgr.34104) 528 : cluster [DBG] pgmap v1097: 25 pgs: 25 active+clean; 1.1 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 9.4 MiB/s rd, 2.0 MiB/s wr, 2 op/s 2021-07-26T16:11:34.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:34 smithi096 bash[33981]: cluster 2021-07-26T16:11:33.325455+0000 mon.a (mon.0) 1223 : cluster [DBG] osdmap e839: 8 total, 8 up, 8 in 2021-07-26T16:11:35.353 INFO:tasks.rados.rados.0.smithi033.stdout:3975: done (2 left) 2021-07-26T16:11:35.353 INFO:tasks.rados.rados.0.smithi033.stdout:3977: done (1 left) 2021-07-26T16:11:35.353 INFO:tasks.rados.rados.0.smithi033.stdout:3978: done (0 left) 2021-07-26T16:11:35.354 INFO:tasks.rados.rados.0.smithi033.stdout:3979: read oid 39 snap 275 2021-07-26T16:11:35.354 INFO:tasks.rados.rados.0.smithi033.stdout:3979: expect deleted 2021-07-26T16:11:35.354 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 45 current snap is 392 2021-07-26T16:11:35.354 INFO:tasks.rados.rados.0.smithi033.stdout:3980: seq_num 1180 ranges {2326528=565248} 2021-07-26T16:11:35.373 INFO:tasks.rados.rados.0.smithi033.stdout:3980: writing smithi03339061-45 from 2326528 to 2891776 tid 1 2021-07-26T16:11:35.373 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 1 current snap is 392 2021-07-26T16:11:35.373 INFO:tasks.rados.rados.0.smithi033.stdout:3981: seq_num 1181 ranges {7118848=581632} 2021-07-26T16:11:35.417 INFO:tasks.rados.rados.0.smithi033.stdout:3981: writing smithi03339061-1 from 7118848 to 7700480 tid 1 2021-07-26T16:11:35.417 INFO:tasks.rados.rados.0.smithi033.stdout:3982: rmattr oid 9 current snap is 392 2021-07-26T16:11:35.417 INFO:tasks.rados.rados.0.smithi033.stdout:3982: done (3 left) 2021-07-26T16:11:35.418 INFO:tasks.rados.rados.0.smithi033.stdout:3983: rollback oid 36 current snap is 392 2021-07-26T16:11:35.418 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 36 to 345 2021-07-26T16:11:35.418 INFO:tasks.rados.rados.0.smithi033.stdout:3980: finishing write tid 1 to smithi03339061-45 2021-07-26T16:11:35.418 INFO:tasks.rados.rados.0.smithi033.stdout:3980: finishing write tid 2 to smithi03339061-45 2021-07-26T16:11:35.419 INFO:tasks.rados.rados.0.smithi033.stdout:3980: finishing write tid 3 to smithi03339061-45 2021-07-26T16:11:35.419 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 45 v 2610 (ObjNum 1180 snap 392 seq_num 1180) dirty exists 2021-07-26T16:11:35.419 INFO:tasks.rados.rados.0.smithi033.stdout:3980: left oid 45 (ObjNum 1180 snap 392 seq_num 1180) 2021-07-26T16:11:35.419 INFO:tasks.rados.rados.0.smithi033.stdout:3979: done (3 left) 2021-07-26T16:11:35.419 INFO:tasks.rados.rados.0.smithi033.stdout:3980: done (2 left) 2021-07-26T16:11:35.420 INFO:tasks.rados.rados.0.smithi033.stdout:3984: snap_create 2021-07-26T16:11:35.424 INFO:tasks.rados.rados.0.smithi033.stdout:3981: finishing write tid 1 to smithi03339061-1 2021-07-26T16:11:35.424 INFO:tasks.rados.rados.0.smithi033.stdout:3981: finishing write tid 2 to smithi03339061-1 2021-07-26T16:11:35.428 INFO:tasks.rados.rados.0.smithi033.stdout:3981: finishing write tid 3 to smithi03339061-1 2021-07-26T16:11:35.428 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 1 v 1094 (ObjNum 1181 snap 392 seq_num 1181) dirty exists 2021-07-26T16:11:35.428 INFO:tasks.rados.rados.0.smithi033.stdout:3981: left oid 1 (ObjNum 1181 snap 392 seq_num 1181) 2021-07-26T16:11:35.430 INFO:tasks.rados.rados.0.smithi033.stdout:3983: finishing rollback tid 0 to smithi03339061-36 2021-07-26T16:11:35.431 INFO:tasks.rados.rados.0.smithi033.stdout:3983: finishing rollback tid 1 to smithi03339061-36 2021-07-26T16:11:35.431 INFO:tasks.rados.rados.0.smithi033.stdout:3983: finishing rollback tid 2 to smithi03339061-36 2021-07-26T16:11:35.431 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 36 v 1469 (ObjNum 1026 snap 341 seq_num 1026) dirty exists 2021-07-26T16:11:35.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:35 smithi033 bash[42377]: cluster 2021-07-26T16:11:34.339303+0000 mon.a (mon.0) 1224 : cluster [DBG] osdmap e840: 8 total, 8 up, 8 in 2021-07-26T16:11:35.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:35 smithi033 bash[41341]: cluster 2021-07-26T16:11:34.339303+0000 mon.a (mon.0) 1224 : cluster [DBG] osdmap e840: 8 total, 8 up, 8 in 2021-07-26T16:11:35.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:35 smithi096 bash[33981]: cluster 2021-07-26T16:11:34.339303+0000 mon.a (mon.0) 1224 : cluster [DBG] osdmap e840: 8 total, 8 up, 8 in 2021-07-26T16:11:36.315 INFO:tasks.rados.rados.0.smithi033.stdout:3981: done (2 left) 2021-07-26T16:11:36.316 INFO:tasks.rados.rados.0.smithi033.stdout:3983: done (1 left) 2021-07-26T16:11:36.316 INFO:tasks.rados.rados.0.smithi033.stdout:3984: done (0 left) 2021-07-26T16:11:36.316 INFO:tasks.rados.rados.0.smithi033.stdout:3985: rollback oid 34 current snap is 393 2021-07-26T16:11:36.316 INFO:tasks.rados.rados.0.smithi033.stdout:rollback oid 34 to 384 2021-07-26T16:11:36.316 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 7 current snap is 393 2021-07-26T16:11:36.317 INFO:tasks.rados.rados.0.smithi033.stdout:3986: seq_num 1182 ranges {0=606208} 2021-07-26T16:11:36.321 INFO:tasks.rados.rados.0.smithi033.stdout:3986: writing smithi03339061-7 from 0 to 606208 tid 1 2021-07-26T16:11:36.321 INFO:tasks.rados.rados.0.smithi033.stdout:3987: snap_remove snap 390 2021-07-26T16:11:36.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:36 smithi033 bash[41341]: cluster 2021-07-26T16:11:35.237265+0000 mgr.y (mgr.34104) 529 : cluster [DBG] pgmap v1100: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 4.2 MiB/s wr, 2 op/s 2021-07-26T16:11:36.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:36 smithi033 bash[41341]: cluster 2021-07-26T16:11:35.347176+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e841: 8 total, 8 up, 8 in 2021-07-26T16:11:36.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:36 smithi033 bash[41341]: cluster 2021-07-26T16:11:36.311288+0000 mon.a (mon.0) 1226 : cluster [DBG] osdmap e842: 8 total, 8 up, 8 in 2021-07-26T16:11:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:36 smithi033 bash[42377]: cluster 2021-07-26T16:11:35.237265+0000 mgr.y (mgr.34104) 529 : cluster [DBG] pgmap v1100: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 4.2 MiB/s wr, 2 op/s 2021-07-26T16:11:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:36 smithi033 bash[42377]: cluster 2021-07-26T16:11:35.347176+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e841: 8 total, 8 up, 8 in 2021-07-26T16:11:36.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:36 smithi033 bash[42377]: cluster 2021-07-26T16:11:36.311288+0000 mon.a (mon.0) 1226 : cluster [DBG] osdmap e842: 8 total, 8 up, 8 in 2021-07-26T16:11:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:36 smithi096 bash[33981]: cluster 2021-07-26T16:11:35.237265+0000 mgr.y (mgr.34104) 529 : cluster [DBG] pgmap v1100: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 255 B/s rd, 4.2 MiB/s wr, 2 op/s 2021-07-26T16:11:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:36 smithi096 bash[33981]: cluster 2021-07-26T16:11:35.347176+0000 mon.a (mon.0) 1225 : cluster [DBG] osdmap e841: 8 total, 8 up, 8 in 2021-07-26T16:11:36.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:36 smithi096 bash[33981]: cluster 2021-07-26T16:11:36.311288+0000 mon.a (mon.0) 1226 : cluster [DBG] osdmap e842: 8 total, 8 up, 8 in 2021-07-26T16:11:37.331 INFO:tasks.rados.rados.0.smithi033.stdout:3987: done (2 left) 2021-07-26T16:11:37.331 INFO:tasks.rados.rados.0.smithi033.stdout:3988: copy_from oid 21 from oid 4 current snap is 393 2021-07-26T16:11:37.331 INFO:tasks.rados.rados.0.smithi033.stdout:3985: finishing rollback tid 0 to smithi03339061-34 2021-07-26T16:11:37.331 INFO:tasks.rados.rados.0.smithi033.stdout:3985: finishing rollback tid 1 to smithi03339061-34 2021-07-26T16:11:37.332 INFO:tasks.rados.rados.0.smithi033.stdout:3985: finishing rollback tid 2 to smithi03339061-34 2021-07-26T16:11:37.332 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 34 v 1472 (ObjNum 1066 snap 349 seq_num 1066) dirty exists 2021-07-26T16:11:37.332 INFO:tasks.rados.rados.0.smithi033.stdout:3986: finishing write tid 1 to smithi03339061-7 2021-07-26T16:11:37.332 INFO:tasks.rados.rados.0.smithi033.stdout:3986: finishing write tid 2 to smithi03339061-7 2021-07-26T16:11:37.333 INFO:tasks.rados.rados.0.smithi033.stdout:3986: finishing write tid 3 to smithi03339061-7 2021-07-26T16:11:37.333 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 7 v 2188 (ObjNum 1182 snap 393 seq_num 1182) dirty exists 2021-07-26T16:11:37.333 INFO:tasks.rados.rados.0.smithi033.stdout:3986: left oid 7 (ObjNum 1182 snap 393 seq_num 1182) 2021-07-26T16:11:37.333 INFO:tasks.rados.rados.0.smithi033.stdout:3985: done (2 left) 2021-07-26T16:11:37.333 INFO:tasks.rados.rados.0.smithi033.stdout:3986: done (1 left) 2021-07-26T16:11:37.334 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 18 current snap is 393 2021-07-26T16:11:37.334 INFO:tasks.rados.rados.0.smithi033.stdout:3989: seq_num 1183 ranges {0=622592} 2021-07-26T16:11:37.336 INFO:tasks.rados.rados.0.smithi033.stdout:3989: writing smithi03339061-18 from 0 to 622592 tid 1 2021-07-26T16:11:37.336 INFO:tasks.rados.rados.0.smithi033.stdout:3990: snap_create 2021-07-26T16:11:37.344 INFO:tasks.rados.rados.0.smithi033.stdout:3989: finishing write tid 1 to smithi03339061-18 2021-07-26T16:11:37.349 INFO:tasks.rados.rados.0.smithi033.stdout:3989: finishing write tid 2 to smithi03339061-18 2021-07-26T16:11:37.352 INFO:tasks.rados.rados.0.smithi033.stdout:3989: finishing write tid 3 to smithi03339061-18 2021-07-26T16:11:37.352 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 18 v 2615 (ObjNum 1183 snap 393 seq_num 1183) dirty exists 2021-07-26T16:11:37.352 INFO:tasks.rados.rados.0.smithi033.stdout:3989: left oid 18 (ObjNum 1183 snap 393 seq_num 1183) 2021-07-26T16:11:37.371 INFO:tasks.rados.rados.0.smithi033.stdout:3988: finishing copy_from to smithi03339061-21 2021-07-26T16:11:37.371 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 21 v 2101 (ObjNum 1080 snap 355 seq_num 1080) dirty exists 2021-07-26T16:11:37.372 INFO:tasks.rados.rados.0.smithi033.stdout:3988: finishing copy_from racing read to smithi03339061-21 2021-07-26T16:11:38.332 INFO:tasks.rados.rados.0.smithi033.stdout:3988: done (2 left) 2021-07-26T16:11:38.333 INFO:tasks.rados.rados.0.smithi033.stdout:3989: done (1 left) 2021-07-26T16:11:38.333 INFO:tasks.rados.rados.0.smithi033.stdout:3990: done (0 left) 2021-07-26T16:11:38.333 INFO:tasks.rados.rados.0.smithi033.stdout:3991: snap_create 2021-07-26T16:11:38.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:38 smithi033 bash[41341]: cluster 2021-07-26T16:11:37.237948+0000 mgr.y (mgr.34104) 530 : cluster [DBG] pgmap v1103: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 511 B/s rd, 2.9 MiB/s wr, 2 op/s 2021-07-26T16:11:38.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:38 smithi033 bash[41341]: cluster 2021-07-26T16:11:37.327942+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e843: 8 total, 8 up, 8 in 2021-07-26T16:11:38.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:38 smithi033 bash[42377]: cluster 2021-07-26T16:11:37.237948+0000 mgr.y (mgr.34104) 530 : cluster [DBG] pgmap v1103: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 511 B/s rd, 2.9 MiB/s wr, 2 op/s 2021-07-26T16:11:38.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:38 smithi033 bash[42377]: cluster 2021-07-26T16:11:37.327942+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e843: 8 total, 8 up, 8 in 2021-07-26T16:11:38.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:38 smithi096 bash[33981]: cluster 2021-07-26T16:11:37.237948+0000 mgr.y (mgr.34104) 530 : cluster [DBG] pgmap v1103: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 511 B/s rd, 2.9 MiB/s wr, 2 op/s 2021-07-26T16:11:38.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:38 smithi096 bash[33981]: cluster 2021-07-26T16:11:37.327942+0000 mon.a (mon.0) 1227 : cluster [DBG] osdmap e843: 8 total, 8 up, 8 in 2021-07-26T16:11:39.348 INFO:tasks.rados.rados.0.smithi033.stdout:3991: done (0 left) 2021-07-26T16:11:39.348 INFO:tasks.rados.rados.0.smithi033.stdout:3992: read oid 35 snap -1 2021-07-26T16:11:39.348 INFO:tasks.rados.rados.0.smithi033.stdout:3992: expect (ObjNum 1087 snap 360 seq_num 1087) 2021-07-26T16:11:39.349 INFO:tasks.rados.rados.0.smithi033.stdout:3993: read oid 40 snap -1 2021-07-26T16:11:39.349 INFO:tasks.rados.rados.0.smithi033.stdout:3993: expect (ObjNum 1169 snap 385 seq_num 1169) 2021-07-26T16:11:39.349 INFO:tasks.rados.rados.0.smithi033.stdout:3994: snap_remove snap 350 2021-07-26T16:11:39.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:39 smithi033 bash[42377]: cluster 2021-07-26T16:11:38.329494+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e844: 8 total, 8 up, 8 in 2021-07-26T16:11:39.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:39 smithi033 bash[41341]: cluster 2021-07-26T16:11:38.329494+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e844: 8 total, 8 up, 8 in 2021-07-26T16:11:39.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:39 smithi096 bash[33981]: cluster 2021-07-26T16:11:38.329494+0000 mon.a (mon.0) 1228 : cluster [DBG] osdmap e844: 8 total, 8 up, 8 in 2021-07-26T16:11:40.373 INFO:tasks.rados.rados.0.smithi033.stdout:3993: expect (ObjNum 1169 snap 385 seq_num 1169) 2021-07-26T16:11:40.384 INFO:tasks.rados.rados.0.smithi033.stdout:3993: done (2 left) 2021-07-26T16:11:40.384 INFO:tasks.rados.rados.0.smithi033.stdout:3994: done (1 left) 2021-07-26T16:11:40.384 INFO:tasks.rados.rados.0.smithi033.stdout:append oid 9 current snap is 395 2021-07-26T16:11:40.384 INFO:tasks.rados.rados.0.smithi033.stdout:3995: seq_num 1184 ranges {0=638976} 2021-07-26T16:11:40.388 INFO:tasks.rados.rados.0.smithi033.stdout:3995: writing smithi03339061-9 from 0 to 638976 tid 1 2021-07-26T16:11:40.389 INFO:tasks.rados.rados.0.smithi033.stdout:3996: delete oid 22 current snap is 395 2021-07-26T16:11:40.389 INFO:tasks.rados.rados.0.smithi033.stdout:3992: expect (ObjNum 1087 snap 360 seq_num 1087) 2021-07-26T16:11:40.677 INFO:tasks.rados.rados.0.smithi033.stdout:3995: finishing write tid 1 to smithi03339061-9 2021-07-26T16:11:40.677 INFO:tasks.rados.rados.0.smithi033.stdout:3995: finishing write tid 2 to smithi03339061-9 2021-07-26T16:11:40.678 INFO:tasks.rados.rados.0.smithi033.stdout:3995: finishing write tid 3 to smithi03339061-9 2021-07-26T16:11:40.678 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 9 v 1851 (ObjNum 1184 snap 395 seq_num 1184) dirty exists 2021-07-26T16:11:40.678 INFO:tasks.rados.rados.0.smithi033.stdout:3995: left oid 9 (ObjNum 1184 snap 395 seq_num 1184) 2021-07-26T16:11:40.678 INFO:tasks.rados.rados.0.smithi033.stdout:3992: done (2 left) 2021-07-26T16:11:40.679 INFO:tasks.rados.rados.0.smithi033.stdout:3995: done (1 left) 2021-07-26T16:11:40.679 INFO:tasks.rados.rados.0.smithi033.stdout:3996: done (0 left) 2021-07-26T16:11:40.679 INFO:tasks.rados.rados.0.smithi033.stdout:3997: copy_from oid 4 from oid 26 current snap is 395 2021-07-26T16:11:40.680 INFO:tasks.rados.rados.0.smithi033.stdout:3998: read oid 14 snap -1 2021-07-26T16:11:40.680 INFO:tasks.rados.rados.0.smithi033.stdout:3998: expect deleted 2021-07-26T16:11:40.680 INFO:tasks.rados.rados.0.smithi033.stdout:3999: setattr oid 44 current snap is 395 2021-07-26T16:11:40.682 INFO:tasks.rados.rados.0.smithi033.stdout:3998: done (2 left) 2021-07-26T16:11:40.683 INFO:tasks.rados.rados.0.smithi033.stdout: waiting on 2 2021-07-26T16:11:40.695 INFO:tasks.rados.rados.0.smithi033.stdout:3997: finishing copy_from to smithi03339061-4 2021-07-26T16:11:40.695 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 4 v 2568 (ObjNum 1174 snap 387 seq_num 1174) dirty exists 2021-07-26T16:11:40.695 INFO:tasks.rados.rados.0.smithi033.stdout:3997: finishing copy_from racing read to smithi03339061-4 2021-07-26T16:11:40.696 INFO:tasks.rados.rados.0.smithi033.stdout:3997: done (1 left) 2021-07-26T16:11:40.696 INFO:tasks.rados.rados.0.smithi033.stdout: waiting on 1 2021-07-26T16:11:40.697 INFO:tasks.rados.rados.0.smithi033.stdout:update_object_version oid 44 v 2569 (ObjNum 1060 snap 348 seq_num 1060) dirty exists 2021-07-26T16:11:40.697 INFO:tasks.rados.rados.0.smithi033.stdout:3999: done (0 left) 2021-07-26T16:11:40.705 INFO:tasks.rados.rados.0.smithi033.stderr:0 errors. 2021-07-26T16:11:40.706 INFO:tasks.rados.rados.0.smithi033.stderr: 2021-07-26T16:11:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:40 smithi033 bash[41341]: cluster 2021-07-26T16:11:39.238692+0000 mgr.y (mgr.34104) 531 : cluster [DBG] pgmap v1106: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1023 B/s rd, 2.6 MiB/s wr, 4 op/s 2021-07-26T16:11:40.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:40 smithi033 bash[41341]: cluster 2021-07-26T16:11:39.342563+0000 mon.a (mon.0) 1229 : cluster [DBG] osdmap e845: 8 total, 8 up, 8 in 2021-07-26T16:11:40.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:40 smithi033 bash[42377]: cluster 2021-07-26T16:11:39.238692+0000 mgr.y (mgr.34104) 531 : cluster [DBG] pgmap v1106: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1023 B/s rd, 2.6 MiB/s wr, 4 op/s 2021-07-26T16:11:40.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:40 smithi033 bash[42377]: cluster 2021-07-26T16:11:39.342563+0000 mon.a (mon.0) 1229 : cluster [DBG] osdmap e845: 8 total, 8 up, 8 in 2021-07-26T16:11:40.718 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd dump --format=json 2021-07-26T16:11:40.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:40 smithi096 bash[33981]: cluster 2021-07-26T16:11:39.238692+0000 mgr.y (mgr.34104) 531 : cluster [DBG] pgmap v1106: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 1023 B/s rd, 2.6 MiB/s wr, 4 op/s 2021-07-26T16:11:40.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:40 smithi096 bash[33981]: cluster 2021-07-26T16:11:39.342563+0000 mon.a (mon.0) 1229 : cluster [DBG] osdmap e845: 8 total, 8 up, 8 in 2021-07-26T16:11:41.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:41 smithi033 bash[41341]: cluster 2021-07-26T16:11:40.358677+0000 mon.a (mon.0) 1230 : cluster [DBG] osdmap e846: 8 total, 8 up, 8 in 2021-07-26T16:11:41.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:41 smithi033 bash[41341]: cluster 2021-07-26T16:11:41.314663+0000 mon.a (mon.0) 1231 : cluster [DBG] osdmap e847: 8 total, 8 up, 8 in 2021-07-26T16:11:41.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:41 smithi033 bash[42377]: cluster 2021-07-26T16:11:40.358677+0000 mon.a (mon.0) 1230 : cluster [DBG] osdmap e846: 8 total, 8 up, 8 in 2021-07-26T16:11:41.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:41 smithi033 bash[42377]: cluster 2021-07-26T16:11:41.314663+0000 mon.a (mon.0) 1231 : cluster [DBG] osdmap e847: 8 total, 8 up, 8 in 2021-07-26T16:11:41.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:41 smithi096 bash[33981]: cluster 2021-07-26T16:11:40.358677+0000 mon.a (mon.0) 1230 : cluster [DBG] osdmap e846: 8 total, 8 up, 8 in 2021-07-26T16:11:41.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:41 smithi096 bash[33981]: cluster 2021-07-26T16:11:41.314663+0000 mon.a (mon.0) 1231 : cluster [DBG] osdmap e847: 8 total, 8 up, 8 in 2021-07-26T16:11:42.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:42 smithi033 bash[42377]: cluster 2021-07-26T16:11:41.239564+0000 mgr.y (mgr.34104) 532 : cluster [DBG] pgmap v1109: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.7 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2021-07-26T16:11:42.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:42 smithi033 bash[41341]: cluster 2021-07-26T16:11:41.239564+0000 mgr.y (mgr.34104) 532 : cluster [DBG] pgmap v1109: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.7 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2021-07-26T16:11:42.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:42 smithi096 bash[33981]: cluster 2021-07-26T16:11:41.239564+0000 mgr.y (mgr.34104) 532 : cluster [DBG] pgmap v1109: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.7 MiB/s rd, 1.6 MiB/s wr, 5 op/s 2021-07-26T16:11:43.486 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T16:11:44.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:44 smithi033 bash[41341]: cluster 2021-07-26T16:11:43.240372+0000 mgr.y (mgr.34104) 533 : cluster [DBG] pgmap v1111: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.0 MiB/s rd, 0 B/s wr, 2 op/s 2021-07-26T16:11:44.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:44 smithi033 bash[42377]: cluster 2021-07-26T16:11:43.240372+0000 mgr.y (mgr.34104) 533 : cluster [DBG] pgmap v1111: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.0 MiB/s rd, 0 B/s wr, 2 op/s 2021-07-26T16:11:44.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:44 smithi096 bash[33981]: cluster 2021-07-26T16:11:43.240372+0000 mgr.y (mgr.34104) 533 : cluster [DBG] pgmap v1111: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 3.0 MiB/s rd, 0 B/s wr, 2 op/s 2021-07-26T16:11:46.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:46 smithi033 bash[41341]: cluster 2021-07-26T16:11:45.241150+0000 mgr.y (mgr.34104) 534 : cluster [DBG] pgmap v1112: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.5 MiB/s rd, 0 B/s wr, 1 op/s 2021-07-26T16:11:46.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:46 smithi033 bash[41341]: cluster 2021-07-26T16:11:46.316533+0000 mon.a (mon.0) 1232 : cluster [DBG] osdmap e848: 8 total, 8 up, 8 in 2021-07-26T16:11:46.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:46 smithi033 bash[42377]: cluster 2021-07-26T16:11:45.241150+0000 mgr.y (mgr.34104) 534 : cluster [DBG] pgmap v1112: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.5 MiB/s rd, 0 B/s wr, 1 op/s 2021-07-26T16:11:46.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:46 smithi033 bash[42377]: cluster 2021-07-26T16:11:46.316533+0000 mon.a (mon.0) 1232 : cluster [DBG] osdmap e848: 8 total, 8 up, 8 in 2021-07-26T16:11:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:46 smithi096 bash[33981]: cluster 2021-07-26T16:11:45.241150+0000 mgr.y (mgr.34104) 534 : cluster [DBG] pgmap v1112: 25 pgs: 1 active+clean+snaptrim, 24 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.5 MiB/s rd, 0 B/s wr, 1 op/s 2021-07-26T16:11:46.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:46 smithi096 bash[33981]: cluster 2021-07-26T16:11:46.316533+0000 mon.a (mon.0) 1232 : cluster [DBG] osdmap e848: 8 total, 8 up, 8 in 2021-07-26T16:11:47.553 INFO:teuthology.orchestra.run.smithi033.stdout: 2021-07-26T16:11:47.553 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":848,"fsid":"7e62724e-ee28-11eb-8c23-001a4aab830c","created":"2021-07-26T15:46:09.081088+0000","modified":"2021-07-26T16:11:46.307664+0000","last_up_change":"2021-07-26T16:02:25.795990+0000","last_in_change":"2021-07-26T15:51:57.326019+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-07-26T15:50:11.585304+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"95","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:52:52.822163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"unique_pool_0","create_time":"2021-07-26T15:56:36.139631+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"846","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":759,"snap_epoch":846,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"teuthologyprofile","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"3d02e4ad-97fb-45ac-9912-2d795394c8ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":204,"up_from":219,"up_thru":344,"down_at":207,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":580058714},{"type":"v1","addr":"172.21.15.33:6803","nonce":580058714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":580058714},{"type":"v1","addr":"172.21.15.33:6805","nonce":580058714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":580058714},{"type":"v1","addr":"172.21.15.33:6809","nonce":580058714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":580058714},{"type":"v1","addr":"172.21.15.33:6807","nonce":580058714}]},"public_addr":"172.21.15.33:6803/580058714","cluster_addr":"172.21.15.33:6805/580058714","heartbeat_back_addr":"172.21.15.33:6809/580058714","heartbeat_front_addr":"172.21.15.33:6807/580058714","state":["exists","up"]},{"osd":1,"uuid":"789d9fd6-efa2-434f-aeb3-2e6ef5cf0d6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":13,"last_clean_end":235,"up_from":247,"up_thru":354,"down_at":236,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":1456109418},{"type":"v1","addr":"172.21.15.33:6811","nonce":1456109418}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":1456109418},{"type":"v1","addr":"172.21.15.33:6813","nonce":1456109418}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":1456109418},{"type":"v1","addr":"172.21.15.33:6817","nonce":1456109418}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":1456109418},{"type":"v1","addr":"172.21.15.33:6815","nonce":1456109418}]},"public_addr":"172.21.15.33:6811/1456109418","cluster_addr":"172.21.15.33:6813/1456109418","heartbeat_back_addr":"172.21.15.33:6817/1456109418","heartbeat_front_addr":"172.21.15.33:6815/1456109418","state":["exists","up"]},{"osd":2,"uuid":"9690c749-a40a-44a7-8a07-5290ff8980a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":18,"last_clean_end":252,"up_from":265,"up_thru":308,"down_at":253,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6818","nonce":3054044750},{"type":"v1","addr":"172.21.15.33:6819","nonce":3054044750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":3054044750},{"type":"v1","addr":"172.21.15.33:6821","nonce":3054044750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":3054044750},{"type":"v1","addr":"172.21.15.33:6825","nonce":3054044750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6822","nonce":3054044750},{"type":"v1","addr":"172.21.15.33:6823","nonce":3054044750}]},"public_addr":"172.21.15.33:6819/3054044750","cluster_addr":"172.21.15.33:6821/3054044750","heartbeat_back_addr":"172.21.15.33:6825/3054044750","heartbeat_front_addr":"172.21.15.33:6823/3054044750","state":["exists","up"]},{"osd":3,"uuid":"ca4ee0f8-4870-49bb-8dd6-75ab536d7199","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":25,"last_clean_end":280,"up_from":293,"up_thru":354,"down_at":282,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6826","nonce":1497559126},{"type":"v1","addr":"172.21.15.33:6827","nonce":1497559126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":1497559126},{"type":"v1","addr":"172.21.15.33:6829","nonce":1497559126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":1497559126},{"type":"v1","addr":"172.21.15.33:6833","nonce":1497559126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":1497559126},{"type":"v1","addr":"172.21.15.33:6831","nonce":1497559126}]},"public_addr":"172.21.15.33:6827/1497559126","cluster_addr":"172.21.15.33:6829/1497559126","heartbeat_back_addr":"172.21.15.33:6833/1497559126","heartbeat_front_addr":"172.21.15.33:6831/1497559126","state":["exists","up"]},{"osd":4,"uuid":"d630717e-8f0b-4257-8157-bff1918f9841","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":30,"last_clean_end":297,"up_from":311,"up_thru":354,"down_at":298,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":3369039463},{"type":"v1","addr":"172.21.15.96:6801","nonce":3369039463}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3369039463},{"type":"v1","addr":"172.21.15.96:6803","nonce":3369039463}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":3369039463},{"type":"v1","addr":"172.21.15.96:6807","nonce":3369039463}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":3369039463},{"type":"v1","addr":"172.21.15.96:6805","nonce":3369039463}]},"public_addr":"172.21.15.96:6801/3369039463","cluster_addr":"172.21.15.96:6803/3369039463","heartbeat_back_addr":"172.21.15.96:6807/3369039463","heartbeat_front_addr":"172.21.15.96:6805/3369039463","state":["exists","up"]},{"osd":5,"uuid":"8e2f20b4-26f0-495a-9361-8cea9b39883d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":36,"last_clean_end":307,"up_from":319,"up_thru":354,"down_at":308,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2596074962},{"type":"v1","addr":"172.21.15.96:6809","nonce":2596074962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2596074962},{"type":"v1","addr":"172.21.15.96:6811","nonce":2596074962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2596074962},{"type":"v1","addr":"172.21.15.96:6815","nonce":2596074962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2596074962},{"type":"v1","addr":"172.21.15.96:6813","nonce":2596074962}]},"public_addr":"172.21.15.96:6809/2596074962","cluster_addr":"172.21.15.96:6811/2596074962","heartbeat_back_addr":"172.21.15.96:6815/2596074962","heartbeat_front_addr":"172.21.15.96:6813/2596074962","state":["exists","up"]},{"osd":6,"uuid":"c08bca3f-043c-406b-9f5a-88890d11ecae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":42,"last_clean_end":326,"up_from":339,"up_thru":354,"down_at":327,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":1665653065},{"type":"v1","addr":"172.21.15.96:6817","nonce":1665653065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":1665653065},{"type":"v1","addr":"172.21.15.96:6819","nonce":1665653065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":1665653065},{"type":"v1","addr":"172.21.15.96:6823","nonce":1665653065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":1665653065},{"type":"v1","addr":"172.21.15.96:6821","nonce":1665653065}]},"public_addr":"172.21.15.96:6817/1665653065","cluster_addr":"172.21.15.96:6819/1665653065","heartbeat_back_addr":"172.21.15.96:6823/1665653065","heartbeat_front_addr":"172.21.15.96:6821/1665653065","state":["exists","up"]},{"osd":7,"uuid":"a54a6024-e16e-429a-aa5b-4445c0a29b17","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":48,"last_clean_end":343,"up_from":354,"up_thru":354,"down_at":344,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":1016563140},{"type":"v1","addr":"172.21.15.96:6825","nonce":1016563140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":1016563140},{"type":"v1","addr":"172.21.15.96:6827","nonce":1016563140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":1016563140},{"type":"v1","addr":"172.21.15.96:6831","nonce":1016563140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":1016563140},{"type":"v1","addr":"172.21.15.96:6829","nonce":1016563140}]},"public_addr":"172.21.15.96:6825/1016563140","cluster_addr":"172.21.15.96:6827/1016563140","heartbeat_back_addr":"172.21.15.96:6831/1016563140","heartbeat_front_addr":"172.21.15.96:6829/1016563140","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:49:14.437542+0000","dead_epoch":207},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:49:42.718085+0000","dead_epoch":236},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:09.839689+0000","dead_epoch":253},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:37.396695+0000","dead_epoch":282},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:50:59.865570+0000","dead_epoch":298},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:51:25.244074+0000","dead_epoch":308},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:51:51.606323+0000","dead_epoch":327},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:52:17.356022+0000","dead_epoch":344}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:0/2349254883":"2021-07-27T15:46:39.321454+0000","172.21.15.33:0/2946348509":"2021-07-27T15:58:08.293323+0000","172.21.15.33:6801/2899626203":"2021-07-27T15:57:13.334310+0000","172.21.15.33:6800/2899626203":"2021-07-27T15:57:13.334310+0000","172.21.15.33:0/629989338":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/2841336790":"2021-07-27T15:58:08.293323+0000","172.21.15.33:0/474711394":"2021-07-27T15:46:39.321454+0000","172.21.15.96:6833/3696224068":"2021-07-27T15:57:32.616345+0000","172.21.15.33:0/1984688876":"2021-07-27T15:57:13.334310+0000","172.21.15.33:6800/1102203802":"2021-07-27T15:58:08.293323+0000","172.21.15.33:6801/2328850889":"2021-07-27T15:47:11.401176+0000","172.21.15.33:0/3822740668":"2021-07-27T15:57:13.334310+0000","172.21.15.96:6832/3696224068":"2021-07-27T15:57:32.616345+0000","172.21.15.96:0/2121940146":"2021-07-27T15:57:32.616345+0000","172.21.15.33:6800/2328850889":"2021-07-27T15:47:11.401176+0000","172.21.15.96:0/1112010259":"2021-07-27T15:57:32.616345+0000","172.21.15.33:6801/1102203802":"2021-07-27T15:58:08.293323+0000","172.21.15.33:6800/3040782006":"2021-07-27T15:46:39.321454+0000","172.21.15.33:0/167530138":"2021-07-27T15:47:11.401176+0000","172.21.15.96:0/1692375729":"2021-07-27T15:57:32.616345+0000","172.21.15.33:0/664260923":"2021-07-27T15:58:08.293323+0000","172.21.15.33:6801/3040782006":"2021-07-27T15:46:39.321454+0000","172.21.15.33:0/2940463047":"2021-07-27T15:58:08.293323+0000","172.21.15.96:0/586202040":"2021-07-27T15:57:32.616345+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"teuthologyprofile":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[{"pool":3,"snaps":[{"begin":677,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":752,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-07-26T16:11:48.333 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph pg dump --format=json 2021-07-26T16:11:48.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:48 smithi033 bash[41341]: cluster 2021-07-26T16:11:47.241770+0000 mgr.y (mgr.34104) 535 : cluster [DBG] pgmap v1114: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 267 KiB/s wr, 4 op/s 2021-07-26T16:11:48.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:48 smithi033 bash[41341]: audit 2021-07-26T16:11:47.548700+0000 mon.c (mon.1) 281 : audit [DBG] from='client.? 172.21.15.33:0/815103256' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T16:11:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:48 smithi033 bash[42377]: cluster 2021-07-26T16:11:47.241770+0000 mgr.y (mgr.34104) 535 : cluster [DBG] pgmap v1114: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 267 KiB/s wr, 4 op/s 2021-07-26T16:11:48.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:48 smithi033 bash[42377]: audit 2021-07-26T16:11:47.548700+0000 mon.c (mon.1) 281 : audit [DBG] from='client.? 172.21.15.33:0/815103256' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T16:11:48.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:48 smithi096 bash[33981]: cluster 2021-07-26T16:11:47.241770+0000 mgr.y (mgr.34104) 535 : cluster [DBG] pgmap v1114: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 2.2 MiB/s rd, 267 KiB/s wr, 4 op/s 2021-07-26T16:11:48.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:48 smithi096 bash[33981]: audit 2021-07-26T16:11:47.548700+0000 mon.c (mon.1) 281 : audit [DBG] from='client.? 172.21.15.33:0/815103256' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-07-26T16:11:50.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:50 smithi033 bash[42377]: cluster 2021-07-26T16:11:49.242504+0000 mgr.y (mgr.34104) 536 : cluster [DBG] pgmap v1115: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 127 B/s rd, 230 KiB/s wr, 3 op/s 2021-07-26T16:11:50.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:50 smithi033 bash[41341]: cluster 2021-07-26T16:11:49.242504+0000 mgr.y (mgr.34104) 536 : cluster [DBG] pgmap v1115: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 127 B/s rd, 230 KiB/s wr, 3 op/s 2021-07-26T16:11:50.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:50 smithi096 bash[33981]: cluster 2021-07-26T16:11:49.242504+0000 mgr.y (mgr.34104) 536 : cluster [DBG] pgmap v1115: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 127 B/s rd, 230 KiB/s wr, 3 op/s 2021-07-26T16:11:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T16:11:52.668 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:52 smithi033 bash[41341]: cluster 2021-07-26T16:11:51.243312+0000 mgr.y (mgr.34104) 537 : cluster [DBG] pgmap v1116: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 103 B/s rd, 185 KiB/s wr, 2 op/s 2021-07-26T16:11:52.668 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:52 smithi033 bash[41341]: cluster 2021-07-26T16:11:51.320134+0000 mon.a (mon.0) 1233 : cluster [DBG] osdmap e849: 8 total, 8 up, 8 in 2021-07-26T16:11:52.668 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:52 smithi033 bash[42377]: cluster 2021-07-26T16:11:51.243312+0000 mgr.y (mgr.34104) 537 : cluster [DBG] pgmap v1116: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 103 B/s rd, 185 KiB/s wr, 2 op/s 2021-07-26T16:11:52.669 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:52 smithi033 bash[42377]: cluster 2021-07-26T16:11:51.320134+0000 mon.a (mon.0) 1233 : cluster [DBG] osdmap e849: 8 total, 8 up, 8 in 2021-07-26T16:11:52.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:52 smithi096 bash[33981]: cluster 2021-07-26T16:11:51.243312+0000 mgr.y (mgr.34104) 537 : cluster [DBG] pgmap v1116: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 103 B/s rd, 185 KiB/s wr, 2 op/s 2021-07-26T16:11:52.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:52 smithi096 bash[33981]: cluster 2021-07-26T16:11:51.320134+0000 mon.a (mon.0) 1233 : cluster [DBG] osdmap e849: 8 total, 8 up, 8 in 2021-07-26T16:11:54.584 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:54 smithi033 bash[42377]: cluster 2021-07-26T16:11:53.244066+0000 mgr.y (mgr.34104) 538 : cluster [DBG] pgmap v1118: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 127 B/s rd, 230 KiB/s wr, 3 op/s 2021-07-26T16:11:54.585 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:54 smithi033 bash[41341]: cluster 2021-07-26T16:11:53.244066+0000 mgr.y (mgr.34104) 538 : cluster [DBG] pgmap v1118: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 127 B/s rd, 230 KiB/s wr, 3 op/s 2021-07-26T16:11:54.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:54 smithi096 bash[33981]: cluster 2021-07-26T16:11:53.244066+0000 mgr.y (mgr.34104) 538 : cluster [DBG] pgmap v1118: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail; 127 B/s rd, 230 KiB/s wr, 3 op/s 2021-07-26T16:11:55.007 INFO:teuthology.orchestra.run.smithi033.stdout: 2021-07-26T16:11:55.008 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2021-07-26T16:11:55.748 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":1118,"stamp":"2021-07-26T16:11:53.243654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1097966112,"num_objects":424,"num_object_clones":372,"num_object_copies":1272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":424,"num_whiteouts":12,"num_read":4263,"num_read_kb":7559968,"num_write":9265,"num_write_kb":2248848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":324149248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21097,"ondisk_log_size":21097,"up":75,"acting":75,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":75,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":4296184,"kb_used_data":1349304,"kb_used_omap":357,"kb_used_meta":2946458,"kb_avail":745665032,"statfs":{"total":767960285184,"available":763560992768,"internally_reserved":0,"allocated":1381687296,"data_stored":3080045306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":365815,"internal_metadata":3017173769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-18030592,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":-1,"num_read":2,"num_read_kb":1,"num_write":23,"num_write_kb":1840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002955"},"pg_stats":[{"pgid":"3.f","version":"846'409","reported_seq":2856,"reported_epoch":848,"state":"active+clean","last_fresh":"2021-07-26T16:11:46.319553+0000","last_change":"2021-07-26T16:11:40.371329+0000","last_active":"2021-07-26T16:11:46.319553+0000","last_peered":"2021-07-26T16:11:46.319553+0000","last_clean":"2021-07-26T16:11:46.319553+0000","last_became_active":"2021-07-26T16:02:26.032435+0000","last_became_peered":"2021-07-26T16:02:26.032435+0000","last_unstale":"2021-07-26T16:11:46.319553+0000","last_undegraded":"2021-07-26T16:11:46.319553+0000","last_fullsized":"2021-07-26T16:11:46.319553+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":409,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":26443776,"num_objects":11,"num_object_clones":10,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":70,"num_read_kb":121315,"num_write":150,"num_write_kb":59816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":10903552,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2a5","length":"1"}]},{"pgid":"3.e","version":"846'801","reported_seq":3230,"reported_epoch":848,"state":"active+clean","last_fresh":"2021-07-26T16:11:46.319205+0000","last_change":"2021-07-26T16:11:40.382392+0000","last_active":"2021-07-26T16:11:46.319205+0000","last_peered":"2021-07-26T16:11:46.319205+0000","last_clean":"2021-07-26T16:11:46.319205+0000","last_became_active":"2021-07-26T16:02:26.030098+0000","last_became_peered":"2021-07-26T16:02:26.030098+0000","last_unstale":"2021-07-26T16:11:46.319205+0000","last_undegraded":"2021-07-26T16:11:46.319205+0000","last_fullsized":"2021-07-26T16:11:46.319205+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":801,"ondisk_log_size":801,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63741952,"num_objects":22,"num_object_clones":20,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":175,"num_read_kb":303884,"num_write":372,"num_write_kb":105176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":4898816,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2a5","length":"1"}]},{"pgid":"3.d","version":"846'1292","reported_seq":3701,"reported_epoch":848,"state":"active+clean","last_fresh":"2021-07-26T16:11:46.319578+0000","last_change":"2021-07-26T16:11:40.403627+0000","last_active":"2021-07-26T16:11:46.319578+0000","last_peered":"2021-07-26T16:11:46.319578+0000","last_clean":"2021-07-26T16:11:46.319578+0000","last_became_active":"2021-07-26T16:02:26.029950+0000","last_became_peered":"2021-07-26T16:02:26.029950+0000","last_unstale":"2021-07-26T16:11:46.319578+0000","last_undegraded":"2021-07-26T16:11:46.319578+0000","last_fullsized":"2021-07-26T16:11:46.319578+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":1292,"ondisk_log_size":1292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":138469376,"num_objects":30,"num_object_clones":27,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":273,"num_read_kb":565376,"num_write":639,"num_write_kb":137784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":30171136,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,3],"acting":[7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2a5","length":"1"}]},{"pgid":"3.c","version":"846'1811","reported_seq":4190,"reported_epoch":848,"state":"active+clean","last_fresh":"2021-07-26T16:11:46.331770+0000","last_change":"2021-07-26T16:11:40.400579+0000","last_active":"2021-07-26T16:11:46.331770+0000","last_peered":"2021-07-26T16:11:46.331770+0000","last_clean":"2021-07-26T16:11:46.331770+0000","last_became_active":"2021-07-26T16:01:59.042850+0000","last_became_peered":"2021-07-26T16:01:59.042850+0000","last_unstale":"2021-07-26T16:11:46.331770+0000","last_undegraded":"2021-07-26T16:11:46.331770+0000","last_fullsized":"2021-07-26T16:11:46.331770+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":1811,"ondisk_log_size":1811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":103071744,"num_objects":39,"num_object_clones":35,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":338,"num_read_kb":676558,"num_write":738,"num_write_kb":177152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":36896768,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2a5","length":"1"}]},{"pgid":"3.b","version":"846'2628","reported_seq":4967,"reported_epoch":849,"state":"active+clean","last_fresh":"2021-07-26T16:11:51.321624+0000","last_change":"2021-07-26T16:11:40.414990+0000","last_active":"2021-07-26T16:11:51.321624+0000","last_peered":"2021-07-26T16:11:51.321624+0000","last_clean":"2021-07-26T16:11:51.321624+0000","last_became_active":"2021-07-26T16:01:23.056498+0000","last_became_peered":"2021-07-26T16:01:23.056498+0000","last_unstale":"2021-07-26T16:11:51.321624+0000","last_undegraded":"2021-07-26T16:11:51.321624+0000","last_fullsized":"2021-07-26T16:11:51.321624+0000","mapping_epoch":311,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":312,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":2628,"ondisk_log_size":2628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":115826688,"num_objects":49,"num_object_clones":43,"num_object_copies":147,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":1,"num_read":529,"num_read_kb":667667,"num_write":1074,"num_write_kb":284896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":30744576,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"846'740","reported_seq":3191,"reported_epoch":849,"state":"active+clean","last_fresh":"2021-07-26T16:11:51.624991+0000","last_change":"2021-07-26T16:11:40.382054+0000","last_active":"2021-07-26T16:11:51.624991+0000","last_peered":"2021-07-26T16:11:51.624991+0000","last_clean":"2021-07-26T16:11:51.624991+0000","last_became_active":"2021-07-26T16:01:59.046422+0000","last_became_peered":"2021-07-26T16:01:59.046422+0000","last_unstale":"2021-07-26T16:11:51.624991+0000","last_undegraded":"2021-07-26T16:11:51.624991+0000","last_fullsized":"2021-07-26T16:11:51.624991+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":740,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31096832,"num_objects":15,"num_object_clones":13,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":145,"num_read_kb":151427,"num_write":456,"num_write_kb":89632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":22757376,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"846'683","reported_seq":3082,"reported_epoch":848,"state":"active+clean","last_fresh":"2021-07-26T16:11:46.524619+0000","last_change":"2021-07-26T16:11:40.371424+0000","last_active":"2021-07-26T16:11:46.524619+0000","last_peered":"2021-07-26T16:11:46.524619+0000","last_clean":"2021-07-26T16:11:46.524619+0000","last_became_active":"2021-07-26T16:02:26.031461+0000","last_became_peered":"2021-07-26T16:02:26.031461+0000","last_unstale":"2021-07-26T16:11:46.524619+0000","last_undegraded":"2021-07-26T16:11:46.524619+0000","last_fullsized":"2021-07-26T16:11:46.524619+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":683,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":28598272,"num_objects":17,"num_object_clones":15,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":129,"num_read_kb":252277,"num_write":379,"num_write_kb":42560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":10051584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2a5","length":"1"}]},{"pgid":"3.8","version":"846'501","reported_seq":2972,"reported_epoch":849,"state":"active+clean","last_fresh":"2021-07-26T16:11:51.321253+0000","last_change":"2021-07-26T16:11:40.386712+0000","last_active":"2021-07-26T16:11:51.321253+0000","last_peered":"2021-07-26T16:11:51.321253+0000","last_clean":"2021-07-26T16:11:51.321253+0000","last_became_active":"2021-07-26T16:02:26.024814+0000","last_became_peered":"2021-07-26T16:02:26.024814+0000","last_unstale":"2021-07-26T16:11:51.321253+0000","last_undegraded":"2021-07-26T16:11:51.321253+0000","last_fullsized":"2021-07-26T16:11:51.321253+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":501,"ondisk_log_size":501,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9625600,"num_objects":9,"num_object_clones":8,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":102,"num_read_kb":226671,"num_write":188,"num_write_kb":33720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":13672448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":816,"reported_epoch":847,"state":"active+clean","last_fresh":"2021-07-26T16:11:41.312393+0000","last_change":"2021-07-26T16:02:26.028433+0000","last_active":"2021-07-26T16:11:41.312393+0000","last_peered":"2021-07-26T16:11:41.312393+0000","last_clean":"2021-07-26T16:11:41.312393+0000","last_became_active":"2021-07-26T16:02:26.028082+0000","last_became_peered":"2021-07-26T16:02:26.028082+0000","last_unstale":"2021-07-26T16:11:41.312393+0000","last_undegraded":"2021-07-26T16:11:41.312393+0000","last_fullsized":"2021-07-26T16:11:41.312393+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"846'1356","reported_seq":3780,"reported_epoch":848,"state":"active+clean","last_fresh":"2021-07-26T16:11:46.331944+0000","last_change":"2021-07-26T16:11:40.403930+0000","last_active":"2021-07-26T16:11:46.331944+0000","last_peered":"2021-07-26T16:11:46.331944+0000","last_clean":"2021-07-26T16:11:46.331944+0000","last_became_active":"2021-07-26T16:01:31.011088+0000","last_became_peered":"2021-07-26T16:01:31.011088+0000","last_unstale":"2021-07-26T16:11:46.331944+0000","last_undegraded":"2021-07-26T16:11:46.331944+0000","last_fullsized":"2021-07-26T16:11:46.331944+0000","mapping_epoch":319,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":320,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":1356,"ondisk_log_size":1356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":77529088,"num_objects":26,"num_object_clones":23,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":1,"num_read":268,"num_read_kb":541316,"num_write":427,"num_write_kb":149952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":19456000,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2a5","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":808,"reported_epoch":847,"state":"active+clean","last_fresh":"2021-07-26T16:11:42.012572+0000","last_change":"2021-07-26T16:01:59.046469+0000","last_active":"2021-07-26T16:11:42.012572+0000","last_peered":"2021-07-26T16:11:42.012572+0000","last_clean":"2021-07-26T16:11:42.012572+0000","last_became_active":"2021-07-26T16:01:59.046194+0000","last_became_peered":"2021-07-26T16:01:59.046194+0000","last_unstale":"2021-07-26T16:11:42.012572+0000","last_undegraded":"2021-07-26T16:11:42.012572+0000","last_fullsized":"2021-07-26T16:11:42.012572+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"846'749","reported_seq":3202,"reported_epoch":848,"state":"active+clean","last_fresh":"2021-07-26T16:11:46.524440+0000","last_change":"2021-07-26T16:11:40.384458+0000","last_active":"2021-07-26T16:11:46.524440+0000","last_peered":"2021-07-26T16:11:46.524440+0000","last_clean":"2021-07-26T16:11:46.524440+0000","last_became_active":"2021-07-26T16:01:23.060015+0000","last_became_peered":"2021-07-26T16:01:23.060015+0000","last_unstale":"2021-07-26T16:11:46.524440+0000","last_undegraded":"2021-07-26T16:11:46.524440+0000","last_fullsized":"2021-07-26T16:11:46.524440+0000","mapping_epoch":311,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":312,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":749,"ondisk_log_size":749,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41377792,"num_objects":14,"num_object_clones":12,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":161,"num_read_kb":510066,"num_write":359,"num_write_kb":107384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":2555904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,0],"acting":[4,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2a5","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":792,"reported_epoch":847,"state":"active+clean","last_fresh":"2021-07-26T16:11:41.690741+0000","last_change":"2021-07-26T16:00:55.016851+0000","last_active":"2021-07-26T16:11:41.690741+0000","last_peered":"2021-07-26T16:11:41.690741+0000","last_clean":"2021-07-26T16:11:41.690741+0000","last_became_active":"2021-07-26T16:00:55.016228+0000","last_became_peered":"2021-07-26T16:00:55.016228+0000","last_unstale":"2021-07-26T16:11:41.690741+0000","last_undegraded":"2021-07-26T16:11:41.690741+0000","last_fullsized":"2021-07-26T16:11:41.690741+0000","mapping_epoch":293,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":294,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"846'1640","reported_seq":4001,"reported_epoch":848,"state":"active+clean","last_fresh":"2021-07-26T16:11:46.313922+0000","last_change":"2021-07-26T16:11:40.384821+0000","last_active":"2021-07-26T16:11:46.313922+0000","last_peered":"2021-07-26T16:11:46.313922+0000","last_clean":"2021-07-26T16:11:46.313922+0000","last_became_active":"2021-07-26T16:01:59.040545+0000","last_became_peered":"2021-07-26T16:01:59.040545+0000","last_unstale":"2021-07-26T16:11:46.313922+0000","last_undegraded":"2021-07-26T16:11:46.313922+0000","last_fullsized":"2021-07-26T16:11:46.313922+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":1640,"ondisk_log_size":1640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":68501504,"num_objects":31,"num_object_clones":27,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":1,"num_read":289,"num_read_kb":452353,"num_write":684,"num_write_kb":152856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":20602880,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2a5","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":825,"reported_epoch":847,"state":"active+clean","last_fresh":"2021-07-26T16:11:42.012400+0000","last_change":"2021-07-26T16:02:26.030814+0000","last_active":"2021-07-26T16:11:42.012400+0000","last_peered":"2021-07-26T16:11:42.012400+0000","last_clean":"2021-07-26T16:11:42.012400+0000","last_became_active":"2021-07-26T16:02:26.030405+0000","last_became_peered":"2021-07-26T16:02:26.030405+0000","last_unstale":"2021-07-26T16:11:42.012400+0000","last_undegraded":"2021-07-26T16:11:42.012400+0000","last_fullsized":"2021-07-26T16:11:42.012400+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"146'139","reported_seq":1047,"reported_epoch":847,"state":"active+clean","last_fresh":"2021-07-26T16:11:41.972942+0000","last_change":"2021-07-26T16:02:39.575229+0000","last_active":"2021-07-26T16:11:41.972942+0000","last_peered":"2021-07-26T16:11:41.972942+0000","last_clean":"2021-07-26T16:11:41.972942+0000","last_became_active":"2021-07-26T16:02:26.034142+0000","last_became_peered":"2021-07-26T16:02:26.034142+0000","last_unstale":"2021-07-26T16:11:41.972942+0000","last_undegraded":"2021-07-26T16:11:41.972942+0000","last_fullsized":"2021-07-26T16:11:41.972942+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:50:12.120754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:50:12.120754+0000","last_clean_scrub_stamp":"2021-07-26T15:50:12.120754+0000","log_size":139,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":294,"num_read_kb":500,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"846'2160","reported_seq":4492,"reported_epoch":849,"state":"active+clean","last_fresh":"2021-07-26T16:11:51.321603+0000","last_change":"2021-07-26T16:11:40.411719+0000","last_active":"2021-07-26T16:11:51.321603+0000","last_peered":"2021-07-26T16:11:51.321603+0000","last_clean":"2021-07-26T16:11:51.321603+0000","last_became_active":"2021-07-26T16:01:59.042655+0000","last_became_peered":"2021-07-26T16:01:59.042655+0000","last_unstale":"2021-07-26T16:11:51.321603+0000","last_undegraded":"2021-07-26T16:11:51.321603+0000","last_fullsized":"2021-07-26T16:11:51.321603+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":2160,"ondisk_log_size":2160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":83042304,"num_objects":38,"num_object_clones":33,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":377,"num_read_kb":585984,"num_write":998,"num_write_kb":228672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":18284544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":807,"reported_epoch":847,"state":"active+clean","last_fresh":"2021-07-26T16:11:41.973252+0000","last_change":"2021-07-26T16:02:39.576860+0000","last_active":"2021-07-26T16:11:41.973252+0000","last_peered":"2021-07-26T16:11:41.973252+0000","last_clean":"2021-07-26T16:11:41.973252+0000","last_became_active":"2021-07-26T16:02:26.033631+0000","last_became_peered":"2021-07-26T16:02:26.033631+0000","last_unstale":"2021-07-26T16:11:41.973252+0000","last_undegraded":"2021-07-26T16:11:41.973252+0000","last_fullsized":"2021-07-26T16:11:41.973252+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"846'1640","reported_seq":4017,"reported_epoch":849,"state":"active+clean","last_fresh":"2021-07-26T16:11:51.816335+0000","last_change":"2021-07-26T16:11:40.401204+0000","last_active":"2021-07-26T16:11:51.816335+0000","last_peered":"2021-07-26T16:11:51.816335+0000","last_clean":"2021-07-26T16:11:51.816335+0000","last_became_active":"2021-07-26T16:01:23.057012+0000","last_became_peered":"2021-07-26T16:01:23.057012+0000","last_unstale":"2021-07-26T16:11:51.816335+0000","last_undegraded":"2021-07-26T16:11:51.816335+0000","last_fullsized":"2021-07-26T16:11:51.816335+0000","mapping_epoch":311,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":312,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":1640,"ondisk_log_size":1640,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":57090048,"num_objects":29,"num_object_clones":25,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":3,"num_read":297,"num_read_kb":984993,"num_write":703,"num_write_kb":184176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":25157632,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":788,"reported_epoch":847,"state":"active+clean","last_fresh":"2021-07-26T16:11:41.973262+0000","last_change":"2021-07-26T16:02:39.576248+0000","last_active":"2021-07-26T16:11:41.973262+0000","last_peered":"2021-07-26T16:11:41.973262+0000","last_clean":"2021-07-26T16:11:41.973262+0000","last_became_active":"2021-07-26T16:02:26.032598+0000","last_became_peered":"2021-07-26T16:02:26.032598+0000","last_unstale":"2021-07-26T16:11:41.973262+0000","last_undegraded":"2021-07-26T16:11:41.973262+0000","last_fullsized":"2021-07-26T16:11:41.973262+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"846'2091","reported_seq":4395,"reported_epoch":848,"state":"active+clean","last_fresh":"2021-07-26T16:11:46.317488+0000","last_change":"2021-07-26T16:11:40.404629+0000","last_active":"2021-07-26T16:11:46.317488+0000","last_peered":"2021-07-26T16:11:46.317488+0000","last_clean":"2021-07-26T16:11:46.317488+0000","last_became_active":"2021-07-26T16:01:59.039336+0000","last_became_peered":"2021-07-26T16:01:59.039336+0000","last_unstale":"2021-07-26T16:11:46.317488+0000","last_undegraded":"2021-07-26T16:11:46.317488+0000","last_fullsized":"2021-07-26T16:11:46.317488+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":2091,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":161873920,"num_objects":46,"num_object_clones":41,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":2,"num_read":334,"num_read_kb":658344,"num_write":891,"num_write_kb":271504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":14254080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2a5","length":"1"}]},{"pgid":"3.7","version":"846'2156","reported_seq":4524,"reported_epoch":849,"state":"active+clean","last_fresh":"2021-07-26T16:11:51.321717+0000","last_change":"2021-07-26T16:11:40.397194+0000","last_active":"2021-07-26T16:11:51.321717+0000","last_peered":"2021-07-26T16:11:51.321717+0000","last_clean":"2021-07-26T16:11:51.321717+0000","last_became_active":"2021-07-26T16:02:26.028306+0000","last_became_peered":"2021-07-26T16:02:26.028306+0000","last_unstale":"2021-07-26T16:11:51.321717+0000","last_undegraded":"2021-07-26T16:11:51.321717+0000","last_fullsized":"2021-07-26T16:11:51.321717+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":2156,"ondisk_log_size":2156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":82206720,"num_objects":39,"num_object_clones":34,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":432,"num_read_kb":780323,"num_write":889,"num_write_kb":205280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":63741952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7],"acting":[3,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":813,"reported_epoch":847,"state":"active+clean","last_fresh":"2021-07-26T16:11:41.312195+0000","last_change":"2021-07-26T16:01:59.041642+0000","last_active":"2021-07-26T16:11:41.312195+0000","last_peered":"2021-07-26T16:11:41.312195+0000","last_clean":"2021-07-26T16:11:41.312195+0000","last_became_active":"2021-07-26T16:01:59.041280+0000","last_became_peered":"2021-07-26T16:01:59.041280+0000","last_unstale":"2021-07-26T16:11:41.312195+0000","last_undegraded":"2021-07-26T16:11:41.312195+0000","last_fullsized":"2021-07-26T16:11:41.312195+0000","mapping_epoch":339,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":340,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":800,"reported_epoch":848,"state":"active+clean","last_fresh":"2021-07-26T16:11:46.624959+0000","last_change":"2021-07-26T16:02:26.031829+0000","last_active":"2021-07-26T16:11:46.624959+0000","last_peered":"2021-07-26T16:11:46.624959+0000","last_clean":"2021-07-26T16:11:46.624959+0000","last_became_active":"2021-07-26T16:02:26.031356+0000","last_became_peered":"2021-07-26T16:02:26.031356+0000","last_unstale":"2021-07-26T16:11:46.624959+0000","last_undegraded":"2021-07-26T16:11:46.624959+0000","last_fullsized":"2021-07-26T16:11:46.624959+0000","mapping_epoch":354,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":355,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:52:53.108645+0000","last_clean_scrub_stamp":"2021-07-26T15:52:53.108645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"846'301","reported_seq":2730,"reported_epoch":849,"state":"active+clean","last_fresh":"2021-07-26T16:11:51.816520+0000","last_change":"2021-07-26T16:11:40.377831+0000","last_active":"2021-07-26T16:11:51.816520+0000","last_peered":"2021-07-26T16:11:51.816520+0000","last_clean":"2021-07-26T16:11:51.816520+0000","last_became_active":"2021-07-26T16:01:23.055458+0000","last_became_peered":"2021-07-26T16:01:23.055458+0000","last_unstale":"2021-07-26T16:11:51.816520+0000","last_undegraded":"2021-07-26T16:11:51.816520+0000","last_fullsized":"2021-07-26T16:11:51.816520+0000","mapping_epoch":311,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":312,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:56:36.707795+0000","last_clean_scrub_stamp":"2021-07-26T15:56:36.707795+0000","log_size":301,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8880128,"num_objects":7,"num_object_clones":6,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":50,"num_read_kb":80914,"num_write":119,"num_write_kb":15872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":16,"stat_sum":{"num_bytes":1097375744,"num_objects":422,"num_object_clones":372,"num_object_copies":1266,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":422,"num_whiteouts":12,"num_read":3969,"num_read_kb":7559468,"num_write":9066,"num_write_kb":2246432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":112,"num_bytes_recovered":324149248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1322913792,"data_stored":3042988032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20958,"ondisk_log_size":20958,"up":48,"acting":48,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":294,"num_read_kb":500,"num_write":199,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":354,"seq":1520418422898,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":423260,"kb_used_data":127380,"kb_used_omap":39,"kb_used_meta":295832,"kb_avail":93321892,"statfs":{"total":95995035648,"available":95561617408,"internally_reserved":0,"allocated":130437120,"data_stored":319855698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":40520,"internal_metadata":302932408},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 16:11:40 2021","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":0.91600000000000004,"15min":0.94599999999999995},"min":{"1min":0.59899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.2709999999999999,"5min":1.518,"15min":1.518},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.996,"5min":0.998,"15min":0.98599999999999999},"min":{"1min":0.57199999999999995,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.419,"5min":1.839,"15min":1.839},"last":1.169}]},{"osd":1,"last update":"Mon Jul 26 16:11:40 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.98899999999999999,"15min":0.98299999999999998},"min":{"1min":0.60199999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.8200000000000001,"5min":1.8200000000000001,"15min":1.827},"last":1.262},{"interface":"front","average":{"1min":1,"5min":0.94799999999999995,"15min":0.95199999999999996},"min":{"1min":0.66000000000000003,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.302,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":1.0229999999999999}]},{"osd":2,"last update":"Mon Jul 26 16:11:40 2021","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96799999999999997,"15min":0.96999999999999997},"min":{"1min":0.72599999999999998,"5min":0.44,"15min":0.44},"max":{"1min":1.331,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.105},{"interface":"front","average":{"1min":1.079,"5min":1.036,"15min":1.0309999999999999},"min":{"1min":0.63,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.036}]},{"osd":3,"last update":"Mon Jul 26 16:11:40 2021","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.0129999999999999,"15min":1.048},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.55100000000000005},"max":{"1min":1.3799999999999999,"5min":2.5099999999999998,"15min":2.5099999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.135,"5min":1.0960000000000001,"15min":1.105},"min":{"1min":0.68999999999999995,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.4590000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.98199999999999998}]},{"osd":4,"last update":"Mon Jul 26 16:11:40 2021","interfaces":[{"interface":"back","average":{"1min":1.1439999999999999,"5min":1.0880000000000001,"15min":1.052},"min":{"1min":0.78600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.7569999999999999,"5min":1.7569999999999999,"15min":1.9079999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.169,"15min":1.1479999999999999},"min":{"1min":0.79900000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.8740000000000001,"5min":2.8740000000000001,"15min":2.8740000000000001},"last":1.117}]},{"osd":5,"last update":"Mon Jul 26 16:11:40 2021","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.133,"15min":1.147},"min":{"1min":0.83599999999999997,"5min":0.63,"15min":0.63},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.4100000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.127,"5min":1.1479999999999999,"15min":1.159},"min":{"1min":0.83299999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.637,"5min":1.637,"15min":1.772},"last":1.0760000000000001}]},{"osd":6,"last update":"Mon Jul 26 16:11:40 2021","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.2210000000000001,"15min":1.2410000000000001},"min":{"1min":1.022,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.917,"5min":1.917,"15min":2.4820000000000002},"last":1.1930000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.2809999999999999,"15min":1.254},"min":{"1min":1.038,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.8620000000000001,"5min":2.198,"15min":2.198},"last":1.0629999999999999}]}]},{"osd":6,"up_from":339,"seq":1455993913464,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":542348,"kb_used_data":195012,"kb_used_omap":53,"kb_used_meta":347274,"kb_avail":93202804,"statfs":{"total":95995035648,"available":95439671296,"internally_reserved":0,"allocated":199692288,"data_stored":408755282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":55247,"internal_metadata":355608625},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 16:11:26 2021","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.91000000000000003,"15min":0.87},"min":{"1min":0.73999999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.2310000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.96499999999999997,"15min":0.95499999999999996},"min":{"1min":0.59799999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.4179999999999999,"5min":1.7829999999999999,"15min":2.544},"last":0.96399999999999997}]},{"osd":1,"last update":"Mon Jul 26 16:11:26 2021","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.90700000000000003,"15min":0.91800000000000004},"min":{"1min":0.52000000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.2569999999999999,"5min":1.4590000000000001,"15min":1.915},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.95599999999999996,"15min":0.96699999999999997},"min":{"1min":0.58899999999999997,"5min":0.501,"15min":0.46200000000000002},"max":{"1min":1.3740000000000001,"5min":1.409,"15min":1.8779999999999999},"last":1.1379999999999999}]},{"osd":2,"last update":"Mon Jul 26 16:11:26 2021","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":0.96299999999999997,"15min":0.95699999999999996},"min":{"1min":0.69199999999999995,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.2430000000000001,"5min":1.3660000000000001,"15min":1.5720000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.016,"5min":1.01,"15min":1.046},"min":{"1min":0.76600000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.349,"5min":1.6140000000000001,"15min":8.3260000000000005},"last":1.0820000000000001}]},{"osd":3,"last update":"Mon Jul 26 16:11:26 2021","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":1.089,"15min":1.081},"min":{"1min":0.69099999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.335,"5min":4.7089999999999996,"15min":6.8460000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.95699999999999996,"5min":1.0409999999999999,"15min":0.97899999999999998},"min":{"1min":0.56699999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.206,"5min":7.3769999999999998,"15min":7.3769999999999998},"last":1.012}]},{"osd":4,"last update":"Mon Jul 26 16:11:26 2021","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.034,"15min":1.0469999999999999},"min":{"1min":0.73199999999999998,"5min":0.54800000000000004,"15min":0.53700000000000003},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":1.054,"5min":1.0860000000000001,"15min":1.139},"min":{"1min":0.53800000000000003,"5min":0.52000000000000002,"15min":0.45900000000000002},"max":{"1min":1.3180000000000001,"5min":2.1339999999999999,"15min":3.2280000000000002},"last":0.76400000000000001}]},{"osd":5,"last update":"Mon Jul 26 16:11:26 2021","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.091,"15min":1.1439999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.48699999999999999},"max":{"1min":1.3720000000000001,"5min":2.2370000000000001,"15min":2.6360000000000001},"last":1.042},{"interface":"front","average":{"1min":1.22,"5min":1.127,"15min":1.103},"min":{"1min":0.81599999999999995,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":3.8860000000000001,"5min":3.8860000000000001,"15min":3.8860000000000001},"last":1.105}]},{"osd":7,"last update":"Mon Jul 26 16:11:42 2021","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.175,"15min":1.159},"min":{"1min":0.71499999999999997,"5min":0.65000000000000002,"15min":0.59699999999999998},"max":{"1min":1.419,"5min":2.1890000000000001,"15min":3.3460000000000001},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.323,"5min":1.2969999999999999,"15min":1.2689999999999999},"min":{"1min":0.77800000000000002,"5min":0.68999999999999995,"15min":0.64800000000000002},"max":{"1min":1.8879999999999999,"5min":2.3090000000000002,"15min":3.4329999999999998},"last":1.2050000000000001}]}]},{"osd":1,"up_from":247,"seq":1060856922256,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":532104,"kb_used_data":171008,"kb_used_omap":31,"kb_used_meta":361056,"kb_avail":93213048,"statfs":{"total":95995035648,"available":95450161152,"internally_reserved":0,"allocated":175112192,"data_stored":377387570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32523,"internal_metadata":369721589},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 16:11:12 2021","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.73599999999999999,"15min":0.877},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.22,"5min":1.24,"15min":8.2569999999999997},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.84599999999999997,"15min":0.86599999999999999},"min":{"1min":0.38200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.2010000000000001,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.86099999999999999}]},{"osd":2,"last update":"Mon Jul 26 16:11:40 2021","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.80700000000000005,"15min":0.79500000000000004},"min":{"1min":0.58199999999999996,"5min":0.36399999999999999,"15min":0.31},"max":{"1min":1.254,"5min":1.3440000000000001,"15min":2.5249999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.872,"15min":0.94099999999999995},"min":{"1min":0.68000000000000005,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0660000000000001,"5min":1.252,"15min":5.4160000000000004},"last":1.0029999999999999}]},{"osd":3,"last update":"Mon Jul 26 16:11:12 2021","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":0.90100000000000002,"15min":0.92300000000000004},"min":{"1min":0.69199999999999995,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":3.274,"5min":3.274,"15min":3.274},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.93700000000000006,"15min":0.98099999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":4.9509999999999996},"last":0.80600000000000005}]},{"osd":4,"last update":"Mon Jul 26 16:11:40 2021","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.171,"15min":1.173},"min":{"1min":0.79700000000000004,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.6309999999999998,"5min":3.6309999999999998,"15min":4.9119999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.2609999999999999,"15min":1.234},"min":{"1min":0.65800000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.4770000000000001,"5min":7.2080000000000002,"15min":7.2080000000000002},"last":1.032}]},{"osd":5,"last update":"Mon Jul 26 16:11:40 2021","interfaces":[{"interface":"back","average":{"1min":1.3180000000000001,"5min":1.2050000000000001,"15min":1.1919999999999999},"min":{"1min":0.71999999999999997,"5min":0.65100000000000002,"15min":0.60299999999999998},"max":{"1min":3.3170000000000002,"5min":3.3170000000000002,"15min":3.3170000000000002},"last":0.97499999999999998},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.234,"15min":1.2709999999999999},"min":{"1min":0.73699999999999999,"5min":0.71799999999999997,"15min":0.56200000000000006},"max":{"1min":1.4530000000000001,"5min":2.1669999999999998,"15min":4.3730000000000002},"last":1.1319999999999999}]},{"osd":6,"last update":"Mon Jul 26 16:11:12 2021","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.2809999999999999,"15min":1.3620000000000001},"min":{"1min":0.995,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.6990000000000001,"5min":2.2440000000000002,"15min":4.4260000000000002},"last":1.264},{"interface":"front","average":{"1min":1.45,"5min":1.294,"15min":1.302},"min":{"1min":0.76600000000000001,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":3.702,"5min":3.702,"15min":3.702},"last":1.1040000000000001}]},{"osd":7,"last update":"Mon Jul 26 16:11:40 2021","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3939999999999999,"15min":1.353},"min":{"1min":0.89200000000000002,"5min":0.66200000000000003,"15min":0.63900000000000001},"max":{"1min":1.5920000000000001,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.208},{"interface":"front","average":{"1min":1.254,"5min":1.353,"15min":1.4019999999999999},"min":{"1min":0.83699999999999997,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.5920000000000001,"5min":4.8090000000000002,"15min":4.9820000000000002},"last":1.2390000000000001}]}]},{"osd":0,"up_from":219,"seq":940597837974,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":571836,"kb_used_data":147572,"kb_used_omap":27,"kb_used_meta":424228,"kb_avail":93173316,"statfs":{"total":95995035648,"available":95409475584,"internally_reserved":0,"allocated":151113728,"data_stored":342269010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":28524,"internal_metadata":434409620},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jul 26 16:11:17 2021","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.86399999999999999,"15min":0.83999999999999997},"min":{"1min":0.437,"5min":0.437,"15min":0.29199999999999998},"max":{"1min":2.5960000000000001,"5min":2.5960000000000001,"15min":2.5960000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.997,"5min":0.91500000000000004,"15min":0.92100000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39000000000000001},"max":{"1min":2.5409999999999999,"5min":2.5409999999999999,"15min":2.5409999999999999},"last":1}]},{"osd":2,"last update":"Mon Jul 26 16:11:44 2021","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.91700000000000004,"15min":0.874},"min":{"1min":0.59599999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.4550000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.95599999999999996,"15min":0.97199999999999998},"min":{"1min":0.624,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.363,"5min":1.363,"15min":1.5780000000000001},"last":0.94099999999999995}]},{"osd":3,"last update":"Mon Jul 26 16:11:17 2021","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":0.92900000000000005,"15min":0.875},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":8.1400000000000006,"5min":8.1400000000000006,"15min":8.1400000000000006},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.91200000000000003,"15min":0.90100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.35699999999999998},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.871}]},{"osd":4,"last update":"Mon Jul 26 16:11:44 2021","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.107,"15min":1.048},"min":{"1min":0.77500000000000002,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.474,"5min":6.1669999999999998,"15min":6.1669999999999998},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.228,"15min":1.228},"min":{"1min":0.93500000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.585,"5min":2.2829999999999999,"15min":2.2829999999999999},"last":1.044}]},{"osd":5,"last update":"Mon Jul 26 16:10:59 2021","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.165,"15min":1.137},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.268,"15min":1.2070000000000001},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.48499999999999999},"max":{"1min":2.5089999999999999,"5min":4.3559999999999999,"15min":4.3559999999999999},"last":1.1319999999999999}]},{"osd":6,"last update":"Mon Jul 26 16:11:17 2021","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.2470000000000001,"15min":1.246},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.78,"5min":2.081,"15min":2.081},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.27,"15min":1.2589999999999999},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.51100000000000001},"max":{"1min":1.625,"5min":2.165,"15min":2.165},"last":1.0740000000000001}]},{"osd":7,"last update":"Mon Jul 26 16:11:44 2021","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.345,"15min":1.323},"min":{"1min":1.0289999999999999,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.6559999999999999,"5min":2.8969999999999998,"15min":2.8969999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.377,"5min":1.359,"15min":1.3360000000000001},"min":{"1min":1.05,"5min":0.66800000000000004,"15min":0.45600000000000002},"max":{"1min":1.722,"5min":2.4209999999999998,"15min":2.4209999999999998},"last":1.1739999999999999}]}]},{"osd":2,"up_from":265,"seq":1138166333578,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":373460,"kb_used_data":143244,"kb_used_omap":32,"kb_used_meta":230175,"kb_avail":93371692,"statfs":{"total":95995035648,"available":95612612608,"internally_reserved":0,"allocated":146681856,"data_stored":314804786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":33155,"internal_metadata":235699837},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 16:11:46 2021","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.77900000000000003,"15min":0.753},"min":{"1min":0.57099999999999995,"5min":0.45400000000000001,"15min":0.26000000000000001},"max":{"1min":0.878,"5min":1.78,"15min":1.78},"last":0.878},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.89100000000000001,"15min":0.84299999999999997},"min":{"1min":0.60599999999999998,"5min":0.372,"15min":0.372},"max":{"1min":1.198,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.82799999999999996}]},{"osd":1,"last update":"Mon Jul 26 16:11:46 2021","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.86699999999999999,"15min":0.86899999999999999},"min":{"1min":0.56999999999999995,"5min":0.46999999999999997,"15min":0.376},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.613},"last":1.103},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.873,"15min":0.90500000000000003},"min":{"1min":0.628,"5min":0.54000000000000004,"15min":0.42499999999999999},"max":{"1min":1.2629999999999999,"5min":1.3779999999999999,"15min":2.4620000000000002},"last":1.2090000000000001}]},{"osd":3,"last update":"Mon Jul 26 16:11:13 2021","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.997,"15min":1.01},"min":{"1min":0.64700000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.1120000000000001,"5min":2.9670000000000001,"15min":5.7569999999999997},"last":1.024},{"interface":"front","average":{"1min":1.054,"5min":1.0609999999999999,"15min":0.98999999999999999},"min":{"1min":0.70999999999999996,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.4550000000000001,"5min":10.932,"15min":10.932},"last":1.0620000000000001}]},{"osd":4,"last update":"Mon Jul 26 16:11:38 2021","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":1.1080000000000001,"15min":1.097},"min":{"1min":0.77500000000000002,"5min":0.65200000000000002,"15min":0.47399999999999998},"max":{"1min":1.3859999999999999,"5min":1.5049999999999999,"15min":1.5129999999999999},"last":1.181},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1910000000000001,"15min":1.2},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":1.482,"5min":2.3149999999999999,"15min":3.5870000000000002},"last":1.2549999999999999}]},{"osd":5,"last update":"Mon Jul 26 16:11:46 2021","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":1.222,"15min":1.232},"min":{"1min":0.86899999999999999,"5min":0.79900000000000004,"15min":0.39900000000000002},"max":{"1min":1.637,"5min":2.0059999999999998,"15min":3.2589999999999999},"last":1.637},{"interface":"front","average":{"1min":1.214,"5min":1.2569999999999999,"15min":1.252},"min":{"1min":0.90200000000000002,"5min":0.70299999999999996,"15min":0.52400000000000002},"max":{"1min":1.504,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.4670000000000001}]},{"osd":6,"last update":"Mon Jul 26 16:11:13 2021","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.3400000000000001,"15min":1.2989999999999999},"min":{"1min":0.91800000000000004,"5min":0.79000000000000004,"15min":0.76300000000000001},"max":{"1min":1.9119999999999999,"5min":2.242,"15min":2.242},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.319,"5min":1.294,"15min":1.2809999999999999},"min":{"1min":1.0129999999999999,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.679,"5min":1.7290000000000001,"15min":1.7290000000000001},"last":1.3520000000000001}]},{"osd":7,"last update":"Mon Jul 26 16:11:38 2021","interfaces":[{"interface":"back","average":{"1min":1.411,"5min":1.399,"15min":1.369},"min":{"1min":1.073,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.7669999999999999,"5min":2.5049999999999999,"15min":2.5049999999999999},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3500000000000001,"15min":1.3220000000000001},"min":{"1min":0.93899999999999995,"5min":0.81799999999999995,"15min":0.52900000000000003},"max":{"1min":1.5469999999999999,"5min":2.7919999999999998,"15min":2.7919999999999998},"last":1.5169999999999999}]}]},{"osd":3,"up_from":293,"seq":1258425417861,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":856452,"kb_used_data":253820,"kb_used_omap":80,"kb_used_meta":602543,"kb_avail":92888700,"statfs":{"total":95995035648,"available":95118028800,"internally_reserved":0,"allocated":259911680,"data_stored":614418000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":82177,"internal_metadata":617004799},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 16:11:10 2021","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.73399999999999999,"15min":0.78500000000000003},"min":{"1min":0.54600000000000004,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.292,"5min":1.292,"15min":2.0960000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.79900000000000004,"15min":0.81799999999999995},"min":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.113,"5min":1.784,"15min":1.9890000000000001},"last":0.68799999999999994}]},{"osd":1,"last update":"Mon Jul 26 16:11:10 2021","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.79700000000000004,"15min":0.81100000000000005},"min":{"1min":0.53000000000000003,"5min":0.434,"15min":0.434},"max":{"1min":1.113,"5min":1.21,"15min":2.2320000000000002},"last":0.98599999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.92600000000000005,"15min":0.95099999999999996},"min":{"1min":0.63400000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.3759999999999999,"5min":1.48,"15min":2.3500000000000001},"last":0.93700000000000006}]},{"osd":2,"last update":"Mon Jul 26 16:11:10 2021","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.89900000000000002,"15min":0.91000000000000003},"min":{"1min":0.55100000000000005,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.3080000000000001,"5min":1.387,"15min":2.0299999999999998},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.96699999999999997,"15min":1.002},"min":{"1min":0.64000000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.4279999999999999,"5min":1.504,"15min":2.21},"last":1.0760000000000001}]},{"osd":4,"last update":"Mon Jul 26 16:11:47 2021","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.097,"15min":1.1000000000000001},"min":{"1min":0.75900000000000001,"5min":0.626,"15min":0.56000000000000005},"max":{"1min":1.4330000000000001,"5min":1.7609999999999999,"15min":1.8320000000000001},"last":1.137},{"interface":"front","average":{"1min":1.125,"5min":1.135,"15min":1.143},"min":{"1min":0.85299999999999998,"5min":0.64600000000000002,"15min":0.60199999999999998},"max":{"1min":1.365,"5min":1.8200000000000001,"15min":1.8200000000000001},"last":1.347}]},{"osd":5,"last update":"Mon Jul 26 16:11:51 2021","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.1819999999999999,"15min":1.2070000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.57799999999999996},"max":{"1min":1.698,"5min":1.873,"15min":1.873},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.276,"15min":1.248},"min":{"1min":0.79900000000000004,"5min":0.77100000000000002,"15min":0.71999999999999997},"max":{"1min":1.76,"5min":1.9390000000000001,"15min":1.9390000000000001},"last":1.5509999999999999}]},{"osd":6,"last update":"Mon Jul 26 16:11:15 2021","interfaces":[{"interface":"back","average":{"1min":1.321,"5min":1.2649999999999999,"15min":1.272},"min":{"1min":0.90100000000000002,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.76,"5min":1.931,"15min":2.0190000000000001},"last":1.262},{"interface":"front","average":{"1min":1.403,"5min":1.3680000000000001,"15min":1.4039999999999999},"min":{"1min":1.0900000000000001,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.7989999999999999,"5min":2.024,"15min":2.1160000000000001},"last":1.514}]},{"osd":7,"last update":"Mon Jul 26 16:11:47 2021","interfaces":[{"interface":"back","average":{"1min":1.3400000000000001,"5min":1.284,"15min":1.3120000000000001},"min":{"1min":1.0329999999999999,"5min":0.748,"15min":0.66700000000000004},"max":{"1min":1.792,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":1.72},{"interface":"front","average":{"1min":1.319,"5min":1.3300000000000001,"15min":1.3540000000000001},"min":{"1min":1.0309999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.669,"5min":1.929,"15min":2.077},"last":1.6479999999999999}]}]},{"osd":4,"up_from":311,"seq":1335734829183,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":584456,"kb_used_data":163648,"kb_used_omap":50,"kb_used_meta":420749,"kb_avail":93160696,"statfs":{"total":95995035648,"available":95396552704,"internally_reserved":0,"allocated":167575552,"data_stored":344967454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51326,"internal_metadata":430847874},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 16:11:36 2021","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.85799999999999998,"15min":0.92900000000000005},"min":{"1min":0.54600000000000004,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.0980000000000001,"5min":2.4239999999999999,"15min":4.9370000000000003},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.98099999999999998,"5min":0.98999999999999999,"15min":0.92800000000000005},"min":{"1min":0.49399999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.2,"5min":2.3719999999999999,"15min":2.3719999999999999},"last":1.0429999999999999}]},{"osd":1,"last update":"Mon Jul 26 16:11:36 2021","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.99199999999999999,"15min":0.97599999999999998},"min":{"1min":0.58199999999999996,"5min":0.50800000000000001,"15min":0.371},"max":{"1min":1.3999999999999999,"5min":2.4700000000000002,"15min":2.4700000000000002},"last":1.256},{"interface":"front","average":{"1min":0.93100000000000005,"5min":1.0149999999999999,"15min":1.04},"min":{"1min":0.67600000000000005,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.198,"5min":11.071,"15min":11.071},"last":1.1040000000000001}]},{"osd":2,"last update":"Mon Jul 26 16:11:36 2021","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.034,"15min":1.018},"min":{"1min":0.72199999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.385,"5min":1.603,"15min":1.603},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.109,"5min":1.0429999999999999,"15min":1.089},"min":{"1min":0.95499999999999996,"5min":0.495,"15min":0.48299999999999998},"max":{"1min":1.4139999999999999,"5min":1.665,"15min":3.944},"last":1.149}]},{"osd":3,"last update":"Mon Jul 26 16:11:36 2021","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.03,"15min":1.0209999999999999},"min":{"1min":0.68700000000000006,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.194,"5min":2.194,"15min":2.194},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.075,"5min":1.1120000000000001,"15min":1.083},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.466,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1830000000000001}]},{"osd":5,"last update":"Mon Jul 26 16:10:51 2021","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.03,"15min":0.98599999999999999},"min":{"1min":0.627,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.5529999999999999,"5min":1.8560000000000001,"15min":1.8560000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.194,"15min":1.099},"min":{"1min":0.79700000000000004,"5min":0.72599999999999998,"15min":0.47099999999999997},"max":{"1min":1.4910000000000001,"5min":4.7229999999999999,"15min":4.7229999999999999},"last":0.90600000000000003}]},{"osd":6,"last update":"Mon Jul 26 16:11:12 2021","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.24,"15min":1.1890000000000001},"min":{"1min":0.85299999999999998,"5min":0.77300000000000002,"15min":0.51100000000000001},"max":{"1min":1.5469999999999999,"5min":2.6949999999999998,"15min":2.6949999999999998},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1539999999999999,"15min":1.1699999999999999},"min":{"1min":1.018,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4390000000000001,"5min":1.609,"15min":1.609},"last":1.2270000000000001}]},{"osd":7,"last update":"Mon Jul 26 16:11:41 2021","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.228,"15min":1.1870000000000001},"min":{"1min":0.80500000000000005,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.456,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":1.131},{"interface":"front","average":{"1min":1.274,"5min":1.3109999999999999,"15min":1.2669999999999999},"min":{"1min":1.0740000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.508,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.202}]}]},{"osd":5,"up_from":319,"seq":1370094567549,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":412268,"kb_used_data":147620,"kb_used_omap":41,"kb_used_meta":264598,"kb_avail":93332884,"statfs":{"total":95995035648,"available":95572873216,"internally_reserved":0,"allocated":151162880,"data_stored":357587506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42343,"internal_metadata":270949017},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jul 26 16:10:50 2021","interfaces":[{"interface":"back","average":{"1min":0.97699999999999998,"5min":0.89200000000000002,"15min":0.90900000000000003},"min":{"1min":0.59699999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.2729999999999999,"5min":1.5429999999999999,"15min":9.1029999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.92000000000000004,"15min":0.88300000000000001},"min":{"1min":0.63900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.161,"5min":1.946,"15min":1.946},"last":0.71399999999999997}]},{"osd":1,"last update":"Mon Jul 26 16:10:50 2021","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.91600000000000004,"15min":0.89500000000000002},"min":{"1min":0.70899999999999996,"5min":0.50600000000000001,"15min":0.42499999999999999},"max":{"1min":1.1779999999999999,"5min":1.23,"15min":1.3420000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.071,"5min":0.98799999999999999,"15min":0.95399999999999996},"min":{"1min":0.73199999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.569,"5min":1.569,"15min":1.569},"last":0.89300000000000002}]},{"osd":2,"last update":"Mon Jul 26 16:10:50 2021","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":0.996,"15min":0.95399999999999996},"min":{"1min":0.72099999999999997,"5min":0.45100000000000001,"15min":0.41299999999999998},"max":{"1min":1.331,"5min":1.4810000000000001,"15min":1.5149999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0149999999999999,"5min":0.96899999999999997,"15min":0.93000000000000005},"min":{"1min":0.73299999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.335,"5min":1.726,"15min":1.726},"last":1.198}]},{"osd":3,"last update":"Mon Jul 26 16:10:50 2021","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0169999999999999,"15min":0.98199999999999998},"min":{"1min":0.79100000000000004,"5min":0.47999999999999998,"15min":0.45900000000000002},"max":{"1min":1.244,"5min":6.4420000000000002,"15min":6.4420000000000002},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.103,"15min":1.04},"min":{"1min":0.76700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Mon Jul 26 16:10:50 2021","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.0309999999999999,"15min":1.0129999999999999},"min":{"1min":0.64500000000000002,"5min":0.50600000000000001,"15min":0.35399999999999998},"max":{"1min":1.5329999999999999,"5min":1.756,"15min":1.756},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.042,"15min":1.0409999999999999},"min":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.44},"max":{"1min":1.4410000000000001,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":1.0680000000000001}]},{"osd":6,"last update":"Mon Jul 26 16:11:18 2021","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.1279999999999999,"15min":1.103},"min":{"1min":0.78700000000000003,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.333,"5min":1.5660000000000001,"15min":1.6479999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0720000000000001,"15min":1.0449999999999999},"min":{"1min":0.624,"5min":0.57299999999999995,"15min":0.499},"max":{"1min":1.345,"5min":1.591,"15min":2.3300000000000001},"last":1.3300000000000001}]},{"osd":7,"last update":"Mon Jul 26 16:10:47 2021","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.214,"15min":1.1759999999999999},"min":{"1min":0.91000000000000003,"5min":0.66000000000000003,"15min":0.46999999999999997},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":1.032},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1579999999999999,"15min":1.121},"min":{"1min":0.75,"5min":0.70299999999999996,"15min":0.61499999999999999},"max":{"1min":1.448,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.167}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":143396864,"data_stored":337268736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":167989248,"data_stored":372977664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":139558912,"data_stored":310394880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":252776448,"data_stored":610000896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":160456704,"data_stored":340557824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":144039936,"data_stored":353177600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":191975424,"data_stored":403755008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":122720256,"data_stored":314855424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-07-26T16:11:55.753 INFO:tasks.cephadm.ceph_manager.ceph:removing pool_name unique_pool_0 2021-07-26T16:11:55.753 DEBUG:teuthology.orchestra.run.smithi033:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/daemon-base:latest-pacific shell --fsid 7e62724e-ee28-11eb-8c23-001a4aab830c -- ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2021-07-26T16:11:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:56 smithi033 bash[41341]: audit 2021-07-26T16:11:54.997508+0000 mgr.y (mgr.34104) 539 : audit [DBG] from='client.44332 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-07-26T16:11:56.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:56 smithi033 bash[41341]: cluster 2021-07-26T16:11:55.244938+0000 mgr.y (mgr.34104) 540 : cluster [DBG] pgmap v1119: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:11:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:56 smithi033 bash[42377]: audit 2021-07-26T16:11:54.997508+0000 mgr.y (mgr.34104) 539 : audit [DBG] from='client.44332 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-07-26T16:11:56.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:56 smithi033 bash[42377]: cluster 2021-07-26T16:11:55.244938+0000 mgr.y (mgr.34104) 540 : cluster [DBG] pgmap v1119: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:11:56.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:56 smithi096 bash[33981]: audit 2021-07-26T16:11:54.997508+0000 mgr.y (mgr.34104) 539 : audit [DBG] from='client.44332 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-07-26T16:11:56.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:56 smithi096 bash[33981]: cluster 2021-07-26T16:11:55.244938+0000 mgr.y (mgr.34104) 540 : cluster [DBG] pgmap v1119: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:11:58.523 INFO:teuthology.orchestra.run.smithi033.stderr:Inferring config /var/lib/ceph/7e62724e-ee28-11eb-8c23-001a4aab830c/mon.a/config 2021-07-26T16:11:58.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:11:58 smithi033 bash[41341]: cluster 2021-07-26T16:11:57.245707+0000 mgr.y (mgr.34104) 541 : cluster [DBG] pgmap v1120: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:11:58.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:11:58 smithi033 bash[42377]: cluster 2021-07-26T16:11:57.245707+0000 mgr.y (mgr.34104) 541 : cluster [DBG] pgmap v1120: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:11:58.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:11:58 smithi096 bash[33981]: cluster 2021-07-26T16:11:57.245707+0000 mgr.y (mgr.34104) 541 : cluster [DBG] pgmap v1120: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:12:00.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:00 smithi033 bash[41341]: cluster 2021-07-26T16:11:59.246407+0000 mgr.y (mgr.34104) 542 : cluster [DBG] pgmap v1121: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:12:00.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:00 smithi033 bash[42377]: cluster 2021-07-26T16:11:59.246407+0000 mgr.y (mgr.34104) 542 : cluster [DBG] pgmap v1121: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:12:00.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:00 smithi096 bash[33981]: cluster 2021-07-26T16:11:59.246407+0000 mgr.y (mgr.34104) 542 : cluster [DBG] pgmap v1121: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:12:02.378 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'unique_pool_0' removed 2021-07-26T16:12:02.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:02 smithi033 bash[42377]: cluster 2021-07-26T16:12:01.247151+0000 mgr.y (mgr.34104) 543 : cluster [DBG] pgmap v1122: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:12:02.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:02 smithi033 bash[42377]: audit 2021-07-26T16:12:02.232745+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? 172.21.15.33:0/1856597839' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2021-07-26T16:12:02.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:02 smithi033 bash[41341]: cluster 2021-07-26T16:12:01.247151+0000 mgr.y (mgr.34104) 543 : cluster [DBG] pgmap v1122: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:12:02.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:02 smithi033 bash[41341]: audit 2021-07-26T16:12:02.232745+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? 172.21.15.33:0/1856597839' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2021-07-26T16:12:02.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:02 smithi096 bash[33981]: cluster 2021-07-26T16:12:01.247151+0000 mgr.y (mgr.34104) 543 : cluster [DBG] pgmap v1122: 25 pgs: 25 active+clean; 1.0 GiB data, 4.1 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:12:02.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:02 smithi096 bash[33981]: audit 2021-07-26T16:12:02.232745+0000 mon.a (mon.0) 1234 : audit [INF] from='client.? 172.21.15.33:0/1856597839' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]: dispatch 2021-07-26T16:12:03.229 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2021-07-26T16:12:03.230 INFO:teuthology.task.print:**** done end ec-rados-default.yaml 2021-07-26T16:12:03.230 INFO:teuthology.task.full_sequential:In full_sequential, running task print... 2021-07-26T16:12:03.230 INFO:teuthology.task.print:**** done start rados_api.yaml 2021-07-26T16:12:03.230 INFO:teuthology.task.full_sequential:In full_sequential, running task workunit... 2021-07-26T16:12:03.236 INFO:tasks.workunit:Pulling workunits from ref pacific 2021-07-26T16:12:03.238 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-07-26T16:12:03.239 DEBUG:teuthology.orchestra.run.smithi033:> stat -- /home/ubuntu/cephtest/mnt.0 2021-07-26T16:12:03.245 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T16:12:03.245 INFO:teuthology.orchestra.run.smithi033.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-07-26T16:12:03.246 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -- /home/ubuntu/cephtest/mnt.0 2021-07-26T16:12:03.295 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2021-07-26T16:12:03.295 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2021-07-26T16:12:03.301 INFO:tasks.workunit:timeout=3h 2021-07-26T16:12:03.301 INFO:tasks.workunit:cleanup=True 2021-07-26T16:12:03.302 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch pacific git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 2021-07-26T16:12:03.310 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-07-26T16:12:03.334 INFO:tasks.workunit.client.0.smithi033.stderr:warning: Could not find remote branch pacific to clone. 2021-07-26T16:12:03.334 INFO:tasks.workunit.client.0.smithi033.stderr:fatal: Remote branch pacific not found in upstream origin 2021-07-26T16:12:03.335 DEBUG:teuthology.orchestra.run:got remote process result: 128 2021-07-26T16:12:03.336 INFO:tasks.workunit:failed to check out 'pacific' from git://git.ceph.com/ceph-ci.git; will also try in git://git.ceph.com/ceph.git 2021-07-26T16:12:03.336 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone --depth 1 --branch pacific git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 2021-07-26T16:12:03.384 INFO:tasks.workunit.client.0.smithi033.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-07-26T16:12:03.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:03 smithi033 bash[41341]: audit 2021-07-26T16:12:02.356352+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? 172.21.15.33:0/1856597839' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2021-07-26T16:12:03.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:03 smithi033 bash[41341]: cluster 2021-07-26T16:12:02.356512+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e850: 8 total, 8 up, 8 in 2021-07-26T16:12:03.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:03 smithi033 bash[42377]: audit 2021-07-26T16:12:02.356352+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? 172.21.15.33:0/1856597839' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2021-07-26T16:12:03.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:03 smithi033 bash[42377]: cluster 2021-07-26T16:12:02.356512+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e850: 8 total, 8 up, 8 in 2021-07-26T16:12:03.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:03 smithi096 bash[33981]: audit 2021-07-26T16:12:02.356352+0000 mon.a (mon.0) 1235 : audit [INF] from='client.? 172.21.15.33:0/1856597839' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "unique_pool_0", "pool2": "unique_pool_0", "yes_i_really_really_mean_it": true}]': finished 2021-07-26T16:12:03.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:03 smithi096 bash[33981]: cluster 2021-07-26T16:12:02.356512+0000 mon.a (mon.0) 1236 : cluster [DBG] osdmap e850: 8 total, 8 up, 8 in 2021-07-26T16:12:04.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:04 smithi033 bash[41341]: cluster 2021-07-26T16:12:03.247739+0000 mgr.y (mgr.34104) 544 : cluster [DBG] pgmap v1124: 9 pgs: 9 active+clean; 577 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:12:04.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:04 smithi033 bash[42377]: cluster 2021-07-26T16:12:03.247739+0000 mgr.y (mgr.34104) 544 : cluster [DBG] pgmap v1124: 9 pgs: 9 active+clean; 577 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:12:04.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:04 smithi096 bash[33981]: cluster 2021-07-26T16:12:03.247739+0000 mgr.y (mgr.34104) 544 : cluster [DBG] pgmap v1124: 9 pgs: 9 active+clean; 577 KiB data, 3.9 GiB used, 711 GiB / 715 GiB avail 2021-07-26T16:12:06.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:06 smithi033 bash[41341]: cluster 2021-07-26T16:12:05.248423+0000 mgr.y (mgr.34104) 545 : cluster [DBG] pgmap v1125: 9 pgs: 9 active+clean; 577 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:06.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:06 smithi033 bash[42377]: cluster 2021-07-26T16:12:05.248423+0000 mgr.y (mgr.34104) 545 : cluster [DBG] pgmap v1125: 9 pgs: 9 active+clean; 577 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:06 smithi096 bash[33981]: cluster 2021-07-26T16:12:05.248423+0000 mgr.y (mgr.34104) 545 : cluster [DBG] pgmap v1125: 9 pgs: 9 active+clean; 577 KiB data, 3.6 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:08.454 DEBUG:teuthology.orchestra.run.smithi033:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-07-26T16:12:08.473 INFO:tasks.workunit.client.0.smithi033.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-07-26T16:12:08.476 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-07-26T16:12:08.476 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-07-26T16:12:08.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:08 smithi033 bash[41341]: cluster 2021-07-26T16:12:07.248943+0000 mgr.y (mgr.34104) 546 : cluster [DBG] pgmap v1126: 9 pgs: 9 active+clean; 577 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:08.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:08 smithi033 bash[42377]: cluster 2021-07-26T16:12:07.248943+0000 mgr.y (mgr.34104) 546 : cluster [DBG] pgmap v1126: 9 pgs: 9 active+clean; 577 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:08.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:08 smithi096 bash[33981]: cluster 2021-07-26T16:12:07.248943+0000 mgr.y (mgr.34104) 546 : cluster [DBG] pgmap v1126: 9 pgs: 9 active+clean; 577 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:09.372 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-07-26T16:12:09.464 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-07-26T16:12:09.528 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-07-26T16:12:09.530 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-07-26T16:12:09.530 INFO:tasks.workunit.client.0.smithi033.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-07-26T16:12:09.591 INFO:tasks.workunit.client.0.smithi033.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-07-26T16:12:09.597 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2021-07-26T16:12:09.597 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2021-07-26T16:12:09.604 INFO:tasks.workunit:Running workunits matching cls on client.0... 2021-07-26T16:12:09.605 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2021-07-26T16:12:09.605 DEBUG:teuthology.orchestra.run.smithi033:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=pacific TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2021-07-26T16:12:09.671 INFO:tasks.workunit.client.0.smithi033.stdout:Running main() from gmock_main.cc 2021-07-26T16:12:09.671 INFO:tasks.workunit.client.0.smithi033.stdout:[==========] Running 22 tests from 1 test suite. 2021-07-26T16:12:09.671 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] Global test environment set-up. 2021-07-26T16:12:09.671 INFO:tasks.workunit.client.0.smithi033.stdout:[----------] 22 tests from TestCls2PCQueue 2021-07-26T16:12:09.672 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2021-07-26T16:12:09.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:09 smithi033 bash[41341]: audit 2021-07-26T16:12:09.269734+0000 mon.c (mon.1) 282 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:12:09.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:09 smithi033 bash[41341]: audit 2021-07-26T16:12:09.270517+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:12:09.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:09 smithi033 bash[41341]: audit 2021-07-26T16:12:09.294603+0000 mon.c (mon.1) 283 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:12:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:09 smithi033 bash[41341]: audit 2021-07-26T16:12:09.295394+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:12:09.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:09 smithi033 bash[42377]: audit 2021-07-26T16:12:09.269734+0000 mon.c (mon.1) 282 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:12:09.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:09 smithi033 bash[42377]: audit 2021-07-26T16:12:09.270517+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:12:09.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:09 smithi033 bash[42377]: audit 2021-07-26T16:12:09.294603+0000 mon.c (mon.1) 283 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:12:09.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:09 smithi033 bash[42377]: audit 2021-07-26T16:12:09.295394+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:12:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:09 smithi096 bash[33981]: audit 2021-07-26T16:12:09.269734+0000 mon.c (mon.1) 282 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:12:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:09 smithi096 bash[33981]: audit 2021-07-26T16:12:09.270517+0000 mon.a (mon.0) 1237 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:12:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:09 smithi096 bash[33981]: audit 2021-07-26T16:12:09.294603+0000 mon.c (mon.1) 283 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:12:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:09 smithi096 bash[33981]: audit 2021-07-26T16:12:09.295394+0000 mon.a (mon.0) 1238 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:12:10.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:10 smithi033 bash[41341]: cluster 2021-07-26T16:12:09.249599+0000 mgr.y (mgr.34104) 547 : cluster [DBG] pgmap v1127: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:10.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:10 smithi033 bash[42377]: cluster 2021-07-26T16:12:09.249599+0000 mgr.y (mgr.34104) 547 : cluster [DBG] pgmap v1127: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:10.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:10 smithi096 bash[33981]: cluster 2021-07-26T16:12:09.249599+0000 mgr.y (mgr.34104) 547 : cluster [DBG] pgmap v1127: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:11.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:11 smithi033 bash[41341]: cluster 2021-07-26T16:12:10.395544+0000 mon.a (mon.0) 1239 : cluster [DBG] osdmap e851: 8 total, 8 up, 8 in 2021-07-26T16:12:11.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:11 smithi033 bash[41341]: audit 2021-07-26T16:12:10.397234+0000 mon.c (mon.1) 284 : audit [INF] from='client.? 172.21.15.33:0/895348738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:11.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:11 smithi033 bash[41341]: audit 2021-07-26T16:12:10.398733+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:11.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:11 smithi033 bash[42377]: cluster 2021-07-26T16:12:10.395544+0000 mon.a (mon.0) 1239 : cluster [DBG] osdmap e851: 8 total, 8 up, 8 in 2021-07-26T16:12:11.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:11 smithi033 bash[42377]: audit 2021-07-26T16:12:10.397234+0000 mon.c (mon.1) 284 : audit [INF] from='client.? 172.21.15.33:0/895348738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:11.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:11 smithi033 bash[42377]: audit 2021-07-26T16:12:10.398733+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:11.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:11 smithi096 bash[33981]: cluster 2021-07-26T16:12:10.395544+0000 mon.a (mon.0) 1239 : cluster [DBG] osdmap e851: 8 total, 8 up, 8 in 2021-07-26T16:12:11.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:11 smithi096 bash[33981]: audit 2021-07-26T16:12:10.397234+0000 mon.c (mon.1) 284 : audit [INF] from='client.? 172.21.15.33:0/895348738' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:11.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:11 smithi096 bash[33981]: audit 2021-07-26T16:12:10.398733+0000 mon.a (mon.0) 1240 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-1","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:12.418 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2747 ms) 2021-07-26T16:12:12.418 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2021-07-26T16:12:12.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:12 smithi033 bash[41341]: cluster 2021-07-26T16:12:11.250312+0000 mgr.y (mgr.34104) 548 : cluster [DBG] pgmap v1129: 41 pgs: 9 creating+peering, 23 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:12.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:12 smithi033 bash[41341]: audit 2021-07-26T16:12:11.405458+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:12.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:12 smithi033 bash[41341]: cluster 2021-07-26T16:12:11.405703+0000 mon.a (mon.0) 1242 : cluster [DBG] osdmap e852: 8 total, 8 up, 8 in 2021-07-26T16:12:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:12 smithi033 bash[42377]: cluster 2021-07-26T16:12:11.250312+0000 mgr.y (mgr.34104) 548 : cluster [DBG] pgmap v1129: 41 pgs: 9 creating+peering, 23 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:12 smithi033 bash[42377]: audit 2021-07-26T16:12:11.405458+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:12.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:12 smithi033 bash[42377]: cluster 2021-07-26T16:12:11.405703+0000 mon.a (mon.0) 1242 : cluster [DBG] osdmap e852: 8 total, 8 up, 8 in 2021-07-26T16:12:12.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:12 smithi096 bash[33981]: cluster 2021-07-26T16:12:11.250312+0000 mgr.y (mgr.34104) 548 : cluster [DBG] pgmap v1129: 41 pgs: 9 creating+peering, 23 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:12.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:12 smithi096 bash[33981]: audit 2021-07-26T16:12:11.405458+0000 mon.a (mon.0) 1241 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-1","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:12.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:12 smithi096 bash[33981]: cluster 2021-07-26T16:12:11.405703+0000 mon.a (mon.0) 1242 : cluster [DBG] osdmap e852: 8 total, 8 up, 8 in 2021-07-26T16:12:13.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:13 smithi033 bash[42377]: cluster 2021-07-26T16:12:12.411424+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e853: 8 total, 8 up, 8 in 2021-07-26T16:12:13.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:13 smithi033 bash[41341]: cluster 2021-07-26T16:12:12.411424+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e853: 8 total, 8 up, 8 in 2021-07-26T16:12:13.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:13 smithi096 bash[33981]: cluster 2021-07-26T16:12:12.411424+0000 mon.a (mon.0) 1243 : cluster [DBG] osdmap e853: 8 total, 8 up, 8 in 2021-07-26T16:12:14.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:14 smithi033 bash[41341]: cluster 2021-07-26T16:12:13.250926+0000 mgr.y (mgr.34104) 549 : cluster [DBG] pgmap v1132: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:14.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:14 smithi033 bash[41341]: cluster 2021-07-26T16:12:13.431829+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e854: 8 total, 8 up, 8 in 2021-07-26T16:12:14.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:14 smithi033 bash[41341]: audit 2021-07-26T16:12:13.434196+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.33:0/4215017951' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:14 smithi033 bash[42377]: cluster 2021-07-26T16:12:13.250926+0000 mgr.y (mgr.34104) 549 : cluster [DBG] pgmap v1132: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:14.709 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:14 smithi033 bash[42377]: cluster 2021-07-26T16:12:13.431829+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e854: 8 total, 8 up, 8 in 2021-07-26T16:12:14.710 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:14 smithi033 bash[42377]: audit 2021-07-26T16:12:13.434196+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.33:0/4215017951' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:14.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:14 smithi096 bash[33981]: cluster 2021-07-26T16:12:13.250926+0000 mgr.y (mgr.34104) 549 : cluster [DBG] pgmap v1132: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:14.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:14 smithi096 bash[33981]: cluster 2021-07-26T16:12:13.431829+0000 mon.a (mon.0) 1244 : cluster [DBG] osdmap e854: 8 total, 8 up, 8 in 2021-07-26T16:12:14.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:14 smithi096 bash[33981]: audit 2021-07-26T16:12:13.434196+0000 mon.a (mon.0) 1245 : audit [INF] from='client.? 172.21.15.33:0/4215017951' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-2","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:15.472 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3043 ms) 2021-07-26T16:12:15.473 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.Reserve 2021-07-26T16:12:15.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:15 smithi033 bash[42377]: audit 2021-07-26T16:12:14.441970+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? 172.21.15.33:0/4215017951' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:15.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:15 smithi033 bash[42377]: cluster 2021-07-26T16:12:14.442543+0000 mon.a (mon.0) 1247 : cluster [DBG] osdmap e855: 8 total, 8 up, 8 in 2021-07-26T16:12:15.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:15 smithi033 bash[41341]: audit 2021-07-26T16:12:14.441970+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? 172.21.15.33:0/4215017951' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:15.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:15 smithi033 bash[41341]: cluster 2021-07-26T16:12:14.442543+0000 mon.a (mon.0) 1247 : cluster [DBG] osdmap e855: 8 total, 8 up, 8 in 2021-07-26T16:12:15.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:15 smithi096 bash[33981]: audit 2021-07-26T16:12:14.441970+0000 mon.a (mon.0) 1246 : audit [INF] from='client.? 172.21.15.33:0/4215017951' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-2","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:15.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:15 smithi096 bash[33981]: cluster 2021-07-26T16:12:14.442543+0000 mon.a (mon.0) 1247 : cluster [DBG] osdmap e855: 8 total, 8 up, 8 in 2021-07-26T16:12:16.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:16 smithi033 bash[42377]: cluster 2021-07-26T16:12:15.251586+0000 mgr.y (mgr.34104) 550 : cluster [DBG] pgmap v1135: 41 pgs: 10 creating+peering, 18 unknown, 13 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:16.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:16 smithi033 bash[42377]: cluster 2021-07-26T16:12:15.457992+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e856: 8 total, 8 up, 8 in 2021-07-26T16:12:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:16 smithi033 bash[41341]: cluster 2021-07-26T16:12:15.251586+0000 mgr.y (mgr.34104) 550 : cluster [DBG] pgmap v1135: 41 pgs: 10 creating+peering, 18 unknown, 13 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:16.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:16 smithi033 bash[41341]: cluster 2021-07-26T16:12:15.457992+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e856: 8 total, 8 up, 8 in 2021-07-26T16:12:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:16 smithi096 bash[33981]: cluster 2021-07-26T16:12:15.251586+0000 mgr.y (mgr.34104) 550 : cluster [DBG] pgmap v1135: 41 pgs: 10 creating+peering, 18 unknown, 13 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:16.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:16 smithi096 bash[33981]: cluster 2021-07-26T16:12:15.457992+0000 mon.a (mon.0) 1248 : cluster [DBG] osdmap e856: 8 total, 8 up, 8 in 2021-07-26T16:12:17.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:17 smithi096 bash[33981]: cluster 2021-07-26T16:12:16.461432+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e857: 8 total, 8 up, 8 in 2021-07-26T16:12:17.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:17 smithi096 bash[33981]: audit 2021-07-26T16:12:16.467013+0000 mon.c (mon.1) 285 : audit [INF] from='client.? 172.21.15.33:0/2219247938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:17.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:17 smithi096 bash[33981]: audit 2021-07-26T16:12:16.468632+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:17.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:17 smithi033 bash[42377]: cluster 2021-07-26T16:12:16.461432+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e857: 8 total, 8 up, 8 in 2021-07-26T16:12:17.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:17 smithi033 bash[42377]: audit 2021-07-26T16:12:16.467013+0000 mon.c (mon.1) 285 : audit [INF] from='client.? 172.21.15.33:0/2219247938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:17.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:17 smithi033 bash[42377]: audit 2021-07-26T16:12:16.468632+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:17.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:17 smithi033 bash[41341]: cluster 2021-07-26T16:12:16.461432+0000 mon.a (mon.0) 1249 : cluster [DBG] osdmap e857: 8 total, 8 up, 8 in 2021-07-26T16:12:17.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:17 smithi033 bash[41341]: audit 2021-07-26T16:12:16.467013+0000 mon.c (mon.1) 285 : audit [INF] from='client.? 172.21.15.33:0/2219247938' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:17.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:17 smithi033 bash[41341]: audit 2021-07-26T16:12:16.468632+0000 mon.a (mon.0) 1250 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-3","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:18.485 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.Reserve (3017 ms) 2021-07-26T16:12:18.485 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2021-07-26T16:12:18.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:18 smithi096 bash[33981]: cluster 2021-07-26T16:12:17.252311+0000 mgr.y (mgr.34104) 551 : cluster [DBG] pgmap v1138: 41 pgs: 5 creating+peering, 27 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:18.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:18 smithi096 bash[33981]: audit 2021-07-26T16:12:17.470653+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:18.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:18 smithi096 bash[33981]: cluster 2021-07-26T16:12:17.470848+0000 mon.a (mon.0) 1252 : cluster [DBG] osdmap e858: 8 total, 8 up, 8 in 2021-07-26T16:12:18.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:18 smithi033 bash[41341]: cluster 2021-07-26T16:12:17.252311+0000 mgr.y (mgr.34104) 551 : cluster [DBG] pgmap v1138: 41 pgs: 5 creating+peering, 27 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:18.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:18 smithi033 bash[41341]: audit 2021-07-26T16:12:17.470653+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:18.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:18 smithi033 bash[41341]: cluster 2021-07-26T16:12:17.470848+0000 mon.a (mon.0) 1252 : cluster [DBG] osdmap e858: 8 total, 8 up, 8 in 2021-07-26T16:12:18.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:18 smithi033 bash[42377]: cluster 2021-07-26T16:12:17.252311+0000 mgr.y (mgr.34104) 551 : cluster [DBG] pgmap v1138: 41 pgs: 5 creating+peering, 27 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:18.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:18 smithi033 bash[42377]: audit 2021-07-26T16:12:17.470653+0000 mon.a (mon.0) 1251 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-3","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:18.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:18 smithi033 bash[42377]: cluster 2021-07-26T16:12:17.470848+0000 mon.a (mon.0) 1252 : cluster [DBG] osdmap e858: 8 total, 8 up, 8 in 2021-07-26T16:12:19.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:19 smithi033 bash[41341]: cluster 2021-07-26T16:12:18.474220+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e859: 8 total, 8 up, 8 in 2021-07-26T16:12:19.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:19 smithi033 bash[42377]: cluster 2021-07-26T16:12:18.474220+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e859: 8 total, 8 up, 8 in 2021-07-26T16:12:19.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:19 smithi096 bash[33981]: cluster 2021-07-26T16:12:18.474220+0000 mon.a (mon.0) 1253 : cluster [DBG] osdmap e859: 8 total, 8 up, 8 in 2021-07-26T16:12:20.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:20 smithi033 bash[42377]: cluster 2021-07-26T16:12:19.253031+0000 mgr.y (mgr.34104) 552 : cluster [DBG] pgmap v1141: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:20.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:20 smithi033 bash[42377]: cluster 2021-07-26T16:12:19.498759+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e860: 8 total, 8 up, 8 in 2021-07-26T16:12:20.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:20 smithi033 bash[42377]: audit 2021-07-26T16:12:19.503837+0000 mon.c (mon.1) 286 : audit [INF] from='client.? 172.21.15.33:0/2875303729' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:20.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:20 smithi033 bash[42377]: audit 2021-07-26T16:12:19.504741+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:20.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:20 smithi033 bash[41341]: cluster 2021-07-26T16:12:19.253031+0000 mgr.y (mgr.34104) 552 : cluster [DBG] pgmap v1141: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:20.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:20 smithi033 bash[41341]: cluster 2021-07-26T16:12:19.498759+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e860: 8 total, 8 up, 8 in 2021-07-26T16:12:20.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:20 smithi033 bash[41341]: audit 2021-07-26T16:12:19.503837+0000 mon.c (mon.1) 286 : audit [INF] from='client.? 172.21.15.33:0/2875303729' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:20.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:20 smithi033 bash[41341]: audit 2021-07-26T16:12:19.504741+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:20.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:20 smithi096 bash[33981]: cluster 2021-07-26T16:12:19.253031+0000 mgr.y (mgr.34104) 552 : cluster [DBG] pgmap v1141: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:20.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:20 smithi096 bash[33981]: cluster 2021-07-26T16:12:19.498759+0000 mon.a (mon.0) 1254 : cluster [DBG] osdmap e860: 8 total, 8 up, 8 in 2021-07-26T16:12:20.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:20 smithi096 bash[33981]: audit 2021-07-26T16:12:19.503837+0000 mon.c (mon.1) 286 : audit [INF] from='client.? 172.21.15.33:0/2875303729' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:20.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:20 smithi096 bash[33981]: audit 2021-07-26T16:12:19.504741+0000 mon.a (mon.0) 1255 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-4","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:21.524 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3045 ms) 2021-07-26T16:12:21.525 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.Commit 2021-07-26T16:12:21.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:21 smithi033 bash[41341]: audit 2021-07-26T16:12:20.500538+0000 mon.a (mon.0) 1256 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:21.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:21 smithi033 bash[41341]: cluster 2021-07-26T16:12:20.501020+0000 mon.a (mon.0) 1257 : cluster [DBG] osdmap e861: 8 total, 8 up, 8 in 2021-07-26T16:12:21.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:21 smithi033 bash[42377]: audit 2021-07-26T16:12:20.500538+0000 mon.a (mon.0) 1256 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:21.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:21 smithi033 bash[42377]: cluster 2021-07-26T16:12:20.501020+0000 mon.a (mon.0) 1257 : cluster [DBG] osdmap e861: 8 total, 8 up, 8 in 2021-07-26T16:12:21.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:21 smithi096 bash[33981]: audit 2021-07-26T16:12:20.500538+0000 mon.a (mon.0) 1256 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-4","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:21.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:21 smithi096 bash[33981]: cluster 2021-07-26T16:12:20.501020+0000 mon.a (mon.0) 1257 : cluster [DBG] osdmap e861: 8 total, 8 up, 8 in 2021-07-26T16:12:22.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:22 smithi033 bash[41341]: cluster 2021-07-26T16:12:21.253752+0000 mgr.y (mgr.34104) 553 : cluster [DBG] pgmap v1144: 41 pgs: 7 creating+peering, 22 unknown, 12 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:22.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:22 smithi033 bash[41341]: cluster 2021-07-26T16:12:21.519657+0000 mon.a (mon.0) 1258 : cluster [DBG] osdmap e862: 8 total, 8 up, 8 in 2021-07-26T16:12:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:22 smithi033 bash[42377]: cluster 2021-07-26T16:12:21.253752+0000 mgr.y (mgr.34104) 553 : cluster [DBG] pgmap v1144: 41 pgs: 7 creating+peering, 22 unknown, 12 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:22.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:22 smithi033 bash[42377]: cluster 2021-07-26T16:12:21.519657+0000 mon.a (mon.0) 1258 : cluster [DBG] osdmap e862: 8 total, 8 up, 8 in 2021-07-26T16:12:22.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:22 smithi096 bash[33981]: cluster 2021-07-26T16:12:21.253752+0000 mgr.y (mgr.34104) 553 : cluster [DBG] pgmap v1144: 41 pgs: 7 creating+peering, 22 unknown, 12 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:22.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:22 smithi096 bash[33981]: cluster 2021-07-26T16:12:21.519657+0000 mon.a (mon.0) 1258 : cluster [DBG] osdmap e862: 8 total, 8 up, 8 in 2021-07-26T16:12:23.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[42377]: cluster 2021-07-26T16:12:22.542440+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e863: 8 total, 8 up, 8 in 2021-07-26T16:12:23.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[42377]: audit 2021-07-26T16:12:22.546952+0000 mon.c (mon.1) 287 : audit [INF] from='client.? 172.21.15.33:0/234847773' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:23.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[42377]: audit 2021-07-26T16:12:22.548764+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:23.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[42377]: audit 2021-07-26T16:12:22.815016+0000 mon.c (mon.1) 288 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:12:23.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[42377]: audit 2021-07-26T16:12:22.818033+0000 mon.c (mon.1) 289 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:12:23.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[42377]: audit 2021-07-26T16:12:22.820442+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:12:23.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[42377]: audit 2021-07-26T16:12:23.080655+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:12:23.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[41341]: cluster 2021-07-26T16:12:22.542440+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e863: 8 total, 8 up, 8 in 2021-07-26T16:12:23.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[41341]: audit 2021-07-26T16:12:22.546952+0000 mon.c (mon.1) 287 : audit [INF] from='client.? 172.21.15.33:0/234847773' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:23.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[41341]: audit 2021-07-26T16:12:22.548764+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:23.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[41341]: audit 2021-07-26T16:12:22.815016+0000 mon.c (mon.1) 288 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:12:23.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[41341]: audit 2021-07-26T16:12:22.818033+0000 mon.c (mon.1) 289 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:12:23.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[41341]: audit 2021-07-26T16:12:22.820442+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:12:23.961 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:23 smithi033 bash[41341]: audit 2021-07-26T16:12:23.080655+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:12:23.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:23 smithi096 bash[33981]: cluster 2021-07-26T16:12:22.542440+0000 mon.a (mon.0) 1259 : cluster [DBG] osdmap e863: 8 total, 8 up, 8 in 2021-07-26T16:12:23.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:23 smithi096 bash[33981]: audit 2021-07-26T16:12:22.546952+0000 mon.c (mon.1) 287 : audit [INF] from='client.? 172.21.15.33:0/234847773' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:23.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:23 smithi096 bash[33981]: audit 2021-07-26T16:12:22.548764+0000 mon.a (mon.0) 1260 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-5","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:23.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:23 smithi096 bash[33981]: audit 2021-07-26T16:12:22.815016+0000 mon.c (mon.1) 288 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:12:23.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:23 smithi096 bash[33981]: audit 2021-07-26T16:12:22.818033+0000 mon.c (mon.1) 289 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:12:23.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:23 smithi096 bash[33981]: audit 2021-07-26T16:12:22.820442+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:12:23.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:23 smithi096 bash[33981]: audit 2021-07-26T16:12:23.080655+0000 mon.a (mon.0) 1261 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:12:24.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:24 smithi033 bash[42377]: cluster 2021-07-26T16:12:23.254539+0000 mgr.y (mgr.34104) 554 : cluster [DBG] pgmap v1147: 41 pgs: 6 creating+peering, 26 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:24.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:24 smithi033 bash[42377]: audit 2021-07-26T16:12:23.548851+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:24.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:24 smithi033 bash[42377]: cluster 2021-07-26T16:12:23.549666+0000 mon.a (mon.0) 1263 : cluster [DBG] osdmap e864: 8 total, 8 up, 8 in 2021-07-26T16:12:24.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:24 smithi033 bash[41341]: cluster 2021-07-26T16:12:23.254539+0000 mgr.y (mgr.34104) 554 : cluster [DBG] pgmap v1147: 41 pgs: 6 creating+peering, 26 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:24.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:24 smithi033 bash[41341]: audit 2021-07-26T16:12:23.548851+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:24.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:24 smithi033 bash[41341]: cluster 2021-07-26T16:12:23.549666+0000 mon.a (mon.0) 1263 : cluster [DBG] osdmap e864: 8 total, 8 up, 8 in 2021-07-26T16:12:24.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:24 smithi096 bash[33981]: cluster 2021-07-26T16:12:23.254539+0000 mgr.y (mgr.34104) 554 : cluster [DBG] pgmap v1147: 41 pgs: 6 creating+peering, 26 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:24.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:24 smithi096 bash[33981]: audit 2021-07-26T16:12:23.548851+0000 mon.a (mon.0) 1262 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-5","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:24.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:24 smithi096 bash[33981]: cluster 2021-07-26T16:12:23.549666+0000 mon.a (mon.0) 1263 : cluster [DBG] osdmap e864: 8 total, 8 up, 8 in 2021-07-26T16:12:25.590 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.Commit (4066 ms) 2021-07-26T16:12:25.590 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.Abort 2021-07-26T16:12:25.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:25 smithi033 bash[42377]: cluster 2021-07-26T16:12:24.572133+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e865: 8 total, 8 up, 8 in 2021-07-26T16:12:25.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:25 smithi033 bash[41341]: cluster 2021-07-26T16:12:24.572133+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e865: 8 total, 8 up, 8 in 2021-07-26T16:12:25.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:25 smithi096 bash[33981]: cluster 2021-07-26T16:12:24.572133+0000 mon.a (mon.0) 1264 : cluster [DBG] osdmap e865: 8 total, 8 up, 8 in 2021-07-26T16:12:26.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:26 smithi033 bash[41341]: cluster 2021-07-26T16:12:25.255285+0000 mgr.y (mgr.34104) 555 : cluster [DBG] pgmap v1150: 41 pgs: 6 creating+peering, 17 unknown, 18 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:26.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:26 smithi033 bash[41341]: cluster 2021-07-26T16:12:25.582810+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e866: 8 total, 8 up, 8 in 2021-07-26T16:12:26.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:26 smithi033 bash[42377]: cluster 2021-07-26T16:12:25.255285+0000 mgr.y (mgr.34104) 555 : cluster [DBG] pgmap v1150: 41 pgs: 6 creating+peering, 17 unknown, 18 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:26.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:26 smithi033 bash[42377]: cluster 2021-07-26T16:12:25.582810+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e866: 8 total, 8 up, 8 in 2021-07-26T16:12:26.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:26 smithi096 bash[33981]: cluster 2021-07-26T16:12:25.255285+0000 mgr.y (mgr.34104) 555 : cluster [DBG] pgmap v1150: 41 pgs: 6 creating+peering, 17 unknown, 18 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:26.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:26 smithi096 bash[33981]: cluster 2021-07-26T16:12:25.582810+0000 mon.a (mon.0) 1265 : cluster [DBG] osdmap e866: 8 total, 8 up, 8 in 2021-07-26T16:12:27.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:27 smithi033 bash[41341]: cluster 2021-07-26T16:12:26.592049+0000 mon.a (mon.0) 1266 : cluster [DBG] osdmap e867: 8 total, 8 up, 8 in 2021-07-26T16:12:27.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:27 smithi033 bash[41341]: audit 2021-07-26T16:12:26.596437+0000 mon.c (mon.1) 291 : audit [INF] from='client.? 172.21.15.33:0/4237605754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:27.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:27 smithi033 bash[41341]: audit 2021-07-26T16:12:26.605742+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:27.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:27 smithi033 bash[41341]: audit 2021-07-26T16:12:27.592770+0000 mon.a (mon.0) 1268 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:27.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:27 smithi033 bash[41341]: cluster 2021-07-26T16:12:27.592979+0000 mon.a (mon.0) 1269 : cluster [DBG] osdmap e868: 8 total, 8 up, 8 in 2021-07-26T16:12:27.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:27 smithi033 bash[42377]: cluster 2021-07-26T16:12:26.592049+0000 mon.a (mon.0) 1266 : cluster [DBG] osdmap e867: 8 total, 8 up, 8 in 2021-07-26T16:12:27.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:27 smithi033 bash[42377]: audit 2021-07-26T16:12:26.596437+0000 mon.c (mon.1) 291 : audit [INF] from='client.? 172.21.15.33:0/4237605754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:27.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:27 smithi033 bash[42377]: audit 2021-07-26T16:12:26.605742+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:27.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:27 smithi033 bash[42377]: audit 2021-07-26T16:12:27.592770+0000 mon.a (mon.0) 1268 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:27.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:27 smithi033 bash[42377]: cluster 2021-07-26T16:12:27.592979+0000 mon.a (mon.0) 1269 : cluster [DBG] osdmap e868: 8 total, 8 up, 8 in 2021-07-26T16:12:27.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:27 smithi096 bash[33981]: cluster 2021-07-26T16:12:26.592049+0000 mon.a (mon.0) 1266 : cluster [DBG] osdmap e867: 8 total, 8 up, 8 in 2021-07-26T16:12:27.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:27 smithi096 bash[33981]: audit 2021-07-26T16:12:26.596437+0000 mon.c (mon.1) 291 : audit [INF] from='client.? 172.21.15.33:0/4237605754' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:27.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:27 smithi096 bash[33981]: audit 2021-07-26T16:12:26.605742+0000 mon.a (mon.0) 1267 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-6","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:27.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:27 smithi096 bash[33981]: audit 2021-07-26T16:12:27.592770+0000 mon.a (mon.0) 1268 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-6","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:27.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:27 smithi096 bash[33981]: cluster 2021-07-26T16:12:27.592979+0000 mon.a (mon.0) 1269 : cluster [DBG] osdmap e868: 8 total, 8 up, 8 in 2021-07-26T16:12:28.603 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.Abort (3011 ms) 2021-07-26T16:12:28.603 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2021-07-26T16:12:28.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:28 smithi033 bash[41341]: cluster 2021-07-26T16:12:27.255994+0000 mgr.y (mgr.34104) 556 : cluster [DBG] pgmap v1153: 41 pgs: 7 creating+peering, 25 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:28.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:28 smithi033 bash[41341]: cluster 2021-07-26T16:12:28.596426+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e869: 8 total, 8 up, 8 in 2021-07-26T16:12:28.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:28 smithi033 bash[42377]: cluster 2021-07-26T16:12:27.255994+0000 mgr.y (mgr.34104) 556 : cluster [DBG] pgmap v1153: 41 pgs: 7 creating+peering, 25 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:28.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:28 smithi033 bash[42377]: cluster 2021-07-26T16:12:28.596426+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e869: 8 total, 8 up, 8 in 2021-07-26T16:12:28.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:28 smithi096 bash[33981]: cluster 2021-07-26T16:12:27.255994+0000 mgr.y (mgr.34104) 556 : cluster [DBG] pgmap v1153: 41 pgs: 7 creating+peering, 25 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:28.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:28 smithi096 bash[33981]: cluster 2021-07-26T16:12:28.596426+0000 mon.a (mon.0) 1270 : cluster [DBG] osdmap e869: 8 total, 8 up, 8 in 2021-07-26T16:12:30.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:30 smithi033 bash[41341]: cluster 2021-07-26T16:12:29.256610+0000 mgr.y (mgr.34104) 557 : cluster [DBG] pgmap v1156: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:30.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:30 smithi033 bash[41341]: cluster 2021-07-26T16:12:29.633678+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e870: 8 total, 8 up, 8 in 2021-07-26T16:12:30.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:30 smithi033 bash[41341]: audit 2021-07-26T16:12:29.640473+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:30.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:30 smithi033 bash[41341]: audit 2021-07-26T16:12:29.642872+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.33:0/265000132' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:30.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:30 smithi033 bash[42377]: cluster 2021-07-26T16:12:29.256610+0000 mgr.y (mgr.34104) 557 : cluster [DBG] pgmap v1156: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:30.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:30 smithi033 bash[42377]: cluster 2021-07-26T16:12:29.633678+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e870: 8 total, 8 up, 8 in 2021-07-26T16:12:30.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:30 smithi033 bash[42377]: audit 2021-07-26T16:12:29.640473+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:30.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:30 smithi033 bash[42377]: audit 2021-07-26T16:12:29.642872+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.33:0/265000132' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:30.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:30 smithi096 bash[33981]: cluster 2021-07-26T16:12:29.256610+0000 mgr.y (mgr.34104) 557 : cluster [DBG] pgmap v1156: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:30.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:30 smithi096 bash[33981]: cluster 2021-07-26T16:12:29.633678+0000 mon.a (mon.0) 1271 : cluster [DBG] osdmap e870: 8 total, 8 up, 8 in 2021-07-26T16:12:30.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:30 smithi096 bash[33981]: audit 2021-07-26T16:12:29.640473+0000 mon.a (mon.0) 1272 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:30.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:30 smithi096 bash[33981]: audit 2021-07-26T16:12:29.642872+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.33:0/265000132' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-7","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:31.662 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.ReserveError (3060 ms) 2021-07-26T16:12:31.663 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.CommitError 2021-07-26T16:12:31.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:31 smithi033 bash[41341]: audit 2021-07-26T16:12:30.636104+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:31.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:31 smithi033 bash[41341]: cluster 2021-07-26T16:12:30.636392+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e871: 8 total, 8 up, 8 in 2021-07-26T16:12:31.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:31 smithi033 bash[42377]: audit 2021-07-26T16:12:30.636104+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:31.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:31 smithi033 bash[42377]: cluster 2021-07-26T16:12:30.636392+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e871: 8 total, 8 up, 8 in 2021-07-26T16:12:31.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:31 smithi096 bash[33981]: audit 2021-07-26T16:12:30.636104+0000 mon.a (mon.0) 1273 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-7","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:31.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:31 smithi096 bash[33981]: cluster 2021-07-26T16:12:30.636392+0000 mon.a (mon.0) 1274 : cluster [DBG] osdmap e871: 8 total, 8 up, 8 in 2021-07-26T16:12:32.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:32 smithi033 bash[42377]: cluster 2021-07-26T16:12:31.257281+0000 mgr.y (mgr.34104) 558 : cluster [DBG] pgmap v1159: 41 pgs: 6 creating+peering, 21 unknown, 14 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:32.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:32 smithi033 bash[42377]: cluster 2021-07-26T16:12:31.656312+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e872: 8 total, 8 up, 8 in 2021-07-26T16:12:32.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:32 smithi033 bash[41341]: cluster 2021-07-26T16:12:31.257281+0000 mgr.y (mgr.34104) 558 : cluster [DBG] pgmap v1159: 41 pgs: 6 creating+peering, 21 unknown, 14 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:32.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:32 smithi033 bash[41341]: cluster 2021-07-26T16:12:31.656312+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e872: 8 total, 8 up, 8 in 2021-07-26T16:12:32.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:32 smithi096 bash[33981]: cluster 2021-07-26T16:12:31.257281+0000 mgr.y (mgr.34104) 558 : cluster [DBG] pgmap v1159: 41 pgs: 6 creating+peering, 21 unknown, 14 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:32.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:32 smithi096 bash[33981]: cluster 2021-07-26T16:12:31.656312+0000 mon.a (mon.0) 1275 : cluster [DBG] osdmap e872: 8 total, 8 up, 8 in 2021-07-26T16:12:33.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:33 smithi033 bash[42377]: cluster 2021-07-26T16:12:32.670207+0000 mon.a (mon.0) 1276 : cluster [DBG] osdmap e873: 8 total, 8 up, 8 in 2021-07-26T16:12:33.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:33 smithi033 bash[42377]: audit 2021-07-26T16:12:32.671700+0000 mon.c (mon.1) 292 : audit [INF] from='client.? 172.21.15.33:0/3954887846' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:33.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:33 smithi033 bash[42377]: audit 2021-07-26T16:12:32.673453+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:33.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:33 smithi033 bash[41341]: cluster 2021-07-26T16:12:32.670207+0000 mon.a (mon.0) 1276 : cluster [DBG] osdmap e873: 8 total, 8 up, 8 in 2021-07-26T16:12:33.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:33 smithi033 bash[41341]: audit 2021-07-26T16:12:32.671700+0000 mon.c (mon.1) 292 : audit [INF] from='client.? 172.21.15.33:0/3954887846' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:33.960 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:33 smithi033 bash[41341]: audit 2021-07-26T16:12:32.673453+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:33.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:33 smithi096 bash[33981]: cluster 2021-07-26T16:12:32.670207+0000 mon.a (mon.0) 1276 : cluster [DBG] osdmap e873: 8 total, 8 up, 8 in 2021-07-26T16:12:33.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:33 smithi096 bash[33981]: audit 2021-07-26T16:12:32.671700+0000 mon.c (mon.1) 292 : audit [INF] from='client.? 172.21.15.33:0/3954887846' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:33.985 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:33 smithi096 bash[33981]: audit 2021-07-26T16:12:32.673453+0000 mon.a (mon.0) 1277 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-8","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:34.701 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.CommitError (3039 ms) 2021-07-26T16:12:34.701 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.AbortError 2021-07-26T16:12:34.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:34 smithi033 bash[41341]: cluster 2021-07-26T16:12:33.258010+0000 mgr.y (mgr.34104) 559 : cluster [DBG] pgmap v1162: 41 pgs: 4 creating+peering, 28 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:34.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:34 smithi033 bash[41341]: audit 2021-07-26T16:12:33.676918+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:34.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:34 smithi033 bash[41341]: cluster 2021-07-26T16:12:33.677623+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e874: 8 total, 8 up, 8 in 2021-07-26T16:12:34.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:34 smithi033 bash[42377]: cluster 2021-07-26T16:12:33.258010+0000 mgr.y (mgr.34104) 559 : cluster [DBG] pgmap v1162: 41 pgs: 4 creating+peering, 28 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:34.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:34 smithi033 bash[42377]: audit 2021-07-26T16:12:33.676918+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:34.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:34 smithi033 bash[42377]: cluster 2021-07-26T16:12:33.677623+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e874: 8 total, 8 up, 8 in 2021-07-26T16:12:34.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:34 smithi096 bash[33981]: cluster 2021-07-26T16:12:33.258010+0000 mgr.y (mgr.34104) 559 : cluster [DBG] pgmap v1162: 41 pgs: 4 creating+peering, 28 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:34.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:34 smithi096 bash[33981]: audit 2021-07-26T16:12:33.676918+0000 mon.a (mon.0) 1278 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-8","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:34.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:34 smithi096 bash[33981]: cluster 2021-07-26T16:12:33.677623+0000 mon.a (mon.0) 1279 : cluster [DBG] osdmap e874: 8 total, 8 up, 8 in 2021-07-26T16:12:35.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:35 smithi033 bash[41341]: cluster 2021-07-26T16:12:34.696139+0000 mon.a (mon.0) 1280 : cluster [DBG] osdmap e875: 8 total, 8 up, 8 in 2021-07-26T16:12:35.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:35 smithi033 bash[42377]: cluster 2021-07-26T16:12:34.696139+0000 mon.a (mon.0) 1280 : cluster [DBG] osdmap e875: 8 total, 8 up, 8 in 2021-07-26T16:12:35.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:35 smithi096 bash[33981]: cluster 2021-07-26T16:12:34.696139+0000 mon.a (mon.0) 1280 : cluster [DBG] osdmap e875: 8 total, 8 up, 8 in 2021-07-26T16:12:36.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:36 smithi033 bash[41341]: cluster 2021-07-26T16:12:35.258679+0000 mgr.y (mgr.34104) 560 : cluster [DBG] pgmap v1165: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:36.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:36 smithi033 bash[41341]: cluster 2021-07-26T16:12:35.707196+0000 mon.a (mon.0) 1281 : cluster [DBG] osdmap e876: 8 total, 8 up, 8 in 2021-07-26T16:12:36.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:36 smithi033 bash[41341]: audit 2021-07-26T16:12:35.714869+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? 172.21.15.33:0/262285777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:36.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:36 smithi033 bash[42377]: cluster 2021-07-26T16:12:35.258679+0000 mgr.y (mgr.34104) 560 : cluster [DBG] pgmap v1165: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:36.959 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:36 smithi033 bash[42377]: cluster 2021-07-26T16:12:35.707196+0000 mon.a (mon.0) 1281 : cluster [DBG] osdmap e876: 8 total, 8 up, 8 in 2021-07-26T16:12:36.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:36 smithi033 bash[42377]: audit 2021-07-26T16:12:35.714869+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? 172.21.15.33:0/262285777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:36.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:36 smithi096 bash[33981]: cluster 2021-07-26T16:12:35.258679+0000 mgr.y (mgr.34104) 560 : cluster [DBG] pgmap v1165: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:36.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:36 smithi096 bash[33981]: cluster 2021-07-26T16:12:35.707196+0000 mon.a (mon.0) 1281 : cluster [DBG] osdmap e876: 8 total, 8 up, 8 in 2021-07-26T16:12:36.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:36 smithi096 bash[33981]: audit 2021-07-26T16:12:35.714869+0000 mon.a (mon.0) 1282 : audit [INF] from='client.? 172.21.15.33:0/262285777' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-9","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:37.737 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.AbortError (3036 ms) 2021-07-26T16:12:37.737 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2021-07-26T16:12:37.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:37 smithi096 bash[33981]: audit 2021-07-26T16:12:36.719713+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? 172.21.15.33:0/262285777' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:37.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:37 smithi096 bash[33981]: cluster 2021-07-26T16:12:36.720105+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e877: 8 total, 8 up, 8 in 2021-07-26T16:12:38.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:37 smithi033 bash[42377]: audit 2021-07-26T16:12:36.719713+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? 172.21.15.33:0/262285777' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:38.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:37 smithi033 bash[42377]: cluster 2021-07-26T16:12:36.720105+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e877: 8 total, 8 up, 8 in 2021-07-26T16:12:38.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:37 smithi033 bash[41341]: audit 2021-07-26T16:12:36.719713+0000 mon.a (mon.0) 1283 : audit [INF] from='client.? 172.21.15.33:0/262285777' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-9","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:38.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:37 smithi033 bash[41341]: cluster 2021-07-26T16:12:36.720105+0000 mon.a (mon.0) 1284 : cluster [DBG] osdmap e877: 8 total, 8 up, 8 in 2021-07-26T16:12:39.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:38 smithi033 bash[41341]: cluster 2021-07-26T16:12:37.259511+0000 mgr.y (mgr.34104) 561 : cluster [DBG] pgmap v1168: 41 pgs: 5 creating+peering, 12 unknown, 24 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 8.5 KiB/s wr, 17 op/s 2021-07-26T16:12:39.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:38 smithi033 bash[41341]: cluster 2021-07-26T16:12:37.733079+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e878: 8 total, 8 up, 8 in 2021-07-26T16:12:39.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:38 smithi033 bash[42377]: cluster 2021-07-26T16:12:37.259511+0000 mgr.y (mgr.34104) 561 : cluster [DBG] pgmap v1168: 41 pgs: 5 creating+peering, 12 unknown, 24 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 8.5 KiB/s wr, 17 op/s 2021-07-26T16:12:39.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:38 smithi033 bash[42377]: cluster 2021-07-26T16:12:37.733079+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e878: 8 total, 8 up, 8 in 2021-07-26T16:12:39.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:38 smithi096 bash[33981]: cluster 2021-07-26T16:12:37.259511+0000 mgr.y (mgr.34104) 561 : cluster [DBG] pgmap v1168: 41 pgs: 5 creating+peering, 12 unknown, 24 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 8.7 KiB/s rd, 8.5 KiB/s wr, 17 op/s 2021-07-26T16:12:39.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:38 smithi096 bash[33981]: cluster 2021-07-26T16:12:37.733079+0000 mon.a (mon.0) 1285 : cluster [DBG] osdmap e878: 8 total, 8 up, 8 in 2021-07-26T16:12:40.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:39 smithi033 bash[41341]: cluster 2021-07-26T16:12:38.739257+0000 mon.a (mon.0) 1286 : cluster [DBG] osdmap e879: 8 total, 8 up, 8 in 2021-07-26T16:12:40.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:39 smithi033 bash[41341]: audit 2021-07-26T16:12:38.740935+0000 mon.c (mon.1) 293 : audit [INF] from='client.? 172.21.15.33:0/1357015527' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:40.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:39 smithi033 bash[41341]: audit 2021-07-26T16:12:38.741882+0000 mon.a (mon.0) 1287 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:40.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:39 smithi033 bash[41341]: audit 2021-07-26T16:12:39.739888+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:40.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:39 smithi033 bash[41341]: cluster 2021-07-26T16:12:39.740364+0000 mon.a (mon.0) 1289 : cluster [DBG] osdmap e880: 8 total, 8 up, 8 in 2021-07-26T16:12:40.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:39 smithi033 bash[42377]: cluster 2021-07-26T16:12:38.739257+0000 mon.a (mon.0) 1286 : cluster [DBG] osdmap e879: 8 total, 8 up, 8 in 2021-07-26T16:12:40.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:39 smithi033 bash[42377]: audit 2021-07-26T16:12:38.740935+0000 mon.c (mon.1) 293 : audit [INF] from='client.? 172.21.15.33:0/1357015527' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:40.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:39 smithi033 bash[42377]: audit 2021-07-26T16:12:38.741882+0000 mon.a (mon.0) 1287 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:40.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:39 smithi033 bash[42377]: audit 2021-07-26T16:12:39.739888+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:40.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:39 smithi033 bash[42377]: cluster 2021-07-26T16:12:39.740364+0000 mon.a (mon.0) 1289 : cluster [DBG] osdmap e880: 8 total, 8 up, 8 in 2021-07-26T16:12:40.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:39 smithi096 bash[33981]: cluster 2021-07-26T16:12:38.739257+0000 mon.a (mon.0) 1286 : cluster [DBG] osdmap e879: 8 total, 8 up, 8 in 2021-07-26T16:12:40.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:39 smithi096 bash[33981]: audit 2021-07-26T16:12:38.740935+0000 mon.c (mon.1) 293 : audit [INF] from='client.? 172.21.15.33:0/1357015527' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:40.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:39 smithi096 bash[33981]: audit 2021-07-26T16:12:38.741882+0000 mon.a (mon.0) 1287 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-10","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:40.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:39 smithi096 bash[33981]: audit 2021-07-26T16:12:39.739888+0000 mon.a (mon.0) 1288 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-10","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:40.235 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:39 smithi096 bash[33981]: cluster 2021-07-26T16:12:39.740364+0000 mon.a (mon.0) 1289 : cluster [DBG] osdmap e880: 8 total, 8 up, 8 in 2021-07-26T16:12:40.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3013 ms) 2021-07-26T16:12:40.750 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2021-07-26T16:12:41.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:40 smithi033 bash[41341]: cluster 2021-07-26T16:12:39.260221+0000 mgr.y (mgr.34104) 562 : cluster [DBG] pgmap v1171: 41 pgs: 6 creating+peering, 26 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:41.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:40 smithi033 bash[41341]: cluster 2021-07-26T16:12:40.741623+0000 mon.a (mon.0) 1290 : cluster [DBG] osdmap e881: 8 total, 8 up, 8 in 2021-07-26T16:12:41.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:40 smithi033 bash[42377]: cluster 2021-07-26T16:12:39.260221+0000 mgr.y (mgr.34104) 562 : cluster [DBG] pgmap v1171: 41 pgs: 6 creating+peering, 26 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:41.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:40 smithi033 bash[42377]: cluster 2021-07-26T16:12:40.741623+0000 mon.a (mon.0) 1290 : cluster [DBG] osdmap e881: 8 total, 8 up, 8 in 2021-07-26T16:12:41.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:40 smithi096 bash[33981]: cluster 2021-07-26T16:12:39.260221+0000 mgr.y (mgr.34104) 562 : cluster [DBG] pgmap v1171: 41 pgs: 6 creating+peering, 26 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:41.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:40 smithi096 bash[33981]: cluster 2021-07-26T16:12:40.741623+0000 mon.a (mon.0) 1290 : cluster [DBG] osdmap e881: 8 total, 8 up, 8 in 2021-07-26T16:12:43.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:42 smithi033 bash[41341]: cluster 2021-07-26T16:12:41.260858+0000 mgr.y (mgr.34104) 563 : cluster [DBG] pgmap v1174: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:43.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:42 smithi033 bash[41341]: cluster 2021-07-26T16:12:41.782861+0000 mon.a (mon.0) 1291 : cluster [DBG] osdmap e882: 8 total, 8 up, 8 in 2021-07-26T16:12:43.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:42 smithi033 bash[41341]: audit 2021-07-26T16:12:41.786283+0000 mon.c (mon.1) 294 : audit [INF] from='client.? 172.21.15.33:0/3352385421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:43.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:42 smithi033 bash[41341]: audit 2021-07-26T16:12:41.787178+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:43.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:42 smithi033 bash[42377]: cluster 2021-07-26T16:12:41.260858+0000 mgr.y (mgr.34104) 563 : cluster [DBG] pgmap v1174: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:43.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:42 smithi033 bash[42377]: cluster 2021-07-26T16:12:41.782861+0000 mon.a (mon.0) 1291 : cluster [DBG] osdmap e882: 8 total, 8 up, 8 in 2021-07-26T16:12:43.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:42 smithi033 bash[42377]: audit 2021-07-26T16:12:41.786283+0000 mon.c (mon.1) 294 : audit [INF] from='client.? 172.21.15.33:0/3352385421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:43.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:42 smithi033 bash[42377]: audit 2021-07-26T16:12:41.787178+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:43.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:42 smithi096 bash[33981]: cluster 2021-07-26T16:12:41.260858+0000 mgr.y (mgr.34104) 563 : cluster [DBG] pgmap v1174: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:43.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:42 smithi096 bash[33981]: cluster 2021-07-26T16:12:41.782861+0000 mon.a (mon.0) 1291 : cluster [DBG] osdmap e882: 8 total, 8 up, 8 in 2021-07-26T16:12:43.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:42 smithi096 bash[33981]: audit 2021-07-26T16:12:41.786283+0000 mon.c (mon.1) 294 : audit [INF] from='client.? 172.21.15.33:0/3352385421' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:43.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:42 smithi096 bash[33981]: audit 2021-07-26T16:12:41.787178+0000 mon.a (mon.0) 1292 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-11","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:43.813 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3060 ms) 2021-07-26T16:12:43.814 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2021-07-26T16:12:44.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:43 smithi033 bash[41341]: audit 2021-07-26T16:12:42.786514+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:44.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:43 smithi033 bash[41341]: cluster 2021-07-26T16:12:42.788090+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e883: 8 total, 8 up, 8 in 2021-07-26T16:12:44.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:43 smithi033 bash[42377]: audit 2021-07-26T16:12:42.786514+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:44.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:43 smithi033 bash[42377]: cluster 2021-07-26T16:12:42.788090+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e883: 8 total, 8 up, 8 in 2021-07-26T16:12:44.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:43 smithi096 bash[33981]: audit 2021-07-26T16:12:42.786514+0000 mon.a (mon.0) 1293 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-11","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:44.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:43 smithi096 bash[33981]: cluster 2021-07-26T16:12:42.788090+0000 mon.a (mon.0) 1294 : cluster [DBG] osdmap e883: 8 total, 8 up, 8 in 2021-07-26T16:12:45.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:44 smithi033 bash[41341]: cluster 2021-07-26T16:12:43.261449+0000 mgr.y (mgr.34104) 564 : cluster [DBG] pgmap v1177: 41 pgs: 14 creating+peering, 16 unknown, 11 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:45.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:44 smithi033 bash[41341]: cluster 2021-07-26T16:12:43.802752+0000 mon.a (mon.0) 1295 : cluster [DBG] osdmap e884: 8 total, 8 up, 8 in 2021-07-26T16:12:45.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:44 smithi033 bash[42377]: cluster 2021-07-26T16:12:43.261449+0000 mgr.y (mgr.34104) 564 : cluster [DBG] pgmap v1177: 41 pgs: 14 creating+peering, 16 unknown, 11 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:45.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:44 smithi033 bash[42377]: cluster 2021-07-26T16:12:43.802752+0000 mon.a (mon.0) 1295 : cluster [DBG] osdmap e884: 8 total, 8 up, 8 in 2021-07-26T16:12:45.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:44 smithi096 bash[33981]: cluster 2021-07-26T16:12:43.261449+0000 mgr.y (mgr.34104) 564 : cluster [DBG] pgmap v1177: 41 pgs: 14 creating+peering, 16 unknown, 11 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:45.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:44 smithi096 bash[33981]: cluster 2021-07-26T16:12:43.802752+0000 mon.a (mon.0) 1295 : cluster [DBG] osdmap e884: 8 total, 8 up, 8 in 2021-07-26T16:12:46.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:45 smithi033 bash[41341]: cluster 2021-07-26T16:12:44.819066+0000 mon.a (mon.0) 1296 : cluster [DBG] osdmap e885: 8 total, 8 up, 8 in 2021-07-26T16:12:46.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:45 smithi033 bash[41341]: audit 2021-07-26T16:12:44.821385+0000 mon.a (mon.0) 1297 : audit [INF] from='client.? 172.21.15.33:0/650506730' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:46.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:45 smithi033 bash[41341]: cluster 2021-07-26T16:12:45.262228+0000 mgr.y (mgr.34104) 565 : cluster [DBG] pgmap v1180: 41 pgs: 3 creating+peering, 29 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:46.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:45 smithi033 bash[42377]: cluster 2021-07-26T16:12:44.819066+0000 mon.a (mon.0) 1296 : cluster [DBG] osdmap e885: 8 total, 8 up, 8 in 2021-07-26T16:12:46.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:45 smithi033 bash[42377]: audit 2021-07-26T16:12:44.821385+0000 mon.a (mon.0) 1297 : audit [INF] from='client.? 172.21.15.33:0/650506730' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:46.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:45 smithi033 bash[42377]: cluster 2021-07-26T16:12:45.262228+0000 mgr.y (mgr.34104) 565 : cluster [DBG] pgmap v1180: 41 pgs: 3 creating+peering, 29 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:46.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:45 smithi096 bash[33981]: cluster 2021-07-26T16:12:44.819066+0000 mon.a (mon.0) 1296 : cluster [DBG] osdmap e885: 8 total, 8 up, 8 in 2021-07-26T16:12:46.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:45 smithi096 bash[33981]: audit 2021-07-26T16:12:44.821385+0000 mon.a (mon.0) 1297 : audit [INF] from='client.? 172.21.15.33:0/650506730' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-12","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:46.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:45 smithi096 bash[33981]: cluster 2021-07-26T16:12:45.262228+0000 mgr.y (mgr.34104) 565 : cluster [DBG] pgmap v1180: 41 pgs: 3 creating+peering, 29 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:46.840 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3031 ms) 2021-07-26T16:12:46.841 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2021-07-26T16:12:47.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:46 smithi033 bash[41341]: audit 2021-07-26T16:12:45.823187+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? 172.21.15.33:0/650506730' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:47.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:46 smithi033 bash[41341]: cluster 2021-07-26T16:12:45.823592+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e886: 8 total, 8 up, 8 in 2021-07-26T16:12:47.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:46 smithi033 bash[42377]: audit 2021-07-26T16:12:45.823187+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? 172.21.15.33:0/650506730' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:47.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:46 smithi033 bash[42377]: cluster 2021-07-26T16:12:45.823592+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e886: 8 total, 8 up, 8 in 2021-07-26T16:12:47.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:46 smithi096 bash[33981]: audit 2021-07-26T16:12:45.823187+0000 mon.a (mon.0) 1298 : audit [INF] from='client.? 172.21.15.33:0/650506730' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-12","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:47.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:46 smithi096 bash[33981]: cluster 2021-07-26T16:12:45.823592+0000 mon.a (mon.0) 1299 : cluster [DBG] osdmap e886: 8 total, 8 up, 8 in 2021-07-26T16:12:48.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:47 smithi033 bash[42377]: cluster 2021-07-26T16:12:46.834447+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e887: 8 total, 8 up, 8 in 2021-07-26T16:12:48.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:47 smithi033 bash[42377]: cluster 2021-07-26T16:12:47.262844+0000 mgr.y (mgr.34104) 566 : cluster [DBG] pgmap v1183: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:48.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:47 smithi033 bash[41341]: cluster 2021-07-26T16:12:46.834447+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e887: 8 total, 8 up, 8 in 2021-07-26T16:12:48.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:47 smithi033 bash[41341]: cluster 2021-07-26T16:12:47.262844+0000 mgr.y (mgr.34104) 566 : cluster [DBG] pgmap v1183: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:48.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:47 smithi096 bash[33981]: cluster 2021-07-26T16:12:46.834447+0000 mon.a (mon.0) 1300 : cluster [DBG] osdmap e887: 8 total, 8 up, 8 in 2021-07-26T16:12:48.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:47 smithi096 bash[33981]: cluster 2021-07-26T16:12:47.262844+0000 mgr.y (mgr.34104) 566 : cluster [DBG] pgmap v1183: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:49.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:48 smithi033 bash[41341]: cluster 2021-07-26T16:12:47.857696+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e888: 8 total, 8 up, 8 in 2021-07-26T16:12:49.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:48 smithi033 bash[41341]: audit 2021-07-26T16:12:47.859818+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? 172.21.15.33:0/2654973027' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:49.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:48 smithi033 bash[42377]: cluster 2021-07-26T16:12:47.857696+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e888: 8 total, 8 up, 8 in 2021-07-26T16:12:49.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:48 smithi033 bash[42377]: audit 2021-07-26T16:12:47.859818+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? 172.21.15.33:0/2654973027' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:49.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:48 smithi096 bash[33981]: cluster 2021-07-26T16:12:47.857696+0000 mon.a (mon.0) 1301 : cluster [DBG] osdmap e888: 8 total, 8 up, 8 in 2021-07-26T16:12:49.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:48 smithi096 bash[33981]: audit 2021-07-26T16:12:47.859818+0000 mon.a (mon.0) 1302 : audit [INF] from='client.? 172.21.15.33:0/2654973027' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-13","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:49.883 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3040 ms) 2021-07-26T16:12:49.883 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2021-07-26T16:12:50.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:49 smithi033 bash[41341]: audit 2021-07-26T16:12:48.861784+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? 172.21.15.33:0/2654973027' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:50.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:49 smithi033 bash[41341]: cluster 2021-07-26T16:12:48.862438+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e889: 8 total, 8 up, 8 in 2021-07-26T16:12:50.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:49 smithi033 bash[41341]: cluster 2021-07-26T16:12:49.263699+0000 mgr.y (mgr.34104) 567 : cluster [DBG] pgmap v1186: 41 pgs: 4 creating+peering, 16 unknown, 21 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:50.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:49 smithi033 bash[42377]: audit 2021-07-26T16:12:48.861784+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? 172.21.15.33:0/2654973027' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:50.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:49 smithi033 bash[42377]: cluster 2021-07-26T16:12:48.862438+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e889: 8 total, 8 up, 8 in 2021-07-26T16:12:50.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:49 smithi033 bash[42377]: cluster 2021-07-26T16:12:49.263699+0000 mgr.y (mgr.34104) 567 : cluster [DBG] pgmap v1186: 41 pgs: 4 creating+peering, 16 unknown, 21 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:50.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:49 smithi096 bash[33981]: audit 2021-07-26T16:12:48.861784+0000 mon.a (mon.0) 1303 : audit [INF] from='client.? 172.21.15.33:0/2654973027' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-13","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:50.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:49 smithi096 bash[33981]: cluster 2021-07-26T16:12:48.862438+0000 mon.a (mon.0) 1304 : cluster [DBG] osdmap e889: 8 total, 8 up, 8 in 2021-07-26T16:12:50.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:49 smithi096 bash[33981]: cluster 2021-07-26T16:12:49.263699+0000 mgr.y (mgr.34104) 567 : cluster [DBG] pgmap v1186: 41 pgs: 4 creating+peering, 16 unknown, 21 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:51.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:50 smithi033 bash[41341]: cluster 2021-07-26T16:12:49.874278+0000 mon.a (mon.0) 1305 : cluster [DBG] osdmap e890: 8 total, 8 up, 8 in 2021-07-26T16:12:51.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:50 smithi033 bash[42377]: cluster 2021-07-26T16:12:49.874278+0000 mon.a (mon.0) 1305 : cluster [DBG] osdmap e890: 8 total, 8 up, 8 in 2021-07-26T16:12:51.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:50 smithi096 bash[33981]: cluster 2021-07-26T16:12:49.874278+0000 mon.a (mon.0) 1305 : cluster [DBG] osdmap e890: 8 total, 8 up, 8 in 2021-07-26T16:12:52.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:51 smithi033 bash[41341]: cluster 2021-07-26T16:12:50.898541+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e891: 8 total, 8 up, 8 in 2021-07-26T16:12:52.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:51 smithi033 bash[41341]: audit 2021-07-26T16:12:50.905558+0000 mon.a (mon.0) 1307 : audit [INF] from='client.? 172.21.15.33:0/924618965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:52.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:51 smithi033 bash[41341]: cluster 2021-07-26T16:12:51.264417+0000 mgr.y (mgr.34104) 568 : cluster [DBG] pgmap v1189: 41 pgs: 3 creating+peering, 29 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:52.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:51 smithi033 bash[42377]: cluster 2021-07-26T16:12:50.898541+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e891: 8 total, 8 up, 8 in 2021-07-26T16:12:52.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:51 smithi033 bash[42377]: audit 2021-07-26T16:12:50.905558+0000 mon.a (mon.0) 1307 : audit [INF] from='client.? 172.21.15.33:0/924618965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:52.210 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:51 smithi033 bash[42377]: cluster 2021-07-26T16:12:51.264417+0000 mgr.y (mgr.34104) 568 : cluster [DBG] pgmap v1189: 41 pgs: 3 creating+peering, 29 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:52.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:51 smithi096 bash[33981]: cluster 2021-07-26T16:12:50.898541+0000 mon.a (mon.0) 1306 : cluster [DBG] osdmap e891: 8 total, 8 up, 8 in 2021-07-26T16:12:52.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:51 smithi096 bash[33981]: audit 2021-07-26T16:12:50.905558+0000 mon.a (mon.0) 1307 : audit [INF] from='client.? 172.21.15.33:0/924618965' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-14","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:52.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:51 smithi096 bash[33981]: cluster 2021-07-26T16:12:51.264417+0000 mgr.y (mgr.34104) 568 : cluster [DBG] pgmap v1189: 41 pgs: 3 creating+peering, 29 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:52.930 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3049 ms) 2021-07-26T16:12:52.930 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2021-07-26T16:12:53.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:52 smithi033 bash[41341]: audit 2021-07-26T16:12:51.910957+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? 172.21.15.33:0/924618965' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:53.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:52 smithi033 bash[41341]: cluster 2021-07-26T16:12:51.911136+0000 mon.a (mon.0) 1309 : cluster [DBG] osdmap e892: 8 total, 8 up, 8 in 2021-07-26T16:12:53.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:52 smithi033 bash[42377]: audit 2021-07-26T16:12:51.910957+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? 172.21.15.33:0/924618965' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:53.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:52 smithi033 bash[42377]: cluster 2021-07-26T16:12:51.911136+0000 mon.a (mon.0) 1309 : cluster [DBG] osdmap e892: 8 total, 8 up, 8 in 2021-07-26T16:12:53.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:52 smithi096 bash[33981]: audit 2021-07-26T16:12:51.910957+0000 mon.a (mon.0) 1308 : audit [INF] from='client.? 172.21.15.33:0/924618965' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-14","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:53.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:52 smithi096 bash[33981]: cluster 2021-07-26T16:12:51.911136+0000 mon.a (mon.0) 1309 : cluster [DBG] osdmap e892: 8 total, 8 up, 8 in 2021-07-26T16:12:54.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:53 smithi033 bash[41341]: cluster 2021-07-26T16:12:52.920240+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e893: 8 total, 8 up, 8 in 2021-07-26T16:12:54.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:53 smithi033 bash[41341]: cluster 2021-07-26T16:12:53.264982+0000 mgr.y (mgr.34104) 569 : cluster [DBG] pgmap v1192: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:54.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:53 smithi033 bash[42377]: cluster 2021-07-26T16:12:52.920240+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e893: 8 total, 8 up, 8 in 2021-07-26T16:12:54.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:53 smithi033 bash[42377]: cluster 2021-07-26T16:12:53.264982+0000 mgr.y (mgr.34104) 569 : cluster [DBG] pgmap v1192: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:54.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:53 smithi096 bash[33981]: cluster 2021-07-26T16:12:52.920240+0000 mon.a (mon.0) 1310 : cluster [DBG] osdmap e893: 8 total, 8 up, 8 in 2021-07-26T16:12:54.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:53 smithi096 bash[33981]: cluster 2021-07-26T16:12:53.264982+0000 mgr.y (mgr.34104) 569 : cluster [DBG] pgmap v1192: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:55.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:54 smithi033 bash[42377]: cluster 2021-07-26T16:12:53.935870+0000 mon.a (mon.0) 1311 : cluster [DBG] osdmap e894: 8 total, 8 up, 8 in 2021-07-26T16:12:55.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:54 smithi033 bash[42377]: audit 2021-07-26T16:12:53.937462+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? 172.21.15.33:0/898273570' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:55.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:54 smithi033 bash[41341]: cluster 2021-07-26T16:12:53.935870+0000 mon.a (mon.0) 1311 : cluster [DBG] osdmap e894: 8 total, 8 up, 8 in 2021-07-26T16:12:55.209 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:54 smithi033 bash[41341]: audit 2021-07-26T16:12:53.937462+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? 172.21.15.33:0/898273570' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:55.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:54 smithi096 bash[33981]: cluster 2021-07-26T16:12:53.935870+0000 mon.a (mon.0) 1311 : cluster [DBG] osdmap e894: 8 total, 8 up, 8 in 2021-07-26T16:12:55.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:54 smithi096 bash[33981]: audit 2021-07-26T16:12:53.937462+0000 mon.a (mon.0) 1312 : audit [INF] from='client.? 172.21.15.33:0/898273570' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-15","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:55.969 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3040 ms) 2021-07-26T16:12:55.970 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2021-07-26T16:12:56.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:55 smithi033 bash[41341]: audit 2021-07-26T16:12:54.938929+0000 mon.a (mon.0) 1313 : audit [INF] from='client.? 172.21.15.33:0/898273570' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:56.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:55 smithi033 bash[41341]: cluster 2021-07-26T16:12:54.939569+0000 mon.a (mon.0) 1314 : cluster [DBG] osdmap e895: 8 total, 8 up, 8 in 2021-07-26T16:12:56.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:55 smithi033 bash[41341]: cluster 2021-07-26T16:12:55.265363+0000 mgr.y (mgr.34104) 570 : cluster [DBG] pgmap v1195: 41 pgs: 12 creating+peering, 20 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:56.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:55 smithi033 bash[42377]: audit 2021-07-26T16:12:54.938929+0000 mon.a (mon.0) 1313 : audit [INF] from='client.? 172.21.15.33:0/898273570' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:56.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:55 smithi033 bash[42377]: cluster 2021-07-26T16:12:54.939569+0000 mon.a (mon.0) 1314 : cluster [DBG] osdmap e895: 8 total, 8 up, 8 in 2021-07-26T16:12:56.209 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:55 smithi033 bash[42377]: cluster 2021-07-26T16:12:55.265363+0000 mgr.y (mgr.34104) 570 : cluster [DBG] pgmap v1195: 41 pgs: 12 creating+peering, 20 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:56.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:55 smithi096 bash[33981]: audit 2021-07-26T16:12:54.938929+0000 mon.a (mon.0) 1313 : audit [INF] from='client.? 172.21.15.33:0/898273570' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-15","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:56.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:55 smithi096 bash[33981]: cluster 2021-07-26T16:12:54.939569+0000 mon.a (mon.0) 1314 : cluster [DBG] osdmap e895: 8 total, 8 up, 8 in 2021-07-26T16:12:56.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:55 smithi096 bash[33981]: cluster 2021-07-26T16:12:55.265363+0000 mgr.y (mgr.34104) 570 : cluster [DBG] pgmap v1195: 41 pgs: 12 creating+peering, 20 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:57.208 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:56 smithi033 bash[41341]: cluster 2021-07-26T16:12:55.960883+0000 mon.a (mon.0) 1315 : cluster [DBG] osdmap e896: 8 total, 8 up, 8 in 2021-07-26T16:12:57.208 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:56 smithi033 bash[42377]: cluster 2021-07-26T16:12:55.960883+0000 mon.a (mon.0) 1315 : cluster [DBG] osdmap e896: 8 total, 8 up, 8 in 2021-07-26T16:12:57.234 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:56 smithi096 bash[33981]: cluster 2021-07-26T16:12:55.960883+0000 mon.a (mon.0) 1315 : cluster [DBG] osdmap e896: 8 total, 8 up, 8 in 2021-07-26T16:12:58.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:57 smithi033 bash[41341]: cluster 2021-07-26T16:12:56.970476+0000 mon.a (mon.0) 1316 : cluster [DBG] osdmap e897: 8 total, 8 up, 8 in 2021-07-26T16:12:58.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:57 smithi033 bash[41341]: audit 2021-07-26T16:12:56.972669+0000 mon.c (mon.1) 295 : audit [INF] from='client.? 172.21.15.33:0/3593757602' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:58.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:57 smithi033 bash[41341]: audit 2021-07-26T16:12:56.974578+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:58.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:57 smithi033 bash[41341]: cluster 2021-07-26T16:12:57.265988+0000 mgr.y (mgr.34104) 571 : cluster [DBG] pgmap v1198: 41 pgs: 4 creating+peering, 28 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:58.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:57 smithi033 bash[42377]: cluster 2021-07-26T16:12:56.970476+0000 mon.a (mon.0) 1316 : cluster [DBG] osdmap e897: 8 total, 8 up, 8 in 2021-07-26T16:12:58.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:57 smithi033 bash[42377]: audit 2021-07-26T16:12:56.972669+0000 mon.c (mon.1) 295 : audit [INF] from='client.? 172.21.15.33:0/3593757602' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:58.460 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:57 smithi033 bash[42377]: audit 2021-07-26T16:12:56.974578+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:58.461 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:57 smithi033 bash[42377]: cluster 2021-07-26T16:12:57.265988+0000 mgr.y (mgr.34104) 571 : cluster [DBG] pgmap v1198: 41 pgs: 4 creating+peering, 28 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:58.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:57 smithi096 bash[33981]: cluster 2021-07-26T16:12:56.970476+0000 mon.a (mon.0) 1316 : cluster [DBG] osdmap e897: 8 total, 8 up, 8 in 2021-07-26T16:12:58.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:57 smithi096 bash[33981]: audit 2021-07-26T16:12:56.972669+0000 mon.c (mon.1) 295 : audit [INF] from='client.? 172.21.15.33:0/3593757602' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:58.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:57 smithi096 bash[33981]: audit 2021-07-26T16:12:56.974578+0000 mon.a (mon.0) 1317 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-16","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:12:58.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:57 smithi096 bash[33981]: cluster 2021-07-26T16:12:57.265988+0000 mgr.y (mgr.34104) 571 : cluster [DBG] pgmap v1198: 41 pgs: 4 creating+peering, 28 unknown, 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:12:59.005 INFO:tasks.workunit.client.0.smithi033.stdout:[ OK ] TestCls2PCQueue.Cleanup (3036 ms) 2021-07-26T16:12:59.006 INFO:tasks.workunit.client.0.smithi033.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2021-07-26T16:12:59.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:58 smithi033 bash[42377]: audit 2021-07-26T16:12:57.973039+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:59.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:12:58 smithi033 bash[42377]: cluster 2021-07-26T16:12:57.973286+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e898: 8 total, 8 up, 8 in 2021-07-26T16:12:59.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:58 smithi033 bash[41341]: audit 2021-07-26T16:12:57.973039+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:59.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:12:58 smithi033 bash[41341]: cluster 2021-07-26T16:12:57.973286+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e898: 8 total, 8 up, 8 in 2021-07-26T16:12:59.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:58 smithi096 bash[33981]: audit 2021-07-26T16:12:57.973039+0000 mon.a (mon.0) 1318 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-16","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:12:59.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:12:58 smithi096 bash[33981]: cluster 2021-07-26T16:12:57.973286+0000 mon.a (mon.0) 1319 : cluster [DBG] osdmap e898: 8 total, 8 up, 8 in 2021-07-26T16:13:00.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:00 smithi033 bash[41341]: cluster 2021-07-26T16:12:58.997466+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e899: 8 total, 8 up, 8 in 2021-07-26T16:13:00.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:00 smithi033 bash[41341]: cluster 2021-07-26T16:12:59.266567+0000 mgr.y (mgr.34104) 572 : cluster [DBG] pgmap v1201: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:13:00.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:00 smithi033 bash[42377]: cluster 2021-07-26T16:12:58.997466+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e899: 8 total, 8 up, 8 in 2021-07-26T16:13:00.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:00 smithi033 bash[42377]: cluster 2021-07-26T16:12:59.266567+0000 mgr.y (mgr.34104) 572 : cluster [DBG] pgmap v1201: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:13:00.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:00 smithi096 bash[33981]: cluster 2021-07-26T16:12:58.997466+0000 mon.a (mon.0) 1320 : cluster [DBG] osdmap e899: 8 total, 8 up, 8 in 2021-07-26T16:13:00.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:00 smithi096 bash[33981]: cluster 2021-07-26T16:12:59.266567+0000 mgr.y (mgr.34104) 572 : cluster [DBG] pgmap v1201: 9 pgs: 9 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:13:01.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:01 smithi033 bash[42377]: cluster 2021-07-26T16:13:00.014647+0000 mon.a (mon.0) 1321 : cluster [DBG] osdmap e900: 8 total, 8 up, 8 in 2021-07-26T16:13:01.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:01 smithi033 bash[42377]: audit 2021-07-26T16:13:00.016316+0000 mon.c (mon.1) 296 : audit [INF] from='client.? 172.21.15.33:0/3731105957' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:13:01.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:01 smithi033 bash[42377]: audit 2021-07-26T16:13:00.017831+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:13:01.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:01 smithi033 bash[41341]: cluster 2021-07-26T16:13:00.014647+0000 mon.a (mon.0) 1321 : cluster [DBG] osdmap e900: 8 total, 8 up, 8 in 2021-07-26T16:13:01.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:01 smithi033 bash[41341]: audit 2021-07-26T16:13:00.016316+0000 mon.c (mon.1) 296 : audit [INF] from='client.? 172.21.15.33:0/3731105957' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:13:01.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:01 smithi033 bash[41341]: audit 2021-07-26T16:13:00.017831+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:13:01.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:01 smithi096 bash[33981]: cluster 2021-07-26T16:13:00.014647+0000 mon.a (mon.0) 1321 : cluster [DBG] osdmap e900: 8 total, 8 up, 8 in 2021-07-26T16:13:01.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:01 smithi096 bash[33981]: audit 2021-07-26T16:13:00.016316+0000 mon.c (mon.1) 296 : audit [INF] from='client.? 172.21.15.33:0/3731105957' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:13:01.485 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:01 smithi096 bash[33981]: audit 2021-07-26T16:13:00.017831+0000 mon.a (mon.0) 1322 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-17","app": "rados","yes_i_really_mean_it": true}]: dispatch 2021-07-26T16:13:02.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:02 smithi033 bash[41341]: audit 2021-07-26T16:13:01.015773+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:13:02.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:02 smithi033 bash[41341]: cluster 2021-07-26T16:13:01.016130+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e901: 8 total, 8 up, 8 in 2021-07-26T16:13:02.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:02 smithi033 bash[41341]: cluster 2021-07-26T16:13:01.267222+0000 mgr.y (mgr.34104) 573 : cluster [DBG] pgmap v1204: 41 pgs: 4 creating+peering, 25 unknown, 12 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:13:02.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:02 smithi033 bash[42377]: audit 2021-07-26T16:13:01.015773+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:13:02.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:02 smithi033 bash[42377]: cluster 2021-07-26T16:13:01.016130+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e901: 8 total, 8 up, 8 in 2021-07-26T16:13:02.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:02 smithi033 bash[42377]: cluster 2021-07-26T16:13:01.267222+0000 mgr.y (mgr.34104) 573 : cluster [DBG] pgmap v1204: 41 pgs: 4 creating+peering, 25 unknown, 12 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:13:02.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:02 smithi096 bash[33981]: audit 2021-07-26T16:13:01.015773+0000 mon.a (mon.0) 1323 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test-rados-api-smithi033-52385-17","app": "rados","yes_i_really_mean_it": true}]': finished 2021-07-26T16:13:02.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:02 smithi096 bash[33981]: cluster 2021-07-26T16:13:01.016130+0000 mon.a (mon.0) 1324 : cluster [DBG] osdmap e901: 8 total, 8 up, 8 in 2021-07-26T16:13:02.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:02 smithi096 bash[33981]: cluster 2021-07-26T16:13:01.267222+0000 mgr.y (mgr.34104) 573 : cluster [DBG] pgmap v1204: 41 pgs: 4 creating+peering, 25 unknown, 12 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:13:03.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:03 smithi033 bash[42377]: cluster 2021-07-26T16:13:02.030376+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e902: 8 total, 8 up, 8 in 2021-07-26T16:13:03.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:03 smithi033 bash[41341]: cluster 2021-07-26T16:13:02.030376+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e902: 8 total, 8 up, 8 in 2021-07-26T16:13:03.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:03 smithi096 bash[33981]: cluster 2021-07-26T16:13:02.030376+0000 mon.a (mon.0) 1325 : cluster [DBG] osdmap e902: 8 total, 8 up, 8 in 2021-07-26T16:13:04.458 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:04 smithi033 bash[41341]: cluster 2021-07-26T16:13:03.267953+0000 mgr.y (mgr.34104) 574 : cluster [DBG] pgmap v1206: 41 pgs: 4 creating+peering, 12 unknown, 25 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:13:04.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:04 smithi033 bash[42377]: cluster 2021-07-26T16:13:03.267953+0000 mgr.y (mgr.34104) 574 : cluster [DBG] pgmap v1206: 41 pgs: 4 creating+peering, 12 unknown, 25 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:13:04.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:04 smithi096 bash[33981]: cluster 2021-07-26T16:13:03.267953+0000 mgr.y (mgr.34104) 574 : cluster [DBG] pgmap v1206: 41 pgs: 4 creating+peering, 12 unknown, 25 active+clean; 577 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail 2021-07-26T16:13:06.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:06 smithi033 bash[41341]: cluster 2021-07-26T16:13:05.268713+0000 mgr.y (mgr.34104) 575 : cluster [DBG] pgmap v1207: 41 pgs: 4 creating+peering, 37 active+clean; 954 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 247 KiB/s rd, 2.5 MiB/s wr, 2.85k op/s 2021-07-26T16:13:06.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:06 smithi033 bash[42377]: cluster 2021-07-26T16:13:05.268713+0000 mgr.y (mgr.34104) 575 : cluster [DBG] pgmap v1207: 41 pgs: 4 creating+peering, 37 active+clean; 954 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 247 KiB/s rd, 2.5 MiB/s wr, 2.85k op/s 2021-07-26T16:13:06.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:06 smithi096 bash[33981]: cluster 2021-07-26T16:13:05.268713+0000 mgr.y (mgr.34104) 575 : cluster [DBG] pgmap v1207: 41 pgs: 4 creating+peering, 37 active+clean; 954 KiB data, 2.9 GiB used, 712 GiB / 715 GiB avail; 247 KiB/s rd, 2.5 MiB/s wr, 2.85k op/s 2021-07-26T16:13:08.708 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:08 smithi033 bash[42377]: cluster 2021-07-26T16:13:07.269569+0000 mgr.y (mgr.34104) 576 : cluster [DBG] pgmap v1208: 41 pgs: 41 active+clean; 954 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 205 KiB/s rd, 2.1 MiB/s wr, 2.35k op/s 2021-07-26T16:13:08.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:08 smithi033 bash[41341]: cluster 2021-07-26T16:13:07.269569+0000 mgr.y (mgr.34104) 576 : cluster [DBG] pgmap v1208: 41 pgs: 41 active+clean; 954 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 205 KiB/s rd, 2.1 MiB/s wr, 2.35k op/s 2021-07-26T16:13:08.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:08 smithi096 bash[33981]: cluster 2021-07-26T16:13:07.269569+0000 mgr.y (mgr.34104) 576 : cluster [DBG] pgmap v1208: 41 pgs: 41 active+clean; 954 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 205 KiB/s rd, 2.1 MiB/s wr, 2.35k op/s 2021-07-26T16:13:09.708 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.015199+0000 mon.c (mon.1) 297 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.9", "id": [7, 0]}]: dispatch 2021-07-26T16:13:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.015753+0000 mon.c (mon.1) 298 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.c", "id": [7, 5]}]: dispatch 2021-07-26T16:13:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.016081+0000 mon.c (mon.1) 299 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1e", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.709 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.016147+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.9", "id": [7, 0]}]: dispatch 2021-07-26T16:13:09.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.016538+0000 mon.c (mon.1) 300 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1f", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.017333+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.c", "id": [7, 5]}]: dispatch 2021-07-26T16:13:09.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.017848+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1e", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.710 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.018363+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1f", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.277131+0000 mon.c (mon.1) 301 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:13:09.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.277826+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:13:09.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.301351+0000 mon.c (mon.1) 302 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:13:09.711 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[41341]: audit 2021-07-26T16:13:09.302234+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:13:09.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.015199+0000 mon.c (mon.1) 297 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.9", "id": [7, 0]}]: dispatch 2021-07-26T16:13:09.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.015753+0000 mon.c (mon.1) 298 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.c", "id": [7, 5]}]: dispatch 2021-07-26T16:13:09.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.016081+0000 mon.c (mon.1) 299 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1e", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.016147+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.9", "id": [7, 0]}]: dispatch 2021-07-26T16:13:09.712 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.016538+0000 mon.c (mon.1) 300 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1f", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.017333+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.c", "id": [7, 5]}]: dispatch 2021-07-26T16:13:09.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.017848+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1e", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.018363+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1f", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.713 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.277131+0000 mon.c (mon.1) 301 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:13:09.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.277826+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:13:09.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.301351+0000 mon.c (mon.1) 302 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:13:09.714 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:09 smithi033 bash[42377]: audit 2021-07-26T16:13:09.302234+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:13:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.015199+0000 mon.c (mon.1) 297 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.9", "id": [7, 0]}]: dispatch 2021-07-26T16:13:09.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.015753+0000 mon.c (mon.1) 298 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.c", "id": [7, 5]}]: dispatch 2021-07-26T16:13:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.016081+0000 mon.c (mon.1) 299 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1e", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.016147+0000 mon.a (mon.0) 1326 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.9", "id": [7, 0]}]: dispatch 2021-07-26T16:13:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.016538+0000 mon.c (mon.1) 300 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1f", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.017333+0000 mon.a (mon.0) 1327 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.c", "id": [7, 5]}]: dispatch 2021-07-26T16:13:09.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.017848+0000 mon.a (mon.0) 1328 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1e", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.018363+0000 mon.a (mon.0) 1329 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1f", "id": [7, 4]}]: dispatch 2021-07-26T16:13:09.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.277131+0000 mon.c (mon.1) 301 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:13:09.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.277826+0000 mon.a (mon.0) 1330 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-07-26T16:13:09.736 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.301351+0000 mon.c (mon.1) 302 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:13:09.737 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:09 smithi096 bash[33981]: audit 2021-07-26T16:13:09.302234+0000 mon.a (mon.0) 1331 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-07-26T16:13:10.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:10 smithi096 bash[33981]: cluster 2021-07-26T16:13:09.270312+0000 mgr.y (mgr.34104) 577 : cluster [DBG] pgmap v1209: 41 pgs: 41 active+clean; 954 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 180 KiB/s rd, 1.8 MiB/s wr, 2.07k op/s 2021-07-26T16:13:10.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:10 smithi096 bash[33981]: audit 2021-07-26T16:13:09.457758+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.9", "id": [7, 0]}]': finished 2021-07-26T16:13:10.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:10 smithi096 bash[33981]: audit 2021-07-26T16:13:09.457884+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.c", "id": [7, 5]}]': finished 2021-07-26T16:13:10.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:10 smithi096 bash[33981]: audit 2021-07-26T16:13:09.458009+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1e", "id": [7, 4]}]': finished 2021-07-26T16:13:10.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:10 smithi096 bash[33981]: audit 2021-07-26T16:13:09.458240+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1f", "id": [7, 4]}]': finished 2021-07-26T16:13:10.735 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:10 smithi096 bash[33981]: cluster 2021-07-26T16:13:09.458359+0000 mon.a (mon.0) 1336 : cluster [DBG] osdmap e903: 8 total, 8 up, 8 in 2021-07-26T16:13:10.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[41341]: cluster 2021-07-26T16:13:09.270312+0000 mgr.y (mgr.34104) 577 : cluster [DBG] pgmap v1209: 41 pgs: 41 active+clean; 954 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 180 KiB/s rd, 1.8 MiB/s wr, 2.07k op/s 2021-07-26T16:13:10.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[41341]: audit 2021-07-26T16:13:09.457758+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.9", "id": [7, 0]}]': finished 2021-07-26T16:13:10.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[41341]: audit 2021-07-26T16:13:09.457884+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.c", "id": [7, 5]}]': finished 2021-07-26T16:13:10.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[41341]: audit 2021-07-26T16:13:09.458009+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1e", "id": [7, 4]}]': finished 2021-07-26T16:13:10.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[41341]: audit 2021-07-26T16:13:09.458240+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1f", "id": [7, 4]}]': finished 2021-07-26T16:13:10.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[41341]: cluster 2021-07-26T16:13:09.458359+0000 mon.a (mon.0) 1336 : cluster [DBG] osdmap e903: 8 total, 8 up, 8 in 2021-07-26T16:13:10.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[42377]: cluster 2021-07-26T16:13:09.270312+0000 mgr.y (mgr.34104) 577 : cluster [DBG] pgmap v1209: 41 pgs: 41 active+clean; 954 KiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 180 KiB/s rd, 1.8 MiB/s wr, 2.07k op/s 2021-07-26T16:13:10.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[42377]: audit 2021-07-26T16:13:09.457758+0000 mon.a (mon.0) 1332 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.9", "id": [7, 0]}]': finished 2021-07-26T16:13:10.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[42377]: audit 2021-07-26T16:13:09.457884+0000 mon.a (mon.0) 1333 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.c", "id": [7, 5]}]': finished 2021-07-26T16:13:10.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[42377]: audit 2021-07-26T16:13:09.458009+0000 mon.a (mon.0) 1334 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1e", "id": [7, 4]}]': finished 2021-07-26T16:13:10.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[42377]: audit 2021-07-26T16:13:09.458240+0000 mon.a (mon.0) 1335 : audit [INF] from='mgr.34104 ' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "20.1f", "id": [7, 4]}]': finished 2021-07-26T16:13:10.961 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:10 smithi033 bash[42377]: cluster 2021-07-26T16:13:09.458359+0000 mon.a (mon.0) 1336 : cluster [DBG] osdmap e903: 8 total, 8 up, 8 in 2021-07-26T16:13:11.734 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:11 smithi096 bash[33981]: cluster 2021-07-26T16:13:10.459003+0000 mon.a (mon.0) 1337 : cluster [DBG] osdmap e904: 8 total, 8 up, 8 in 2021-07-26T16:13:11.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:11 smithi033 bash[41341]: cluster 2021-07-26T16:13:10.459003+0000 mon.a (mon.0) 1337 : cluster [DBG] osdmap e904: 8 total, 8 up, 8 in 2021-07-26T16:13:11.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:11 smithi033 bash[42377]: cluster 2021-07-26T16:13:10.459003+0000 mon.a (mon.0) 1337 : cluster [DBG] osdmap e904: 8 total, 8 up, 8 in 2021-07-26T16:13:12.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:12 smithi033 bash[41341]: cluster 2021-07-26T16:13:11.270996+0000 mgr.y (mgr.34104) 578 : cluster [DBG] pgmap v1212: 41 pgs: 41 active+clean; 1.3 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 391 KiB/s rd, 4.0 MiB/s wr, 4.49k op/s 2021-07-26T16:13:12.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:12 smithi033 bash[42377]: cluster 2021-07-26T16:13:11.270996+0000 mgr.y (mgr.34104) 578 : cluster [DBG] pgmap v1212: 41 pgs: 41 active+clean; 1.3 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 391 KiB/s rd, 4.0 MiB/s wr, 4.49k op/s 2021-07-26T16:13:12.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:12 smithi096 bash[33981]: cluster 2021-07-26T16:13:11.270996+0000 mgr.y (mgr.34104) 578 : cluster [DBG] pgmap v1212: 41 pgs: 41 active+clean; 1.3 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 391 KiB/s rd, 4.0 MiB/s wr, 4.49k op/s 2021-07-26T16:13:14.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:14 smithi033 bash[41341]: cluster 2021-07-26T16:13:13.272221+0000 mgr.y (mgr.34104) 579 : cluster [DBG] pgmap v1213: 41 pgs: 41 active+clean; 1.3 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 205 KiB/s rd, 2.1 MiB/s wr, 2.35k op/s 2021-07-26T16:13:14.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:14 smithi033 bash[42377]: cluster 2021-07-26T16:13:13.272221+0000 mgr.y (mgr.34104) 579 : cluster [DBG] pgmap v1213: 41 pgs: 41 active+clean; 1.3 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 205 KiB/s rd, 2.1 MiB/s wr, 2.35k op/s 2021-07-26T16:13:14.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:14 smithi096 bash[33981]: cluster 2021-07-26T16:13:13.272221+0000 mgr.y (mgr.34104) 579 : cluster [DBG] pgmap v1213: 41 pgs: 41 active+clean; 1.3 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 205 KiB/s rd, 2.1 MiB/s wr, 2.35k op/s 2021-07-26T16:13:16.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:16 smithi033 bash[41341]: cluster 2021-07-26T16:13:15.273022+0000 mgr.y (mgr.34104) 580 : cluster [DBG] pgmap v1214: 41 pgs: 41 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 384 KiB/s rd, 3.9 MiB/s wr, 4.41k op/s 2021-07-26T16:13:16.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:16 smithi033 bash[42377]: cluster 2021-07-26T16:13:15.273022+0000 mgr.y (mgr.34104) 580 : cluster [DBG] pgmap v1214: 41 pgs: 41 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 384 KiB/s rd, 3.9 MiB/s wr, 4.41k op/s 2021-07-26T16:13:16.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:16 smithi096 bash[33981]: cluster 2021-07-26T16:13:15.273022+0000 mgr.y (mgr.34104) 580 : cluster [DBG] pgmap v1214: 41 pgs: 41 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 384 KiB/s rd, 3.9 MiB/s wr, 4.41k op/s 2021-07-26T16:13:18.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:18 smithi033 bash[41341]: cluster 2021-07-26T16:13:17.273753+0000 mgr.y (mgr.34104) 581 : cluster [DBG] pgmap v1215: 41 pgs: 41 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 384 KiB/s rd, 3.9 MiB/s wr, 4.41k op/s 2021-07-26T16:13:18.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:18 smithi033 bash[42377]: cluster 2021-07-26T16:13:17.273753+0000 mgr.y (mgr.34104) 581 : cluster [DBG] pgmap v1215: 41 pgs: 41 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 384 KiB/s rd, 3.9 MiB/s wr, 4.41k op/s 2021-07-26T16:13:18.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:18 smithi096 bash[33981]: cluster 2021-07-26T16:13:17.273753+0000 mgr.y (mgr.34104) 581 : cluster [DBG] pgmap v1215: 41 pgs: 41 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 384 KiB/s rd, 3.9 MiB/s wr, 4.41k op/s 2021-07-26T16:13:20.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:20 smithi033 bash[42377]: cluster 2021-07-26T16:13:19.274509+0000 mgr.y (mgr.34104) 582 : cluster [DBG] pgmap v1216: 41 pgs: 41 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 313 KiB/s rd, 3.2 MiB/s wr, 3.60k op/s 2021-07-26T16:13:20.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:20 smithi033 bash[41341]: cluster 2021-07-26T16:13:19.274509+0000 mgr.y (mgr.34104) 582 : cluster [DBG] pgmap v1216: 41 pgs: 41 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 313 KiB/s rd, 3.2 MiB/s wr, 3.60k op/s 2021-07-26T16:13:20.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:20 smithi096 bash[33981]: cluster 2021-07-26T16:13:19.274509+0000 mgr.y (mgr.34104) 582 : cluster [DBG] pgmap v1216: 41 pgs: 41 active+clean; 1.7 MiB data, 3.0 GiB used, 712 GiB / 715 GiB avail; 313 KiB/s rd, 3.2 MiB/s wr, 3.60k op/s 2021-07-26T16:13:22.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:22 smithi033 bash[42377]: cluster 2021-07-26T16:13:21.275377+0000 mgr.y (mgr.34104) 583 : cluster [DBG] pgmap v1217: 41 pgs: 41 active+clean; 2.0 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 251 KiB/s rd, 2.6 MiB/s wr, 2.88k op/s 2021-07-26T16:13:22.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:22 smithi033 bash[41341]: cluster 2021-07-26T16:13:21.275377+0000 mgr.y (mgr.34104) 583 : cluster [DBG] pgmap v1217: 41 pgs: 41 active+clean; 2.0 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 251 KiB/s rd, 2.6 MiB/s wr, 2.88k op/s 2021-07-26T16:13:22.986 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:22 smithi096 bash[33981]: cluster 2021-07-26T16:13:21.275377+0000 mgr.y (mgr.34104) 583 : cluster [DBG] pgmap v1217: 41 pgs: 41 active+clean; 2.0 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 251 KiB/s rd, 2.6 MiB/s wr, 2.88k op/s 2021-07-26T16:13:23.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:23 smithi033 bash[41341]: audit 2021-07-26T16:13:23.087167+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:13:23.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:23 smithi033 bash[41341]: audit 2021-07-26T16:13:23.090329+0000 mon.c (mon.1) 304 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:13:23.959 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:23 smithi033 bash[41341]: audit 2021-07-26T16:13:23.092960+0000 mon.c (mon.1) 305 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:13:23.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:23 smithi033 bash[42377]: audit 2021-07-26T16:13:23.087167+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:13:23.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:23 smithi033 bash[42377]: audit 2021-07-26T16:13:23.090329+0000 mon.c (mon.1) 304 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:13:23.960 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:23 smithi033 bash[42377]: audit 2021-07-26T16:13:23.092960+0000 mon.c (mon.1) 305 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:13:23.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:23 smithi096 bash[33981]: audit 2021-07-26T16:13:23.087167+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2021-07-26T16:13:23.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:23 smithi096 bash[33981]: audit 2021-07-26T16:13:23.090329+0000 mon.c (mon.1) 304 : audit [DBG] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-07-26T16:13:23.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:23 smithi096 bash[33981]: audit 2021-07-26T16:13:23.092960+0000 mon.c (mon.1) 305 : audit [INF] from='mgr.34104 172.21.15.33:0/3356360471' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2021-07-26T16:13:24.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:24 smithi033 bash[42377]: cluster 2021-07-26T16:13:23.276097+0000 mgr.y (mgr.34104) 584 : cluster [DBG] pgmap v1218: 41 pgs: 41 active+clean; 2.0 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 226 KiB/s rd, 2.3 MiB/s wr, 2.60k op/s 2021-07-26T16:13:24.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:24 smithi033 bash[41341]: cluster 2021-07-26T16:13:23.276097+0000 mgr.y (mgr.34104) 584 : cluster [DBG] pgmap v1218: 41 pgs: 41 active+clean; 2.0 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 226 KiB/s rd, 2.3 MiB/s wr, 2.60k op/s 2021-07-26T16:13:24.984 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:24 smithi096 bash[33981]: cluster 2021-07-26T16:13:23.276097+0000 mgr.y (mgr.34104) 584 : cluster [DBG] pgmap v1218: 41 pgs: 41 active+clean; 2.0 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 226 KiB/s rd, 2.3 MiB/s wr, 2.60k op/s 2021-07-26T16:13:26.532 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:26 smithi096 bash[33981]: cluster 2021-07-26T16:13:25.277069+0000 mgr.y (mgr.34104) 585 : cluster [DBG] pgmap v1219: 41 pgs: 41 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 324 KiB/s rd, 3.3 MiB/s wr, 3.72k op/s 2021-07-26T16:13:26.958 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:26 smithi033 bash[41341]: cluster 2021-07-26T16:13:25.277069+0000 mgr.y (mgr.34104) 585 : cluster [DBG] pgmap v1219: 41 pgs: 41 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 324 KiB/s rd, 3.3 MiB/s wr, 3.72k op/s 2021-07-26T16:13:26.958 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:26 smithi033 bash[42377]: cluster 2021-07-26T16:13:25.277069+0000 mgr.y (mgr.34104) 585 : cluster [DBG] pgmap v1219: 41 pgs: 41 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 324 KiB/s rd, 3.3 MiB/s wr, 3.72k op/s 2021-07-26T16:13:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:28 smithi033 bash[42377]: audit 2021-07-26T16:13:27.124926+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:13:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:28 smithi033 bash[42377]: cluster 2021-07-26T16:13:27.277871+0000 mgr.y (mgr.34104) 586 : cluster [DBG] pgmap v1220: 41 pgs: 41 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 204 KiB/s rd, 2.1 MiB/s wr, 2.35k op/s 2021-07-26T16:13:28.458 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:28 smithi033 bash[42377]: audit 2021-07-26T16:13:27.449931+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:13:28.459 INFO:journalctl@ceph.mon.c.smithi033.stdout:Jul 26 16:13:28 smithi033 bash[42377]: audit 2021-07-26T16:13:27.718038+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:13:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:28 smithi033 bash[41341]: audit 2021-07-26T16:13:27.124926+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:13:28.459 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:28 smithi033 bash[41341]: cluster 2021-07-26T16:13:27.277871+0000 mgr.y (mgr.34104) 586 : cluster [DBG] pgmap v1220: 41 pgs: 41 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 204 KiB/s rd, 2.1 MiB/s wr, 2.35k op/s 2021-07-26T16:13:28.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:28 smithi033 bash[41341]: audit 2021-07-26T16:13:27.449931+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:13:28.460 INFO:journalctl@ceph.mon.a.smithi033.stdout:Jul 26 16:13:28 smithi033 bash[41341]: audit 2021-07-26T16:13:27.718038+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:13:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:28 smithi096 bash[33981]: audit 2021-07-26T16:13:27.124926+0000 mon.a (mon.0) 1338 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:13:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:28 smithi096 bash[33981]: cluster 2021-07-26T16:13:27.277871+0000 mgr.y (mgr.34104) 586 : cluster [DBG] pgmap v1220: 41 pgs: 41 active+clean; 2.3 MiB data, 3.1 GiB used, 712 GiB / 715 GiB avail; 204 KiB/s rd, 2.1 MiB/s wr, 2.35k op/s 2021-07-26T16:13:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:28 smithi096 bash[33981]: audit 2021-07-26T16:13:27.449931+0000 mon.a (mon.0) 1339 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:13:28.484 INFO:journalctl@ceph.mon.b.smithi096.stdout:Jul 26 16:13:28 smithi096 bash[33981]: audit 2021-07-26T16:13:27.718038+0000 mon.a (mon.0) 1340 : audit [INF] from='mgr.34104 ' entity='mgr.y' 2021-07-26T16:13:30.282 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-07-26T16:13:30.283 DEBUG:teuthology.task.console_log:Killing console logger for smithi033 2021-07-26T16:13:30.284 DEBUG:teuthology.task.console_log:Killing console logger for smithi096 2021-07-26T16:13:30.284 DEBUG:teuthology.exit:Finished running handlers